2023-12-12T11:20:48.513 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-12T11:20:48.513 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488285 --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --verbose --owner mchangir --name mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi -- /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488285/orig.config.yaml 2023-12-12T11:20:48.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T11:20:48.646 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488285 branch: wip-mchangir-testing-20231205.064351 description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: mchangir@redhat.com first_in_suite: false job_id: '7488285' kernel: flavor: default kdb: true sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-mchangir-testing-20231205.064351 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-testing-20231205.064351 sha1: f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 owner: mchangir priority: 1000 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 5473 sha1: f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 sleep_before_teardown: 0 subset: 600/1024 suite: fs suite_branch: wip-mchangir-testing-20231205.064351 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 targets: smithi063.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO01mRfwTFnLLqpMz4MuaRzsiv6dXKVKV2kivOnL3uTufca4/qmQSZUKBAsM9tCPrdRGR6Y+tef4W9ku/7awxQg= smithi093.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNlaUBOyZRqFYnKLb8cCpbp8FibGz4MHdMFP2RQvBvGPhp3k/CYweWfdGRsm3qM0cMrdk+DHYtdnI9VQ+yyzCfA= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /cephfs/home/mchangir/src/git.ceph.com_ceph-c_wip-mchangir-testing-20231205.064351/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-12_08:46:52 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2023-12-12T11:20:48.646 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa; will attempt to use it 2023-12-12T11:20:48.647 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks 2023-12-12T11:20:48.647 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-12T11:20:48.649 INFO:teuthology.task.internal:Checking packages... 2023-12-12T11:20:48.673 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9' 2023-12-12T11:20:48.673 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-12T11:20:48.673 INFO:teuthology.packaging:ref: None 2023-12-12T11:20:48.673 INFO:teuthology.packaging:tag: None 2023-12-12T11:20:48.673 INFO:teuthology.packaging:branch: wip-mchangir-testing-20231205.064351 2023-12-12T11:20:48.673 INFO:teuthology.packaging:sha1: f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 2023-12-12T11:20:48.673 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-mchangir-testing-20231205.064351 2023-12-12T11:20:48.819 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-96.gf1fbf3c5 2023-12-12T11:20:48.820 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-12T11:20:48.825 INFO:teuthology.task.internal:no buildpackages task found 2023-12-12T11:20:48.825 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-12T11:20:48.846 INFO:teuthology.task.internal:Saving configuration 2023-12-12T11:20:48.868 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-12T11:20:48.874 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-12T11:20:48.900 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi063.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488285', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 11:15:41.206340', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO01mRfwTFnLLqpMz4MuaRzsiv6dXKVKV2kivOnL3uTufca4/qmQSZUKBAsM9tCPrdRGR6Y+tef4W9ku/7awxQg='} 2023-12-12T11:20:48.922 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488285', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 11:15:41.207694', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNlaUBOyZRqFYnKLb8cCpbp8FibGz4MHdMFP2RQvBvGPhp3k/CYweWfdGRsm3qM0cMrdk+DHYtdnI9VQ+yyzCfA='} 2023-12-12T11:20:48.922 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-12T11:20:48.930 INFO:teuthology.task.internal:roles: ubuntu@smithi063.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2023-12-12T11:20:48.930 INFO:teuthology.task.internal:roles: ubuntu@smithi093.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2023-12-12T11:20:48.930 INFO:teuthology.run_tasks:Running task console_log... 2023-12-12T11:20:48.999 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff907532e50>, signals=[15]) 2023-12-12T11:20:48.999 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-12T11:20:49.005 INFO:teuthology.task.internal:Opening connections... 2023-12-12T11:20:49.005 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi063.front.sepia.ceph.com 2023-12-12T11:20:49.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:20:49.080 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi093.front.sepia.ceph.com 2023-12-12T11:20:49.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:20:49.150 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-12T11:20:49.157 DEBUG:teuthology.orchestra.run.smithi063:> uname -m 2023-12-12T11:20:49.181 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64 2023-12-12T11:20:49.181 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2023-12-12T11:20:49.244 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="CentOS Stream" 2023-12-12T11:20:49.244 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="8" 2023-12-12T11:20:49.244 INFO:teuthology.orchestra.run.smithi063.stdout:ID="centos" 2023-12-12T11:20:49.244 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="rhel fedora" 2023-12-12T11:20:49.244 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="8" 2023-12-12T11:20:49.244 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el8" 2023-12-12T11:20:49.244 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-12T11:20:49.244 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31" 2023-12-12T11:20:49.244 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-12T11:20:49.244 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://centos.org/" 2023-12-12T11:20:49.244 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-12T11:20:49.244 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-12T11:20:49.244 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-12T11:20:49.245 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2023-12-12T11:20:49.267 DEBUG:teuthology.orchestra.run.smithi093:> uname -m 2023-12-12T11:20:49.290 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64 2023-12-12T11:20:49.291 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2023-12-12T11:20:49.353 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="CentOS Stream" 2023-12-12T11:20:49.353 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8" 2023-12-12T11:20:49.353 INFO:teuthology.orchestra.run.smithi093.stdout:ID="centos" 2023-12-12T11:20:49.353 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="rhel fedora" 2023-12-12T11:20:49.353 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8" 2023-12-12T11:20:49.354 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8" 2023-12-12T11:20:49.354 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-12T11:20:49.354 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2023-12-12T11:20:49.354 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-12T11:20:49.354 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://centos.org/" 2023-12-12T11:20:49.354 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-12T11:20:49.354 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-12T11:20:49.354 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-12T11:20:49.355 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2023-12-12T11:20:49.383 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-12T11:20:49.393 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-12T11:20:49.399 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-12T11:20:49.399 DEBUG:teuthology.orchestra.run.smithi063:> test '!' -e /home/ubuntu/cephtest 2023-12-12T11:20:49.402 DEBUG:teuthology.orchestra.run.smithi093:> test '!' -e /home/ubuntu/cephtest 2023-12-12T11:20:49.423 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-12T11:20:49.428 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-12T11:20:49.429 DEBUG:teuthology.orchestra.run.smithi063:> test -z $(ls -A /var/lib/ceph) 2023-12-12T11:20:49.464 DEBUG:teuthology.orchestra.run.smithi093:> test -z $(ls -A /var/lib/ceph) 2023-12-12T11:20:49.497 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-12T11:20:49.559 INFO:teuthology.run_tasks:Running task kernel... 2023-12-12T11:20:49.575 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'} 2023-12-12T11:20:49.575 INFO:teuthology.task.kernel:config {'host.a': {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}, 'host.b': {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}}, timeout 300 2023-12-12T11:20:49.576 DEBUG:teuthology.orchestra.run.smithi063:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-12T11:20:49.576 DEBUG:teuthology.orchestra.run.smithi093:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-12T11:20:49.596 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T11:20:49.597 DEBUG:teuthology.task.kernel:sha1 for host.a is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-12T11:20:49.597 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-12T11:20:49.597 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2023-12-12T11:20:49.598 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T11:20:49.599 DEBUG:teuthology.task.kernel:sha1 for host.b is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-12T11:20:49.599 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-12T11:20:49.599 DEBUG:teuthology.orchestra.run.smithi093:> uname -r 2023-12-12T11:20:49.658 INFO:teuthology.orchestra.run.smithi063.stdout:4.18.0-489.el8.x86_64 2023-12-12T11:20:49.659 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-12T11:20:49.659 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-12T11:20:49.659 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-12T11:20:49.663 INFO:teuthology.orchestra.run.smithi093.stdout:4.18.0-489.el8.x86_64 2023-12-12T11:20:49.663 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-12T11:20:49.663 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-12T11:20:49.663 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-12T11:20:49.813 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum upgrade -y linux-firmware 2023-12-12T11:20:50.013 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum upgrade -y linux-firmware 2023-12-12T11:20:54.721 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 8 - AppStream 16 MB/s | 35 MB 00:02 2023-12-12T11:20:54.795 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 8 - AppStream 14 MB/s | 35 MB 00:02 2023-12-12T11:21:03.587 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 8 - BaseOS 22 MB/s | 56 MB 00:02 2023-12-12T11:21:03.922 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 8 - BaseOS 25 MB/s | 56 MB 00:02 2023-12-12T11:21:11.995 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 8 - Extras 40 kB/s | 18 kB 00:00 2023-12-12T11:21:12.729 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 8 - Extras common packages 12 kB/s | 6.9 kB 00:00 2023-12-12T11:21:13.005 INFO:teuthology.orchestra.run.smithi093.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-12-12T11:21:13.121 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 8 - Extras 39 kB/s | 18 kB 00:00 2023-12-12T11:21:13.605 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 8 - Extras common packages 24 kB/s | 6.9 kB 00:00 2023-12-12T11:21:13.890 INFO:teuthology.orchestra.run.smithi063.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2023-12-12T11:21:14.591 INFO:teuthology.orchestra.run.smithi093.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-12-12T11:21:15.574 INFO:teuthology.orchestra.run.smithi063.stdout:Extra Packages for Enterprise Linux 10 MB/s | 16 MB 00:01 2023-12-12T11:21:18.424 INFO:teuthology.orchestra.run.smithi093.stdout:lab-extras 333 kB/s | 24 kB 00:00 2023-12-12T11:21:19.674 INFO:teuthology.orchestra.run.smithi063.stdout:lab-extras 577 kB/s | 24 kB 00:00 2023-12-12T11:21:22.420 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-12T11:21:22.420 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:21:22.420 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repo Size 2023-12-12T11:21:22.420 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:21:22.420 INFO:teuthology.orchestra.run.smithi093.stdout:Upgrading: 2023-12-12T11:21:22.420 INFO:teuthology.orchestra.run.smithi093.stdout: linux-firmware noarch 20231121-120.git9552083a.el8 baseos 347 M 2023-12-12T11:21:22.421 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:21:22.421 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-12T11:21:22.421 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:21:22.421 INFO:teuthology.orchestra.run.smithi093.stdout:Upgrade 1 Package 2023-12-12T11:21:22.421 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:21:22.421 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 347 M 2023-12-12T11:21:22.421 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-12T11:21:23.887 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-12T11:21:23.888 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:21:23.888 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repo Size 2023-12-12T11:21:23.888 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:21:23.888 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrading: 2023-12-12T11:21:23.888 INFO:teuthology.orchestra.run.smithi063.stdout: linux-firmware noarch 20231121-120.git9552083a.el8 baseos 347 M 2023-12-12T11:21:23.888 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:21:23.888 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-12T11:21:23.888 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:21:23.888 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrade 1 Package 2023-12-12T11:21:23.888 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:21:23.889 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 347 M 2023-12-12T11:21:23.889 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-12T11:21:35.516 INFO:teuthology.orchestra.run.smithi093.stdout:linux-firmware-20231121-120.git9552083a.el8.noa 27 MB/s | 347 MB 00:12 2023-12-12T11:21:35.517 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:21:35.517 INFO:teuthology.orchestra.run.smithi093.stdout:Total 26 MB/s | 347 MB 00:13 2023-12-12T11:21:37.533 INFO:teuthology.orchestra.run.smithi063.stdout:linux-firmware-20231121-120.git9552083a.el8.noa 25 MB/s | 347 MB 00:13 2023-12-12T11:21:37.533 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:21:37.533 INFO:teuthology.orchestra.run.smithi063.stdout:Total 25 MB/s | 347 MB 00:13 2023-12-12T11:21:37.574 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-12T11:21:37.642 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-12T11:21:37.642 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-12T11:21:39.688 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-12T11:21:39.763 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-12T11:21:39.764 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-12T11:21:39.782 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-12T11:21:39.820 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-12T11:21:41.997 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-12T11:21:42.034 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-12T11:22:02.170 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-12T11:22:02.534 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : linux-firmware-20231121-120.git9552083a.el8.noarch 1/2 2023-12-12T11:22:02.797 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-12-12T11:22:03.023 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-12-12T11:22:03.023 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : linux-firmware-20231121-120.git9552083a.el8.noarch 1/2 2023-12-12T11:22:03.799 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-12-12T11:22:03.799 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:22:03.799 INFO:teuthology.orchestra.run.smithi093.stdout:Upgraded: 2023-12-12T11:22:03.799 INFO:teuthology.orchestra.run.smithi093.stdout: linux-firmware-20231121-120.git9552083a.el8.noarch 2023-12-12T11:22:03.800 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:22:03.800 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-12T11:22:03.981 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on host.b... 2023-12-12T11:22:03.982 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-12T11:22:04.343 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/8/flavors/default/x86_64/ 2023-12-12T11:22:04.343 DEBUG:teuthology.orchestra.run.smithi093:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/8/flavors/default/x86_64/ --input-file=- 2023-12-12T11:22:04.346 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi093.front.sepia.ceph.com to complete... 2023-12-12T11:22:05.784 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-12T11:22:06.186 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : linux-firmware-20231121-120.git9552083a.el8.noarch 1/2 2023-12-12T11:22:06.411 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-12-12T11:22:06.694 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-12-12T11:22:06.694 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : linux-firmware-20231121-120.git9552083a.el8.noarch 1/2 2023-12-12T11:22:07.521 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-12-12T11:22:07.521 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:22:07.521 INFO:teuthology.orchestra.run.smithi063.stdout:Upgraded: 2023-12-12T11:22:07.521 INFO:teuthology.orchestra.run.smithi063.stdout: linux-firmware-20231121-120.git9552083a.el8.noarch 2023-12-12T11:22:07.522 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:22:07.522 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-12T11:22:07.717 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on host.a... 2023-12-12T11:22:07.717 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-12T11:22:08.098 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/8/flavors/default/x86_64/ 2023-12-12T11:22:08.099 DEBUG:teuthology.orchestra.run.smithi063:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/8/flavors/default/x86_64/ --input-file=- 2023-12-12T11:22:08.101 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi063.front.sepia.ceph.com to complete... 2023-12-12T11:22:18.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12 11:22:18 URL:https://1.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/8/flavors/default/x86_64/kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm [383180176/383180176] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-12T11:22:18.118 INFO:teuthology.orchestra.run.smithi093.stderr:FINISHED --2023-12-12 11:22:18-- 2023-12-12T11:22:18.118 INFO:teuthology.orchestra.run.smithi093.stderr:Total wall clock time: 14s 2023-12-12T11:22:18.119 INFO:teuthology.orchestra.run.smithi093.stderr:Downloaded: 1 files, 365M in 13s (27.2 MB/s) 2023-12-12T11:22:18.121 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on host.b... 2023-12-12T11:22:18.121 DEBUG:teuthology.orchestra.run.smithi093:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-12T11:22:19.795 INFO:teuthology.orchestra.run.smithi093.stdout:Verifying... ######################################## 2023-12-12T11:22:19.838 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing... ######################################## 2023-12-12T11:22:19.947 INFO:teuthology.orchestra.run.smithi093.stdout:Updating / installing... 2023-12-12T11:22:58.250 INFO:teuthology.orchestra.run.smithi093.stdout:kernel-6.6.0_gcd68252d7b4d-1 ######################################## 2023-12-12T11:22:59.643 INFO:teuthology.orchestra.run.smithi093.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-12T11:23:22.491 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi093.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-12T11:23:22.492 DEBUG:teuthology.orchestra.run.smithi093:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-12T11:23:22.552 INFO:teuthology.orchestra.run.smithi093.stdout:/boot/System.map-6.6.0-gcd68252d7b4d 2023-12-12T11:23:22.553 INFO:teuthology.orchestra.run.smithi093.stdout:/boot/config-6.6.0-gcd68252d7b4d 2023-12-12T11:23:22.553 INFO:teuthology.orchestra.run.smithi093.stdout:/boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-12T11:23:22.553 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d 2023-12-12T11:23:22.553 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel 2023-12-12T11:23:22.553 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch 2023-12-12T11:23:22.553 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86 2023-12-12T11:23:22.553 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto 2023-12-12T11:23:22.553 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-12T11:23:22.553 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-12T11:23:22.553 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-12T11:23:22.553 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-12T11:23:22.553 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-12T11:23:22.553 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-12T11:23:22.553 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-12T11:23:22.554 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-12T11:23:22.554 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-12T11:23:22.554 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-12T11:23:22.554 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-12T11:23:22.554 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-12T11:23:22.554 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-12T11:23:22.554 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-12T11:23:22.554 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-12T11:23:22.554 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-12T11:23:22.554 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-12T11:23:22.554 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-12T11:23:22.554 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-12T11:23:22.554 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-12T11:23:22.554 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel 2023-12-12T11:23:22.555 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu 2023-12-12T11:23:22.555 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce 2023-12-12T11:23:22.555 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-12T11:23:22.555 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm 2023-12-12T11:23:22.555 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-12T11:23:22.555 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-12T11:23:22.555 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-12T11:23:22.555 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto 2023-12-12T11:23:22.555 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-12T11:23:22.555 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-12T11:23:22.555 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-12T11:23:22.555 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx 2023-12-12T11:23:22.555 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-12T11:23:22.555 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-12T11:23:22.555 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-12T11:23:22.556 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-12T11:23:22.556 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-12T11:23:22.556 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-12T11:23:22.556 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-12T11:23:22.556 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-12T11:23:22.556 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-12T11:23:22.556 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-12T11:23:22.556 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-12T11:23:22.556 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-12T11:23:22.556 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-12T11:23:22.556 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-12T11:23:22.556 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-12T11:23:22.556 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-12T11:23:22.556 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-12T11:23:22.557 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-12T11:23:22.557 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-12T11:23:22.557 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-12T11:23:22.557 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-12T11:23:22.557 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-12T11:23:22.557 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-12T11:23:22.557 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-12T11:23:22.557 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-12T11:23:22.557 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-12T11:23:22.557 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-12T11:23:22.557 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-12T11:23:22.557 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-12T11:23:22.557 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-12T11:23:22.557 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-12T11:23:22.557 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-12T11:23:22.557 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-12T11:23:22.557 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-12T11:23:22.558 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-12T11:23:22.558 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-12T11:23:22.558 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-12T11:23:22.558 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-12T11:23:22.558 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-12T11:23:22.558 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-12T11:23:22.558 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-12T11:23:22.558 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-12T11:23:22.558 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-12T11:23:22.558 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-12T11:23:22.558 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-12T11:23:22.558 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers 2023-12-12T11:23:22.558 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi 2023-12-12T11:23:22.558 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-12T11:23:22.558 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-12T11:23:22.559 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/custom_method.ko 2023-12-12T11:23:22.559 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-12T11:23:22.559 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-12T11:23:22.559 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-12T11:23:22.559 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-12T11:23:22.559 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-12T11:23:22.559 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata 2023-12-12T11:23:22.559 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-12T11:23:22.559 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-12T11:23:22.559 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ata_generic.ko 2023-12-12T11:23:22.559 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-12T11:23:22.559 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-12T11:23:22.559 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-12T11:23:22.559 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-12T11:23:22.559 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-12T11:23:22.560 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-12T11:23:22.560 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-12T11:23:22.560 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-12T11:23:22.560 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-12T11:23:22.560 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-12T11:23:22.560 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-12T11:23:22.560 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-12T11:23:22.560 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-12T11:23:22.560 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-12T11:23:22.560 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-12T11:23:22.560 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-12T11:23:22.560 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-12T11:23:22.560 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-12T11:23:22.560 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-12T11:23:22.560 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-12T11:23:22.560 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-12T11:23:22.561 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-12T11:23:22.561 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-12T11:23:22.561 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-12T11:23:22.561 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-12T11:23:22.561 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-12T11:23:22.561 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-12T11:23:22.561 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-12T11:23:22.561 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-12T11:23:22.561 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-12T11:23:22.561 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-12T11:23:22.561 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-12T11:23:22.561 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-12T11:23:22.561 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-12T11:23:22.561 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-12T11:23:22.561 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sis.ko 2023-12-12T11:23:22.561 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-12T11:23:22.562 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-12T11:23:22.562 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-12T11:23:22.562 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-12T11:23:22.562 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-12T11:23:22.562 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-12T11:23:22.562 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-12T11:23:22.562 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-12T11:23:22.562 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-12T11:23:22.562 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-12T11:23:22.562 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-12T11:23:22.562 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-12T11:23:22.562 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-12T11:23:22.562 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-12T11:23:22.562 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-12T11:23:22.562 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-12T11:23:22.563 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-12T11:23:22.563 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay 2023-12-12T11:23:22.563 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-12T11:23:22.563 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base 2023-12-12T11:23:22.563 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap 2023-12-12T11:23:22.563 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-12T11:23:22.563 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-12T11:23:22.563 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma 2023-12-12T11:23:22.563 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-12T11:23:22.563 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block 2023-12-12T11:23:22.563 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe 2023-12-12T11:23:22.563 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-12T11:23:22.563 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/brd.ko 2023-12-12T11:23:22.563 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd 2023-12-12T11:23:22.563 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-12T11:23:22.563 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-12T11:23:22.563 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/loop.ko 2023-12-12T11:23:22.564 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx 2023-12-12T11:23:22.564 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-12T11:23:22.564 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-12T11:23:22.564 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk 2023-12-12T11:23:22.564 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-12T11:23:22.564 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-12T11:23:22.564 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-12T11:23:22.564 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/virtio_blk.ko 2023-12-12T11:23:22.564 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback 2023-12-12T11:23:22.564 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-12T11:23:22.564 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkfront.ko 2023-12-12T11:23:22.564 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram 2023-12-12T11:23:22.564 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-12T11:23:22.564 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char 2023-12-12T11:23:22.564 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-12T11:23:22.564 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random 2023-12-12T11:23:22.565 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-12T11:23:22.565 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-12T11:23:22.565 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-12T11:23:22.565 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-12T11:23:22.565 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-12T11:23:22.565 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi 2023-12-12T11:23:22.565 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-12T11:23:22.565 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-12T11:23:22.565 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-12T11:23:22.565 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-12T11:23:22.565 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-12T11:23:22.565 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-12T11:23:22.565 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-12T11:23:22.565 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave 2023-12-12T11:23:22.565 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-12T11:23:22.566 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-12T11:23:22.566 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-12T11:23:22.566 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm 2023-12-12T11:23:22.566 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm.ko 2023-12-12T11:23:22.566 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-12T11:23:22.566 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-12T11:23:22.566 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-12T11:23:22.566 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-12T11:23:22.566 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-12T11:23:22.566 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/uv_mmtimer.ko 2023-12-12T11:23:22.566 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/virtio_console.ko 2023-12-12T11:23:22.566 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq 2023-12-12T11:23:22.566 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-12T11:23:22.566 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-12T11:23:22.566 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-12T11:23:22.566 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-12T11:23:22.567 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-12T11:23:22.567 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-12T11:23:22.567 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto 2023-12-12T11:23:22.567 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp 2023-12-12T11:23:22.567 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-12T11:23:22.567 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-12T11:23:22.567 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel 2023-12-12T11:23:22.567 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat 2023-12-12T11:23:22.567 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common 2023-12-12T11:23:22.567 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-12T11:23:22.567 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-12T11:23:22.567 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-12T11:23:22.567 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-12T11:23:22.567 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-12T11:23:22.567 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio 2023-12-12T11:23:22.567 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-12T11:23:22.567 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca 2023-12-12T11:23:22.568 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-12T11:23:22.568 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq 2023-12-12T11:23:22.568 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-12T11:23:22.568 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma 2023-12-12T11:23:22.568 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw 2023-12-12T11:23:22.568 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-12T11:23:22.568 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat 2023-12-12T11:23:22.568 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-12T11:23:22.568 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac 2023-12-12T11:23:22.568 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-12T11:23:22.568 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-12T11:23:22.568 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-12T11:23:22.568 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-12T11:23:22.568 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-12T11:23:22.568 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-12T11:23:22.568 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-12T11:23:22.568 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-12T11:23:22.569 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-12T11:23:22.569 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-12T11:23:22.569 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-12T11:23:22.569 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-12T11:23:22.569 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-12T11:23:22.569 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware 2023-12-12T11:23:22.569 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/edd.ko 2023-12-12T11:23:22.569 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-12T11:23:22.569 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio 2023-12-12T11:23:22.569 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-12T11:23:22.569 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-12T11:23:22.569 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid 2023-12-12T11:23:22.569 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-12T11:23:22.569 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-12T11:23:22.569 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-12T11:23:22.569 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-12T11:23:22.570 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-12T11:23:22.570 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-12T11:23:22.570 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-12T11:23:22.570 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-12T11:23:22.570 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-12T11:23:22.570 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-12T11:23:22.570 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-12T11:23:22.570 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-12T11:23:22.570 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-12T11:23:22.570 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-12T11:23:22.570 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-12T11:23:22.570 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-12T11:23:22.570 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-12T11:23:22.570 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-12T11:23:22.570 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-12T11:23:22.570 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-12T11:23:22.571 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-12T11:23:22.571 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-12T11:23:22.571 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-12T11:23:22.571 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-12T11:23:22.571 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-12T11:23:22.571 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-12T11:23:22.571 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-12T11:23:22.571 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-12T11:23:22.571 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-12T11:23:22.571 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-12T11:23:22.571 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-12T11:23:22.571 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-12T11:23:22.571 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-12T11:23:22.571 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-12T11:23:22.571 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-12T11:23:22.571 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-12T11:23:22.572 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-12T11:23:22.572 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-12T11:23:22.572 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-12T11:23:22.572 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-12T11:23:22.572 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-12T11:23:22.572 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-12T11:23:22.572 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-12T11:23:22.572 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-12T11:23:22.572 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-12T11:23:22.572 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-12T11:23:22.572 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-12T11:23:22.572 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-12T11:23:22.572 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-12T11:23:22.572 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-12T11:23:22.572 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-12T11:23:22.572 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-12T11:23:22.573 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-12T11:23:22.573 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-12T11:23:22.573 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-12T11:23:22.573 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-12T11:23:22.573 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-12T11:23:22.573 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-12T11:23:22.573 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-12T11:23:22.573 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-12T11:23:22.573 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-12T11:23:22.573 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-12T11:23:22.573 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-12T11:23:22.573 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-12T11:23:22.573 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv 2023-12-12T11:23:22.573 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-12T11:23:22.573 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-12T11:23:22.573 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-12T11:23:22.574 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon 2023-12-12T11:23:22.574 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-12T11:23:22.574 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-12T11:23:22.574 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-12T11:23:22.574 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-12T11:23:22.574 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-12T11:23:22.574 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-12T11:23:22.574 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-12T11:23:22.574 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-12T11:23:22.574 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-12T11:23:22.574 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-12T11:23:22.574 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-12T11:23:22.574 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-12T11:23:22.574 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-12T11:23:22.574 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-12T11:23:22.575 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-12T11:23:22.575 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-12T11:23:22.575 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-12T11:23:22.575 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-12T11:23:22.575 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-12T11:23:22.575 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-12T11:23:22.575 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-12T11:23:22.575 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-12T11:23:22.575 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-12T11:23:22.575 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-12T11:23:22.575 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-12T11:23:22.575 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-12T11:23:22.575 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-12T11:23:22.575 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-12T11:23:22.575 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-12T11:23:22.575 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-12T11:23:22.576 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-12T11:23:22.576 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-12T11:23:22.576 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-12T11:23:22.576 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-12T11:23:22.576 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-12T11:23:22.576 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-12T11:23:22.576 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-12T11:23:22.576 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-12T11:23:22.576 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-12T11:23:22.576 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-12T11:23:22.576 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-12T11:23:22.576 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-12T11:23:22.576 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-12T11:23:22.576 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-12T11:23:22.576 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-12T11:23:22.576 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-12T11:23:22.577 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-12T11:23:22.577 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-12T11:23:22.577 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-12T11:23:22.577 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-12T11:23:22.577 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-12T11:23:22.577 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-12T11:23:22.577 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-12T11:23:22.577 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-12T11:23:22.577 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-12T11:23:22.577 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-12T11:23:22.577 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-12T11:23:22.577 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-12T11:23:22.577 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-12T11:23:22.577 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-12T11:23:22.577 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-12T11:23:22.577 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-12T11:23:22.578 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-12T11:23:22.578 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-12T11:23:22.578 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-12T11:23:22.578 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-12T11:23:22.578 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-12T11:23:22.578 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-12T11:23:22.578 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-12T11:23:22.578 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-12T11:23:22.578 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-12T11:23:22.578 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-12T11:23:22.578 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-12T11:23:22.578 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-12T11:23:22.578 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-12T11:23:22.578 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-12T11:23:22.578 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-12T11:23:22.579 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-12T11:23:22.579 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-12T11:23:22.579 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-12T11:23:22.579 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-12T11:23:22.579 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-12T11:23:22.579 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-12T11:23:22.579 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-12T11:23:22.579 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-12T11:23:22.579 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-12T11:23:22.579 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-12T11:23:22.579 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-12T11:23:22.579 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus 2023-12-12T11:23:22.579 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-12T11:23:22.579 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-12T11:23:22.579 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-12T11:23:22.579 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-12T11:23:22.579 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-12T11:23:22.580 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-12T11:23:22.580 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-12T11:23:22.580 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-12T11:23:22.580 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-12T11:23:22.580 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-12T11:23:22.580 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-12T11:23:22.580 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-12T11:23:22.580 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-12T11:23:22.580 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-12T11:23:22.580 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-12T11:23:22.580 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-12T11:23:22.580 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-12T11:23:22.580 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-12T11:23:22.580 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-12T11:23:22.580 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-12T11:23:22.580 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-12T11:23:22.581 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-12T11:23:22.581 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-12T11:23:22.581 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-12T11:23:22.581 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-12T11:23:22.581 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-12T11:23:22.581 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-12T11:23:22.581 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-12T11:23:22.581 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-12T11:23:22.581 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-12T11:23:22.581 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-12T11:23:22.581 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-12T11:23:22.581 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-12T11:23:22.581 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-12T11:23:22.581 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-12T11:23:22.581 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-12T11:23:22.581 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-12T11:23:22.582 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-12T11:23:22.582 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-12T11:23:22.582 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-12T11:23:22.582 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-12T11:23:22.582 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c 2023-12-12T11:23:22.582 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos 2023-12-12T11:23:22.582 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-12T11:23:22.582 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-12T11:23:22.582 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses 2023-12-12T11:23:22.582 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-12T11:23:22.582 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-12T11:23:22.582 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-12T11:23:22.582 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-12T11:23:22.582 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-12T11:23:22.582 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-12T11:23:22.583 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-12T11:23:22.583 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-12T11:23:22.583 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-12T11:23:22.583 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-12T11:23:22.583 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-12T11:23:22.583 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-12T11:23:22.583 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-12T11:23:22.583 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-12T11:23:22.583 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-12T11:23:22.583 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-12T11:23:22.583 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-12T11:23:22.583 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-12T11:23:22.583 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-12T11:23:22.583 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-12T11:23:22.583 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-12T11:23:22.583 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-12T11:23:22.584 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-12T11:23:22.584 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-dev.ko 2023-12-12T11:23:22.584 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-12T11:23:22.584 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-12T11:23:22.584 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-12T11:23:22.584 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-12T11:23:22.584 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband 2023-12-12T11:23:22.584 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core 2023-12-12T11:23:22.584 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-12T11:23:22.584 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-12T11:23:22.584 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-12T11:23:22.584 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-12T11:23:22.584 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-12T11:23:22.584 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-12T11:23:22.584 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-12T11:23:22.584 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw 2023-12-12T11:23:22.585 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4 2023-12-12T11:23:22.585 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-12T11:23:22.585 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4 2023-12-12T11:23:22.585 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-12T11:23:22.585 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5 2023-12-12T11:23:22.585 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-12T11:23:22.585 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca 2023-12-12T11:23:22.585 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-12T11:23:22.585 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp 2023-12-12T11:23:22.585 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib 2023-12-12T11:23:22.585 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-12T11:23:22.585 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser 2023-12-12T11:23:22.585 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-12T11:23:22.585 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert 2023-12-12T11:23:22.585 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-12T11:23:22.585 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp 2023-12-12T11:23:22.586 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-12T11:23:22.586 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt 2023-12-12T11:23:22.586 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-12T11:23:22.586 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input 2023-12-12T11:23:22.586 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport 2023-12-12T11:23:22.586 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-12T11:23:22.586 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-12T11:23:22.586 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-12T11:23:22.586 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-12T11:23:22.586 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard 2023-12-12T11:23:22.586 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-12T11:23:22.586 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse 2023-12-12T11:23:22.586 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-12T11:23:22.586 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-12T11:23:22.586 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-12T11:23:22.587 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-12T11:23:22.587 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-12T11:23:22.587 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-12T11:23:22.587 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-12T11:23:22.587 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-12T11:23:22.587 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4 2023-12-12T11:23:22.587 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-12T11:23:22.587 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio 2023-12-12T11:23:22.587 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-12T11:23:22.587 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-12T11:23:22.587 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-12T11:23:22.587 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-12T11:23:22.587 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-12T11:23:22.587 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu 2023-12-12T11:23:22.587 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd 2023-12-12T11:23:22.587 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-12T11:23:22.588 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds 2023-12-12T11:23:22.588 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-12T11:23:22.588 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-12T11:23:22.588 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-12T11:23:22.588 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-12T11:23:22.588 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger 2023-12-12T11:23:22.588 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-12T11:23:22.588 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-12T11:23:22.588 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-12T11:23:22.588 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-12T11:23:22.588 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-12T11:23:22.588 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-12T11:23:22.588 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-12T11:23:22.588 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-12T11:23:22.588 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md 2023-12-12T11:23:22.589 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache 2023-12-12T11:23:22.589 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-12T11:23:22.589 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-12T11:23:22.589 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-12T11:23:22.589 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-12T11:23:22.589 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-12T11:23:22.589 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-12T11:23:22.589 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-12T11:23:22.589 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-12T11:23:22.589 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-12T11:23:22.589 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-12T11:23:22.589 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-12T11:23:22.589 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-12T11:23:22.589 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-12T11:23:22.589 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-12T11:23:22.589 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-12T11:23:22.589 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-12T11:23:22.590 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-12T11:23:22.590 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-12T11:23:22.590 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-12T11:23:22.590 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data 2023-12-12T11:23:22.590 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-12T11:23:22.590 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-12T11:23:22.590 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-12T11:23:22.590 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-12T11:23:22.590 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-12T11:23:22.590 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message 2023-12-12T11:23:22.590 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion 2023-12-12T11:23:22.590 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-12T11:23:22.590 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-12T11:23:22.590 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-12T11:23:22.590 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-12T11:23:22.590 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-12T11:23:22.591 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-12T11:23:22.591 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-12T11:23:22.591 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd 2023-12-12T11:23:22.591 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-12T11:23:22.591 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-12T11:23:22.591 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mfd-core.ko 2023-12-12T11:23:22.591 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-12T11:23:22.591 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-12T11:23:22.591 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-12T11:23:22.591 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-12T11:23:22.591 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc 2023-12-12T11:23:22.591 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl 2023-12-12T11:23:22.591 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-12T11:23:22.591 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-12T11:23:22.591 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-12T11:23:22.591 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-12T11:23:22.592 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710 2023-12-12T11:23:22.592 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-12T11:23:22.592 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom 2023-12-12T11:23:22.592 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-12T11:23:22.592 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-12T11:23:22.592 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-12T11:23:22.592 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-12T11:23:22.592 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-12T11:23:22.592 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-12T11:23:22.592 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-12T11:23:22.592 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-12T11:23:22.592 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d 2023-12-12T11:23:22.592 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-12T11:23:22.592 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-12T11:23:22.592 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei 2023-12-12T11:23:22.593 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-12T11:23:22.593 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-12T11:23:22.593 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-12T11:23:22.593 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru 2023-12-12T11:23:22.593 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-12T11:23:22.593 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp 2023-12-12T11:23:22.593 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-12T11:23:22.593 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-12T11:23:22.593 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-12T11:23:22.593 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-12T11:23:22.593 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-12T11:23:22.593 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-12T11:23:22.593 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-12T11:23:22.593 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci 2023-12-12T11:23:22.593 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-12T11:23:22.593 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net 2023-12-12T11:23:22.594 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding 2023-12-12T11:23:22.594 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-12T11:23:22.594 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa 2023-12-12T11:23:22.594 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53 2023-12-12T11:23:22.594 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-12T11:23:22.594 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-12T11:23:22.594 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-12T11:23:22.594 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx 2023-12-12T11:23:22.594 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-12T11:23:22.594 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-12T11:23:22.594 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-12T11:23:22.594 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet 2023-12-12T11:23:22.594 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com 2023-12-12T11:23:22.594 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-12T11:23:22.594 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-12T11:23:22.594 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-12T11:23:22.595 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-12T11:23:22.595 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390 2023-12-12T11:23:22.595 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-12T11:23:22.595 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-12T11:23:22.595 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-12T11:23:22.595 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-12T11:23:22.595 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec 2023-12-12T11:23:22.595 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-12T11:23:22.595 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere 2023-12-12T11:23:22.595 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-12T11:23:22.595 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon 2023-12-12T11:23:22.595 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-12T11:23:22.595 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera 2023-12-12T11:23:22.595 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-12T11:23:22.595 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd 2023-12-12T11:23:22.595 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-12T11:23:22.595 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-12T11:23:22.595 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-12T11:23:22.596 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros 2023-12-12T11:23:22.596 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx 2023-12-12T11:23:22.596 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-12T11:23:22.596 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-12T11:23:22.596 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-12T11:23:22.596 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-12T11:23:22.596 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-12T11:23:22.596 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx 2023-12-12T11:23:22.596 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-12T11:23:22.596 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-12T11:23:22.596 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom 2023-12-12T11:23:22.596 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-12T11:23:22.596 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-12T11:23:22.596 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-12T11:23:22.596 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-12T11:23:22.596 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-12T11:23:22.597 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet 2023-12-12T11:23:22.597 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-12T11:23:22.597 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-12T11:23:22.597 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade 2023-12-12T11:23:22.597 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna 2023-12-12T11:23:22.597 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-12T11:23:22.597 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio 2023-12-12T11:23:22.597 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-12T11:23:22.597 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-12T11:23:22.597 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-12T11:23:22.597 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-12T11:23:22.597 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-12T11:23:22.597 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-12T11:23:22.597 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-12T11:23:22.597 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-12T11:23:22.597 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-12T11:23:22.598 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-12T11:23:22.598 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco 2023-12-12T11:23:22.598 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic 2023-12-12T11:23:22.598 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-12T11:23:22.598 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec 2023-12-12T11:23:22.598 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip 2023-12-12T11:23:22.598 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-12T11:23:22.598 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-12T11:23:22.598 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-12T11:23:22.598 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-12T11:23:22.598 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-12T11:23:22.598 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-12T11:23:22.598 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink 2023-12-12T11:23:22.599 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-12T11:23:22.599 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-12T11:23:22.599 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-12T11:23:22.599 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex 2023-12-12T11:23:22.599 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet 2023-12-12T11:23:22.599 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-12T11:23:22.599 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-12T11:23:22.599 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-12T11:23:22.599 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel 2023-12-12T11:23:22.599 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-12T11:23:22.599 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000 2023-12-12T11:23:22.599 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-12T11:23:22.599 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e 2023-12-12T11:23:22.599 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-12T11:23:22.599 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k 2023-12-12T11:23:22.600 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-12T11:23:22.600 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e 2023-12-12T11:23:22.600 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-12T11:23:22.600 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf 2023-12-12T11:23:22.600 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-12T11:23:22.600 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb 2023-12-12T11:23:22.600 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-12T11:23:22.600 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf 2023-12-12T11:23:22.600 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-12T11:23:22.600 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-12T11:23:22.600 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-12T11:23:22.600 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-12T11:23:22.600 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-12T11:23:22.600 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-12T11:23:22.600 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell 2023-12-12T11:23:22.600 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-12T11:23:22.601 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-12T11:23:22.601 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-12T11:23:22.601 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox 2023-12-12T11:23:22.601 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-12T11:23:22.601 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-12T11:23:22.601 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-12T11:23:22.601 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-12T11:23:22.601 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-12T11:23:22.601 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-12T11:23:22.601 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel 2023-12-12T11:23:22.601 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-12T11:23:22.601 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom 2023-12-12T11:23:22.601 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-12T11:23:22.601 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-12T11:23:22.602 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi 2023-12-12T11:23:22.602 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-12T11:23:22.602 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-12T11:23:22.602 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion 2023-12-12T11:23:22.602 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-12T11:23:22.602 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia 2023-12-12T11:23:22.602 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-12T11:23:22.602 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines 2023-12-12T11:23:22.602 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-12T11:23:22.602 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-12T11:23:22.602 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic 2023-12-12T11:23:22.602 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-12T11:23:22.602 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-12T11:23:22.602 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-12T11:23:22.602 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-12T11:23:22.602 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-12T11:23:22.603 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc 2023-12-12T11:23:22.603 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-12T11:23:22.603 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek 2023-12-12T11:23:22.603 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-12T11:23:22.603 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-12T11:23:22.603 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-12T11:23:22.603 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-12T11:23:22.603 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker 2023-12-12T11:23:22.603 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-12T11:23:22.603 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc 2023-12-12T11:23:22.603 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-12T11:23:22.603 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan 2023-12-12T11:23:22.603 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-12T11:23:22.603 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis 2023-12-12T11:23:22.603 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-12T11:23:22.604 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-12T11:23:22.604 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc 2023-12-12T11:23:22.604 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-12T11:23:22.604 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-12T11:23:22.604 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-12T11:23:22.604 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-12T11:23:22.604 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro 2023-12-12T11:23:22.604 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-12T11:23:22.604 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-12T11:23:22.604 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-12T11:23:22.604 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun 2023-12-12T11:23:22.604 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-12T11:23:22.604 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-12T11:23:22.604 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-12T11:23:22.604 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-12T11:23:22.604 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti 2023-12-12T11:23:22.605 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-12T11:23:22.605 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti 2023-12-12T11:23:22.605 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-12T11:23:22.605 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via 2023-12-12T11:23:22.605 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-12T11:23:22.605 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-12T11:23:22.605 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet 2023-12-12T11:23:22.605 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-12T11:23:22.605 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-12T11:23:22.605 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom 2023-12-12T11:23:22.605 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-12T11:23:22.605 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-12T11:23:22.605 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv 2023-12-12T11:23:22.605 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-12T11:23:22.605 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154 2023-12-12T11:23:22.605 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-12T11:23:22.606 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-12T11:23:22.606 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan 2023-12-12T11:23:22.606 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-12T11:23:22.606 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-12T11:23:22.606 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-12T11:23:22.606 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio 2023-12-12T11:23:22.606 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-12T11:23:22.606 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-12T11:23:22.606 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-12T11:23:22.606 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-12T11:23:22.606 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-12T11:23:22.606 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/net_failover.ko 2023-12-12T11:23:22.606 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-12T11:23:22.606 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-12T11:23:22.606 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs 2023-12-12T11:23:22.607 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-12T11:23:22.607 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-12T11:23:22.607 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy 2023-12-12T11:23:22.607 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-12T11:23:22.607 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-12T11:23:22.607 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-12T11:23:22.607 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-12T11:23:22.607 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-12T11:23:22.607 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-12T11:23:22.607 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-12T11:23:22.607 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-12T11:23:22.607 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/dp83640.ko 2023-12-12T11:23:22.607 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-12T11:23:22.607 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-12T11:23:22.607 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-12T11:23:22.607 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-12T11:23:22.608 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-12T11:23:22.608 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-12T11:23:22.608 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-12T11:23:22.608 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-12T11:23:22.608 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-12T11:23:22.608 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-12T11:23:22.608 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-12T11:23:22.608 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-12T11:23:22.608 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp 2023-12-12T11:23:22.608 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-12T11:23:22.608 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-12T11:23:22.608 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-12T11:23:22.608 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-12T11:23:22.608 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-12T11:23:22.608 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-12T11:23:22.608 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-12T11:23:22.608 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-12T11:23:22.609 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-12T11:23:22.609 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip 2023-12-12T11:23:22.609 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slhc.ko 2023-12-12T11:23:22.609 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-12T11:23:22.609 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-12T11:23:22.609 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-12T11:23:22.609 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team 2023-12-12T11:23:22.609 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-12T11:23:22.609 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-12T11:23:22.609 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-12T11:23:22.609 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-12T11:23:22.609 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-12T11:23:22.609 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-12T11:23:22.609 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tun.ko 2023-12-12T11:23:22.609 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-12T11:23:22.610 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/virtio_net.ko 2023-12-12T11:23:22.610 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3 2023-12-12T11:23:22.610 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-12T11:23:22.610 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan 2023-12-12T11:23:22.610 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-12T11:23:22.610 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback 2023-12-12T11:23:22.610 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-12T11:23:22.610 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netfront.ko 2023-12-12T11:23:22.610 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb 2023-12-12T11:23:22.610 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-12T11:23:22.610 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme 2023-12-12T11:23:22.610 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host 2023-12-12T11:23:22.610 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-12T11:23:22.611 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-12T11:23:22.611 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport 2023-12-12T11:23:22.611 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-12T11:23:22.611 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-12T11:23:22.611 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-12T11:23:22.611 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-12T11:23:22.611 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci 2023-12-12T11:23:22.611 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug 2023-12-12T11:23:22.611 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-12T11:23:22.611 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie 2023-12-12T11:23:22.611 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-12T11:23:22.611 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-12T11:23:22.611 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia 2023-12-12T11:23:22.611 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-12T11:23:22.611 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-12T11:23:22.611 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-12T11:23:22.612 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl 2023-12-12T11:23:22.612 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel 2023-12-12T11:23:22.612 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-12T11:23:22.612 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform 2023-12-12T11:23:22.612 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86 2023-12-12T11:23:22.612 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-12T11:23:22.612 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-12T11:23:22.612 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-12T11:23:22.612 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-12T11:23:22.612 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-12T11:23:22.612 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-12T11:23:22.612 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-12T11:23:22.612 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-12T11:23:22.612 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-12T11:23:22.612 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-12T11:23:22.612 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-12T11:23:22.613 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-12T11:23:22.613 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel 2023-12-12T11:23:22.613 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-12T11:23:22.613 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-12T11:23:22.613 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-12T11:23:22.613 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-12T11:23:22.613 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-12T11:23:22.613 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-12T11:23:22.613 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-12T11:23:22.613 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-12T11:23:22.613 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-12T11:23:22.613 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-12T11:23:22.613 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-12T11:23:22.613 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-12T11:23:22.613 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap 2023-12-12T11:23:22.613 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-12T11:23:22.614 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-12T11:23:22.614 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps 2023-12-12T11:23:22.614 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients 2023-12-12T11:23:22.614 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-12T11:23:22.614 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-12T11:23:22.614 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-12T11:23:22.614 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-12T11:23:22.614 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp 2023-12-12T11:23:22.614 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-12T11:23:22.614 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-12T11:23:22.614 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc 2023-12-12T11:23:22.614 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-12T11:23:22.614 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-12T11:23:22.614 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-12T11:23:22.614 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-12T11:23:22.615 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-12T11:23:22.615 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-12T11:23:22.615 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-12T11:23:22.615 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-12T11:23:22.615 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-12T11:23:22.615 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-12T11:23:22.615 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-12T11:23:22.615 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-12T11:23:22.615 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-12T11:23:22.615 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-12T11:23:22.615 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-12T11:23:22.615 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-12T11:23:22.615 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-12T11:23:22.615 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-12T11:23:22.615 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-12T11:23:22.615 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-12T11:23:22.616 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-12T11:23:22.616 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-12T11:23:22.616 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-12T11:23:22.616 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-12T11:23:22.616 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-12T11:23:22.616 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-12T11:23:22.616 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-12T11:23:22.616 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-12T11:23:22.616 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-12T11:23:22.616 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-12T11:23:22.616 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-12T11:23:22.616 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi 2023-12-12T11:23:22.616 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-12T11:23:22.616 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-12T11:23:22.616 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-12T11:23:22.616 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-12T11:23:22.616 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-12T11:23:22.617 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid 2023-12-12T11:23:22.617 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-12T11:23:22.617 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-12T11:23:22.617 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx 2023-12-12T11:23:22.617 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-12T11:23:22.617 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-12T11:23:22.617 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-12T11:23:22.617 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr 2023-12-12T11:23:22.617 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-12T11:23:22.617 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-12T11:23:22.617 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi 2023-12-12T11:23:22.617 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-12T11:23:22.617 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa 2023-12-12T11:23:22.617 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-12T11:23:22.617 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc 2023-12-12T11:23:22.617 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-12T11:23:22.618 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i 2023-12-12T11:23:22.618 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-12T11:23:22.618 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-12T11:23:22.618 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor 2023-12-12T11:23:22.618 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-12T11:23:22.618 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi 2023-12-12T11:23:22.618 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-12T11:23:22.618 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-12T11:23:22.618 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-12T11:23:22.618 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-12T11:23:22.618 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-12T11:23:22.618 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-12T11:23:22.618 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler 2023-12-12T11:23:22.618 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-12T11:23:22.618 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-12T11:23:22.619 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-12T11:23:22.619 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-12T11:23:22.619 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-12T11:23:22.619 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r 2023-12-12T11:23:22.619 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-12T11:23:22.619 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-12T11:23:22.619 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe 2023-12-12T11:23:22.619 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-12T11:23:22.619 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-12T11:23:22.619 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic 2023-12-12T11:23:22.619 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-12T11:23:22.619 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-12T11:23:22.619 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-12T11:23:22.619 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-12T11:23:22.619 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-12T11:23:22.619 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-12T11:23:22.620 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-12T11:23:22.620 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci 2023-12-12T11:23:22.620 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-12T11:23:22.620 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-12T11:23:22.620 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-12T11:23:22.620 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc 2023-12-12T11:23:22.620 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-12T11:23:22.620 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-12T11:23:22.620 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-12T11:23:22.620 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas 2023-12-12T11:23:22.620 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-12T11:23:22.620 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc 2023-12-12T11:23:22.620 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-12T11:23:22.620 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid 2023-12-12T11:23:22.620 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-12T11:23:22.621 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-12T11:23:22.621 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-12T11:23:22.621 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-12T11:23:22.621 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas 2023-12-12T11:23:22.621 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-12T11:23:22.621 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas 2023-12-12T11:23:22.621 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-12T11:23:22.621 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-12T11:23:22.621 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001 2023-12-12T11:23:22.621 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-12T11:23:22.621 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-12T11:23:22.621 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-12T11:23:22.621 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx 2023-12-12T11:23:22.621 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-12T11:23:22.621 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-12T11:23:22.621 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx 2023-12-12T11:23:22.622 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-12T11:23:22.622 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-12T11:23:22.622 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-12T11:23:22.622 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-12T11:23:22.622 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-12T11:23:22.622 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-12T11:23:22.622 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-12T11:23:22.622 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-12T11:23:22.622 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-12T11:23:22.622 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-12T11:23:22.622 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-12T11:23:22.622 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2 2023-12-12T11:23:22.622 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-12T11:23:22.622 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-12T11:23:22.622 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-12T11:23:22.623 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-12T11:23:22.623 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb 2023-12-12T11:23:22.623 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-12T11:23:22.623 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target 2023-12-12T11:23:22.623 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi 2023-12-12T11:23:22.623 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-12T11:23:22.623 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback 2023-12-12T11:23:22.623 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-12T11:23:22.623 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-12T11:23:22.623 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-12T11:23:22.623 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-12T11:23:22.623 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-12T11:23:22.623 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-12T11:23:22.623 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc 2023-12-12T11:23:22.623 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-12T11:23:22.623 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal 2023-12-12T11:23:22.624 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel 2023-12-12T11:23:22.624 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal 2023-12-12T11:23:22.624 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-12T11:23:22.624 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-12T11:23:22.624 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-12T11:23:22.624 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-12T11:23:22.624 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-12T11:23:22.624 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-12T11:23:22.624 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-12T11:23:22.624 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-12T11:23:22.624 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-12T11:23:22.624 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-12T11:23:22.624 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-12T11:23:22.624 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-12T11:23:22.624 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-12T11:23:22.624 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-12T11:23:22.625 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-12T11:23:22.625 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty 2023-12-12T11:23:22.625 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless 2023-12-12T11:23:22.625 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-12T11:23:22.625 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-12T11:23:22.625 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-12T11:23:22.625 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-12T11:23:22.625 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial 2023-12-12T11:23:22.625 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250 2023-12-12T11:23:22.625 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-12T11:23:22.625 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-12T11:23:22.625 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm 2023-12-12T11:23:22.625 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-12T11:23:22.625 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs 2023-12-12T11:23:22.625 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core 2023-12-12T11:23:22.625 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-12T11:23:22.626 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host 2023-12-12T11:23:22.626 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-12T11:23:22.626 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio 2023-12-12T11:23:22.626 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-12T11:23:22.626 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-12T11:23:22.626 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-12T11:23:22.626 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-12T11:23:22.626 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-12T11:23:22.626 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb 2023-12-12T11:23:22.626 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class 2023-12-12T11:23:22.626 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-12T11:23:22.626 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-12T11:23:22.626 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-12T11:23:22.626 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-12T11:23:22.626 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host 2023-12-12T11:23:22.627 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-12T11:23:22.627 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image 2023-12-12T11:23:22.627 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-12T11:23:22.627 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-12T11:23:22.627 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc 2023-12-12T11:23:22.627 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-12T11:23:22.627 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-12T11:23:22.627 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-12T11:23:22.627 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-12T11:23:22.627 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-12T11:23:22.627 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-12T11:23:22.627 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-12T11:23:22.627 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-12T11:23:22.627 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-12T11:23:22.627 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-12T11:23:22.627 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga 2023-12-12T11:23:22.628 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-12T11:23:22.628 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-12T11:23:22.628 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-12T11:23:22.628 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-12T11:23:22.628 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-12T11:23:22.628 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-12T11:23:22.628 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-12T11:23:22.628 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy 2023-12-12T11:23:22.628 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-12T11:23:22.628 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial 2023-12-12T11:23:22.628 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-12T11:23:22.628 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-12T11:23:22.628 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-12T11:23:22.628 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-12T11:23:22.628 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-12T11:23:22.628 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-12T11:23:22.628 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-12T11:23:22.629 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-12T11:23:22.629 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-12T11:23:22.629 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-12T11:23:22.629 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-12T11:23:22.629 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-12T11:23:22.629 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-12T11:23:22.629 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-12T11:23:22.629 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-12T11:23:22.629 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-12T11:23:22.629 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-12T11:23:22.629 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-12T11:23:22.629 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-12T11:23:22.629 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-12T11:23:22.629 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-12T11:23:22.629 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-12T11:23:22.629 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-12T11:23:22.630 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-12T11:23:22.630 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-12T11:23:22.630 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-12T11:23:22.630 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-12T11:23:22.630 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-12T11:23:22.630 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-12T11:23:22.630 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-12T11:23:22.630 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-12T11:23:22.630 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-12T11:23:22.630 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-12T11:23:22.630 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-12T11:23:22.630 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-12T11:23:22.630 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-12T11:23:22.630 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-12T11:23:22.630 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-12T11:23:22.631 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-12T11:23:22.631 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-12T11:23:22.631 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-12T11:23:22.631 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-12T11:23:22.631 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-12T11:23:22.631 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-12T11:23:22.631 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-12T11:23:22.631 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage 2023-12-12T11:23:22.631 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-12T11:23:22.631 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-12T11:23:22.631 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-12T11:23:22.631 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-12T11:23:22.631 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-12T11:23:22.631 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-12T11:23:22.631 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-12T11:23:22.631 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-12T11:23:22.632 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-12T11:23:22.632 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-12T11:23:22.632 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-12T11:23:22.632 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-12T11:23:22.632 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-12T11:23:22.632 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-12T11:23:22.632 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-12T11:23:22.632 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip 2023-12-12T11:23:22.632 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-12T11:23:22.632 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-12T11:23:22.632 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-12T11:23:22.632 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio 2023-12-12T11:23:22.632 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci 2023-12-12T11:23:22.632 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-12T11:23:22.632 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-12T11:23:22.632 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-12T11:23:22.633 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-12T11:23:22.633 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost 2023-12-12T11:23:22.633 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-12T11:23:22.633 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-12T11:23:22.633 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-12T11:23:22.633 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-12T11:23:22.633 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video 2023-12-12T11:23:22.633 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight 2023-12-12T11:23:22.633 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-12T11:23:22.633 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-12T11:23:22.633 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-12T11:23:22.633 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio 2023-12-12T11:23:22.633 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio.ko 2023-12-12T11:23:22.633 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_balloon.ko 2023-12-12T11:23:22.633 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_mmio.ko 2023-12-12T11:23:22.634 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci.ko 2023-12-12T11:23:22.634 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-12T11:23:22.634 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-12T11:23:22.634 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_ring.ko 2023-12-12T11:23:22.634 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1 2023-12-12T11:23:22.634 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters 2023-12-12T11:23:22.634 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-12T11:23:22.634 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-12T11:23:22.634 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves 2023-12-12T11:23:22.634 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-12T11:23:22.634 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-12T11:23:22.634 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-12T11:23:22.634 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-12T11:23:22.634 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-12T11:23:22.634 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-12T11:23:22.634 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-12T11:23:22.635 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-12T11:23:22.635 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-12T11:23:22.635 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-12T11:23:22.635 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-12T11:23:22.635 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-12T11:23:22.635 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog 2023-12-12T11:23:22.635 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-12T11:23:22.635 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-12T11:23:22.635 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-12T11:23:22.635 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-12T11:23:22.635 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-12T11:23:22.635 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-12T11:23:22.635 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-12T11:23:22.635 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-12T11:23:22.635 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-12T11:23:22.635 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-12T11:23:22.636 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-12T11:23:22.636 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-12T11:23:22.636 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-12T11:23:22.636 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-12T11:23:22.636 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-12T11:23:22.636 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-12T11:23:22.636 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-12T11:23:22.636 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-12T11:23:22.636 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-12T11:23:22.636 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-12T11:23:22.636 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-12T11:23:22.636 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-12T11:23:22.636 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-12T11:23:22.636 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-12T11:23:22.636 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-12T11:23:22.636 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-12T11:23:22.636 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen 2023-12-12T11:23:22.637 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-12T11:23:22.637 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-12T11:23:22.637 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-12T11:23:22.637 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-12T11:23:22.637 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback 2023-12-12T11:23:22.637 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-12T11:23:22.637 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-12T11:23:22.637 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs 2023-12-12T11:23:22.637 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-12T11:23:22.637 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs 2023-12-12T11:23:22.637 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p 2023-12-12T11:23:22.637 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-12T11:23:22.637 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs 2023-12-12T11:23:22.637 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-12T11:23:22.637 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs 2023-12-12T11:23:22.637 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-12T11:23:22.638 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-12T11:23:22.638 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs 2023-12-12T11:23:22.638 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-12T11:23:22.638 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles 2023-12-12T11:23:22.638 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-12T11:23:22.638 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph 2023-12-12T11:23:22.638 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-12T11:23:22.638 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda 2023-12-12T11:23:22.638 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-12T11:23:22.638 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs 2023-12-12T11:23:22.638 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-12T11:23:22.638 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm 2023-12-12T11:23:22.638 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-12T11:23:22.638 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs 2023-12-12T11:23:22.639 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-12T11:23:22.639 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs 2023-12-12T11:23:22.639 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-12T11:23:22.639 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat 2023-12-12T11:23:22.639 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/fat.ko 2023-12-12T11:23:22.639 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-12T11:23:22.639 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/vfat.ko 2023-12-12T11:23:22.639 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache 2023-12-12T11:23:22.639 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-12T11:23:22.639 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse 2023-12-12T11:23:22.639 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-12T11:23:22.639 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/fuse.ko 2023-12-12T11:23:22.639 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2 2023-12-12T11:23:22.639 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-12T11:23:22.639 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs 2023-12-12T11:23:22.639 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-12T11:23:22.640 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus 2023-12-12T11:23:22.640 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-12T11:23:22.640 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs 2023-12-12T11:23:22.640 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-12T11:23:22.640 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs 2023-12-12T11:23:22.640 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-12T11:23:22.640 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd 2023-12-12T11:23:22.640 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-12T11:23:22.640 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix 2023-12-12T11:23:22.640 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-12T11:23:22.640 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs 2023-12-12T11:23:22.640 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-12T11:23:22.640 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs 2023-12-12T11:23:22.640 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout 2023-12-12T11:23:22.640 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-12T11:23:22.640 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout 2023-12-12T11:23:22.641 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-12T11:23:22.641 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout 2023-12-12T11:23:22.641 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-12T11:23:22.641 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-12T11:23:22.641 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-12T11:23:22.641 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-12T11:23:22.641 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common 2023-12-12T11:23:22.641 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-12T11:23:22.641 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-12T11:23:22.641 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd 2023-12-12T11:23:22.641 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-12T11:23:22.641 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2 2023-12-12T11:23:22.641 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-12T11:23:22.641 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls 2023-12-12T11:23:22.641 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-12T11:23:22.642 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-12T11:23:22.642 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-12T11:23:22.642 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-12T11:23:22.642 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-12T11:23:22.642 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-12T11:23:22.642 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-12T11:23:22.642 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-12T11:23:22.642 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-12T11:23:22.642 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-12T11:23:22.642 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-12T11:23:22.642 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-12T11:23:22.642 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-12T11:23:22.642 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-12T11:23:22.642 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-12T11:23:22.642 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-12T11:23:22.643 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-12T11:23:22.643 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-12T11:23:22.643 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-12T11:23:22.643 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-12T11:23:22.643 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-12T11:23:22.643 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-12T11:23:22.643 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-12T11:23:22.643 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-12T11:23:22.643 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-12T11:23:22.643 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-12T11:23:22.643 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-12T11:23:22.643 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-12T11:23:22.643 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-12T11:23:22.643 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-12T11:23:22.643 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-12T11:23:22.643 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-12T11:23:22.644 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-12T11:23:22.644 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-12T11:23:22.644 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-12T11:23:22.644 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-12T11:23:22.644 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-12T11:23:22.644 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-12T11:23:22.644 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-12T11:23:22.644 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-12T11:23:22.644 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-12T11:23:22.644 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-12T11:23:22.644 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-12T11:23:22.644 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-12T11:23:22.644 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-12T11:23:22.644 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-12T11:23:22.644 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-12T11:23:22.644 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-12T11:23:22.645 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-12T11:23:22.645 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-12T11:23:22.645 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2 2023-12-12T11:23:22.645 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster 2023-12-12T11:23:22.645 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-12T11:23:22.645 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm 2023-12-12T11:23:22.645 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-12T11:23:22.645 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs 2023-12-12T11:23:22.645 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-12T11:23:22.645 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-12T11:23:22.645 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-12T11:23:22.645 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-12T11:23:22.645 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-12T11:23:22.645 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs 2023-12-12T11:23:22.645 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-12T11:23:22.645 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore 2023-12-12T11:23:22.646 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-12T11:23:22.646 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs 2023-12-12T11:23:22.646 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-12T11:23:22.646 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs 2023-12-12T11:23:22.646 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-12T11:23:22.646 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb 2023-12-12T11:23:22.646 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client 2023-12-12T11:23:22.646 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-12T11:23:22.646 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common 2023-12-12T11:23:22.646 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-12T11:23:22.646 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-12T11:23:22.646 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs 2023-12-12T11:23:22.646 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-12T11:23:22.646 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv 2023-12-12T11:23:22.646 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-12T11:23:22.647 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf 2023-12-12T11:23:22.647 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-12T11:23:22.647 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs 2023-12-12T11:23:22.647 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-12T11:23:22.647 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs 2023-12-12T11:23:22.647 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-12T11:23:22.647 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel 2023-12-12T11:23:22.647 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu 2023-12-12T11:23:22.647 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu/rcutorture.ko 2023-12-12T11:23:22.647 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-12T11:23:22.647 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace 2023-12-12T11:23:22.647 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-12T11:23:22.647 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib 2023-12-12T11:23:22.647 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/asn1_encoder.ko 2023-12-12T11:23:22.647 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-12T11:23:22.647 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-12T11:23:22.648 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto 2023-12-12T11:23:22.648 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-12T11:23:22.648 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-12T11:23:22.648 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-12T11:23:22.648 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-12T11:23:22.648 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4 2023-12-12T11:23:22.648 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-12T11:23:22.648 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-12T11:23:22.648 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math 2023-12-12T11:23:22.648 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-12T11:23:22.648 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6 2023-12-12T11:23:22.648 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-12T11:23:22.648 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon 2023-12-12T11:23:22.648 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-12T11:23:22.648 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-12T11:23:22.648 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-12T11:23:22.649 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-12T11:23:22.649 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd 2023-12-12T11:23:22.649 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd/zstd_compress.ko 2023-12-12T11:23:22.649 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm 2023-12-12T11:23:22.649 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-12T11:23:22.649 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net 2023-12-12T11:23:22.649 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan 2023-12-12T11:23:22.649 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-12T11:23:22.649 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-12T11:23:22.649 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-12T11:23:22.649 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-12T11:23:22.649 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-12T11:23:22.649 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-12T11:23:22.649 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-12T11:23:22.649 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-12T11:23:22.649 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802 2023-12-12T11:23:22.650 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-12T11:23:22.650 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-12T11:23:22.650 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-12T11:23:22.650 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-12T11:23:22.650 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-12T11:23:22.650 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q 2023-12-12T11:23:22.650 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-12T11:23:22.650 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p 2023-12-12T11:23:22.650 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-12T11:23:22.650 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-12T11:23:22.650 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-12T11:23:22.650 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-12T11:23:22.650 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv 2023-12-12T11:23:22.650 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-12T11:23:22.650 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge 2023-12-12T11:23:22.650 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-12T11:23:22.651 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-12T11:23:22.651 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter 2023-12-12T11:23:22.651 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-12T11:23:22.651 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-12T11:23:22.651 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-12T11:23:22.651 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-12T11:23:22.651 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-12T11:23:22.651 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-12T11:23:22.651 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-12T11:23:22.651 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-12T11:23:22.651 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-12T11:23:22.651 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-12T11:23:22.651 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-12T11:23:22.651 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-12T11:23:22.651 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-12T11:23:22.651 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-12T11:23:22.652 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-12T11:23:22.652 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-12T11:23:22.652 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-12T11:23:22.652 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-12T11:23:22.652 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-12T11:23:22.652 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-12T11:23:22.652 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-12T11:23:22.652 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-12T11:23:22.652 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-12T11:23:22.652 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-12T11:23:22.652 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph 2023-12-12T11:23:22.652 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-12T11:23:22.652 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core 2023-12-12T11:23:22.652 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/failover.ko 2023-12-12T11:23:22.652 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-12T11:23:22.652 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp 2023-12-12T11:23:22.653 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-12T11:23:22.653 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-12T11:23:22.653 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-12T11:23:22.653 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-12T11:23:22.653 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver 2023-12-12T11:23:22.653 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver/dns_resolver.ko 2023-12-12T11:23:22.653 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa 2023-12-12T11:23:22.653 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-12T11:23:22.653 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-12T11:23:22.653 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-12T11:23:22.653 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-12T11:23:22.653 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-12T11:23:22.653 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154 2023-12-12T11:23:22.653 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan 2023-12-12T11:23:22.653 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-12T11:23:22.653 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-12T11:23:22.654 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-12T11:23:22.654 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4 2023-12-12T11:23:22.654 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-12T11:23:22.654 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-12T11:23:22.654 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-12T11:23:22.654 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-12T11:23:22.654 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-12T11:23:22.654 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-12T11:23:22.654 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-12T11:23:22.654 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-12T11:23:22.654 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-12T11:23:22.654 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-12T11:23:22.654 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter 2023-12-12T11:23:22.654 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-12T11:23:22.654 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-12T11:23:22.654 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-12T11:23:22.655 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-12T11:23:22.655 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-12T11:23:22.655 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-12T11:23:22.655 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-12T11:23:22.655 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-12T11:23:22.655 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-12T11:23:22.655 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-12T11:23:22.655 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-12T11:23:22.655 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-12T11:23:22.655 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-12T11:23:22.655 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-12T11:23:22.655 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-12T11:23:22.655 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-12T11:23:22.655 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-12T11:23:22.655 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-12T11:23:22.656 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-12T11:23:22.656 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-12T11:23:22.656 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-12T11:23:22.656 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-12T11:23:22.656 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-12T11:23:22.656 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-12T11:23:22.656 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-12T11:23:22.656 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-12T11:23:22.656 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-12T11:23:22.656 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-12T11:23:22.656 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-12T11:23:22.656 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-12T11:23:22.656 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-12T11:23:22.656 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-12T11:23:22.656 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-12T11:23:22.656 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-12T11:23:22.657 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-12T11:23:22.657 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-12T11:23:22.657 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-12T11:23:22.657 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-12T11:23:22.657 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6 2023-12-12T11:23:22.657 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-12T11:23:22.657 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-12T11:23:22.657 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-12T11:23:22.657 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-12T11:23:22.657 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-12T11:23:22.657 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-12T11:23:22.657 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-12T11:23:22.657 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter 2023-12-12T11:23:22.657 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-12T11:23:22.657 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-12T11:23:22.657 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-12T11:23:22.658 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-12T11:23:22.658 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-12T11:23:22.658 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-12T11:23:22.658 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-12T11:23:22.658 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-12T11:23:22.658 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-12T11:23:22.658 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-12T11:23:22.658 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-12T11:23:22.658 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-12T11:23:22.658 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-12T11:23:22.658 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-12T11:23:22.658 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-12T11:23:22.658 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-12T11:23:22.658 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-12T11:23:22.658 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-12T11:23:22.659 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-12T11:23:22.659 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-12T11:23:22.659 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-12T11:23:22.659 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-12T11:23:22.659 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-12T11:23:22.659 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-12T11:23:22.659 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-12T11:23:22.659 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-12T11:23:22.659 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-12T11:23:22.659 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key 2023-12-12T11:23:22.659 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-12T11:23:22.659 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp 2023-12-12T11:23:22.659 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-12T11:23:22.659 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-12T11:23:22.659 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-12T11:23:22.659 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-12T11:23:22.660 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-12T11:23:22.660 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-12T11:23:22.660 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-12T11:23:22.660 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc 2023-12-12T11:23:22.660 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-12T11:23:22.660 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154 2023-12-12T11:23:22.660 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-12T11:23:22.660 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls 2023-12-12T11:23:22.660 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-12T11:23:22.660 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter 2023-12-12T11:23:22.660 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset 2023-12-12T11:23:22.660 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-12T11:23:22.660 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-12T11:23:22.660 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-12T11:23:22.660 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-12T11:23:22.660 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-12T11:23:22.661 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-12T11:23:22.661 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-12T11:23:22.661 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-12T11:23:22.661 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-12T11:23:22.661 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-12T11:23:22.661 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-12T11:23:22.661 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-12T11:23:22.661 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-12T11:23:22.661 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-12T11:23:22.661 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-12T11:23:22.661 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-12T11:23:22.661 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs 2023-12-12T11:23:22.661 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-12T11:23:22.661 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-12T11:23:22.661 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-12T11:23:22.661 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-12T11:23:22.662 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-12T11:23:22.662 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-12T11:23:22.662 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-12T11:23:22.662 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-12T11:23:22.662 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-12T11:23:22.662 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-12T11:23:22.662 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-12T11:23:22.662 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-12T11:23:22.662 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-12T11:23:22.662 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-12T11:23:22.662 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-12T11:23:22.662 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-12T11:23:22.662 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-12T11:23:22.662 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-12T11:23:22.662 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-12T11:23:22.662 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-12T11:23:22.663 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-12T11:23:22.663 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-12T11:23:22.663 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-12T11:23:22.663 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-12T11:23:22.663 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-12T11:23:22.663 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-12T11:23:22.663 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-12T11:23:22.663 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-12T11:23:22.663 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-12T11:23:22.663 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-12T11:23:22.663 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-12T11:23:22.663 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-12T11:23:22.663 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-12T11:23:22.663 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-12T11:23:22.663 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-12T11:23:22.664 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-12T11:23:22.664 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-12T11:23:22.664 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-12T11:23:22.664 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-12T11:23:22.664 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-12T11:23:22.664 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-12T11:23:22.664 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-12T11:23:22.664 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-12T11:23:22.664 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-12T11:23:22.664 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-12T11:23:22.664 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-12T11:23:22.664 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-12T11:23:22.664 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-12T11:23:22.664 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-12T11:23:22.664 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-12T11:23:22.664 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-12T11:23:22.665 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-12T11:23:22.665 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-12T11:23:22.665 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-12T11:23:22.665 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-12T11:23:22.665 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-12T11:23:22.665 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-12T11:23:22.665 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-12T11:23:22.665 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_quota.ko 2023-12-12T11:23:22.665 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-12T11:23:22.665 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-12T11:23:22.665 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-12T11:23:22.665 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-12T11:23:22.665 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tunnel.ko 2023-12-12T11:23:22.665 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-12T11:23:22.665 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-12T11:23:22.665 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-12T11:23:22.666 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-12T11:23:22.666 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-12T11:23:22.666 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-12T11:23:22.666 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-12T11:23:22.666 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-12T11:23:22.666 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-12T11:23:22.666 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-12T11:23:22.666 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-12T11:23:22.666 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-12T11:23:22.666 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-12T11:23:22.666 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-12T11:23:22.666 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-12T11:23:22.666 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-12T11:23:22.666 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-12T11:23:22.666 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-12T11:23:22.667 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-12T11:23:22.667 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-12T11:23:22.667 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-12T11:23:22.667 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-12T11:23:22.667 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-12T11:23:22.667 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-12T11:23:22.667 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-12T11:23:22.667 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-12T11:23:22.667 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-12T11:23:22.667 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-12T11:23:22.667 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-12T11:23:22.667 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-12T11:23:22.667 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-12T11:23:22.667 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-12T11:23:22.667 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-12T11:23:22.667 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-12T11:23:22.668 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-12T11:23:22.668 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-12T11:23:22.668 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-12T11:23:22.668 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-12T11:23:22.668 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-12T11:23:22.668 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-12T11:23:22.668 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-12T11:23:22.668 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-12T11:23:22.668 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-12T11:23:22.668 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-12T11:23:22.668 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-12T11:23:22.668 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-12T11:23:22.668 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-12T11:23:22.668 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-12T11:23:22.668 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-12T11:23:22.668 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-12T11:23:22.669 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-12T11:23:22.669 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-12T11:23:22.669 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-12T11:23:22.669 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-12T11:23:22.669 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-12T11:23:22.669 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-12T11:23:22.669 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-12T11:23:22.669 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-12T11:23:22.669 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-12T11:23:22.669 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-12T11:23:22.669 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-12T11:23:22.669 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-12T11:23:22.669 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-12T11:23:22.669 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-12T11:23:22.669 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-12T11:23:22.669 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-12T11:23:22.670 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-12T11:23:22.670 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-12T11:23:22.670 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-12T11:23:22.670 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-12T11:23:22.670 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-12T11:23:22.670 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink 2023-12-12T11:23:22.670 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-12T11:23:22.670 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh 2023-12-12T11:23:22.670 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-12T11:23:22.670 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch 2023-12-12T11:23:22.670 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-12T11:23:22.670 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-12T11:23:22.670 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-12T11:23:22.670 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-12T11:23:22.670 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet 2023-12-12T11:23:22.671 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-12T11:23:22.671 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds 2023-12-12T11:23:22.671 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-12T11:23:22.671 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-12T11:23:22.671 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-12T11:23:22.671 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched 2023-12-12T11:23:22.671 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-12T11:23:22.671 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-12T11:23:22.671 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-12T11:23:22.671 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-12T11:23:22.671 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-12T11:23:22.671 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-12T11:23:22.671 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-12T11:23:22.671 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-12T11:23:22.671 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-12T11:23:22.672 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-12T11:23:22.672 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-12T11:23:22.672 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-12T11:23:22.672 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-12T11:23:22.672 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-12T11:23:22.672 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-12T11:23:22.672 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-12T11:23:22.672 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-12T11:23:22.672 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-12T11:23:22.672 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-12T11:23:22.672 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-12T11:23:22.672 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-12T11:23:22.672 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-12T11:23:22.672 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-12T11:23:22.672 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-12T11:23:22.672 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-12T11:23:22.672 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-12T11:23:22.673 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-12T11:23:22.673 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-12T11:23:22.673 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-12T11:23:22.673 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-12T11:23:22.673 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-12T11:23:22.673 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-12T11:23:22.673 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-12T11:23:22.673 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-12T11:23:22.673 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-12T11:23:22.673 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-12T11:23:22.673 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-12T11:23:22.673 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-12T11:23:22.673 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-12T11:23:22.673 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-12T11:23:22.673 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-12T11:23:22.673 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-12T11:23:22.674 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-12T11:23:22.674 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-12T11:23:22.674 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp 2023-12-12T11:23:22.674 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-12T11:23:22.674 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-12T11:23:22.674 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc 2023-12-12T11:23:22.674 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss 2023-12-12T11:23:22.674 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-12T11:23:22.674 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-12T11:23:22.674 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-12T11:23:22.674 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma 2023-12-12T11:23:22.674 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-12T11:23:22.674 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc 2023-12-12T11:23:22.674 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-12T11:23:22.675 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-12T11:23:22.675 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix 2023-12-12T11:23:22.675 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-12T11:23:22.675 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock 2023-12-12T11:23:22.675 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-12T11:23:22.675 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-12T11:23:22.675 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-12T11:23:22.675 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-12T11:23:22.675 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-12T11:23:22.675 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm 2023-12-12T11:23:22.675 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-12T11:23:22.675 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security 2023-12-12T11:23:22.675 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys 2023-12-12T11:23:22.675 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys 2023-12-12T11:23:22.675 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-12T11:23:22.675 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys 2023-12-12T11:23:22.676 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys/trusted.ko 2023-12-12T11:23:22.676 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt 2023-12-12T11:23:22.676 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib 2023-12-12T11:23:22.676 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-12T11:23:22.676 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-12T11:23:22.676 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-12T11:23:22.676 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-12T11:23:22.676 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-12T11:23:22.676 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-12T11:23:22.676 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-12T11:23:22.676 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-12T11:23:22.676 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-12T11:23:22.676 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-12T11:23:22.676 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-12T11:23:22.676 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-12T11:23:22.676 INFO:teuthology.orchestra.run.smithi093.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-12T11:23:22.677 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-12T11:23:22.677 DEBUG:teuthology.orchestra.run.smithi093:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-12T11:23:22.704 INFO:teuthology.orchestra.run.smithi093.stdout:postinstall scriptlet (using /bin/sh): 2023-12-12T11:23:22.704 INFO:teuthology.orchestra.run.smithi093.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-gcd68252d7b4d -a -r /boot/System.map-6.6.0-gcd68252d7b4d ]; then 2023-12-12T11:23:22.704 INFO:teuthology.orchestra.run.smithi093.stdout:cp /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm 2023-12-12T11:23:22.704 INFO:teuthology.orchestra.run.smithi093.stdout:cp /boot/System.map-6.6.0-gcd68252d7b4d /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-12T11:23:22.705 INFO:teuthology.orchestra.run.smithi093.stdout:rm -f /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/System.map-6.6.0-gcd68252d7b4d 2023-12-12T11:23:22.705 INFO:teuthology.orchestra.run.smithi093.stdout:/sbin/installkernel 6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-12T11:23:22.705 INFO:teuthology.orchestra.run.smithi093.stdout:rm -f /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-12T11:23:22.705 INFO:teuthology.orchestra.run.smithi093.stdout:fi 2023-12-12T11:23:22.705 INFO:teuthology.orchestra.run.smithi093.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-12T11:23:22.705 INFO:teuthology.orchestra.run.smithi093.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-12T11:23:22.705 INFO:teuthology.orchestra.run.smithi093.stdout:new-kernel-pkg --remove 6.6.0-gcd68252d7b4d --rminitrd --initrdfile=/boot/initramfs-6.6.0-gcd68252d7b4d.img 2023-12-12T11:23:22.705 INFO:teuthology.orchestra.run.smithi093.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-12T11:23:22.705 INFO:teuthology.orchestra.run.smithi093.stdout:kernel-install remove 6.6.0-gcd68252d7b4d 2023-12-12T11:23:22.705 INFO:teuthology.orchestra.run.smithi093.stdout:fi 2023-12-12T11:23:22.705 INFO:teuthology.orchestra.run.smithi093.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-12T11:23:22.705 INFO:teuthology.orchestra.run.smithi093.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-12T11:23:22.705 INFO:teuthology.orchestra.run.smithi093.stdout:/sbin/update-bootloader --remove 6.6.0-gcd68252d7b4d 2023-12-12T11:23:22.705 INFO:teuthology.orchestra.run.smithi093.stdout:fi 2023-12-12T11:23:22.706 DEBUG:teuthology.orchestra.run.smithi093:> sudo rpm -qi grub2-tools 2023-12-12T11:23:22.783 INFO:teuthology.orchestra.run.smithi093.stdout:Name : grub2-tools 2023-12-12T11:23:22.784 INFO:teuthology.orchestra.run.smithi093.stdout:Epoch : 1 2023-12-12T11:23:22.784 INFO:teuthology.orchestra.run.smithi093.stdout:Version : 2.02 2023-12-12T11:23:22.784 INFO:teuthology.orchestra.run.smithi093.stdout:Release : 129.el8 2023-12-12T11:23:22.784 INFO:teuthology.orchestra.run.smithi093.stdout:Architecture: x86_64 2023-12-12T11:23:22.784 INFO:teuthology.orchestra.run.smithi093.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-12-12T11:23:22.784 INFO:teuthology.orchestra.run.smithi093.stdout:Group : System Environment/Base 2023-12-12T11:23:22.784 INFO:teuthology.orchestra.run.smithi093.stdout:Size : 9265586 2023-12-12T11:23:22.784 INFO:teuthology.orchestra.run.smithi093.stdout:License : GPLv3+ 2023-12-12T11:23:22.784 INFO:teuthology.orchestra.run.smithi093.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-12-12T11:23:22.784 INFO:teuthology.orchestra.run.smithi093.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-12-12T11:23:22.784 INFO:teuthology.orchestra.run.smithi093.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-12-12T11:23:22.784 INFO:teuthology.orchestra.run.smithi093.stdout:Build Host : kbuilder.bsys.centos.org 2023-12-12T11:23:22.784 INFO:teuthology.orchestra.run.smithi093.stdout:Relocations : (not relocatable) 2023-12-12T11:23:22.784 INFO:teuthology.orchestra.run.smithi093.stdout:Packager : CentOS BuildSystem 2023-12-12T11:23:22.784 INFO:teuthology.orchestra.run.smithi093.stdout:Vendor : CentOS 2023-12-12T11:23:22.784 INFO:teuthology.orchestra.run.smithi093.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-12T11:23:22.785 INFO:teuthology.orchestra.run.smithi093.stdout:Summary : Support tools for GRUB. 2023-12-12T11:23:22.785 INFO:teuthology.orchestra.run.smithi093.stdout:Description : 2023-12-12T11:23:22.785 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:23:22.785 INFO:teuthology.orchestra.run.smithi093.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-12T11:23:22.785 INFO:teuthology.orchestra.run.smithi093.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-12T11:23:22.785 INFO:teuthology.orchestra.run.smithi093.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-12T11:23:22.785 INFO:teuthology.orchestra.run.smithi093.stdout:hardware devices. 2023-12-12T11:23:22.785 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:23:22.785 INFO:teuthology.orchestra.run.smithi093.stdout:This subpackage provides tools for support of all platforms. 2023-12-12T11:23:22.786 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-12T11:23:22.786 INFO:teuthology.task.kernel:Updating grub on smithi093 to boot 6.6.0-gcd68252d7b4d 2023-12-12T11:23:22.786 DEBUG:teuthology.orchestra.run.smithi093:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-12T11:23:26.307 INFO:teuthology.orchestra.run.smithi093.stderr:Generating grub configuration file ... 2023-12-12T11:23:28.634 INFO:teuthology.orchestra.run.smithi093.stderr:done 2023-12-12T11:23:28.636 DEBUG:teuthology.orchestra.run.smithi093:> mktemp 2023-12-12T11:23:28.658 INFO:teuthology.orchestra.run.smithi093.stdout:/tmp/tmp.Gvs6iPWbsN 2023-12-12T11:23:28.658 DEBUG:teuthology.orchestra.run.smithi093:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Gvs6iPWbsN 2023-12-12T11:23:28.734 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 0666 /tmp/tmp.Gvs6iPWbsN 2023-12-12T11:23:28.888 DEBUG:teuthology.orchestra.remote:smithi093:/tmp/tmp.Gvs6iPWbsN is 6KB 2023-12-12T11:23:28.936 DEBUG:teuthology.orchestra.run.smithi093:> rm -fr /tmp/tmp.Gvs6iPWbsN 2023-12-12T11:23:28.954 DEBUG:teuthology.orchestra.run.smithi093:> sudo /bin/ls /boot/loader/entries || true 2023-12-12T11:23:29.019 INFO:teuthology.orchestra.run.smithi093.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-12-12T11:23:29.020 INFO:teuthology.orchestra.run.smithi093.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-12-12T11:23:29.020 INFO:teuthology.orchestra.run.smithi093.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-12-12T11:23:29.020 INFO:teuthology.orchestra.run.smithi093.stdout:a1b29d6c289747bdb22930598d39874a-6.6.0-gcd68252d7b4d.conf 2023-12-12T11:23:29.021 DEBUG:teuthology.orchestra.run.smithi093:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.6.0-gcd68252d7b4d 2023-12-12T11:23:29.207 DEBUG:teuthology.orchestra.run.smithi093:> sudo shutdown -r now 2023-12-12T11:23:59.209 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2023-12-12T11:23:59.210 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-12-12T11:23:59.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:24:28.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12 11:24:28 URL:https://1.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/8/flavors/default/x86_64/kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm [383180176/383180176] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-12T11:24:28.568 INFO:teuthology.orchestra.run.smithi063.stderr:FINISHED --2023-12-12 11:24:28-- 2023-12-12T11:24:28.568 INFO:teuthology.orchestra.run.smithi063.stderr:Total wall clock time: 2m 20s 2023-12-12T11:24:28.569 INFO:teuthology.orchestra.run.smithi063.stderr:Downloaded: 1 files, 365M in 2m 20s (2.62 MB/s) 2023-12-12T11:24:28.574 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on host.a... 2023-12-12T11:24:28.574 DEBUG:teuthology.orchestra.run.smithi063:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-12T11:24:30.340 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying... ######################################## 2023-12-12T11:24:30.386 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing... ######################################## 2023-12-12T11:24:30.501 INFO:teuthology.orchestra.run.smithi063.stdout:Updating / installing... 2023-12-12T11:24:33.766 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-12-12T11:24:42.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-12-12T11:24:42.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:25:01.154 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-12-12T11:25:11.386 INFO:teuthology.orchestra.run.smithi063.stdout:kernel-6.6.0_gcd68252d7b4d-1 ######################################## 2023-12-12T11:25:13.156 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-12-12T11:25:13.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:25:13.562 DEBUG:teuthology.orchestra.run.smithi093:> true 2023-12-12T11:25:13.602 INFO:teuthology.orchestra.run.smithi063.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-12T11:25:14.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-12-12T11:25:14.100 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "6.6.0-gcd68252d7b4d"... 2023-12-12T11:25:14.100 DEBUG:teuthology.orchestra.run.smithi093:> uname -r 2023-12-12T11:25:14.144 INFO:teuthology.orchestra.run.smithi093.stdout:6.6.0-gcd68252d7b4d 2023-12-12T11:25:14.145 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-12T11:25:14.145 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-12T11:25:14.145 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-12T11:25:15.146 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2023-12-12T11:25:15.146 DEBUG:teuthology.orchestra.run.smithi093:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-12T11:25:15.245 INFO:teuthology.orchestra.run.smithi093.stdout:ttyS1 2023-12-12T11:25:15.270 DEBUG:teuthology.parallel:result is None 2023-12-12T11:25:34.375 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi063.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-12T11:25:34.375 DEBUG:teuthology.orchestra.run.smithi063:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-12T11:25:34.455 INFO:teuthology.orchestra.run.smithi063.stdout:/boot/System.map-6.6.0-gcd68252d7b4d 2023-12-12T11:25:34.455 INFO:teuthology.orchestra.run.smithi063.stdout:/boot/config-6.6.0-gcd68252d7b4d 2023-12-12T11:25:34.455 INFO:teuthology.orchestra.run.smithi063.stdout:/boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-12T11:25:34.455 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d 2023-12-12T11:25:34.455 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel 2023-12-12T11:25:34.455 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch 2023-12-12T11:25:34.455 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86 2023-12-12T11:25:34.455 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto 2023-12-12T11:25:34.455 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-12T11:25:34.455 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-12T11:25:34.455 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-12T11:25:34.456 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-12T11:25:34.456 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-12T11:25:34.456 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-12T11:25:34.456 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-12T11:25:34.456 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-12T11:25:34.456 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-12T11:25:34.456 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-12T11:25:34.456 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-12T11:25:34.456 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-12T11:25:34.456 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-12T11:25:34.456 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-12T11:25:34.456 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-12T11:25:34.456 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-12T11:25:34.456 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-12T11:25:34.457 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-12T11:25:34.457 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-12T11:25:34.457 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-12T11:25:34.457 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel 2023-12-12T11:25:34.457 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu 2023-12-12T11:25:34.457 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce 2023-12-12T11:25:34.457 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-12T11:25:34.457 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm 2023-12-12T11:25:34.457 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-12T11:25:34.457 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-12T11:25:34.457 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-12T11:25:34.457 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto 2023-12-12T11:25:34.457 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-12T11:25:34.457 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-12T11:25:34.457 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-12T11:25:34.458 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx 2023-12-12T11:25:34.458 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-12T11:25:34.458 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-12T11:25:34.458 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-12T11:25:34.458 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-12T11:25:34.458 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-12T11:25:34.458 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-12T11:25:34.458 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-12T11:25:34.458 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-12T11:25:34.459 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-12T11:25:34.459 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-12T11:25:34.459 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-12T11:25:34.459 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-12T11:25:34.459 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-12T11:25:34.459 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-12T11:25:34.459 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-12T11:25:34.459 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-12T11:25:34.459 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-12T11:25:34.459 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-12T11:25:34.459 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-12T11:25:34.459 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-12T11:25:34.459 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-12T11:25:34.459 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-12T11:25:34.460 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-12T11:25:34.460 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-12T11:25:34.460 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-12T11:25:34.460 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-12T11:25:34.460 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-12T11:25:34.460 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-12T11:25:34.460 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-12T11:25:34.460 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-12T11:25:34.460 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-12T11:25:34.460 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-12T11:25:34.460 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-12T11:25:34.460 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-12T11:25:34.460 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-12T11:25:34.460 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-12T11:25:34.461 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-12T11:25:34.461 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-12T11:25:34.461 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-12T11:25:34.461 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-12T11:25:34.461 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-12T11:25:34.461 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-12T11:25:34.461 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-12T11:25:34.461 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-12T11:25:34.461 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-12T11:25:34.461 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers 2023-12-12T11:25:34.461 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi 2023-12-12T11:25:34.461 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-12T11:25:34.461 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-12T11:25:34.461 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/custom_method.ko 2023-12-12T11:25:34.461 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-12T11:25:34.461 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-12T11:25:34.462 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-12T11:25:34.462 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-12T11:25:34.462 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-12T11:25:34.462 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata 2023-12-12T11:25:34.462 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-12T11:25:34.462 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-12T11:25:34.462 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ata_generic.ko 2023-12-12T11:25:34.462 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-12T11:25:34.462 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-12T11:25:34.462 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-12T11:25:34.462 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-12T11:25:34.462 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-12T11:25:34.462 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-12T11:25:34.463 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-12T11:25:34.463 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-12T11:25:34.463 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-12T11:25:34.463 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-12T11:25:34.463 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-12T11:25:34.463 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-12T11:25:34.463 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-12T11:25:34.463 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-12T11:25:34.463 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-12T11:25:34.463 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-12T11:25:34.463 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-12T11:25:34.463 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-12T11:25:34.463 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-12T11:25:34.463 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-12T11:25:34.463 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-12T11:25:34.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-12T11:25:34.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-12T11:25:34.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-12T11:25:34.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-12T11:25:34.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-12T11:25:34.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-12T11:25:34.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-12T11:25:34.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-12T11:25:34.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-12T11:25:34.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-12T11:25:34.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-12T11:25:34.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-12T11:25:34.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-12T11:25:34.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-12T11:25:34.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sis.ko 2023-12-12T11:25:34.464 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-12T11:25:34.465 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-12T11:25:34.465 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-12T11:25:34.465 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-12T11:25:34.465 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-12T11:25:34.465 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-12T11:25:34.465 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-12T11:25:34.465 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-12T11:25:34.465 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-12T11:25:34.465 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-12T11:25:34.465 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-12T11:25:34.465 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-12T11:25:34.465 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-12T11:25:34.465 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-12T11:25:34.466 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-12T11:25:34.466 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-12T11:25:34.466 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-12T11:25:34.466 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay 2023-12-12T11:25:34.466 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-12T11:25:34.466 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base 2023-12-12T11:25:34.466 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap 2023-12-12T11:25:34.466 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-12T11:25:34.466 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-12T11:25:34.467 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma 2023-12-12T11:25:34.467 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-12T11:25:34.467 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block 2023-12-12T11:25:34.467 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe 2023-12-12T11:25:34.467 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-12T11:25:34.467 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/brd.ko 2023-12-12T11:25:34.467 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd 2023-12-12T11:25:34.467 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-12T11:25:34.467 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-12T11:25:34.467 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/loop.ko 2023-12-12T11:25:34.467 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx 2023-12-12T11:25:34.467 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-12T11:25:34.467 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-12T11:25:34.467 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk 2023-12-12T11:25:34.468 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-12T11:25:34.468 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-12T11:25:34.468 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-12T11:25:34.468 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/virtio_blk.ko 2023-12-12T11:25:34.468 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback 2023-12-12T11:25:34.468 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-12T11:25:34.468 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkfront.ko 2023-12-12T11:25:34.468 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram 2023-12-12T11:25:34.468 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-12T11:25:34.468 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char 2023-12-12T11:25:34.468 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-12T11:25:34.468 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random 2023-12-12T11:25:34.468 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-12T11:25:34.468 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-12T11:25:34.469 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-12T11:25:34.469 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-12T11:25:34.469 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-12T11:25:34.469 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi 2023-12-12T11:25:34.469 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-12T11:25:34.469 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-12T11:25:34.469 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-12T11:25:34.469 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-12T11:25:34.469 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-12T11:25:34.469 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-12T11:25:34.469 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-12T11:25:34.469 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave 2023-12-12T11:25:34.469 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-12T11:25:34.469 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-12T11:25:34.469 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-12T11:25:34.470 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm 2023-12-12T11:25:34.470 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm.ko 2023-12-12T11:25:34.470 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-12T11:25:34.470 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-12T11:25:34.470 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-12T11:25:34.470 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-12T11:25:34.470 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-12T11:25:34.470 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/uv_mmtimer.ko 2023-12-12T11:25:34.470 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/virtio_console.ko 2023-12-12T11:25:34.470 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq 2023-12-12T11:25:34.470 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-12T11:25:34.470 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-12T11:25:34.470 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-12T11:25:34.471 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-12T11:25:34.471 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-12T11:25:34.471 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-12T11:25:34.471 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto 2023-12-12T11:25:34.471 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp 2023-12-12T11:25:34.471 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-12T11:25:34.471 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-12T11:25:34.471 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel 2023-12-12T11:25:34.471 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat 2023-12-12T11:25:34.471 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common 2023-12-12T11:25:34.471 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-12T11:25:34.471 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-12T11:25:34.471 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-12T11:25:34.471 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-12T11:25:34.472 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-12T11:25:34.472 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio 2023-12-12T11:25:34.472 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-12T11:25:34.472 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca 2023-12-12T11:25:34.472 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-12T11:25:34.472 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq 2023-12-12T11:25:34.472 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-12T11:25:34.472 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma 2023-12-12T11:25:34.472 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw 2023-12-12T11:25:34.472 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-12T11:25:34.472 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat 2023-12-12T11:25:34.472 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-12T11:25:34.472 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac 2023-12-12T11:25:34.473 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-12T11:25:34.473 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-12T11:25:34.473 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-12T11:25:34.473 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-12T11:25:34.473 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-12T11:25:34.473 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-12T11:25:34.473 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-12T11:25:34.473 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-12T11:25:34.473 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-12T11:25:34.473 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-12T11:25:34.473 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-12T11:25:34.473 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-12T11:25:34.473 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-12T11:25:34.473 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware 2023-12-12T11:25:34.474 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/edd.ko 2023-12-12T11:25:34.474 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-12T11:25:34.474 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio 2023-12-12T11:25:34.474 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-12T11:25:34.474 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-12T11:25:34.474 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid 2023-12-12T11:25:34.474 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-12T11:25:34.474 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-12T11:25:34.474 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-12T11:25:34.474 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-12T11:25:34.474 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-12T11:25:34.474 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-12T11:25:34.474 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-12T11:25:34.475 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-12T11:25:34.475 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-12T11:25:34.475 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-12T11:25:34.475 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-12T11:25:34.475 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-12T11:25:34.475 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-12T11:25:34.475 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-12T11:25:34.475 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-12T11:25:34.475 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-12T11:25:34.475 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-12T11:25:34.475 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-12T11:25:34.475 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-12T11:25:34.476 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-12T11:25:34.476 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-12T11:25:34.476 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-12T11:25:34.476 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-12T11:25:34.476 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-12T11:25:34.476 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-12T11:25:34.476 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-12T11:25:34.476 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-12T11:25:34.476 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-12T11:25:34.476 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-12T11:25:34.476 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-12T11:25:34.476 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-12T11:25:34.477 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-12T11:25:34.477 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-12T11:25:34.477 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-12T11:25:34.477 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-12T11:25:34.477 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-12T11:25:34.477 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-12T11:25:34.477 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-12T11:25:34.477 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-12T11:25:34.477 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-12T11:25:34.477 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-12T11:25:34.478 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-12T11:25:34.478 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-12T11:25:34.478 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-12T11:25:34.479 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-12T11:25:34.479 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-12T11:25:34.479 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-12T11:25:34.480 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-12T11:25:34.480 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-12T11:25:34.480 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-12T11:25:34.480 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-12T11:25:34.480 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-12T11:25:34.480 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-12T11:25:34.481 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-12T11:25:34.481 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-12T11:25:34.481 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-12T11:25:34.481 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-12T11:25:34.481 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-12T11:25:34.481 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-12T11:25:34.481 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-12T11:25:34.482 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-12T11:25:34.482 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-12T11:25:34.482 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-12T11:25:34.482 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-12T11:25:34.482 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv 2023-12-12T11:25:34.483 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-12T11:25:34.483 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-12T11:25:34.483 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-12T11:25:34.483 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon 2023-12-12T11:25:34.483 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-12T11:25:34.483 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-12T11:25:34.483 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-12T11:25:34.483 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-12T11:25:34.484 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-12T11:25:34.484 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-12T11:25:34.484 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-12T11:25:34.484 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-12T11:25:34.484 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-12T11:25:34.484 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-12T11:25:34.484 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-12T11:25:34.484 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-12T11:25:34.485 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-12T11:25:34.485 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-12T11:25:34.485 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-12T11:25:34.485 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-12T11:25:34.485 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-12T11:25:34.485 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-12T11:25:34.485 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-12T11:25:34.485 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-12T11:25:34.485 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-12T11:25:34.485 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-12T11:25:34.485 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-12T11:25:34.486 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-12T11:25:34.486 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-12T11:25:34.486 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-12T11:25:34.486 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-12T11:25:34.486 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-12T11:25:34.486 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-12T11:25:34.486 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-12T11:25:34.486 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-12T11:25:34.486 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-12T11:25:34.486 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-12T11:25:34.486 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-12T11:25:34.487 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-12T11:25:34.487 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-12T11:25:34.487 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-12T11:25:34.487 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-12T11:25:34.487 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-12T11:25:34.487 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-12T11:25:34.487 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-12T11:25:34.487 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-12T11:25:34.487 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-12T11:25:34.487 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-12T11:25:34.487 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-12T11:25:34.487 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-12T11:25:34.487 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-12T11:25:34.487 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-12T11:25:34.487 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-12T11:25:34.488 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-12T11:25:34.488 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-12T11:25:34.488 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-12T11:25:34.488 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-12T11:25:34.488 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-12T11:25:34.488 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-12T11:25:34.488 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-12T11:25:34.488 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-12T11:25:34.488 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-12T11:25:34.488 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-12T11:25:34.488 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-12T11:25:34.488 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-12T11:25:34.488 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-12T11:25:34.489 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-12T11:25:34.489 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-12T11:25:34.489 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-12T11:25:34.489 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-12T11:25:34.489 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-12T11:25:34.489 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-12T11:25:34.489 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-12T11:25:34.489 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-12T11:25:34.489 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-12T11:25:34.489 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-12T11:25:34.489 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-12T11:25:34.489 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-12T11:25:34.490 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-12T11:25:34.490 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-12T11:25:34.490 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-12T11:25:34.490 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-12T11:25:34.490 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-12T11:25:34.490 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-12T11:25:34.490 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-12T11:25:34.490 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-12T11:25:34.491 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-12T11:25:34.491 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-12T11:25:34.491 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-12T11:25:34.491 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-12T11:25:34.491 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-12T11:25:34.492 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-12T11:25:34.492 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus 2023-12-12T11:25:34.492 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-12T11:25:34.492 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-12T11:25:34.492 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-12T11:25:34.492 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-12T11:25:34.492 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-12T11:25:34.492 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-12T11:25:34.492 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-12T11:25:34.493 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-12T11:25:34.493 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-12T11:25:34.493 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-12T11:25:34.493 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-12T11:25:34.493 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-12T11:25:34.493 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-12T11:25:34.494 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-12T11:25:34.494 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-12T11:25:34.494 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-12T11:25:34.494 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-12T11:25:34.494 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-12T11:25:34.494 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-12T11:25:34.494 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-12T11:25:34.495 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-12T11:25:34.495 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-12T11:25:34.495 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-12T11:25:34.495 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-12T11:25:34.495 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-12T11:25:34.495 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-12T11:25:34.495 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-12T11:25:34.496 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-12T11:25:34.496 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-12T11:25:34.496 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-12T11:25:34.496 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-12T11:25:34.496 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-12T11:25:34.496 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-12T11:25:34.496 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-12T11:25:34.496 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-12T11:25:34.496 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-12T11:25:34.497 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-12T11:25:34.497 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-12T11:25:34.497 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-12T11:25:34.497 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-12T11:25:34.497 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-12T11:25:34.497 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c 2023-12-12T11:25:34.497 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos 2023-12-12T11:25:34.497 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-12T11:25:34.497 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-12T11:25:34.497 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses 2023-12-12T11:25:34.497 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-12T11:25:34.497 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-12T11:25:34.497 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-12T11:25:34.497 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-12T11:25:34.497 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-12T11:25:34.497 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-12T11:25:34.498 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-12T11:25:34.498 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-12T11:25:34.498 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-12T11:25:34.498 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-12T11:25:34.498 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-12T11:25:34.498 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-12T11:25:34.498 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-12T11:25:34.498 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-12T11:25:34.498 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-12T11:25:34.498 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-12T11:25:34.498 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-12T11:25:34.498 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-12T11:25:34.498 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-12T11:25:34.498 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-12T11:25:34.499 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-12T11:25:34.499 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-12T11:25:34.499 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-12T11:25:34.499 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-dev.ko 2023-12-12T11:25:34.499 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-12T11:25:34.499 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-12T11:25:34.499 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-12T11:25:34.499 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-12T11:25:34.499 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband 2023-12-12T11:25:34.499 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core 2023-12-12T11:25:34.499 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-12T11:25:34.499 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-12T11:25:34.499 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-12T11:25:34.499 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-12T11:25:34.499 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-12T11:25:34.500 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-12T11:25:34.500 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-12T11:25:34.500 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw 2023-12-12T11:25:34.500 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4 2023-12-12T11:25:34.500 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-12T11:25:34.500 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4 2023-12-12T11:25:34.500 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-12T11:25:34.500 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5 2023-12-12T11:25:34.500 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-12T11:25:34.500 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca 2023-12-12T11:25:34.500 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-12T11:25:34.500 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp 2023-12-12T11:25:34.500 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib 2023-12-12T11:25:34.501 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-12T11:25:34.501 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser 2023-12-12T11:25:34.501 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-12T11:25:34.501 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert 2023-12-12T11:25:34.501 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-12T11:25:34.501 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp 2023-12-12T11:25:34.501 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-12T11:25:34.501 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt 2023-12-12T11:25:34.501 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-12T11:25:34.501 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input 2023-12-12T11:25:34.501 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport 2023-12-12T11:25:34.501 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-12T11:25:34.501 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-12T11:25:34.501 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-12T11:25:34.502 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-12T11:25:34.502 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard 2023-12-12T11:25:34.502 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-12T11:25:34.502 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse 2023-12-12T11:25:34.502 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-12T11:25:34.502 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-12T11:25:34.502 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-12T11:25:34.502 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-12T11:25:34.502 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-12T11:25:34.502 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-12T11:25:34.502 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-12T11:25:34.502 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-12T11:25:34.502 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4 2023-12-12T11:25:34.502 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-12T11:25:34.503 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio 2023-12-12T11:25:34.503 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-12T11:25:34.503 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-12T11:25:34.503 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-12T11:25:34.503 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-12T11:25:34.503 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-12T11:25:34.503 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu 2023-12-12T11:25:34.503 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd 2023-12-12T11:25:34.503 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-12T11:25:34.503 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds 2023-12-12T11:25:34.503 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-12T11:25:34.503 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-12T11:25:34.503 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-12T11:25:34.504 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-12T11:25:34.504 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger 2023-12-12T11:25:34.504 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-12T11:25:34.504 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-12T11:25:34.504 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-12T11:25:34.504 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-12T11:25:34.504 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-12T11:25:34.504 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-12T11:25:34.504 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-12T11:25:34.504 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-12T11:25:34.504 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md 2023-12-12T11:25:34.505 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache 2023-12-12T11:25:34.505 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-12T11:25:34.505 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-12T11:25:34.505 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-12T11:25:34.505 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-12T11:25:34.505 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-12T11:25:34.505 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-12T11:25:34.505 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-12T11:25:34.505 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-12T11:25:34.505 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-12T11:25:34.505 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-12T11:25:34.505 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-12T11:25:34.505 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-12T11:25:34.506 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-12T11:25:34.506 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-12T11:25:34.506 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-12T11:25:34.506 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-12T11:25:34.506 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-12T11:25:34.506 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-12T11:25:34.506 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-12T11:25:34.506 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data 2023-12-12T11:25:34.506 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-12T11:25:34.506 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-12T11:25:34.507 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-12T11:25:34.507 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-12T11:25:34.507 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-12T11:25:34.507 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message 2023-12-12T11:25:34.507 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion 2023-12-12T11:25:34.507 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-12T11:25:34.507 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-12T11:25:34.507 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-12T11:25:34.507 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-12T11:25:34.507 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-12T11:25:34.507 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-12T11:25:34.508 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-12T11:25:34.508 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd 2023-12-12T11:25:34.508 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-12T11:25:34.508 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-12T11:25:34.508 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mfd-core.ko 2023-12-12T11:25:34.508 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-12T11:25:34.508 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-12T11:25:34.508 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-12T11:25:34.508 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-12T11:25:34.508 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc 2023-12-12T11:25:34.508 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl 2023-12-12T11:25:34.508 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-12T11:25:34.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-12T11:25:34.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-12T11:25:34.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-12T11:25:34.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710 2023-12-12T11:25:34.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-12T11:25:34.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom 2023-12-12T11:25:34.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-12T11:25:34.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-12T11:25:34.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-12T11:25:34.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-12T11:25:34.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-12T11:25:34.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-12T11:25:34.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-12T11:25:34.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-12T11:25:34.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d 2023-12-12T11:25:34.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-12T11:25:34.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-12T11:25:34.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei 2023-12-12T11:25:34.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-12T11:25:34.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-12T11:25:34.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-12T11:25:34.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru 2023-12-12T11:25:34.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-12T11:25:34.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp 2023-12-12T11:25:34.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-12T11:25:34.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-12T11:25:34.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-12T11:25:34.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-12T11:25:34.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-12T11:25:34.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-12T11:25:34.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-12T11:25:34.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci 2023-12-12T11:25:34.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-12T11:25:34.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net 2023-12-12T11:25:34.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding 2023-12-12T11:25:34.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-12T11:25:34.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa 2023-12-12T11:25:34.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53 2023-12-12T11:25:34.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-12T11:25:34.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-12T11:25:34.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-12T11:25:34.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx 2023-12-12T11:25:34.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-12T11:25:34.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-12T11:25:34.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-12T11:25:34.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet 2023-12-12T11:25:34.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com 2023-12-12T11:25:34.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-12T11:25:34.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-12T11:25:34.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-12T11:25:34.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-12T11:25:34.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390 2023-12-12T11:25:34.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-12T11:25:34.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-12T11:25:34.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-12T11:25:34.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-12T11:25:34.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec 2023-12-12T11:25:34.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-12T11:25:34.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere 2023-12-12T11:25:34.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-12T11:25:34.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon 2023-12-12T11:25:34.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-12T11:25:34.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera 2023-12-12T11:25:34.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-12T11:25:34.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd 2023-12-12T11:25:34.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-12T11:25:34.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-12T11:25:34.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-12T11:25:34.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros 2023-12-12T11:25:34.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx 2023-12-12T11:25:34.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-12T11:25:34.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-12T11:25:34.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-12T11:25:34.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-12T11:25:34.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-12T11:25:34.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx 2023-12-12T11:25:34.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-12T11:25:34.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-12T11:25:34.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom 2023-12-12T11:25:34.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-12T11:25:34.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-12T11:25:34.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-12T11:25:34.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-12T11:25:34.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-12T11:25:34.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet 2023-12-12T11:25:34.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-12T11:25:34.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-12T11:25:34.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade 2023-12-12T11:25:34.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna 2023-12-12T11:25:34.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-12T11:25:34.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio 2023-12-12T11:25:34.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-12T11:25:34.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-12T11:25:34.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-12T11:25:34.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-12T11:25:34.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-12T11:25:34.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-12T11:25:34.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-12T11:25:34.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-12T11:25:34.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-12T11:25:34.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-12T11:25:34.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco 2023-12-12T11:25:34.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic 2023-12-12T11:25:34.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-12T11:25:34.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec 2023-12-12T11:25:34.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip 2023-12-12T11:25:34.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-12T11:25:34.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-12T11:25:34.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-12T11:25:34.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-12T11:25:34.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-12T11:25:34.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-12T11:25:34.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink 2023-12-12T11:25:34.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-12T11:25:34.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-12T11:25:34.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-12T11:25:34.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex 2023-12-12T11:25:34.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet 2023-12-12T11:25:34.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-12T11:25:34.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-12T11:25:34.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-12T11:25:34.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel 2023-12-12T11:25:34.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-12T11:25:34.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000 2023-12-12T11:25:34.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-12T11:25:34.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e 2023-12-12T11:25:34.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-12T11:25:34.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k 2023-12-12T11:25:34.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-12T11:25:34.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e 2023-12-12T11:25:34.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-12T11:25:34.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf 2023-12-12T11:25:34.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-12T11:25:34.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb 2023-12-12T11:25:34.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-12T11:25:34.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf 2023-12-12T11:25:34.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-12T11:25:34.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-12T11:25:34.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-12T11:25:34.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-12T11:25:34.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-12T11:25:34.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-12T11:25:34.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell 2023-12-12T11:25:34.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-12T11:25:34.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-12T11:25:34.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-12T11:25:34.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox 2023-12-12T11:25:34.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-12T11:25:34.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-12T11:25:34.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-12T11:25:34.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-12T11:25:34.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-12T11:25:34.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-12T11:25:34.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel 2023-12-12T11:25:34.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-12T11:25:34.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom 2023-12-12T11:25:34.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-12T11:25:34.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-12T11:25:34.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi 2023-12-12T11:25:34.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-12T11:25:34.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-12T11:25:34.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion 2023-12-12T11:25:34.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-12T11:25:34.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia 2023-12-12T11:25:34.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-12T11:25:34.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines 2023-12-12T11:25:34.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-12T11:25:34.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-12T11:25:34.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic 2023-12-12T11:25:34.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-12T11:25:34.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-12T11:25:34.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-12T11:25:34.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-12T11:25:34.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-12T11:25:34.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc 2023-12-12T11:25:34.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-12T11:25:34.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek 2023-12-12T11:25:34.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-12T11:25:34.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-12T11:25:34.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-12T11:25:34.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-12T11:25:34.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker 2023-12-12T11:25:34.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-12T11:25:34.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc 2023-12-12T11:25:34.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-12T11:25:34.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan 2023-12-12T11:25:34.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-12T11:25:34.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis 2023-12-12T11:25:34.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-12T11:25:34.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-12T11:25:34.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc 2023-12-12T11:25:34.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-12T11:25:34.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-12T11:25:34.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-12T11:25:34.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-12T11:25:34.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro 2023-12-12T11:25:34.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-12T11:25:34.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-12T11:25:34.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-12T11:25:34.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun 2023-12-12T11:25:34.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-12T11:25:34.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-12T11:25:34.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-12T11:25:34.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-12T11:25:34.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti 2023-12-12T11:25:34.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-12T11:25:34.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti 2023-12-12T11:25:34.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-12T11:25:34.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via 2023-12-12T11:25:34.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-12T11:25:34.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-12T11:25:34.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet 2023-12-12T11:25:34.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-12T11:25:34.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-12T11:25:34.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom 2023-12-12T11:25:34.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-12T11:25:34.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-12T11:25:34.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv 2023-12-12T11:25:34.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-12T11:25:34.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154 2023-12-12T11:25:34.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-12T11:25:34.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-12T11:25:34.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan 2023-12-12T11:25:34.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-12T11:25:34.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-12T11:25:34.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-12T11:25:34.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio 2023-12-12T11:25:34.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-12T11:25:34.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-12T11:25:34.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-12T11:25:34.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-12T11:25:34.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-12T11:25:34.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/net_failover.ko 2023-12-12T11:25:34.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-12T11:25:34.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-12T11:25:34.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs 2023-12-12T11:25:34.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-12T11:25:34.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-12T11:25:34.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy 2023-12-12T11:25:34.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-12T11:25:34.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-12T11:25:34.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-12T11:25:34.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-12T11:25:34.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-12T11:25:34.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-12T11:25:34.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-12T11:25:34.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-12T11:25:34.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/dp83640.ko 2023-12-12T11:25:34.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-12T11:25:34.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-12T11:25:34.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-12T11:25:34.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-12T11:25:34.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-12T11:25:34.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-12T11:25:34.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-12T11:25:34.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-12T11:25:34.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-12T11:25:34.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-12T11:25:34.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-12T11:25:34.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-12T11:25:34.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp 2023-12-12T11:25:34.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-12T11:25:34.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-12T11:25:34.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-12T11:25:34.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-12T11:25:34.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-12T11:25:34.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-12T11:25:34.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-12T11:25:34.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-12T11:25:34.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-12T11:25:34.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip 2023-12-12T11:25:34.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slhc.ko 2023-12-12T11:25:34.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-12T11:25:34.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-12T11:25:34.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-12T11:25:34.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team 2023-12-12T11:25:34.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-12T11:25:34.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-12T11:25:34.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-12T11:25:34.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-12T11:25:34.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-12T11:25:34.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-12T11:25:34.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tun.ko 2023-12-12T11:25:34.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-12T11:25:34.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/virtio_net.ko 2023-12-12T11:25:34.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3 2023-12-12T11:25:34.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-12T11:25:34.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan 2023-12-12T11:25:34.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-12T11:25:34.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback 2023-12-12T11:25:34.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-12T11:25:34.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netfront.ko 2023-12-12T11:25:34.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb 2023-12-12T11:25:34.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-12T11:25:34.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme 2023-12-12T11:25:34.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host 2023-12-12T11:25:34.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-12T11:25:34.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-12T11:25:34.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport 2023-12-12T11:25:34.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-12T11:25:34.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-12T11:25:34.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-12T11:25:34.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-12T11:25:34.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci 2023-12-12T11:25:34.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug 2023-12-12T11:25:34.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-12T11:25:34.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie 2023-12-12T11:25:34.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-12T11:25:34.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-12T11:25:34.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia 2023-12-12T11:25:34.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-12T11:25:34.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-12T11:25:34.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-12T11:25:34.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl 2023-12-12T11:25:34.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel 2023-12-12T11:25:34.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-12T11:25:34.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform 2023-12-12T11:25:34.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86 2023-12-12T11:25:34.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-12T11:25:34.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-12T11:25:34.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-12T11:25:34.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-12T11:25:34.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-12T11:25:34.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-12T11:25:34.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-12T11:25:34.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-12T11:25:34.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-12T11:25:34.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-12T11:25:34.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-12T11:25:34.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-12T11:25:34.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel 2023-12-12T11:25:34.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-12T11:25:34.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-12T11:25:34.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-12T11:25:34.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-12T11:25:34.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-12T11:25:34.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-12T11:25:34.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-12T11:25:34.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-12T11:25:34.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-12T11:25:34.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-12T11:25:34.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-12T11:25:34.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-12T11:25:34.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap 2023-12-12T11:25:34.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-12T11:25:34.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-12T11:25:34.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps 2023-12-12T11:25:34.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients 2023-12-12T11:25:34.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-12T11:25:34.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-12T11:25:34.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-12T11:25:34.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-12T11:25:34.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp 2023-12-12T11:25:34.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-12T11:25:34.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-12T11:25:34.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc 2023-12-12T11:25:34.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-12T11:25:34.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-12T11:25:34.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-12T11:25:34.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-12T11:25:34.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-12T11:25:34.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-12T11:25:34.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-12T11:25:34.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-12T11:25:34.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-12T11:25:34.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-12T11:25:34.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-12T11:25:34.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-12T11:25:34.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-12T11:25:34.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-12T11:25:34.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-12T11:25:34.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-12T11:25:34.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-12T11:25:34.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-12T11:25:34.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-12T11:25:34.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-12T11:25:34.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-12T11:25:34.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-12T11:25:34.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-12T11:25:34.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-12T11:25:34.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-12T11:25:34.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-12T11:25:34.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-12T11:25:34.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-12T11:25:34.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-12T11:25:34.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-12T11:25:34.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-12T11:25:34.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi 2023-12-12T11:25:34.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-12T11:25:34.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-12T11:25:34.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-12T11:25:34.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-12T11:25:34.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-12T11:25:34.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid 2023-12-12T11:25:34.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-12T11:25:34.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-12T11:25:34.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx 2023-12-12T11:25:34.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-12T11:25:34.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-12T11:25:34.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-12T11:25:34.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr 2023-12-12T11:25:34.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-12T11:25:34.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-12T11:25:34.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi 2023-12-12T11:25:34.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-12T11:25:34.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa 2023-12-12T11:25:34.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-12T11:25:34.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc 2023-12-12T11:25:34.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-12T11:25:34.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i 2023-12-12T11:25:34.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-12T11:25:34.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-12T11:25:34.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor 2023-12-12T11:25:34.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-12T11:25:34.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi 2023-12-12T11:25:34.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-12T11:25:34.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-12T11:25:34.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-12T11:25:34.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-12T11:25:34.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-12T11:25:34.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-12T11:25:34.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler 2023-12-12T11:25:34.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-12T11:25:34.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-12T11:25:34.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-12T11:25:34.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-12T11:25:34.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-12T11:25:34.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r 2023-12-12T11:25:34.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-12T11:25:34.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-12T11:25:34.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe 2023-12-12T11:25:34.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-12T11:25:34.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-12T11:25:34.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic 2023-12-12T11:25:34.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-12T11:25:34.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-12T11:25:34.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-12T11:25:34.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-12T11:25:34.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-12T11:25:34.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-12T11:25:34.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-12T11:25:34.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci 2023-12-12T11:25:34.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-12T11:25:34.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-12T11:25:34.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-12T11:25:34.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc 2023-12-12T11:25:34.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-12T11:25:34.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-12T11:25:34.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-12T11:25:34.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas 2023-12-12T11:25:34.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-12T11:25:34.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc 2023-12-12T11:25:34.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-12T11:25:34.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid 2023-12-12T11:25:34.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-12T11:25:34.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-12T11:25:34.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-12T11:25:34.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-12T11:25:34.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas 2023-12-12T11:25:34.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-12T11:25:34.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas 2023-12-12T11:25:34.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-12T11:25:34.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-12T11:25:34.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001 2023-12-12T11:25:34.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-12T11:25:34.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-12T11:25:34.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-12T11:25:34.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx 2023-12-12T11:25:34.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-12T11:25:34.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-12T11:25:34.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx 2023-12-12T11:25:34.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-12T11:25:34.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-12T11:25:34.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-12T11:25:34.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-12T11:25:34.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-12T11:25:34.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-12T11:25:34.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-12T11:25:34.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-12T11:25:34.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-12T11:25:34.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-12T11:25:34.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-12T11:25:34.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2 2023-12-12T11:25:34.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-12T11:25:34.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-12T11:25:34.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-12T11:25:34.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-12T11:25:34.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb 2023-12-12T11:25:34.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-12T11:25:34.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target 2023-12-12T11:25:34.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi 2023-12-12T11:25:34.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-12T11:25:34.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback 2023-12-12T11:25:34.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-12T11:25:34.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-12T11:25:34.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-12T11:25:34.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-12T11:25:34.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-12T11:25:34.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-12T11:25:34.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc 2023-12-12T11:25:34.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-12T11:25:34.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal 2023-12-12T11:25:34.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel 2023-12-12T11:25:34.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal 2023-12-12T11:25:34.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-12T11:25:34.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-12T11:25:34.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-12T11:25:34.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-12T11:25:34.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-12T11:25:34.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-12T11:25:34.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-12T11:25:34.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-12T11:25:34.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-12T11:25:34.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-12T11:25:34.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-12T11:25:34.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-12T11:25:34.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-12T11:25:34.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-12T11:25:34.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-12T11:25:34.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty 2023-12-12T11:25:34.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless 2023-12-12T11:25:34.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-12T11:25:34.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-12T11:25:34.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-12T11:25:34.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-12T11:25:34.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial 2023-12-12T11:25:34.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250 2023-12-12T11:25:34.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-12T11:25:34.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-12T11:25:34.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm 2023-12-12T11:25:34.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-12T11:25:34.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs 2023-12-12T11:25:34.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core 2023-12-12T11:25:34.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-12T11:25:34.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host 2023-12-12T11:25:34.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-12T11:25:34.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio 2023-12-12T11:25:34.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-12T11:25:34.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-12T11:25:34.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-12T11:25:34.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-12T11:25:34.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-12T11:25:34.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb 2023-12-12T11:25:34.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class 2023-12-12T11:25:34.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-12T11:25:34.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-12T11:25:34.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-12T11:25:34.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-12T11:25:34.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host 2023-12-12T11:25:34.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-12T11:25:34.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image 2023-12-12T11:25:34.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-12T11:25:34.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-12T11:25:34.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc 2023-12-12T11:25:34.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-12T11:25:34.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-12T11:25:34.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-12T11:25:34.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-12T11:25:34.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-12T11:25:34.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-12T11:25:34.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-12T11:25:34.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-12T11:25:34.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-12T11:25:34.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-12T11:25:34.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga 2023-12-12T11:25:34.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-12T11:25:34.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-12T11:25:34.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-12T11:25:34.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-12T11:25:34.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-12T11:25:34.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-12T11:25:34.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-12T11:25:34.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy 2023-12-12T11:25:34.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-12T11:25:34.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial 2023-12-12T11:25:34.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-12T11:25:34.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-12T11:25:34.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-12T11:25:34.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-12T11:25:34.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-12T11:25:34.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-12T11:25:34.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-12T11:25:34.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-12T11:25:34.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-12T11:25:34.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-12T11:25:34.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-12T11:25:34.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-12T11:25:34.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-12T11:25:34.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-12T11:25:34.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-12T11:25:34.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-12T11:25:34.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-12T11:25:34.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-12T11:25:34.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-12T11:25:34.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-12T11:25:34.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-12T11:25:34.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-12T11:25:34.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-12T11:25:34.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-12T11:25:34.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-12T11:25:34.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-12T11:25:34.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-12T11:25:34.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-12T11:25:34.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-12T11:25:34.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-12T11:25:34.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-12T11:25:34.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-12T11:25:34.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-12T11:25:34.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-12T11:25:34.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-12T11:25:34.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-12T11:25:34.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-12T11:25:34.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-12T11:25:34.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-12T11:25:34.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-12T11:25:34.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-12T11:25:34.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-12T11:25:34.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-12T11:25:34.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-12T11:25:34.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-12T11:25:34.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage 2023-12-12T11:25:34.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-12T11:25:34.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-12T11:25:34.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-12T11:25:34.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-12T11:25:34.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-12T11:25:34.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-12T11:25:34.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-12T11:25:34.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-12T11:25:34.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-12T11:25:34.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-12T11:25:34.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-12T11:25:34.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-12T11:25:34.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-12T11:25:34.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-12T11:25:34.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-12T11:25:34.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip 2023-12-12T11:25:34.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-12T11:25:34.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-12T11:25:34.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-12T11:25:34.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio 2023-12-12T11:25:34.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci 2023-12-12T11:25:34.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-12T11:25:34.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-12T11:25:34.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-12T11:25:34.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-12T11:25:34.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost 2023-12-12T11:25:34.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-12T11:25:34.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-12T11:25:34.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-12T11:25:34.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-12T11:25:34.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video 2023-12-12T11:25:34.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight 2023-12-12T11:25:34.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-12T11:25:34.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-12T11:25:34.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-12T11:25:34.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio 2023-12-12T11:25:34.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio.ko 2023-12-12T11:25:34.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_balloon.ko 2023-12-12T11:25:34.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_mmio.ko 2023-12-12T11:25:34.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci.ko 2023-12-12T11:25:34.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-12T11:25:34.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-12T11:25:34.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_ring.ko 2023-12-12T11:25:34.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1 2023-12-12T11:25:34.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters 2023-12-12T11:25:34.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-12T11:25:34.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-12T11:25:34.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves 2023-12-12T11:25:34.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-12T11:25:34.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-12T11:25:34.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-12T11:25:34.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-12T11:25:34.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-12T11:25:34.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-12T11:25:34.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-12T11:25:34.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-12T11:25:34.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-12T11:25:34.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-12T11:25:34.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-12T11:25:34.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-12T11:25:34.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog 2023-12-12T11:25:34.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-12T11:25:34.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-12T11:25:34.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-12T11:25:34.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-12T11:25:34.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-12T11:25:34.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-12T11:25:34.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-12T11:25:34.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-12T11:25:34.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-12T11:25:34.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-12T11:25:34.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-12T11:25:34.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-12T11:25:34.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-12T11:25:34.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-12T11:25:34.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-12T11:25:34.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-12T11:25:34.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-12T11:25:34.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-12T11:25:34.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-12T11:25:34.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-12T11:25:34.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-12T11:25:34.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-12T11:25:34.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-12T11:25:34.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-12T11:25:34.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-12T11:25:34.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-12T11:25:34.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen 2023-12-12T11:25:34.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-12T11:25:34.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-12T11:25:34.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-12T11:25:34.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-12T11:25:34.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback 2023-12-12T11:25:34.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-12T11:25:34.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-12T11:25:34.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs 2023-12-12T11:25:34.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-12T11:25:34.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs 2023-12-12T11:25:34.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p 2023-12-12T11:25:34.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-12T11:25:34.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs 2023-12-12T11:25:34.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-12T11:25:34.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs 2023-12-12T11:25:34.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-12T11:25:34.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-12T11:25:34.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs 2023-12-12T11:25:34.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-12T11:25:34.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles 2023-12-12T11:25:34.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-12T11:25:34.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph 2023-12-12T11:25:34.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-12T11:25:34.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda 2023-12-12T11:25:34.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-12T11:25:34.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs 2023-12-12T11:25:34.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-12T11:25:34.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm 2023-12-12T11:25:34.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-12T11:25:34.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs 2023-12-12T11:25:34.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-12T11:25:34.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs 2023-12-12T11:25:34.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-12T11:25:34.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat 2023-12-12T11:25:34.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/fat.ko 2023-12-12T11:25:34.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-12T11:25:34.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/vfat.ko 2023-12-12T11:25:34.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache 2023-12-12T11:25:34.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-12T11:25:34.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse 2023-12-12T11:25:34.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-12T11:25:34.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/fuse.ko 2023-12-12T11:25:34.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2 2023-12-12T11:25:34.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-12T11:25:34.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs 2023-12-12T11:25:34.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-12T11:25:34.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus 2023-12-12T11:25:34.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-12T11:25:34.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs 2023-12-12T11:25:34.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-12T11:25:34.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs 2023-12-12T11:25:34.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-12T11:25:34.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd 2023-12-12T11:25:34.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-12T11:25:34.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix 2023-12-12T11:25:34.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-12T11:25:34.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs 2023-12-12T11:25:34.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-12T11:25:34.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs 2023-12-12T11:25:34.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout 2023-12-12T11:25:34.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-12T11:25:34.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout 2023-12-12T11:25:34.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-12T11:25:34.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout 2023-12-12T11:25:34.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-12T11:25:34.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-12T11:25:34.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-12T11:25:34.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-12T11:25:34.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common 2023-12-12T11:25:34.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-12T11:25:34.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-12T11:25:34.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd 2023-12-12T11:25:34.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-12T11:25:34.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2 2023-12-12T11:25:34.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-12T11:25:34.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls 2023-12-12T11:25:34.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-12T11:25:34.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-12T11:25:34.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-12T11:25:34.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-12T11:25:34.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-12T11:25:34.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-12T11:25:34.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-12T11:25:34.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-12T11:25:34.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-12T11:25:34.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-12T11:25:34.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-12T11:25:34.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-12T11:25:34.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-12T11:25:34.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-12T11:25:34.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-12T11:25:34.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-12T11:25:34.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-12T11:25:34.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-12T11:25:34.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-12T11:25:34.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-12T11:25:34.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-12T11:25:34.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-12T11:25:34.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-12T11:25:34.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-12T11:25:34.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-12T11:25:34.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-12T11:25:34.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-12T11:25:34.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-12T11:25:34.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-12T11:25:34.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-12T11:25:34.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-12T11:25:34.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-12T11:25:34.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-12T11:25:34.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-12T11:25:34.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-12T11:25:34.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-12T11:25:34.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-12T11:25:34.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-12T11:25:34.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-12T11:25:34.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-12T11:25:34.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-12T11:25:34.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-12T11:25:34.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-12T11:25:34.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-12T11:25:34.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-12T11:25:34.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-12T11:25:34.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-12T11:25:34.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-12T11:25:34.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-12T11:25:34.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-12T11:25:34.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2 2023-12-12T11:25:34.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster 2023-12-12T11:25:34.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-12T11:25:34.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm 2023-12-12T11:25:34.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-12T11:25:34.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs 2023-12-12T11:25:34.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-12T11:25:34.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-12T11:25:34.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-12T11:25:34.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-12T11:25:34.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-12T11:25:34.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs 2023-12-12T11:25:34.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-12T11:25:34.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore 2023-12-12T11:25:34.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-12T11:25:34.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs 2023-12-12T11:25:34.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-12T11:25:34.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs 2023-12-12T11:25:34.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-12T11:25:34.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb 2023-12-12T11:25:34.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client 2023-12-12T11:25:34.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-12T11:25:34.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common 2023-12-12T11:25:34.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-12T11:25:34.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-12T11:25:34.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs 2023-12-12T11:25:34.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-12T11:25:34.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv 2023-12-12T11:25:34.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-12T11:25:34.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf 2023-12-12T11:25:34.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-12T11:25:34.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs 2023-12-12T11:25:34.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-12T11:25:34.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs 2023-12-12T11:25:34.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-12T11:25:34.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel 2023-12-12T11:25:34.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu 2023-12-12T11:25:34.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu/rcutorture.ko 2023-12-12T11:25:34.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-12T11:25:34.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace 2023-12-12T11:25:34.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-12T11:25:34.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib 2023-12-12T11:25:34.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/asn1_encoder.ko 2023-12-12T11:25:34.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-12T11:25:34.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-12T11:25:34.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto 2023-12-12T11:25:34.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-12T11:25:34.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-12T11:25:34.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-12T11:25:34.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-12T11:25:34.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4 2023-12-12T11:25:34.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-12T11:25:34.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-12T11:25:34.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math 2023-12-12T11:25:34.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-12T11:25:34.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6 2023-12-12T11:25:34.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-12T11:25:34.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon 2023-12-12T11:25:34.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-12T11:25:34.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-12T11:25:34.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-12T11:25:34.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-12T11:25:34.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd 2023-12-12T11:25:34.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd/zstd_compress.ko 2023-12-12T11:25:34.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm 2023-12-12T11:25:34.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-12T11:25:34.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net 2023-12-12T11:25:34.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan 2023-12-12T11:25:34.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-12T11:25:34.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-12T11:25:34.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-12T11:25:34.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-12T11:25:34.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-12T11:25:34.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-12T11:25:34.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-12T11:25:34.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-12T11:25:34.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802 2023-12-12T11:25:34.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-12T11:25:34.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-12T11:25:34.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-12T11:25:34.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-12T11:25:34.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-12T11:25:34.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q 2023-12-12T11:25:34.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-12T11:25:34.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p 2023-12-12T11:25:34.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-12T11:25:34.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-12T11:25:34.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-12T11:25:34.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-12T11:25:34.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv 2023-12-12T11:25:34.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-12T11:25:34.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge 2023-12-12T11:25:34.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-12T11:25:34.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-12T11:25:34.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter 2023-12-12T11:25:34.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-12T11:25:34.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-12T11:25:34.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-12T11:25:34.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-12T11:25:34.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-12T11:25:34.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-12T11:25:34.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-12T11:25:34.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-12T11:25:34.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-12T11:25:34.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-12T11:25:34.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-12T11:25:34.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-12T11:25:34.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-12T11:25:34.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-12T11:25:34.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-12T11:25:34.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-12T11:25:34.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-12T11:25:34.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-12T11:25:34.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-12T11:25:34.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-12T11:25:34.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-12T11:25:34.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-12T11:25:34.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-12T11:25:34.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-12T11:25:34.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph 2023-12-12T11:25:34.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-12T11:25:34.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core 2023-12-12T11:25:34.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/failover.ko 2023-12-12T11:25:34.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-12T11:25:34.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp 2023-12-12T11:25:34.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-12T11:25:34.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-12T11:25:34.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-12T11:25:34.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-12T11:25:34.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver 2023-12-12T11:25:34.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver/dns_resolver.ko 2023-12-12T11:25:34.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa 2023-12-12T11:25:34.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-12T11:25:34.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-12T11:25:34.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-12T11:25:34.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-12T11:25:34.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-12T11:25:34.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154 2023-12-12T11:25:34.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan 2023-12-12T11:25:34.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-12T11:25:34.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-12T11:25:34.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-12T11:25:34.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4 2023-12-12T11:25:34.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-12T11:25:34.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-12T11:25:34.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-12T11:25:34.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-12T11:25:34.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-12T11:25:34.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-12T11:25:34.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-12T11:25:34.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-12T11:25:34.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-12T11:25:34.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-12T11:25:34.590 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter 2023-12-12T11:25:34.590 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-12T11:25:34.590 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-12T11:25:34.590 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-12T11:25:34.590 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-12T11:25:34.590 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-12T11:25:34.591 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-12T11:25:34.591 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-12T11:25:34.591 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-12T11:25:34.591 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-12T11:25:34.591 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-12T11:25:34.591 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-12T11:25:34.591 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-12T11:25:34.592 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-12T11:25:34.592 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-12T11:25:34.592 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-12T11:25:34.592 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-12T11:25:34.592 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-12T11:25:34.592 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-12T11:25:34.593 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-12T11:25:34.593 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-12T11:25:34.593 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-12T11:25:34.593 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-12T11:25:34.593 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-12T11:25:34.593 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-12T11:25:34.593 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-12T11:25:34.594 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-12T11:25:34.594 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-12T11:25:34.594 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-12T11:25:34.594 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-12T11:25:34.594 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-12T11:25:34.594 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-12T11:25:34.594 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-12T11:25:34.595 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-12T11:25:34.595 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-12T11:25:34.595 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-12T11:25:34.595 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-12T11:25:34.595 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-12T11:25:34.595 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-12T11:25:34.595 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6 2023-12-12T11:25:34.595 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-12T11:25:34.595 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-12T11:25:34.596 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-12T11:25:34.596 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-12T11:25:34.596 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-12T11:25:34.596 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-12T11:25:34.596 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-12T11:25:34.596 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter 2023-12-12T11:25:34.597 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-12T11:25:34.597 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-12T11:25:34.597 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-12T11:25:34.597 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-12T11:25:34.597 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-12T11:25:34.597 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-12T11:25:34.597 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-12T11:25:34.598 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-12T11:25:34.598 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-12T11:25:34.599 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-12T11:25:34.599 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-12T11:25:34.599 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-12T11:25:34.599 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-12T11:25:34.599 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-12T11:25:34.599 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-12T11:25:34.599 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-12T11:25:34.599 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-12T11:25:34.599 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-12T11:25:34.599 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-12T11:25:34.599 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-12T11:25:34.599 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-12T11:25:34.600 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-12T11:25:34.600 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-12T11:25:34.600 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-12T11:25:34.600 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-12T11:25:34.600 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-12T11:25:34.600 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-12T11:25:34.600 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key 2023-12-12T11:25:34.600 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-12T11:25:34.600 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp 2023-12-12T11:25:34.600 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-12T11:25:34.600 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-12T11:25:34.600 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-12T11:25:34.600 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-12T11:25:34.601 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-12T11:25:34.601 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-12T11:25:34.601 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-12T11:25:34.601 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc 2023-12-12T11:25:34.601 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-12T11:25:34.601 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154 2023-12-12T11:25:34.601 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-12T11:25:34.601 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls 2023-12-12T11:25:34.601 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-12T11:25:34.601 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter 2023-12-12T11:25:34.601 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset 2023-12-12T11:25:34.601 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-12T11:25:34.601 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-12T11:25:34.602 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-12T11:25:34.602 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-12T11:25:34.602 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-12T11:25:34.602 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-12T11:25:34.602 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-12T11:25:34.602 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-12T11:25:34.602 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-12T11:25:34.602 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-12T11:25:34.602 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-12T11:25:34.602 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-12T11:25:34.602 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-12T11:25:34.602 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-12T11:25:34.602 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-12T11:25:34.602 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-12T11:25:34.603 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs 2023-12-12T11:25:34.603 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-12T11:25:34.603 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-12T11:25:34.603 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-12T11:25:34.603 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-12T11:25:34.603 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-12T11:25:34.603 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-12T11:25:34.603 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-12T11:25:34.603 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-12T11:25:34.603 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-12T11:25:34.603 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-12T11:25:34.603 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-12T11:25:34.603 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-12T11:25:34.604 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-12T11:25:34.604 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-12T11:25:34.604 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-12T11:25:34.604 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-12T11:25:34.604 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-12T11:25:34.604 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-12T11:25:34.604 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-12T11:25:34.604 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-12T11:25:34.604 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-12T11:25:34.604 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-12T11:25:34.604 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-12T11:25:34.605 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-12T11:25:34.605 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-12T11:25:34.605 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-12T11:25:34.605 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-12T11:25:34.605 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-12T11:25:34.605 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-12T11:25:34.605 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-12T11:25:34.605 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-12T11:25:34.605 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-12T11:25:34.605 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-12T11:25:34.605 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-12T11:25:34.605 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-12T11:25:34.605 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-12T11:25:34.605 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-12T11:25:34.606 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-12T11:25:34.606 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-12T11:25:34.606 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-12T11:25:34.606 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-12T11:25:34.606 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-12T11:25:34.606 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-12T11:25:34.606 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-12T11:25:34.606 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-12T11:25:34.606 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-12T11:25:34.606 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-12T11:25:34.606 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-12T11:25:34.606 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-12T11:25:34.606 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-12T11:25:34.607 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-12T11:25:34.607 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-12T11:25:34.607 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-12T11:25:34.607 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-12T11:25:34.607 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-12T11:25:34.607 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-12T11:25:34.607 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-12T11:25:34.607 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-12T11:25:34.607 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_quota.ko 2023-12-12T11:25:34.607 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-12T11:25:34.607 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-12T11:25:34.608 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-12T11:25:34.608 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-12T11:25:34.608 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tunnel.ko 2023-12-12T11:25:34.608 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-12T11:25:34.608 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-12T11:25:34.608 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-12T11:25:34.608 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-12T11:25:34.608 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-12T11:25:34.608 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-12T11:25:34.608 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-12T11:25:34.608 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-12T11:25:34.608 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-12T11:25:34.608 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-12T11:25:34.608 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-12T11:25:34.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-12T11:25:34.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-12T11:25:34.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-12T11:25:34.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-12T11:25:34.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-12T11:25:34.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-12T11:25:34.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-12T11:25:34.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-12T11:25:34.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-12T11:25:34.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-12T11:25:34.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-12T11:25:34.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-12T11:25:34.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-12T11:25:34.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-12T11:25:34.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-12T11:25:34.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-12T11:25:34.610 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-12T11:25:34.610 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-12T11:25:34.610 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-12T11:25:34.610 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-12T11:25:34.610 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-12T11:25:34.610 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-12T11:25:34.610 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-12T11:25:34.610 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-12T11:25:34.610 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-12T11:25:34.610 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-12T11:25:34.611 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-12T11:25:34.611 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-12T11:25:34.611 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-12T11:25:34.611 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-12T11:25:34.611 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-12T11:25:34.611 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-12T11:25:34.611 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-12T11:25:34.611 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-12T11:25:34.611 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-12T11:25:34.611 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-12T11:25:34.611 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-12T11:25:34.612 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-12T11:25:34.612 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-12T11:25:34.612 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-12T11:25:34.612 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-12T11:25:34.612 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-12T11:25:34.612 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-12T11:25:34.612 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-12T11:25:34.612 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-12T11:25:34.612 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-12T11:25:34.612 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-12T11:25:34.612 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-12T11:25:34.612 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-12T11:25:34.612 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-12T11:25:34.612 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-12T11:25:34.612 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-12T11:25:34.613 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-12T11:25:34.613 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-12T11:25:34.613 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-12T11:25:34.613 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-12T11:25:34.613 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-12T11:25:34.613 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-12T11:25:34.613 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-12T11:25:34.613 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-12T11:25:34.613 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink 2023-12-12T11:25:34.613 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-12T11:25:34.613 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh 2023-12-12T11:25:34.613 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-12T11:25:34.613 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch 2023-12-12T11:25:34.613 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-12T11:25:34.614 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-12T11:25:34.614 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-12T11:25:34.614 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-12T11:25:34.614 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet 2023-12-12T11:25:34.614 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-12T11:25:34.614 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds 2023-12-12T11:25:34.614 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-12T11:25:34.614 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-12T11:25:34.614 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-12T11:25:34.615 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched 2023-12-12T11:25:34.615 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-12T11:25:34.615 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-12T11:25:34.615 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-12T11:25:34.615 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-12T11:25:34.615 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-12T11:25:34.615 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-12T11:25:34.615 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-12T11:25:34.615 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-12T11:25:34.616 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-12T11:25:34.616 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-12T11:25:34.616 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-12T11:25:34.616 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-12T11:25:34.616 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-12T11:25:34.616 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-12T11:25:34.616 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-12T11:25:34.616 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-12T11:25:34.616 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-12T11:25:34.616 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-12T11:25:34.616 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-12T11:25:34.616 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-12T11:25:34.616 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-12T11:25:34.616 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-12T11:25:34.616 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-12T11:25:34.617 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-12T11:25:34.617 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-12T11:25:34.617 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-12T11:25:34.617 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-12T11:25:34.617 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-12T11:25:34.617 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-12T11:25:34.617 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-12T11:25:34.617 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-12T11:25:34.617 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-12T11:25:34.617 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-12T11:25:34.617 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-12T11:25:34.617 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-12T11:25:34.617 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-12T11:25:34.617 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-12T11:25:34.617 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-12T11:25:34.618 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-12T11:25:34.618 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-12T11:25:34.618 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-12T11:25:34.618 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-12T11:25:34.618 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-12T11:25:34.618 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-12T11:25:34.618 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp 2023-12-12T11:25:34.618 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-12T11:25:34.618 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-12T11:25:34.618 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc 2023-12-12T11:25:34.618 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss 2023-12-12T11:25:34.619 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-12T11:25:34.619 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-12T11:25:34.619 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-12T11:25:34.619 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma 2023-12-12T11:25:34.619 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-12T11:25:34.619 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc 2023-12-12T11:25:34.619 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-12T11:25:34.619 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-12T11:25:34.619 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix 2023-12-12T11:25:34.619 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-12T11:25:34.619 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock 2023-12-12T11:25:34.619 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-12T11:25:34.619 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-12T11:25:34.619 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-12T11:25:34.620 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-12T11:25:34.620 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-12T11:25:34.620 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm 2023-12-12T11:25:34.620 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-12T11:25:34.620 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security 2023-12-12T11:25:34.620 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys 2023-12-12T11:25:34.620 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys 2023-12-12T11:25:34.620 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-12T11:25:34.620 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys 2023-12-12T11:25:34.620 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys/trusted.ko 2023-12-12T11:25:34.620 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt 2023-12-12T11:25:34.620 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib 2023-12-12T11:25:34.620 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-12T11:25:34.620 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-12T11:25:34.621 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-12T11:25:34.621 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-12T11:25:34.621 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-12T11:25:34.621 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-12T11:25:34.621 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-12T11:25:34.621 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-12T11:25:34.621 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-12T11:25:34.621 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-12T11:25:34.621 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-12T11:25:34.621 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-12T11:25:34.621 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-12T11:25:34.622 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-12T11:25:34.622 DEBUG:teuthology.orchestra.run.smithi063:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-12T11:25:34.650 INFO:teuthology.orchestra.run.smithi063.stdout:postinstall scriptlet (using /bin/sh): 2023-12-12T11:25:34.650 INFO:teuthology.orchestra.run.smithi063.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-gcd68252d7b4d -a -r /boot/System.map-6.6.0-gcd68252d7b4d ]; then 2023-12-12T11:25:34.650 INFO:teuthology.orchestra.run.smithi063.stdout:cp /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm 2023-12-12T11:25:34.651 INFO:teuthology.orchestra.run.smithi063.stdout:cp /boot/System.map-6.6.0-gcd68252d7b4d /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-12T11:25:34.651 INFO:teuthology.orchestra.run.smithi063.stdout:rm -f /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/System.map-6.6.0-gcd68252d7b4d 2023-12-12T11:25:34.651 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/installkernel 6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-12T11:25:34.651 INFO:teuthology.orchestra.run.smithi063.stdout:rm -f /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-12T11:25:34.651 INFO:teuthology.orchestra.run.smithi063.stdout:fi 2023-12-12T11:25:34.651 INFO:teuthology.orchestra.run.smithi063.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-12T11:25:34.651 INFO:teuthology.orchestra.run.smithi063.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-12T11:25:34.651 INFO:teuthology.orchestra.run.smithi063.stdout:new-kernel-pkg --remove 6.6.0-gcd68252d7b4d --rminitrd --initrdfile=/boot/initramfs-6.6.0-gcd68252d7b4d.img 2023-12-12T11:25:34.651 INFO:teuthology.orchestra.run.smithi063.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-12T11:25:34.651 INFO:teuthology.orchestra.run.smithi063.stdout:kernel-install remove 6.6.0-gcd68252d7b4d 2023-12-12T11:25:34.651 INFO:teuthology.orchestra.run.smithi063.stdout:fi 2023-12-12T11:25:34.651 INFO:teuthology.orchestra.run.smithi063.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-12T11:25:34.651 INFO:teuthology.orchestra.run.smithi063.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-12T11:25:34.651 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/update-bootloader --remove 6.6.0-gcd68252d7b4d 2023-12-12T11:25:34.652 INFO:teuthology.orchestra.run.smithi063.stdout:fi 2023-12-12T11:25:34.652 DEBUG:teuthology.orchestra.run.smithi063:> sudo rpm -qi grub2-tools 2023-12-12T11:25:34.727 INFO:teuthology.orchestra.run.smithi063.stdout:Name : grub2-tools 2023-12-12T11:25:34.728 INFO:teuthology.orchestra.run.smithi063.stdout:Epoch : 1 2023-12-12T11:25:34.728 INFO:teuthology.orchestra.run.smithi063.stdout:Version : 2.02 2023-12-12T11:25:34.728 INFO:teuthology.orchestra.run.smithi063.stdout:Release : 129.el8 2023-12-12T11:25:34.728 INFO:teuthology.orchestra.run.smithi063.stdout:Architecture: x86_64 2023-12-12T11:25:34.728 INFO:teuthology.orchestra.run.smithi063.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-12-12T11:25:34.728 INFO:teuthology.orchestra.run.smithi063.stdout:Group : System Environment/Base 2023-12-12T11:25:34.728 INFO:teuthology.orchestra.run.smithi063.stdout:Size : 9265586 2023-12-12T11:25:34.728 INFO:teuthology.orchestra.run.smithi063.stdout:License : GPLv3+ 2023-12-12T11:25:34.728 INFO:teuthology.orchestra.run.smithi063.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-12-12T11:25:34.729 INFO:teuthology.orchestra.run.smithi063.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-12-12T11:25:34.729 INFO:teuthology.orchestra.run.smithi063.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-12-12T11:25:34.729 INFO:teuthology.orchestra.run.smithi063.stdout:Build Host : kbuilder.bsys.centos.org 2023-12-12T11:25:34.729 INFO:teuthology.orchestra.run.smithi063.stdout:Relocations : (not relocatable) 2023-12-12T11:25:34.729 INFO:teuthology.orchestra.run.smithi063.stdout:Packager : CentOS BuildSystem 2023-12-12T11:25:34.729 INFO:teuthology.orchestra.run.smithi063.stdout:Vendor : CentOS 2023-12-12T11:25:34.729 INFO:teuthology.orchestra.run.smithi063.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-12T11:25:34.729 INFO:teuthology.orchestra.run.smithi063.stdout:Summary : Support tools for GRUB. 2023-12-12T11:25:34.730 INFO:teuthology.orchestra.run.smithi063.stdout:Description : 2023-12-12T11:25:34.730 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:25:34.730 INFO:teuthology.orchestra.run.smithi063.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-12T11:25:34.730 INFO:teuthology.orchestra.run.smithi063.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-12T11:25:34.730 INFO:teuthology.orchestra.run.smithi063.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-12T11:25:34.730 INFO:teuthology.orchestra.run.smithi063.stdout:hardware devices. 2023-12-12T11:25:34.730 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:25:34.730 INFO:teuthology.orchestra.run.smithi063.stdout:This subpackage provides tools for support of all platforms. 2023-12-12T11:25:34.731 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-12T11:25:34.731 INFO:teuthology.task.kernel:Updating grub on smithi063 to boot 6.6.0-gcd68252d7b4d 2023-12-12T11:25:34.731 DEBUG:teuthology.orchestra.run.smithi063:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-12T11:25:39.106 INFO:teuthology.orchestra.run.smithi063.stderr:Generating grub configuration file ... 2023-12-12T11:25:41.257 INFO:teuthology.orchestra.run.smithi063.stderr:done 2023-12-12T11:25:41.259 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2023-12-12T11:25:41.281 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.bmAM8ALiyx 2023-12-12T11:25:41.281 DEBUG:teuthology.orchestra.run.smithi063:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.bmAM8ALiyx 2023-12-12T11:25:41.353 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.bmAM8ALiyx 2023-12-12T11:25:41.524 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.bmAM8ALiyx is 6KB 2023-12-12T11:25:41.573 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.bmAM8ALiyx 2023-12-12T11:25:41.591 DEBUG:teuthology.orchestra.run.smithi063:> sudo /bin/ls /boot/loader/entries || true 2023-12-12T11:25:41.673 INFO:teuthology.orchestra.run.smithi063.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-12-12T11:25:41.673 INFO:teuthology.orchestra.run.smithi063.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-12-12T11:25:41.673 INFO:teuthology.orchestra.run.smithi063.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-12-12T11:25:41.673 INFO:teuthology.orchestra.run.smithi063.stdout:a1b29d6c289747bdb22930598d39874a-6.6.0-gcd68252d7b4d.conf 2023-12-12T11:25:41.674 DEBUG:teuthology.orchestra.run.smithi063:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.6.0-gcd68252d7b4d 2023-12-12T11:25:41.868 DEBUG:teuthology.orchestra.run.smithi063:> sudo shutdown -r now 2023-12-12T11:26:11.871 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2023-12-12T11:26:11.871 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-12-12T11:26:11.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:26:30.242 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2023-12-12T11:26:39.243 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-12-12T11:26:39.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:26:42.306 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2023-12-12T11:26:54.307 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-12-12T11:26:54.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:27:12.742 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2023-12-12T11:27:27.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-12-12T11:27:27.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:27:28.040 DEBUG:teuthology.orchestra.run.smithi063:> true 2023-12-12T11:27:28.426 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-12-12T11:27:28.426 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "6.6.0-gcd68252d7b4d"... 2023-12-12T11:27:28.426 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2023-12-12T11:27:28.471 INFO:teuthology.orchestra.run.smithi063.stdout:6.6.0-gcd68252d7b4d 2023-12-12T11:27:28.471 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-12T11:27:28.471 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-12T11:27:28.472 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-12T11:27:29.473 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2023-12-12T11:27:29.473 DEBUG:teuthology.orchestra.run.smithi063:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-12T11:27:29.594 INFO:teuthology.orchestra.run.smithi063.stdout:ttyS1 2023-12-12T11:27:29.618 DEBUG:teuthology.parallel:result is None 2023-12-12T11:27:29.618 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-12T11:27:29.626 INFO:teuthology.task.internal:Creating test directory... 2023-12-12T11:27:29.626 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-12T11:27:29.631 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-12T11:27:29.683 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-12T11:27:29.694 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-12T11:27:29.700 INFO:teuthology.task.internal:Creating archive directory... 2023-12-12T11:27:29.701 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-12T11:27:29.705 DEBUG:teuthology.orchestra.run.smithi093:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-12T11:27:29.771 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-12T11:27:29.777 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-12T11:27:29.777 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-12T11:27:29.782 DEBUG:teuthology.orchestra.run.smithi093:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-12T11:27:29.862 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-12T11:27:29.879 INFO:teuthology.orchestra.run.smithi093.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-12T11:27:29.888 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-12T11:27:29.908 INFO:teuthology.orchestra.run.smithi093.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-12T11:27:29.912 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-12T11:27:29.919 INFO:teuthology.task.internal:Configuring sudo... 2023-12-12T11:27:29.919 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-12T11:27:29.924 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-12T11:27:29.997 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-12T11:27:30.015 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-12T11:27:30.015 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-12T11:27:30.019 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-12T11:27:30.066 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-12T11:27:30.181 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-12T11:27:30.270 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-12T11:27:30.345 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-12T11:27:30.434 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-12T11:27:30.434 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-12T11:27:30.505 DEBUG:teuthology.orchestra.run.smithi093:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-12T11:27:30.580 DEBUG:teuthology.orchestra.run.smithi093:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-12T11:27:30.658 DEBUG:teuthology.orchestra.run.smithi093:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-12T11:27:30.732 DEBUG:teuthology.orchestra.run.smithi093:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-12T11:27:30.801 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-12T11:27:30.801 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-12T11:27:30.871 DEBUG:teuthology.orchestra.run.smithi063:> sudo service rsyslog restart 2023-12-12T11:27:30.876 DEBUG:teuthology.orchestra.run.smithi093:> sudo service rsyslog restart 2023-12-12T11:27:30.992 INFO:teuthology.orchestra.run.smithi063.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-12T11:27:31.041 INFO:teuthology.orchestra.run.smithi093.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-12T11:27:31.505 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-12T11:27:31.512 INFO:teuthology.task.internal:Starting timer... 2023-12-12T11:27:31.512 INFO:teuthology.run_tasks:Running task pcp... 2023-12-12T11:27:31.522 INFO:teuthology.run_tasks:Running task selinux... 2023-12-12T11:27:31.531 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-12-12T11:27:31.531 DEBUG:teuthology.orchestra.run.smithi063:> sudo service auditd rotate 2023-12-12T11:27:31.673 INFO:teuthology.orchestra.run.smithi063.stdout:Rotating logs: 2023-12-12T11:27:31.677 DEBUG:teuthology.orchestra.run.smithi093:> sudo service auditd rotate 2023-12-12T11:27:31.809 INFO:teuthology.orchestra.run.smithi093.stdout:Rotating logs: 2023-12-12T11:27:31.812 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-12T11:27:31.812 DEBUG:teuthology.orchestra.run.smithi063:> /usr/sbin/getenforce 2023-12-12T11:27:31.864 INFO:teuthology.orchestra.run.smithi063.stdout:Permissive 2023-12-12T11:27:31.864 DEBUG:teuthology.orchestra.run.smithi093:> /usr/sbin/getenforce 2023-12-12T11:27:31.916 INFO:teuthology.orchestra.run.smithi093.stdout:Permissive 2023-12-12T11:27:31.916 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi063.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi093.front.sepia.ceph.com': 'permissive'} 2023-12-12T11:27:31.916 DEBUG:teuthology.orchestra.run.smithi063:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-12T11:27:31.987 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T11:27:31.988 DEBUG:teuthology.orchestra.run.smithi093:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-12T11:27:32.058 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T11:27:32.059 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-12T11:27:32.059 DEBUG:teuthology.orchestra.run.smithi063:> sudo /usr/sbin/setenforce permissive 2023-12-12T11:27:32.130 DEBUG:teuthology.orchestra.run.smithi093:> sudo /usr/sbin/setenforce permissive 2023-12-12T11:27:32.201 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-12T11:27:32.210 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-12-12T11:27:32.216 INFO:teuthology.repo_utils:Fetching main from origin 2023-12-12T11:27:32.329 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-12T11:27:32.344 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-12T11:27:32.345 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi063.front.sepia.ceph.com,smithi093.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-12T11:38:12.931 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi063.front.sepia.ceph.com'), Remote(name='ubuntu@smithi093.front.sepia.ceph.com')] 2023-12-12T11:38:12.932 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-12-12T11:38:12.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:38:13.019 DEBUG:teuthology.orchestra.run.smithi063:> true 2023-12-12T11:38:13.136 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-12-12T11:38:13.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-12-12T11:38:13.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T11:38:13.226 DEBUG:teuthology.orchestra.run.smithi093:> true 2023-12-12T11:38:13.340 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-12-12T11:38:13.341 INFO:teuthology.run_tasks:Running task clock... 2023-12-12T11:38:13.351 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-12T11:38:13.352 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-12T11:38:13.352 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-12T11:38:13.357 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-12T11:38:13.357 DEBUG:teuthology.orchestra.run.smithi093:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-12T11:38:13.430 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-12T11:38:13.456 INFO:teuthology.orchestra.run.smithi093.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-12T11:38:13.463 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-12T11:38:13.489 INFO:teuthology.orchestra.run.smithi093.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-12T11:38:13.554 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: ntpd: command not found 2023-12-12T11:38:13.574 INFO:teuthology.orchestra.run.smithi093.stderr:sudo: ntpd: command not found 2023-12-12T11:38:13.582 INFO:teuthology.orchestra.run.smithi063.stdout:506 Cannot talk to daemon 2023-12-12T11:38:13.602 INFO:teuthology.orchestra.run.smithi093.stdout:506 Cannot talk to daemon 2023-12-12T11:38:13.616 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-12T11:38:13.635 INFO:teuthology.orchestra.run.smithi093.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-12T11:38:13.650 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-12T11:38:13.667 INFO:teuthology.orchestra.run.smithi093.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-12T11:38:13.732 INFO:teuthology.orchestra.run.smithi063.stderr:bash: ntpq: command not found 2023-12-12T11:38:13.739 INFO:teuthology.orchestra.run.smithi063.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-12T11:38:13.740 INFO:teuthology.orchestra.run.smithi063.stdout:=============================================================================== 2023-12-12T11:38:13.740 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T11:38:13.740 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T11:38:13.740 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T11:38:13.740 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T11:38:13.763 INFO:teuthology.orchestra.run.smithi093.stderr:bash: ntpq: command not found 2023-12-12T11:38:13.769 INFO:teuthology.orchestra.run.smithi093.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-12T11:38:13.769 INFO:teuthology.orchestra.run.smithi093.stdout:=============================================================================== 2023-12-12T11:38:13.769 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T11:38:13.769 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T11:38:13.769 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T11:38:13.769 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T11:38:13.770 INFO:teuthology.run_tasks:Running task pexec... 2023-12-12T11:38:13.781 INFO:teuthology.task.pexec:Executing custom commands... 2023-12-12T11:38:13.782 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi063.front.sepia.ceph.com 2023-12-12T11:38:13.782 DEBUG:teuthology.orchestra.run.smithi063:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-12T11:38:13.783 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi093.front.sepia.ceph.com 2023-12-12T11:38:13.783 DEBUG:teuthology.orchestra.run.smithi093:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-12T11:38:14.851 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:02:12 ago on Tue 12 Dec 2023 11:36:02 AM UTC. 2023-12-12T11:38:14.898 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:02:02 ago on Tue 12 Dec 2023 11:36:12 AM UTC. 2023-12-12T11:38:17.048 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-12T11:38:17.048 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:38:17.049 INFO:teuthology.orchestra.run.smithi093.stdout: Package Architecture Version Repository Size 2023-12-12T11:38:17.049 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:38:17.049 INFO:teuthology.orchestra.run.smithi093.stdout:Resetting modules: 2023-12-12T11:38:17.049 INFO:teuthology.orchestra.run.smithi093.stdout: container-tools 2023-12-12T11:38:17.049 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:38:17.049 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-12T11:38:17.049 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:38:17.049 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:38:17.309 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-12T11:38:17.463 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-12T11:38:17.464 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:38:17.464 INFO:teuthology.orchestra.run.smithi063.stdout: Package Architecture Version Repository Size 2023-12-12T11:38:17.464 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:38:17.464 INFO:teuthology.orchestra.run.smithi063.stdout:Resetting modules: 2023-12-12T11:38:17.464 INFO:teuthology.orchestra.run.smithi063.stdout: container-tools 2023-12-12T11:38:17.464 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:38:17.464 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-12T11:38:17.465 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:38:17.465 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:38:17.754 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-12T11:38:18.435 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:02:16 ago on Tue 12 Dec 2023 11:36:02 AM UTC. 2023-12-12T11:38:18.947 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:02:06 ago on Tue 12 Dec 2023 11:36:12 AM UTC. 2023-12-12T11:38:20.625 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-12T11:38:20.822 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:38:20.822 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repository Size 2023-12-12T11:38:20.823 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:38:20.823 INFO:teuthology.orchestra.run.smithi093.stdout:Installing group/module packages: 2023-12-12T11:38:20.823 INFO:teuthology.orchestra.run.smithi093.stdout: aardvark-dns x86_64 2:1.8.0-1.module_el8+712+4cd1bd69 appstream 1.0 M 2023-12-12T11:38:20.823 INFO:teuthology.orchestra.run.smithi093.stdout: buildah x86_64 1:1.32.0-1.module_el8+712+4cd1bd69 appstream 9.6 M 2023-12-12T11:38:20.823 INFO:teuthology.orchestra.run.smithi093.stdout: cockpit-podman noarch 78-1.module_el8+712+4cd1bd69 appstream 750 k 2023-12-12T11:38:20.823 INFO:teuthology.orchestra.run.smithi093.stdout: crun x86_64 1.9.2-1.module_el8+712+4cd1bd69 appstream 241 k 2023-12-12T11:38:20.823 INFO:teuthology.orchestra.run.smithi093.stdout: netavark x86_64 2:1.8.0-2.module_el8+712+4cd1bd69 appstream 3.9 M 2023-12-12T11:38:20.823 INFO:teuthology.orchestra.run.smithi093.stdout: python3-podman noarch 4.7.0-1.module_el8+712+4cd1bd69 appstream 178 k 2023-12-12T11:38:20.823 INFO:teuthology.orchestra.run.smithi093.stdout: skopeo x86_64 2:1.13.3-1.module_el8+712+4cd1bd69 appstream 8.1 M 2023-12-12T11:38:20.823 INFO:teuthology.orchestra.run.smithi093.stdout: toolbox x86_64 0.0.99.4-6.module_el8+712+4cd1bd69 appstream 2.5 M 2023-12-12T11:38:20.823 INFO:teuthology.orchestra.run.smithi093.stdout: udica noarch 0.2.6-20.module_el8+712+4cd1bd69 appstream 53 k 2023-12-12T11:38:20.823 INFO:teuthology.orchestra.run.smithi093.stdout:Installing dependencies: 2023-12-12T11:38:20.823 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2023-12-12T11:38:20.824 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2023-12-12T11:38:20.824 INFO:teuthology.orchestra.run.smithi093.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2023-12-12T11:38:20.824 INFO:teuthology.orchestra.run.smithi093.stdout:Installing weak dependencies: 2023-12-12T11:38:20.824 INFO:teuthology.orchestra.run.smithi093.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2023-12-12T11:38:20.824 INFO:teuthology.orchestra.run.smithi093.stdout:Installing module profiles: 2023-12-12T11:38:20.824 INFO:teuthology.orchestra.run.smithi093.stdout: container-tools/common 2023-12-12T11:38:20.824 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:38:20.824 INFO:teuthology.orchestra.run.smithi093.stdout:Enabling module streams: 2023-12-12T11:38:20.824 INFO:teuthology.orchestra.run.smithi093.stdout: container-tools rhel8 2023-12-12T11:38:20.824 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:38:20.824 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-12T11:38:20.824 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:38:20.824 INFO:teuthology.orchestra.run.smithi093.stdout:Install 13 Packages 2023-12-12T11:38:20.824 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:38:20.824 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 27 M 2023-12-12T11:38:20.825 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 89 M 2023-12-12T11:38:20.825 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-12T11:38:21.269 INFO:teuthology.orchestra.run.smithi093.stdout:(1/13): cockpit-podman-78-1.module_el8+712+4cd1 3.0 MB/s | 750 kB 00:00 2023-12-12T11:38:21.311 INFO:teuthology.orchestra.run.smithi093.stdout:(2/13): aardvark-dns-1.8.0-1.module_el8+712+4cd 3.5 MB/s | 1.0 MB 00:00 2023-12-12T11:38:21.336 INFO:teuthology.orchestra.run.smithi093.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 568 kB/s | 38 kB 00:00 2023-12-12T11:38:21.351 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-12T11:38:21.370 INFO:teuthology.orchestra.run.smithi093.stdout:(4/13): crun-1.9.2-1.module_el8+712+4cd1bd69.x8 4.0 MB/s | 241 kB 00:00 2023-12-12T11:38:21.436 INFO:teuthology.orchestra.run.smithi093.stdout:(5/13): python3-podman-4.7.0-1.module_el8+712+4 2.6 MB/s | 178 kB 00:00 2023-12-12T11:38:21.529 INFO:teuthology.orchestra.run.smithi093.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 270 kB/s | 25 kB 00:00 2023-12-12T11:38:21.562 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:38:21.562 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2023-12-12T11:38:21.562 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:38:21.562 INFO:teuthology.orchestra.run.smithi063.stdout:Installing group/module packages: 2023-12-12T11:38:21.563 INFO:teuthology.orchestra.run.smithi063.stdout: aardvark-dns x86_64 2:1.8.0-1.module_el8+712+4cd1bd69 appstream 1.0 M 2023-12-12T11:38:21.563 INFO:teuthology.orchestra.run.smithi063.stdout: buildah x86_64 1:1.32.0-1.module_el8+712+4cd1bd69 appstream 9.6 M 2023-12-12T11:38:21.563 INFO:teuthology.orchestra.run.smithi063.stdout: cockpit-podman noarch 78-1.module_el8+712+4cd1bd69 appstream 750 k 2023-12-12T11:38:21.563 INFO:teuthology.orchestra.run.smithi063.stdout: crun x86_64 1.9.2-1.module_el8+712+4cd1bd69 appstream 241 k 2023-12-12T11:38:21.563 INFO:teuthology.orchestra.run.smithi063.stdout: netavark x86_64 2:1.8.0-2.module_el8+712+4cd1bd69 appstream 3.9 M 2023-12-12T11:38:21.563 INFO:teuthology.orchestra.run.smithi063.stdout: python3-podman noarch 4.7.0-1.module_el8+712+4cd1bd69 appstream 178 k 2023-12-12T11:38:21.563 INFO:teuthology.orchestra.run.smithi063.stdout: skopeo x86_64 2:1.13.3-1.module_el8+712+4cd1bd69 appstream 8.1 M 2023-12-12T11:38:21.563 INFO:teuthology.orchestra.run.smithi063.stdout: toolbox x86_64 0.0.99.4-6.module_el8+712+4cd1bd69 appstream 2.5 M 2023-12-12T11:38:21.563 INFO:teuthology.orchestra.run.smithi063.stdout: udica noarch 0.2.6-20.module_el8+712+4cd1bd69 appstream 53 k 2023-12-12T11:38:21.563 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2023-12-12T11:38:21.563 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2023-12-12T11:38:21.563 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2023-12-12T11:38:21.563 INFO:teuthology.orchestra.run.smithi063.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2023-12-12T11:38:21.563 INFO:teuthology.orchestra.run.smithi063.stdout:Installing weak dependencies: 2023-12-12T11:38:21.563 INFO:teuthology.orchestra.run.smithi063.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2023-12-12T11:38:21.563 INFO:teuthology.orchestra.run.smithi063.stdout:Installing module profiles: 2023-12-12T11:38:21.564 INFO:teuthology.orchestra.run.smithi063.stdout: container-tools/common 2023-12-12T11:38:21.564 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:38:21.564 INFO:teuthology.orchestra.run.smithi063.stdout:Enabling module streams: 2023-12-12T11:38:21.564 INFO:teuthology.orchestra.run.smithi063.stdout: container-tools rhel8 2023-12-12T11:38:21.564 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:38:21.564 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-12T11:38:21.564 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:38:21.564 INFO:teuthology.orchestra.run.smithi063.stdout:Install 13 Packages 2023-12-12T11:38:21.564 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:38:21.565 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 27 M 2023-12-12T11:38:21.565 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 89 M 2023-12-12T11:38:21.565 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-12T11:38:21.596 INFO:teuthology.orchestra.run.smithi093.stdout:(7/13): netavark-1.8.0-2.module_el8+712+4cd1bd6 15 MB/s | 3.9 MB 00:00 2023-12-12T11:38:21.621 INFO:teuthology.orchestra.run.smithi093.stdout:(8/13): python3-pyxdg-0.25-16.el8.noarch.rpm 1.0 MB/s | 94 kB 00:00 2023-12-12T11:38:21.754 INFO:teuthology.orchestra.run.smithi093.stdout:(9/13): buildah-1.32.0-1.module_el8+712+4cd1bd6 13 MB/s | 9.6 MB 00:00 2023-12-12T11:38:21.821 INFO:teuthology.orchestra.run.smithi093.stdout:(10/13): udica-0.2.6-20.module_el8+712+4cd1bd69 793 kB/s | 53 kB 00:00 2023-12-12T11:38:21.890 INFO:teuthology.orchestra.run.smithi093.stdout:(11/13): toolbox-0.0.99.4-6.module_el8+712+4cd1 9.5 MB/s | 2.5 MB 00:00 2023-12-12T11:38:21.913 INFO:teuthology.orchestra.run.smithi093.stdout:(12/13): yajl-2.1.0-12.el8.x86_64.rpm 447 kB/s | 41 kB 00:00 2023-12-12T11:38:21.982 INFO:teuthology.orchestra.run.smithi063.stdout:(1/13): cockpit-podman-78-1.module_el8+712+4cd1 1.9 MB/s | 750 kB 00:00 2023-12-12T11:38:22.015 INFO:teuthology.orchestra.run.smithi063.stdout:(2/13): aardvark-dns-1.8.0-1.module_el8+712+4cd 2.4 MB/s | 1.0 MB 00:00 2023-12-12T11:38:22.041 INFO:teuthology.orchestra.run.smithi063.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 649 kB/s | 38 kB 00:00 2023-12-12T11:38:22.075 INFO:teuthology.orchestra.run.smithi063.stdout:(4/13): crun-1.9.2-1.module_el8+712+4cd1bd69.x8 4.0 MB/s | 241 kB 00:00 2023-12-12T11:38:22.080 INFO:teuthology.orchestra.run.smithi093.stdout:(13/13): skopeo-1.13.3-1.module_el8+712+4cd1bd6 17 MB/s | 8.1 MB 00:00 2023-12-12T11:38:22.081 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:38:22.081 INFO:teuthology.orchestra.run.smithi093.stdout:Total 21 MB/s | 27 MB 00:01 2023-12-12T11:38:22.142 INFO:teuthology.orchestra.run.smithi063.stdout:(5/13): python3-podman-4.7.0-1.module_el8+712+4 2.6 MB/s | 178 kB 00:00 2023-12-12T11:38:22.200 INFO:teuthology.orchestra.run.smithi063.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 425 kB/s | 25 kB 00:00 2023-12-12T11:38:22.301 INFO:teuthology.orchestra.run.smithi063.stdout:(7/13): netavark-1.8.0-2.module_el8+712+4cd1bd6 15 MB/s | 3.9 MB 00:00 2023-12-12T11:38:22.318 INFO:teuthology.orchestra.run.smithi063.stdout:(8/13): python3-pyxdg-0.25-16.el8.noarch.rpm 803 kB/s | 94 kB 00:00 2023-12-12T11:38:22.510 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-12T11:38:22.535 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-12T11:38:22.535 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-12T11:38:22.552 INFO:teuthology.orchestra.run.smithi063.stdout:(9/13): toolbox-0.0.99.4-6.module_el8+712+4cd1b 11 MB/s | 2.5 MB 00:00 2023-12-12T11:38:22.669 INFO:teuthology.orchestra.run.smithi063.stdout:(10/13): buildah-1.32.0-1.module_el8+712+4cd1bd 9.0 MB/s | 9.6 MB 00:01 2023-12-12T11:38:22.694 INFO:teuthology.orchestra.run.smithi063.stdout:(11/13): udica-0.2.6-20.module_el8+712+4cd1bd69 371 kB/s | 53 kB 00:00 2023-12-12T11:38:22.711 INFO:teuthology.orchestra.run.smithi063.stdout:(12/13): yajl-2.1.0-12.el8.x86_64.rpm 987 kB/s | 41 kB 00:00 2023-12-12T11:38:22.796 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-12T11:38:22.800 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-12T11:38:22.819 INFO:teuthology.orchestra.run.smithi063.stdout:(13/13): skopeo-1.13.3-1.module_el8+712+4cd1bd6 16 MB/s | 8.1 MB 00:00 2023-12-12T11:38:22.820 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:38:22.820 INFO:teuthology.orchestra.run.smithi063.stdout:Total 21 MB/s | 27 MB 00:01 2023-12-12T11:38:23.267 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-12T11:38:23.294 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-12T11:38:23.294 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-12T11:38:23.510 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-12T11:38:23.577 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-12T11:38:23.581 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-12T11:38:23.749 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2023-12-12T11:38:23.893 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-12T11:38:24.048 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/13 2023-12-12T11:38:24.298 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-12T11:38:24.500 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-12T11:38:24.551 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2023-12-12T11:38:24.684 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-12T11:38:24.919 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/13 2023-12-12T11:38:25.041 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 5/13 2023-12-12T11:38:25.162 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-12T11:38:25.768 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 5/13 2023-12-12T11:38:26.067 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-12T11:38:26.302 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 7/13 2023-12-12T11:38:26.538 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 8/13 2023-12-12T11:38:26.773 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 9/13 2023-12-12T11:38:26.837 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-12T11:38:27.052 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 7/13 2023-12-12T11:38:27.197 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 10/13 2023-12-12T11:38:27.302 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 8/13 2023-12-12T11:38:27.539 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 9/13 2023-12-12T11:38:27.946 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 10/13 2023-12-12T11:38:28.115 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-12T11:38:28.328 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 12/13 2023-12-12T11:38:28.481 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-12T11:38:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-12T11:38:29.132 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-12T11:38:29.133 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 1/13 2023-12-12T11:38:29.133 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2/13 2023-12-12T11:38:29.133 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 3/13 2023-12-12T11:38:29.133 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-12T11:38:29.133 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 5/13 2023-12-12T11:38:29.133 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-12T11:38:29.133 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 7/13 2023-12-12T11:38:29.133 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2023-12-12T11:38:29.133 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2023-12-12T11:38:29.133 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 10/13 2023-12-12T11:38:29.133 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-12T11:38:29.133 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 12/13 2023-12-12T11:38:29.135 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 12/13 2023-12-12T11:38:29.323 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-12T11:38:30.032 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-12T11:38:30.032 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 1/13 2023-12-12T11:38:30.032 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2/13 2023-12-12T11:38:30.032 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 3/13 2023-12-12T11:38:30.033 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-12T11:38:30.033 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 5/13 2023-12-12T11:38:30.033 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-12T11:38:30.033 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 7/13 2023-12-12T11:38:30.033 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2023-12-12T11:38:30.033 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2023-12-12T11:38:30.033 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 10/13 2023-12-12T11:38:30.033 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-12T11:38:30.033 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 12/13 2023-12-12T11:38:30.160 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2023-12-12T11:38:30.160 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:38:30.160 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-12T11:38:30.160 INFO:teuthology.orchestra.run.smithi093.stdout: aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-12T11:38:30.160 INFO:teuthology.orchestra.run.smithi093.stdout: buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-12T11:38:30.160 INFO:teuthology.orchestra.run.smithi093.stdout: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 2023-12-12T11:38:30.160 INFO:teuthology.orchestra.run.smithi093.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2023-12-12T11:38:30.160 INFO:teuthology.orchestra.run.smithi093.stdout: crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 2023-12-12T11:38:30.160 INFO:teuthology.orchestra.run.smithi093.stdout: netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 2023-12-12T11:38:30.160 INFO:teuthology.orchestra.run.smithi093.stdout: python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noarch 2023-12-12T11:38:30.160 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-12T11:38:30.161 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-12T11:38:30.161 INFO:teuthology.orchestra.run.smithi093.stdout: skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 2023-12-12T11:38:30.161 INFO:teuthology.orchestra.run.smithi093.stdout: toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 2023-12-12T11:38:30.161 INFO:teuthology.orchestra.run.smithi093.stdout: udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 2023-12-12T11:38:30.161 INFO:teuthology.orchestra.run.smithi093.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-12T11:38:30.161 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:38:30.161 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-12T11:38:30.379 DEBUG:teuthology.parallel:result is None 2023-12-12T11:38:30.906 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2023-12-12T11:38:30.906 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:38:30.906 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-12T11:38:30.906 INFO:teuthology.orchestra.run.smithi063.stdout: aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-12T11:38:30.906 INFO:teuthology.orchestra.run.smithi063.stdout: buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-12T11:38:30.906 INFO:teuthology.orchestra.run.smithi063.stdout: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 2023-12-12T11:38:30.906 INFO:teuthology.orchestra.run.smithi063.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2023-12-12T11:38:30.906 INFO:teuthology.orchestra.run.smithi063.stdout: crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 2023-12-12T11:38:30.906 INFO:teuthology.orchestra.run.smithi063.stdout: netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 2023-12-12T11:38:30.906 INFO:teuthology.orchestra.run.smithi063.stdout: python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noarch 2023-12-12T11:38:30.906 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-12T11:38:30.906 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-12T11:38:30.907 INFO:teuthology.orchestra.run.smithi063.stdout: skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 2023-12-12T11:38:30.907 INFO:teuthology.orchestra.run.smithi063.stdout: toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 2023-12-12T11:38:30.907 INFO:teuthology.orchestra.run.smithi063.stdout: udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 2023-12-12T11:38:30.907 INFO:teuthology.orchestra.run.smithi063.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-12T11:38:30.907 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:38:30.907 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-12T11:38:31.146 DEBUG:teuthology.parallel:result is None 2023-12-12T11:38:31.146 INFO:teuthology.run_tasks:Running task install... 2023-12-12T11:38:31.157 DEBUG:teuthology.task.install:project ceph 2023-12-12T11:38:31.157 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9'}} 2023-12-12T11:38:31.157 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9'} 2023-12-12T11:38:31.157 INFO:teuthology.task.install:Using flavor: default 2023-12-12T11:38:31.164 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-12T11:38:31.164 INFO:teuthology.task.install:extra packages: [] 2023-12-12T11:38:31.164 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9', 'tag': None, 'wait_for_package': False} 2023-12-12T11:38:31.165 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-12T11:38:31.165 INFO:teuthology.packaging:ref: None 2023-12-12T11:38:31.165 INFO:teuthology.packaging:tag: None 2023-12-12T11:38:31.165 INFO:teuthology.packaging:branch: quincy 2023-12-12T11:38:31.165 INFO:teuthology.packaging:sha1: f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 2023-12-12T11:38:31.165 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-12T11:38:31.167 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9', 'tag': None, 'wait_for_package': False} 2023-12-12T11:38:31.167 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-12T11:38:31.167 INFO:teuthology.packaging:ref: None 2023-12-12T11:38:31.168 INFO:teuthology.packaging:tag: None 2023-12-12T11:38:31.168 INFO:teuthology.packaging:branch: quincy 2023-12-12T11:38:31.168 INFO:teuthology.packaging:sha1: f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 2023-12-12T11:38:31.168 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-12T11:38:31.400 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/quincy/bef78a51880cb7d25e258a6b00c26898788a1958/centos/8/flavors/default/ 2023-12-12T11:38:31.401 INFO:teuthology.task.install.rpm:Package version is 17.2.7-123.gbef78a51 2023-12-12T11:38:31.507 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/quincy/bef78a51880cb7d25e258a6b00c26898788a1958/centos/8/flavors/default/ 2023-12-12T11:38:31.507 INFO:teuthology.task.install.rpm:Package version is 17.2.7-123.gbef78a51 2023-12-12T11:38:31.580 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/quincy/bef78a51880cb7d25e258a6b00c26898788a1958/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/bef78a51880cb7d25e258a6b00c26898788a1958/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/bef78a51880cb7d25e258a6b00c26898788a1958/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-12T11:38:31.581 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-12T11:38:31.581 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-12T11:38:31.617 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/quincy/bef78a51880cb7d25e258a6b00c26898788a1958/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/bef78a51880cb7d25e258a6b00c26898788a1958/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/bef78a51880cb7d25e258a6b00c26898788a1958/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-12T11:38:31.618 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-12T11:38:31.618 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-12T11:38:31.652 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-12T11:38:31.653 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-12T11:38:31.653 INFO:teuthology.packaging:ref: None 2023-12-12T11:38:31.653 INFO:teuthology.packaging:tag: None 2023-12-12T11:38:31.653 INFO:teuthology.packaging:branch: quincy 2023-12-12T11:38:31.653 INFO:teuthology.packaging:sha1: f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 2023-12-12T11:38:31.653 DEBUG:teuthology.orchestra.run.smithi063:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-12T11:38:31.699 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-12T11:38:31.699 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-12T11:38:31.699 INFO:teuthology.packaging:ref: None 2023-12-12T11:38:31.699 INFO:teuthology.packaging:tag: None 2023-12-12T11:38:31.700 INFO:teuthology.packaging:branch: quincy 2023-12-12T11:38:31.700 INFO:teuthology.packaging:sha1: f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 2023-12-12T11:38:31.700 DEBUG:teuthology.orchestra.run.smithi093:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-12T11:38:31.765 DEBUG:teuthology.orchestra.run.smithi063:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-12T11:38:31.814 DEBUG:teuthology.orchestra.run.smithi093:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-12T11:38:31.861 DEBUG:teuthology.orchestra.run.smithi063:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-12T11:38:31.910 DEBUG:teuthology.orchestra.run.smithi093:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-12T11:38:31.932 INFO:teuthology.orchestra.run.smithi063.stdout:check_obsoletes = 1 2023-12-12T11:38:31.935 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum clean all 2023-12-12T11:38:31.979 INFO:teuthology.orchestra.run.smithi093.stdout:check_obsoletes = 1 2023-12-12T11:38:31.983 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum clean all 2023-12-12T11:38:32.318 INFO:teuthology.orchestra.run.smithi063.stdout:76 files removed 2023-12-12T11:38:32.342 INFO:teuthology.orchestra.run.smithi093.stdout:76 files removed 2023-12-12T11:38:32.356 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-radosgw 2023-12-12T11:38:32.377 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install ceph-radosgw 2023-12-12T11:38:33.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph packages for x86_64 217 kB/s | 78 kB 00:00 2023-12-12T11:38:33.362 INFO:teuthology.orchestra.run.smithi063.stdout:ceph packages for x86_64 186 kB/s | 78 kB 00:00 2023-12-12T11:38:33.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph noarch packages 38 kB/s | 9.1 kB 00:00 2023-12-12T11:38:33.637 INFO:teuthology.orchestra.run.smithi063.stdout:ceph noarch packages 39 kB/s | 9.1 kB 00:00 2023-12-12T11:38:33.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph source packages 5.0 kB/s | 1.4 kB 00:00 2023-12-12T11:38:33.938 INFO:teuthology.orchestra.run.smithi063.stdout:ceph source packages 5.3 kB/s | 1.4 kB 00:00 2023-12-12T11:38:35.646 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 8 - AppStream 21 MB/s | 35 MB 00:01 2023-12-12T11:38:35.852 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 8 - AppStream 18 MB/s | 35 MB 00:01 2023-12-12T11:38:45.177 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 8 - BaseOS 22 MB/s | 56 MB 00:02 2023-12-12T11:38:45.239 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 8 - BaseOS 23 MB/s | 56 MB 00:02 2023-12-12T11:38:53.960 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 8 - Extras 44 kB/s | 18 kB 00:00 2023-12-12T11:38:54.536 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 8 - Extras common packages 18 kB/s | 6.9 kB 00:00 2023-12-12T11:38:54.572 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 8 - Extras 44 kB/s | 18 kB 00:00 2023-12-12T11:38:55.240 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 8 - Extras common packages 15 kB/s | 6.9 kB 00:00 2023-12-12T11:38:55.795 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 8 - PowerTools 6.0 MB/s | 6.6 MB 00:01 2023-12-12T11:38:56.199 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 8 - PowerTools 8.4 MB/s | 6.6 MB 00:00 2023-12-12T11:38:57.338 INFO:teuthology.orchestra.run.smithi093.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-12-12T11:38:57.775 INFO:teuthology.orchestra.run.smithi063.stdout:Copr repo for python3-asyncssh owned by ceph 31 kB/s | 3.5 kB 00:00 2023-12-12T11:38:58.801 INFO:teuthology.orchestra.run.smithi063.stdout:Extra Packages for Enterprise Linux 19 MB/s | 16 MB 00:00 2023-12-12T11:38:59.007 INFO:teuthology.orchestra.run.smithi093.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-12-12T11:39:03.501 INFO:teuthology.orchestra.run.smithi093.stdout:lab-extras 334 kB/s | 24 kB 00:00 2023-12-12T11:39:03.535 INFO:teuthology.orchestra.run.smithi063.stdout:lab-extras 438 kB/s | 24 kB 00:00 2023-12-12T11:39:08.257 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-12T11:39:08.260 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:39:08.260 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repository Size 2023-12-12T11:39:08.260 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:39:08.260 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-12T11:39:08.260 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-radosgw x86_64 2:17.2.7-123.gbef78a51.el8 ceph 17 M 2023-12-12T11:39:08.260 INFO:teuthology.orchestra.run.smithi093.stdout:Upgrading: 2023-12-12T11:39:08.260 INFO:teuthology.orchestra.run.smithi093.stdout: librados2 x86_64 2:17.2.7-123.gbef78a51.el8 ceph 3.5 M 2023-12-12T11:39:08.261 INFO:teuthology.orchestra.run.smithi093.stdout: librbd1 x86_64 2:17.2.7-123.gbef78a51.el8 ceph 3.6 M 2023-12-12T11:39:08.261 INFO:teuthology.orchestra.run.smithi093.stdout:Installing dependencies: 2023-12-12T11:39:08.261 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-base x86_64 2:17.2.7-123.gbef78a51.el8 ceph 5.2 M 2023-12-12T11:39:08.261 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-common x86_64 2:17.2.7-123.gbef78a51.el8 ceph 23 M 2023-12-12T11:39:08.261 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-selinux x86_64 2:17.2.7-123.gbef78a51.el8 ceph 24 k 2023-12-12T11:39:08.261 INFO:teuthology.orchestra.run.smithi093.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-12T11:39:08.261 INFO:teuthology.orchestra.run.smithi093.stdout: libcephfs2 x86_64 2:17.2.7-123.gbef78a51.el8 ceph 795 k 2023-12-12T11:39:08.261 INFO:teuthology.orchestra.run.smithi093.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-12T11:39:08.261 INFO:teuthology.orchestra.run.smithi093.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-12-12T11:39:08.261 INFO:teuthology.orchestra.run.smithi093.stdout: libradosstriper1 x86_64 2:17.2.7-123.gbef78a51.el8 ceph 506 k 2023-12-12T11:39:08.261 INFO:teuthology.orchestra.run.smithi093.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2023-12-12T11:39:08.261 INFO:teuthology.orchestra.run.smithi093.stdout: librgw2 x86_64 2:17.2.7-123.gbef78a51.el8 ceph 5.6 M 2023-12-12T11:39:08.261 INFO:teuthology.orchestra.run.smithi093.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-12T11:39:08.261 INFO:teuthology.orchestra.run.smithi093.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-12-12T11:39:08.262 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-argparse x86_64 2:17.2.7-123.gbef78a51.el8 ceph 45 k 2023-12-12T11:39:08.262 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-common x86_64 2:17.2.7-123.gbef78a51.el8 ceph 115 k 2023-12-12T11:39:08.262 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cephfs x86_64 2:17.2.7-123.gbef78a51.el8 ceph 190 k 2023-12-12T11:39:08.262 INFO:teuthology.orchestra.run.smithi093.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-12-12T11:39:08.262 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rados x86_64 2:17.2.7-123.gbef78a51.el8 ceph 371 k 2023-12-12T11:39:08.262 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rbd x86_64 2:17.2.7-123.gbef78a51.el8 ceph 358 k 2023-12-12T11:39:08.262 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rgw x86_64 2:17.2.7-123.gbef78a51.el8 ceph 107 k 2023-12-12T11:39:08.262 INFO:teuthology.orchestra.run.smithi093.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-12T11:39:08.262 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:39:08.262 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-12T11:39:08.262 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:39:08.262 INFO:teuthology.orchestra.run.smithi093.stdout:Install 21 Packages 2023-12-12T11:39:08.262 INFO:teuthology.orchestra.run.smithi093.stdout:Upgrade 2 Packages 2023-12-12T11:39:08.262 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:39:08.263 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 64 M 2023-12-12T11:39:08.263 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-12T11:39:08.482 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-12T11:39:08.485 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:39:08.485 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2023-12-12T11:39:08.485 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:39:08.485 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-12T11:39:08.485 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-radosgw x86_64 2:17.2.7-123.gbef78a51.el8 ceph 17 M 2023-12-12T11:39:08.485 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrading: 2023-12-12T11:39:08.486 INFO:teuthology.orchestra.run.smithi063.stdout: librados2 x86_64 2:17.2.7-123.gbef78a51.el8 ceph 3.5 M 2023-12-12T11:39:08.486 INFO:teuthology.orchestra.run.smithi063.stdout: librbd1 x86_64 2:17.2.7-123.gbef78a51.el8 ceph 3.6 M 2023-12-12T11:39:08.486 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2023-12-12T11:39:08.486 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base x86_64 2:17.2.7-123.gbef78a51.el8 ceph 5.2 M 2023-12-12T11:39:08.486 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-common x86_64 2:17.2.7-123.gbef78a51.el8 ceph 23 M 2023-12-12T11:39:08.486 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-selinux x86_64 2:17.2.7-123.gbef78a51.el8 ceph 24 k 2023-12-12T11:39:08.487 INFO:teuthology.orchestra.run.smithi063.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-12T11:39:08.487 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs2 x86_64 2:17.2.7-123.gbef78a51.el8 ceph 795 k 2023-12-12T11:39:08.487 INFO:teuthology.orchestra.run.smithi063.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-12T11:39:08.487 INFO:teuthology.orchestra.run.smithi063.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-12-12T11:39:08.487 INFO:teuthology.orchestra.run.smithi063.stdout: libradosstriper1 x86_64 2:17.2.7-123.gbef78a51.el8 ceph 506 k 2023-12-12T11:39:08.487 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2023-12-12T11:39:08.487 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2 x86_64 2:17.2.7-123.gbef78a51.el8 ceph 5.6 M 2023-12-12T11:39:08.488 INFO:teuthology.orchestra.run.smithi063.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-12T11:39:08.488 INFO:teuthology.orchestra.run.smithi063.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-12-12T11:39:08.488 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-argparse x86_64 2:17.2.7-123.gbef78a51.el8 ceph 45 k 2023-12-12T11:39:08.488 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common x86_64 2:17.2.7-123.gbef78a51.el8 ceph 115 k 2023-12-12T11:39:08.488 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cephfs x86_64 2:17.2.7-123.gbef78a51.el8 ceph 190 k 2023-12-12T11:39:08.488 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-12-12T11:39:08.488 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rados x86_64 2:17.2.7-123.gbef78a51.el8 ceph 371 k 2023-12-12T11:39:08.489 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rbd x86_64 2:17.2.7-123.gbef78a51.el8 ceph 358 k 2023-12-12T11:39:08.489 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rgw x86_64 2:17.2.7-123.gbef78a51.el8 ceph 107 k 2023-12-12T11:39:08.489 INFO:teuthology.orchestra.run.smithi063.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-12T11:39:08.489 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:39:08.489 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-12T11:39:08.489 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:39:08.489 INFO:teuthology.orchestra.run.smithi063.stdout:Install 21 Packages 2023-12-12T11:39:08.490 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrade 2 Packages 2023-12-12T11:39:08.490 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:39:08.491 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 64 M 2023-12-12T11:39:08.491 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-12T11:39:10.466 INFO:teuthology.orchestra.run.smithi093.stdout:(1/23): ceph-common-17.2.7-123.gbef78a51.el8.x8 18 MB/s | 23 MB 00:01 2023-12-12T11:39:10.516 INFO:teuthology.orchestra.run.smithi093.stdout:(2/23): ceph-selinux-17.2.7-123.gbef78a51.el8.x 492 kB/s | 24 kB 00:00 2023-12-12T11:39:10.866 INFO:teuthology.orchestra.run.smithi093.stdout:(3/23): libcephfs2-17.2.7-123.gbef78a51.el8.x86 2.2 MB/s | 795 kB 00:00 2023-12-12T11:39:10.991 INFO:teuthology.orchestra.run.smithi093.stdout:(4/23): libradosstriper1-17.2.7-123.gbef78a51.e 4.0 MB/s | 506 kB 00:00 2023-12-12T11:39:11.642 INFO:teuthology.orchestra.run.smithi093.stdout:(5/23): librgw2-17.2.7-123.gbef78a51.el8.x86_64 8.6 MB/s | 5.6 MB 00:00 2023-12-12T11:39:11.709 INFO:teuthology.orchestra.run.smithi093.stdout:(6/23): python3-ceph-argparse-17.2.7-123.gbef78 674 kB/s | 45 kB 00:00 2023-12-12T11:39:11.759 INFO:teuthology.orchestra.run.smithi093.stdout:(7/23): python3-ceph-common-17.2.7-123.gbef78a5 2.3 MB/s | 115 kB 00:00 2023-12-12T11:39:11.826 INFO:teuthology.orchestra.run.smithi093.stdout:(8/23): python3-cephfs-17.2.7-123.gbef78a51.el8 2.8 MB/s | 190 kB 00:00 2023-12-12T11:39:11.894 INFO:teuthology.orchestra.run.smithi093.stdout:(9/23): python3-rados-17.2.7-123.gbef78a51.el8. 5.5 MB/s | 371 kB 00:00 2023-12-12T11:39:11.959 INFO:teuthology.orchestra.run.smithi093.stdout:(10/23): python3-rbd-17.2.7-123.gbef78a51.el8.x 5.3 MB/s | 358 kB 00:00 2023-12-12T11:39:12.002 INFO:teuthology.orchestra.run.smithi093.stdout:(11/23): python3-rgw-17.2.7-123.gbef78a51.el8.x 2.5 MB/s | 107 kB 00:00 2023-12-12T11:39:12.337 INFO:teuthology.orchestra.run.smithi063.stdout:(1/23): ceph-base-17.2.7-123.gbef78a51.el8.x86_ 1.9 MB/s | 5.2 MB 00:02 2023-12-12T11:39:12.378 INFO:teuthology.orchestra.run.smithi063.stdout:(2/23): ceph-selinux-17.2.7-123.gbef78a51.el8.x 588 kB/s | 24 kB 00:00 2023-12-12T11:39:12.385 INFO:teuthology.orchestra.run.smithi093.stdout:(12/23): librdkafka-1.6.1-1.el8.x86_64.rpm 1.7 MB/s | 677 kB 00:00 2023-12-12T11:39:12.477 INFO:teuthology.orchestra.run.smithi093.stdout:(13/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.8 MB/s | 259 kB 00:00 2023-12-12T11:39:12.527 INFO:teuthology.orchestra.run.smithi093.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 884 kB/s | 44 kB 00:00 2023-12-12T11:39:12.596 INFO:teuthology.orchestra.run.smithi063.stdout:(3/23): libcephfs2-17.2.7-123.gbef78a51.el8.x86 3.6 MB/s | 795 kB 00:00 2023-12-12T11:39:12.737 INFO:teuthology.orchestra.run.smithi063.stdout:(4/23): libradosstriper1-17.2.7-123.gbef78a51.e 3.5 MB/s | 506 kB 00:00 2023-12-12T11:39:12.869 INFO:teuthology.orchestra.run.smithi093.stdout:(15/23): librabbitmq-0.9.0-4.el8.x86_64.rpm 137 kB/s | 47 kB 00:00 2023-12-12T11:39:13.086 INFO:teuthology.orchestra.run.smithi093.stdout:(16/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2023-12-12T11:39:13.153 INFO:teuthology.orchestra.run.smithi093.stdout:(17/23): liboath-2.6.2-3.el8.x86_64.rpm 884 kB/s | 59 kB 00:00 2023-12-12T11:39:13.203 INFO:teuthology.orchestra.run.smithi093.stdout:(18/23): libunwind-1.3.1-3.el8.x86_64.rpm 1.5 MB/s | 75 kB 00:00 2023-12-12T11:39:13.487 INFO:teuthology.orchestra.run.smithi093.stdout:(19/23): thrift-0.13.0-2.el8.x86_64.rpm 6.1 MB/s | 1.7 MB 00:00 2023-12-12T11:39:13.638 INFO:teuthology.orchestra.run.smithi063.stdout:(5/23): ceph-common-17.2.7-123.gbef78a51.el8.x8 5.9 MB/s | 23 MB 00:03 2023-12-12T11:39:13.813 INFO:teuthology.orchestra.run.smithi063.stdout:(6/23): ceph-radosgw-17.2.7-123.gbef78a51.el8.x 4.1 MB/s | 17 MB 00:04 2023-12-12T11:39:13.838 INFO:teuthology.orchestra.run.smithi063.stdout:(7/23): python3-ceph-argparse-17.2.7-123.gbef78 224 kB/s | 45 kB 00:00 2023-12-12T11:39:13.862 INFO:teuthology.orchestra.run.smithi093.stdout:(20/23): librados2-17.2.7-123.gbef78a51.el8.x86 9.2 MB/s | 3.5 MB 00:00 2023-12-12T11:39:13.913 INFO:teuthology.orchestra.run.smithi063.stdout:(8/23): python3-ceph-common-17.2.7-123.gbef78a5 1.1 MB/s | 115 kB 00:00 2023-12-12T11:39:13.947 INFO:teuthology.orchestra.run.smithi063.stdout:(9/23): python3-cephfs-17.2.7-123.gbef78a51.el8 1.7 MB/s | 190 kB 00:00 2023-12-12T11:39:14.022 INFO:teuthology.orchestra.run.smithi063.stdout:(10/23): python3-rados-17.2.7-123.gbef78a51.el8 3.4 MB/s | 371 kB 00:00 2023-12-12T11:39:14.046 INFO:teuthology.orchestra.run.smithi093.stdout:(21/23): ceph-base-17.2.7-123.gbef78a51.el8.x86 1.1 MB/s | 5.2 MB 00:04 2023-12-12T11:39:14.097 INFO:teuthology.orchestra.run.smithi063.stdout:(11/23): librgw2-17.2.7-123.gbef78a51.el8.x86_6 4.1 MB/s | 5.6 MB 00:01 2023-12-12T11:39:14.123 INFO:teuthology.orchestra.run.smithi063.stdout:(12/23): python3-rbd-17.2.7-123.gbef78a51.el8.x 2.0 MB/s | 358 kB 00:00 2023-12-12T11:39:14.140 INFO:teuthology.orchestra.run.smithi063.stdout:(13/23): python3-rgw-17.2.7-123.gbef78a51.el8.x 909 kB/s | 107 kB 00:00 2023-12-12T11:39:14.213 INFO:teuthology.orchestra.run.smithi093.stdout:(22/23): librbd1-17.2.7-123.gbef78a51.el8.x86_6 10 MB/s | 3.6 MB 00:00 2023-12-12T11:39:14.231 INFO:teuthology.orchestra.run.smithi063.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 482 kB/s | 44 kB 00:00 2023-12-12T11:39:14.265 INFO:teuthology.orchestra.run.smithi063.stdout:(15/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.8 MB/s | 259 kB 00:00 2023-12-12T11:39:14.324 INFO:teuthology.orchestra.run.smithi063.stdout:(16/23): librdkafka-1.6.1-1.el8.x86_64.rpm 2.9 MB/s | 677 kB 00:00 2023-12-12T11:39:14.591 INFO:teuthology.orchestra.run.smithi063.stdout:(17/23): librabbitmq-0.9.0-4.el8.x86_64.rpm 131 kB/s | 47 kB 00:00 2023-12-12T11:39:14.741 INFO:teuthology.orchestra.run.smithi063.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 141 kB/s | 59 kB 00:00 2023-12-12T11:39:14.858 INFO:teuthology.orchestra.run.smithi063.stdout:(19/23): gperftools-libs-2.7-9.el8.x86_64.rpm 517 kB/s | 306 kB 00:00 2023-12-12T11:39:15.008 INFO:teuthology.orchestra.run.smithi063.stdout:(20/23): libunwind-1.3.1-3.el8.x86_64.rpm 180 kB/s | 75 kB 00:00 2023-12-12T11:39:15.217 INFO:teuthology.orchestra.run.smithi063.stdout:(21/23): thrift-0.13.0-2.el8.x86_64.rpm 3.7 MB/s | 1.7 MB 00:00 2023-12-12T11:39:15.520 INFO:teuthology.orchestra.run.smithi063.stdout:(22/23): librados2-17.2.7-123.gbef78a51.el8.x86 5.2 MB/s | 3.5 MB 00:00 2023-12-12T11:39:15.750 INFO:teuthology.orchestra.run.smithi063.stdout:(23/23): librbd1-17.2.7-123.gbef78a51.el8.x86_6 4.8 MB/s | 3.6 MB 00:00 2023-12-12T11:39:15.755 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:39:15.756 INFO:teuthology.orchestra.run.smithi063.stdout:Total 8.8 MB/s | 64 MB 00:07 2023-12-12T11:39:15.858 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-12T11:39:15.914 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-12T11:39:15.914 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-12T11:39:16.342 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-12T11:39:16.346 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-12T11:39:17.406 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-12T11:39:17.601 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-12-12T11:39:17.842 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-12T11:39:18.303 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-12T11:39:18.517 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : librados2-2:17.2.7-123.gbef78a51.el8.x86_64 3/25 2023-12-12T11:39:18.631 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados2-2:17.2.7-123.gbef78a51.el8.x86_64 3/25 2023-12-12T11:39:18.869 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rados-2:17.2.7-123.gbef78a51.el8.x86_64 4/25 2023-12-12T11:39:19.067 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephfs2-2:17.2.7-123.gbef78a51.el8.x86_64 5/25 2023-12-12T11:39:19.541 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcephfs2-2:17.2.7-123.gbef78a51.el8.x86_64 5/25 2023-12-12T11:39:19.671 INFO:teuthology.orchestra.run.smithi093.stdout:(23/23): ceph-radosgw-17.2.7-123.gbef78a51.el8. 1.6 MB/s | 17 MB 00:10 2023-12-12T11:39:19.673 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:39:19.674 INFO:teuthology.orchestra.run.smithi093.stdout:Total 5.6 MB/s | 64 MB 00:11 2023-12-12T11:39:19.726 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : librbd1-2:17.2.7-123.gbef78a51.el8.x86_64 6/25 2023-12-12T11:39:19.772 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-12T11:39:19.823 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-12T11:39:19.823 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-12T11:39:19.990 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librbd1-2:17.2.7-123.gbef78a51.el8.x86_64 6/25 2023-12-12T11:39:20.197 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : thrift-0.13.0-2.el8.x86_64 7/25 2023-12-12T11:39:20.234 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-12T11:39:20.237 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-12T11:39:20.452 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 8/25 2023-12-12T11:39:21.163 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/25 2023-12-12T11:39:21.287 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-12T11:39:21.325 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librgw2-2:17.2.7-123.gbef78a51.el8.x86_64 10/25 2023-12-12T11:39:21.412 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librgw2-2:17.2.7-123.gbef78a51.el8.x86_64 10/25 2023-12-12T11:39:21.492 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-12-12T11:39:21.539 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ceph-argparse-2:17.2.7-123.gbef78a51.el8.x 11/25 2023-12-12T11:39:21.691 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-12T11:39:21.705 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cephfs-2:17.2.7-123.gbef78a51.el8.x86_64 12/25 2023-12-12T11:39:22.016 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rgw-2:17.2.7-123.gbef78a51.el8.x86_64 13/25 2023-12-12T11:39:22.119 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-12T11:39:22.226 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rbd-2:17.2.7-123.gbef78a51.el8.x86_64 14/25 2023-12-12T11:39:22.299 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : librados2-2:17.2.7-123.gbef78a51.el8.x86_64 3/25 2023-12-12T11:39:22.383 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libradosstriper1-2:17.2.7-123.gbef78a51.el8.x86_64 15/25 2023-12-12T11:39:22.416 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librados2-2:17.2.7-123.gbef78a51.el8.x86_64 3/25 2023-12-12T11:39:22.479 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libradosstriper1-2:17.2.7-123.gbef78a51.el8.x86_64 15/25 2023-12-12T11:39:22.604 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-rados-2:17.2.7-123.gbef78a51.el8.x86_64 4/25 2023-12-12T11:39:22.683 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-12-12T11:39:22.791 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libcephfs2-2:17.2.7-123.gbef78a51.el8.x86_64 5/25 2023-12-12T11:39:22.844 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-12-12T11:39:23.015 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-12-12T11:39:23.192 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ceph-common-2:17.2.7-123.gbef78a51.el8.x86 19/25 2023-12-12T11:39:23.247 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libcephfs2-2:17.2.7-123.gbef78a51.el8.x86_64 5/25 2023-12-12T11:39:23.424 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : librbd1-2:17.2.7-123.gbef78a51.el8.x86_64 6/25 2023-12-12T11:39:23.676 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librbd1-2:17.2.7-123.gbef78a51.el8.x86_64 6/25 2023-12-12T11:39:23.871 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : thrift-0.13.0-2.el8.x86_64 7/25 2023-12-12T11:39:24.110 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 8/25 2023-12-12T11:39:24.779 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/25 2023-12-12T11:39:24.916 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : librgw2-2:17.2.7-123.gbef78a51.el8.x86_64 10/25 2023-12-12T11:39:24.998 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librgw2-2:17.2.7-123.gbef78a51.el8.x86_64 10/25 2023-12-12T11:39:25.145 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-ceph-argparse-2:17.2.7-123.gbef78a51.el8.x 11/25 2023-12-12T11:39:25.328 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cephfs-2:17.2.7-123.gbef78a51.el8.x86_64 12/25 2023-12-12T11:39:25.512 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-rgw-2:17.2.7-123.gbef78a51.el8.x86_64 13/25 2023-12-12T11:39:25.697 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-rbd-2:17.2.7-123.gbef78a51.el8.x86_64 14/25 2023-12-12T11:39:25.841 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libradosstriper1-2:17.2.7-123.gbef78a51.el8.x86_64 15/25 2023-12-12T11:39:25.938 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libradosstriper1-2:17.2.7-123.gbef78a51.el8.x86_64 15/25 2023-12-12T11:39:26.363 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-common-2:17.2.7-123.gbef78a51.el8.x86_64 20/25 2023-12-12T11:39:26.555 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-12-12T11:39:26.642 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-common-2:17.2.7-123.gbef78a51.el8.x86_64 20/25 2023-12-12T11:39:26.700 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-12-12T11:39:26.884 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-12-12T11:39:27.108 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-ceph-common-2:17.2.7-123.gbef78a51.el8.x86 19/25 2023-12-12T11:39:27.338 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-common-2:17.2.7-123.gbef78a51.el8.x86_64 20/25 2023-12-12T11:39:27.588 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-base-2:17.2.7-123.gbef78a51.el8.x86_64 21/25 2023-12-12T11:39:27.805 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-base-2:17.2.7-123.gbef78a51.el8.x86_64 21/25 2023-12-12T11:39:27.991 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-selinux-2:17.2.7-123.gbef78a51.el8.x86_64 22/25 2023-12-12T11:39:30.074 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-common-2:17.2.7-123.gbef78a51.el8.x86_64 20/25 2023-12-12T11:39:30.316 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-common-2:17.2.7-123.gbef78a51.el8.x86_64 20/25 2023-12-12T11:39:30.974 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-common-2:17.2.7-123.gbef78a51.el8.x86_64 20/25 2023-12-12T11:39:31.244 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-base-2:17.2.7-123.gbef78a51.el8.x86_64 21/25 2023-12-12T11:39:31.521 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-base-2:17.2.7-123.gbef78a51.el8.x86_64 21/25 2023-12-12T11:39:31.723 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-selinux-2:17.2.7-123.gbef78a51.el8.x86_64 22/25 2023-12-12T11:39:49.039 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-selinux-2:17.2.7-123.gbef78a51.el8.x86_64 22/25 2023-12-12T11:39:49.039 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /sys 2023-12-12T11:39:49.039 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /proc 2023-12-12T11:39:49.039 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /dev 2023-12-12T11:39:49.039 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /run 2023-12-12T11:39:49.039 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /mnt 2023-12-12T11:39:49.040 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /var/tmp 2023-12-12T11:39:49.040 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /home 2023-12-12T11:39:49.040 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /tmp 2023-12-12T11:39:49.040 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /dev 2023-12-12T11:39:49.040 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:39:50.927 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-radosgw-2:17.2.7-123.gbef78a51.el8.x86_64 23/25 2023-12-12T11:39:51.039 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-123.gbef78a51.el8.x86_64 23/25 2023-12-12T11:39:51.039 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-12T11:39:51.260 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-12T11:39:51.261 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-12T11:39:51.964 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-selinux-2:17.2.7-123.gbef78a51.el8.x86_64 22/25 2023-12-12T11:39:51.965 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /sys 2023-12-12T11:39:51.965 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /proc 2023-12-12T11:39:51.965 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /dev 2023-12-12T11:39:51.965 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /run 2023-12-12T11:39:51.965 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /mnt 2023-12-12T11:39:51.965 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /var/tmp 2023-12-12T11:39:51.965 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /home 2023-12-12T11:39:51.965 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /tmp 2023-12-12T11:39:51.965 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /dev 2023-12-12T11:39:51.965 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:39:52.283 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-12T11:39:52.283 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-base-2:17.2.7-123.gbef78a51.el8.x86_64 1/25 2023-12-12T11:39:52.283 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-common-2:17.2.7-123.gbef78a51.el8.x86_64 2/25 2023-12-12T11:39:52.283 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-radosgw-2:17.2.7-123.gbef78a51.el8.x86_64 3/25 2023-12-12T11:39:52.283 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-selinux-2:17.2.7-123.gbef78a51.el8.x86_64 4/25 2023-12-12T11:39:52.283 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephfs2-2:17.2.7-123.gbef78a51.el8.x86_64 5/25 2023-12-12T11:39:52.283 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libradosstriper1-2:17.2.7-123.gbef78a51.el8.x86_64 6/25 2023-12-12T11:39:52.283 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librgw2-2:17.2.7-123.gbef78a51.el8.x86_64 7/25 2023-12-12T11:39:52.283 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ceph-argparse-2:17.2.7-123.gbef78a51.el8.x 8/25 2023-12-12T11:39:52.283 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ceph-common-2:17.2.7-123.gbef78a51.el8.x86 9/25 2023-12-12T11:39:52.283 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cephfs-2:17.2.7-123.gbef78a51.el8.x86_64 10/25 2023-12-12T11:39:52.283 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rados-2:17.2.7-123.gbef78a51.el8.x86_64 11/25 2023-12-12T11:39:52.284 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rbd-2:17.2.7-123.gbef78a51.el8.x86_64 12/25 2023-12-12T11:39:52.284 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rgw-2:17.2.7-123.gbef78a51.el8.x86_64 13/25 2023-12-12T11:39:52.284 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/25 2023-12-12T11:39:52.284 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-12-12T11:39:52.284 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-12-12T11:39:52.284 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 17/25 2023-12-12T11:39:52.284 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-12-12T11:39:52.284 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-12-12T11:39:52.284 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-12-12T11:39:52.284 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-12-12T11:39:52.284 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados2-2:17.2.7-123.gbef78a51.el8.x86_64 22/25 2023-12-12T11:39:52.284 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-12-12T11:39:52.284 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librbd1-2:17.2.7-123.gbef78a51.el8.x86_64 24/25 2023-12-12T11:39:53.352 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-12-12T11:39:53.353 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:39:53.353 INFO:teuthology.orchestra.run.smithi063.stdout:Upgraded: 2023-12-12T11:39:53.353 INFO:teuthology.orchestra.run.smithi063.stdout: librados2-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:39:53.353 INFO:teuthology.orchestra.run.smithi063.stdout: librbd1-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:39:53.353 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-12T11:39:53.353 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:39:53.353 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-common-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:39:53.353 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-radosgw-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:39:53.353 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-selinux-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:39:53.353 INFO:teuthology.orchestra.run.smithi063.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-12T11:39:53.353 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs2-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:39:53.353 INFO:teuthology.orchestra.run.smithi063.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-12T11:39:53.353 INFO:teuthology.orchestra.run.smithi063.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-12T11:39:53.353 INFO:teuthology.orchestra.run.smithi063.stdout: libradosstriper1-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:39:53.353 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka-1.6.1-1.el8.x86_64 2023-12-12T11:39:53.354 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:39:53.354 INFO:teuthology.orchestra.run.smithi063.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-12T11:39:53.354 INFO:teuthology.orchestra.run.smithi063.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-12T11:39:53.354 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-argparse-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:39:53.354 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:39:53.354 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cephfs-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:39:53.354 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-12T11:39:53.354 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rados-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:39:53.354 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rbd-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:39:53.354 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rgw-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:39:53.354 INFO:teuthology.orchestra.run.smithi063.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-12T11:39:53.354 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:39:53.354 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-12T11:39:53.731 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-test 2023-12-12T11:39:53.766 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-radosgw-2:17.2.7-123.gbef78a51.el8.x86_64 23/25 2023-12-12T11:39:53.886 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-123.gbef78a51.el8.x86_64 23/25 2023-12-12T11:39:53.886 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-12T11:39:54.125 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-12T11:39:54.126 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-12T11:39:54.851 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:00:51 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:39:55.093 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-12T11:39:55.093 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-base-2:17.2.7-123.gbef78a51.el8.x86_64 1/25 2023-12-12T11:39:55.093 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-common-2:17.2.7-123.gbef78a51.el8.x86_64 2/25 2023-12-12T11:39:55.093 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-radosgw-2:17.2.7-123.gbef78a51.el8.x86_64 3/25 2023-12-12T11:39:55.093 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-selinux-2:17.2.7-123.gbef78a51.el8.x86_64 4/25 2023-12-12T11:39:55.093 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libcephfs2-2:17.2.7-123.gbef78a51.el8.x86_64 5/25 2023-12-12T11:39:55.093 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libradosstriper1-2:17.2.7-123.gbef78a51.el8.x86_64 6/25 2023-12-12T11:39:55.093 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librgw2-2:17.2.7-123.gbef78a51.el8.x86_64 7/25 2023-12-12T11:39:55.093 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-ceph-argparse-2:17.2.7-123.gbef78a51.el8.x 8/25 2023-12-12T11:39:55.093 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-ceph-common-2:17.2.7-123.gbef78a51.el8.x86 9/25 2023-12-12T11:39:55.093 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cephfs-2:17.2.7-123.gbef78a51.el8.x86_64 10/25 2023-12-12T11:39:55.093 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-rados-2:17.2.7-123.gbef78a51.el8.x86_64 11/25 2023-12-12T11:39:55.094 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-rbd-2:17.2.7-123.gbef78a51.el8.x86_64 12/25 2023-12-12T11:39:55.094 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-rgw-2:17.2.7-123.gbef78a51.el8.x86_64 13/25 2023-12-12T11:39:55.094 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/25 2023-12-12T11:39:55.094 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-12-12T11:39:55.094 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-12-12T11:39:55.094 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 17/25 2023-12-12T11:39:55.094 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-12-12T11:39:55.094 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-12-12T11:39:55.094 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-12-12T11:39:55.094 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-12-12T11:39:55.094 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librados2-2:17.2.7-123.gbef78a51.el8.x86_64 22/25 2023-12-12T11:39:55.094 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-12-12T11:39:55.094 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librbd1-2:17.2.7-123.gbef78a51.el8.x86_64 24/25 2023-12-12T11:39:56.072 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-12-12T11:39:56.072 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:39:56.072 INFO:teuthology.orchestra.run.smithi093.stdout:Upgraded: 2023-12-12T11:39:56.072 INFO:teuthology.orchestra.run.smithi093.stdout: librados2-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:39:56.072 INFO:teuthology.orchestra.run.smithi093.stdout: librbd1-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:39:56.072 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-12T11:39:56.073 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-base-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:39:56.073 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-common-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:39:56.073 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-radosgw-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:39:56.073 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-selinux-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:39:56.073 INFO:teuthology.orchestra.run.smithi093.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-12T11:39:56.073 INFO:teuthology.orchestra.run.smithi093.stdout: libcephfs2-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:39:56.073 INFO:teuthology.orchestra.run.smithi093.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-12T11:39:56.073 INFO:teuthology.orchestra.run.smithi093.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-12T11:39:56.073 INFO:teuthology.orchestra.run.smithi093.stdout: libradosstriper1-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:39:56.073 INFO:teuthology.orchestra.run.smithi093.stdout: librdkafka-1.6.1-1.el8.x86_64 2023-12-12T11:39:56.073 INFO:teuthology.orchestra.run.smithi093.stdout: librgw2-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:39:56.073 INFO:teuthology.orchestra.run.smithi093.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-12T11:39:56.073 INFO:teuthology.orchestra.run.smithi093.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-12T11:39:56.073 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-argparse-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:39:56.074 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-common-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:39:56.074 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cephfs-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:39:56.074 INFO:teuthology.orchestra.run.smithi093.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-12T11:39:56.074 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rados-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:39:56.074 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rbd-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:39:56.074 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rgw-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:39:56.074 INFO:teuthology.orchestra.run.smithi093.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-12T11:39:56.074 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:39:56.074 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-12T11:39:56.445 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install ceph-test 2023-12-12T11:39:56.747 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-12T11:39:56.748 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:39:56.748 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2023-12-12T11:39:56.748 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:39:56.749 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-12T11:39:56.749 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-test x86_64 2:17.2.7-123.gbef78a51.el8 ceph 52 M 2023-12-12T11:39:56.749 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2023-12-12T11:39:56.749 INFO:teuthology.orchestra.run.smithi063.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2023-12-12T11:39:56.749 INFO:teuthology.orchestra.run.smithi063.stdout: libcephsqlite x86_64 2:17.2.7-123.gbef78a51.el8 ceph 174 k 2023-12-12T11:39:56.749 INFO:teuthology.orchestra.run.smithi063.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-12-12T11:39:56.749 INFO:teuthology.orchestra.run.smithi063.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-12-12T11:39:56.749 INFO:teuthology.orchestra.run.smithi063.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-12-12T11:39:56.749 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:39:56.749 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-12T11:39:56.749 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:39:56.749 INFO:teuthology.orchestra.run.smithi063.stdout:Install 6 Packages 2023-12-12T11:39:56.749 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:39:56.750 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 53 M 2023-12-12T11:39:56.750 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 234 M 2023-12-12T11:39:56.750 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-12T11:39:56.929 INFO:teuthology.orchestra.run.smithi063.stdout:(1/6): jq-1.6-8.el8.x86_64.rpm 1.4 MB/s | 203 kB 00:00 2023-12-12T11:39:56.979 INFO:teuthology.orchestra.run.smithi063.stdout:(2/6): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-12-12T11:39:57.038 INFO:teuthology.orchestra.run.smithi063.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-12-12T11:39:57.079 INFO:teuthology.orchestra.run.smithi063.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.7 MB/s | 71 kB 00:00 2023-12-12T11:39:57.138 INFO:teuthology.orchestra.run.smithi063.stdout:(5/6): libcephsqlite-17.2.7-123.gbef78a51.el8.x 500 kB/s | 174 kB 00:00 2023-12-12T11:39:57.510 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:00:54 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:39:59.258 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-12T11:39:59.259 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:39:59.259 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repository Size 2023-12-12T11:39:59.259 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:39:59.259 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-12T11:39:59.259 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-test x86_64 2:17.2.7-123.gbef78a51.el8 ceph 52 M 2023-12-12T11:39:59.259 INFO:teuthology.orchestra.run.smithi093.stdout:Installing dependencies: 2023-12-12T11:39:59.259 INFO:teuthology.orchestra.run.smithi093.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2023-12-12T11:39:59.259 INFO:teuthology.orchestra.run.smithi093.stdout: libcephsqlite x86_64 2:17.2.7-123.gbef78a51.el8 ceph 174 k 2023-12-12T11:39:59.260 INFO:teuthology.orchestra.run.smithi093.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-12-12T11:39:59.260 INFO:teuthology.orchestra.run.smithi093.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-12-12T11:39:59.260 INFO:teuthology.orchestra.run.smithi093.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-12-12T11:39:59.260 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:39:59.260 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-12T11:39:59.260 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:39:59.260 INFO:teuthology.orchestra.run.smithi093.stdout:Install 6 Packages 2023-12-12T11:39:59.260 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:39:59.260 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 53 M 2023-12-12T11:39:59.261 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 234 M 2023-12-12T11:39:59.261 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-12T11:39:59.288 INFO:teuthology.orchestra.run.smithi063.stdout:(6/6): ceph-test-17.2.7-123.gbef78a51.el8.x86_6 21 MB/s | 52 MB 00:02 2023-12-12T11:39:59.290 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:39:59.291 INFO:teuthology.orchestra.run.smithi063.stdout:Total 21 MB/s | 53 MB 00:02 2023-12-12T11:39:59.389 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-12T11:39:59.416 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-12T11:39:59.416 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-12T11:39:59.440 INFO:teuthology.orchestra.run.smithi093.stdout:(1/6): jq-1.6-8.el8.x86_64.rpm 1.4 MB/s | 203 kB 00:00 2023-12-12T11:39:59.507 INFO:teuthology.orchestra.run.smithi093.stdout:(2/6): oniguruma-6.8.2-2.el8.x86_64.rpm 2.8 MB/s | 187 kB 00:00 2023-12-12T11:39:59.574 INFO:teuthology.orchestra.run.smithi093.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 4.7 MB/s | 323 kB 00:00 2023-12-12T11:39:59.616 INFO:teuthology.orchestra.run.smithi093.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.7 MB/s | 71 kB 00:00 2023-12-12T11:39:59.649 INFO:teuthology.orchestra.run.smithi093.stdout:(5/6): libcephsqlite-17.2.7-123.gbef78a51.el8.x 499 kB/s | 174 kB 00:00 2023-12-12T11:39:59.746 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-12T11:39:59.750 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-12T11:40:00.265 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-12T11:40:00.456 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-12-12T11:40:00.618 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-12-12T11:40:00.770 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-12T11:40:00.874 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-12T11:40:01.071 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2023-12-12T11:40:01.228 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephsqlite-2:17.2.7-123.gbef78a51.el8.x86_64 5/6 2023-12-12T11:40:02.033 INFO:teuthology.orchestra.run.smithi093.stdout:(6/6): ceph-test-17.2.7-123.gbef78a51.el8.x86_6 19 MB/s | 52 MB 00:02 2023-12-12T11:40:02.035 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:40:02.035 INFO:teuthology.orchestra.run.smithi093.stdout:Total 19 MB/s | 53 MB 00:02 2023-12-12T11:40:02.132 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-12T11:40:02.156 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-12T11:40:02.156 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-12T11:40:02.467 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-12T11:40:02.470 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-12T11:40:02.970 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-12T11:40:03.202 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-12-12T11:40:03.381 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-12-12T11:40:03.510 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-12T11:40:03.615 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-12T11:40:03.818 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2023-12-12T11:40:03.960 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libcephsqlite-2:17.2.7-123.gbef78a51.el8.x86_64 5/6 2023-12-12T11:40:06.942 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcephsqlite-2:17.2.7-123.gbef78a51.el8.x86_64 5/6 2023-12-12T11:40:07.277 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-test-2:17.2.7-123.gbef78a51.el8.x86_64 6/6 2023-12-12T11:40:07.656 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-test-2:17.2.7-123.gbef78a51.el8.x86_64 6/6 2023-12-12T11:40:07.656 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-test-2:17.2.7-123.gbef78a51.el8.x86_64 1/6 2023-12-12T11:40:07.657 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephsqlite-2:17.2.7-123.gbef78a51.el8.x86_64 2/6 2023-12-12T11:40:07.657 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2023-12-12T11:40:07.657 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-12-12T11:40:07.657 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-12-12T11:40:08.473 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-12-12T11:40:08.473 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:40:08.473 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-12T11:40:08.473 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-test-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:40:08.473 INFO:teuthology.orchestra.run.smithi063.stdout: jq-1.6-8.el8.x86_64 2023-12-12T11:40:08.473 INFO:teuthology.orchestra.run.smithi063.stdout: libcephsqlite-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:40:08.473 INFO:teuthology.orchestra.run.smithi063.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-12T11:40:08.473 INFO:teuthology.orchestra.run.smithi063.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-12T11:40:08.473 INFO:teuthology.orchestra.run.smithi063.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-12T11:40:08.473 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:40:08.473 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-12T11:40:08.667 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph 2023-12-12T11:40:09.426 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libcephsqlite-2:17.2.7-123.gbef78a51.el8.x86_64 5/6 2023-12-12T11:40:09.633 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-test-2:17.2.7-123.gbef78a51.el8.x86_64 6/6 2023-12-12T11:40:09.830 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:06 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:40:09.999 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-test-2:17.2.7-123.gbef78a51.el8.x86_64 6/6 2023-12-12T11:40:09.999 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-test-2:17.2.7-123.gbef78a51.el8.x86_64 1/6 2023-12-12T11:40:09.999 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libcephsqlite-2:17.2.7-123.gbef78a51.el8.x86_64 2/6 2023-12-12T11:40:09.999 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2023-12-12T11:40:09.999 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-12-12T11:40:09.999 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-12-12T11:40:10.787 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-12-12T11:40:10.787 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:40:10.787 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-12T11:40:10.787 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-test-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:40:10.787 INFO:teuthology.orchestra.run.smithi093.stdout: jq-1.6-8.el8.x86_64 2023-12-12T11:40:10.787 INFO:teuthology.orchestra.run.smithi093.stdout: libcephsqlite-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:40:10.787 INFO:teuthology.orchestra.run.smithi093.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-12T11:40:10.787 INFO:teuthology.orchestra.run.smithi093.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-12T11:40:10.787 INFO:teuthology.orchestra.run.smithi093.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-12T11:40:10.787 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:40:10.788 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-12T11:40:10.969 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install ceph 2023-12-12T11:40:11.738 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-12T11:40:11.741 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:40:11.742 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2023-12-12T11:40:11.742 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:40:11.742 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-12T11:40:11.742 INFO:teuthology.orchestra.run.smithi063.stdout: ceph x86_64 2:17.2.7-123.gbef78a51.el8 ceph 6.4 k 2023-12-12T11:40:11.742 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2023-12-12T11:40:11.742 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mds x86_64 2:17.2.7-123.gbef78a51.el8 ceph 2.3 M 2023-12-12T11:40:11.742 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr x86_64 2:17.2.7-123.gbef78a51.el8 ceph 1.6 M 2023-12-12T11:40:11.742 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core noarch 2:17.2.7-123.gbef78a51.el8 ceph-noarch 238 k 2023-12-12T11:40:11.742 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon x86_64 2:17.2.7-123.gbef78a51.el8 ceph 3.9 M 2023-12-12T11:40:11.742 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-osd x86_64 2:17.2.7-123.gbef78a51.el8 ceph 17 M 2023-12-12T11:40:11.742 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-12T11:40:11.742 INFO:teuthology.orchestra.run.smithi063.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-12T11:40:11.743 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-12-12T11:40:11.743 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-12T11:40:11.743 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-12T11:40:11.743 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-12-12T11:40:11.743 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-12T11:40:11.743 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-12T11:40:11.743 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-12T11:40:11.743 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-12-12T11:40:11.743 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-12-12T11:40:11.743 INFO:teuthology.orchestra.run.smithi063.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-12T11:40:11.743 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-12T11:40:11.743 INFO:teuthology.orchestra.run.smithi063.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-12T11:40:11.743 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-12-12T11:40:11.743 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-12-12T11:40:11.743 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-12-12T11:40:11.744 INFO:teuthology.orchestra.run.smithi063.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-12T11:40:11.744 INFO:teuthology.orchestra.run.smithi063.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-12T11:40:11.744 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-12T11:40:11.744 INFO:teuthology.orchestra.run.smithi063.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-12T11:40:11.744 INFO:teuthology.orchestra.run.smithi063.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-12T11:40:11.744 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-12T11:40:11.744 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-12T11:40:11.744 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-12-12T11:40:11.744 INFO:teuthology.orchestra.run.smithi063.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-12T11:40:11.744 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:40:11.744 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-12T11:40:11.744 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:40:11.744 INFO:teuthology.orchestra.run.smithi063.stdout:Install 32 Packages 2023-12-12T11:40:11.744 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:40:11.745 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 28 M 2023-12-12T11:40:11.745 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 110 M 2023-12-12T11:40:11.745 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-12T11:40:12.092 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:09 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:40:12.163 INFO:teuthology.orchestra.run.smithi063.stdout:(1/32): ceph-17.2.7-123.gbef78a51.el8.x86_64.rp 42 kB/s | 6.4 kB 00:00 2023-12-12T11:40:12.414 INFO:teuthology.orchestra.run.smithi063.stdout:(2/32): ceph-mds-17.2.7-123.gbef78a51.el8.x86_6 5.7 MB/s | 2.3 MB 00:00 2023-12-12T11:40:12.781 INFO:teuthology.orchestra.run.smithi063.stdout:(3/32): ceph-mon-17.2.7-123.gbef78a51.el8.x86_6 6.4 MB/s | 3.9 MB 00:00 2023-12-12T11:40:12.823 INFO:teuthology.orchestra.run.smithi063.stdout:(4/32): ceph-mgr-17.2.7-123.gbef78a51.el8.x86_6 1.9 MB/s | 1.6 MB 00:00 2023-12-12T11:40:12.865 INFO:teuthology.orchestra.run.smithi063.stdout:(5/32): ceph-mgr-modules-core-17.2.7-123.gbef78 2.8 MB/s | 238 kB 00:00 2023-12-12T11:40:12.941 INFO:teuthology.orchestra.run.smithi063.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 518 kB/s | 39 kB 00:00 2023-12-12T11:40:12.958 INFO:teuthology.orchestra.run.smithi063.stdout:(7/32): python3-mako-1.0.6-14.el8.noarch.rpm 1.1 MB/s | 157 kB 00:00 2023-12-12T11:40:12.991 INFO:teuthology.orchestra.run.smithi063.stdout:(8/32): python3-pytz-2017.2-11.el8.noarch.rpm 1.7 MB/s | 57 kB 00:00 2023-12-12T11:40:13.018 INFO:teuthology.orchestra.run.smithi063.stdout:(9/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 1.3 MB/s | 103 kB 00:00 2023-12-12T11:40:13.067 INFO:teuthology.orchestra.run.smithi063.stdout:(10/32): python3-werkzeug-0.12.2-4.el8.noarch.r 5.9 MB/s | 457 kB 00:00 2023-12-12T11:40:13.324 INFO:teuthology.orchestra.run.smithi063.stdout:(11/32): ceph-osd-17.2.7-123.gbef78a51.el8.x86_ 18 MB/s | 17 MB 00:00 2023-12-12T11:40:13.609 INFO:teuthology.orchestra.run.smithi063.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 420 kB/s | 249 kB 00:00 2023-12-12T11:40:13.701 INFO:teuthology.orchestra.run.smithi063.stdout:(13/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 476 kB/s | 44 kB 00:00 2023-12-12T11:40:13.751 INFO:teuthology.orchestra.run.smithi063.stdout:(14/32): python3-pycparser-2.14-14.el8.noarch.r 256 kB/s | 109 kB 00:00 2023-12-12T11:40:13.785 INFO:teuthology.orchestra.run.smithi063.stdout:(15/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 2.2 MB/s | 185 kB 00:00 2023-12-12T11:40:13.836 INFO:teuthology.orchestra.run.smithi063.stdout:(16/32): python3-cryptography-3.2.1-6.el8.x86_6 835 kB/s | 641 kB 00:00 2023-12-12T11:40:13.851 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-12T11:40:13.855 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:40:13.855 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repository Size 2023-12-12T11:40:13.855 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:40:13.855 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-12T11:40:13.855 INFO:teuthology.orchestra.run.smithi093.stdout: ceph x86_64 2:17.2.7-123.gbef78a51.el8 ceph 6.4 k 2023-12-12T11:40:13.855 INFO:teuthology.orchestra.run.smithi093.stdout:Installing dependencies: 2023-12-12T11:40:13.855 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mds x86_64 2:17.2.7-123.gbef78a51.el8 ceph 2.3 M 2023-12-12T11:40:13.855 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr x86_64 2:17.2.7-123.gbef78a51.el8 ceph 1.6 M 2023-12-12T11:40:13.855 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-modules-core noarch 2:17.2.7-123.gbef78a51.el8 ceph-noarch 238 k 2023-12-12T11:40:13.855 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mon x86_64 2:17.2.7-123.gbef78a51.el8 ceph 3.9 M 2023-12-12T11:40:13.855 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-osd x86_64 2:17.2.7-123.gbef78a51.el8 ceph 17 M 2023-12-12T11:40:13.855 INFO:teuthology.orchestra.run.smithi093.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-12T11:40:13.856 INFO:teuthology.orchestra.run.smithi093.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-12T11:40:13.856 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-12-12T11:40:13.856 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-12T11:40:13.856 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-12T11:40:13.856 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-12-12T11:40:13.856 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-12T11:40:13.856 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-12T11:40:13.856 INFO:teuthology.orchestra.run.smithi093.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-12T11:40:13.856 INFO:teuthology.orchestra.run.smithi093.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-12-12T11:40:13.856 INFO:teuthology.orchestra.run.smithi093.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-12-12T11:40:13.856 INFO:teuthology.orchestra.run.smithi093.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-12T11:40:13.856 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-12T11:40:13.856 INFO:teuthology.orchestra.run.smithi093.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-12T11:40:13.856 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-12-12T11:40:13.857 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-12-12T11:40:13.857 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-12-12T11:40:13.857 INFO:teuthology.orchestra.run.smithi093.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-12T11:40:13.857 INFO:teuthology.orchestra.run.smithi093.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-12T11:40:13.857 INFO:teuthology.orchestra.run.smithi093.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-12T11:40:13.857 INFO:teuthology.orchestra.run.smithi093.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-12T11:40:13.857 INFO:teuthology.orchestra.run.smithi093.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-12T11:40:13.857 INFO:teuthology.orchestra.run.smithi093.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-12T11:40:13.857 INFO:teuthology.orchestra.run.smithi093.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-12T11:40:13.857 INFO:teuthology.orchestra.run.smithi093.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-12-12T11:40:13.857 INFO:teuthology.orchestra.run.smithi093.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-12T11:40:13.857 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:40:13.857 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-12T11:40:13.857 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:40:13.857 INFO:teuthology.orchestra.run.smithi093.stdout:Install 32 Packages 2023-12-12T11:40:13.858 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:40:13.858 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 28 M 2023-12-12T11:40:13.858 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 110 M 2023-12-12T11:40:13.858 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-12T11:40:13.861 INFO:teuthology.orchestra.run.smithi063.stdout:(17/32): python3-cherrypy-18.4.0-1.el8.noarch.r 5.0 MB/s | 384 kB 00:00 2023-12-12T11:40:13.903 INFO:teuthology.orchestra.run.smithi063.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 166 kB/s | 11 kB 00:00 2023-12-12T11:40:13.927 INFO:teuthology.orchestra.run.smithi063.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 265 kB/s | 18 kB 00:00 2023-12-12T11:40:13.953 INFO:teuthology.orchestra.run.smithi063.stdout:(20/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 858 kB/s | 173 kB 00:00 2023-12-12T11:40:13.978 INFO:teuthology.orchestra.run.smithi063.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 975 kB/s | 49 kB 00:00 2023-12-12T11:40:14.003 INFO:teuthology.orchestra.run.smithi063.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 782 kB/s | 59 kB 00:00 2023-12-12T11:40:14.029 INFO:teuthology.orchestra.run.smithi063.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 310 kB/s | 16 kB 00:00 2023-12-12T11:40:14.054 INFO:teuthology.orchestra.run.smithi063.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 373 kB/s | 19 kB 00:00 2023-12-12T11:40:14.079 INFO:teuthology.orchestra.run.smithi063.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 480 kB/s | 24 kB 00:00 2023-12-12T11:40:14.113 INFO:teuthology.orchestra.run.smithi063.stdout:(26/32): python3-tempora-1.14.1-5.el8.noarch.rp 501 kB/s | 29 kB 00:00 2023-12-12T11:40:14.138 INFO:teuthology.orchestra.run.smithi063.stdout:(27/32): python3-trustme-0.6.0-4.el8.noarch.rpm 472 kB/s | 27 kB 00:00 2023-12-12T11:40:14.163 INFO:teuthology.orchestra.run.smithi063.stdout:(28/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.3 MB/s | 283 kB 00:00 2023-12-12T11:40:14.180 INFO:teuthology.orchestra.run.smithi063.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 3.7 MB/s | 255 kB 00:00 2023-12-12T11:40:14.205 INFO:teuthology.orchestra.run.smithi063.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 2.0 MB/s | 85 kB 00:00 2023-12-12T11:40:14.231 INFO:teuthology.orchestra.run.smithi063.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 459 kB/s | 23 kB 00:00 2023-12-12T11:40:14.256 INFO:teuthology.orchestra.run.smithi063.stdout:(32/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.1 MB/s | 251 kB 00:00 2023-12-12T11:40:14.257 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:40:14.257 INFO:teuthology.orchestra.run.smithi063.stdout:Total 11 MB/s | 28 MB 00:02 2023-12-12T11:40:14.447 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-12T11:40:14.491 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-12T11:40:14.491 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-12T11:40:14.566 INFO:teuthology.orchestra.run.smithi093.stdout:(1/32): ceph-17.2.7-123.gbef78a51.el8.x86_64.rp 52 kB/s | 6.4 kB 00:00 2023-12-12T11:40:14.829 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-12T11:40:14.833 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-12T11:40:15.475 INFO:teuthology.orchestra.run.smithi093.stdout:(2/32): ceph-mon-17.2.7-123.gbef78a51.el8.x86_6 4.3 MB/s | 3.9 MB 00:00 2023-12-12T11:40:15.659 INFO:teuthology.orchestra.run.smithi093.stdout:(3/32): ceph-mgr-17.2.7-123.gbef78a51.el8.x86_6 1.3 MB/s | 1.6 MB 00:01 2023-12-12T11:40:15.709 INFO:teuthology.orchestra.run.smithi093.stdout:(4/32): ceph-mds-17.2.7-123.gbef78a51.el8.x86_6 1.8 MB/s | 2.3 MB 00:01 2023-12-12T11:40:15.776 INFO:teuthology.orchestra.run.smithi093.stdout:(5/32): ceph-mgr-modules-core-17.2.7-123.gbef78 2.0 MB/s | 238 kB 00:00 2023-12-12T11:40:15.835 INFO:teuthology.orchestra.run.smithi093.stdout:(6/32): python3-mako-1.0.6-14.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2023-12-12T11:40:15.860 INFO:teuthology.orchestra.run.smithi093.stdout:(7/32): python3-markupsafe-0.23-19.el8.x86_64.r 466 kB/s | 39 kB 00:00 2023-12-12T11:40:15.885 INFO:teuthology.orchestra.run.smithi093.stdout:(8/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 2.0 MB/s | 103 kB 00:00 2023-12-12T11:40:15.935 INFO:teuthology.orchestra.run.smithi093.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 760 kB/s | 57 kB 00:00 2023-12-12T11:40:15.969 INFO:teuthology.orchestra.run.smithi093.stdout:(10/32): python3-werkzeug-0.12.2-4.el8.noarch.r 5.4 MB/s | 457 kB 00:00 2023-12-12T11:40:16.096 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-12T11:40:16.338 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-12-12T11:40:16.411 INFO:teuthology.orchestra.run.smithi093.stdout:(11/32): ceph-osd-17.2.7-123.gbef78a51.el8.x86_ 18 MB/s | 17 MB 00:00 2023-12-12T11:40:16.562 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-12-12T11:40:16.594 INFO:teuthology.orchestra.run.smithi093.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 378 kB/s | 249 kB 00:00 2023-12-12T11:40:16.686 INFO:teuthology.orchestra.run.smithi093.stdout:(13/32): python3-cryptography-3.2.1-6.el8.x86_6 894 kB/s | 641 kB 00:00 2023-12-12T11:40:16.794 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-12-12T11:40:16.837 INFO:teuthology.orchestra.run.smithi093.stdout:(14/32): python3-pycparser-2.14-14.el8.noarch.r 256 kB/s | 109 kB 00:00 2023-12-12T11:40:16.853 INFO:teuthology.orchestra.run.smithi093.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 169 kB/s | 44 kB 00:00 2023-12-12T11:40:17.012 INFO:teuthology.orchestra.run.smithi093.stdout:(16/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 987 kB/s | 173 kB 00:00 2023-12-12T11:40:17.026 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-12-12T11:40:17.029 INFO:teuthology.orchestra.run.smithi093.stdout:(17/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 541 kB/s | 185 kB 00:00 2023-12-12T11:40:17.080 INFO:teuthology.orchestra.run.smithi093.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 167 kB/s | 11 kB 00:00 2023-12-12T11:40:17.096 INFO:teuthology.orchestra.run.smithi093.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 263 kB/s | 18 kB 00:00 2023-12-12T11:40:17.155 INFO:teuthology.orchestra.run.smithi093.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 649 kB/s | 49 kB 00:00 2023-12-12T11:40:17.180 INFO:teuthology.orchestra.run.smithi093.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 705 kB/s | 59 kB 00:00 2023-12-12T11:40:17.207 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-12-12T11:40:17.247 INFO:teuthology.orchestra.run.smithi093.stdout:(22/32): python3-portend-2.6-1.el8.noarch.rpm 234 kB/s | 16 kB 00:00 2023-12-12T11:40:17.272 INFO:teuthology.orchestra.run.smithi093.stdout:(23/32): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2023-12-12T11:40:17.298 INFO:teuthology.orchestra.run.smithi093.stdout:(24/32): python3-cherrypy-18.4.0-1.el8.noarch.r 867 kB/s | 384 kB 00:00 2023-12-12T11:40:17.323 INFO:teuthology.orchestra.run.smithi093.stdout:(25/32): python3-simplegeneric-0.8.1-17.el8.noa 249 kB/s | 19 kB 00:00 2023-12-12T11:40:17.348 INFO:teuthology.orchestra.run.smithi093.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 317 kB/s | 24 kB 00:00 2023-12-12T11:40:17.374 INFO:teuthology.orchestra.run.smithi093.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 386 kB/s | 29 kB 00:00 2023-12-12T11:40:17.383 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-12-12T11:40:17.399 INFO:teuthology.orchestra.run.smithi093.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 364 kB/s | 27 kB 00:00 2023-12-12T11:40:17.432 INFO:teuthology.orchestra.run.smithi093.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 3.0 MB/s | 255 kB 00:00 2023-12-12T11:40:17.474 INFO:teuthology.orchestra.run.smithi093.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.4 MB/s | 251 kB 00:00 2023-12-12T11:40:17.499 INFO:teuthology.orchestra.run.smithi093.stdout:(31/32): python3-webtest-2.0.33-1.el8.noarch.rp 851 kB/s | 85 kB 00:00 2023-12-12T11:40:17.525 INFO:teuthology.orchestra.run.smithi093.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 250 kB/s | 23 kB 00:00 2023-12-12T11:40:17.529 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:40:17.529 INFO:teuthology.orchestra.run.smithi093.stdout:Total 7.7 MB/s | 28 MB 00:03 2023-12-12T11:40:17.556 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-12-12T11:40:17.692 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-12-12T11:40:17.717 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-12T11:40:17.759 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-12T11:40:17.759 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-12T11:40:17.912 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-12-12T11:40:18.092 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-12T11:40:18.095 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-12T11:40:18.188 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-12-12T11:40:18.418 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-12-12T11:40:18.643 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-12-12T11:40:19.083 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-12-12T11:40:19.196 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-12T11:40:19.334 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-12-12T11:40:19.441 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-12-12T11:40:19.478 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-12-12T11:40:19.684 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-12-12T11:40:19.706 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-12-12T11:40:19.904 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-12T11:40:19.921 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-12-12T11:40:20.157 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-12-12T11:40:20.215 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-12-12T11:40:20.367 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-12-12T11:40:20.427 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-12-12T11:40:20.554 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-12-12T11:40:20.590 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-12-12T11:40:20.736 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-12-12T11:40:20.774 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-12-12T11:40:20.906 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-12-12T11:40:21.054 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-12-12T11:40:21.111 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-12-12T11:40:21.267 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-12-12T11:40:21.346 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-12-12T11:40:21.536 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-12-12T11:40:21.568 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-12-12T11:40:21.785 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-12-12T11:40:21.876 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-12-12T11:40:22.217 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-12-12T11:40:22.218 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-12-12T11:40:22.464 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-12-12T11:40:22.642 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-12-12T11:40:22.891 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-12-12T11:40:23.094 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-12T11:40:23.117 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-123.gbef78a51.el8.n 27/32 2023-12-12T11:40:23.314 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-2:17.2.7-123.gbef78a51.el8.x86_64 28/32 2023-12-12T11:40:23.381 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-12-12T11:40:23.557 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-12-12T11:40:23.712 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-12-12T11:40:23.880 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-12-12T11:40:24.160 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-12-12T11:40:24.406 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-12-12T11:40:24.692 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-12-12T11:40:25.029 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-2:17.2.7-123.gbef78a51.el8.x86_64 28/32 2023-12-12T11:40:25.032 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-12-12T11:40:25.264 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-osd-2:17.2.7-123.gbef78a51.el8.x86_64 29/32 2023-12-12T11:40:25.407 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-12-12T11:40:25.760 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-osd-2:17.2.7-123.gbef78a51.el8.x86_64 29/32 2023-12-12T11:40:26.009 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mon-2:17.2.7-123.gbef78a51.el8.x86_64 30/32 2023-12-12T11:40:26.245 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-123.gbef78a51.el8.n 27/32 2023-12-12T11:40:26.280 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mon-2:17.2.7-123.gbef78a51.el8.x86_64 30/32 2023-12-12T11:40:26.444 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-2:17.2.7-123.gbef78a51.el8.x86_64 28/32 2023-12-12T11:40:26.459 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mds-2:17.2.7-123.gbef78a51.el8.x86_64 31/32 2023-12-12T11:40:26.504 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mds-2:17.2.7-123.gbef78a51.el8.x86_64 31/32 2023-12-12T11:40:26.626 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-2:17.2.7-123.gbef78a51.el8.x86_64 32/32 2023-12-12T11:40:26.731 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-2:17.2.7-123.gbef78a51.el8.x86_64 32/32 2023-12-12T11:40:26.731 INFO:teuthology.orchestra.run.smithi063.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-12T11:40:26.731 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:40:27.286 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-2:17.2.7-123.gbef78a51.el8.x86_64 1/32 2023-12-12T11:40:27.286 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mds-2:17.2.7-123.gbef78a51.el8.x86_64 2/32 2023-12-12T11:40:27.286 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-2:17.2.7-123.gbef78a51.el8.x86_64 3/32 2023-12-12T11:40:27.286 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mon-2:17.2.7-123.gbef78a51.el8.x86_64 4/32 2023-12-12T11:40:27.286 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-osd-2:17.2.7-123.gbef78a51.el8.x86_64 5/32 2023-12-12T11:40:27.286 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-123.gbef78a51.el8.n 6/32 2023-12-12T11:40:27.286 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-12-12T11:40:27.286 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-12-12T11:40:27.286 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-12-12T11:40:27.287 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-12-12T11:40:27.287 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-12-12T11:40:27.287 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-12-12T11:40:27.287 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-12-12T11:40:27.287 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-12-12T11:40:27.287 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-12-12T11:40:27.287 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-12-12T11:40:27.287 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-12T11:40:27.287 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-12-12T11:40:27.287 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-12-12T11:40:27.287 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-12-12T11:40:27.287 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-12-12T11:40:27.287 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-12-12T11:40:27.287 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-12-12T11:40:27.288 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-12-12T11:40:27.288 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-12-12T11:40:27.288 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-12-12T11:40:27.288 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-12-12T11:40:27.289 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-12-12T11:40:27.289 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-12-12T11:40:27.289 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-12-12T11:40:27.289 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-12-12T11:40:28.062 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-2:17.2.7-123.gbef78a51.el8.x86_64 28/32 2023-12-12T11:40:28.269 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-osd-2:17.2.7-123.gbef78a51.el8.x86_64 29/32 2023-12-12T11:40:28.420 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-12-12T11:40:28.420 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:40:28.420 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-12T11:40:28.420 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:40:28.420 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mds-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:40:28.420 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:40:28.420 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core-2:17.2.7-123.gbef78a51.el8.noarch 2023-12-12T11:40:28.420 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:40:28.420 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-osd-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:40:28.420 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-12T11:40:28.420 INFO:teuthology.orchestra.run.smithi063.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-12T11:40:28.421 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-12T11:40:28.421 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-12T11:40:28.421 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-12T11:40:28.421 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-12T11:40:28.421 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-12T11:40:28.421 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-12T11:40:28.421 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-12T11:40:28.421 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-12T11:40:28.421 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-12T11:40:28.421 INFO:teuthology.orchestra.run.smithi063.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-12T11:40:28.421 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-12T11:40:28.421 INFO:teuthology.orchestra.run.smithi063.stdout: python3-portend-2.6-1.el8.noarch 2023-12-12T11:40:28.421 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-12T11:40:28.421 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-12T11:40:28.421 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-12T11:40:28.421 INFO:teuthology.orchestra.run.smithi063.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-12T11:40:28.422 INFO:teuthology.orchestra.run.smithi063.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-12T11:40:28.422 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-12T11:40:28.422 INFO:teuthology.orchestra.run.smithi063.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-12T11:40:28.422 INFO:teuthology.orchestra.run.smithi063.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-12T11:40:28.422 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-12T11:40:28.422 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-12T11:40:28.422 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-12T11:40:28.422 INFO:teuthology.orchestra.run.smithi063.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-12T11:40:28.422 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:40:28.422 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-12T11:40:28.711 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-base 2023-12-12T11:40:28.736 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-osd-2:17.2.7-123.gbef78a51.el8.x86_64 29/32 2023-12-12T11:40:28.982 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mon-2:17.2.7-123.gbef78a51.el8.x86_64 30/32 2023-12-12T11:40:29.240 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mon-2:17.2.7-123.gbef78a51.el8.x86_64 30/32 2023-12-12T11:40:29.407 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mds-2:17.2.7-123.gbef78a51.el8.x86_64 31/32 2023-12-12T11:40:29.450 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mds-2:17.2.7-123.gbef78a51.el8.x86_64 31/32 2023-12-12T11:40:29.573 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-2:17.2.7-123.gbef78a51.el8.x86_64 32/32 2023-12-12T11:40:29.689 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-2:17.2.7-123.gbef78a51.el8.x86_64 32/32 2023-12-12T11:40:29.689 INFO:teuthology.orchestra.run.smithi093.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-12T11:40:29.689 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:40:29.844 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:26 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:40:30.234 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-2:17.2.7-123.gbef78a51.el8.x86_64 1/32 2023-12-12T11:40:30.234 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mds-2:17.2.7-123.gbef78a51.el8.x86_64 2/32 2023-12-12T11:40:30.235 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-2:17.2.7-123.gbef78a51.el8.x86_64 3/32 2023-12-12T11:40:30.235 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mon-2:17.2.7-123.gbef78a51.el8.x86_64 4/32 2023-12-12T11:40:30.235 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-osd-2:17.2.7-123.gbef78a51.el8.x86_64 5/32 2023-12-12T11:40:30.235 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-123.gbef78a51.el8.n 6/32 2023-12-12T11:40:30.235 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-12-12T11:40:30.235 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-12-12T11:40:30.235 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-12-12T11:40:30.235 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-12-12T11:40:30.235 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-12-12T11:40:30.235 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-12-12T11:40:30.235 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-12-12T11:40:30.235 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-12-12T11:40:30.235 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-12-12T11:40:30.235 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-12-12T11:40:30.235 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-12T11:40:30.236 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-12-12T11:40:30.236 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-12-12T11:40:30.236 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-12-12T11:40:30.236 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-12-12T11:40:30.236 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-12-12T11:40:30.236 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-12-12T11:40:30.236 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-12-12T11:40:30.236 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-12-12T11:40:30.236 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-12-12T11:40:30.236 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-12-12T11:40:30.236 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-12-12T11:40:30.236 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-12-12T11:40:30.236 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-12-12T11:40:30.236 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-12-12T11:40:31.450 INFO:teuthology.orchestra.run.smithi063.stdout:Package ceph-base-2:17.2.7-123.gbef78a51.el8.x86_64 is already installed. 2023-12-12T11:40:31.475 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-12-12T11:40:31.553 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:40:31.553 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-12T11:40:31.553 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:40:31.553 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mds-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:40:31.553 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:40:31.554 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-modules-core-2:17.2.7-123.gbef78a51.el8.noarch 2023-12-12T11:40:31.554 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mon-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:40:31.554 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-osd-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:40:31.554 INFO:teuthology.orchestra.run.smithi093.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-12T11:40:31.554 INFO:teuthology.orchestra.run.smithi093.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-12T11:40:31.554 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-12T11:40:31.554 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-12T11:40:31.554 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-12T11:40:31.554 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-12T11:40:31.554 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-12T11:40:31.554 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-12T11:40:31.554 INFO:teuthology.orchestra.run.smithi093.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-12T11:40:31.554 INFO:teuthology.orchestra.run.smithi093.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-12T11:40:31.554 INFO:teuthology.orchestra.run.smithi093.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-12T11:40:31.555 INFO:teuthology.orchestra.run.smithi093.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-12T11:40:31.555 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-12T11:40:31.555 INFO:teuthology.orchestra.run.smithi093.stdout: python3-portend-2.6-1.el8.noarch 2023-12-12T11:40:31.555 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-12T11:40:31.555 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-12T11:40:31.555 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-12T11:40:31.555 INFO:teuthology.orchestra.run.smithi093.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-12T11:40:31.555 INFO:teuthology.orchestra.run.smithi093.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-12T11:40:31.555 INFO:teuthology.orchestra.run.smithi093.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-12T11:40:31.555 INFO:teuthology.orchestra.run.smithi093.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-12T11:40:31.555 INFO:teuthology.orchestra.run.smithi093.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-12T11:40:31.555 INFO:teuthology.orchestra.run.smithi093.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-12T11:40:31.555 INFO:teuthology.orchestra.run.smithi093.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-12T11:40:31.555 INFO:teuthology.orchestra.run.smithi093.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-12T11:40:31.555 INFO:teuthology.orchestra.run.smithi093.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-12T11:40:31.556 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:40:31.556 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-12T11:40:31.710 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-12T11:40:31.712 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2023-12-12T11:40:31.712 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-12T11:40:31.761 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install ceph-base 2023-12-12T11:40:31.850 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install cephadm 2023-12-12T11:40:32.843 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:29 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:40:32.968 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:29 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:40:34.371 INFO:teuthology.orchestra.run.smithi093.stdout:Package ceph-base-2:17.2.7-123.gbef78a51.el8.x86_64 is already installed. 2023-12-12T11:40:34.616 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-12T11:40:34.617 INFO:teuthology.orchestra.run.smithi093.stdout:Nothing to do. 2023-12-12T11:40:34.617 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-12T11:40:34.728 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install cephadm 2023-12-12T11:40:34.839 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-12T11:40:34.840 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:40:34.840 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2023-12-12T11:40:34.840 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:40:34.840 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-12T11:40:34.840 INFO:teuthology.orchestra.run.smithi063.stdout: cephadm noarch 2:17.2.7-123.gbef78a51.el8 ceph-noarch 80 k 2023-12-12T11:40:34.840 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:40:34.840 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-12T11:40:34.840 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:40:34.840 INFO:teuthology.orchestra.run.smithi063.stdout:Install 1 Package 2023-12-12T11:40:34.841 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:40:34.841 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 80 k 2023-12-12T11:40:34.841 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 364 k 2023-12-12T11:40:34.841 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-12T11:40:35.030 INFO:teuthology.orchestra.run.smithi063.stdout:cephadm-17.2.7-123.gbef78a51.el8.noarch.rpm 427 kB/s | 80 kB 00:00 2023-12-12T11:40:35.031 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:40:35.031 INFO:teuthology.orchestra.run.smithi063.stdout:Total 423 kB/s | 80 kB 00:00 2023-12-12T11:40:35.031 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-12T11:40:35.042 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-12T11:40:35.042 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-12T11:40:35.046 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-12T11:40:35.050 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-12T11:40:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-12T11:40:35.693 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: cephadm-2:17.2.7-123.gbef78a51.el8.noarch 1/1 2023-12-12T11:40:35.797 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:32 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:40:35.867 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephadm-2:17.2.7-123.gbef78a51.el8.noarch 1/1 2023-12-12T11:40:36.167 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: cephadm-2:17.2.7-123.gbef78a51.el8.noarch 1/1 2023-12-12T11:40:36.907 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephadm-2:17.2.7-123.gbef78a51.el8.noarch 1/1 2023-12-12T11:40:36.907 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:40:36.908 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-12T11:40:36.908 INFO:teuthology.orchestra.run.smithi063.stdout: cephadm-2:17.2.7-123.gbef78a51.el8.noarch 2023-12-12T11:40:36.908 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:40:36.908 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-12T11:40:37.145 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-immutable-object-cache 2023-12-12T11:40:37.550 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-12T11:40:37.552 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:40:37.552 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repository Size 2023-12-12T11:40:37.552 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:40:37.552 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-12T11:40:37.552 INFO:teuthology.orchestra.run.smithi093.stdout: cephadm noarch 2:17.2.7-123.gbef78a51.el8 ceph-noarch 80 k 2023-12-12T11:40:37.552 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:40:37.552 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-12T11:40:37.552 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:40:37.552 INFO:teuthology.orchestra.run.smithi093.stdout:Install 1 Package 2023-12-12T11:40:37.553 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:40:37.553 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 80 k 2023-12-12T11:40:37.553 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 364 k 2023-12-12T11:40:37.553 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-12T11:40:37.848 INFO:teuthology.orchestra.run.smithi093.stdout:cephadm-17.2.7-123.gbef78a51.el8.noarch.rpm 272 kB/s | 80 kB 00:00 2023-12-12T11:40:37.848 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:40:37.848 INFO:teuthology.orchestra.run.smithi093.stdout:Total 271 kB/s | 80 kB 00:00 2023-12-12T11:40:37.849 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-12T11:40:37.859 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-12T11:40:37.859 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-12T11:40:37.862 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-12T11:40:37.865 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-12T11:40:37.914 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-12T11:40:38.272 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:35 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:40:38.525 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: cephadm-2:17.2.7-123.gbef78a51.el8.noarch 1/1 2023-12-12T11:40:38.713 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : cephadm-2:17.2.7-123.gbef78a51.el8.noarch 1/1 2023-12-12T11:40:39.006 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: cephadm-2:17.2.7-123.gbef78a51.el8.noarch 1/1 2023-12-12T11:40:39.718 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : cephadm-2:17.2.7-123.gbef78a51.el8.noarch 1/1 2023-12-12T11:40:39.719 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:40:39.719 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-12T11:40:39.719 INFO:teuthology.orchestra.run.smithi093.stdout: cephadm-2:17.2.7-123.gbef78a51.el8.noarch 2023-12-12T11:40:39.719 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:40:39.719 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-12T11:40:39.980 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install ceph-immutable-object-cache 2023-12-12T11:40:40.187 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-12T11:40:40.188 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:40:40.188 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repo Size 2023-12-12T11:40:40.188 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:40:40.188 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-12T11:40:40.188 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-123.gbef78a51.el8 ceph 161 k 2023-12-12T11:40:40.188 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:40:40.188 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-12T11:40:40.188 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:40:40.188 INFO:teuthology.orchestra.run.smithi063.stdout:Install 1 Package 2023-12-12T11:40:40.188 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:40:40.188 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 161 k 2023-12-12T11:40:40.189 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 490 k 2023-12-12T11:40:40.189 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-12T11:40:40.511 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-immutable-object-cache-17.2.7-123.gbef78a5 501 kB/s | 161 kB 00:00 2023-12-12T11:40:40.512 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:40:40.512 INFO:teuthology.orchestra.run.smithi063.stdout:Total 499 kB/s | 161 kB 00:00 2023-12-12T11:40:40.512 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-12T11:40:40.527 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-12T11:40:40.527 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-12T11:40:40.585 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-12T11:40:40.589 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-12T11:40:40.709 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-12T11:40:40.890 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-123.gbef78a51.e 1/1 2023-12-12T11:40:41.042 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:38 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:40:41.579 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-123.gbef78a51.e 1/1 2023-12-12T11:40:42.333 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-123.gbef78a51.e 1/1 2023-12-12T11:40:42.333 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:40:42.333 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-12T11:40:42.333 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-immutable-object-cache-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:40:42.333 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:40:42.333 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-12T11:40:42.571 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-mgr 2023-12-12T11:40:42.792 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-12T11:40:42.793 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:40:42.793 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repo Size 2023-12-12T11:40:42.793 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:40:42.793 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-12T11:40:42.793 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-123.gbef78a51.el8 ceph 161 k 2023-12-12T11:40:42.793 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:40:42.793 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-12T11:40:42.793 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:40:42.793 INFO:teuthology.orchestra.run.smithi093.stdout:Install 1 Package 2023-12-12T11:40:42.793 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:40:42.794 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 161 k 2023-12-12T11:40:42.794 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 490 k 2023-12-12T11:40:42.794 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-12T11:40:43.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-immutable-object-cache-17.2.7-123.gbef78a5 751 kB/s | 161 kB 00:00 2023-12-12T11:40:43.010 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:40:43.010 INFO:teuthology.orchestra.run.smithi093.stdout:Total 746 kB/s | 161 kB 00:00 2023-12-12T11:40:43.011 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-12T11:40:43.024 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-12T11:40:43.024 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-12T11:40:43.079 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-12T11:40:43.082 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-12T11:40:43.202 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-12T11:40:43.363 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-123.gbef78a51.e 1/1 2023-12-12T11:40:43.713 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:40 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:40:44.023 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-123.gbef78a51.e 1/1 2023-12-12T11:40:44.728 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-123.gbef78a51.e 1/1 2023-12-12T11:40:44.728 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:40:44.728 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-12T11:40:44.728 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-immutable-object-cache-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:40:44.728 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:40:44.728 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-12T11:40:44.940 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install ceph-mgr 2023-12-12T11:40:45.330 INFO:teuthology.orchestra.run.smithi063.stdout:Package ceph-mgr-2:17.2.7-123.gbef78a51.el8.x86_64 is already installed. 2023-12-12T11:40:45.592 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-12T11:40:45.593 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2023-12-12T11:40:45.593 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-12T11:40:45.735 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-mgr-dashboard 2023-12-12T11:40:46.027 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:43 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:40:46.844 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:43 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:40:47.549 INFO:teuthology.orchestra.run.smithi093.stdout:Package ceph-mgr-2:17.2.7-123.gbef78a51.el8.x86_64 is already installed. 2023-12-12T11:40:47.796 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-12T11:40:47.797 INFO:teuthology.orchestra.run.smithi093.stdout:Nothing to do. 2023-12-12T11:40:47.797 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-12T11:40:47.920 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install ceph-mgr-dashboard 2023-12-12T11:40:48.728 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-12T11:40:48.730 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:40:48.730 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2023-12-12T11:40:48.730 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:40:48.730 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-12T11:40:48.730 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard noarch 2:17.2.7-123.gbef78a51.el8 ceph-noarch 1.7 M 2023-12-12T11:40:48.730 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2023-12-12T11:40:48.731 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-grafana-dashboards noarch 2:17.2.7-123.gbef78a51.el8 ceph-noarch 23 k 2023-12-12T11:40:48.731 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-prometheus-alerts noarch 2:17.2.7-123.gbef78a51.el8 ceph-noarch 14 k 2023-12-12T11:40:48.731 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-12-12T11:40:48.731 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-12T11:40:48.731 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-12T11:40:48.731 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:40:48.731 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-12T11:40:48.731 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:40:48.731 INFO:teuthology.orchestra.run.smithi063.stdout:Install 6 Packages 2023-12-12T11:40:48.731 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:40:48.732 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 2.0 M 2023-12-12T11:40:48.732 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 8.0 M 2023-12-12T11:40:48.732 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-12T11:40:48.991 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:45 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:40:49.130 INFO:teuthology.orchestra.run.smithi063.stdout:(1/6): ceph-grafana-dashboards-17.2.7-123.gbef7 73 kB/s | 23 kB 00:00 2023-12-12T11:40:49.155 INFO:teuthology.orchestra.run.smithi063.stdout:(2/6): ceph-prometheus-alerts-17.2.7-123.gbef78 42 kB/s | 14 kB 00:00 2023-12-12T11:40:49.297 INFO:teuthology.orchestra.run.smithi063.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 238 kB/s | 34 kB 00:00 2023-12-12T11:40:49.455 INFO:teuthology.orchestra.run.smithi063.stdout:(4/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.2 MB/s | 196 kB 00:00 2023-12-12T11:40:49.498 INFO:teuthology.orchestra.run.smithi063.stdout:(5/6): python3-jwt-1.6.1-2.el8.noarch.rpm 116 kB/s | 43 kB 00:00 2023-12-12T11:40:50.696 INFO:teuthology.orchestra.run.smithi063.stdout:(6/6): ceph-mgr-dashboard-17.2.7-123.gbef78a51. 922 kB/s | 1.7 MB 00:01 2023-12-12T11:40:50.698 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:40:50.699 INFO:teuthology.orchestra.run.smithi063.stdout:Total 1.0 MB/s | 2.0 MB 00:01 2023-12-12T11:40:50.726 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-12T11:40:50.740 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-12T11:40:50.740 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-12T11:40:50.745 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-12T11:40:50.746 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:40:50.746 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repository Size 2023-12-12T11:40:50.747 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:40:50.747 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-12T11:40:50.747 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-dashboard noarch 2:17.2.7-123.gbef78a51.el8 ceph-noarch 1.7 M 2023-12-12T11:40:50.747 INFO:teuthology.orchestra.run.smithi093.stdout:Installing dependencies: 2023-12-12T11:40:50.747 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-grafana-dashboards noarch 2:17.2.7-123.gbef78a51.el8 ceph-noarch 23 k 2023-12-12T11:40:50.747 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-prometheus-alerts noarch 2:17.2.7-123.gbef78a51.el8 ceph-noarch 14 k 2023-12-12T11:40:50.747 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-12-12T11:40:50.747 INFO:teuthology.orchestra.run.smithi093.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-12T11:40:50.747 INFO:teuthology.orchestra.run.smithi093.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-12T11:40:50.747 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:40:50.748 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-12T11:40:50.748 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:40:50.748 INFO:teuthology.orchestra.run.smithi093.stdout:Install 6 Packages 2023-12-12T11:40:50.748 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:40:50.748 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 2.0 M 2023-12-12T11:40:50.748 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 8.0 M 2023-12-12T11:40:50.748 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-12T11:40:50.845 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-12T11:40:50.849 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-12T11:40:51.136 INFO:teuthology.orchestra.run.smithi093.stdout:(1/6): ceph-prometheus-alerts-17.2.7-123.gbef78 97 kB/s | 14 kB 00:00 2023-12-12T11:40:51.146 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-12T11:40:51.186 INFO:teuthology.orchestra.run.smithi093.stdout:(2/6): ceph-grafana-dashboards-17.2.7-123.gbef7 115 kB/s | 23 kB 00:00 2023-12-12T11:40:51.328 INFO:teuthology.orchestra.run.smithi093.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 238 kB/s | 34 kB 00:00 2023-12-12T11:40:51.352 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-12-12T11:40:51.446 INFO:teuthology.orchestra.run.smithi093.stdout:(4/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.6 MB/s | 196 kB 00:00 2023-12-12T11:40:51.479 INFO:teuthology.orchestra.run.smithi093.stdout:(5/6): python3-jwt-1.6.1-2.el8.noarch.rpm 124 kB/s | 43 kB 00:00 2023-12-12T11:40:51.587 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-12-12T11:40:51.646 INFO:teuthology.orchestra.run.smithi093.stdout:(6/6): ceph-mgr-dashboard-17.2.7-123.gbef78a51. 2.6 MB/s | 1.7 MB 00:00 2023-12-12T11:40:51.648 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:40:51.649 INFO:teuthology.orchestra.run.smithi093.stdout:Total 2.2 MB/s | 2.0 MB 00:00 2023-12-12T11:40:51.673 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-12T11:40:51.685 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-12T11:40:51.685 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-12T11:40:51.767 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-12-12T11:40:51.787 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-12T11:40:51.790 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-12T11:40:51.922 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-123.gbef78a51.el8.no 4/6 2023-12-12T11:40:52.101 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-12T11:40:52.296 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-123.gbef78a51.el8.n 5/6 2023-12-12T11:40:52.315 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-12-12T11:40:52.477 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-123.gbef78a51.el8.noarch 6/6 2023-12-12T11:40:52.600 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-12-12T11:40:52.832 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-123.gbef78a51.el8.noarch 6/6 2023-12-12T11:40:52.832 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-123.gbef78a51.el8.n 1/6 2023-12-12T11:40:52.832 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-123.gbef78a51.el8.noarch 2/6 2023-12-12T11:40:52.832 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-123.gbef78a51.el8.no 3/6 2023-12-12T11:40:52.832 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-12-12T11:40:52.832 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-12-12T11:40:52.940 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-12-12T11:40:53.069 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-123.gbef78a51.el8.no 4/6 2023-12-12T11:40:53.470 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-123.gbef78a51.el8.n 5/6 2023-12-12T11:40:53.611 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-12-12T11:40:53.612 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:40:53.612 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-12T11:40:53.612 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-grafana-dashboards-2:17.2.7-123.gbef78a51.el8.noarch 2023-12-12T11:40:53.612 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard-2:17.2.7-123.gbef78a51.el8.noarch 2023-12-12T11:40:53.612 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-prometheus-alerts-2:17.2.7-123.gbef78a51.el8.noarch 2023-12-12T11:40:53.612 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-12T11:40:53.612 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-12T11:40:53.612 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-12T11:40:53.612 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:40:53.612 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-12T11:40:53.648 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-123.gbef78a51.el8.noarch 6/6 2023-12-12T11:40:53.793 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-12T11:40:53.990 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-123.gbef78a51.el8.noarch 6/6 2023-12-12T11:40:53.991 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-123.gbef78a51.el8.n 1/6 2023-12-12T11:40:53.991 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-123.gbef78a51.el8.noarch 2/6 2023-12-12T11:40:53.991 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-123.gbef78a51.el8.no 3/6 2023-12-12T11:40:53.991 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-12-12T11:40:53.991 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-12-12T11:40:54.691 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-12-12T11:40:54.691 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:40:54.691 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-12T11:40:54.691 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-grafana-dashboards-2:17.2.7-123.gbef78a51.el8.noarch 2023-12-12T11:40:54.691 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-dashboard-2:17.2.7-123.gbef78a51.el8.noarch 2023-12-12T11:40:54.691 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-prometheus-alerts-2:17.2.7-123.gbef78a51.el8.noarch 2023-12-12T11:40:54.691 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-12T11:40:54.691 INFO:teuthology.orchestra.run.smithi093.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-12T11:40:54.692 INFO:teuthology.orchestra.run.smithi093.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-12T11:40:54.692 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:40:54.692 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-12T11:40:54.854 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-12T11:40:54.910 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:51 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:40:55.928 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:52 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:40:56.816 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-12T11:40:56.818 INFO:teuthology.orchestra.run.smithi063.stdout:============================================================================================ 2023-12-12T11:40:56.818 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2023-12-12T11:40:56.818 INFO:teuthology.orchestra.run.smithi063.stdout:============================================================================================ 2023-12-12T11:40:56.818 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-12T11:40:56.819 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-123.gbef78a51.el8 ceph-noarch 7.4 M 2023-12-12T11:40:56.819 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2023-12-12T11:40:56.819 INFO:teuthology.orchestra.run.smithi063.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-12-12T11:40:56.819 INFO:teuthology.orchestra.run.smithi063.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-12-12T11:40:56.819 INFO:teuthology.orchestra.run.smithi063.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-12-12T11:40:56.819 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-12-12T11:40:56.819 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-12-12T11:40:56.819 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-12-12T11:40:56.820 INFO:teuthology.orchestra.run.smithi063.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2023-12-12T11:40:56.820 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:40:56.820 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-12T11:40:56.820 INFO:teuthology.orchestra.run.smithi063.stdout:============================================================================================ 2023-12-12T11:40:56.820 INFO:teuthology.orchestra.run.smithi063.stdout:Install 8 Packages 2023-12-12T11:40:56.820 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:40:56.821 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 36 M 2023-12-12T11:40:56.821 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 210 M 2023-12-12T11:40:56.821 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-12T11:40:57.606 INFO:teuthology.orchestra.run.smithi063.stdout:(1/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 8.7 MB/s | 4.9 MB 00:00 2023-12-12T11:40:57.681 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-12T11:40:57.682 INFO:teuthology.orchestra.run.smithi063.stdout:(2/8): openblas-0.3.15-4.el8.x86_64.rpm 7.4 MB/s | 4.7 MB 00:00 2023-12-12T11:40:57.682 INFO:teuthology.orchestra.run.smithi093.stdout:============================================================================================ 2023-12-12T11:40:57.682 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repository Size 2023-12-12T11:40:57.683 INFO:teuthology.orchestra.run.smithi093.stdout:============================================================================================ 2023-12-12T11:40:57.683 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-12T11:40:57.683 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-123.gbef78a51.el8 ceph-noarch 7.4 M 2023-12-12T11:40:57.683 INFO:teuthology.orchestra.run.smithi093.stdout:Installing dependencies: 2023-12-12T11:40:57.683 INFO:teuthology.orchestra.run.smithi093.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-12-12T11:40:57.683 INFO:teuthology.orchestra.run.smithi093.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-12-12T11:40:57.683 INFO:teuthology.orchestra.run.smithi093.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-12-12T11:40:57.683 INFO:teuthology.orchestra.run.smithi093.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-12-12T11:40:57.683 INFO:teuthology.orchestra.run.smithi093.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-12-12T11:40:57.683 INFO:teuthology.orchestra.run.smithi093.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-12-12T11:40:57.683 INFO:teuthology.orchestra.run.smithi093.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2023-12-12T11:40:57.683 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:40:57.683 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-12T11:40:57.683 INFO:teuthology.orchestra.run.smithi093.stdout:============================================================================================ 2023-12-12T11:40:57.683 INFO:teuthology.orchestra.run.smithi093.stdout:Install 8 Packages 2023-12-12T11:40:57.683 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:40:57.684 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 36 M 2023-12-12T11:40:57.684 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 210 M 2023-12-12T11:40:57.684 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-12T11:40:57.765 INFO:teuthology.orchestra.run.smithi063.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 2.6 MB/s | 225 kB 00:00 2023-12-12T11:40:57.865 INFO:teuthology.orchestra.run.smithi063.stdout:(4/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 14 MB/s | 3.7 MB 00:00 2023-12-12T11:40:58.116 INFO:teuthology.orchestra.run.smithi063.stdout:(5/8): ceph-mgr-diskprediction-local-17.2.7-123 6.9 MB/s | 7.4 MB 00:01 2023-12-12T11:40:58.471 INFO:teuthology.orchestra.run.smithi093.stdout:(1/8): openblas-0.3.15-4.el8.x86_64.rpm 13 MB/s | 4.7 MB 00:00 2023-12-12T11:40:58.533 INFO:teuthology.orchestra.run.smithi063.stdout:(6/8): libgfortran-8.5.0-21.el8.x86_64.rpm 968 kB/s | 645 kB 00:00 2023-12-12T11:40:58.537 INFO:teuthology.orchestra.run.smithi093.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 11 MB/s | 4.9 MB 00:00 2023-12-12T11:40:58.588 INFO:teuthology.orchestra.run.smithi093.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 4.4 MB/s | 225 kB 00:00 2023-12-12T11:40:58.616 INFO:teuthology.orchestra.run.smithi063.stdout:(7/8): libquadmath-8.5.0-21.el8.x86_64.rpm 345 kB/s | 172 kB 00:00 2023-12-12T11:40:58.680 INFO:teuthology.orchestra.run.smithi093.stdout:(4/8): ceph-mgr-diskprediction-local-17.2.7-123 13 MB/s | 7.4 MB 00:00 2023-12-12T11:40:58.747 INFO:teuthology.orchestra.run.smithi093.stdout:(5/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 14 MB/s | 3.7 MB 00:00 2023-12-12T11:40:59.116 INFO:teuthology.orchestra.run.smithi063.stdout:(8/8): python3-scipy-1.0.0-21.module_el8+762+77 10 MB/s | 14 MB 00:01 2023-12-12T11:40:59.117 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:40:59.117 INFO:teuthology.orchestra.run.smithi063.stdout:Total 16 MB/s | 36 MB 00:02 2023-12-12T11:40:59.230 INFO:teuthology.orchestra.run.smithi093.stdout:(6/8): python3-scipy-1.0.0-21.module_el8+762+77 22 MB/s | 14 MB 00:00 2023-12-12T11:40:59.280 INFO:teuthology.orchestra.run.smithi093.stdout:(7/8): libquadmath-8.5.0-21.el8.x86_64.rpm 323 kB/s | 172 kB 00:00 2023-12-12T11:40:59.306 INFO:teuthology.orchestra.run.smithi093.stdout:(8/8): libgfortran-8.5.0-21.el8.x86_64.rpm 1.0 MB/s | 645 kB 00:00 2023-12-12T11:40:59.306 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:40:59.306 INFO:teuthology.orchestra.run.smithi093.stdout:Total 22 MB/s | 36 MB 00:01 2023-12-12T11:40:59.453 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-12T11:40:59.478 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-12T11:40:59.478 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-12T11:40:59.634 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-12T11:40:59.657 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-12T11:40:59.657 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-12T11:40:59.906 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-12T11:40:59.910 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-12T11:41:00.077 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-12T11:41:00.080 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-12T11:41:00.544 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-12T11:41:00.657 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-12T11:41:00.696 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-12T11:41:00.785 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-12T11:41:00.945 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-12T11:41:00.980 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-12T11:41:01.085 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-12T11:41:01.329 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-12T11:41:01.744 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-12T11:41:01.902 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-12-12T11:41:02.019 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-12T11:41:02.162 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-12-12T11:41:02.581 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-12-12T11:41:02.718 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-12T11:41:02.881 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-12-12T11:41:03.012 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-12T11:41:03.532 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-12T11:41:03.882 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-12T11:41:04.214 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-12-12T11:41:04.234 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-12-12T11:41:04.434 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-12T11:41:04.445 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-12T11:41:06.463 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-12T11:41:06.623 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-12T11:41:07.838 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2023-12-12T11:41:07.998 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2023-12-12T11:41:08.009 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-123.gbef78a51 8/8 2023-12-12T11:41:08.195 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-123.gbef78a51 8/8 2023-12-12T11:41:08.411 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-123.gbef78a51 8/8 2023-12-12T11:41:08.411 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-123.gbef78a51 1/8 2023-12-12T11:41:08.411 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-12-12T11:41:08.411 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-12-12T11:41:08.411 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-12-12T11:41:08.411 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-12-12T11:41:08.411 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2023-12-12T11:41:08.411 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2023-12-12T11:41:08.614 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-123.gbef78a51 8/8 2023-12-12T11:41:08.614 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-123.gbef78a51 1/8 2023-12-12T11:41:08.614 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-12-12T11:41:08.614 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-12-12T11:41:08.614 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-12-12T11:41:08.615 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-12-12T11:41:08.615 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2023-12-12T11:41:08.615 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2023-12-12T11:41:09.187 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2023-12-12T11:41:09.187 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:41:09.187 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-12T11:41:09.187 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-diskprediction-local-2:17.2.7-123.gbef78a51.el8.noarch 2023-12-12T11:41:09.187 INFO:teuthology.orchestra.run.smithi093.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-12-12T11:41:09.187 INFO:teuthology.orchestra.run.smithi093.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-12-12T11:41:09.187 INFO:teuthology.orchestra.run.smithi093.stdout: openblas-0.3.15-4.el8.x86_64 2023-12-12T11:41:09.187 INFO:teuthology.orchestra.run.smithi093.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-12-12T11:41:09.187 INFO:teuthology.orchestra.run.smithi093.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-12T11:41:09.187 INFO:teuthology.orchestra.run.smithi093.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-12T11:41:09.187 INFO:teuthology.orchestra.run.smithi093.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2023-12-12T11:41:09.188 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:41:09.188 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-12T11:41:09.353 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install ceph-mgr-rook 2023-12-12T11:41:09.420 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2023-12-12T11:41:09.420 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:41:09.420 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-12T11:41:09.420 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-diskprediction-local-2:17.2.7-123.gbef78a51.el8.noarch 2023-12-12T11:41:09.421 INFO:teuthology.orchestra.run.smithi063.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-12-12T11:41:09.421 INFO:teuthology.orchestra.run.smithi063.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-12-12T11:41:09.421 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-0.3.15-4.el8.x86_64 2023-12-12T11:41:09.421 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-12-12T11:41:09.421 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-12T11:41:09.421 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-12T11:41:09.421 INFO:teuthology.orchestra.run.smithi063.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2023-12-12T11:41:09.421 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:41:09.421 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-12T11:41:09.617 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-mgr-rook 2023-12-12T11:41:10.412 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:02:07 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:41:10.738 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:02:07 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:41:12.285 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-12T11:41:12.287 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:41:12.287 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repository Size 2023-12-12T11:41:12.287 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:41:12.287 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-12T11:41:12.288 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-rook noarch 2:17.2.7-123.gbef78a51.el8 ceph-noarch 47 k 2023-12-12T11:41:12.288 INFO:teuthology.orchestra.run.smithi093.stdout:Installing dependencies: 2023-12-12T11:41:12.288 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-12T11:41:12.288 INFO:teuthology.orchestra.run.smithi093.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-12T11:41:12.288 INFO:teuthology.orchestra.run.smithi093.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-12T11:41:12.288 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-12-12T11:41:12.288 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-12-12T11:41:12.288 INFO:teuthology.orchestra.run.smithi093.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-12T11:41:12.288 INFO:teuthology.orchestra.run.smithi093.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-12-12T11:41:12.288 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-12-12T11:41:12.288 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-12-12T11:41:12.288 INFO:teuthology.orchestra.run.smithi093.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-12-12T11:41:12.288 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-12T11:41:12.289 INFO:teuthology.orchestra.run.smithi093.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-12T11:41:12.289 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:41:12.289 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-12T11:41:12.289 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:41:12.289 INFO:teuthology.orchestra.run.smithi093.stdout:Install 13 Packages 2023-12-12T11:41:12.289 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:41:12.289 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 1.9 M 2023-12-12T11:41:12.290 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 25 M 2023-12-12T11:41:12.290 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-12T11:41:12.801 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-12T11:41:12.803 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:41:12.803 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2023-12-12T11:41:12.803 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:41:12.803 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-12T11:41:12.803 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-rook noarch 2:17.2.7-123.gbef78a51.el8 ceph-noarch 47 k 2023-12-12T11:41:12.803 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2023-12-12T11:41:12.803 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-12T11:41:12.803 INFO:teuthology.orchestra.run.smithi063.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-12T11:41:12.803 INFO:teuthology.orchestra.run.smithi063.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-12T11:41:12.803 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-12-12T11:41:12.803 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-12-12T11:41:12.803 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-12T11:41:12.803 INFO:teuthology.orchestra.run.smithi063.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-12-12T11:41:12.803 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-12-12T11:41:12.804 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-12-12T11:41:12.804 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-12-12T11:41:12.804 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-12T11:41:12.804 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-12T11:41:12.804 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:41:12.804 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-12T11:41:12.804 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:41:12.804 INFO:teuthology.orchestra.run.smithi063.stdout:Install 13 Packages 2023-12-12T11:41:12.804 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:41:12.805 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 1.9 M 2023-12-12T11:41:12.805 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 25 M 2023-12-12T11:41:12.805 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-12T11:41:13.109 INFO:teuthology.orchestra.run.smithi093.stdout:(1/13): python3-jsonpointer-1.10-11.el8.noarch. 223 kB/s | 20 kB 00:00 2023-12-12T11:41:13.135 INFO:teuthology.orchestra.run.smithi093.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 232 kB/s | 27 kB 00:00 2023-12-12T11:41:13.210 INFO:teuthology.orchestra.run.smithi093.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.3 MB/s | 126 kB 00:00 2023-12-12T11:41:13.227 INFO:teuthology.orchestra.run.smithi093.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 1.2 MB/s | 110 kB 00:00 2023-12-12T11:41:13.313 INFO:teuthology.orchestra.run.smithi063.stdout:(1/13): python3-jsonpointer-1.10-11.el8.noarch. 172 kB/s | 20 kB 00:00 2023-12-12T11:41:13.346 INFO:teuthology.orchestra.run.smithi063.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 177 kB/s | 27 kB 00:00 2023-12-12T11:41:13.413 INFO:teuthology.orchestra.run.smithi063.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.3 MB/s | 126 kB 00:00 2023-12-12T11:41:13.430 INFO:teuthology.orchestra.run.smithi063.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 1.3 MB/s | 110 kB 00:00 2023-12-12T11:41:13.569 INFO:teuthology.orchestra.run.smithi093.stdout:(5/13): ceph-mgr-rook-17.2.7-123.gbef78a51.el8. 86 kB/s | 47 kB 00:00 2023-12-12T11:41:13.586 INFO:teuthology.orchestra.run.smithi093.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 119 kB/s | 43 kB 00:00 2023-12-12T11:41:13.669 INFO:teuthology.orchestra.run.smithi093.stdout:(7/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 338 kB/s | 155 kB 00:00 2023-12-12T11:41:13.687 INFO:teuthology.orchestra.run.smithi093.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 282 kB/s | 33 kB 00:00 2023-12-12T11:41:13.706 INFO:teuthology.orchestra.run.smithi093.stdout:(9/13): python3-certifi-2018.10.15-7.el8.noarch 139 kB/s | 16 kB 00:00 2023-12-12T11:41:13.772 INFO:teuthology.orchestra.run.smithi063.stdout:(5/13): ceph-mgr-rook-17.2.7-123.gbef78a51.el8. 82 kB/s | 47 kB 00:00 2023-12-12T11:41:13.779 INFO:teuthology.orchestra.run.smithi093.stdout:(10/13): python3-rsa-4.9-2.el8.noarch.rpm 921 kB/s | 64 kB 00:00 2023-12-12T11:41:13.797 INFO:teuthology.orchestra.run.smithi063.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 116 kB/s | 43 kB 00:00 2023-12-12T11:41:13.812 INFO:teuthology.orchestra.run.smithi093.stdout:(11/13): python3-google-auth-1.1.1-10.el8.noarc 572 kB/s | 81 kB 00:00 2023-12-12T11:41:13.839 INFO:teuthology.orchestra.run.smithi063.stdout:(7/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 364 kB/s | 155 kB 00:00 2023-12-12T11:41:13.862 INFO:teuthology.orchestra.run.smithi093.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 737 kB/s | 61 kB 00:00 2023-12-12T11:41:13.904 INFO:teuthology.orchestra.run.smithi093.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 5.4 MB/s | 1.2 MB 00:00 2023-12-12T11:41:13.906 INFO:teuthology.orchestra.run.smithi063.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 150 kB/s | 16 kB 00:00 2023-12-12T11:41:13.907 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:41:13.907 INFO:teuthology.orchestra.run.smithi093.stdout:Total 1.2 MB/s | 1.9 MB 00:01 2023-12-12T11:41:13.931 INFO:teuthology.orchestra.run.smithi063.stdout:(9/13): python3-cachetools-3.1.1-4.el8.noarch.r 207 kB/s | 33 kB 00:00 2023-12-12T11:41:13.976 INFO:teuthology.orchestra.run.smithi063.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 598 kB/s | 81 kB 00:00 2023-12-12T11:41:14.007 INFO:teuthology.orchestra.run.smithi063.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 854 kB/s | 64 kB 00:00 2023-12-12T11:41:14.041 INFO:teuthology.orchestra.run.smithi063.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 952 kB/s | 61 kB 00:00 2023-12-12T11:41:14.047 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-12T11:41:14.067 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-12T11:41:14.067 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-12T11:41:14.099 INFO:teuthology.orchestra.run.smithi063.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 6.1 MB/s | 1.2 MB 00:00 2023-12-12T11:41:14.100 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:41:14.100 INFO:teuthology.orchestra.run.smithi063.stdout:Total 1.5 MB/s | 1.9 MB 00:01 2023-12-12T11:41:14.172 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-12T11:41:14.176 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-12T11:41:14.243 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-12T11:41:14.264 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-12T11:41:14.264 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-12T11:41:14.376 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-12T11:41:14.380 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-12T11:41:14.739 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-12T11:41:14.951 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-12-12T11:41:14.961 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-12T11:41:15.155 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-12-12T11:41:15.198 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-12-12T11:41:15.381 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-12-12T11:41:15.385 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-12-12T11:41:15.586 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-12-12T11:41:15.600 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-12-12T11:41:15.792 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-12-12T11:41:15.803 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-12-12T11:41:15.996 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-12-12T11:41:16.012 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-12-12T11:41:16.227 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-12-12T11:41:16.317 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-12-12T11:41:16.542 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-12-12T11:41:16.552 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-12-12T11:41:16.805 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-12-12T11:41:17.757 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-12-12T11:41:18.033 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-12-12T11:41:18.098 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-12-12T11:41:18.208 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-12-12T11:41:18.352 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-12-12T11:41:18.420 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-12-12T11:41:18.512 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-12-12T11:41:18.617 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-rook-2:17.2.7-123.gbef78a51.el8.noarch 13/13 2023-12-12T11:41:18.733 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-12-12T11:41:18.929 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-rook-2:17.2.7-123.gbef78a51.el8.noarch 13/13 2023-12-12T11:41:18.990 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-123.gbef78a51.el8.noarch 13/13 2023-12-12T11:41:18.991 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-rook-2:17.2.7-123.gbef78a51.el8.noarch 1/13 2023-12-12T11:41:18.991 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-12-12T11:41:18.991 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-12-12T11:41:18.991 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-12-12T11:41:18.991 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-12-12T11:41:18.991 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-12-12T11:41:18.991 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-12-12T11:41:18.991 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-12-12T11:41:18.991 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-12-12T11:41:18.991 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-12-12T11:41:18.991 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-12-12T11:41:18.991 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-12-12T11:41:19.302 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-123.gbef78a51.el8.noarch 13/13 2023-12-12T11:41:19.302 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-rook-2:17.2.7-123.gbef78a51.el8.noarch 1/13 2023-12-12T11:41:19.302 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-12-12T11:41:19.302 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-12-12T11:41:19.302 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-12-12T11:41:19.302 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-12-12T11:41:19.302 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-12-12T11:41:19.303 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-12-12T11:41:19.303 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-12-12T11:41:19.303 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-12-12T11:41:19.303 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-12-12T11:41:19.303 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-12-12T11:41:19.303 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-12-12T11:41:19.796 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-12-12T11:41:19.797 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:41:19.797 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-12T11:41:19.797 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-rook-2:17.2.7-123.gbef78a51.el8.noarch 2023-12-12T11:41:19.797 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-12T11:41:19.797 INFO:teuthology.orchestra.run.smithi093.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-12T11:41:19.797 INFO:teuthology.orchestra.run.smithi093.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-12T11:41:19.797 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-12T11:41:19.797 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-12T11:41:19.797 INFO:teuthology.orchestra.run.smithi093.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-12T11:41:19.797 INFO:teuthology.orchestra.run.smithi093.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-12T11:41:19.797 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-12T11:41:19.797 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-12T11:41:19.798 INFO:teuthology.orchestra.run.smithi093.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-12T11:41:19.798 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-12T11:41:19.798 INFO:teuthology.orchestra.run.smithi093.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-12T11:41:19.798 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:41:19.798 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-12T11:41:19.946 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install ceph-mgr-cephadm 2023-12-12T11:41:20.118 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-12-12T11:41:20.118 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:41:20.118 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-12T11:41:20.118 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-rook-2:17.2.7-123.gbef78a51.el8.noarch 2023-12-12T11:41:20.118 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-12T11:41:20.118 INFO:teuthology.orchestra.run.smithi063.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-12T11:41:20.118 INFO:teuthology.orchestra.run.smithi063.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-12T11:41:20.118 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-12T11:41:20.118 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-12T11:41:20.118 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-12T11:41:20.119 INFO:teuthology.orchestra.run.smithi063.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-12T11:41:20.119 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-12T11:41:20.119 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-12T11:41:20.119 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-12T11:41:20.119 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-12T11:41:20.119 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-12T11:41:20.119 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:41:20.119 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-12T11:41:20.284 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-mgr-cephadm 2023-12-12T11:41:21.008 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:02:18 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:41:21.416 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:02:18 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:41:22.758 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-12T11:41:22.759 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:41:22.759 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repository Size 2023-12-12T11:41:22.759 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:41:22.760 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-12T11:41:22.760 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-cephadm noarch 2:17.2.7-123.gbef78a51.el8 ceph-noarch 121 k 2023-12-12T11:41:22.760 INFO:teuthology.orchestra.run.smithi093.stdout:Installing dependencies: 2023-12-12T11:41:22.760 INFO:teuthology.orchestra.run.smithi093.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-12T11:41:22.760 INFO:teuthology.orchestra.run.smithi093.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-12-12T11:41:22.760 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-12-12T11:41:22.760 INFO:teuthology.orchestra.run.smithi093.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-12T11:41:22.760 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:41:22.760 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-12T11:41:22.760 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:41:22.760 INFO:teuthology.orchestra.run.smithi093.stdout:Install 5 Packages 2023-12-12T11:41:22.760 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:41:22.761 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 6.0 M 2023-12-12T11:41:22.761 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 26 M 2023-12-12T11:41:22.761 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-12T11:41:23.294 INFO:teuthology.orchestra.run.smithi093.stdout:(1/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 2.7 MB/s | 538 kB 00:00 2023-12-12T11:41:23.322 INFO:teuthology.orchestra.run.smithi093.stdout:(2/5): ceph-mgr-cephadm-17.2.7-123.gbef78a51.el 543 kB/s | 121 kB 00:00 2023-12-12T11:41:23.326 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-12T11:41:23.327 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:41:23.327 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2023-12-12T11:41:23.327 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:41:23.327 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-12T11:41:23.327 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-cephadm noarch 2:17.2.7-123.gbef78a51.el8 ceph-noarch 121 k 2023-12-12T11:41:23.328 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2023-12-12T11:41:23.328 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-12T11:41:23.328 INFO:teuthology.orchestra.run.smithi063.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-12-12T11:41:23.328 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-12-12T11:41:23.328 INFO:teuthology.orchestra.run.smithi063.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-12T11:41:23.328 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:41:23.328 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-12T11:41:23.328 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:41:23.328 INFO:teuthology.orchestra.run.smithi063.stdout:Install 5 Packages 2023-12-12T11:41:23.328 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:41:23.330 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 6.0 M 2023-12-12T11:41:23.330 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 26 M 2023-12-12T11:41:23.330 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-12T11:41:23.661 INFO:teuthology.orchestra.run.smithi093.stdout:(3/5): python3-babel-2.5.1-7.el8.noarch.rpm 8.5 MB/s | 4.8 MB 00:00 2023-12-12T11:41:23.736 INFO:teuthology.orchestra.run.smithi093.stdout:(4/5): python3-natsort-7.1.1-2.el8.noarch.rpm 144 kB/s | 60 kB 00:00 2023-12-12T11:41:23.986 INFO:teuthology.orchestra.run.smithi093.stdout:(5/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 688 kB/s | 476 kB 00:00 2023-12-12T11:41:23.988 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:41:23.989 INFO:teuthology.orchestra.run.smithi093.stdout:Total 4.8 MB/s | 6.0 MB 00:01 2023-12-12T11:41:24.006 INFO:teuthology.orchestra.run.smithi063.stdout:(1/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 2.4 MB/s | 538 kB 00:00 2023-12-12T11:41:24.069 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-12T11:41:24.084 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-12T11:41:24.084 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-12T11:41:24.181 INFO:teuthology.orchestra.run.smithi063.stdout:(2/5): ceph-mgr-cephadm-17.2.7-123.gbef78a51.el 306 kB/s | 121 kB 00:00 2023-12-12T11:41:24.210 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-12T11:41:24.213 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-12T11:41:24.256 INFO:teuthology.orchestra.run.smithi063.stdout:(3/5): python3-babel-2.5.1-7.el8.noarch.rpm 10 MB/s | 4.8 MB 00:00 2023-12-12T11:41:24.515 INFO:teuthology.orchestra.run.smithi063.stdout:(4/5): python3-natsort-7.1.1-2.el8.noarch.rpm 181 kB/s | 60 kB 00:00 2023-12-12T11:41:24.518 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-12T11:41:24.623 INFO:teuthology.orchestra.run.smithi063.stdout:(5/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 771 kB/s | 476 kB 00:00 2023-12-12T11:41:24.624 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:41:24.624 INFO:teuthology.orchestra.run.smithi063.stdout:Total 4.6 MB/s | 6.0 MB 00:01 2023-12-12T11:41:24.707 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-12T11:41:24.723 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-12T11:41:24.723 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-12T11:41:24.852 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-12T11:41:24.856 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-12T11:41:24.874 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-12-12T11:41:25.154 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-12T11:41:25.499 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-12-12T11:41:25.940 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-12-12T11:41:26.336 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-12-12T11:41:26.576 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-12-12T11:41:26.632 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-12-12T11:41:26.823 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-123.gbef78a51.el8.noarch 5/5 2023-12-12T11:41:26.987 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-12-12T11:41:27.176 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-123.gbef78a51.el8.noarch 5/5 2023-12-12T11:41:27.176 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-123.gbef78a51.el8.noarch 1/5 2023-12-12T11:41:27.176 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-12-12T11:41:27.176 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-12-12T11:41:27.176 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-12-12T11:41:27.295 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-12-12T11:41:27.476 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-123.gbef78a51.el8.noarch 5/5 2023-12-12T11:41:27.832 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-123.gbef78a51.el8.noarch 5/5 2023-12-12T11:41:27.832 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-123.gbef78a51.el8.noarch 1/5 2023-12-12T11:41:27.832 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-12-12T11:41:27.832 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-12-12T11:41:27.832 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-12-12T11:41:27.948 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-12-12T11:41:27.948 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:41:27.948 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-12T11:41:27.948 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-cephadm-2:17.2.7-123.gbef78a51.el8.noarch 2023-12-12T11:41:27.948 INFO:teuthology.orchestra.run.smithi093.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-12T11:41:27.948 INFO:teuthology.orchestra.run.smithi093.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-12T11:41:27.948 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-12T11:41:27.948 INFO:teuthology.orchestra.run.smithi093.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-12T11:41:27.948 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:41:27.948 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-12T11:41:28.112 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install ceph-fuse 2023-12-12T11:41:28.566 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-12-12T11:41:28.566 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:41:28.566 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-12T11:41:28.566 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-cephadm-2:17.2.7-123.gbef78a51.el8.noarch 2023-12-12T11:41:28.566 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-12T11:41:28.566 INFO:teuthology.orchestra.run.smithi063.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-12T11:41:28.566 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-12T11:41:28.567 INFO:teuthology.orchestra.run.smithi063.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-12T11:41:28.567 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:41:28.567 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-12T11:41:28.760 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-fuse 2023-12-12T11:41:29.169 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:02:26 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:41:29.864 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:02:26 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:41:30.952 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-12T11:41:30.953 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:41:30.953 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repository Size 2023-12-12T11:41:30.953 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:41:30.953 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-12T11:41:30.953 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-fuse x86_64 2:17.2.7-123.gbef78a51.el8 ceph 875 k 2023-12-12T11:41:30.953 INFO:teuthology.orchestra.run.smithi093.stdout:Installing dependencies: 2023-12-12T11:41:30.953 INFO:teuthology.orchestra.run.smithi093.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-12-12T11:41:30.953 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:41:30.953 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-12T11:41:30.953 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:41:30.953 INFO:teuthology.orchestra.run.smithi093.stdout:Install 2 Packages 2023-12-12T11:41:30.953 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:41:30.954 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 958 k 2023-12-12T11:41:30.954 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 3.0 M 2023-12-12T11:41:30.954 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-12T11:41:31.278 INFO:teuthology.orchestra.run.smithi093.stdout:(1/2): ceph-fuse-17.2.7-123.gbef78a51.el8.x86_6 3.0 MB/s | 875 kB 00:00 2023-12-12T11:41:31.336 INFO:teuthology.orchestra.run.smithi093.stdout:(2/2): fuse-2.9.7-17.el8.x86_64.rpm 243 kB/s | 83 kB 00:00 2023-12-12T11:41:31.336 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:41:31.337 INFO:teuthology.orchestra.run.smithi093.stdout:Total 2.4 MB/s | 958 kB 00:00 2023-12-12T11:41:31.361 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-12T11:41:31.387 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-12T11:41:31.387 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-12T11:41:31.490 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-12T11:41:31.494 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-12T11:41:31.692 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-12T11:41:31.777 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-12T11:41:31.778 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:41:31.778 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2023-12-12T11:41:31.778 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:41:31.778 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-12T11:41:31.778 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-fuse x86_64 2:17.2.7-123.gbef78a51.el8 ceph 875 k 2023-12-12T11:41:31.778 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2023-12-12T11:41:31.778 INFO:teuthology.orchestra.run.smithi063.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-12-12T11:41:31.778 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:41:31.778 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-12T11:41:31.779 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:41:31.779 INFO:teuthology.orchestra.run.smithi063.stdout:Install 2 Packages 2023-12-12T11:41:31.779 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:41:31.779 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 958 k 2023-12-12T11:41:31.779 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 3.0 M 2023-12-12T11:41:31.779 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-12T11:41:31.956 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-12-12T11:41:32.147 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-fuse-2:17.2.7-123.gbef78a51.el8.x86_64 2/2 2023-12-12T11:41:32.597 INFO:teuthology.orchestra.run.smithi063.stdout:(1/2): ceph-fuse-17.2.7-123.gbef78a51.el8.x86_6 1.3 MB/s | 875 kB 00:00 2023-12-12T11:41:32.624 INFO:teuthology.orchestra.run.smithi063.stdout:(2/2): fuse-2.9.7-17.el8.x86_64.rpm 126 kB/s | 83 kB 00:00 2023-12-12T11:41:32.624 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:41:32.625 INFO:teuthology.orchestra.run.smithi063.stdout:Total 1.1 MB/s | 958 kB 00:00 2023-12-12T11:41:32.653 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-12T11:41:32.681 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-12T11:41:32.681 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-12T11:41:32.743 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-fuse-2:17.2.7-123.gbef78a51.el8.x86_64 2/2 2023-12-12T11:41:32.743 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-fuse-2:17.2.7-123.gbef78a51.el8.x86_64 1/2 2023-12-12T11:41:32.795 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-12T11:41:32.799 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-12T11:41:33.010 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-12T11:41:33.281 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-12-12T11:41:33.456 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-12-12T11:41:33.456 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:41:33.456 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-12T11:41:33.456 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-fuse-2:17.2.7-123.gbef78a51.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-12-12T11:41:33.456 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:41:33.456 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-12T11:41:33.468 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-fuse-2:17.2.7-123.gbef78a51.el8.x86_64 2/2 2023-12-12T11:41:33.689 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install librados-devel 2023-12-12T11:41:34.100 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-fuse-2:17.2.7-123.gbef78a51.el8.x86_64 2/2 2023-12-12T11:41:34.100 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-fuse-2:17.2.7-123.gbef78a51.el8.x86_64 1/2 2023-12-12T11:41:34.782 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:02:31 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:41:34.838 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-12-12T11:41:34.838 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:41:34.839 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-12T11:41:34.839 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-fuse-2:17.2.7-123.gbef78a51.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-12-12T11:41:34.839 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:41:34.839 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-12T11:41:35.093 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install librados-devel 2023-12-12T11:41:36.214 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:02:33 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:41:36.541 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-12T11:41:36.542 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:41:36.542 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repo Size 2023-12-12T11:41:36.542 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:41:36.542 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-12T11:41:36.542 INFO:teuthology.orchestra.run.smithi093.stdout: librados-devel x86_64 2:17.2.7-123.gbef78a51.el8 ceph 130 k 2023-12-12T11:41:36.542 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:41:36.542 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-12T11:41:36.542 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:41:36.542 INFO:teuthology.orchestra.run.smithi093.stdout:Install 1 Package 2023-12-12T11:41:36.543 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:41:36.543 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 130 k 2023-12-12T11:41:36.543 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 464 k 2023-12-12T11:41:36.543 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-12T11:41:37.202 INFO:teuthology.orchestra.run.smithi093.stdout:librados-devel-17.2.7-123.gbef78a51.el8.x86_64. 197 kB/s | 130 kB 00:00 2023-12-12T11:41:37.202 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:41:37.202 INFO:teuthology.orchestra.run.smithi093.stdout:Total 197 kB/s | 130 kB 00:00 2023-12-12T11:41:37.202 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-12T11:41:37.210 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-12T11:41:37.211 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-12T11:41:37.270 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-12T11:41:37.273 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-12T11:41:37.409 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-12T11:41:37.621 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : librados-devel-2:17.2.7-123.gbef78a51.el8.x86_64 1/1 2023-12-12T11:41:38.007 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librados-devel-2:17.2.7-123.gbef78a51.el8.x86_64 1/1 2023-12-12T11:41:38.171 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-12T11:41:38.171 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:41:38.172 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repo Size 2023-12-12T11:41:38.172 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:41:38.172 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-12T11:41:38.172 INFO:teuthology.orchestra.run.smithi063.stdout: librados-devel x86_64 2:17.2.7-123.gbef78a51.el8 ceph 130 k 2023-12-12T11:41:38.172 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:41:38.172 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-12T11:41:38.172 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:41:38.172 INFO:teuthology.orchestra.run.smithi063.stdout:Install 1 Package 2023-12-12T11:41:38.172 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:41:38.173 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 130 k 2023-12-12T11:41:38.173 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 464 k 2023-12-12T11:41:38.173 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-12T11:41:38.439 INFO:teuthology.orchestra.run.smithi063.stdout:librados-devel-17.2.7-123.gbef78a51.el8.x86_64. 488 kB/s | 130 kB 00:00 2023-12-12T11:41:38.440 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:41:38.440 INFO:teuthology.orchestra.run.smithi063.stdout:Total 486 kB/s | 130 kB 00:00 2023-12-12T11:41:38.440 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-12T11:41:38.448 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-12T11:41:38.449 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-12T11:41:38.509 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-12T11:41:38.513 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-12T11:41:38.651 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-12T11:41:38.736 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librados-devel-2:17.2.7-123.gbef78a51.el8.x86_64 1/1 2023-12-12T11:41:38.736 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:41:38.736 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-12T11:41:38.736 INFO:teuthology.orchestra.run.smithi093.stdout: librados-devel-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:41:38.737 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:41:38.737 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-12T11:41:38.874 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librados-devel-2:17.2.7-123.gbef78a51.el8.x86_64 1/1 2023-12-12T11:41:38.955 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install libcephfs2 2023-12-12T11:41:39.267 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados-devel-2:17.2.7-123.gbef78a51.el8.x86_64 1/1 2023-12-12T11:41:39.999 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados-devel-2:17.2.7-123.gbef78a51.el8.x86_64 1/1 2023-12-12T11:41:39.999 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:41:39.999 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-12T11:41:39.999 INFO:teuthology.orchestra.run.smithi063.stdout: librados-devel-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:41:39.999 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:41:40.000 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-12T11:41:40.033 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:02:37 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:41:40.234 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install libcephfs2 2023-12-12T11:41:41.357 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:02:38 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:41:41.548 INFO:teuthology.orchestra.run.smithi093.stdout:Package libcephfs2-2:17.2.7-123.gbef78a51.el8.x86_64 is already installed. 2023-12-12T11:41:41.792 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-12T11:41:41.793 INFO:teuthology.orchestra.run.smithi093.stdout:Nothing to do. 2023-12-12T11:41:41.793 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-12T11:41:41.910 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install libcephfs-devel 2023-12-12T11:41:42.984 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:02:39 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:41:43.160 INFO:teuthology.orchestra.run.smithi063.stdout:Package libcephfs2-2:17.2.7-123.gbef78a51.el8.x86_64 is already installed. 2023-12-12T11:41:43.422 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-12T11:41:43.424 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2023-12-12T11:41:43.424 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-12T11:41:43.561 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install libcephfs-devel 2023-12-12T11:41:44.693 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:02:41 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:41:44.732 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-12T11:41:44.732 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:41:44.732 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repo Size 2023-12-12T11:41:44.733 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:41:44.733 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-12T11:41:44.733 INFO:teuthology.orchestra.run.smithi093.stdout: libcephfs-devel x86_64 2:17.2.7-123.gbef78a51.el8 ceph 25 k 2023-12-12T11:41:44.733 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:41:44.733 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-12T11:41:44.733 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:41:44.733 INFO:teuthology.orchestra.run.smithi093.stdout:Install 1 Package 2023-12-12T11:41:44.733 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:41:44.734 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 25 k 2023-12-12T11:41:44.734 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 109 k 2023-12-12T11:41:44.734 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-12T11:41:44.962 INFO:teuthology.orchestra.run.smithi093.stdout:libcephfs-devel-17.2.7-123.gbef78a51.el8.x86_64 109 kB/s | 25 kB 00:00 2023-12-12T11:41:44.963 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:41:44.963 INFO:teuthology.orchestra.run.smithi093.stdout:Total 108 kB/s | 25 kB 00:00 2023-12-12T11:41:44.964 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-12T11:41:44.969 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-12T11:41:44.969 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-12T11:41:44.973 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-12T11:41:44.976 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-12T11:41:45.035 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-12T11:41:45.228 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libcephfs-devel-2:17.2.7-123.gbef78a51.el8.x86_64 1/1 2023-12-12T11:41:45.525 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-123.gbef78a51.el8.x86_64 1/1 2023-12-12T11:41:46.191 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libcephfs-devel-2:17.2.7-123.gbef78a51.el8.x86_64 1/1 2023-12-12T11:41:46.192 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:41:46.192 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-12T11:41:46.192 INFO:teuthology.orchestra.run.smithi093.stdout: libcephfs-devel-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:41:46.192 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:41:46.192 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-12T11:41:46.349 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install librados2 2023-12-12T11:41:46.606 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-12T11:41:46.606 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:41:46.606 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repo Size 2023-12-12T11:41:46.606 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:41:46.606 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-12T11:41:46.607 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs-devel x86_64 2:17.2.7-123.gbef78a51.el8 ceph 25 k 2023-12-12T11:41:46.607 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:41:46.607 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-12T11:41:46.607 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:41:46.607 INFO:teuthology.orchestra.run.smithi063.stdout:Install 1 Package 2023-12-12T11:41:46.607 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:41:46.607 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 25 k 2023-12-12T11:41:46.607 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 109 k 2023-12-12T11:41:46.608 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-12T11:41:46.758 INFO:teuthology.orchestra.run.smithi063.stdout:libcephfs-devel-17.2.7-123.gbef78a51.el8.x86_64 166 kB/s | 25 kB 00:00 2023-12-12T11:41:46.759 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:41:46.759 INFO:teuthology.orchestra.run.smithi063.stdout:Total 164 kB/s | 25 kB 00:00 2023-12-12T11:41:46.759 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-12T11:41:46.764 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-12T11:41:46.764 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-12T11:41:46.768 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-12T11:41:46.772 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-12T11:41:46.830 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-12T11:41:47.006 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephfs-devel-2:17.2.7-123.gbef78a51.el8.x86_64 1/1 2023-12-12T11:41:47.323 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-123.gbef78a51.el8.x86_64 1/1 2023-12-12T11:41:47.424 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:02:44 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:41:48.013 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephfs-devel-2:17.2.7-123.gbef78a51.el8.x86_64 1/1 2023-12-12T11:41:48.013 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:41:48.013 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-12T11:41:48.013 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs-devel-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:41:48.013 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:41:48.013 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-12T11:41:48.184 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install librados2 2023-12-12T11:41:48.910 INFO:teuthology.orchestra.run.smithi093.stdout:Package librados2-2:17.2.7-123.gbef78a51.el8.x86_64 is already installed. 2023-12-12T11:41:49.154 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-12T11:41:49.155 INFO:teuthology.orchestra.run.smithi093.stdout:Nothing to do. 2023-12-12T11:41:49.155 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-12T11:41:49.276 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install librbd1 2023-12-12T11:41:49.306 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:02:46 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:41:50.348 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:02:47 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:41:50.935 INFO:teuthology.orchestra.run.smithi063.stdout:Package librados2-2:17.2.7-123.gbef78a51.el8.x86_64 is already installed. 2023-12-12T11:41:51.193 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-12T11:41:51.195 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2023-12-12T11:41:51.195 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-12T11:41:51.331 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install librbd1 2023-12-12T11:41:51.878 INFO:teuthology.orchestra.run.smithi093.stdout:Package librbd1-2:17.2.7-123.gbef78a51.el8.x86_64 is already installed. 2023-12-12T11:41:52.122 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-12T11:41:52.123 INFO:teuthology.orchestra.run.smithi093.stdout:Nothing to do. 2023-12-12T11:41:52.124 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-12T11:41:52.242 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install python3-rados 2023-12-12T11:41:52.451 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:02:49 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:41:53.310 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:02:50 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:41:54.301 INFO:teuthology.orchestra.run.smithi063.stdout:Package librbd1-2:17.2.7-123.gbef78a51.el8.x86_64 is already installed. 2023-12-12T11:41:54.560 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-12T11:41:54.562 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2023-12-12T11:41:54.562 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-12T11:41:54.704 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install python3-rados 2023-12-12T11:41:54.824 INFO:teuthology.orchestra.run.smithi093.stdout:Package python3-rados-2:17.2.7-123.gbef78a51.el8.x86_64 is already installed. 2023-12-12T11:41:55.068 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-12T11:41:55.070 INFO:teuthology.orchestra.run.smithi093.stdout:Nothing to do. 2023-12-12T11:41:55.070 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-12T11:41:55.190 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install python3-rgw 2023-12-12T11:41:55.822 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:02:52 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:41:56.269 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:02:53 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:41:57.442 INFO:teuthology.orchestra.run.smithi063.stdout:Package python3-rados-2:17.2.7-123.gbef78a51.el8.x86_64 is already installed. 2023-12-12T11:41:57.705 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-12T11:41:57.706 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2023-12-12T11:41:57.706 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-12T11:41:57.794 INFO:teuthology.orchestra.run.smithi093.stdout:Package python3-rgw-2:17.2.7-123.gbef78a51.el8.x86_64 is already installed. 2023-12-12T11:41:57.840 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install python3-rgw 2023-12-12T11:41:58.036 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-12T11:41:58.038 INFO:teuthology.orchestra.run.smithi093.stdout:Nothing to do. 2023-12-12T11:41:58.038 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-12T11:41:58.155 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install python3-cephfs 2023-12-12T11:41:58.962 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:02:55 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:41:59.211 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:02:56 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:42:00.633 INFO:teuthology.orchestra.run.smithi063.stdout:Package python3-rgw-2:17.2.7-123.gbef78a51.el8.x86_64 is already installed. 2023-12-12T11:42:00.728 INFO:teuthology.orchestra.run.smithi093.stdout:Package python3-cephfs-2:17.2.7-123.gbef78a51.el8.x86_64 is already installed. 2023-12-12T11:42:00.891 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-12T11:42:00.893 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2023-12-12T11:42:00.893 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-12T11:42:00.970 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-12T11:42:00.971 INFO:teuthology.orchestra.run.smithi093.stdout:Nothing to do. 2023-12-12T11:42:00.971 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-12T11:42:01.042 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install python3-cephfs 2023-12-12T11:42:01.091 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install python3-rbd 2023-12-12T11:42:02.154 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:02:59 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:42:02.161 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:02:59 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:42:03.685 INFO:teuthology.orchestra.run.smithi093.stdout:Package python3-rbd-2:17.2.7-123.gbef78a51.el8.x86_64 is already installed. 2023-12-12T11:42:03.786 INFO:teuthology.orchestra.run.smithi063.stdout:Package python3-cephfs-2:17.2.7-123.gbef78a51.el8.x86_64 is already installed. 2023-12-12T11:42:03.930 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-12T11:42:03.931 INFO:teuthology.orchestra.run.smithi093.stdout:Nothing to do. 2023-12-12T11:42:03.931 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-12T11:42:04.044 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-12T11:42:04.045 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2023-12-12T11:42:04.046 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-12T11:42:04.048 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install rbd-fuse 2023-12-12T11:42:04.179 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install python3-rbd 2023-12-12T11:42:05.122 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:03:02 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:42:05.298 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:03:02 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:42:06.868 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-12T11:42:06.869 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:42:06.869 INFO:teuthology.orchestra.run.smithi093.stdout: Package Architecture Version Repository Size 2023-12-12T11:42:06.869 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:42:06.869 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-12T11:42:06.869 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-fuse x86_64 2:17.2.7-123.gbef78a51.el8 ceph 90 k 2023-12-12T11:42:06.869 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:42:06.869 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-12T11:42:06.869 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:42:06.869 INFO:teuthology.orchestra.run.smithi093.stdout:Install 1 Package 2023-12-12T11:42:06.869 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:42:06.870 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 90 k 2023-12-12T11:42:06.870 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 264 k 2023-12-12T11:42:06.870 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-12T11:42:06.927 INFO:teuthology.orchestra.run.smithi063.stdout:Package python3-rbd-2:17.2.7-123.gbef78a51.el8.x86_64 is already installed. 2023-12-12T11:42:07.188 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-12T11:42:07.190 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2023-12-12T11:42:07.190 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-12T11:42:07.321 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install rbd-fuse 2023-12-12T11:42:07.560 INFO:teuthology.orchestra.run.smithi093.stdout:rbd-fuse-17.2.7-123.gbef78a51.el8.x86_64.rpm 131 kB/s | 90 kB 00:00 2023-12-12T11:42:07.561 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:42:07.561 INFO:teuthology.orchestra.run.smithi093.stdout:Total 131 kB/s | 90 kB 00:00 2023-12-12T11:42:07.561 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-12T11:42:07.575 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-12T11:42:07.575 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-12T11:42:07.636 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-12T11:42:07.639 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-12T11:42:07.764 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-12T11:42:07.941 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : rbd-fuse-2:17.2.7-123.gbef78a51.el8.x86_64 1/1 2023-12-12T11:42:08.325 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: rbd-fuse-2:17.2.7-123.gbef78a51.el8.x86_64 1/1 2023-12-12T11:42:08.453 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:03:05 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:42:09.058 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : rbd-fuse-2:17.2.7-123.gbef78a51.el8.x86_64 1/1 2023-12-12T11:42:09.058 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:42:09.058 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-12T11:42:09.058 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-fuse-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:42:09.058 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:42:09.058 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-12T11:42:09.281 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install rbd-mirror 2023-12-12T11:42:10.338 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-12T11:42:10.338 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:42:10.339 INFO:teuthology.orchestra.run.smithi063.stdout: Package Architecture Version Repository Size 2023-12-12T11:42:10.339 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:42:10.339 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-12T11:42:10.339 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-fuse x86_64 2:17.2.7-123.gbef78a51.el8 ceph 90 k 2023-12-12T11:42:10.339 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:42:10.339 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-12T11:42:10.339 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:42:10.339 INFO:teuthology.orchestra.run.smithi063.stdout:Install 1 Package 2023-12-12T11:42:10.339 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:42:10.340 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 90 k 2023-12-12T11:42:10.340 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 264 k 2023-12-12T11:42:10.340 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-12T11:42:10.356 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:03:07 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:42:10.923 INFO:teuthology.orchestra.run.smithi063.stdout:rbd-fuse-17.2.7-123.gbef78a51.el8.x86_64.rpm 155 kB/s | 90 kB 00:00 2023-12-12T11:42:10.923 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:42:10.923 INFO:teuthology.orchestra.run.smithi063.stdout:Total 155 kB/s | 90 kB 00:00 2023-12-12T11:42:10.924 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-12T11:42:10.938 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-12T11:42:10.938 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-12T11:42:11.000 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-12T11:42:11.003 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-12T11:42:11.140 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-12T11:42:11.336 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-fuse-2:17.2.7-123.gbef78a51.el8.x86_64 1/1 2023-12-12T11:42:11.723 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: rbd-fuse-2:17.2.7-123.gbef78a51.el8.x86_64 1/1 2023-12-12T11:42:12.107 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-12T11:42:12.107 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:42:12.108 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repo Size 2023-12-12T11:42:12.108 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:42:12.108 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-12T11:42:12.108 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-mirror x86_64 2:17.2.7-123.gbef78a51.el8 ceph 3.5 M 2023-12-12T11:42:12.108 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:42:12.108 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-12T11:42:12.108 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:42:12.108 INFO:teuthology.orchestra.run.smithi093.stdout:Install 1 Package 2023-12-12T11:42:12.108 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:42:12.109 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 3.5 M 2023-12-12T11:42:12.109 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 16 M 2023-12-12T11:42:12.109 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-12T11:42:12.469 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-fuse-2:17.2.7-123.gbef78a51.el8.x86_64 1/1 2023-12-12T11:42:12.469 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:42:12.469 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-12T11:42:12.469 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-fuse-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:42:12.469 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:42:12.470 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-12T11:42:12.700 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install rbd-mirror 2023-12-12T11:42:12.762 INFO:teuthology.orchestra.run.smithi093.stdout:rbd-mirror-17.2.7-123.gbef78a51.el8.x86_64.rpm 5.3 MB/s | 3.5 MB 00:00 2023-12-12T11:42:12.762 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:42:12.763 INFO:teuthology.orchestra.run.smithi093.stdout:Total 5.3 MB/s | 3.5 MB 00:00 2023-12-12T11:42:12.763 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-12T11:42:12.777 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-12T11:42:12.778 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-12T11:42:12.846 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-12T11:42:12.850 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-12T11:42:13.334 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-12T11:42:13.500 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : rbd-mirror-2:17.2.7-123.gbef78a51.el8.x86_64 1/1 2023-12-12T11:42:13.821 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:03:10 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:42:14.165 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: rbd-mirror-2:17.2.7-123.gbef78a51.el8.x86_64 1/1 2023-12-12T11:42:14.967 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : rbd-mirror-2:17.2.7-123.gbef78a51.el8.x86_64 1/1 2023-12-12T11:42:14.968 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:42:14.968 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-12T11:42:14.968 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-mirror-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:42:14.968 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:42:14.968 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-12T11:42:15.180 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install rbd-nbd 2023-12-12T11:42:15.885 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-12T11:42:15.885 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:42:15.886 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repo Size 2023-12-12T11:42:15.886 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:42:15.886 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-12T11:42:15.886 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-mirror x86_64 2:17.2.7-123.gbef78a51.el8 ceph 3.5 M 2023-12-12T11:42:15.886 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:42:15.886 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-12T11:42:15.886 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:42:15.886 INFO:teuthology.orchestra.run.smithi063.stdout:Install 1 Package 2023-12-12T11:42:15.886 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:42:15.887 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 3.5 M 2023-12-12T11:42:15.887 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 16 M 2023-12-12T11:42:15.887 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-12T11:42:16.257 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:03:13 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:42:16.426 INFO:teuthology.orchestra.run.smithi063.stdout:rbd-mirror-17.2.7-123.gbef78a51.el8.x86_64.rpm 6.4 MB/s | 3.5 MB 00:00 2023-12-12T11:42:16.427 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:42:16.427 INFO:teuthology.orchestra.run.smithi063.stdout:Total 6.4 MB/s | 3.5 MB 00:00 2023-12-12T11:42:16.427 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-12T11:42:16.447 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-12T11:42:16.447 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-12T11:42:16.517 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-12T11:42:16.521 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-12T11:42:17.062 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-12T11:42:17.229 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-mirror-2:17.2.7-123.gbef78a51.el8.x86_64 1/1 2023-12-12T11:42:17.915 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: rbd-mirror-2:17.2.7-123.gbef78a51.el8.x86_64 1/1 2023-12-12T11:42:18.009 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-12T11:42:18.010 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:42:18.010 INFO:teuthology.orchestra.run.smithi093.stdout: Package Architecture Version Repository Size 2023-12-12T11:42:18.010 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:42:18.010 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-12T11:42:18.010 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-nbd x86_64 2:17.2.7-123.gbef78a51.el8 ceph 173 k 2023-12-12T11:42:18.010 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:42:18.011 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-12T11:42:18.011 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-12T11:42:18.011 INFO:teuthology.orchestra.run.smithi093.stdout:Install 1 Package 2023-12-12T11:42:18.011 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:42:18.011 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 173 k 2023-12-12T11:42:18.011 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 552 k 2023-12-12T11:42:18.011 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-12T11:42:18.565 INFO:teuthology.orchestra.run.smithi093.stdout:rbd-nbd-17.2.7-123.gbef78a51.el8.x86_64.rpm 312 kB/s | 173 kB 00:00 2023-12-12T11:42:18.565 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:42:18.565 INFO:teuthology.orchestra.run.smithi093.stdout:Total 312 kB/s | 173 kB 00:00 2023-12-12T11:42:18.566 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-12T11:42:18.579 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-12T11:42:18.579 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-12T11:42:18.637 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-12T11:42:18.640 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-12T11:42:18.696 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-mirror-2:17.2.7-123.gbef78a51.el8.x86_64 1/1 2023-12-12T11:42:18.696 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:42:18.697 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-12T11:42:18.697 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-mirror-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:42:18.697 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:42:18.697 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-12T11:42:18.771 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-12T11:42:18.911 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install rbd-nbd 2023-12-12T11:42:18.981 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : rbd-nbd-2:17.2.7-123.gbef78a51.el8.x86_64 1/1 2023-12-12T11:42:19.357 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: rbd-nbd-2:17.2.7-123.gbef78a51.el8.x86_64 1/1 2023-12-12T11:42:20.036 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:03:17 ago on Tue 12 Dec 2023 11:39:03 AM UTC. 2023-12-12T11:42:20.091 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : rbd-nbd-2:17.2.7-123.gbef78a51.el8.x86_64 1/1 2023-12-12T11:42:20.091 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:42:20.091 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-12T11:42:20.091 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-nbd-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:42:20.092 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:42:20.092 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-12T11:42:20.359 DEBUG:teuthology.parallel:result is None 2023-12-12T11:42:21.938 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-12T11:42:21.939 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:42:21.939 INFO:teuthology.orchestra.run.smithi063.stdout: Package Architecture Version Repository Size 2023-12-12T11:42:21.939 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:42:21.939 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-12T11:42:21.939 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-nbd x86_64 2:17.2.7-123.gbef78a51.el8 ceph 173 k 2023-12-12T11:42:21.939 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:42:21.939 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-12T11:42:21.939 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-12T11:42:21.939 INFO:teuthology.orchestra.run.smithi063.stdout:Install 1 Package 2023-12-12T11:42:21.939 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:42:21.940 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 173 k 2023-12-12T11:42:21.940 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 552 k 2023-12-12T11:42:21.940 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-12T11:42:22.153 INFO:teuthology.orchestra.run.smithi063.stdout:rbd-nbd-17.2.7-123.gbef78a51.el8.x86_64.rpm 814 kB/s | 173 kB 00:00 2023-12-12T11:42:22.153 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:42:22.154 INFO:teuthology.orchestra.run.smithi063.stdout:Total 809 kB/s | 173 kB 00:00 2023-12-12T11:42:22.154 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-12T11:42:22.168 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-12T11:42:22.168 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-12T11:42:22.228 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-12T11:42:22.232 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-12T11:42:22.355 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-12T11:42:22.578 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-nbd-2:17.2.7-123.gbef78a51.el8.x86_64 1/1 2023-12-12T11:42:22.957 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: rbd-nbd-2:17.2.7-123.gbef78a51.el8.x86_64 1/1 2023-12-12T11:42:23.757 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-nbd-2:17.2.7-123.gbef78a51.el8.x86_64 1/1 2023-12-12T11:42:23.757 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:42:23.757 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-12T11:42:23.757 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-nbd-2:17.2.7-123.gbef78a51.el8.x86_64 2023-12-12T11:42:23.757 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:42:23.757 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-12T11:42:24.007 DEBUG:teuthology.parallel:result is None 2023-12-12T11:42:24.007 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-12T11:42:24.007 INFO:teuthology.packaging:ref: None 2023-12-12T11:42:24.007 INFO:teuthology.packaging:tag: None 2023-12-12T11:42:24.007 INFO:teuthology.packaging:branch: quincy 2023-12-12T11:42:24.008 INFO:teuthology.packaging:sha1: f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 2023-12-12T11:42:24.008 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-12T11:42:24.306 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-12T11:42:24.361 INFO:teuthology.orchestra.run.smithi063.stdout:17.2.7-123.gbef78a51.el8 2023-12-12T11:42:24.362 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-123.gbef78a51.el8 2023-12-12T11:42:24.362 INFO:teuthology.task.install:The correct ceph version 17.2.7-123.gbef78a51 is installed. 2023-12-12T11:42:24.363 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-12T11:42:24.363 INFO:teuthology.packaging:ref: None 2023-12-12T11:42:24.364 INFO:teuthology.packaging:tag: None 2023-12-12T11:42:24.364 INFO:teuthology.packaging:branch: quincy 2023-12-12T11:42:24.364 INFO:teuthology.packaging:sha1: f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 2023-12-12T11:42:24.364 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-12T11:42:24.568 DEBUG:teuthology.orchestra.run.smithi093:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-12T11:42:24.631 INFO:teuthology.orchestra.run.smithi093.stdout:17.2.7-123.gbef78a51.el8 2023-12-12T11:42:24.632 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-123.gbef78a51.el8 2023-12-12T11:42:24.632 INFO:teuthology.task.install:The correct ceph version 17.2.7-123.gbef78a51 is installed. 2023-12-12T11:42:24.634 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-12T11:42:24.634 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-12T11:42:24.634 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-12T11:42:24.706 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-12T11:42:24.706 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-12T11:42:24.783 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-12T11:42:24.783 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-12T11:42:24.783 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/daemon-helper 2023-12-12T11:42:24.853 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-12T11:42:24.964 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-12T11:42:24.964 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/usr/bin/daemon-helper 2023-12-12T11:42:25.037 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-12T11:42:25.146 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-12T11:42:25.146 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-12T11:42:25.147 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-12T11:42:25.217 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-12T11:42:25.327 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-12T11:42:25.328 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-12T11:42:25.396 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-12T11:42:25.507 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-12T11:42:25.507 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-12T11:42:25.508 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/stdin-killer 2023-12-12T11:42:25.578 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-12T11:42:25.689 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-12T11:42:25.689 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/usr/bin/stdin-killer 2023-12-12T11:42:25.759 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-12T11:42:25.869 INFO:teuthology.run_tasks:Running task print... 2023-12-12T11:42:26.129 INFO:teuthology.task.print:**** done install task... 2023-12-12T11:42:26.129 INFO:teuthology.run_tasks:Running task cephadm... 2023-12-12T11:42:26.631 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9'} 2023-12-12T11:42:26.631 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2023-12-12T11:42:26.632 INFO:tasks.cephadm:Cluster fsid is 85e33c70-98e3-11ee-95a3-87774f69a715 2023-12-12T11:42:26.632 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-12-12T11:42:26.632 INFO:tasks.cephadm:No mon roles; fabricating mons 2023-12-12T11:42:26.632 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi063': '172.21.15.63', 'mon.smithi093': '172.21.15.93'} 2023-12-12T11:42:26.632 INFO:tasks.cephadm:Normalizing hostnames... 2023-12-12T11:42:26.633 DEBUG:teuthology.orchestra.run.smithi063:> sudo hostname $(hostname -s) 2023-12-12T11:42:26.711 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname $(hostname -s) 2023-12-12T11:42:26.785 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2023-12-12T11:42:26.786 DEBUG:teuthology.orchestra.run.smithi063:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-12T11:42:27.044 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-rw-r--. 1 ubuntu ubuntu 367151 Dec 12 11:42 /home/ubuntu/cephtest/cephadm 2023-12-12T11:42:27.044 DEBUG:teuthology.orchestra.run.smithi093:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-12T11:42:27.337 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-rw-r--. 1 ubuntu ubuntu 367151 Dec 12 11:42 /home/ubuntu/cephtest/cephadm 2023-12-12T11:42:27.337 DEBUG:teuthology.orchestra.run.smithi063:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-12T11:42:27.389 DEBUG:teuthology.orchestra.run.smithi093:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-12T11:42:27.447 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2023-12-12T11:42:27.447 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2023-12-12T11:42:27.452 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2023-12-12T11:42:28.711 INFO:teuthology.orchestra.run.smithi063.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-12T11:42:28.725 INFO:teuthology.orchestra.run.smithi093.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-12T11:42:56.274 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:42:56.274 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)", 2023-12-12T11:42:56.274 INFO:teuthology.orchestra.run.smithi063.stdout: "image_id": "ae61961939357480e653ac8e9de20b80f93fdab1f043ea2650f72f52836280af", 2023-12-12T11:42:56.274 INFO:teuthology.orchestra.run.smithi063.stdout: "repo_digests": [ 2023-12-12T11:42:56.274 INFO:teuthology.orchestra.run.smithi063.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:dcb8c2d1299dc9344a67035fe2bba5fccc39ace0b06906e0fb4070025c6cab8d" 2023-12-12T11:42:56.274 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2023-12-12T11:42:56.274 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:42:59.100 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-12-12T11:42:59.100 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_version": "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)", 2023-12-12T11:42:59.100 INFO:teuthology.orchestra.run.smithi093.stdout: "image_id": "ae61961939357480e653ac8e9de20b80f93fdab1f043ea2650f72f52836280af", 2023-12-12T11:42:59.100 INFO:teuthology.orchestra.run.smithi093.stdout: "repo_digests": [ 2023-12-12T11:42:59.100 INFO:teuthology.orchestra.run.smithi093.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:dcb8c2d1299dc9344a67035fe2bba5fccc39ace0b06906e0fb4070025c6cab8d" 2023-12-12T11:42:59.100 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-12-12T11:42:59.100 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-12-12T11:42:59.126 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph 2023-12-12T11:42:59.208 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /etc/ceph 2023-12-12T11:42:59.282 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 777 /etc/ceph 2023-12-12T11:42:59.356 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 777 /etc/ceph 2023-12-12T11:42:59.424 INFO:tasks.cephadm:Writing seed config... 2023-12-12T11:42:59.426 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2023-12-12T11:42:59.426 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2023-12-12T11:42:59.426 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2023-12-12T11:42:59.426 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2023-12-12T11:42:59.426 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2023-12-12T11:42:59.426 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-12-12T11:42:59.426 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-12-12T11:42:59.426 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2023-12-12T11:42:59.426 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2023-12-12T11:42:59.426 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-12-12T11:42:59.426 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-12-12T11:42:59.426 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2023-12-12T11:42:59.427 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-12-12T11:42:59.427 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-12-12T11:42:59.427 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-12-12T11:42:59.427 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-12-12T11:42:59.427 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-12-12T11:42:59.427 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-12-12T11:42:59.427 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-12-12T11:42:59.427 INFO:tasks.cephadm: override: [client] debug client = 20 2023-12-12T11:42:59.427 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-12-12T11:42:59.427 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-12-12T11:42:59.427 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-12-12T11:42:59.427 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2023-12-12T11:42:59.427 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-12-12T11:42:59.427 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-12-12T11:42:59.427 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-12-12T11:42:59.428 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-12-12T11:42:59.428 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-12-12T11:42:59.428 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-12-12T11:42:59.428 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-12-12T11:42:59.428 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-12-12T11:42:59.428 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-12-12T11:42:59.428 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-12-12T11:42:59.428 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-12-12T11:42:59.428 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-12-12T11:42:59.428 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-12-12T11:42:59.428 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-12-12T11:42:59.428 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-12-12T11:42:59.428 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-12-12T11:42:59.429 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-12T11:42:59.429 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-12-12T11:42:59.476 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 85e33c70-98e3-11ee-95a3-87774f69a715 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-12-12T11:42:59.477 DEBUG:teuthology.orchestra.run.smithi063:mon.smithi063> sudo journalctl -f -n 0 -u ceph-85e33c70-98e3-11ee-95a3-87774f69a715@mon.smithi063.service 2023-12-12T11:42:59.521 INFO:tasks.cephadm:Bootstrapping... 2023-12-12T11:42:59.521 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.63 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-12-12T11:42:59.591 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:-- Logs begin at Tue 2023-12-12 11:27:09 UTC. -- 2023-12-12T11:42:59.831 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-12T11:42:59.831 INFO:teuthology.orchestra.run.smithi063.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', '85e33c70-98e3-11ee-95a3-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.63', '--skip-admin-label'] 2023-12-12T11:42:59.878 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stdout 4.6.1 2023-12-12T11:42:59.879 INFO:teuthology.orchestra.run.smithi063.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-12-12T11:42:59.879 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying podman|docker is present... 2023-12-12T11:42:59.924 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stdout 4.6.1 2023-12-12T11:42:59.925 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying lvm2 is present... 2023-12-12T11:42:59.925 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying time synchronization is in place... 2023-12-12T11:42:59.939 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-12T11:42:59.940 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-12T11:42:59.953 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-12T11:42:59.953 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout inactive 2023-12-12T11:42:59.966 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout enabled 2023-12-12T11:42:59.980 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout active 2023-12-12T11:42:59.980 INFO:teuthology.orchestra.run.smithi063.stdout:Unit chronyd.service is enabled and running 2023-12-12T11:42:59.980 INFO:teuthology.orchestra.run.smithi063.stdout:Repeating the final host check... 2023-12-12T11:43:00.025 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stdout 4.6.1 2023-12-12T11:43:00.025 INFO:teuthology.orchestra.run.smithi063.stdout:podman (/bin/podman) version 4.6.1 is present 2023-12-12T11:43:00.025 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl is present 2023-12-12T11:43:00.025 INFO:teuthology.orchestra.run.smithi063.stdout:lvcreate is present 2023-12-12T11:43:00.039 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-12T11:43:00.039 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-12T11:43:00.052 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-12T11:43:00.052 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout inactive 2023-12-12T11:43:00.066 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout enabled 2023-12-12T11:43:00.080 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout active 2023-12-12T11:43:00.080 INFO:teuthology.orchestra.run.smithi063.stdout:Unit chronyd.service is enabled and running 2023-12-12T11:43:00.080 INFO:teuthology.orchestra.run.smithi063.stdout:Host looks OK 2023-12-12T11:43:00.080 INFO:teuthology.orchestra.run.smithi063.stdout:Cluster fsid: 85e33c70-98e3-11ee-95a3-87774f69a715 2023-12-12T11:43:00.080 INFO:teuthology.orchestra.run.smithi063.stdout:Acquiring lock 140089889761768 on /run/cephadm/85e33c70-98e3-11ee-95a3-87774f69a715.lock 2023-12-12T11:43:00.081 INFO:teuthology.orchestra.run.smithi063.stdout:Lock 140089889761768 acquired on /run/cephadm/85e33c70-98e3-11ee-95a3-87774f69a715.lock 2023-12-12T11:43:00.081 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying IP 172.21.15.63 port 3300 ... 2023-12-12T11:43:00.081 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying IP 172.21.15.63 port 6789 ... 2023-12-12T11:43:00.081 INFO:teuthology.orchestra.run.smithi063.stdout:Base mon IP(s) is [172.21.15.63:3300, 172.21.15.63:6789], mon addrv is [v2:172.21.15.63:3300,v1:172.21.15.63:6789] 2023-12-12T11:43:00.090 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.63 metric 100 2023-12-12T11:43:00.090 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.63 metric 100 2023-12-12T11:43:00.098 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-12-12T11:43:00.098 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2023-12-12T11:43:00.098 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1796sec hoplimit 64 pref medium 2023-12-12T11:43:00.104 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-12-12T11:43:00.105 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-12-12T11:43:00.105 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-12T11:43:00.105 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2023-12-12T11:43:00.105 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2023-12-12T11:43:00.105 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-12T11:43:00.105 INFO:teuthology.orchestra.run.smithi063.stdout:Mon IP `172.21.15.63` is in CIDR network `172.21.0.0/20` 2023-12-12T11:43:00.105 INFO:teuthology.orchestra.run.smithi063.stdout:Mon IP `172.21.15.63` is in CIDR network `172.21.0.0/20` 2023-12-12T11:43:00.106 INFO:teuthology.orchestra.run.smithi063.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-12-12T11:43:00.106 INFO:teuthology.orchestra.run.smithi063.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-12-12T11:43:00.107 INFO:teuthology.orchestra.run.smithi063.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-12T11:43:00.489 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stdout ae61961939357480e653ac8e9de20b80f93fdab1f043ea2650f72f52836280af 2023-12-12T11:43:00.489 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-12T11:43:00.489 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stderr Getting image source signatures 2023-12-12T11:43:00.489 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stderr Copying blob sha256:057a34c5241d48b3cd20731be5e70d3dd69b0d94822fcd4e9db2a38576fa562a 2023-12-12T11:43:00.489 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stderr Copying blob sha256:d3e436ac93e4b5a6d94c7ac8024df331e66e67275836276615dc044fd3cbf83a 2023-12-12T11:43:00.489 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stderr Copying config sha256:ae61961939357480e653ac8e9de20b80f93fdab1f043ea2650f72f52836280af 2023-12-12T11:43:00.489 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stderr Writing manifest to image destination 2023-12-12T11:43:01.164 INFO:teuthology.orchestra.run.smithi063.stdout:ceph: stdout ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable) 2023-12-12T11:43:01.164 INFO:teuthology.orchestra.run.smithi063.stdout:Ceph version: ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable) 2023-12-12T11:43:01.164 INFO:teuthology.orchestra.run.smithi063.stdout:Extracting ceph user uid/gid from container image... 2023-12-12T11:43:01.728 INFO:teuthology.orchestra.run.smithi063.stdout:stat: stdout 167 167 2023-12-12T11:43:01.729 INFO:teuthology.orchestra.run.smithi063.stdout:Creating initial keys... 2023-12-12T11:43:02.331 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph-authtool: stdout AQBGR3hl4fxlARAAGJ8Bay2bek/bL+ui+hj8ow== 2023-12-12T11:43:02.916 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph-authtool: stdout AQBGR3hlZUmnIxAABfadhBRJ8AnNzZ3kaM2LCw== 2023-12-12T11:43:03.503 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph-authtool: stdout AQBHR3hlGWTRCxAA6/UQqR1T2uuk3uXAmmTQaw== 2023-12-12T11:43:03.504 INFO:teuthology.orchestra.run.smithi063.stdout:Creating initial monmap... 2023-12-12T11:43:04.083 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-12T11:43:04.084 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2023-12-12T11:43:04.084 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 85e33c70-98e3-11ee-95a3-87774f69a715 2023-12-12T11:43:04.084 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-12T11:43:04.084 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool for smithi063 [v2:172.21.15.63:3300,v1:172.21.15.63:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-12T11:43:04.084 INFO:teuthology.orchestra.run.smithi063.stdout:setting min_mon_release = octopus 2023-12-12T11:43:04.084 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/monmaptool: set fsid to 85e33c70-98e3-11ee-95a3-87774f69a715 2023-12-12T11:43:04.084 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-12T11:43:04.084 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:43:04.084 INFO:teuthology.orchestra.run.smithi063.stdout:Creating mon... 2023-12-12T11:43:04.703 INFO:teuthology.orchestra.run.smithi063.stdout:create mon.smithi063 on 2023-12-12T11:43:04.917 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-12-12T11:43:05.110 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-12-12T11:43:05.328 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-85e33c70-98e3-11ee-95a3-87774f69a715.target → /etc/systemd/system/ceph-85e33c70-98e3-11ee-95a3-87774f69a715.target. 2023-12-12T11:43:05.329 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-85e33c70-98e3-11ee-95a3-87774f69a715.target → /etc/systemd/system/ceph-85e33c70-98e3-11ee-95a3-87774f69a715.target. 2023-12-12T11:43:05.655 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-85e33c70-98e3-11ee-95a3-87774f69a715@mon.smithi063 2023-12-12T11:43:05.655 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Failed to reset failed state of unit ceph-85e33c70-98e3-11ee-95a3-87774f69a715@mon.smithi063.service: Unit ceph-85e33c70-98e3-11ee-95a3-87774f69a715@mon.smithi063.service not loaded. 2023-12-12T11:43:05.882 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-85e33c70-98e3-11ee-95a3-87774f69a715.target.wants/ceph-85e33c70-98e3-11ee-95a3-87774f69a715@mon.smithi063.service → /etc/systemd/system/ceph-85e33c70-98e3-11ee-95a3-87774f69a715@.service. 2023-12-12T11:43:05.922 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:05 smithi063 systemd[1]: Starting Ceph mon.smithi063 for 85e33c70-98e3-11ee-95a3-87774f69a715... 2023-12-12T11:43:06.418 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-12T11:43:06.418 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout disabled 2023-12-12T11:43:06.439 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-12T11:43:06.439 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout inactive 2023-12-12T11:43:06.439 INFO:teuthology.orchestra.run.smithi063.stdout:firewalld.service is not enabled 2023-12-12T11:43:06.439 INFO:teuthology.orchestra.run.smithi063.stdout:Not possible to enable service . firewalld.service is not available 2023-12-12T11:43:06.439 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for mon to start... 2023-12-12T11:43:06.439 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for mon... 2023-12-12T11:43:06.680 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:06 smithi063 bash[106592]: da92c058a2220cef3386bd7ff16621ca16cf7b93459b69eba6feabb2654f4276 2023-12-12T11:43:06.680 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:06 smithi063 systemd[1]: Started Ceph mon.smithi063 for 85e33c70-98e3-11ee-95a3-87774f69a715. 2023-12-12T11:43:06.680 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:06 smithi063 ceph-mon[106631]: mkfs 85e33c70-98e3-11ee-95a3-87774f69a715 2023-12-12T11:43:06.681 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:06 smithi063 ceph-mon[106631]: mon.smithi063 is new leader, mons smithi063 in quorum (ranks 0) 2023-12-12T11:43:07.356 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout cluster: 2023-12-12T11:43:07.356 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout id: 85e33c70-98e3-11ee-95a3-87774f69a715 2023-12-12T11:43:07.357 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-12-12T11:43:07.357 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2023-12-12T11:43:07.357 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout services: 2023-12-12T11:43:07.357 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi063 (age 0.608594s) 2023-12-12T11:43:07.357 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-12-12T11:43:07.357 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-12-12T11:43:07.358 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2023-12-12T11:43:07.358 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout data: 2023-12-12T11:43:07.358 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-12-12T11:43:07.358 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-12-12T11:43:07.359 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-12-12T11:43:07.359 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout pgs: 2023-12-12T11:43:07.359 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2023-12-12T11:43:07.359 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.940+0000 7f0b55089700 1 Processor -- start 2023-12-12T11:43:07.359 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.941+0000 7f0b55089700 1 -- start start 2023-12-12T11:43:07.359 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.941+0000 7f0b55089700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b50077bb0 0x7f0b500760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:07.360 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.941+0000 7f0b55089700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b50077fc0 con 0x7f0b50077bb0 2023-12-12T11:43:07.360 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.942+0000 7f0b4ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b50077bb0 0x7f0b500760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:07.360 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.942+0000 7f0b4ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b50077bb0 0x7f0b500760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53672/0 (socket says 172.21.15.63:53672) 2023-12-12T11:43:07.360 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.942+0000 7f0b4ffff700 1 -- 172.21.15.63:0/1897490897 learned_addr learned my addr 172.21.15.63:0/1897490897 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:07.360 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.942+0000 7f0b4ffff700 1 -- 172.21.15.63:0/1897490897 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b50076600 con 0x7f0b50077bb0 2023-12-12T11:43:07.360 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.943+0000 7f0b4ffff700 1 --2- 172.21.15.63:0/1897490897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b50077bb0 0x7f0b500760c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0b400098e0 tx=0x7f0b40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee6273fd49fd918 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:07.361 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.943+0000 7f0b4effd700 1 -- 172.21.15.63:0/1897490897 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0b4000b860 con 0x7f0b50077bb0 2023-12-12T11:43:07.361 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.943+0000 7f0b4effd700 1 -- 172.21.15.63:0/1897490897 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4000b9c0 con 0x7f0b50077bb0 2023-12-12T11:43:07.361 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.943+0000 7f0b4effd700 1 -- 172.21.15.63:0/1897490897 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0b4000bc90 con 0x7f0b50077bb0 2023-12-12T11:43:07.361 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.944+0000 7f0b55089700 1 -- 172.21.15.63:0/1897490897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b50077bb0 msgr2=0x7f0b500760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:07.361 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.944+0000 7f0b55089700 1 --2- 172.21.15.63:0/1897490897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b50077bb0 0x7f0b500760c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0b400098e0 tx=0x7f0b40009250 comp rx=0 tx=0).stop 2023-12-12T11:43:07.362 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.944+0000 7f0b55089700 1 -- 172.21.15.63:0/1897490897 shutdown_connections 2023-12-12T11:43:07.362 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.944+0000 7f0b55089700 1 --2- 172.21.15.63:0/1897490897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b50077bb0 0x7f0b500760c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:07.362 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.944+0000 7f0b55089700 1 -- 172.21.15.63:0/1897490897 >> 172.21.15.63:0/1897490897 conn(0x7f0b500fd880 msgr2=0x7f0b500ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:07.362 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.944+0000 7f0b55089700 1 -- 172.21.15.63:0/1897490897 shutdown_connections 2023-12-12T11:43:07.363 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.944+0000 7f0b55089700 1 -- 172.21.15.63:0/1897490897 wait complete. 2023-12-12T11:43:07.363 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.945+0000 7f0b55089700 1 Processor -- start 2023-12-12T11:43:07.363 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.945+0000 7f0b55089700 1 -- start start 2023-12-12T11:43:07.363 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.945+0000 7f0b55089700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b50077bb0 0x7f0b50112a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:07.363 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.945+0000 7f0b55089700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b50112f40 con 0x7f0b50077bb0 2023-12-12T11:43:07.363 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.945+0000 7f0b4ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b50077bb0 0x7f0b50112a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:07.364 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.946+0000 7f0b4ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b50077bb0 0x7f0b50112a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53680/0 (socket says 172.21.15.63:53680) 2023-12-12T11:43:07.364 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.946+0000 7f0b4ffff700 1 -- 172.21.15.63:0/693662230 learned_addr learned my addr 172.21.15.63:0/693662230 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:07.364 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.946+0000 7f0b4ffff700 1 -- 172.21.15.63:0/693662230 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b400094f0 con 0x7f0b50077bb0 2023-12-12T11:43:07.364 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.946+0000 7f0b4ffff700 1 --2- 172.21.15.63:0/693662230 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b50077bb0 0x7f0b50112a00 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0b40009290 tx=0x7f0b40016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:07.364 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.946+0000 7f0b4cff9700 1 -- 172.21.15.63:0/693662230 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0b4001c5c0 con 0x7f0b50077bb0 2023-12-12T11:43:07.365 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.946+0000 7f0b4cff9700 1 -- 172.21.15.63:0/693662230 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4001c740 con 0x7f0b50077bb0 2023-12-12T11:43:07.365 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.946+0000 7f0b55089700 1 -- 172.21.15.63:0/693662230 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b50113140 con 0x7f0b50077bb0 2023-12-12T11:43:07.365 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.946+0000 7f0b4cff9700 1 -- 172.21.15.63:0/693662230 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0b4001ca50 con 0x7f0b50077bb0 2023-12-12T11:43:07.365 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.947+0000 7f0b55089700 1 -- 172.21.15.63:0/693662230 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b50113550 con 0x7f0b50077bb0 2023-12-12T11:43:07.365 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.947+0000 7f0b4cff9700 1 -- 172.21.15.63:0/693662230 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f0b4001a450 con 0x7f0b50077bb0 2023-12-12T11:43:07.365 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.947+0000 7f0b4cff9700 1 -- 172.21.15.63:0/693662230 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f0b4002e790 con 0x7f0b50077bb0 2023-12-12T11:43:07.365 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.948+0000 7f0b55089700 1 -- 172.21.15.63:0/693662230 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b5004bb80 con 0x7f0b50077bb0 2023-12-12T11:43:07.365 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:06.951+0000 7f0b4cff9700 1 -- 172.21.15.63:0/693662230 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f0b4001ce30 con 0x7f0b50077bb0 2023-12-12T11:43:07.365 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.027+0000 7f0b55089700 1 -- 172.21.15.63:0/693662230 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f0b5010bcb0 con 0x7f0b50077bb0 2023-12-12T11:43:07.365 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.027+0000 7f0b4cff9700 1 -- 172.21.15.63:0/693662230 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f0b4001a890 con 0x7f0b50077bb0 2023-12-12T11:43:07.365 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.028+0000 7f0b55089700 1 -- 172.21.15.63:0/693662230 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b50077bb0 msgr2=0x7f0b50112a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:07.365 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.028+0000 7f0b55089700 1 --2- 172.21.15.63:0/693662230 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b50077bb0 0x7f0b50112a00 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0b40009290 tx=0x7f0b40016000 comp rx=0 tx=0).stop 2023-12-12T11:43:07.365 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.028+0000 7f0b55089700 1 -- 172.21.15.63:0/693662230 shutdown_connections 2023-12-12T11:43:07.366 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.028+0000 7f0b55089700 1 --2- 172.21.15.63:0/693662230 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b50077bb0 0x7f0b50112a00 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:07.366 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.028+0000 7f0b55089700 1 -- 172.21.15.63:0/693662230 >> 172.21.15.63:0/693662230 conn(0x7f0b500fd880 msgr2=0x7f0b50106ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:07.366 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.028+0000 7f0b55089700 1 -- 172.21.15.63:0/693662230 shutdown_connections 2023-12-12T11:43:07.366 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.028+0000 7f0b55089700 1 -- 172.21.15.63:0/693662230 wait complete. 2023-12-12T11:43:07.366 INFO:teuthology.orchestra.run.smithi063.stdout:mon is available 2023-12-12T11:43:07.366 INFO:teuthology.orchestra.run.smithi063.stdout:Assimilating anything we can from ceph.conf... 2023-12-12T11:43:07.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:07 smithi063 ceph-mon[106631]: mon.smithi063 is new leader, mons smithi063 in quorum (ranks 0) 2023-12-12T11:43:07.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:07 smithi063 ceph-mon[106631]: monmap e1: 1 mons at {smithi063=[v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-12T11:43:07.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:07 smithi063 ceph-mon[106631]: fsmap 2023-12-12T11:43:07.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:07 smithi063 ceph-mon[106631]: osdmap e1: 0 total, 0 up, 0 in 2023-12-12T11:43:07.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:07 smithi063 ceph-mon[106631]: mgrmap e1: no daemons active 2023-12-12T11:43:07.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:07 smithi063 ceph-mon[106631]: from='client.? 172.21.15.63:0/693662230' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-12-12T11:43:08.225 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2023-12-12T11:43:08.225 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout [global] 2023-12-12T11:43:08.225 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout fsid = 85e33c70-98e3-11ee-95a3-87774f69a715 2023-12-12T11:43:08.225 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.63:3300,v1:172.21.15.63:6789] 2023-12-12T11:43:08.225 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-12T11:43:08.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-12T11:43:08.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-12T11:43:08.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-12T11:43:08.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2023-12-12T11:43:08.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-12T11:43:08.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-12T11:43:08.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2023-12-12T11:43:08.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout [osd] 2023-12-12T11:43:08.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-12T11:43:08.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-12T11:43:08.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-12T11:43:08.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-12T11:43:08.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-12T11:43:08.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.780+0000 7f8c34b47700 1 Processor -- start 2023-12-12T11:43:08.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.780+0000 7f8c34b47700 1 -- start start 2023-12-12T11:43:08.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.781+0000 7f8c34b47700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c30077bd0 0x7f8c300760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:08.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.781+0000 7f8c34b47700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c30077fe0 con 0x7f8c30077bd0 2023-12-12T11:43:08.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.781+0000 7f8c2e59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c30077bd0 0x7f8c300760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:08.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.781+0000 7f8c2e59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c30077bd0 0x7f8c300760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53690/0 (socket says 172.21.15.63:53690) 2023-12-12T11:43:08.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.781+0000 7f8c2e59c700 1 -- 172.21.15.63:0/1339688410 learned_addr learned my addr 172.21.15.63:0/1339688410 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:08.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.782+0000 7f8c2e59c700 1 -- 172.21.15.63:0/1339688410 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c30076620 con 0x7f8c30077bd0 2023-12-12T11:43:08.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.782+0000 7f8c2e59c700 1 --2- 172.21.15.63:0/1339688410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c30077bd0 0x7f8c300760e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8c200098e0 tx=0x7f8c20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e391c23e5e8b9b7c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:08.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.782+0000 7f8c2d59a700 1 -- 172.21.15.63:0/1339688410 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c2000b860 con 0x7f8c30077bd0 2023-12-12T11:43:08.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.782+0000 7f8c2d59a700 1 -- 172.21.15.63:0/1339688410 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2000b9c0 con 0x7f8c30077bd0 2023-12-12T11:43:08.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.782+0000 7f8c2d59a700 1 -- 172.21.15.63:0/1339688410 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c2000bc90 con 0x7f8c30077bd0 2023-12-12T11:43:08.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.783+0000 7f8c34b47700 1 -- 172.21.15.63:0/1339688410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c30077bd0 msgr2=0x7f8c300760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:08.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.783+0000 7f8c34b47700 1 --2- 172.21.15.63:0/1339688410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c30077bd0 0x7f8c300760e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8c200098e0 tx=0x7f8c20009250 comp rx=0 tx=0).stop 2023-12-12T11:43:08.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.783+0000 7f8c34b47700 1 -- 172.21.15.63:0/1339688410 shutdown_connections 2023-12-12T11:43:08.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.783+0000 7f8c34b47700 1 --2- 172.21.15.63:0/1339688410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c30077bd0 0x7f8c300760e0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:08.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.783+0000 7f8c34b47700 1 -- 172.21.15.63:0/1339688410 >> 172.21.15.63:0/1339688410 conn(0x7f8c300fda50 msgr2=0x7f8c300ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:08.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.783+0000 7f8c34b47700 1 -- 172.21.15.63:0/1339688410 shutdown_connections 2023-12-12T11:43:08.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.783+0000 7f8c34b47700 1 -- 172.21.15.63:0/1339688410 wait complete. 2023-12-12T11:43:08.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.784+0000 7f8c34b47700 1 Processor -- start 2023-12-12T11:43:08.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.784+0000 7f8c34b47700 1 -- start start 2023-12-12T11:43:08.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.785+0000 7f8c34b47700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c30077bd0 0x7f8c30112b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:08.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.785+0000 7f8c34b47700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c301130c0 con 0x7f8c30077bd0 2023-12-12T11:43:08.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.785+0000 7f8c2e59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c30077bd0 0x7f8c30112b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:08.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.785+0000 7f8c2e59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c30077bd0 0x7f8c30112b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53696/0 (socket says 172.21.15.63:53696) 2023-12-12T11:43:08.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.785+0000 7f8c2e59c700 1 -- 172.21.15.63:0/1982978791 learned_addr learned my addr 172.21.15.63:0/1982978791 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:08.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.785+0000 7f8c2e59c700 1 -- 172.21.15.63:0/1982978791 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c200094f0 con 0x7f8c30077bd0 2023-12-12T11:43:08.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.786+0000 7f8c2e59c700 1 --2- 172.21.15.63:0/1982978791 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c30077bd0 0x7f8c30112b80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8c20009290 tx=0x7f8c20016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:08.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.786+0000 7f8c1effd700 1 -- 172.21.15.63:0/1982978791 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c2001c5c0 con 0x7f8c30077bd0 2023-12-12T11:43:08.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.786+0000 7f8c1effd700 1 -- 172.21.15.63:0/1982978791 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2001c740 con 0x7f8c30077bd0 2023-12-12T11:43:08.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.786+0000 7f8c34b47700 1 -- 172.21.15.63:0/1982978791 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c301132c0 con 0x7f8c30077bd0 2023-12-12T11:43:08.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.786+0000 7f8c1effd700 1 -- 172.21.15.63:0/1982978791 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c2001ca50 con 0x7f8c30077bd0 2023-12-12T11:43:08.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.786+0000 7f8c34b47700 1 -- 172.21.15.63:0/1982978791 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c301136d0 con 0x7f8c30077bd0 2023-12-12T11:43:08.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.788+0000 7f8c1effd700 1 -- 172.21.15.63:0/1982978791 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f8c2001a450 con 0x7f8c30077bd0 2023-12-12T11:43:08.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.788+0000 7f8c1effd700 1 -- 172.21.15.63:0/1982978791 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f8c2002e790 con 0x7f8c30077bd0 2023-12-12T11:43:08.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.788+0000 7f8c1cff9700 1 -- 172.21.15.63:0/1982978791 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c3004bb80 con 0x7f8c30077bd0 2023-12-12T11:43:08.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.790+0000 7f8c1effd700 1 -- 172.21.15.63:0/1982978791 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f8c2001ce30 con 0x7f8c30077bd0 2023-12-12T11:43:08.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.864+0000 7f8c1cff9700 1 -- 172.21.15.63:0/1982978791 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f8c30076990 con 0x7f8c30077bd0 2023-12-12T11:43:08.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.868+0000 7f8c1effd700 1 -- 172.21.15.63:0/1982978791 <== mon.0 v2:172.21.15.63:3300/0 7 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f8c2002e950 con 0x7f8c30077bd0 2023-12-12T11:43:08.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.868+0000 7f8c1effd700 1 -- 172.21.15.63:0/1982978791 <== mon.0 v2:172.21.15.63:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f8c2001b630 con 0x7f8c30077bd0 2023-12-12T11:43:08.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.869+0000 7f8c1cff9700 1 -- 172.21.15.63:0/1982978791 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c30077bd0 msgr2=0x7f8c30112b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:08.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.869+0000 7f8c1cff9700 1 --2- 172.21.15.63:0/1982978791 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c30077bd0 0x7f8c30112b80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8c20009290 tx=0x7f8c20016000 comp rx=0 tx=0).stop 2023-12-12T11:43:08.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.869+0000 7f8c1cff9700 1 -- 172.21.15.63:0/1982978791 shutdown_connections 2023-12-12T11:43:08.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.869+0000 7f8c1cff9700 1 --2- 172.21.15.63:0/1982978791 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c30077bd0 0x7f8c30112b80 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:08.230 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.869+0000 7f8c1cff9700 1 -- 172.21.15.63:0/1982978791 >> 172.21.15.63:0/1982978791 conn(0x7f8c300fda50 msgr2=0x7f8c30107040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:08.230 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.869+0000 7f8c1cff9700 1 -- 172.21.15.63:0/1982978791 shutdown_connections 2023-12-12T11:43:08.230 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:07.869+0000 7f8c1cff9700 1 -- 172.21.15.63:0/1982978791 wait complete. 2023-12-12T11:43:08.230 INFO:teuthology.orchestra.run.smithi063.stdout:Generating new minimal ceph.conf... 2023-12-12T11:43:08.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:08 smithi063 ceph-mon[106631]: from='client.? 172.21.15.63:0/1982978791' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-12T11:43:08.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:08 smithi063 ceph-mon[106631]: from='client.? 172.21.15.63:0/1982978791' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-12-12T11:43:09.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:09 smithi063 ceph-mon[106631]: from='client.? 172.21.15.63:0/3020680414' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:43:10.041 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.629+0000 7fa8daed8700 1 Processor -- start 2023-12-12T11:43:10.042 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.629+0000 7fa8daed8700 1 -- start start 2023-12-12T11:43:10.042 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.630+0000 7fa8daed8700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8d41022d0 0x7fa8d41026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:10.042 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.630+0000 7fa8daed8700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d4102c20 con 0x7fa8d41022d0 2023-12-12T11:43:10.042 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.630+0000 7fa8d8c74700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8d41022d0 0x7fa8d41026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:10.042 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.630+0000 7fa8d8c74700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8d41022d0 0x7fa8d41026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33236/0 (socket says 172.21.15.63:33236) 2023-12-12T11:43:10.042 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.630+0000 7fa8d8c74700 1 -- 172.21.15.63:0/1462249659 learned_addr learned my addr 172.21.15.63:0/1462249659 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:10.042 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.631+0000 7fa8d8c74700 1 -- 172.21.15.63:0/1462249659 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d4102d60 con 0x7fa8d41022d0 2023-12-12T11:43:10.045 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.631+0000 7fa8d8c74700 1 --2- 172.21.15.63:0/1462249659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8d41022d0 0x7fa8d41026e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80098e0 tx=0x7fa8c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95fe5428009730f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:10.045 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.631+0000 7fa8d37fe700 1 -- 172.21.15.63:0/1462249659 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8c800b860 con 0x7fa8d41022d0 2023-12-12T11:43:10.045 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.631+0000 7fa8d37fe700 1 -- 172.21.15.63:0/1462249659 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fa8c800be30 con 0x7fa8d41022d0 2023-12-12T11:43:10.045 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.631+0000 7fa8d37fe700 1 -- 172.21.15.63:0/1462249659 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8c8010380 con 0x7fa8d41022d0 2023-12-12T11:43:10.045 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.632+0000 7fa8daed8700 1 -- 172.21.15.63:0/1462249659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8d41022d0 msgr2=0x7fa8d41026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:10.045 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.632+0000 7fa8daed8700 1 --2- 172.21.15.63:0/1462249659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8d41022d0 0x7fa8d41026e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80098e0 tx=0x7fa8c8009250 comp rx=0 tx=0).stop 2023-12-12T11:43:10.045 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.632+0000 7fa8daed8700 1 -- 172.21.15.63:0/1462249659 shutdown_connections 2023-12-12T11:43:10.045 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.632+0000 7fa8daed8700 1 --2- 172.21.15.63:0/1462249659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8d41022d0 0x7fa8d41026e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:10.045 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.632+0000 7fa8daed8700 1 -- 172.21.15.63:0/1462249659 >> 172.21.15.63:0/1462249659 conn(0x7fa8d40fda50 msgr2=0x7fa8d40ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:10.045 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.632+0000 7fa8daed8700 1 -- 172.21.15.63:0/1462249659 shutdown_connections 2023-12-12T11:43:10.046 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.632+0000 7fa8daed8700 1 -- 172.21.15.63:0/1462249659 wait complete. 2023-12-12T11:43:10.046 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.633+0000 7fa8daed8700 1 Processor -- start 2023-12-12T11:43:10.046 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.633+0000 7fa8daed8700 1 -- start start 2023-12-12T11:43:10.046 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.634+0000 7fa8daed8700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8d41022d0 0x7fa8d4111140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:10.046 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.634+0000 7fa8daed8700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d4111680 con 0x7fa8d41022d0 2023-12-12T11:43:10.046 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.634+0000 7fa8d8c74700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8d41022d0 0x7fa8d4111140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:10.046 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.634+0000 7fa8d8c74700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8d41022d0 0x7fa8d4111140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33242/0 (socket says 172.21.15.63:33242) 2023-12-12T11:43:10.046 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.634+0000 7fa8d8c74700 1 -- 172.21.15.63:0/3020680414 learned_addr learned my addr 172.21.15.63:0/3020680414 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:10.046 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.634+0000 7fa8d8c74700 1 -- 172.21.15.63:0/3020680414 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c80094f0 con 0x7fa8d41022d0 2023-12-12T11:43:10.046 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.635+0000 7fa8d8c74700 1 --2- 172.21.15.63:0/3020680414 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8d41022d0 0x7fa8d4111140 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8000c00 tx=0x7fa8c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:10.046 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.635+0000 7fa8d17fa700 1 -- 172.21.15.63:0/3020680414 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8c8010a80 con 0x7fa8d41022d0 2023-12-12T11:43:10.046 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.635+0000 7fa8d17fa700 1 -- 172.21.15.63:0/3020680414 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fa8c801a430 con 0x7fa8d41022d0 2023-12-12T11:43:10.046 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.635+0000 7fa8daed8700 1 -- 172.21.15.63:0/3020680414 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d4111880 con 0x7fa8d41022d0 2023-12-12T11:43:10.046 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.635+0000 7fa8d17fa700 1 -- 172.21.15.63:0/3020680414 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8c80245b0 con 0x7fa8d41022d0 2023-12-12T11:43:10.047 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.635+0000 7fa8daed8700 1 -- 172.21.15.63:0/3020680414 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d4111c90 con 0x7fa8d41022d0 2023-12-12T11:43:10.048 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.635+0000 7fa8d17fa700 1 -- 172.21.15.63:0/3020680414 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fa8c8024a20 con 0x7fa8d41022d0 2023-12-12T11:43:10.048 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.636+0000 7fa8d17fa700 1 -- 172.21.15.63:0/3020680414 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa8c802eb00 con 0x7fa8d41022d0 2023-12-12T11:43:10.048 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.637+0000 7fa8daed8700 1 -- 172.21.15.63:0/3020680414 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d404bb80 con 0x7fa8d41022d0 2023-12-12T11:43:10.048 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.639+0000 7fa8d17fa700 1 -- 172.21.15.63:0/3020680414 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fa8c801a960 con 0x7fa8d41022d0 2023-12-12T11:43:10.048 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.712+0000 7fa8daed8700 1 -- 172.21.15.63:0/3020680414 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fa8d41040e0 con 0x7fa8d41022d0 2023-12-12T11:43:10.048 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.712+0000 7fa8d17fa700 1 -- 172.21.15.63:0/3020680414 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7fa8d41040e0 con 0x7fa8d41022d0 2023-12-12T11:43:10.049 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.713+0000 7fa8daed8700 1 -- 172.21.15.63:0/3020680414 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8d41022d0 msgr2=0x7fa8d4111140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:10.049 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.713+0000 7fa8daed8700 1 --2- 172.21.15.63:0/3020680414 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8d41022d0 0x7fa8d4111140 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8000c00 tx=0x7fa8c8009250 comp rx=0 tx=0).stop 2023-12-12T11:43:10.049 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.713+0000 7fa8daed8700 1 -- 172.21.15.63:0/3020680414 shutdown_connections 2023-12-12T11:43:10.049 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.713+0000 7fa8daed8700 1 --2- 172.21.15.63:0/3020680414 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8d41022d0 0x7fa8d4111140 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:10.049 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.713+0000 7fa8daed8700 1 -- 172.21.15.63:0/3020680414 >> 172.21.15.63:0/3020680414 conn(0x7fa8d40fda50 msgr2=0x7fa8d40ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:10.049 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.713+0000 7fa8daed8700 1 -- 172.21.15.63:0/3020680414 shutdown_connections 2023-12-12T11:43:10.049 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:08.713+0000 7fa8daed8700 1 -- 172.21.15.63:0/3020680414 wait complete. 2023-12-12T11:43:10.049 INFO:teuthology.orchestra.run.smithi063.stdout:Restarting the monitor... 2023-12-12T11:43:10.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:10 smithi063 systemd[1]: Stopping Ceph mon.smithi063 for 85e33c70-98e3-11ee-95a3-87774f69a715... 2023-12-12T11:43:10.628 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:10 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-mon-smithi063[106608]: 2023-12-12T11:43:10.334+0000 7fa954850700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi063 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-12T11:43:10.628 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:10 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-mon-smithi063[106608]: 2023-12-12T11:43:10.334+0000 7fa954850700 -1 mon.smithi063@0(leader) e1 *** Got Signal Terminated *** 2023-12-12T11:43:10.970 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:10 smithi063 bash[106958]: ceph-85e33c70-98e3-11ee-95a3-87774f69a715-mon-smithi063 2023-12-12T11:43:11.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:10 smithi063 systemd[1]: ceph-85e33c70-98e3-11ee-95a3-87774f69a715@mon.smithi063.service: Succeeded. 2023-12-12T11:43:11.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:10 smithi063 systemd[1]: Stopped Ceph mon.smithi063 for 85e33c70-98e3-11ee-95a3-87774f69a715. 2023-12-12T11:43:11.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:10 smithi063 systemd[1]: Starting Ceph mon.smithi063 for 85e33c70-98e3-11ee-95a3-87774f69a715... 2023-12-12T11:43:11.402 INFO:teuthology.orchestra.run.smithi063.stdout:Setting mon public_network to 172.21.0.0/20 2023-12-12T11:43:11.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 bash[107078]: ee8e9d7455f90c92d7bac02799b9dfac65ea4863d3bca2dd46f32725511a6964 2023-12-12T11:43:11.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 systemd[1]: Started Ceph mon.smithi063 for 85e33c70-98e3-11ee-95a3-87774f69a715. 2023-12-12T11:43:11.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: set uid:gid to 167:167 (ceph:ceph) 2023-12-12T11:43:11.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable), process ceph-mon, pid 7 2023-12-12T11:43:11.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: pidfile_write: ignore empty --pid-file 2023-12-12T11:43:11.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: load: jerasure load: lrc 2023-12-12T11:43:11.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: RocksDB version: 6.15.5 2023-12-12T11:43:11.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-12-12T11:43:11.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Compile date Dec 11 2023 2023-12-12T11:43:11.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: DB SUMMARY 2023-12-12T11:43:11.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: DB Session ID: 4X4MSYW4HO4VABHOW9KY 2023-12-12T11:43:11.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: CURRENT file: CURRENT 2023-12-12T11:43:11.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: IDENTITY file: IDENTITY 2023-12-12T11:43:11.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2023-12-12T11:43:11.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi063/store.db dir, Total Num: 1, files: 000008.sst 2023-12-12T11:43:11.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi063/store.db: 000010.log size: 96756 ; 2023-12-12T11:43:11.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.error_if_exists: 0 2023-12-12T11:43:11.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.create_if_missing: 0 2023-12-12T11:43:11.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.paranoid_checks: 1 2023-12-12T11:43:11.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-12T11:43:11.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.env: 0x55f28bb06a80 2023-12-12T11:43:11.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.fs: Posix File System 2023-12-12T11:43:11.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.info_log: 0x55f28ddd4780 2023-12-12T11:43:11.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.max_file_opening_threads: 16 2023-12-12T11:43:11.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.statistics: (nil) 2023-12-12T11:43:11.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.use_fsync: 0 2023-12-12T11:43:11.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.max_log_file_size: 0 2023-12-12T11:43:11.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-12T11:43:11.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-12T11:43:11.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.keep_log_file_num: 1000 2023-12-12T11:43:11.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.recycle_log_file_num: 0 2023-12-12T11:43:11.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.allow_fallocate: 1 2023-12-12T11:43:11.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.allow_mmap_reads: 0 2023-12-12T11:43:11.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.allow_mmap_writes: 0 2023-12-12T11:43:11.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.use_direct_reads: 0 2023-12-12T11:43:11.798 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-12T11:43:11.798 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.create_missing_column_families: 0 2023-12-12T11:43:11.798 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.db_log_dir: 2023-12-12T11:43:11.798 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi063/store.db 2023-12-12T11:43:11.798 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-12T11:43:11.798 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-12T11:43:11.798 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-12T11:43:11.798 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-12T11:43:11.798 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-12T11:43:11.798 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-12T11:43:11.798 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.advise_random_on_open: 1 2023-12-12T11:43:11.799 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.db_write_buffer_size: 0 2023-12-12T11:43:11.799 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.write_buffer_manager: 0x55f28eb449f0 2023-12-12T11:43:11.799 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-12T11:43:11.799 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-12-12T11:43:11.799 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-12T11:43:11.799 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-12T11:43:11.799 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.rate_limiter: (nil) 2023-12-12T11:43:11.799 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-12T11:43:11.799 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.wal_recovery_mode: 2 2023-12-12T11:43:11.799 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.enable_thread_tracking: 0 2023-12-12T11:43:11.799 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.enable_pipelined_write: 0 2023-12-12T11:43:11.799 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.unordered_write: 0 2023-12-12T11:43:11.799 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-12T11:43:11.799 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-12T11:43:11.800 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-12T11:43:11.800 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-12T11:43:11.800 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.row_cache: None 2023-12-12T11:43:11.800 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.wal_filter: None 2023-12-12T11:43:11.800 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-12T11:43:11.800 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.allow_ingest_behind: 0 2023-12-12T11:43:11.800 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.preserve_deletes: 0 2023-12-12T11:43:11.800 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.two_write_queues: 0 2023-12-12T11:43:11.800 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.manual_wal_flush: 0 2023-12-12T11:43:11.800 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.atomic_flush: 0 2023-12-12T11:43:11.800 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-12T11:43:11.801 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-12T11:43:11.801 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-12T11:43:11.801 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.log_readahead_size: 0 2023-12-12T11:43:11.801 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-12T11:43:11.801 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.best_efforts_recovery: 0 2023-12-12T11:43:11.801 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-12T11:43:11.801 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-12T11:43:11.803 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.allow_data_in_errors: 0 2023-12-12T11:43:11.803 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.db_host_id: __hostname__ 2023-12-12T11:43:11.803 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.max_background_jobs: 2 2023-12-12T11:43:11.803 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.max_background_compactions: -1 2023-12-12T11:43:11.803 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.max_subcompactions: 1 2023-12-12T11:43:11.803 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-12T11:43:11.803 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-12T11:43:11.803 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-12T11:43:11.803 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.max_total_wal_size: 0 2023-12-12T11:43:11.803 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-12T11:43:11.803 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-12T11:43:11.803 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-12T11:43:11.803 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-12T11:43:11.804 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.max_open_files: -1 2023-12-12T11:43:11.804 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.bytes_per_sync: 0 2023-12-12T11:43:11.804 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-12T11:43:11.804 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-12T11:43:11.804 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.compaction_readahead_size: 0 2023-12-12T11:43:11.804 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.max_background_flushes: -1 2023-12-12T11:43:11.804 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Compression algorithms supported: 2023-12-12T11:43:11.804 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-12T11:43:11.804 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: kZSTD supported: 0 2023-12-12T11:43:11.804 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: kXpressCompression supported: 0 2023-12-12T11:43:11.804 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: kLZ4HCCompression supported: 1 2023-12-12T11:43:11.805 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: kZlibCompression supported: 1 2023-12-12T11:43:11.805 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: kSnappyCompression supported: 1 2023-12-12T11:43:11.805 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: kLZ4Compression supported: 1 2023-12-12T11:43:11.805 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: kBZip2Compression supported: 0 2023-12-12T11:43:11.805 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-12T11:43:11.805 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi063/store.db/MANIFEST-000009 2023-12-12T11:43:11.805 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2023-12-12T11:43:11.805 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-12T11:43:11.805 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.merge_operator: 2023-12-12T11:43:11.805 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.compaction_filter: None 2023-12-12T11:43:11.806 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.compaction_filter_factory: None 2023-12-12T11:43:11.806 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.sst_partitioner_factory: None 2023-12-12T11:43:11.806 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-12T11:43:11.806 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-12T11:43:11.806 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f28de24f90) 2023-12-12T11:43:11.806 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: cache_index_and_filter_blocks: 1 2023-12-12T11:43:11.806 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-12T11:43:11.806 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-12T11:43:11.806 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: pin_top_level_index_and_filter: 1 2023-12-12T11:43:11.806 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: index_type: 0 2023-12-12T11:43:11.807 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: data_block_index_type: 0 2023-12-12T11:43:11.807 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: index_shortening: 1 2023-12-12T11:43:11.807 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-12T11:43:11.807 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: hash_index_allow_collision: 1 2023-12-12T11:43:11.807 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: checksum: 1 2023-12-12T11:43:11.807 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: no_block_cache: 0 2023-12-12T11:43:11.807 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_cache: 0x55f28de57090 2023-12-12T11:43:11.807 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_cache_name: BinnedLRUCache 2023-12-12T11:43:11.807 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_cache_options: 2023-12-12T11:43:11.807 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: capacity : 536870912 2023-12-12T11:43:11.807 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: num_shard_bits : 4 2023-12-12T11:43:11.808 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: strict_capacity_limit : 0 2023-12-12T11:43:11.808 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: high_pri_pool_ratio: 0.000 2023-12-12T11:43:11.808 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_cache_compressed: (nil) 2023-12-12T11:43:11.808 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: persistent_cache: (nil) 2023-12-12T11:43:11.808 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_size: 4096 2023-12-12T11:43:11.808 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_size_deviation: 10 2023-12-12T11:43:11.808 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_restart_interval: 16 2023-12-12T11:43:11.808 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: index_block_restart_interval: 1 2023-12-12T11:43:11.808 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: metadata_block_size: 4096 2023-12-12T11:43:11.808 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: partition_filters: 0 2023-12-12T11:43:11.808 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: use_delta_encoding: 1 2023-12-12T11:43:11.809 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2023-12-12T11:43:11.809 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: whole_key_filtering: 1 2023-12-12T11:43:11.809 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: verify_compression: 0 2023-12-12T11:43:11.809 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: read_amp_bytes_per_bit: 0 2023-12-12T11:43:11.809 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: format_version: 4 2023-12-12T11:43:11.809 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: enable_index_compression: 1 2023-12-12T11:43:11.809 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_align: 0 2023-12-12T11:43:11.809 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.write_buffer_size: 33554432 2023-12-12T11:43:11.809 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.max_write_buffer_number: 2 2023-12-12T11:43:11.809 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.compression: NoCompression 2023-12-12T11:43:11.809 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.bottommost_compression: Disabled 2023-12-12T11:43:11.809 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.prefix_extractor: nullptr 2023-12-12T11:43:11.810 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-12T11:43:11.810 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.num_levels: 7 2023-12-12T11:43:11.810 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-12T11:43:11.810 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-12T11:43:11.810 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-12T11:43:11.810 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-12T11:43:11.810 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-12T11:43:11.810 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-12T11:43:11.810 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-12T11:43:11.810 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-12T11:43:11.810 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-12T11:43:11.810 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-12T11:43:11.810 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-12T11:43:11.811 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.compression_opts.level: 32767 2023-12-12T11:43:11.811 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.compression_opts.strategy: 0 2023-12-12T11:43:11.811 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-12T11:43:11.811 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-12T11:43:11.811 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-12T11:43:11.811 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.compression_opts.enabled: false 2023-12-12T11:43:11.811 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-12T11:43:11.811 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-12T11:43:11.811 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-12T11:43:11.811 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.target_file_size_base: 67108864 2023-12-12T11:43:11.811 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-12T11:43:11.811 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-12T11:43:11.811 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-12T11:43:11.811 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-12T11:43:11.811 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-12T11:43:11.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-12T11:43:11.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-12T11:43:11.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-12T11:43:11.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-12T11:43:11.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-12T11:43:11.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-12T11:43:11.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-12T11:43:11.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-12T11:43:11.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.arena_block_size: 4194304 2023-12-12T11:43:11.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-12T11:43:11.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-12T11:43:11.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-12-12T11:43:11.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.disable_auto_compactions: 0 2023-12-12T11:43:11.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-12T11:43:11.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-12T11:43:11.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-12T11:43:11.813 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-12T11:43:11.813 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-12T11:43:11.813 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-12T11:43:11.813 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-12T11:43:11.813 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-12T11:43:11.813 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-12T11:43:11.813 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-12T11:43:11.813 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.table_properties_collectors: 2023-12-12T11:43:11.813 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.inplace_update_support: 0 2023-12-12T11:43:11.813 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-12T11:43:11.813 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-12T11:43:11.813 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-12T11:43:11.813 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-12T11:43:11.813 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.bloom_locality: 0 2023-12-12T11:43:11.814 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.max_successive_merges: 0 2023-12-12T11:43:11.814 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-12T11:43:11.814 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.paranoid_file_checks: 0 2023-12-12T11:43:11.814 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.force_consistency_checks: 1 2023-12-12T11:43:11.814 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.report_bg_io_stats: 0 2023-12-12T11:43:11.814 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.ttl: 2592000 2023-12-12T11:43:11.814 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-12T11:43:11.814 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.enable_blob_files: false 2023-12-12T11:43:11.814 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.min_blob_size: 0 2023-12-12T11:43:11.814 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.blob_file_size: 268435456 2023-12-12T11:43:11.814 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-12T11:43:11.814 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-12T11:43:11.814 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-12T11:43:11.814 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi063/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-12T11:43:11.814 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2023-12-12T11:43:11.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2023-12-12T11:43:11.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702381391416412, "job": 1, "event": "recovery_started", "wal_files": [10]} 2023-12-12T11:43:11.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2023-12-12T11:43:11.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-12-12T11:43:11.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702381391417885, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 92125, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 90220, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13225, "raw_average_key_size": 49, "raw_value_size": 82959, "raw_average_value_size": 310, "num_data_blocks": 11, "num_entries": 267, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1702381391, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "dd20ea7e-1a6a-4575-b807-93642a2628b0", "db_session_id": "4X4MSYW4HO4VABHOW9KY"}} 2023-12-12T11:43:11.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2023-12-12T11:43:11.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702381391418532, "job": 1, "event": "recovery_finished"} 2023-12-12T11:43:11.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi063/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-12T11:43:11.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55f28ddeb180 2023-12-12T11:43:11.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: DB pointer 0x55f28dec0000 2023-12-12T11:43:11.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2023-12-12T11:43:11.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: rocksdb: [db/db_impl/db_impl.cc:903] 2023-12-12T11:43:11.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ** DB Stats ** 2023-12-12T11:43:11.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-12T11:43:11.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-12T11:43:11.816 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-12T11:43:11.816 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-12T11:43:11.816 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-12T11:43:11.816 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-12-12T11:43:11.816 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-12T11:43:11.816 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-12T11:43:11.816 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ** Compaction Stats [default] ** 2023-12-12T11:43:11.816 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-12T11:43:11.816 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-12T11:43:11.816 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: L0 2/0 91.76 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 90.4 0.00 0.00 1 0.001 0 0 2023-12-12T11:43:11.816 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Sum 2/0 91.76 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 90.4 0.00 0.00 1 0.001 0 0 2023-12-12T11:43:11.816 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 90.4 0.00 0.00 1 0.001 0 0 2023-12-12T11:43:11.816 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-12T11:43:11.816 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ** Compaction Stats [default] ** 2023-12-12T11:43:11.816 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-12T11:43:11.817 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-12T11:43:11.817 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 90.4 0.00 0.00 1 0.001 0 0 2023-12-12T11:43:11.817 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-12T11:43:11.817 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-12T11:43:11.817 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-12T11:43:11.817 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-12T11:43:11.817 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-12T11:43:11.817 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-12T11:43:11.817 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Cumulative compaction: 0.00 GB write, 13.31 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-12T11:43:11.817 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Interval compaction: 0.00 GB write, 13.31 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-12T11:43:11.817 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-12T11:43:11.817 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-12T11:43:11.817 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-12T11:43:11.817 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-12T11:43:11.818 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ** Compaction Stats [default] ** 2023-12-12T11:43:11.818 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-12T11:43:11.818 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-12T11:43:11.818 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: L0 2/0 91.76 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 90.4 0.00 0.00 1 0.001 0 0 2023-12-12T11:43:11.818 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Sum 2/0 91.76 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 90.4 0.00 0.00 1 0.001 0 0 2023-12-12T11:43:11.818 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-12-12T11:43:11.818 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-12T11:43:11.818 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ** Compaction Stats [default] ** 2023-12-12T11:43:11.818 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-12T11:43:11.818 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-12T11:43:11.818 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 90.4 0.00 0.00 1 0.001 0 0 2023-12-12T11:43:11.818 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-12T11:43:11.819 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-12T11:43:11.819 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-12T11:43:11.819 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-12T11:43:11.819 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-12T11:43:11.819 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-12T11:43:11.819 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Cumulative compaction: 0.00 GB write, 13.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-12T11:43:11.819 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-12T11:43:11.819 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-12T11:43:11.819 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-12T11:43:11.819 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-12T11:43:11.819 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: starting mon.smithi063 rank 0 at public addrs [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] at bind addrs [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi063 fsid 85e33c70-98e3-11ee-95a3-87774f69a715 2023-12-12T11:43:11.819 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: mon.smithi063@-1(???) e1 preinit fsid 85e33c70-98e3-11ee-95a3-87774f69a715 2023-12-12T11:43:11.819 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: mon.smithi063@-1(???).mds e1 new map 2023-12-12T11:43:11.819 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: mon.smithi063@-1(???).mds e1 print_map 2023-12-12T11:43:11.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: e1 2023-12-12T11:43:11.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-12T11:43:11.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:43:11.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: legacy client fscid: -1 2023-12-12T11:43:11.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-12T11:43:11.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: No filesystems configured 2023-12-12T11:43:11.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: mon.smithi063@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-12T11:43:11.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: mon.smithi063@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-12T11:43:11.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: mon.smithi063@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-12T11:43:11.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: mon.smithi063@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-12T11:43:11.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: mon.smithi063@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-12-12T11:43:11.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: mon.smithi063 is new leader, mons smithi063 in quorum (ranks 0) 2023-12-12T11:43:11.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: monmap e1: 1 mons at {smithi063=[v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-12T11:43:11.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: fsmap 2023-12-12T11:43:11.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: osdmap e1: 0 total, 0 up, 0 in 2023-12-12T11:43:11.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:11 smithi063 ceph-mon[107117]: mgrmap e1: no daemons active 2023-12-12T11:43:12.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.786+0000 7fabf7db4700 1 Processor -- start 2023-12-12T11:43:12.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.786+0000 7fabf7db4700 1 -- start start 2023-12-12T11:43:12.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.787+0000 7fabf7db4700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabf01022d0 0x7fabf01026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:12.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.787+0000 7fabf7db4700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf0102c20 con 0x7fabf01022d0 2023-12-12T11:43:12.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.787+0000 7fabf5b50700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabf01022d0 0x7fabf01026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:12.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.787+0000 7fabf5b50700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabf01022d0 0x7fabf01026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33254/0 (socket says 172.21.15.63:33254) 2023-12-12T11:43:12.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.787+0000 7fabf5b50700 1 -- 172.21.15.63:0/3498708256 learned_addr learned my addr 172.21.15.63:0/3498708256 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:12.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.788+0000 7fabf5b50700 1 -- 172.21.15.63:0/3498708256 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf0102d60 con 0x7fabf01022d0 2023-12-12T11:43:12.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.788+0000 7fabf5b50700 1 --2- 172.21.15.63:0/3498708256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabf01022d0 0x7fabf01026e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fabec0098e0 tx=0x7fabec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e90f9e9c5cbbf1e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:12.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.788+0000 7fabf4b4e700 1 -- 172.21.15.63:0/3498708256 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fabec00b860 con 0x7fabf01022d0 2023-12-12T11:43:12.234 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.788+0000 7fabf4b4e700 1 -- 172.21.15.63:0/3498708256 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fabec00be30 con 0x7fabf01022d0 2023-12-12T11:43:12.234 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.788+0000 7fabf4b4e700 1 -- 172.21.15.63:0/3498708256 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fabec010380 con 0x7fabf01022d0 2023-12-12T11:43:12.234 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.789+0000 7fabf7db4700 1 -- 172.21.15.63:0/3498708256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabf01022d0 msgr2=0x7fabf01026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:12.235 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.789+0000 7fabf7db4700 1 --2- 172.21.15.63:0/3498708256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabf01022d0 0x7fabf01026e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fabec0098e0 tx=0x7fabec009250 comp rx=0 tx=0).stop 2023-12-12T11:43:12.235 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.789+0000 7fabf7db4700 1 -- 172.21.15.63:0/3498708256 shutdown_connections 2023-12-12T11:43:12.235 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.789+0000 7fabf7db4700 1 --2- 172.21.15.63:0/3498708256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabf01022d0 0x7fabf01026e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:12.235 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.789+0000 7fabf7db4700 1 -- 172.21.15.63:0/3498708256 >> 172.21.15.63:0/3498708256 conn(0x7fabf00fda50 msgr2=0x7fabf00ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:12.235 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.789+0000 7fabf7db4700 1 -- 172.21.15.63:0/3498708256 shutdown_connections 2023-12-12T11:43:12.236 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.789+0000 7fabf7db4700 1 -- 172.21.15.63:0/3498708256 wait complete. 2023-12-12T11:43:12.236 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.790+0000 7fabf7db4700 1 Processor -- start 2023-12-12T11:43:12.236 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.790+0000 7fabf7db4700 1 -- start start 2023-12-12T11:43:12.236 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.790+0000 7fabf7db4700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabf01022d0 0x7fabf0111130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:12.236 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.790+0000 7fabf7db4700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf0111670 con 0x7fabf01022d0 2023-12-12T11:43:12.236 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.791+0000 7fabf5b50700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabf01022d0 0x7fabf0111130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:12.236 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.791+0000 7fabf5b50700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabf01022d0 0x7fabf0111130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33258/0 (socket says 172.21.15.63:33258) 2023-12-12T11:43:12.236 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.791+0000 7fabf5b50700 1 -- 172.21.15.63:0/1055164919 learned_addr learned my addr 172.21.15.63:0/1055164919 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:12.236 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.791+0000 7fabf5b50700 1 -- 172.21.15.63:0/1055164919 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec0094f0 con 0x7fabf01022d0 2023-12-12T11:43:12.237 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.791+0000 7fabf5b50700 1 --2- 172.21.15.63:0/1055164919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabf01022d0 0x7fabf0111130 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fabec000c00 tx=0x7fabec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:12.237 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.792+0000 7fabe67fc700 1 -- 172.21.15.63:0/1055164919 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fabec010a80 con 0x7fabf01022d0 2023-12-12T11:43:12.237 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.792+0000 7fabe67fc700 1 -- 172.21.15.63:0/1055164919 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fabec01a430 con 0x7fabf01022d0 2023-12-12T11:43:12.237 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.792+0000 7fabf7db4700 1 -- 172.21.15.63:0/1055164919 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf0111870 con 0x7fabf01022d0 2023-12-12T11:43:12.237 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.792+0000 7fabe67fc700 1 -- 172.21.15.63:0/1055164919 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fabec0245b0 con 0x7fabf01022d0 2023-12-12T11:43:12.237 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.792+0000 7fabf7db4700 1 -- 172.21.15.63:0/1055164919 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf0111c80 con 0x7fabf01022d0 2023-12-12T11:43:12.237 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.792+0000 7fabe67fc700 1 -- 172.21.15.63:0/1055164919 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fabec0247f0 con 0x7fabf01022d0 2023-12-12T11:43:12.237 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.792+0000 7fabe67fc700 1 -- 172.21.15.63:0/1055164919 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fabec02e790 con 0x7fabf01022d0 2023-12-12T11:43:12.237 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.793+0000 7fabf7db4700 1 -- 172.21.15.63:0/1055164919 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf004bb80 con 0x7fabf01022d0 2023-12-12T11:43:12.237 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.797+0000 7fabe67fc700 1 -- 172.21.15.63:0/1055164919 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fabec01a960 con 0x7fabf01022d0 2023-12-12T11:43:12.237 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.869+0000 7fabf7db4700 1 -- 172.21.15.63:0/1055164919 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fabf01040e0 con 0x7fabf01022d0 2023-12-12T11:43:12.237 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.873+0000 7fabe67fc700 1 -- 172.21.15.63:0/1055164919 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fabec024c80 con 0x7fabf01022d0 2023-12-12T11:43:12.237 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.873+0000 7fabf7db4700 1 -- 172.21.15.63:0/1055164919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabf01022d0 msgr2=0x7fabf0111130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:12.237 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.873+0000 7fabf7db4700 1 --2- 172.21.15.63:0/1055164919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabf01022d0 0x7fabf0111130 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fabec000c00 tx=0x7fabec009250 comp rx=0 tx=0).stop 2023-12-12T11:43:12.238 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.873+0000 7fabf7db4700 1 -- 172.21.15.63:0/1055164919 shutdown_connections 2023-12-12T11:43:12.238 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.873+0000 7fabf7db4700 1 --2- 172.21.15.63:0/1055164919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabf01022d0 0x7fabf0111130 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:12.238 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.873+0000 7fabf7db4700 1 -- 172.21.15.63:0/1055164919 >> 172.21.15.63:0/1055164919 conn(0x7fabf00fda50 msgr2=0x7fabf00ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:12.238 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.874+0000 7fabf7db4700 1 -- 172.21.15.63:0/1055164919 shutdown_connections 2023-12-12T11:43:12.238 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:11.874+0000 7fabf7db4700 1 -- 172.21.15.63:0/1055164919 wait complete. 2023-12-12T11:43:12.238 INFO:teuthology.orchestra.run.smithi063.stdout:Wrote config to /etc/ceph/ceph.conf 2023-12-12T11:43:12.238 INFO:teuthology.orchestra.run.smithi063.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-12-12T11:43:12.238 INFO:teuthology.orchestra.run.smithi063.stdout:Creating mgr... 2023-12-12T11:43:12.238 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying port 9283 ... 2023-12-12T11:43:12.528 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-85e33c70-98e3-11ee-95a3-87774f69a715@mgr.smithi063.zjnfdi 2023-12-12T11:43:12.529 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Failed to reset failed state of unit ceph-85e33c70-98e3-11ee-95a3-87774f69a715@mgr.smithi063.zjnfdi.service: Unit ceph-85e33c70-98e3-11ee-95a3-87774f69a715@mgr.smithi063.zjnfdi.service not loaded. 2023-12-12T11:43:12.744 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-85e33c70-98e3-11ee-95a3-87774f69a715.target.wants/ceph-85e33c70-98e3-11ee-95a3-87774f69a715@mgr.smithi063.zjnfdi.service → /etc/systemd/system/ceph-85e33c70-98e3-11ee-95a3-87774f69a715@.service. 2023-12-12T11:43:13.233 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:12 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/1055164919' entity='client.admin' 2023-12-12T11:43:13.264 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-12T11:43:13.264 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout disabled 2023-12-12T11:43:13.286 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-12T11:43:13.286 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout inactive 2023-12-12T11:43:13.286 INFO:teuthology.orchestra.run.smithi063.stdout:firewalld.service is not enabled 2023-12-12T11:43:13.286 INFO:teuthology.orchestra.run.smithi063.stdout:Not possible to enable service . firewalld.service is not available 2023-12-12T11:43:13.308 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-12T11:43:13.308 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout disabled 2023-12-12T11:43:13.331 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-12T11:43:13.331 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout inactive 2023-12-12T11:43:13.331 INFO:teuthology.orchestra.run.smithi063.stdout:firewalld.service is not enabled 2023-12-12T11:43:13.331 INFO:teuthology.orchestra.run.smithi063.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2023-12-12T11:43:13.331 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for mgr to start... 2023-12-12T11:43:13.331 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for mgr... 2023-12-12T11:43:14.225 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2023-12-12T11:43:14.225 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout { 2023-12-12T11:43:14.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "fsid": "85e33c70-98e3-11ee-95a3-87774f69a715", 2023-12-12T11:43:14.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "health": { 2023-12-12T11:43:14.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-12T11:43:14.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-12T11:43:14.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-12T11:43:14.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-12T11:43:14.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-12T11:43:14.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-12T11:43:14.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 0 2023-12-12T11:43:14.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2023-12-12T11:43:14.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-12T11:43:14.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "smithi063" 2023-12-12T11:43:14.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2023-12-12T11:43:14.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2023-12-12T11:43:14.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-12T11:43:14.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-12T11:43:14.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-12T11:43:14.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-12T11:43:14.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-12T11:43:14.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-12T11:43:14.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-12T11:43:14.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-12T11:43:14.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-12T11:43:14.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-12T11:43:14.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-12T11:43:14.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-12T11:43:14.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-12T11:43:14.231 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-12T11:43:14.231 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-12T11:43:14.231 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-12T11:43:14.231 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-12T11:43:14.232 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-12T11:43:14.232 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-12T11:43:14.232 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-12T11:43:14.232 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-12T11:43:14.232 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-12T11:43:14.232 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-12T11:43:14.232 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-12T11:43:14.232 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-12T11:43:14.232 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-12T11:43:14.232 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-12T11:43:14.232 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-12T11:43:14.232 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-12T11:43:14.232 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-12T11:43:14.232 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-12T11:43:14.232 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-12T11:43:14.232 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-12T11:43:14.233 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-12T11:43:14.233 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-12T11:43:14.233 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "restful" 2023-12-12T11:43:14.233 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2023-12-12T11:43:14.233 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-12T11:43:14.233 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-12T11:43:14.233 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-12T11:43:14.233 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-12T11:43:14.233 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "modified": "2023-12-12T11:43:06.421568+0000", 2023-12-12T11:43:14.233 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-12T11:43:14.233 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-12T11:43:14.233 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-12T11:43:14.233 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout } 2023-12-12T11:43:14.233 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.776+0000 7fcb40e70700 1 Processor -- start 2023-12-12T11:43:14.233 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.777+0000 7fcb40e70700 1 -- start start 2023-12-12T11:43:14.233 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.777+0000 7fcb40e70700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb3c077b90 0x7fcb3c0760a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:14.234 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.777+0000 7fcb40e70700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c077fa0 con 0x7fcb3c077b90 2023-12-12T11:43:14.234 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.777+0000 7fcb3a59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb3c077b90 0x7fcb3c0760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:14.234 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.777+0000 7fcb3a59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb3c077b90 0x7fcb3c0760a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33290/0 (socket says 172.21.15.63:33290) 2023-12-12T11:43:14.234 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.778+0000 7fcb3a59c700 1 -- 172.21.15.63:0/3755022405 learned_addr learned my addr 172.21.15.63:0/3755022405 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:14.234 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.778+0000 7fcb3a59c700 1 -- 172.21.15.63:0/3755022405 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3c0765e0 con 0x7fcb3c077b90 2023-12-12T11:43:14.234 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.778+0000 7fcb3a59c700 1 --2- 172.21.15.63:0/3755022405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb3c077b90 0x7fcb3c0760a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c0098e0 tx=0x7fcb2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992ff80dd3cf46b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:14.234 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.778+0000 7fcb3959a700 1 -- 172.21.15.63:0/3755022405 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb2c00b860 con 0x7fcb3c077b90 2023-12-12T11:43:14.234 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:13 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/3963210538' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-12T11:43:14.238 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.778+0000 7fcb3959a700 1 -- 172.21.15.63:0/3755022405 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fcb2c00be30 con 0x7fcb3c077b90 2023-12-12T11:43:14.238 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.778+0000 7fcb3959a700 1 -- 172.21.15.63:0/3755022405 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb2c010380 con 0x7fcb3c077b90 2023-12-12T11:43:14.238 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.779+0000 7fcb40e70700 1 -- 172.21.15.63:0/3755022405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb3c077b90 msgr2=0x7fcb3c0760a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:14.238 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.779+0000 7fcb40e70700 1 --2- 172.21.15.63:0/3755022405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb3c077b90 0x7fcb3c0760a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c0098e0 tx=0x7fcb2c009250 comp rx=0 tx=0).stop 2023-12-12T11:43:14.238 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.779+0000 7fcb40e70700 1 -- 172.21.15.63:0/3755022405 shutdown_connections 2023-12-12T11:43:14.238 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.779+0000 7fcb40e70700 1 --2- 172.21.15.63:0/3755022405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb3c077b90 0x7fcb3c0760a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:14.239 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.779+0000 7fcb40e70700 1 -- 172.21.15.63:0/3755022405 >> 172.21.15.63:0/3755022405 conn(0x7fcb3c0fda50 msgr2=0x7fcb3c0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:14.239 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.779+0000 7fcb40e70700 1 -- 172.21.15.63:0/3755022405 shutdown_connections 2023-12-12T11:43:14.239 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.779+0000 7fcb40e70700 1 -- 172.21.15.63:0/3755022405 wait complete. 2023-12-12T11:43:14.239 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.781+0000 7fcb40e70700 1 Processor -- start 2023-12-12T11:43:14.239 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.781+0000 7fcb40e70700 1 -- start start 2023-12-12T11:43:14.239 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.781+0000 7fcb40e70700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb3c077b90 0x7fcb3c113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:14.239 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.781+0000 7fcb40e70700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c1138c0 con 0x7fcb3c077b90 2023-12-12T11:43:14.239 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.782+0000 7fcb3a59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb3c077b90 0x7fcb3c113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:14.239 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.782+0000 7fcb3a59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb3c077b90 0x7fcb3c113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33302/0 (socket says 172.21.15.63:33302) 2023-12-12T11:43:14.239 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.782+0000 7fcb3a59c700 1 -- 172.21.15.63:0/3963210538 learned_addr learned my addr 172.21.15.63:0/3963210538 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:14.239 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.782+0000 7fcb3a59c700 1 -- 172.21.15.63:0/3963210538 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2c0094f0 con 0x7fcb3c077b90 2023-12-12T11:43:14.239 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.782+0000 7fcb3a59c700 1 --2- 172.21.15.63:0/3963210538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb3c077b90 0x7fcb3c113380 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c006b00 tx=0x7fcb2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:14.239 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.783+0000 7fcb2affd700 1 -- 172.21.15.63:0/3963210538 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb2c010a80 con 0x7fcb3c077b90 2023-12-12T11:43:14.239 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.783+0000 7fcb2affd700 1 -- 172.21.15.63:0/3963210538 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fcb2c01a430 con 0x7fcb3c077b90 2023-12-12T11:43:14.239 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.783+0000 7fcb2affd700 1 -- 172.21.15.63:0/3963210538 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb2c0245b0 con 0x7fcb3c077b90 2023-12-12T11:43:14.240 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.783+0000 7fcb40e70700 1 -- 172.21.15.63:0/3963210538 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb3c113ac0 con 0x7fcb3c077b90 2023-12-12T11:43:14.240 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.783+0000 7fcb40e70700 1 -- 172.21.15.63:0/3963210538 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb3c113ed0 con 0x7fcb3c077b90 2023-12-12T11:43:14.240 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.783+0000 7fcb2affd700 1 -- 172.21.15.63:0/3963210538 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fcb2c024a60 con 0x7fcb3c077b90 2023-12-12T11:43:14.240 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.783+0000 7fcb2affd700 1 -- 172.21.15.63:0/3963210538 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fcb2c02eaa0 con 0x7fcb3c077b90 2023-12-12T11:43:14.240 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.784+0000 7fcb40e70700 1 -- 172.21.15.63:0/3963210538 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb3c04bb80 con 0x7fcb3c077b90 2023-12-12T11:43:14.240 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.787+0000 7fcb2affd700 1 -- 172.21.15.63:0/3963210538 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fcb2c02ed00 con 0x7fcb3c077b90 2023-12-12T11:43:14.240 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.884+0000 7fcb40e70700 1 -- 172.21.15.63:0/3963210538 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fcb3c10cd60 con 0x7fcb3c077b90 2023-12-12T11:43:14.240 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.884+0000 7fcb2affd700 1 -- 172.21.15.63:0/3963210538 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fcb2c010be0 con 0x7fcb3c077b90 2023-12-12T11:43:14.240 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.885+0000 7fcb40e70700 1 -- 172.21.15.63:0/3963210538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb3c077b90 msgr2=0x7fcb3c113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:14.240 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.885+0000 7fcb40e70700 1 --2- 172.21.15.63:0/3963210538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb3c077b90 0x7fcb3c113380 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c006b00 tx=0x7fcb2c009250 comp rx=0 tx=0).stop 2023-12-12T11:43:14.240 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.885+0000 7fcb40e70700 1 -- 172.21.15.63:0/3963210538 shutdown_connections 2023-12-12T11:43:14.240 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.885+0000 7fcb40e70700 1 --2- 172.21.15.63:0/3963210538 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb3c077b90 0x7fcb3c113380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:14.240 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.885+0000 7fcb40e70700 1 -- 172.21.15.63:0/3963210538 >> 172.21.15.63:0/3963210538 conn(0x7fcb3c0fda50 msgr2=0x7fcb3c0ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:14.240 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.885+0000 7fcb40e70700 1 -- 172.21.15.63:0/3963210538 shutdown_connections 2023-12-12T11:43:14.240 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:13.885+0000 7fcb40e70700 1 -- 172.21.15.63:0/3963210538 wait complete. 2023-12-12T11:43:14.241 INFO:teuthology.orchestra.run.smithi063.stdout:mgr not available, waiting (1/15)... 2023-12-12T11:43:17.121 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2023-12-12T11:43:17.121 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout { 2023-12-12T11:43:17.121 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "fsid": "85e33c70-98e3-11ee-95a3-87774f69a715", 2023-12-12T11:43:17.124 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "health": { 2023-12-12T11:43:17.124 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-12T11:43:17.125 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-12T11:43:17.125 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-12T11:43:17.125 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-12T11:43:17.125 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-12T11:43:17.125 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-12T11:43:17.125 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 0 2023-12-12T11:43:17.125 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2023-12-12T11:43:17.125 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-12T11:43:17.125 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "smithi063" 2023-12-12T11:43:17.125 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2023-12-12T11:43:17.125 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2023-12-12T11:43:17.125 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-12T11:43:17.125 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-12T11:43:17.125 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-12T11:43:17.125 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-12T11:43:17.126 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-12T11:43:17.126 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-12T11:43:17.126 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-12T11:43:17.126 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-12T11:43:17.126 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-12T11:43:17.126 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-12T11:43:17.126 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-12T11:43:17.126 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-12T11:43:17.126 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-12T11:43:17.126 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-12T11:43:17.126 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-12T11:43:17.126 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-12T11:43:17.126 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-12T11:43:17.126 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-12T11:43:17.126 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-12T11:43:17.126 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-12T11:43:17.134 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-12T11:43:17.134 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-12T11:43:17.134 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-12T11:43:17.134 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-12T11:43:17.134 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-12T11:43:17.134 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-12T11:43:17.134 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-12T11:43:17.134 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-12T11:43:17.134 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-12T11:43:17.134 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-12T11:43:17.134 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-12T11:43:17.135 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-12T11:43:17.135 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-12T11:43:17.135 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-12T11:43:17.135 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-12T11:43:17.135 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "restful" 2023-12-12T11:43:17.135 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2023-12-12T11:43:17.135 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-12T11:43:17.135 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-12T11:43:17.135 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-12T11:43:17.135 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-12T11:43:17.135 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "modified": "2023-12-12T11:43:06.421568+0000", 2023-12-12T11:43:17.135 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-12T11:43:17.135 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-12T11:43:17.135 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-12T11:43:17.135 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout } 2023-12-12T11:43:17.135 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.680+0000 7f7013d0b700 1 Processor -- start 2023-12-12T11:43:17.136 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.680+0000 7f7013d0b700 1 -- start start 2023-12-12T11:43:17.136 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.681+0000 7f7013d0b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f700c071000 0x7f700c1072a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:17.136 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.681+0000 7f7013d0b700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700c102c90 con 0x7f700c071000 2023-12-12T11:43:17.136 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.681+0000 7f7011aa7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f700c071000 0x7f700c1072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:17.136 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.681+0000 7f7011aa7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f700c071000 0x7f700c1072a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33314/0 (socket says 172.21.15.63:33314) 2023-12-12T11:43:17.136 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.681+0000 7f7011aa7700 1 -- 172.21.15.63:0/2108578982 learned_addr learned my addr 172.21.15.63:0/2108578982 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:17.136 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.682+0000 7f7011aa7700 1 -- 172.21.15.63:0/2108578982 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700c1077e0 con 0x7f700c071000 2023-12-12T11:43:17.136 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.682+0000 7f7011aa7700 1 --2- 172.21.15.63:0/2108578982 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f700c071000 0x7f700c1072a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f70080098e0 tx=0x7f7008009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c541dbe93895272d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:17.136 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.682+0000 7f7010aa5700 1 -- 172.21.15.63:0/2108578982 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f700800b860 con 0x7f700c071000 2023-12-12T11:43:17.136 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.682+0000 7f7010aa5700 1 -- 172.21.15.63:0/2108578982 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f700800be30 con 0x7f700c071000 2023-12-12T11:43:17.136 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.682+0000 7f7010aa5700 1 -- 172.21.15.63:0/2108578982 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7008010380 con 0x7f700c071000 2023-12-12T11:43:17.136 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.683+0000 7f7013d0b700 1 -- 172.21.15.63:0/2108578982 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f700c071000 msgr2=0x7f700c1072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:17.136 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.683+0000 7f7013d0b700 1 --2- 172.21.15.63:0/2108578982 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f700c071000 0x7f700c1072a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f70080098e0 tx=0x7f7008009250 comp rx=0 tx=0).stop 2023-12-12T11:43:17.136 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.683+0000 7f7013d0b700 1 -- 172.21.15.63:0/2108578982 shutdown_connections 2023-12-12T11:43:17.137 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.683+0000 7f7013d0b700 1 --2- 172.21.15.63:0/2108578982 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f700c071000 0x7f700c1072a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:17.137 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.683+0000 7f7013d0b700 1 -- 172.21.15.63:0/2108578982 >> 172.21.15.63:0/2108578982 conn(0x7f700c0fc970 msgr2=0x7f700c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:17.137 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.683+0000 7f7013d0b700 1 -- 172.21.15.63:0/2108578982 shutdown_connections 2023-12-12T11:43:17.137 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.683+0000 7f7013d0b700 1 -- 172.21.15.63:0/2108578982 wait complete. 2023-12-12T11:43:17.137 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.684+0000 7f7013d0b700 1 Processor -- start 2023-12-12T11:43:17.137 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.684+0000 7f7013d0b700 1 -- start start 2023-12-12T11:43:17.137 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.684+0000 7f7013d0b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f700c071000 0x7f700c113360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:17.137 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.684+0000 7f7013d0b700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700c1138a0 con 0x7f700c071000 2023-12-12T11:43:17.137 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.685+0000 7f7011aa7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f700c071000 0x7f700c113360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:17.137 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.685+0000 7f7011aa7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f700c071000 0x7f700c113360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33318/0 (socket says 172.21.15.63:33318) 2023-12-12T11:43:17.137 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.685+0000 7f7011aa7700 1 -- 172.21.15.63:0/3342718337 learned_addr learned my addr 172.21.15.63:0/3342718337 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:17.137 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.685+0000 7f7011aa7700 1 -- 172.21.15.63:0/3342718337 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70080094f0 con 0x7f700c071000 2023-12-12T11:43:17.137 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.685+0000 7f7011aa7700 1 --2- 172.21.15.63:0/3342718337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f700c071000 0x7f700c113360 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7008006b00 tx=0x7f7008009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:17.138 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.686+0000 7f70027fc700 1 -- 172.21.15.63:0/3342718337 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7008010a80 con 0x7f700c071000 2023-12-12T11:43:17.138 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.686+0000 7f7013d0b700 1 -- 172.21.15.63:0/3342718337 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f700c113aa0 con 0x7f700c071000 2023-12-12T11:43:17.138 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.686+0000 7f70027fc700 1 -- 172.21.15.63:0/3342718337 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f700801a430 con 0x7f700c071000 2023-12-12T11:43:17.138 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.686+0000 7f70027fc700 1 -- 172.21.15.63:0/3342718337 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f70080245b0 con 0x7f700c071000 2023-12-12T11:43:17.138 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.686+0000 7f7013d0b700 1 -- 172.21.15.63:0/3342718337 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f700c113eb0 con 0x7f700c071000 2023-12-12T11:43:17.138 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.686+0000 7f70027fc700 1 -- 172.21.15.63:0/3342718337 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f7008024a60 con 0x7f700c071000 2023-12-12T11:43:17.138 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.686+0000 7f70027fc700 1 -- 172.21.15.63:0/3342718337 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f700802eaa0 con 0x7f700c071000 2023-12-12T11:43:17.138 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.687+0000 7f7013d0b700 1 -- 172.21.15.63:0/3342718337 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f700c04bb80 con 0x7f700c071000 2023-12-12T11:43:17.138 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.690+0000 7f70027fc700 1 -- 172.21.15.63:0/3342718337 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f700802ecb0 con 0x7f700c071000 2023-12-12T11:43:17.138 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.766+0000 7f7013d0b700 1 -- 172.21.15.63:0/3342718337 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f700c108500 con 0x7f700c071000 2023-12-12T11:43:17.138 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.767+0000 7f70027fc700 1 -- 172.21.15.63:0/3342718337 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f700802ee50 con 0x7f700c071000 2023-12-12T11:43:17.138 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.768+0000 7f7013d0b700 1 -- 172.21.15.63:0/3342718337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f700c071000 msgr2=0x7f700c113360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:17.138 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.768+0000 7f7013d0b700 1 --2- 172.21.15.63:0/3342718337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f700c071000 0x7f700c113360 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7008006b00 tx=0x7f7008009250 comp rx=0 tx=0).stop 2023-12-12T11:43:17.138 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.768+0000 7f7013d0b700 1 -- 172.21.15.63:0/3342718337 shutdown_connections 2023-12-12T11:43:17.139 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.768+0000 7f7013d0b700 1 --2- 172.21.15.63:0/3342718337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f700c071000 0x7f700c113360 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:17.139 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.768+0000 7f7013d0b700 1 -- 172.21.15.63:0/3342718337 >> 172.21.15.63:0/3342718337 conn(0x7f700c0fc970 msgr2=0x7f700c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:17.139 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.768+0000 7f7013d0b700 1 -- 172.21.15.63:0/3342718337 shutdown_connections 2023-12-12T11:43:17.139 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:16.768+0000 7f7013d0b700 1 -- 172.21.15.63:0/3342718337 wait complete. 2023-12-12T11:43:17.139 INFO:teuthology.orchestra.run.smithi063.stdout:mgr not available, waiting (2/15)... 2023-12-12T11:43:17.698 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:17 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/3342718337' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-12T11:43:19.996 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2023-12-12T11:43:19.996 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout { 2023-12-12T11:43:19.996 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "fsid": "85e33c70-98e3-11ee-95a3-87774f69a715", 2023-12-12T11:43:19.996 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "health": { 2023-12-12T11:43:19.996 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-12T11:43:19.996 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-12T11:43:19.996 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-12T11:43:19.996 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-12T11:43:19.997 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-12T11:43:19.997 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-12T11:43:19.997 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 0 2023-12-12T11:43:19.997 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2023-12-12T11:43:19.997 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-12T11:43:19.997 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "smithi063" 2023-12-12T11:43:19.997 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2023-12-12T11:43:19.997 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2023-12-12T11:43:19.997 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-12T11:43:19.997 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-12T11:43:19.997 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-12T11:43:19.997 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-12T11:43:19.997 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-12T11:43:19.997 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-12T11:43:19.997 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-12T11:43:19.998 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-12T11:43:19.998 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-12T11:43:19.998 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-12T11:43:19.998 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-12T11:43:19.998 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-12T11:43:19.998 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-12T11:43:19.998 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-12T11:43:19.998 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-12T11:43:19.998 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-12T11:43:19.998 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-12T11:43:19.998 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-12T11:43:19.998 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-12T11:43:19.998 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-12T11:43:19.998 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-12T11:43:19.999 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-12T11:43:19.999 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-12T11:43:19.999 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-12T11:43:19.999 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-12T11:43:19.999 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-12T11:43:19.999 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-12T11:43:19.999 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-12T11:43:19.999 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-12T11:43:19.999 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-12T11:43:19.999 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-12T11:43:19.999 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-12T11:43:19.999 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-12T11:43:19.999 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-12T11:43:19.999 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-12T11:43:19.999 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "restful" 2023-12-12T11:43:20.000 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2023-12-12T11:43:20.000 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-12T11:43:20.000 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-12T11:43:20.000 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-12T11:43:20.000 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-12T11:43:20.000 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "modified": "2023-12-12T11:43:06.421568+0000", 2023-12-12T11:43:20.000 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-12T11:43:20.000 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-12T11:43:20.000 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-12T11:43:20.000 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout } 2023-12-12T11:43:20.000 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.537+0000 7fa5e28b2700 1 Processor -- start 2023-12-12T11:43:20.000 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.538+0000 7fa5e28b2700 1 -- start start 2023-12-12T11:43:20.000 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.538+0000 7fa5e28b2700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5dc070f80 0x7fa5dc107320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:20.000 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.538+0000 7fa5e28b2700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc102d10 con 0x7fa5dc070f80 2023-12-12T11:43:20.000 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.538+0000 7fa5dbfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5dc070f80 0x7fa5dc107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:20.001 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.538+0000 7fa5dbfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5dc070f80 0x7fa5dc107320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40050/0 (socket says 172.21.15.63:40050) 2023-12-12T11:43:20.001 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.538+0000 7fa5dbfff700 1 -- 172.21.15.63:0/3373931003 learned_addr learned my addr 172.21.15.63:0/3373931003 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:20.001 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.539+0000 7fa5dbfff700 1 -- 172.21.15.63:0/3373931003 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc107860 con 0x7fa5dc070f80 2023-12-12T11:43:20.001 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.539+0000 7fa5dbfff700 1 --2- 172.21.15.63:0/3373931003 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5dc070f80 0x7fa5dc107320 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc0098e0 tx=0x7fa5cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ff174866a9eb51 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:20.001 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.539+0000 7fa5daffd700 1 -- 172.21.15.63:0/3373931003 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa5cc00b860 con 0x7fa5dc070f80 2023-12-12T11:43:20.001 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.539+0000 7fa5daffd700 1 -- 172.21.15.63:0/3373931003 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fa5cc00be30 con 0x7fa5dc070f80 2023-12-12T11:43:20.001 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.539+0000 7fa5daffd700 1 -- 172.21.15.63:0/3373931003 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa5cc010380 con 0x7fa5dc070f80 2023-12-12T11:43:20.001 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.540+0000 7fa5e28b2700 1 -- 172.21.15.63:0/3373931003 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5dc070f80 msgr2=0x7fa5dc107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:20.001 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.540+0000 7fa5e28b2700 1 --2- 172.21.15.63:0/3373931003 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5dc070f80 0x7fa5dc107320 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc0098e0 tx=0x7fa5cc009250 comp rx=0 tx=0).stop 2023-12-12T11:43:20.001 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.540+0000 7fa5e28b2700 1 -- 172.21.15.63:0/3373931003 shutdown_connections 2023-12-12T11:43:20.001 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.540+0000 7fa5e28b2700 1 --2- 172.21.15.63:0/3373931003 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5dc070f80 0x7fa5dc107320 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:20.001 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.540+0000 7fa5e28b2700 1 -- 172.21.15.63:0/3373931003 >> 172.21.15.63:0/3373931003 conn(0x7fa5dc0fc970 msgr2=0x7fa5dc0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:20.001 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.540+0000 7fa5e28b2700 1 -- 172.21.15.63:0/3373931003 shutdown_connections 2023-12-12T11:43:20.001 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.540+0000 7fa5e28b2700 1 -- 172.21.15.63:0/3373931003 wait complete. 2023-12-12T11:43:20.002 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.541+0000 7fa5e28b2700 1 Processor -- start 2023-12-12T11:43:20.002 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.541+0000 7fa5e28b2700 1 -- start start 2023-12-12T11:43:20.002 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.542+0000 7fa5e28b2700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5dc070f80 0x7fa5dc113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:20.002 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.542+0000 7fa5e28b2700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc1138c0 con 0x7fa5dc070f80 2023-12-12T11:43:20.002 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.542+0000 7fa5dbfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5dc070f80 0x7fa5dc113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:20.002 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:19 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/3483314575' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-12T11:43:20.004 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.542+0000 7fa5dbfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5dc070f80 0x7fa5dc113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40064/0 (socket says 172.21.15.63:40064) 2023-12-12T11:43:20.004 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.542+0000 7fa5dbfff700 1 -- 172.21.15.63:0/3483314575 learned_addr learned my addr 172.21.15.63:0/3483314575 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:20.004 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.542+0000 7fa5dbfff700 1 -- 172.21.15.63:0/3483314575 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5cc0094f0 con 0x7fa5dc070f80 2023-12-12T11:43:20.004 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.542+0000 7fa5dbfff700 1 --2- 172.21.15.63:0/3483314575 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5dc070f80 0x7fa5dc113380 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc006b00 tx=0x7fa5cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:20.004 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.543+0000 7fa5d8ff9700 1 -- 172.21.15.63:0/3483314575 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa5cc010a80 con 0x7fa5dc070f80 2023-12-12T11:43:20.005 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.543+0000 7fa5d8ff9700 1 -- 172.21.15.63:0/3483314575 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fa5cc01a430 con 0x7fa5dc070f80 2023-12-12T11:43:20.005 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.543+0000 7fa5d8ff9700 1 -- 172.21.15.63:0/3483314575 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa5cc0245b0 con 0x7fa5dc070f80 2023-12-12T11:43:20.005 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.543+0000 7fa5e28b2700 1 -- 172.21.15.63:0/3483314575 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5dc113ac0 con 0x7fa5dc070f80 2023-12-12T11:43:20.005 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.543+0000 7fa5e28b2700 1 -- 172.21.15.63:0/3483314575 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5dc113ed0 con 0x7fa5dc070f80 2023-12-12T11:43:20.005 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.543+0000 7fa5d8ff9700 1 -- 172.21.15.63:0/3483314575 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fa5cc024a60 con 0x7fa5dc070f80 2023-12-12T11:43:20.005 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.543+0000 7fa5d8ff9700 1 -- 172.21.15.63:0/3483314575 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa5cc02eaa0 con 0x7fa5dc070f80 2023-12-12T11:43:20.005 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.544+0000 7fa5e28b2700 1 -- 172.21.15.63:0/3483314575 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5dc04bb80 con 0x7fa5dc070f80 2023-12-12T11:43:20.005 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.546+0000 7fa5d8ff9700 1 -- 172.21.15.63:0/3483314575 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fa5cc02ec60 con 0x7fa5dc070f80 2023-12-12T11:43:20.005 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.624+0000 7fa5e28b2700 1 -- 172.21.15.63:0/3483314575 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fa5dc1084f0 con 0x7fa5dc070f80 2023-12-12T11:43:20.005 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.624+0000 7fa5d8ff9700 1 -- 172.21.15.63:0/3483314575 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fa5dc1084f0 con 0x7fa5dc070f80 2023-12-12T11:43:20.005 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.625+0000 7fa5e28b2700 1 -- 172.21.15.63:0/3483314575 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5dc070f80 msgr2=0x7fa5dc113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:20.005 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.625+0000 7fa5e28b2700 1 --2- 172.21.15.63:0/3483314575 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5dc070f80 0x7fa5dc113380 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc006b00 tx=0x7fa5cc009250 comp rx=0 tx=0).stop 2023-12-12T11:43:20.005 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.625+0000 7fa5e28b2700 1 -- 172.21.15.63:0/3483314575 shutdown_connections 2023-12-12T11:43:20.005 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.625+0000 7fa5e28b2700 1 --2- 172.21.15.63:0/3483314575 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5dc070f80 0x7fa5dc113380 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:20.005 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.625+0000 7fa5e28b2700 1 -- 172.21.15.63:0/3483314575 >> 172.21.15.63:0/3483314575 conn(0x7fa5dc0fc970 msgr2=0x7fa5dc0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:20.006 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.626+0000 7fa5e28b2700 1 -- 172.21.15.63:0/3483314575 shutdown_connections 2023-12-12T11:43:20.006 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:19.626+0000 7fa5e28b2700 1 -- 172.21.15.63:0/3483314575 wait complete. 2023-12-12T11:43:20.006 INFO:teuthology.orchestra.run.smithi063.stdout:mgr not available, waiting (3/15)... 2023-12-12T11:43:22.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:22 smithi063 ceph-mon[107117]: Activating manager daemon smithi063.zjnfdi 2023-12-12T11:43:22.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:22 smithi063 ceph-mon[107117]: mgrmap e2: smithi063.zjnfdi(active, starting, since 0.0048118s) 2023-12-12T11:43:22.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:22 smithi063 ceph-mon[107117]: from='mgr.14100 172.21.15.63:0/1364156162' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-12T11:43:22.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:22 smithi063 ceph-mon[107117]: from='mgr.14100 172.21.15.63:0/1364156162' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-12T11:43:22.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:22 smithi063 ceph-mon[107117]: from='mgr.14100 172.21.15.63:0/1364156162' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-12T11:43:22.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:22 smithi063 ceph-mon[107117]: from='mgr.14100 172.21.15.63:0/1364156162' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-12T11:43:22.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:22 smithi063 ceph-mon[107117]: from='mgr.14100 172.21.15.63:0/1364156162' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr metadata", "who": "smithi063.zjnfdi", "id": "smithi063.zjnfdi"}]: dispatch 2023-12-12T11:43:22.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:22 smithi063 ceph-mon[107117]: Manager daemon smithi063.zjnfdi is now available 2023-12-12T11:43:22.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:22 smithi063 ceph-mon[107117]: from='mgr.14100 172.21.15.63:0/1364156162' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.zjnfdi/mirror_snapshot_schedule"}]: dispatch 2023-12-12T11:43:22.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:22 smithi063 ceph-mon[107117]: from='mgr.14100 172.21.15.63:0/1364156162' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.zjnfdi/trash_purge_schedule"}]: dispatch 2023-12-12T11:43:22.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:22 smithi063 ceph-mon[107117]: from='mgr.14100 172.21.15.63:0/1364156162' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:43:22.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:22 smithi063 ceph-mon[107117]: from='mgr.14100 172.21.15.63:0/1364156162' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:43:22.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:22 smithi063 ceph-mon[107117]: from='mgr.14100 172.21.15.63:0/1364156162' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:43:24.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:23 smithi063 ceph-mon[107117]: mgrmap e3: smithi063.zjnfdi(active, since 1.00943s) 2023-12-12T11:43:25.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:24 smithi063 ceph-mon[107117]: mgrmap e4: smithi063.zjnfdi(active, since 2s) 2023-12-12T11:43:28.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:27 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/4244348130' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-12T11:43:28.344 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2023-12-12T11:43:28.344 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout { 2023-12-12T11:43:28.344 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "fsid": "85e33c70-98e3-11ee-95a3-87774f69a715", 2023-12-12T11:43:28.344 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "health": { 2023-12-12T11:43:28.344 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-12T11:43:28.345 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-12T11:43:28.345 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-12T11:43:28.345 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-12T11:43:28.345 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-12T11:43:28.345 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-12T11:43:28.345 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 0 2023-12-12T11:43:28.345 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2023-12-12T11:43:28.345 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-12T11:43:28.345 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "smithi063" 2023-12-12T11:43:28.345 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2023-12-12T11:43:28.345 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum_age": 16, 2023-12-12T11:43:28.345 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-12T11:43:28.345 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-12T11:43:28.345 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-12T11:43:28.345 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-12T11:43:28.345 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-12T11:43:28.346 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-12T11:43:28.346 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-12T11:43:28.346 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-12T11:43:28.346 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-12T11:43:28.346 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-12T11:43:28.346 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-12T11:43:28.346 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-12T11:43:28.346 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-12T11:43:28.346 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-12T11:43:28.346 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-12T11:43:28.346 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-12T11:43:28.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-12T11:43:28.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-12T11:43:28.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-12T11:43:28.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-12T11:43:28.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-12T11:43:28.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-12T11:43:28.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-12T11:43:28.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-12T11:43:28.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-12T11:43:28.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-12T11:43:28.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-12T11:43:28.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-12T11:43:28.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-12T11:43:28.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-12T11:43:28.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-12T11:43:28.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-12T11:43:28.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-12T11:43:28.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-12T11:43:28.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-12T11:43:28.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "restful" 2023-12-12T11:43:28.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2023-12-12T11:43:28.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-12T11:43:28.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-12T11:43:28.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-12T11:43:28.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-12T11:43:28.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "modified": "2023-12-12T11:43:06.421568+0000", 2023-12-12T11:43:28.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-12T11:43:28.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-12T11:43:28.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-12T11:43:28.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout } 2023-12-12T11:43:28.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.255+0000 7fe17dd77700 1 Processor -- start 2023-12-12T11:43:28.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.256+0000 7fe17dd77700 1 -- start start 2023-12-12T11:43:28.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.256+0000 7fe17dd77700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe178102140 0x7fe178102550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:28.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.256+0000 7fe17dd77700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe178102a90 con 0x7fe178102140 2023-12-12T11:43:28.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.256+0000 7fe17cd75700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe178102140 0x7fe178102550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:28.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.257+0000 7fe17cd75700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe178102140 0x7fe178102550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40150/0 (socket says 172.21.15.63:40150) 2023-12-12T11:43:28.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.257+0000 7fe17cd75700 1 -- 172.21.15.63:0/3642274348 learned_addr learned my addr 172.21.15.63:0/3642274348 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:28.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.257+0000 7fe17cd75700 1 -- 172.21.15.63:0/3642274348 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe178102bd0 con 0x7fe178102140 2023-12-12T11:43:28.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.257+0000 7fe17cd75700 1 --2- 172.21.15.63:0/3642274348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe178102140 0x7fe178102550 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0098e0 tx=0x7fe16c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0d195b19c616f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:28.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.257+0000 7fe1777fe700 1 -- 172.21.15.63:0/3642274348 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe16c00b860 con 0x7fe178102140 2023-12-12T11:43:28.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.257+0000 7fe1777fe700 1 -- 172.21.15.63:0/3642274348 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe16c00be30 con 0x7fe178102140 2023-12-12T11:43:28.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.257+0000 7fe1777fe700 1 -- 172.21.15.63:0/3642274348 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe16c010380 con 0x7fe178102140 2023-12-12T11:43:28.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.258+0000 7fe17dd77700 1 -- 172.21.15.63:0/3642274348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe178102140 msgr2=0x7fe178102550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:28.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.258+0000 7fe17dd77700 1 --2- 172.21.15.63:0/3642274348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe178102140 0x7fe178102550 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0098e0 tx=0x7fe16c009250 comp rx=0 tx=0).stop 2023-12-12T11:43:28.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.258+0000 7fe17dd77700 1 -- 172.21.15.63:0/3642274348 shutdown_connections 2023-12-12T11:43:28.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.258+0000 7fe17dd77700 1 --2- 172.21.15.63:0/3642274348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe178102140 0x7fe178102550 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:28.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.258+0000 7fe17dd77700 1 -- 172.21.15.63:0/3642274348 >> 172.21.15.63:0/3642274348 conn(0x7fe1780fd880 msgr2=0x7fe1780ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:28.356 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.258+0000 7fe17dd77700 1 -- 172.21.15.63:0/3642274348 shutdown_connections 2023-12-12T11:43:28.356 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.258+0000 7fe17dd77700 1 -- 172.21.15.63:0/3642274348 wait complete. 2023-12-12T11:43:28.356 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.259+0000 7fe17dd77700 1 Processor -- start 2023-12-12T11:43:28.356 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.259+0000 7fe17dd77700 1 -- start start 2023-12-12T11:43:28.356 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.260+0000 7fe17dd77700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe178102140 0x7fe1781131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:28.356 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.260+0000 7fe17dd77700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe178113700 con 0x7fe178102140 2023-12-12T11:43:28.356 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.260+0000 7fe17cd75700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe178102140 0x7fe1781131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:28.356 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.260+0000 7fe17cd75700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe178102140 0x7fe1781131c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40164/0 (socket says 172.21.15.63:40164) 2023-12-12T11:43:28.356 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.260+0000 7fe17cd75700 1 -- 172.21.15.63:0/4244348130 learned_addr learned my addr 172.21.15.63:0/4244348130 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:28.356 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.260+0000 7fe17cd75700 1 -- 172.21.15.63:0/4244348130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c0094f0 con 0x7fe178102140 2023-12-12T11:43:28.356 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.260+0000 7fe17cd75700 1 --2- 172.21.15.63:0/4244348130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe178102140 0x7fe1781131c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe16c000c00 tx=0x7fe16c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:28.356 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.261+0000 7fe1757fa700 1 -- 172.21.15.63:0/4244348130 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe16c010a80 con 0x7fe178102140 2023-12-12T11:43:28.356 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.261+0000 7fe1757fa700 1 -- 172.21.15.63:0/4244348130 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe16c01a430 con 0x7fe178102140 2023-12-12T11:43:28.356 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.261+0000 7fe17dd77700 1 -- 172.21.15.63:0/4244348130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe178113900 con 0x7fe178102140 2023-12-12T11:43:28.357 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.261+0000 7fe1757fa700 1 -- 172.21.15.63:0/4244348130 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe16c0245b0 con 0x7fe178102140 2023-12-12T11:43:28.357 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.261+0000 7fe17dd77700 1 -- 172.21.15.63:0/4244348130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe178113d10 con 0x7fe178102140 2023-12-12T11:43:28.357 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.262+0000 7fe1757fa700 1 -- 172.21.15.63:0/4244348130 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7fe16c01a5a0 con 0x7fe178102140 2023-12-12T11:43:28.357 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.262+0000 7fe17dd77700 1 -- 172.21.15.63:0/4244348130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17804bb80 con 0x7fe178102140 2023-12-12T11:43:28.357 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.262+0000 7fe1757fa700 1 --2- 172.21.15.63:0/4244348130 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7fe1680365a0 0x7fe168038a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:28.357 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.262+0000 7fe1757fa700 1 -- 172.21.15.63:0/4244348130 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe16c04aaf0 con 0x7fe178102140 2023-12-12T11:43:28.357 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.262+0000 7fe177fff700 1 --2- 172.21.15.63:0/4244348130 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7fe1680365a0 0x7fe168038a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:28.357 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.263+0000 7fe177fff700 1 --2- 172.21.15.63:0/4244348130 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7fe1680365a0 0x7fe168038a50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe164009990 tx=0x7fe164006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:28.357 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.268+0000 7fe1757fa700 1 -- 172.21.15.63:0/4244348130 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe16c023df0 con 0x7fe178102140 2023-12-12T11:43:28.357 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.547+0000 7fe17dd77700 1 -- 172.21.15.63:0/4244348130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fe17810d1c0 con 0x7fe178102140 2023-12-12T11:43:28.357 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.547+0000 7fe1757fa700 1 -- 172.21.15.63:0/4244348130 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fe16c023390 con 0x7fe178102140 2023-12-12T11:43:28.357 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.550+0000 7fe17dd77700 1 -- 172.21.15.63:0/4244348130 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7fe1680365a0 msgr2=0x7fe168038a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:28.357 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.550+0000 7fe17dd77700 1 --2- 172.21.15.63:0/4244348130 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7fe1680365a0 0x7fe168038a50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe164009990 tx=0x7fe164006e40 comp rx=0 tx=0).stop 2023-12-12T11:43:28.357 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.550+0000 7fe17dd77700 1 -- 172.21.15.63:0/4244348130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe178102140 msgr2=0x7fe1781131c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:28.357 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.550+0000 7fe17dd77700 1 --2- 172.21.15.63:0/4244348130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe178102140 0x7fe1781131c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe16c000c00 tx=0x7fe16c009250 comp rx=0 tx=0).stop 2023-12-12T11:43:28.358 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.550+0000 7fe17dd77700 1 -- 172.21.15.63:0/4244348130 shutdown_connections 2023-12-12T11:43:28.358 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.550+0000 7fe17dd77700 1 --2- 172.21.15.63:0/4244348130 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7fe1680365a0 0x7fe168038a50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:28.358 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.550+0000 7fe17dd77700 1 --2- 172.21.15.63:0/4244348130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe178102140 0x7fe1781131c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:28.358 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.550+0000 7fe17dd77700 1 -- 172.21.15.63:0/4244348130 >> 172.21.15.63:0/4244348130 conn(0x7fe1780fd880 msgr2=0x7fe1780ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:28.358 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.550+0000 7fe17dd77700 1 -- 172.21.15.63:0/4244348130 shutdown_connections 2023-12-12T11:43:28.358 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:27.550+0000 7fe17dd77700 1 -- 172.21.15.63:0/4244348130 wait complete. 2023-12-12T11:43:28.358 INFO:teuthology.orchestra.run.smithi063.stdout:mgr is available 2023-12-12T11:43:29.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:29 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/3519300835' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-12T11:43:29.300 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2023-12-12T11:43:29.300 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout [global] 2023-12-12T11:43:29.300 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout fsid = 85e33c70-98e3-11ee-95a3-87774f69a715 2023-12-12T11:43:29.301 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-12T11:43:29.301 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-12T11:43:29.301 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-12T11:43:29.301 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-12T11:43:29.301 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2023-12-12T11:43:29.301 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-12T11:43:29.301 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-12T11:43:29.301 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2023-12-12T11:43:29.301 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout [osd] 2023-12-12T11:43:29.301 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-12T11:43:29.301 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-12T11:43:29.301 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-12T11:43:29.301 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-12T11:43:29.301 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-12T11:43:29.302 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.743+0000 7f0135d5e700 1 Processor -- start 2023-12-12T11:43:29.302 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.743+0000 7f0135d5e700 1 -- start start 2023-12-12T11:43:29.302 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.744+0000 7f0135d5e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0130077bf0 0x7f0130076100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:29.302 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.744+0000 7f0135d5e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0130078000 con 0x7f0130077bf0 2023-12-12T11:43:29.302 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.744+0000 7f012f7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0130077bf0 0x7f0130076100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:29.302 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.744+0000 7f012f7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0130077bf0 0x7f0130076100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36602/0 (socket says 172.21.15.63:36602) 2023-12-12T11:43:29.302 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.744+0000 7f012f7fe700 1 -- 172.21.15.63:0/2506522808 learned_addr learned my addr 172.21.15.63:0/2506522808 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:29.302 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.745+0000 7f012f7fe700 1 -- 172.21.15.63:0/2506522808 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0130076640 con 0x7f0130077bf0 2023-12-12T11:43:29.302 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.745+0000 7f012f7fe700 1 --2- 172.21.15.63:0/2506522808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0130077bf0 0x7f0130076100 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f01200098e0 tx=0x7f0120009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b86e6317ccc49e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:29.302 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.745+0000 7f012e7fc700 1 -- 172.21.15.63:0/2506522808 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f012000b860 con 0x7f0130077bf0 2023-12-12T11:43:29.302 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.745+0000 7f012e7fc700 1 -- 172.21.15.63:0/2506522808 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f012000be30 con 0x7f0130077bf0 2023-12-12T11:43:29.302 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.745+0000 7f012e7fc700 1 -- 172.21.15.63:0/2506522808 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0120010380 con 0x7f0130077bf0 2023-12-12T11:43:29.302 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.746+0000 7f0135d5e700 1 -- 172.21.15.63:0/2506522808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0130077bf0 msgr2=0x7f0130076100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:29.302 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.746+0000 7f0135d5e700 1 --2- 172.21.15.63:0/2506522808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0130077bf0 0x7f0130076100 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f01200098e0 tx=0x7f0120009250 comp rx=0 tx=0).stop 2023-12-12T11:43:29.303 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.746+0000 7f0135d5e700 1 -- 172.21.15.63:0/2506522808 shutdown_connections 2023-12-12T11:43:29.303 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.746+0000 7f0135d5e700 1 --2- 172.21.15.63:0/2506522808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0130077bf0 0x7f0130076100 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:29.303 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.746+0000 7f0135d5e700 1 -- 172.21.15.63:0/2506522808 >> 172.21.15.63:0/2506522808 conn(0x7f01300fda50 msgr2=0x7f01300ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:29.303 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.746+0000 7f0135d5e700 1 -- 172.21.15.63:0/2506522808 shutdown_connections 2023-12-12T11:43:29.303 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.746+0000 7f0135d5e700 1 -- 172.21.15.63:0/2506522808 wait complete. 2023-12-12T11:43:29.303 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.747+0000 7f0135d5e700 1 Processor -- start 2023-12-12T11:43:29.303 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.747+0000 7f0135d5e700 1 -- start start 2023-12-12T11:43:29.303 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.748+0000 7f0135d5e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0130077bf0 0x7f0130113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:29.303 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.748+0000 7f0135d5e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01301138c0 con 0x7f0130077bf0 2023-12-12T11:43:29.303 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.748+0000 7f012f7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0130077bf0 0x7f0130113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:29.303 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.748+0000 7f012f7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0130077bf0 0x7f0130113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36612/0 (socket says 172.21.15.63:36612) 2023-12-12T11:43:29.304 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.748+0000 7f012f7fe700 1 -- 172.21.15.63:0/3519300835 learned_addr learned my addr 172.21.15.63:0/3519300835 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:29.304 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.748+0000 7f012f7fe700 1 -- 172.21.15.63:0/3519300835 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01200094f0 con 0x7f0130077bf0 2023-12-12T11:43:29.304 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.749+0000 7f012f7fe700 1 --2- 172.21.15.63:0/3519300835 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0130077bf0 0x7f0130113380 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0120006b00 tx=0x7f0120009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:29.304 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.749+0000 7f0127fff700 1 -- 172.21.15.63:0/3519300835 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0120010a80 con 0x7f0130077bf0 2023-12-12T11:43:29.304 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.749+0000 7f0127fff700 1 -- 172.21.15.63:0/3519300835 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f012001a430 con 0x7f0130077bf0 2023-12-12T11:43:29.304 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.749+0000 7f0135d5e700 1 -- 172.21.15.63:0/3519300835 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0130113ac0 con 0x7f0130077bf0 2023-12-12T11:43:29.304 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.749+0000 7f0127fff700 1 -- 172.21.15.63:0/3519300835 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f01200245b0 con 0x7f0130077bf0 2023-12-12T11:43:29.304 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.749+0000 7f0135d5e700 1 -- 172.21.15.63:0/3519300835 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0130113ed0 con 0x7f0130077bf0 2023-12-12T11:43:29.304 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.750+0000 7f0127fff700 1 -- 172.21.15.63:0/3519300835 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7f0120010be0 con 0x7f0130077bf0 2023-12-12T11:43:29.304 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.750+0000 7f0135d5e700 1 -- 172.21.15.63:0/3519300835 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f013004bb80 con 0x7f0130077bf0 2023-12-12T11:43:29.304 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.751+0000 7f0127fff700 1 --2- 172.21.15.63:0/3519300835 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7f011c0365f0 0x7f011c038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:29.304 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.751+0000 7f0127fff700 1 -- 172.21.15.63:0/3519300835 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f012004aa50 con 0x7f0130077bf0 2023-12-12T11:43:29.304 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.751+0000 7f012effd700 1 --2- 172.21.15.63:0/3519300835 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7f011c0365f0 0x7f011c038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:29.304 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.751+0000 7f012effd700 1 --2- 172.21.15.63:0/3519300835 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7f011c0365f0 0x7f011c038aa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0118009990 tx=0x7f0118006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:29.305 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.755+0000 7f0127fff700 1 -- 172.21.15.63:0/3519300835 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f012002e440 con 0x7f0130077bf0 2023-12-12T11:43:29.305 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.957+0000 7f0135d5e700 1 -- 172.21.15.63:0/3519300835 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f0130108570 con 0x7f0130077bf0 2023-12-12T11:43:29.305 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.958+0000 7f0127fff700 1 -- 172.21.15.63:0/3519300835 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f0120023390 con 0x7f0130077bf0 2023-12-12T11:43:29.305 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.960+0000 7f0135d5e700 1 -- 172.21.15.63:0/3519300835 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7f011c0365f0 msgr2=0x7f011c038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:29.305 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.960+0000 7f0135d5e700 1 --2- 172.21.15.63:0/3519300835 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7f011c0365f0 0x7f011c038aa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0118009990 tx=0x7f0118006e40 comp rx=0 tx=0).stop 2023-12-12T11:43:29.305 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.960+0000 7f0135d5e700 1 -- 172.21.15.63:0/3519300835 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0130077bf0 msgr2=0x7f0130113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:29.305 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.960+0000 7f0135d5e700 1 --2- 172.21.15.63:0/3519300835 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0130077bf0 0x7f0130113380 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0120006b00 tx=0x7f0120009250 comp rx=0 tx=0).stop 2023-12-12T11:43:29.305 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.960+0000 7f0135d5e700 1 -- 172.21.15.63:0/3519300835 shutdown_connections 2023-12-12T11:43:29.305 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.960+0000 7f0135d5e700 1 --2- 172.21.15.63:0/3519300835 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7f011c0365f0 0x7f011c038aa0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:29.305 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.960+0000 7f0135d5e700 1 --2- 172.21.15.63:0/3519300835 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0130077bf0 0x7f0130113380 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:29.305 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.960+0000 7f0135d5e700 1 -- 172.21.15.63:0/3519300835 >> 172.21.15.63:0/3519300835 conn(0x7f01300fda50 msgr2=0x7f01300ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:29.305 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.961+0000 7f0135d5e700 1 -- 172.21.15.63:0/3519300835 shutdown_connections 2023-12-12T11:43:29.305 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:28.961+0000 7f0135d5e700 1 -- 172.21.15.63:0/3519300835 wait complete. 2023-12-12T11:43:29.305 INFO:teuthology.orchestra.run.smithi063.stdout:Enabling cephadm module... 2023-12-12T11:43:30.274 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:30 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/659945709' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-12-12T11:43:30.382 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.686+0000 7f9eed494700 1 Processor -- start 2023-12-12T11:43:30.383 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.686+0000 7f9eed494700 1 -- start start 2023-12-12T11:43:30.383 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.686+0000 7f9eed494700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ee8077bb0 0x7f9ee80760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:30.383 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.686+0000 7f9eed494700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee8077fc0 con 0x7f9ee8077bb0 2023-12-12T11:43:30.383 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.687+0000 7f9ee6ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ee8077bb0 0x7f9ee80760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:30.383 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.687+0000 7f9ee6ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ee8077bb0 0x7f9ee80760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36622/0 (socket says 172.21.15.63:36622) 2023-12-12T11:43:30.383 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.687+0000 7f9ee6ffd700 1 -- 172.21.15.63:0/734570098 learned_addr learned my addr 172.21.15.63:0/734570098 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:30.383 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.687+0000 7f9ee6ffd700 1 -- 172.21.15.63:0/734570098 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee8076600 con 0x7f9ee8077bb0 2023-12-12T11:43:30.383 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.687+0000 7f9ee6ffd700 1 --2- 172.21.15.63:0/734570098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ee8077bb0 0x7f9ee80760c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9ed80098e0 tx=0x7f9ed8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890135c2b8de69cc server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:30.383 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.688+0000 7f9ee5ffb700 1 -- 172.21.15.63:0/734570098 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ed800b860 con 0x7f9ee8077bb0 2023-12-12T11:43:30.383 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.688+0000 7f9ee5ffb700 1 -- 172.21.15.63:0/734570098 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f9ed800be30 con 0x7f9ee8077bb0 2023-12-12T11:43:30.383 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.688+0000 7f9ee5ffb700 1 -- 172.21.15.63:0/734570098 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ed8010380 con 0x7f9ee8077bb0 2023-12-12T11:43:30.383 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.688+0000 7f9eed494700 1 -- 172.21.15.63:0/734570098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ee8077bb0 msgr2=0x7f9ee80760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:30.383 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.688+0000 7f9eed494700 1 --2- 172.21.15.63:0/734570098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ee8077bb0 0x7f9ee80760c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9ed80098e0 tx=0x7f9ed8009250 comp rx=0 tx=0).stop 2023-12-12T11:43:30.383 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.688+0000 7f9eed494700 1 -- 172.21.15.63:0/734570098 shutdown_connections 2023-12-12T11:43:30.384 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.688+0000 7f9eed494700 1 --2- 172.21.15.63:0/734570098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ee8077bb0 0x7f9ee80760c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:30.384 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.688+0000 7f9eed494700 1 -- 172.21.15.63:0/734570098 >> 172.21.15.63:0/734570098 conn(0x7f9ee80fda50 msgr2=0x7f9ee80ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:30.384 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.688+0000 7f9eed494700 1 -- 172.21.15.63:0/734570098 shutdown_connections 2023-12-12T11:43:30.384 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.688+0000 7f9eed494700 1 -- 172.21.15.63:0/734570098 wait complete. 2023-12-12T11:43:30.384 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.689+0000 7f9eed494700 1 Processor -- start 2023-12-12T11:43:30.384 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.689+0000 7f9eed494700 1 -- start start 2023-12-12T11:43:30.384 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.690+0000 7f9eed494700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ee8077bb0 0x7f9ee81133a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:30.384 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.690+0000 7f9eed494700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee81138e0 con 0x7f9ee8077bb0 2023-12-12T11:43:30.384 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.690+0000 7f9ee6ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ee8077bb0 0x7f9ee81133a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:30.384 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.690+0000 7f9ee6ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ee8077bb0 0x7f9ee81133a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36638/0 (socket says 172.21.15.63:36638) 2023-12-12T11:43:30.384 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.690+0000 7f9ee6ffd700 1 -- 172.21.15.63:0/659945709 learned_addr learned my addr 172.21.15.63:0/659945709 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:30.384 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.690+0000 7f9ee6ffd700 1 -- 172.21.15.63:0/659945709 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed80094f0 con 0x7f9ee8077bb0 2023-12-12T11:43:30.384 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.691+0000 7f9ee6ffd700 1 --2- 172.21.15.63:0/659945709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ee8077bb0 0x7f9ee81133a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8006fd0 tx=0x7f9ed8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:30.384 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.691+0000 7f9ecf7fe700 1 -- 172.21.15.63:0/659945709 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ed8010750 con 0x7f9ee8077bb0 2023-12-12T11:43:30.385 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.691+0000 7f9ecf7fe700 1 -- 172.21.15.63:0/659945709 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f9ed8010d20 con 0x7f9ee8077bb0 2023-12-12T11:43:30.385 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.691+0000 7f9ecf7fe700 1 -- 172.21.15.63:0/659945709 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ed801ad90 con 0x7f9ee8077bb0 2023-12-12T11:43:30.385 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.691+0000 7f9eed494700 1 -- 172.21.15.63:0/659945709 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee8113ae0 con 0x7f9ee8077bb0 2023-12-12T11:43:30.385 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.691+0000 7f9eed494700 1 -- 172.21.15.63:0/659945709 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee8113ef0 con 0x7f9ee8077bb0 2023-12-12T11:43:30.385 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.692+0000 7f9eed494700 1 -- 172.21.15.63:0/659945709 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee804bb80 con 0x7f9ee8077bb0 2023-12-12T11:43:30.385 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.692+0000 7f9ecf7fe700 1 -- 172.21.15.63:0/659945709 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7f9ed801a460 con 0x7f9ee8077bb0 2023-12-12T11:43:30.385 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.693+0000 7f9ecf7fe700 1 --2- 172.21.15.63:0/659945709 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7f9ed00365f0 0x7f9ed0038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:30.385 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.693+0000 7f9ecf7fe700 1 -- 172.21.15.63:0/659945709 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f9ed8049a80 con 0x7f9ee8077bb0 2023-12-12T11:43:30.386 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.693+0000 7f9ee67fc700 1 --2- 172.21.15.63:0/659945709 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7f9ed00365f0 0x7f9ed0038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:30.386 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.693+0000 7f9ee67fc700 1 --2- 172.21.15.63:0/659945709 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7f9ed00365f0 0x7f9ed0038aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9edc009990 tx=0x7f9edc006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:30.386 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.697+0000 7f9ecf7fe700 1 -- 172.21.15.63:0/659945709 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9ed8022ac0 con 0x7f9ee8077bb0 2023-12-12T11:43:30.386 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:29.953+0000 7f9eed494700 1 -- 172.21.15.63:0/659945709 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f9ee80008d0 con 0x7f9ee8077bb0 2023-12-12T11:43:30.386 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.014+0000 7f9ecf7fe700 1 -- 172.21.15.63:0/659945709 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f9ed802ad40 con 0x7f9ee8077bb0 2023-12-12T11:43:30.387 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.016+0000 7f9ecf7fe700 1 -- 172.21.15.63:0/659945709 <== mon.0 v2:172.21.15.63:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f9ed804b6d0 con 0x7f9ee8077bb0 2023-12-12T11:43:30.387 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.018+0000 7f9eed494700 1 -- 172.21.15.63:0/659945709 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7f9ed00365f0 msgr2=0x7f9ed0038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:30.387 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.018+0000 7f9eed494700 1 --2- 172.21.15.63:0/659945709 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7f9ed00365f0 0x7f9ed0038aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9edc009990 tx=0x7f9edc006e40 comp rx=0 tx=0).stop 2023-12-12T11:43:30.387 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.018+0000 7f9eed494700 1 -- 172.21.15.63:0/659945709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ee8077bb0 msgr2=0x7f9ee81133a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:30.387 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.018+0000 7f9eed494700 1 --2- 172.21.15.63:0/659945709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ee8077bb0 0x7f9ee81133a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8006fd0 tx=0x7f9ed8009250 comp rx=0 tx=0).stop 2023-12-12T11:43:30.387 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.018+0000 7f9eed494700 1 -- 172.21.15.63:0/659945709 shutdown_connections 2023-12-12T11:43:30.387 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.018+0000 7f9eed494700 1 --2- 172.21.15.63:0/659945709 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7f9ed00365f0 0x7f9ed0038aa0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:30.387 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.018+0000 7f9eed494700 1 --2- 172.21.15.63:0/659945709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ee8077bb0 0x7f9ee81133a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:30.387 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.018+0000 7f9eed494700 1 -- 172.21.15.63:0/659945709 >> 172.21.15.63:0/659945709 conn(0x7f9ee80fda50 msgr2=0x7f9ee80ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:30.387 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.018+0000 7f9eed494700 1 -- 172.21.15.63:0/659945709 shutdown_connections 2023-12-12T11:43:30.387 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.018+0000 7f9eed494700 1 -- 172.21.15.63:0/659945709 wait complete. 2023-12-12T11:43:31.291 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:31 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/659945709' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-12-12T11:43:31.292 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:31 smithi063 ceph-mon[107117]: mgrmap e5: smithi063.zjnfdi(active, since 8s) 2023-12-12T11:43:31.454 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout { 2023-12-12T11:43:31.454 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-12-12T11:43:31.454 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-12T11:43:31.454 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "active_name": "smithi063.zjnfdi", 2023-12-12T11:43:31.454 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-12T11:43:31.455 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout } 2023-12-12T11:43:31.455 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.811+0000 7fad1759e700 1 Processor -- start 2023-12-12T11:43:31.455 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.812+0000 7fad1759e700 1 -- start start 2023-12-12T11:43:31.455 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.812+0000 7fad1759e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad18077bb0 0x7fad180760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:31.455 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.812+0000 7fad1759e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad18077fc0 con 0x7fad18077bb0 2023-12-12T11:43:31.455 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.812+0000 7fad1659c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad18077bb0 0x7fad180760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:31.455 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.812+0000 7fad1659c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad18077bb0 0x7fad180760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36668/0 (socket says 172.21.15.63:36668) 2023-12-12T11:43:31.455 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.812+0000 7fad1659c700 1 -- 172.21.15.63:0/3422784102 learned_addr learned my addr 172.21.15.63:0/3422784102 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:31.455 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.813+0000 7fad1659c700 1 -- 172.21.15.63:0/3422784102 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad18076600 con 0x7fad18077bb0 2023-12-12T11:43:31.456 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.813+0000 7fad1659c700 1 --2- 172.21.15.63:0/3422784102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad18077bb0 0x7fad180760c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fad080098e0 tx=0x7fad08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b23549d6ca586d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:31.456 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.813+0000 7fad1559a700 1 -- 172.21.15.63:0/3422784102 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad0800b860 con 0x7fad18077bb0 2023-12-12T11:43:31.456 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.813+0000 7fad1559a700 1 -- 172.21.15.63:0/3422784102 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fad0800be30 con 0x7fad18077bb0 2023-12-12T11:43:31.456 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.813+0000 7fad1559a700 1 -- 172.21.15.63:0/3422784102 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad08010380 con 0x7fad18077bb0 2023-12-12T11:43:31.456 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.814+0000 7fad1759e700 1 -- 172.21.15.63:0/3422784102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad18077bb0 msgr2=0x7fad180760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:31.456 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.814+0000 7fad1759e700 1 --2- 172.21.15.63:0/3422784102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad18077bb0 0x7fad180760c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fad080098e0 tx=0x7fad08009250 comp rx=0 tx=0).stop 2023-12-12T11:43:31.456 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.814+0000 7fad1759e700 1 -- 172.21.15.63:0/3422784102 shutdown_connections 2023-12-12T11:43:31.456 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.814+0000 7fad1759e700 1 --2- 172.21.15.63:0/3422784102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad18077bb0 0x7fad180760c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:31.456 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.814+0000 7fad1759e700 1 -- 172.21.15.63:0/3422784102 >> 172.21.15.63:0/3422784102 conn(0x7fad180fd880 msgr2=0x7fad180ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:31.456 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.814+0000 7fad1759e700 1 -- 172.21.15.63:0/3422784102 shutdown_connections 2023-12-12T11:43:31.456 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.814+0000 7fad1759e700 1 -- 172.21.15.63:0/3422784102 wait complete. 2023-12-12T11:43:31.456 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.815+0000 7fad1759e700 1 Processor -- start 2023-12-12T11:43:31.456 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.815+0000 7fad1759e700 1 -- start start 2023-12-12T11:43:31.456 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.815+0000 7fad1759e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad18077bb0 0x7fad18113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:31.457 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.815+0000 7fad1759e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad18113740 con 0x7fad18077bb0 2023-12-12T11:43:31.457 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.816+0000 7fad1659c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad18077bb0 0x7fad18113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:31.457 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.816+0000 7fad1659c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad18077bb0 0x7fad18113200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36684/0 (socket says 172.21.15.63:36684) 2023-12-12T11:43:31.457 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.816+0000 7fad1659c700 1 -- 172.21.15.63:0/4142348871 learned_addr learned my addr 172.21.15.63:0/4142348871 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:31.457 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.816+0000 7fad1659c700 1 -- 172.21.15.63:0/4142348871 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad080094f0 con 0x7fad18077bb0 2023-12-12T11:43:31.457 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.816+0000 7fad1659c700 1 --2- 172.21.15.63:0/4142348871 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad18077bb0 0x7fad18113200 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fad08006fd0 tx=0x7fad08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:31.457 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.817+0000 7fad06ffd700 1 -- 172.21.15.63:0/4142348871 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad08010750 con 0x7fad18077bb0 2023-12-12T11:43:31.457 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.817+0000 7fad1759e700 1 -- 172.21.15.63:0/4142348871 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad18113940 con 0x7fad18077bb0 2023-12-12T11:43:31.457 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.817+0000 7fad06ffd700 1 -- 172.21.15.63:0/4142348871 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fad08010d20 con 0x7fad18077bb0 2023-12-12T11:43:31.457 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.817+0000 7fad06ffd700 1 -- 172.21.15.63:0/4142348871 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad0801ad90 con 0x7fad18077bb0 2023-12-12T11:43:31.457 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.817+0000 7fad1759e700 1 -- 172.21.15.63:0/4142348871 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad18113d50 con 0x7fad18077bb0 2023-12-12T11:43:31.457 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.818+0000 7fad1759e700 1 -- 172.21.15.63:0/4142348871 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad1804bb80 con 0x7fad18077bb0 2023-12-12T11:43:31.457 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.818+0000 7fad06ffd700 1 -- 172.21.15.63:0/4142348871 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fad0801a460 con 0x7fad18077bb0 2023-12-12T11:43:31.457 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.819+0000 7fad06ffd700 1 --2- 172.21.15.63:0/4142348871 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7fad000365f0 0x7fad00038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:31.458 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.819+0000 7fad06ffd700 1 -- 172.21.15.63:0/4142348871 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fad08049b50 con 0x7fad18077bb0 2023-12-12T11:43:31.458 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.819+0000 7fad15d9b700 1 -- 172.21.15.63:0/4142348871 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7fad000365f0 msgr2=0x7fad00038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/1972453923 2023-12-12T11:43:31.458 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.819+0000 7fad15d9b700 1 --2- 172.21.15.63:0/4142348871 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7fad000365f0 0x7fad00038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T11:43:31.458 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:30.823+0000 7fad06ffd700 1 -- 172.21.15.63:0/4142348871 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fad080108b0 con 0x7fad18077bb0 2023-12-12T11:43:31.458 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.020+0000 7fad15d9b700 1 -- 172.21.15.63:0/4142348871 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7fad000365f0 msgr2=0x7fad00038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/1972453923 2023-12-12T11:43:31.458 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.020+0000 7fad15d9b700 1 --2- 172.21.15.63:0/4142348871 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7fad000365f0 0x7fad00038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-12T11:43:31.458 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.083+0000 7fad1759e700 1 -- 172.21.15.63:0/4142348871 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fad1810d000 con 0x7fad18077bb0 2023-12-12T11:43:31.458 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.084+0000 7fad06ffd700 1 -- 172.21.15.63:0/4142348871 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7fad08020070 con 0x7fad18077bb0 2023-12-12T11:43:31.458 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.086+0000 7fad1759e700 1 -- 172.21.15.63:0/4142348871 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7fad000365f0 msgr2=0x7fad00038aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-12T11:43:31.458 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.086+0000 7fad1759e700 1 --2- 172.21.15.63:0/4142348871 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7fad000365f0 0x7fad00038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:31.458 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.086+0000 7fad1759e700 1 -- 172.21.15.63:0/4142348871 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad18077bb0 msgr2=0x7fad18113200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:31.458 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.086+0000 7fad1759e700 1 --2- 172.21.15.63:0/4142348871 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad18077bb0 0x7fad18113200 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fad08006fd0 tx=0x7fad08009250 comp rx=0 tx=0).stop 2023-12-12T11:43:31.458 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.086+0000 7fad1759e700 1 -- 172.21.15.63:0/4142348871 shutdown_connections 2023-12-12T11:43:31.459 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.086+0000 7fad1759e700 1 --2- 172.21.15.63:0/4142348871 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7fad000365f0 0x7fad00038aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:31.459 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.086+0000 7fad1759e700 1 --2- 172.21.15.63:0/4142348871 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad18077bb0 0x7fad18113200 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:31.459 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.086+0000 7fad1759e700 1 -- 172.21.15.63:0/4142348871 >> 172.21.15.63:0/4142348871 conn(0x7fad180fd880 msgr2=0x7fad180ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:31.459 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.086+0000 7fad1759e700 1 -- 172.21.15.63:0/4142348871 shutdown_connections 2023-12-12T11:43:31.459 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.086+0000 7fad1759e700 1 -- 172.21.15.63:0/4142348871 wait complete. 2023-12-12T11:43:31.459 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for the mgr to restart... 2023-12-12T11:43:31.459 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for mgr epoch 5... 2023-12-12T11:43:32.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:32 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/4142348871' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-12T11:43:38.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:38 smithi063 ceph-mon[107117]: Active manager daemon smithi063.zjnfdi restarted 2023-12-12T11:43:38.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:38 smithi063 ceph-mon[107117]: Activating manager daemon smithi063.zjnfdi 2023-12-12T11:43:38.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:38 smithi063 ceph-mon[107117]: osdmap e2: 0 total, 0 up, 0 in 2023-12-12T11:43:38.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:38 smithi063 ceph-mon[107117]: mgrmap e6: smithi063.zjnfdi(active, starting, since 0.00586445s) 2023-12-12T11:43:38.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:38 smithi063 ceph-mon[107117]: from='mgr.14120 172.21.15.63:0/3652348595' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-12T11:43:38.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:38 smithi063 ceph-mon[107117]: from='mgr.14120 172.21.15.63:0/3652348595' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr metadata", "who": "smithi063.zjnfdi", "id": "smithi063.zjnfdi"}]: dispatch 2023-12-12T11:43:38.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:38 smithi063 ceph-mon[107117]: from='mgr.14120 172.21.15.63:0/3652348595' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-12T11:43:38.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:38 smithi063 ceph-mon[107117]: from='mgr.14120 172.21.15.63:0/3652348595' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-12T11:43:38.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:38 smithi063 ceph-mon[107117]: from='mgr.14120 172.21.15.63:0/3652348595' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-12T11:43:38.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:38 smithi063 ceph-mon[107117]: Manager daemon smithi063.zjnfdi is now available 2023-12-12T11:43:38.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:38 smithi063 ceph-mon[107117]: from='mgr.14120 172.21.15.63:0/3652348595' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:43:38.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:38 smithi063 ceph-mon[107117]: from='mgr.14120 172.21.15.63:0/3652348595' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:43:38.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:38 smithi063 ceph-mon[107117]: from='mgr.14120 172.21.15.63:0/3652348595' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:43:38.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:38 smithi063 ceph-mon[107117]: from='mgr.14120 172.21.15.63:0/3652348595' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:43:39.982 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout { 2023-12-12T11:43:39.982 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-12-12T11:43:39.983 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-12T11:43:39.983 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout } 2023-12-12T11:43:39.983 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.862+0000 7f2fa6ca9700 1 Processor -- start 2023-12-12T11:43:39.983 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.862+0000 7f2fa6ca9700 1 -- start start 2023-12-12T11:43:39.983 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.862+0000 7f2fa6ca9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa0077b90 0x7f2fa00760a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:39.983 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.862+0000 7f2fa6ca9700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa0077fa0 con 0x7f2fa0077b90 2023-12-12T11:43:39.983 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.863+0000 7f2fa4a45700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa0077b90 0x7f2fa00760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:39.983 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:39 smithi063 ceph-mon[107117]: Found migration_current of "None". Setting to last migration. 2023-12-12T11:43:39.983 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:39 smithi063 ceph-mon[107117]: from='mgr.14120 172.21.15.63:0/3652348595' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:43:39.983 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:39 smithi063 ceph-mon[107117]: from='mgr.14120 172.21.15.63:0/3652348595' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.zjnfdi/mirror_snapshot_schedule"}]: dispatch 2023-12-12T11:43:39.984 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:39 smithi063 ceph-mon[107117]: from='mgr.14120 172.21.15.63:0/3652348595' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.zjnfdi/trash_purge_schedule"}]: dispatch 2023-12-12T11:43:39.984 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:39 smithi063 ceph-mon[107117]: mgrmap e7: smithi063.zjnfdi(active, since 1.00783s) 2023-12-12T11:43:39.990 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.863+0000 7f2fa4a45700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa0077b90 0x7f2fa00760a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36700/0 (socket says 172.21.15.63:36700) 2023-12-12T11:43:39.990 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.863+0000 7f2fa4a45700 1 -- 172.21.15.63:0/626136783 learned_addr learned my addr 172.21.15.63:0/626136783 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:39.990 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.863+0000 7f2fa4a45700 1 -- 172.21.15.63:0/626136783 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa00765e0 con 0x7f2fa0077b90 2023-12-12T11:43:39.990 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.863+0000 7f2fa4a45700 1 --2- 172.21.15.63:0/626136783 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa0077b90 0x7f2fa00760a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2f940098e0 tx=0x7f2f94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8204f12f1cdb157f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:39.990 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.864+0000 7f2f9f7fe700 1 -- 172.21.15.63:0/626136783 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f9400b860 con 0x7f2fa0077b90 2023-12-12T11:43:39.990 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.864+0000 7f2f9f7fe700 1 -- 172.21.15.63:0/626136783 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f2f9400be30 con 0x7f2fa0077b90 2023-12-12T11:43:39.991 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.864+0000 7f2f9f7fe700 1 -- 172.21.15.63:0/626136783 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f94010380 con 0x7f2fa0077b90 2023-12-12T11:43:39.991 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.864+0000 7f2fa6ca9700 1 -- 172.21.15.63:0/626136783 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa0077b90 msgr2=0x7f2fa00760a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:39.991 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.864+0000 7f2fa6ca9700 1 --2- 172.21.15.63:0/626136783 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa0077b90 0x7f2fa00760a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2f940098e0 tx=0x7f2f94009250 comp rx=0 tx=0).stop 2023-12-12T11:43:39.991 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.864+0000 7f2fa6ca9700 1 -- 172.21.15.63:0/626136783 shutdown_connections 2023-12-12T11:43:39.991 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.864+0000 7f2fa6ca9700 1 --2- 172.21.15.63:0/626136783 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa0077b90 0x7f2fa00760a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:39.991 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.864+0000 7f2fa6ca9700 1 -- 172.21.15.63:0/626136783 >> 172.21.15.63:0/626136783 conn(0x7f2fa00fda50 msgr2=0x7f2fa00ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:39.991 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.864+0000 7f2fa6ca9700 1 -- 172.21.15.63:0/626136783 shutdown_connections 2023-12-12T11:43:39.991 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.865+0000 7f2fa6ca9700 1 -- 172.21.15.63:0/626136783 wait complete. 2023-12-12T11:43:39.991 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.866+0000 7f2fa6ca9700 1 Processor -- start 2023-12-12T11:43:39.991 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.866+0000 7f2fa6ca9700 1 -- start start 2023-12-12T11:43:39.991 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.866+0000 7f2fa6ca9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa0077b90 0x7f2fa0113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:39.991 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.866+0000 7f2fa6ca9700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa01138c0 con 0x7f2fa0077b90 2023-12-12T11:43:39.991 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.867+0000 7f2fa4a45700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa0077b90 0x7f2fa0113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:39.991 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.867+0000 7f2fa4a45700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa0077b90 0x7f2fa0113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36706/0 (socket says 172.21.15.63:36706) 2023-12-12T11:43:39.992 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.867+0000 7f2fa4a45700 1 -- 172.21.15.63:0/1935465341 learned_addr learned my addr 172.21.15.63:0/1935465341 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:39.992 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.867+0000 7f2fa4a45700 1 -- 172.21.15.63:0/1935465341 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f940094f0 con 0x7f2fa0077b90 2023-12-12T11:43:39.992 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.867+0000 7f2fa4a45700 1 --2- 172.21.15.63:0/1935465341 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa0077b90 0x7f2fa0113380 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2f94006b00 tx=0x7f2f94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:39.992 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.868+0000 7f2f9d7fa700 1 -- 172.21.15.63:0/1935465341 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f94010a80 con 0x7f2fa0077b90 2023-12-12T11:43:39.992 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.868+0000 7f2f9d7fa700 1 -- 172.21.15.63:0/1935465341 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f2f9401a430 con 0x7f2fa0077b90 2023-12-12T11:43:39.992 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.868+0000 7f2f9d7fa700 1 -- 172.21.15.63:0/1935465341 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f940245b0 con 0x7f2fa0077b90 2023-12-12T11:43:39.992 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.868+0000 7f2fa6ca9700 1 -- 172.21.15.63:0/1935465341 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa0113ac0 con 0x7f2fa0077b90 2023-12-12T11:43:39.992 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.868+0000 7f2fa6ca9700 1 -- 172.21.15.63:0/1935465341 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa0113ed0 con 0x7f2fa0077b90 2023-12-12T11:43:39.992 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.869+0000 7f2f9d7fa700 1 -- 172.21.15.63:0/1935465341 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f2f94010be0 con 0x7f2fa0077b90 2023-12-12T11:43:39.992 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.869+0000 7f2f9d7fa700 1 --2- 172.21.15.63:0/1935465341 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7f2f900365f0 0x7f2f90038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:39.992 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.869+0000 7f2f9d7fa700 1 -- 172.21.15.63:0/1935465341 --> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2f900391b0 con 0x7f2f900365f0 2023-12-12T11:43:39.992 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.870+0000 7f2f9d7fa700 1 -- 172.21.15.63:0/1935465341 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f2f9404ab10 con 0x7f2fa0077b90 2023-12-12T11:43:39.992 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.870+0000 7f2f9ffff700 1 -- 172.21.15.63:0/1935465341 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7f2f900365f0 msgr2=0x7f2f90038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/1972453923 2023-12-12T11:43:39.992 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:31.870+0000 7f2f9ffff700 1 --2- 172.21.15.63:0/1935465341 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7f2f900365f0 0x7f2f90038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T11:43:39.992 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:32.071+0000 7f2f9ffff700 1 -- 172.21.15.63:0/1935465341 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7f2f900365f0 msgr2=0x7f2f90038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/1972453923 2023-12-12T11:43:39.993 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:32.071+0000 7f2f9ffff700 1 --2- 172.21.15.63:0/1935465341 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7f2f900365f0 0x7f2f90038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-12T11:43:39.993 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:32.472+0000 7f2f9ffff700 1 -- 172.21.15.63:0/1935465341 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7f2f900365f0 msgr2=0x7f2f90038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/1972453923 2023-12-12T11:43:39.993 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:32.472+0000 7f2f9ffff700 1 --2- 172.21.15.63:0/1935465341 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7f2f900365f0 0x7f2f90038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-12T11:43:39.993 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:33.273+0000 7f2f9ffff700 1 -- 172.21.15.63:0/1935465341 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7f2f900365f0 msgr2=0x7f2f90038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/1972453923 2023-12-12T11:43:39.993 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:33.273+0000 7f2f9ffff700 1 --2- 172.21.15.63:0/1935465341 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7f2f900365f0 0x7f2f90038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-12T11:43:39.993 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:34.875+0000 7f2f9ffff700 1 -- 172.21.15.63:0/1935465341 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7f2f900365f0 msgr2=0x7f2f90038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/1972453923 2023-12-12T11:43:39.993 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:34.875+0000 7f2f9ffff700 1 --2- 172.21.15.63:0/1935465341 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7f2f900365f0 0x7f2f90038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-12T11:43:39.993 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:38.078+0000 7f2f9ffff700 1 -- 172.21.15.63:0/1935465341 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7f2f900365f0 msgr2=0x7f2f90038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/1972453923 2023-12-12T11:43:39.993 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:38.078+0000 7f2f9ffff700 1 --2- 172.21.15.63:0/1935465341 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7f2f900365f0 0x7f2f90038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-12-12T11:43:39.993 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:38.665+0000 7f2f9d7fa700 1 -- 172.21.15.63:0/1935465341 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mgrmap(e 6) v1 ==== 43048+0+0 (secure 0 0 0) 0x7f2f9402e960 con 0x7f2fa0077b90 2023-12-12T11:43:39.993 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:38.666+0000 7f2f9d7fa700 1 -- 172.21.15.63:0/1935465341 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7f2f900365f0 msgr2=0x7f2f90038aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-12T11:43:39.993 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:38.666+0000 7f2f9d7fa700 1 --2- 172.21.15.63:0/1935465341 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7f2f900365f0 0x7f2f90038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:39.993 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:39.666+0000 7f2f9d7fa700 1 -- 172.21.15.63:0/1935465341 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7f2f94023390 con 0x7f2fa0077b90 2023-12-12T11:43:39.994 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:39.666+0000 7f2f9d7fa700 1 --2- 172.21.15.63:0/1935465341 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f2f90039f60 0x7f2f9003c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:39.994 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:39.666+0000 7f2f9d7fa700 1 -- 172.21.15.63:0/1935465341 --> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2f900391b0 con 0x7f2f90039f60 2023-12-12T11:43:39.994 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:39.667+0000 7f2f9ffff700 1 --2- 172.21.15.63:0/1935465341 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f2f90039f60 0x7f2f9003c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:39.994 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:39.668+0000 7f2f9ffff700 1 --2- 172.21.15.63:0/1935465341 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f2f90039f60 0x7f2f9003c340 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c0039d0 tx=0x7f2f8c009350 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:39.994 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:39.669+0000 7f2f9d7fa700 1 -- 172.21.15.63:0/1935465341 <== mgr.14120 v2:172.21.15.63:6800/4048286824 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f2f900391b0 con 0x7f2f90039f60 2023-12-12T11:43:39.994 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:39.675+0000 7f2fa6ca9700 1 -- 172.21.15.63:0/1935465341 --> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f2fa004bb80 con 0x7f2f90039f60 2023-12-12T11:43:39.994 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:39.675+0000 7f2f9d7fa700 1 -- 172.21.15.63:0/1935465341 <== mgr.14120 v2:172.21.15.63:6800/4048286824 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f2fa004bb80 con 0x7f2f90039f60 2023-12-12T11:43:39.994 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:39.676+0000 7f2fa6ca9700 1 -- 172.21.15.63:0/1935465341 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f2f90039f60 msgr2=0x7f2f9003c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:39.994 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:39.676+0000 7f2fa6ca9700 1 --2- 172.21.15.63:0/1935465341 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f2f90039f60 0x7f2f9003c340 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c0039d0 tx=0x7f2f8c009350 comp rx=0 tx=0).stop 2023-12-12T11:43:39.994 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:39.676+0000 7f2fa6ca9700 1 -- 172.21.15.63:0/1935465341 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa0077b90 msgr2=0x7f2fa0113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:39.994 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:39.676+0000 7f2fa6ca9700 1 --2- 172.21.15.63:0/1935465341 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa0077b90 0x7f2fa0113380 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2f94006b00 tx=0x7f2f94009250 comp rx=0 tx=0).stop 2023-12-12T11:43:39.994 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:39.676+0000 7f2fa6ca9700 1 -- 172.21.15.63:0/1935465341 shutdown_connections 2023-12-12T11:43:39.994 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:39.676+0000 7f2fa6ca9700 1 --2- 172.21.15.63:0/1935465341 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f2f90039f60 0x7f2f9003c340 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:39.994 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:39.676+0000 7f2fa6ca9700 1 --2- 172.21.15.63:0/1935465341 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa0077b90 0x7f2fa0113380 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:39.994 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:39.676+0000 7f2fa6ca9700 1 --2- 172.21.15.63:0/1935465341 >> [v2:172.21.15.63:6800/1972453923,v1:172.21.15.63:6801/1972453923] conn(0x7f2f900365f0 0x7f2f90038aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:39.995 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:39.676+0000 7f2fa6ca9700 1 -- 172.21.15.63:0/1935465341 >> 172.21.15.63:0/1935465341 conn(0x7f2fa00fda50 msgr2=0x7f2fa00ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:39.995 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:39.676+0000 7f2fa6ca9700 1 -- 172.21.15.63:0/1935465341 shutdown_connections 2023-12-12T11:43:39.995 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:39.676+0000 7f2fa6ca9700 1 -- 172.21.15.63:0/1935465341 wait complete. 2023-12-12T11:43:39.995 INFO:teuthology.orchestra.run.smithi063.stdout:mgr epoch 5 is available 2023-12-12T11:43:39.995 INFO:teuthology.orchestra.run.smithi063.stdout:Setting orchestrator backend to cephadm... 2023-12-12T11:43:40.966 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.386+0000 7fe22abf9700 1 Processor -- start 2023-12-12T11:43:40.966 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:40 smithi063 ceph-mon[107117]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-12T11:43:40.966 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:40 smithi063 ceph-mon[107117]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-12T11:43:40.966 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:40 smithi063 ceph-mon[107117]: from='mgr.14120 172.21.15.63:0/3652348595' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:43:40.967 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:40 smithi063 ceph-mon[107117]: from='mgr.14120 172.21.15.63:0/3652348595' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:43:40.967 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:40 smithi063 ceph-mon[107117]: from='mgr.14120 172.21.15.63:0/3652348595' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:43:40.971 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.386+0000 7fe22abf9700 1 -- start start 2023-12-12T11:43:40.972 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.387+0000 7fe22abf9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2241044d0 0x7fe2241048e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:40.972 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.387+0000 7fe22abf9700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe224104e20 con 0x7fe2241044d0 2023-12-12T11:43:40.972 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.387+0000 7fe228995700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2241044d0 0x7fe2241048e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:40.972 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.387+0000 7fe228995700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2241044d0 0x7fe2241048e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55756/0 (socket says 172.21.15.63:55756) 2023-12-12T11:43:40.972 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.387+0000 7fe228995700 1 -- 172.21.15.63:0/725935391 learned_addr learned my addr 172.21.15.63:0/725935391 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:40.972 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.387+0000 7fe228995700 1 -- 172.21.15.63:0/725935391 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe224104f60 con 0x7fe2241044d0 2023-12-12T11:43:40.972 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.388+0000 7fe228995700 1 --2- 172.21.15.63:0/725935391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2241044d0 0x7fe2241048e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe2180098e0 tx=0x7fe218009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4eefff91a3df5e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:40.972 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.388+0000 7fe2237fe700 1 -- 172.21.15.63:0/725935391 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe21800b860 con 0x7fe2241044d0 2023-12-12T11:43:40.972 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.388+0000 7fe2237fe700 1 -- 172.21.15.63:0/725935391 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe21800be30 con 0x7fe2241044d0 2023-12-12T11:43:40.972 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.388+0000 7fe2237fe700 1 -- 172.21.15.63:0/725935391 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe218010380 con 0x7fe2241044d0 2023-12-12T11:43:40.973 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.389+0000 7fe22abf9700 1 -- 172.21.15.63:0/725935391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2241044d0 msgr2=0x7fe2241048e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:40.973 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.389+0000 7fe22abf9700 1 --2- 172.21.15.63:0/725935391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2241044d0 0x7fe2241048e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe2180098e0 tx=0x7fe218009250 comp rx=0 tx=0).stop 2023-12-12T11:43:40.973 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.389+0000 7fe22abf9700 1 -- 172.21.15.63:0/725935391 shutdown_connections 2023-12-12T11:43:40.973 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.389+0000 7fe22abf9700 1 --2- 172.21.15.63:0/725935391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2241044d0 0x7fe2241048e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:40.973 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.389+0000 7fe22abf9700 1 -- 172.21.15.63:0/725935391 >> 172.21.15.63:0/725935391 conn(0x7fe224077a80 msgr2=0x7fe224102350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:40.973 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.389+0000 7fe22abf9700 1 -- 172.21.15.63:0/725935391 shutdown_connections 2023-12-12T11:43:40.973 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.389+0000 7fe22abf9700 1 -- 172.21.15.63:0/725935391 wait complete. 2023-12-12T11:43:40.973 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.390+0000 7fe22abf9700 1 Processor -- start 2023-12-12T11:43:40.974 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.390+0000 7fe22abf9700 1 -- start start 2023-12-12T11:43:40.974 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.391+0000 7fe22abf9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2241044d0 0x7fe224113340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:40.974 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.391+0000 7fe22abf9700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe224113880 con 0x7fe2241044d0 2023-12-12T11:43:40.974 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.391+0000 7fe228995700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2241044d0 0x7fe224113340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:40.974 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.391+0000 7fe228995700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2241044d0 0x7fe224113340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55760/0 (socket says 172.21.15.63:55760) 2023-12-12T11:43:40.974 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.391+0000 7fe228995700 1 -- 172.21.15.63:0/2692358452 learned_addr learned my addr 172.21.15.63:0/2692358452 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:40.974 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.391+0000 7fe228995700 1 -- 172.21.15.63:0/2692358452 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2180094f0 con 0x7fe2241044d0 2023-12-12T11:43:40.974 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.392+0000 7fe228995700 1 --2- 172.21.15.63:0/2692358452 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2241044d0 0x7fe224113340 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe218000c00 tx=0x7fe218009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:40.974 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.392+0000 7fe2217fa700 1 -- 172.21.15.63:0/2692358452 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe218010a80 con 0x7fe2241044d0 2023-12-12T11:43:40.974 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.392+0000 7fe2217fa700 1 -- 172.21.15.63:0/2692358452 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe21801a430 con 0x7fe2241044d0 2023-12-12T11:43:40.974 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.392+0000 7fe22abf9700 1 -- 172.21.15.63:0/2692358452 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe224113a80 con 0x7fe2241044d0 2023-12-12T11:43:40.974 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.392+0000 7fe2217fa700 1 -- 172.21.15.63:0/2692358452 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe2180245b0 con 0x7fe2241044d0 2023-12-12T11:43:40.974 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.392+0000 7fe22abf9700 1 -- 172.21.15.63:0/2692358452 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe224113e90 con 0x7fe2241044d0 2023-12-12T11:43:40.974 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.393+0000 7fe2217fa700 1 -- 172.21.15.63:0/2692358452 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7fe21801a5a0 con 0x7fe2241044d0 2023-12-12T11:43:40.975 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.393+0000 7fe20effd700 1 -- 172.21.15.63:0/2692358452 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe22404bb80 con 0x7fe2241044d0 2023-12-12T11:43:40.975 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.394+0000 7fe2217fa700 1 --2- 172.21.15.63:0/2692358452 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fe214036510 0x7fe2140389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:40.975 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.394+0000 7fe2217fa700 1 -- 172.21.15.63:0/2692358452 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe21804a9d0 con 0x7fe2241044d0 2023-12-12T11:43:40.975 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.394+0000 7fe223fff700 1 --2- 172.21.15.63:0/2692358452 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fe214036510 0x7fe2140389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:40.975 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.395+0000 7fe223fff700 1 --2- 172.21.15.63:0/2692358452 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fe214036510 0x7fe2140389c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe210009990 tx=0x7fe210006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:40.975 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.399+0000 7fe2217fa700 1 -- 172.21.15.63:0/2692358452 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe218023df0 con 0x7fe2241044d0 2023-12-12T11:43:40.975 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.616+0000 7fe20effd700 1 -- 172.21.15.63:0/2692358452 --> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2241062e0 con 0x7fe214036510 2023-12-12T11:43:40.975 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.622+0000 7fe2217fa700 1 -- 172.21.15.63:0/2692358452 <== mgr.14120 v2:172.21.15.63:6800/4048286824 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe2241062e0 con 0x7fe214036510 2023-12-12T11:43:40.975 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.624+0000 7fe20effd700 1 -- 172.21.15.63:0/2692358452 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fe214036510 msgr2=0x7fe2140389c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:40.975 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.624+0000 7fe20effd700 1 --2- 172.21.15.63:0/2692358452 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fe214036510 0x7fe2140389c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe210009990 tx=0x7fe210006e40 comp rx=0 tx=0).stop 2023-12-12T11:43:40.975 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.624+0000 7fe20effd700 1 -- 172.21.15.63:0/2692358452 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2241044d0 msgr2=0x7fe224113340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:40.975 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.624+0000 7fe20effd700 1 --2- 172.21.15.63:0/2692358452 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2241044d0 0x7fe224113340 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe218000c00 tx=0x7fe218009250 comp rx=0 tx=0).stop 2023-12-12T11:43:40.975 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.625+0000 7fe20effd700 1 -- 172.21.15.63:0/2692358452 shutdown_connections 2023-12-12T11:43:40.975 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.625+0000 7fe20effd700 1 --2- 172.21.15.63:0/2692358452 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fe214036510 0x7fe2140389c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:40.975 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.625+0000 7fe20effd700 1 --2- 172.21.15.63:0/2692358452 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2241044d0 0x7fe224113340 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:40.976 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.625+0000 7fe20effd700 1 -- 172.21.15.63:0/2692358452 >> 172.21.15.63:0/2692358452 conn(0x7fe224077a80 msgr2=0x7fe224102690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:40.976 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.625+0000 7fe20effd700 1 -- 172.21.15.63:0/2692358452 shutdown_connections 2023-12-12T11:43:40.976 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:40.625+0000 7fe20effd700 1 -- 172.21.15.63:0/2692358452 wait complete. 2023-12-12T11:43:41.899 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:41 smithi063 ceph-mon[107117]: [12/Dec/2023:11:43:40] ENGINE Bus STARTING 2023-12-12T11:43:41.899 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:41 smithi063 ceph-mon[107117]: [12/Dec/2023:11:43:40] ENGINE Serving on https://172.21.15.63:7150 2023-12-12T11:43:41.899 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:41 smithi063 ceph-mon[107117]: [12/Dec/2023:11:43:40] ENGINE Bus STARTED 2023-12-12T11:43:41.899 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:41 smithi063 ceph-mon[107117]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:43:41.899 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:41 smithi063 ceph-mon[107117]: mgrmap e8: smithi063.zjnfdi(active, since 2s) 2023-12-12T11:43:42.061 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout value unchanged 2023-12-12T11:43:42.061 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.376+0000 7f6358a94700 1 Processor -- start 2023-12-12T11:43:42.061 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.376+0000 7f6358a94700 1 -- start start 2023-12-12T11:43:42.061 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.377+0000 7f6358a94700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6354077bd0 0x7f63540760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:42.061 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.377+0000 7f6358a94700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6354077fe0 con 0x7f6354077bd0 2023-12-12T11:43:42.062 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.377+0000 7f635259c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6354077bd0 0x7f63540760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:42.062 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.377+0000 7f635259c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6354077bd0 0x7f63540760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55768/0 (socket says 172.21.15.63:55768) 2023-12-12T11:43:42.062 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.377+0000 7f635259c700 1 -- 172.21.15.63:0/3595755624 learned_addr learned my addr 172.21.15.63:0/3595755624 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:42.062 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.377+0000 7f635259c700 1 -- 172.21.15.63:0/3595755624 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6354076620 con 0x7f6354077bd0 2023-12-12T11:43:42.062 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.378+0000 7f635259c700 1 --2- 172.21.15.63:0/3595755624 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6354077bd0 0x7f63540760e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f63440098e0 tx=0x7f6344009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e48d64766b5de11 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:42.062 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.378+0000 7f6351d9b700 1 -- 172.21.15.63:0/3595755624 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f634400b860 con 0x7f6354077bd0 2023-12-12T11:43:42.062 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.378+0000 7f6351d9b700 1 -- 172.21.15.63:0/3595755624 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f634400be30 con 0x7f6354077bd0 2023-12-12T11:43:42.062 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.378+0000 7f6351d9b700 1 -- 172.21.15.63:0/3595755624 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6344010380 con 0x7f6354077bd0 2023-12-12T11:43:42.062 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.378+0000 7f6358a94700 1 -- 172.21.15.63:0/3595755624 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6354077bd0 msgr2=0x7f63540760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:42.062 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.378+0000 7f6358a94700 1 --2- 172.21.15.63:0/3595755624 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6354077bd0 0x7f63540760e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f63440098e0 tx=0x7f6344009250 comp rx=0 tx=0).stop 2023-12-12T11:43:42.062 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.379+0000 7f6358a94700 1 -- 172.21.15.63:0/3595755624 shutdown_connections 2023-12-12T11:43:42.063 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.379+0000 7f6358a94700 1 --2- 172.21.15.63:0/3595755624 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6354077bd0 0x7f63540760e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:42.063 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.379+0000 7f6358a94700 1 -- 172.21.15.63:0/3595755624 >> 172.21.15.63:0/3595755624 conn(0x7f63540fda50 msgr2=0x7f63540ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:42.063 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.379+0000 7f6358a94700 1 -- 172.21.15.63:0/3595755624 shutdown_connections 2023-12-12T11:43:42.063 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.379+0000 7f6358a94700 1 -- 172.21.15.63:0/3595755624 wait complete. 2023-12-12T11:43:42.063 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.380+0000 7f6358a94700 1 Processor -- start 2023-12-12T11:43:42.063 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.380+0000 7f6358a94700 1 -- start start 2023-12-12T11:43:42.063 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.380+0000 7f6358a94700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6354077bd0 0x7f63541133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:42.063 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.380+0000 7f6358a94700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6354113900 con 0x7f6354077bd0 2023-12-12T11:43:42.063 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.380+0000 7f635259c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6354077bd0 0x7f63541133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:42.063 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.380+0000 7f635259c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6354077bd0 0x7f63541133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55776/0 (socket says 172.21.15.63:55776) 2023-12-12T11:43:42.063 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.380+0000 7f635259c700 1 -- 172.21.15.63:0/3736318516 learned_addr learned my addr 172.21.15.63:0/3736318516 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:42.064 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.381+0000 7f635259c700 1 -- 172.21.15.63:0/3736318516 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63440094f0 con 0x7f6354077bd0 2023-12-12T11:43:42.064 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.381+0000 7f635259c700 1 --2- 172.21.15.63:0/3736318516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6354077bd0 0x7f63541133c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6344006fd0 tx=0x7f6344009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:42.064 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.381+0000 7f634affd700 1 -- 172.21.15.63:0/3736318516 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6344010750 con 0x7f6354077bd0 2023-12-12T11:43:42.064 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.381+0000 7f634affd700 1 -- 172.21.15.63:0/3736318516 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f6344010d20 con 0x7f6354077bd0 2023-12-12T11:43:42.064 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.381+0000 7f634affd700 1 -- 172.21.15.63:0/3736318516 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f634401ada0 con 0x7f6354077bd0 2023-12-12T11:43:42.064 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.381+0000 7f6358a94700 1 -- 172.21.15.63:0/3736318516 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6354113b00 con 0x7f6354077bd0 2023-12-12T11:43:42.064 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.381+0000 7f6358a94700 1 -- 172.21.15.63:0/3736318516 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6354113f10 con 0x7f6354077bd0 2023-12-12T11:43:42.064 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.382+0000 7f634affd700 1 -- 172.21.15.63:0/3736318516 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7f63440108b0 con 0x7f6354077bd0 2023-12-12T11:43:42.064 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.382+0000 7f6358a94700 1 -- 172.21.15.63:0/3736318516 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f635404bb80 con 0x7f6354077bd0 2023-12-12T11:43:42.064 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.383+0000 7f634affd700 1 --2- 172.21.15.63:0/3736318516 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f6340036510 0x7f63400389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:42.064 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.383+0000 7f634affd700 1 -- 172.21.15.63:0/3736318516 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f63440499f0 con 0x7f6354077bd0 2023-12-12T11:43:42.064 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.383+0000 7f634bfff700 1 --2- 172.21.15.63:0/3736318516 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f6340036510 0x7f63400389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:42.065 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.384+0000 7f634bfff700 1 --2- 172.21.15.63:0/3736318516 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f6340036510 0x7f63400389c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f633c009990 tx=0x7f633c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:42.065 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.388+0000 7f634affd700 1 -- 172.21.15.63:0/3736318516 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f634401a5d0 con 0x7f6354077bd0 2023-12-12T11:43:42.065 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.594+0000 7f6358a94700 1 -- 172.21.15.63:0/3736318516 --> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f635410d1f0 con 0x7f6340036510 2023-12-12T11:43:42.065 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.595+0000 7f634affd700 1 -- 172.21.15.63:0/3736318516 <== mgr.14120 v2:172.21.15.63:6800/4048286824 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f635410d1f0 con 0x7f6340036510 2023-12-12T11:43:42.065 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.597+0000 7f6358a94700 1 -- 172.21.15.63:0/3736318516 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f6340036510 msgr2=0x7f63400389c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:42.065 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.598+0000 7f6358a94700 1 --2- 172.21.15.63:0/3736318516 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f6340036510 0x7f63400389c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f633c009990 tx=0x7f633c006e40 comp rx=0 tx=0).stop 2023-12-12T11:43:42.065 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.598+0000 7f6358a94700 1 -- 172.21.15.63:0/3736318516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6354077bd0 msgr2=0x7f63541133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:42.065 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.598+0000 7f6358a94700 1 --2- 172.21.15.63:0/3736318516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6354077bd0 0x7f63541133c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6344006fd0 tx=0x7f6344009250 comp rx=0 tx=0).stop 2023-12-12T11:43:42.065 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.598+0000 7f6358a94700 1 -- 172.21.15.63:0/3736318516 shutdown_connections 2023-12-12T11:43:42.065 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.598+0000 7f6358a94700 1 --2- 172.21.15.63:0/3736318516 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f6340036510 0x7f63400389c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:42.065 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.598+0000 7f6358a94700 1 --2- 172.21.15.63:0/3736318516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6354077bd0 0x7f63541133c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:42.065 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.598+0000 7f6358a94700 1 -- 172.21.15.63:0/3736318516 >> 172.21.15.63:0/3736318516 conn(0x7f63540fda50 msgr2=0x7f63540ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:42.065 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.598+0000 7f6358a94700 1 -- 172.21.15.63:0/3736318516 shutdown_connections 2023-12-12T11:43:42.066 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:41.598+0000 7f6358a94700 1 -- 172.21.15.63:0/3736318516 wait complete. 2023-12-12T11:43:42.066 INFO:teuthology.orchestra.run.smithi063.stdout:Generating ssh key... 2023-12-12T11:43:43.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:42 smithi063 ceph-mon[107117]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:43:43.616 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.425+0000 7fe4e6710700 1 Processor -- start 2023-12-12T11:43:43.616 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.425+0000 7fe4e6710700 1 -- start start 2023-12-12T11:43:43.616 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.426+0000 7fe4e6710700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4e01022d0 0x7fe4e01026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:43.616 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.426+0000 7fe4e6710700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e0102c20 con 0x7fe4e01022d0 2023-12-12T11:43:43.616 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.426+0000 7fe4dffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4e01022d0 0x7fe4e01026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:43.616 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.426+0000 7fe4dffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4e01022d0 0x7fe4e01026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55780/0 (socket says 172.21.15.63:55780) 2023-12-12T11:43:43.616 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.426+0000 7fe4dffff700 1 -- 172.21.15.63:0/1179242866 learned_addr learned my addr 172.21.15.63:0/1179242866 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:43.616 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.427+0000 7fe4dffff700 1 -- 172.21.15.63:0/1179242866 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e0102d60 con 0x7fe4e01022d0 2023-12-12T11:43:43.616 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.427+0000 7fe4dffff700 1 --2- 172.21.15.63:0/1179242866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4e01022d0 0x7fe4e01026e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe4d00098e0 tx=0x7fe4d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f26d5ae48922fe5b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:43.616 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.427+0000 7fe4df7fe700 1 -- 172.21.15.63:0/1179242866 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe4d000b860 con 0x7fe4e01022d0 2023-12-12T11:43:43.616 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.427+0000 7fe4df7fe700 1 -- 172.21.15.63:0/1179242866 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe4d000be30 con 0x7fe4e01022d0 2023-12-12T11:43:43.616 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.427+0000 7fe4df7fe700 1 -- 172.21.15.63:0/1179242866 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe4d0010380 con 0x7fe4e01022d0 2023-12-12T11:43:43.617 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.428+0000 7fe4e6710700 1 -- 172.21.15.63:0/1179242866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4e01022d0 msgr2=0x7fe4e01026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:43.617 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.428+0000 7fe4e6710700 1 --2- 172.21.15.63:0/1179242866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4e01022d0 0x7fe4e01026e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe4d00098e0 tx=0x7fe4d0009250 comp rx=0 tx=0).stop 2023-12-12T11:43:43.617 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.428+0000 7fe4e6710700 1 -- 172.21.15.63:0/1179242866 shutdown_connections 2023-12-12T11:43:43.617 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.428+0000 7fe4e6710700 1 --2- 172.21.15.63:0/1179242866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4e01022d0 0x7fe4e01026e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:43.617 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.428+0000 7fe4e6710700 1 -- 172.21.15.63:0/1179242866 >> 172.21.15.63:0/1179242866 conn(0x7fe4e00fda50 msgr2=0x7fe4e00ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:43.617 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.428+0000 7fe4e6710700 1 -- 172.21.15.63:0/1179242866 shutdown_connections 2023-12-12T11:43:43.617 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.428+0000 7fe4e6710700 1 -- 172.21.15.63:0/1179242866 wait complete. 2023-12-12T11:43:43.617 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.429+0000 7fe4e6710700 1 Processor -- start 2023-12-12T11:43:43.617 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.429+0000 7fe4e6710700 1 -- start start 2023-12-12T11:43:43.617 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.429+0000 7fe4e6710700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4e01022d0 0x7fe4e0077c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:43.617 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.429+0000 7fe4e6710700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e0076080 con 0x7fe4e01022d0 2023-12-12T11:43:43.617 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.429+0000 7fe4dffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4e01022d0 0x7fe4e0077c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:43.617 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.429+0000 7fe4dffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4e01022d0 0x7fe4e0077c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55796/0 (socket says 172.21.15.63:55796) 2023-12-12T11:43:43.618 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.429+0000 7fe4dffff700 1 -- 172.21.15.63:0/3051331902 learned_addr learned my addr 172.21.15.63:0/3051331902 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:43.618 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.430+0000 7fe4dffff700 1 -- 172.21.15.63:0/3051331902 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d00094f0 con 0x7fe4e01022d0 2023-12-12T11:43:43.618 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.430+0000 7fe4dffff700 1 --2- 172.21.15.63:0/3051331902 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4e01022d0 0x7fe4e0077c00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0000c00 tx=0x7fe4d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:43.618 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.430+0000 7fe4dd7fa700 1 -- 172.21.15.63:0/3051331902 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe4d0010a80 con 0x7fe4e01022d0 2023-12-12T11:43:43.618 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.430+0000 7fe4dd7fa700 1 -- 172.21.15.63:0/3051331902 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe4d001a430 con 0x7fe4e01022d0 2023-12-12T11:43:43.618 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.430+0000 7fe4e6710700 1 -- 172.21.15.63:0/3051331902 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e0076280 con 0x7fe4e01022d0 2023-12-12T11:43:43.618 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.430+0000 7fe4dd7fa700 1 -- 172.21.15.63:0/3051331902 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe4d00245b0 con 0x7fe4e01022d0 2023-12-12T11:43:43.618 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.430+0000 7fe4e6710700 1 -- 172.21.15.63:0/3051331902 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e0076690 con 0x7fe4e01022d0 2023-12-12T11:43:43.618 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.431+0000 7fe4dd7fa700 1 -- 172.21.15.63:0/3051331902 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fe4d001a5a0 con 0x7fe4e01022d0 2023-12-12T11:43:43.618 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.432+0000 7fe4e6710700 1 -- 172.21.15.63:0/3051331902 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e010b150 con 0x7fe4e01022d0 2023-12-12T11:43:43.618 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.432+0000 7fe4dd7fa700 1 --2- 172.21.15.63:0/3051331902 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fe4cc036640 0x7fe4cc038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:43.619 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.432+0000 7fe4dd7fa700 1 -- 172.21.15.63:0/3051331902 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe4d004ab10 con 0x7fe4e01022d0 2023-12-12T11:43:43.619 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.432+0000 7fe4d7fff700 1 --2- 172.21.15.63:0/3051331902 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fe4cc036640 0x7fe4cc038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:43.619 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.433+0000 7fe4d7fff700 1 --2- 172.21.15.63:0/3051331902 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fe4cc036640 0x7fe4cc038af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8009990 tx=0x7fe4c8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:43.619 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.437+0000 7fe4dd7fa700 1 -- 172.21.15.63:0/3051331902 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe4d0023df0 con 0x7fe4e01022d0 2023-12-12T11:43:43.619 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.640+0000 7fe4e6710700 1 -- 172.21.15.63:0/3051331902 --> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4e002b150 con 0x7fe4cc036640 2023-12-12T11:43:43.619 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.867+0000 7fe4dd7fa700 1 -- 172.21.15.63:0/3051331902 <== mgr.14120 v2:172.21.15.63:6800/4048286824 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe4e002b150 con 0x7fe4cc036640 2023-12-12T11:43:43.619 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.870+0000 7fe4e6710700 1 -- 172.21.15.63:0/3051331902 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fe4cc036640 msgr2=0x7fe4cc038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:43.619 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.870+0000 7fe4e6710700 1 --2- 172.21.15.63:0/3051331902 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fe4cc036640 0x7fe4cc038af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8009990 tx=0x7fe4c8006e40 comp rx=0 tx=0).stop 2023-12-12T11:43:43.619 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.870+0000 7fe4e6710700 1 -- 172.21.15.63:0/3051331902 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4e01022d0 msgr2=0x7fe4e0077c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:43.619 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.870+0000 7fe4e6710700 1 --2- 172.21.15.63:0/3051331902 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4e01022d0 0x7fe4e0077c00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0000c00 tx=0x7fe4d0009250 comp rx=0 tx=0).stop 2023-12-12T11:43:43.619 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.870+0000 7fe4e6710700 1 -- 172.21.15.63:0/3051331902 shutdown_connections 2023-12-12T11:43:43.619 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.870+0000 7fe4e6710700 1 --2- 172.21.15.63:0/3051331902 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fe4cc036640 0x7fe4cc038af0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:43.619 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.870+0000 7fe4e6710700 1 --2- 172.21.15.63:0/3051331902 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4e01022d0 0x7fe4e0077c00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:43.620 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.870+0000 7fe4e6710700 1 -- 172.21.15.63:0/3051331902 >> 172.21.15.63:0/3051331902 conn(0x7fe4e00fda50 msgr2=0x7fe4e00ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:43.620 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.870+0000 7fe4e6710700 1 -- 172.21.15.63:0/3051331902 shutdown_connections 2023-12-12T11:43:43.620 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:42.870+0000 7fe4e6710700 1 -- 172.21.15.63:0/3051331902 wait complete. 2023-12-12T11:43:44.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:43 smithi063 ceph-mon[107117]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:43:44.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:43 smithi063 ceph-mon[107117]: Generating ssh key... 2023-12-12T11:43:44.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:43 smithi063 ceph-mon[107117]: from='mgr.14120 172.21.15.63:0/3652348595' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:43:44.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:43 smithi063 ceph-mon[107117]: from='mgr.14120 172.21.15.63:0/3652348595' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:43:44.865 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLXCLanB34deF1kqKX1KHerLYI2th0MIpecUNtBwjFjSU3o0bSleyOTu6Grln4EGyfMeMX2cCZdvspLELB4FCHOpn/7SU8PsFU3mlU0Rd+KFWsq8dW/0R6XpfrtgI1ZraInoNIUqJtREazf87M+UNSESdegV2IEX8K261azF+pA3bDggSo61DeSJsFRK4hGr049A2kmZ6TCUEvyusZRx2UgrbsGq0XoO7PMRsdpYO/FnyOiQf6EnGSZfL1XyCthJQA9wbNAITP00rLXMYFUZxOXBt+sV3yFfOEizKmGicB5ZRE/CFK1BF/Egc0pUmAkbK9+RX4aEj685xP6m9YkAfwpVQjRbEUymU4FfzXp0wXzSAkvmxwfMHJA0pFJAIb83H7+PwFoQkOSaW5f/qZ/zP8NndQ55hAh86qkxPRMTJ4YLUDOxFJmY3AXFwnqGNpl7wEBCUtBIy0FR18orrp3IRaLhB+N8xvzrkRqi40/kJG2S+Hi5BwVZ0phM+3s17OKkc= ceph-85e33c70-98e3-11ee-95a3-87774f69a715 2023-12-12T11:43:44.865 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.202+0000 7f7f8443a700 1 Processor -- start 2023-12-12T11:43:44.865 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.202+0000 7f7f8443a700 1 -- start start 2023-12-12T11:43:44.865 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.203+0000 7f7f8443a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f7c077b90 0x7f7f7c0760a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:44.865 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.203+0000 7f7f8443a700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c077fa0 con 0x7f7f7c077b90 2023-12-12T11:43:44.865 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.203+0000 7f7f821d6700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f7c077b90 0x7f7f7c0760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:44.865 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.203+0000 7f7f821d6700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f7c077b90 0x7f7f7c0760a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55812/0 (socket says 172.21.15.63:55812) 2023-12-12T11:43:44.865 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.203+0000 7f7f821d6700 1 -- 172.21.15.63:0/3939515588 learned_addr learned my addr 172.21.15.63:0/3939515588 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:44.865 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.203+0000 7f7f821d6700 1 -- 172.21.15.63:0/3939515588 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7c0765e0 con 0x7f7f7c077b90 2023-12-12T11:43:44.865 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.204+0000 7f7f821d6700 1 --2- 172.21.15.63:0/3939515588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f7c077b90 0x7f7f7c0760a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7f780098e0 tx=0x7f7f78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d134d4d3823126b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:44.866 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.204+0000 7f7f811d4700 1 -- 172.21.15.63:0/3939515588 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f7800b860 con 0x7f7f7c077b90 2023-12-12T11:43:44.866 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.204+0000 7f7f811d4700 1 -- 172.21.15.63:0/3939515588 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f7f7800be30 con 0x7f7f7c077b90 2023-12-12T11:43:44.866 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.204+0000 7f7f811d4700 1 -- 172.21.15.63:0/3939515588 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f78010380 con 0x7f7f7c077b90 2023-12-12T11:43:44.866 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.204+0000 7f7f8443a700 1 -- 172.21.15.63:0/3939515588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f7c077b90 msgr2=0x7f7f7c0760a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:44.866 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.204+0000 7f7f8443a700 1 --2- 172.21.15.63:0/3939515588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f7c077b90 0x7f7f7c0760a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7f780098e0 tx=0x7f7f78009250 comp rx=0 tx=0).stop 2023-12-12T11:43:44.866 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.205+0000 7f7f8443a700 1 -- 172.21.15.63:0/3939515588 shutdown_connections 2023-12-12T11:43:44.866 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.205+0000 7f7f8443a700 1 --2- 172.21.15.63:0/3939515588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f7c077b90 0x7f7f7c0760a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:44.866 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.205+0000 7f7f8443a700 1 -- 172.21.15.63:0/3939515588 >> 172.21.15.63:0/3939515588 conn(0x7f7f7c0fda50 msgr2=0x7f7f7c0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:44.866 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.205+0000 7f7f8443a700 1 -- 172.21.15.63:0/3939515588 shutdown_connections 2023-12-12T11:43:44.866 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.205+0000 7f7f8443a700 1 -- 172.21.15.63:0/3939515588 wait complete. 2023-12-12T11:43:44.866 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.206+0000 7f7f8443a700 1 Processor -- start 2023-12-12T11:43:44.866 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.206+0000 7f7f8443a700 1 -- start start 2023-12-12T11:43:44.866 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.206+0000 7f7f8443a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f7c077b90 0x7f7f7c113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:44.866 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.206+0000 7f7f8443a700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c1138c0 con 0x7f7f7c077b90 2023-12-12T11:43:44.867 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.206+0000 7f7f821d6700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f7c077b90 0x7f7f7c113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:44.867 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.206+0000 7f7f821d6700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f7c077b90 0x7f7f7c113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55826/0 (socket says 172.21.15.63:55826) 2023-12-12T11:43:44.867 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.206+0000 7f7f821d6700 1 -- 172.21.15.63:0/3975931187 learned_addr learned my addr 172.21.15.63:0/3975931187 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:44.867 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.207+0000 7f7f821d6700 1 -- 172.21.15.63:0/3975931187 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f780094f0 con 0x7f7f7c077b90 2023-12-12T11:43:44.867 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.207+0000 7f7f821d6700 1 --2- 172.21.15.63:0/3975931187 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f7c077b90 0x7f7f7c113380 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7f78006b00 tx=0x7f7f78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:44.867 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.207+0000 7f7f72ffd700 1 -- 172.21.15.63:0/3975931187 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f78010a80 con 0x7f7f7c077b90 2023-12-12T11:43:44.867 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.207+0000 7f7f72ffd700 1 -- 172.21.15.63:0/3975931187 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f7f7801a430 con 0x7f7f7c077b90 2023-12-12T11:43:44.867 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.207+0000 7f7f8443a700 1 -- 172.21.15.63:0/3975931187 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f7c113ac0 con 0x7f7f7c077b90 2023-12-12T11:43:44.867 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.207+0000 7f7f72ffd700 1 -- 172.21.15.63:0/3975931187 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f780245b0 con 0x7f7f7c077b90 2023-12-12T11:43:44.867 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.207+0000 7f7f8443a700 1 -- 172.21.15.63:0/3975931187 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f7c113ed0 con 0x7f7f7c077b90 2023-12-12T11:43:44.867 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.208+0000 7f7f72ffd700 1 -- 172.21.15.63:0/3975931187 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f7f78010be0 con 0x7f7f7c077b90 2023-12-12T11:43:44.868 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.208+0000 7f7f8443a700 1 -- 172.21.15.63:0/3975931187 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f7c04bb80 con 0x7f7f7c077b90 2023-12-12T11:43:44.868 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.209+0000 7f7f72ffd700 1 --2- 172.21.15.63:0/3975931187 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f7f68036640 0x7f7f68038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:44.868 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.209+0000 7f7f72ffd700 1 -- 172.21.15.63:0/3975931187 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f7f7804abb0 con 0x7f7f7c077b90 2023-12-12T11:43:44.868 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.209+0000 7f7f819d5700 1 --2- 172.21.15.63:0/3975931187 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f7f68036640 0x7f7f68038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:44.868 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.210+0000 7f7f819d5700 1 --2- 172.21.15.63:0/3975931187 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f7f68036640 0x7f7f68038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009990 tx=0x7f7f6c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:44.868 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.214+0000 7f7f72ffd700 1 -- 172.21.15.63:0/3975931187 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7f7801a5a0 con 0x7f7f7c077b90 2023-12-12T11:43:44.868 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.419+0000 7f7f8443a700 1 -- 172.21.15.63:0/3975931187 --> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f7c10d1b0 con 0x7f7f68036640 2023-12-12T11:43:44.868 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.420+0000 7f7f72ffd700 1 -- 172.21.15.63:0/3975931187 <== mgr.14120 v2:172.21.15.63:6800/4048286824 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f7f7c10d1b0 con 0x7f7f68036640 2023-12-12T11:43:44.868 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.422+0000 7f7f8443a700 1 -- 172.21.15.63:0/3975931187 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f7f68036640 msgr2=0x7f7f68038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:44.868 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.422+0000 7f7f8443a700 1 --2- 172.21.15.63:0/3975931187 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f7f68036640 0x7f7f68038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009990 tx=0x7f7f6c006e40 comp rx=0 tx=0).stop 2023-12-12T11:43:44.868 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.422+0000 7f7f8443a700 1 -- 172.21.15.63:0/3975931187 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f7c077b90 msgr2=0x7f7f7c113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:44.868 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.422+0000 7f7f8443a700 1 --2- 172.21.15.63:0/3975931187 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f7c077b90 0x7f7f7c113380 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7f78006b00 tx=0x7f7f78009250 comp rx=0 tx=0).stop 2023-12-12T11:43:44.868 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.422+0000 7f7f8443a700 1 -- 172.21.15.63:0/3975931187 shutdown_connections 2023-12-12T11:43:44.868 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.422+0000 7f7f8443a700 1 --2- 172.21.15.63:0/3975931187 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f7f68036640 0x7f7f68038af0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:44.869 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.422+0000 7f7f8443a700 1 --2- 172.21.15.63:0/3975931187 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f7c077b90 0x7f7f7c113380 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:44.869 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.422+0000 7f7f8443a700 1 -- 172.21.15.63:0/3975931187 >> 172.21.15.63:0/3975931187 conn(0x7f7f7c0fda50 msgr2=0x7f7f7c0ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:44.869 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.422+0000 7f7f8443a700 1 -- 172.21.15.63:0/3975931187 shutdown_connections 2023-12-12T11:43:44.869 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:44.422+0000 7f7f8443a700 1 -- 172.21.15.63:0/3975931187 wait complete. 2023-12-12T11:43:44.869 INFO:teuthology.orchestra.run.smithi063.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-12-12T11:43:44.869 INFO:teuthology.orchestra.run.smithi063.stdout:Adding key to root@localhost authorized_keys... 2023-12-12T11:43:44.869 INFO:teuthology.orchestra.run.smithi063.stdout:Adding host smithi063... 2023-12-12T11:43:45.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:45 smithi063 ceph-mon[107117]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:43:46.525 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:46 smithi063 ceph-mon[107117]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi063", "addr": "172.21.15.63", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:43:47.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:47 smithi063 ceph-mon[107117]: Deploying cephadm binary to smithi063 2023-12-12T11:43:48.684 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout Added host 'smithi063' with addr '172.21.15.63' 2023-12-12T11:43:48.685 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.411+0000 7f9027451700 1 Processor -- start 2023-12-12T11:43:48.685 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.412+0000 7f9027451700 1 -- start start 2023-12-12T11:43:48.685 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.412+0000 7f9027451700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9020077b90 0x7f90200760a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:48.685 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.412+0000 7f9027451700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9020077fa0 con 0x7f9020077b90 2023-12-12T11:43:48.685 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.412+0000 7f90251ed700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9020077b90 0x7f90200760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:48.685 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.412+0000 7f90251ed700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9020077b90 0x7f90200760a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55830/0 (socket says 172.21.15.63:55830) 2023-12-12T11:43:48.685 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.412+0000 7f90251ed700 1 -- 172.21.15.63:0/1046488394 learned_addr learned my addr 172.21.15.63:0/1046488394 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:48.685 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.413+0000 7f90251ed700 1 -- 172.21.15.63:0/1046488394 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90200765e0 con 0x7f9020077b90 2023-12-12T11:43:48.685 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.413+0000 7f90251ed700 1 --2- 172.21.15.63:0/1046488394 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9020077b90 0x7f90200760a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f901c0098e0 tx=0x7f901c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96dd2cc6c9db2cd1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:48.685 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.413+0000 7f9017fff700 1 -- 172.21.15.63:0/1046488394 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f901c00b860 con 0x7f9020077b90 2023-12-12T11:43:48.685 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.413+0000 7f9017fff700 1 -- 172.21.15.63:0/1046488394 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f901c00be30 con 0x7f9020077b90 2023-12-12T11:43:48.685 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.413+0000 7f9017fff700 1 -- 172.21.15.63:0/1046488394 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f901c010380 con 0x7f9020077b90 2023-12-12T11:43:48.686 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.414+0000 7f9027451700 1 -- 172.21.15.63:0/1046488394 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9020077b90 msgr2=0x7f90200760a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:48.686 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.414+0000 7f9027451700 1 --2- 172.21.15.63:0/1046488394 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9020077b90 0x7f90200760a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f901c0098e0 tx=0x7f901c009250 comp rx=0 tx=0).stop 2023-12-12T11:43:48.686 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.414+0000 7f9027451700 1 -- 172.21.15.63:0/1046488394 shutdown_connections 2023-12-12T11:43:48.686 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.414+0000 7f9027451700 1 --2- 172.21.15.63:0/1046488394 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9020077b90 0x7f90200760a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:48.686 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.414+0000 7f9027451700 1 -- 172.21.15.63:0/1046488394 >> 172.21.15.63:0/1046488394 conn(0x7f90200fda50 msgr2=0x7f90200ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:48.686 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.414+0000 7f9027451700 1 -- 172.21.15.63:0/1046488394 shutdown_connections 2023-12-12T11:43:48.686 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.414+0000 7f9027451700 1 -- 172.21.15.63:0/1046488394 wait complete. 2023-12-12T11:43:48.686 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.415+0000 7f9027451700 1 Processor -- start 2023-12-12T11:43:48.686 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.415+0000 7f9027451700 1 -- start start 2023-12-12T11:43:48.686 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.415+0000 7f9027451700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9020077b90 0x7f90201132d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:48.686 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.415+0000 7f9027451700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9020113810 con 0x7f9020077b90 2023-12-12T11:43:48.686 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.416+0000 7f90251ed700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9020077b90 0x7f90201132d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:48.686 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.416+0000 7f90251ed700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9020077b90 0x7f90201132d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55846/0 (socket says 172.21.15.63:55846) 2023-12-12T11:43:48.687 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.416+0000 7f90251ed700 1 -- 172.21.15.63:0/1691472037 learned_addr learned my addr 172.21.15.63:0/1691472037 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:48.687 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.416+0000 7f90251ed700 1 -- 172.21.15.63:0/1691472037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901c0094f0 con 0x7f9020077b90 2023-12-12T11:43:48.687 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.416+0000 7f90251ed700 1 --2- 172.21.15.63:0/1691472037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9020077b90 0x7f90201132d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f901c006b00 tx=0x7f901c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:48.687 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.417+0000 7f9015ffb700 1 -- 172.21.15.63:0/1691472037 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f901c010a80 con 0x7f9020077b90 2023-12-12T11:43:48.687 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.417+0000 7f9015ffb700 1 -- 172.21.15.63:0/1691472037 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f901c01a430 con 0x7f9020077b90 2023-12-12T11:43:48.687 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.417+0000 7f9015ffb700 1 -- 172.21.15.63:0/1691472037 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f901c0245b0 con 0x7f9020077b90 2023-12-12T11:43:48.687 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.417+0000 7f9027451700 1 -- 172.21.15.63:0/1691472037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9020113a10 con 0x7f9020077b90 2023-12-12T11:43:48.687 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.417+0000 7f9027451700 1 -- 172.21.15.63:0/1691472037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9020113e20 con 0x7f9020077b90 2023-12-12T11:43:48.687 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.418+0000 7f9015ffb700 1 -- 172.21.15.63:0/1691472037 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f901c010be0 con 0x7f9020077b90 2023-12-12T11:43:48.687 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.418+0000 7f9027451700 1 -- 172.21.15.63:0/1691472037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f902004bb80 con 0x7f9020077b90 2023-12-12T11:43:48.687 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.418+0000 7f9015ffb700 1 --2- 172.21.15.63:0/1691472037 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f900c036640 0x7f900c038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:48.687 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.418+0000 7f9015ffb700 1 -- 172.21.15.63:0/1691472037 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f901c04ab70 con 0x7f9020077b90 2023-12-12T11:43:48.687 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.418+0000 7f90249ec700 1 --2- 172.21.15.63:0/1691472037 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f900c036640 0x7f900c038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:48.687 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.419+0000 7f90249ec700 1 --2- 172.21.15.63:0/1691472037 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f900c036640 0x7f900c038af0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9010009990 tx=0x7f9010006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:48.688 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.423+0000 7f9015ffb700 1 -- 172.21.15.63:0/1691472037 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f901c01a5a0 con 0x7f9020077b90 2023-12-12T11:43:48.688 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:45.630+0000 7f9027451700 1 -- 172.21.15.63:0/1691472037 --> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi063", "addr": "172.21.15.63", "target": ["mon-mgr", ""]}) v1 -- 0x7f90200008d0 con 0x7f900c036640 2023-12-12T11:43:48.688 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:48.322+0000 7f9015ffb700 1 -- 172.21.15.63:0/1691472037 <== mgr.14120 v2:172.21.15.63:6800/4048286824 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f90200008d0 con 0x7f900c036640 2023-12-12T11:43:48.689 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:48.325+0000 7f9027451700 1 -- 172.21.15.63:0/1691472037 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f900c036640 msgr2=0x7f900c038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:48.689 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:48.325+0000 7f9027451700 1 --2- 172.21.15.63:0/1691472037 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f900c036640 0x7f900c038af0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9010009990 tx=0x7f9010006e40 comp rx=0 tx=0).stop 2023-12-12T11:43:48.689 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:48.325+0000 7f9027451700 1 -- 172.21.15.63:0/1691472037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9020077b90 msgr2=0x7f90201132d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:48.689 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:48.325+0000 7f9027451700 1 --2- 172.21.15.63:0/1691472037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9020077b90 0x7f90201132d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f901c006b00 tx=0x7f901c009250 comp rx=0 tx=0).stop 2023-12-12T11:43:48.689 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:48.325+0000 7f9027451700 1 -- 172.21.15.63:0/1691472037 shutdown_connections 2023-12-12T11:43:48.689 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:48.325+0000 7f9027451700 1 --2- 172.21.15.63:0/1691472037 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f900c036640 0x7f900c038af0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:48.689 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:48.325+0000 7f9027451700 1 --2- 172.21.15.63:0/1691472037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9020077b90 0x7f90201132d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:48.690 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:48.325+0000 7f9027451700 1 -- 172.21.15.63:0/1691472037 >> 172.21.15.63:0/1691472037 conn(0x7f90200fda50 msgr2=0x7f90200ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:48.690 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:48.326+0000 7f9027451700 1 -- 172.21.15.63:0/1691472037 shutdown_connections 2023-12-12T11:43:48.690 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:48.326+0000 7f9027451700 1 -- 172.21.15.63:0/1691472037 wait complete. 2023-12-12T11:43:48.690 INFO:teuthology.orchestra.run.smithi063.stdout:Deploying mon service with default placement... 2023-12-12T11:43:49.576 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:49 smithi063 ceph-mon[107117]: from='mgr.14120 172.21.15.63:0/3652348595' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:43:49.576 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:49 smithi063 ceph-mon[107117]: Added host smithi063 2023-12-12T11:43:49.576 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:49 smithi063 ceph-mon[107117]: from='mgr.14120 172.21.15.63:0/3652348595' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:43:49.827 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-12-12T11:43:49.832 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.088+0000 7f623e69a700 1 Processor -- start 2023-12-12T11:43:49.832 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.088+0000 7f623e69a700 1 -- start start 2023-12-12T11:43:49.832 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.088+0000 7f623e69a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6238077b90 0x7f62380760a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:49.832 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.088+0000 7f623e69a700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6238077fa0 con 0x7f6238077b90 2023-12-12T11:43:49.833 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.089+0000 7f623d698700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6238077b90 0x7f62380760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:49.833 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.089+0000 7f623d698700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6238077b90 0x7f62380760a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53780/0 (socket says 172.21.15.63:53780) 2023-12-12T11:43:49.833 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.089+0000 7f623d698700 1 -- 172.21.15.63:0/1881338713 learned_addr learned my addr 172.21.15.63:0/1881338713 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:49.833 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.089+0000 7f623d698700 1 -- 172.21.15.63:0/1881338713 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62380765e0 con 0x7f6238077b90 2023-12-12T11:43:49.833 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.089+0000 7f623d698700 1 --2- 172.21.15.63:0/1881338713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6238077b90 0x7f62380760a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f62340098e0 tx=0x7f6234009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f083e2ed034ba3 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:49.833 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.090+0000 7f622ffff700 1 -- 172.21.15.63:0/1881338713 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f623400b860 con 0x7f6238077b90 2023-12-12T11:43:49.833 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.090+0000 7f622ffff700 1 -- 172.21.15.63:0/1881338713 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f623400be30 con 0x7f6238077b90 2023-12-12T11:43:49.833 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.090+0000 7f622ffff700 1 -- 172.21.15.63:0/1881338713 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6234010380 con 0x7f6238077b90 2023-12-12T11:43:49.833 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.090+0000 7f623e69a700 1 -- 172.21.15.63:0/1881338713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6238077b90 msgr2=0x7f62380760a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:49.833 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.090+0000 7f623e69a700 1 --2- 172.21.15.63:0/1881338713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6238077b90 0x7f62380760a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f62340098e0 tx=0x7f6234009250 comp rx=0 tx=0).stop 2023-12-12T11:43:49.833 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.090+0000 7f623e69a700 1 -- 172.21.15.63:0/1881338713 shutdown_connections 2023-12-12T11:43:49.833 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.090+0000 7f623e69a700 1 --2- 172.21.15.63:0/1881338713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6238077b90 0x7f62380760a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:49.833 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.090+0000 7f623e69a700 1 -- 172.21.15.63:0/1881338713 >> 172.21.15.63:0/1881338713 conn(0x7f62380fd880 msgr2=0x7f62380ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:49.833 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.090+0000 7f623e69a700 1 -- 172.21.15.63:0/1881338713 shutdown_connections 2023-12-12T11:43:49.833 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.090+0000 7f623e69a700 1 -- 172.21.15.63:0/1881338713 wait complete. 2023-12-12T11:43:49.834 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.091+0000 7f623e69a700 1 Processor -- start 2023-12-12T11:43:49.834 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.091+0000 7f623e69a700 1 -- start start 2023-12-12T11:43:49.834 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.092+0000 7f623e69a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6238077b90 0x7f62381131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:49.834 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.092+0000 7f623e69a700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6238113700 con 0x7f6238077b90 2023-12-12T11:43:49.834 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.092+0000 7f623d698700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6238077b90 0x7f62381131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:49.834 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.092+0000 7f623d698700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6238077b90 0x7f62381131c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53796/0 (socket says 172.21.15.63:53796) 2023-12-12T11:43:49.834 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.092+0000 7f623d698700 1 -- 172.21.15.63:0/1848386888 learned_addr learned my addr 172.21.15.63:0/1848386888 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:49.834 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.092+0000 7f623d698700 1 -- 172.21.15.63:0/1848386888 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62340094f0 con 0x7f6238077b90 2023-12-12T11:43:49.835 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.093+0000 7f623d698700 1 --2- 172.21.15.63:0/1848386888 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6238077b90 0x7f62381131c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6234006b00 tx=0x7f6234009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:49.835 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.093+0000 7f622dffb700 1 -- 172.21.15.63:0/1848386888 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6234010a80 con 0x7f6238077b90 2023-12-12T11:43:49.835 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.093+0000 7f622dffb700 1 -- 172.21.15.63:0/1848386888 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f623401a430 con 0x7f6238077b90 2023-12-12T11:43:49.835 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.093+0000 7f622dffb700 1 -- 172.21.15.63:0/1848386888 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62340245b0 con 0x7f6238077b90 2023-12-12T11:43:49.835 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.093+0000 7f623e69a700 1 -- 172.21.15.63:0/1848386888 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6238113900 con 0x7f6238077b90 2023-12-12T11:43:49.835 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.093+0000 7f623e69a700 1 -- 172.21.15.63:0/1848386888 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6238113d10 con 0x7f6238077b90 2023-12-12T11:43:49.835 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.094+0000 7f622dffb700 1 -- 172.21.15.63:0/1848386888 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f6234010be0 con 0x7f6238077b90 2023-12-12T11:43:49.835 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.094+0000 7f623e69a700 1 -- 172.21.15.63:0/1848386888 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f623804bb80 con 0x7f6238077b90 2023-12-12T11:43:49.835 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.095+0000 7f622dffb700 1 --2- 172.21.15.63:0/1848386888 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f6224036640 0x7f6224038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:49.835 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.095+0000 7f622dffb700 1 -- 172.21.15.63:0/1848386888 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f623404ab90 con 0x7f6238077b90 2023-12-12T11:43:49.836 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.095+0000 7f623ce97700 1 --2- 172.21.15.63:0/1848386888 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f6224036640 0x7f6224038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:49.836 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.095+0000 7f623ce97700 1 --2- 172.21.15.63:0/1848386888 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f6224036640 0x7f6224038af0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6228009990 tx=0x7f6228006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:49.836 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.100+0000 7f622dffb700 1 -- 172.21.15.63:0/1848386888 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f623401a5a0 con 0x7f6238077b90 2023-12-12T11:43:49.836 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.322+0000 7f623e69a700 1 -- 172.21.15.63:0/1848386888 --> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f623804bb80 con 0x7f6224036640 2023-12-12T11:43:49.836 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.327+0000 7f622dffb700 1 -- 172.21.15.63:0/1848386888 <== mgr.14120 v2:172.21.15.63:6800/4048286824 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f623804bb80 con 0x7f6224036640 2023-12-12T11:43:49.836 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.329+0000 7f623e69a700 1 -- 172.21.15.63:0/1848386888 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f6224036640 msgr2=0x7f6224038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:49.836 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.329+0000 7f623e69a700 1 --2- 172.21.15.63:0/1848386888 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f6224036640 0x7f6224038af0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6228009990 tx=0x7f6228006e40 comp rx=0 tx=0).stop 2023-12-12T11:43:49.836 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.329+0000 7f623e69a700 1 -- 172.21.15.63:0/1848386888 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6238077b90 msgr2=0x7f62381131c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:49.836 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.329+0000 7f623e69a700 1 --2- 172.21.15.63:0/1848386888 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6238077b90 0x7f62381131c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6234006b00 tx=0x7f6234009250 comp rx=0 tx=0).stop 2023-12-12T11:43:49.836 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.329+0000 7f623e69a700 1 -- 172.21.15.63:0/1848386888 shutdown_connections 2023-12-12T11:43:49.837 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.330+0000 7f623e69a700 1 --2- 172.21.15.63:0/1848386888 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f6224036640 0x7f6224038af0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:49.837 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.330+0000 7f623e69a700 1 --2- 172.21.15.63:0/1848386888 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6238077b90 0x7f62381131c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:49.837 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.330+0000 7f623e69a700 1 -- 172.21.15.63:0/1848386888 >> 172.21.15.63:0/1848386888 conn(0x7f62380fd880 msgr2=0x7f62380ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:49.837 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.330+0000 7f623e69a700 1 -- 172.21.15.63:0/1848386888 shutdown_connections 2023-12-12T11:43:49.837 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:49.330+0000 7f623e69a700 1 -- 172.21.15.63:0/1848386888 wait complete. 2023-12-12T11:43:49.837 INFO:teuthology.orchestra.run.smithi063.stdout:Deploying mgr service with default placement... 2023-12-12T11:43:50.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:50 smithi063 ceph-mon[107117]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:43:50.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:50 smithi063 ceph-mon[107117]: Saving service mon spec with placement count:5 2023-12-12T11:43:50.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:50 smithi063 ceph-mon[107117]: from='mgr.14120 172.21.15.63:0/3652348595' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:43:50.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:50 smithi063 ceph-mon[107117]: from='mgr.14120 172.21.15.63:0/3652348595' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:43:51.110 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-12-12T11:43:51.110 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.513+0000 7f71b9600700 1 Processor -- start 2023-12-12T11:43:51.110 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.513+0000 7f71b9600700 1 -- start start 2023-12-12T11:43:51.110 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.513+0000 7f71b9600700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71b4070f80 0x7f71b4107320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:51.110 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.513+0000 7f71b9600700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b4102d10 con 0x7f71b4070f80 2023-12-12T11:43:51.110 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.514+0000 7f71b2ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71b4070f80 0x7f71b4107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:51.110 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.514+0000 7f71b2ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71b4070f80 0x7f71b4107320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53804/0 (socket says 172.21.15.63:53804) 2023-12-12T11:43:51.110 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.514+0000 7f71b2ffd700 1 -- 172.21.15.63:0/2511380180 learned_addr learned my addr 172.21.15.63:0/2511380180 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:51.110 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.514+0000 7f71b2ffd700 1 -- 172.21.15.63:0/2511380180 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b4107860 con 0x7f71b4070f80 2023-12-12T11:43:51.110 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.514+0000 7f71b2ffd700 1 --2- 172.21.15.63:0/2511380180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71b4070f80 0x7f71b4107320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f71a40098e0 tx=0x7f71a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5df43f292522777 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:51.111 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.515+0000 7f71b1ffb700 1 -- 172.21.15.63:0/2511380180 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71a400b860 con 0x7f71b4070f80 2023-12-12T11:43:51.111 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.515+0000 7f71b1ffb700 1 -- 172.21.15.63:0/2511380180 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f71a400be70 con 0x7f71b4070f80 2023-12-12T11:43:51.111 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.515+0000 7f71b1ffb700 1 -- 172.21.15.63:0/2511380180 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71a4010380 con 0x7f71b4070f80 2023-12-12T11:43:51.111 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.515+0000 7f71b9600700 1 -- 172.21.15.63:0/2511380180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71b4070f80 msgr2=0x7f71b4107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:51.111 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.515+0000 7f71b9600700 1 --2- 172.21.15.63:0/2511380180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71b4070f80 0x7f71b4107320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f71a40098e0 tx=0x7f71a4009250 comp rx=0 tx=0).stop 2023-12-12T11:43:51.111 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.516+0000 7f71b9600700 1 -- 172.21.15.63:0/2511380180 shutdown_connections 2023-12-12T11:43:51.111 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.516+0000 7f71b9600700 1 --2- 172.21.15.63:0/2511380180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71b4070f80 0x7f71b4107320 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:51.111 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.516+0000 7f71b9600700 1 -- 172.21.15.63:0/2511380180 >> 172.21.15.63:0/2511380180 conn(0x7f71b40fc970 msgr2=0x7f71b40fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:51.111 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.516+0000 7f71b9600700 1 -- 172.21.15.63:0/2511380180 shutdown_connections 2023-12-12T11:43:51.111 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.516+0000 7f71b9600700 1 -- 172.21.15.63:0/2511380180 wait complete. 2023-12-12T11:43:51.111 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.516+0000 7f71b9600700 1 Processor -- start 2023-12-12T11:43:51.112 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.517+0000 7f71b9600700 1 -- start start 2023-12-12T11:43:51.112 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.517+0000 7f71b9600700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71b4070f80 0x7f71b41133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:51.112 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.517+0000 7f71b9600700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b4113900 con 0x7f71b4070f80 2023-12-12T11:43:51.112 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.517+0000 7f71b2ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71b4070f80 0x7f71b41133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:51.112 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.517+0000 7f71b2ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71b4070f80 0x7f71b41133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53816/0 (socket says 172.21.15.63:53816) 2023-12-12T11:43:51.112 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.517+0000 7f71b2ffd700 1 -- 172.21.15.63:0/3433327525 learned_addr learned my addr 172.21.15.63:0/3433327525 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:51.112 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.517+0000 7f71b2ffd700 1 -- 172.21.15.63:0/3433327525 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a40094f0 con 0x7f71b4070f80 2023-12-12T11:43:51.112 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.518+0000 7f71b2ffd700 1 --2- 172.21.15.63:0/3433327525 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71b4070f80 0x7f71b41133c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f71a4006d40 tx=0x7f71a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:51.112 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.518+0000 7f719b7fe700 1 -- 172.21.15.63:0/3433327525 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71a4010960 con 0x7f71b4070f80 2023-12-12T11:43:51.112 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.518+0000 7f719b7fe700 1 -- 172.21.15.63:0/3433327525 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f71a401a430 con 0x7f71b4070f80 2023-12-12T11:43:51.112 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.518+0000 7f71b9600700 1 -- 172.21.15.63:0/3433327525 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b4113b00 con 0x7f71b4070f80 2023-12-12T11:43:51.112 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.518+0000 7f719b7fe700 1 -- 172.21.15.63:0/3433327525 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71a40245b0 con 0x7f71b4070f80 2023-12-12T11:43:51.112 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.518+0000 7f71b9600700 1 -- 172.21.15.63:0/3433327525 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b4113f10 con 0x7f71b4070f80 2023-12-12T11:43:51.112 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.519+0000 7f719b7fe700 1 -- 172.21.15.63:0/3433327525 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f71a4010ac0 con 0x7f71b4070f80 2023-12-12T11:43:51.113 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.519+0000 7f71b9600700 1 -- 172.21.15.63:0/3433327525 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b404bb80 con 0x7f71b4070f80 2023-12-12T11:43:51.113 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.520+0000 7f719b7fe700 1 --2- 172.21.15.63:0/3433327525 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f719c036640 0x7f719c038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:51.113 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.520+0000 7f719b7fe700 1 -- 172.21.15.63:0/3433327525 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f71a404a090 con 0x7f71b4070f80 2023-12-12T11:43:51.113 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.520+0000 7f71b27fc700 1 --2- 172.21.15.63:0/3433327525 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f719c036640 0x7f719c038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:51.113 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.521+0000 7f71b27fc700 1 --2- 172.21.15.63:0/3433327525 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f719c036640 0x7f719c038af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009990 tx=0x7f71a8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:51.113 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.525+0000 7f719b7fe700 1 -- 172.21.15.63:0/3433327525 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f71a402b4d0 con 0x7f71b4070f80 2023-12-12T11:43:51.113 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.758+0000 7f71b9600700 1 -- 172.21.15.63:0/3433327525 --> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f71b40008d0 con 0x7f719c036640 2023-12-12T11:43:51.113 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.763+0000 7f719b7fe700 1 -- 172.21.15.63:0/3433327525 <== mgr.14120 v2:172.21.15.63:6800/4048286824 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f71b40008d0 con 0x7f719c036640 2023-12-12T11:43:51.113 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.765+0000 7f71b9600700 1 -- 172.21.15.63:0/3433327525 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f719c036640 msgr2=0x7f719c038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:51.113 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.765+0000 7f71b9600700 1 --2- 172.21.15.63:0/3433327525 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f719c036640 0x7f719c038af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009990 tx=0x7f71a8006e40 comp rx=0 tx=0).stop 2023-12-12T11:43:51.113 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.765+0000 7f71b9600700 1 -- 172.21.15.63:0/3433327525 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71b4070f80 msgr2=0x7f71b41133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:51.113 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.765+0000 7f71b9600700 1 --2- 172.21.15.63:0/3433327525 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71b4070f80 0x7f71b41133c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f71a4006d40 tx=0x7f71a4009250 comp rx=0 tx=0).stop 2023-12-12T11:43:51.113 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.765+0000 7f71b9600700 1 -- 172.21.15.63:0/3433327525 shutdown_connections 2023-12-12T11:43:51.113 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.765+0000 7f71b9600700 1 --2- 172.21.15.63:0/3433327525 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f719c036640 0x7f719c038af0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:51.114 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.765+0000 7f71b9600700 1 --2- 172.21.15.63:0/3433327525 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71b4070f80 0x7f71b41133c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:51.114 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.765+0000 7f71b9600700 1 -- 172.21.15.63:0/3433327525 >> 172.21.15.63:0/3433327525 conn(0x7f71b40fc970 msgr2=0x7f71b40fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:51.114 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.765+0000 7f71b9600700 1 -- 172.21.15.63:0/3433327525 shutdown_connections 2023-12-12T11:43:51.114 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:50.765+0000 7f71b9600700 1 -- 172.21.15.63:0/3433327525 wait complete. 2023-12-12T11:43:51.114 INFO:teuthology.orchestra.run.smithi063.stdout:Deploying crash service with default placement... 2023-12-12T11:43:51.944 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:51 smithi063 ceph-mon[107117]: from='mgr.14120 172.21.15.63:0/3652348595' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:43:51.945 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:51 smithi063 ceph-mon[107117]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:43:51.945 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:51 smithi063 ceph-mon[107117]: Saving service mgr spec with placement count:2 2023-12-12T11:43:51.945 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:51 smithi063 ceph-mon[107117]: from='mgr.14120 172.21.15.63:0/3652348595' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:43:52.106 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2023-12-12T11:43:52.106 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.497+0000 7fd6924df700 1 Processor -- start 2023-12-12T11:43:52.107 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.497+0000 7fd6924df700 1 -- start start 2023-12-12T11:43:52.107 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.498+0000 7fd6924df700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd68c1022d0 0x7fd68c1026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:52.107 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.498+0000 7fd6924df700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c102c20 con 0x7fd68c1022d0 2023-12-12T11:43:52.107 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.498+0000 7fd68bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd68c1022d0 0x7fd68c1026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:52.107 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.498+0000 7fd68bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd68c1022d0 0x7fd68c1026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53828/0 (socket says 172.21.15.63:53828) 2023-12-12T11:43:52.107 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.498+0000 7fd68bfff700 1 -- 172.21.15.63:0/1294028781 learned_addr learned my addr 172.21.15.63:0/1294028781 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:52.107 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.499+0000 7fd68bfff700 1 -- 172.21.15.63:0/1294028781 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68c102d60 con 0x7fd68c1022d0 2023-12-12T11:43:52.107 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.499+0000 7fd68bfff700 1 --2- 172.21.15.63:0/1294028781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd68c1022d0 0x7fd68c1026e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0098e0 tx=0x7fd67c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2782ad114a817ab server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:52.107 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.499+0000 7fd68affd700 1 -- 172.21.15.63:0/1294028781 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd67c00b860 con 0x7fd68c1022d0 2023-12-12T11:43:52.107 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.499+0000 7fd68affd700 1 -- 172.21.15.63:0/1294028781 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd67c00be70 con 0x7fd68c1022d0 2023-12-12T11:43:52.107 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.499+0000 7fd68affd700 1 -- 172.21.15.63:0/1294028781 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd67c010380 con 0x7fd68c1022d0 2023-12-12T11:43:52.107 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.500+0000 7fd6924df700 1 -- 172.21.15.63:0/1294028781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd68c1022d0 msgr2=0x7fd68c1026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:52.107 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.500+0000 7fd6924df700 1 --2- 172.21.15.63:0/1294028781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd68c1022d0 0x7fd68c1026e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0098e0 tx=0x7fd67c009250 comp rx=0 tx=0).stop 2023-12-12T11:43:52.107 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.500+0000 7fd6924df700 1 -- 172.21.15.63:0/1294028781 shutdown_connections 2023-12-12T11:43:52.107 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.500+0000 7fd6924df700 1 --2- 172.21.15.63:0/1294028781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd68c1022d0 0x7fd68c1026e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:52.108 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.500+0000 7fd6924df700 1 -- 172.21.15.63:0/1294028781 >> 172.21.15.63:0/1294028781 conn(0x7fd68c0fda50 msgr2=0x7fd68c0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:52.108 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.500+0000 7fd6924df700 1 -- 172.21.15.63:0/1294028781 shutdown_connections 2023-12-12T11:43:52.108 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.500+0000 7fd6924df700 1 -- 172.21.15.63:0/1294028781 wait complete. 2023-12-12T11:43:52.108 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.501+0000 7fd6924df700 1 Processor -- start 2023-12-12T11:43:52.108 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.501+0000 7fd6924df700 1 -- start start 2023-12-12T11:43:52.108 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.502+0000 7fd6924df700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd68c1022d0 0x7fd68c077c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:52.108 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.502+0000 7fd6924df700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c076080 con 0x7fd68c1022d0 2023-12-12T11:43:52.108 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.502+0000 7fd68bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd68c1022d0 0x7fd68c077c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:52.108 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.502+0000 7fd68bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd68c1022d0 0x7fd68c077c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53830/0 (socket says 172.21.15.63:53830) 2023-12-12T11:43:52.108 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.502+0000 7fd68bfff700 1 -- 172.21.15.63:0/518715602 learned_addr learned my addr 172.21.15.63:0/518715602 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:52.108 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.502+0000 7fd68bfff700 1 -- 172.21.15.63:0/518715602 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67c0094f0 con 0x7fd68c1022d0 2023-12-12T11:43:52.108 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.503+0000 7fd68bfff700 1 --2- 172.21.15.63:0/518715602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd68c1022d0 0x7fd68c077c00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00c010 tx=0x7fd67c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:52.108 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.503+0000 7fd688ff9700 1 -- 172.21.15.63:0/518715602 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd67c010960 con 0x7fd68c1022d0 2023-12-12T11:43:52.108 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.503+0000 7fd6924df700 1 -- 172.21.15.63:0/518715602 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd68c076280 con 0x7fd68c1022d0 2023-12-12T11:43:52.109 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.503+0000 7fd688ff9700 1 -- 172.21.15.63:0/518715602 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd67c01a430 con 0x7fd68c1022d0 2023-12-12T11:43:52.109 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.503+0000 7fd688ff9700 1 -- 172.21.15.63:0/518715602 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd67c019580 con 0x7fd68c1022d0 2023-12-12T11:43:52.109 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.503+0000 7fd6924df700 1 -- 172.21.15.63:0/518715602 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68c076690 con 0x7fd68c1022d0 2023-12-12T11:43:52.109 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.504+0000 7fd688ff9700 1 -- 172.21.15.63:0/518715602 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fd67c010ac0 con 0x7fd68c1022d0 2023-12-12T11:43:52.109 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.504+0000 7fd6924df700 1 -- 172.21.15.63:0/518715602 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd68c10b190 con 0x7fd68c1022d0 2023-12-12T11:43:52.109 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.505+0000 7fd688ff9700 1 --2- 172.21.15.63:0/518715602 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fd674036640 0x7fd674038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:52.109 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.505+0000 7fd688ff9700 1 -- 172.21.15.63:0/518715602 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd67c04a440 con 0x7fd68c1022d0 2023-12-12T11:43:52.109 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.505+0000 7fd68b7fe700 1 --2- 172.21.15.63:0/518715602 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fd674036640 0x7fd674038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:52.109 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.506+0000 7fd68b7fe700 1 --2- 172.21.15.63:0/518715602 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fd674036640 0x7fd674038af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd680009990 tx=0x7fd680006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:52.109 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.510+0000 7fd688ff9700 1 -- 172.21.15.63:0/518715602 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd67c0222f0 con 0x7fd68c1022d0 2023-12-12T11:43:52.109 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.736+0000 7fd6924df700 1 -- 172.21.15.63:0/518715602 --> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7fd68c02b150 con 0x7fd674036640 2023-12-12T11:43:52.109 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.741+0000 7fd688ff9700 1 -- 172.21.15.63:0/518715602 <== mgr.14120 v2:172.21.15.63:6800/4048286824 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fd68c02b150 con 0x7fd674036640 2023-12-12T11:43:52.109 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.743+0000 7fd6924df700 1 -- 172.21.15.63:0/518715602 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fd674036640 msgr2=0x7fd674038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:52.109 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.743+0000 7fd6924df700 1 --2- 172.21.15.63:0/518715602 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fd674036640 0x7fd674038af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd680009990 tx=0x7fd680006e40 comp rx=0 tx=0).stop 2023-12-12T11:43:52.109 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.743+0000 7fd6924df700 1 -- 172.21.15.63:0/518715602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd68c1022d0 msgr2=0x7fd68c077c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:52.110 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.743+0000 7fd6924df700 1 --2- 172.21.15.63:0/518715602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd68c1022d0 0x7fd68c077c00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00c010 tx=0x7fd67c009250 comp rx=0 tx=0).stop 2023-12-12T11:43:52.110 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.743+0000 7fd6924df700 1 -- 172.21.15.63:0/518715602 shutdown_connections 2023-12-12T11:43:52.110 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.743+0000 7fd6924df700 1 --2- 172.21.15.63:0/518715602 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fd674036640 0x7fd674038af0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:52.110 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.743+0000 7fd6924df700 1 --2- 172.21.15.63:0/518715602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd68c1022d0 0x7fd68c077c00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:52.110 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.743+0000 7fd6924df700 1 -- 172.21.15.63:0/518715602 >> 172.21.15.63:0/518715602 conn(0x7fd68c0fda50 msgr2=0x7fd68c0ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:52.110 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.744+0000 7fd6924df700 1 -- 172.21.15.63:0/518715602 shutdown_connections 2023-12-12T11:43:52.110 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:51.744+0000 7fd6924df700 1 -- 172.21.15.63:0/518715602 wait complete. 2023-12-12T11:43:52.110 INFO:teuthology.orchestra.run.smithi063.stdout:Deploying prometheus service with default placement... 2023-12-12T11:43:53.006 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:52 smithi063 ceph-mon[107117]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:43:53.006 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:52 smithi063 ceph-mon[107117]: Saving service crash spec with placement * 2023-12-12T11:43:53.006 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:52 smithi063 ceph-mon[107117]: from='mgr.14120 172.21.15.63:0/3652348595' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:43:53.006 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:52 smithi063 ceph-mon[107117]: from='mgr.14120 172.21.15.63:0/3652348595' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:43:53.190 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2023-12-12T11:43:53.191 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.555+0000 7f080734f700 1 Processor -- start 2023-12-12T11:43:53.191 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.555+0000 7f080734f700 1 -- start start 2023-12-12T11:43:53.191 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.555+0000 7f080734f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0800077bb0 0x7f08000760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:53.191 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.555+0000 7f080734f700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0800077fc0 con 0x7f0800077bb0 2023-12-12T11:43:53.191 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.556+0000 7f08050eb700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0800077bb0 0x7f08000760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:53.191 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.556+0000 7f08050eb700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0800077bb0 0x7f08000760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53844/0 (socket says 172.21.15.63:53844) 2023-12-12T11:43:53.191 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.556+0000 7f08050eb700 1 -- 172.21.15.63:0/2412283516 learned_addr learned my addr 172.21.15.63:0/2412283516 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:53.191 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.556+0000 7f08050eb700 1 -- 172.21.15.63:0/2412283516 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0800076600 con 0x7f0800077bb0 2023-12-12T11:43:53.191 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.556+0000 7f08050eb700 1 --2- 172.21.15.63:0/2412283516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0800077bb0 0x7f08000760c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0098e0 tx=0x7f07fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7bdabdf0c04c18 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:53.191 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.557+0000 7f07f7fff700 1 -- 172.21.15.63:0/2412283516 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f07fc00b860 con 0x7f0800077bb0 2023-12-12T11:43:53.191 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.557+0000 7f07f7fff700 1 -- 172.21.15.63:0/2412283516 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f07fc00be70 con 0x7f0800077bb0 2023-12-12T11:43:53.192 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.557+0000 7f07f7fff700 1 -- 172.21.15.63:0/2412283516 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f07fc010380 con 0x7f0800077bb0 2023-12-12T11:43:53.192 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.557+0000 7f080734f700 1 -- 172.21.15.63:0/2412283516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0800077bb0 msgr2=0x7f08000760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:53.192 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.557+0000 7f080734f700 1 --2- 172.21.15.63:0/2412283516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0800077bb0 0x7f08000760c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0098e0 tx=0x7f07fc009250 comp rx=0 tx=0).stop 2023-12-12T11:43:53.192 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.557+0000 7f080734f700 1 -- 172.21.15.63:0/2412283516 shutdown_connections 2023-12-12T11:43:53.192 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.557+0000 7f080734f700 1 --2- 172.21.15.63:0/2412283516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0800077bb0 0x7f08000760c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:53.192 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.557+0000 7f080734f700 1 -- 172.21.15.63:0/2412283516 >> 172.21.15.63:0/2412283516 conn(0x7f08000fda50 msgr2=0x7f08000ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:53.192 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.557+0000 7f080734f700 1 -- 172.21.15.63:0/2412283516 shutdown_connections 2023-12-12T11:43:53.192 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.558+0000 7f080734f700 1 -- 172.21.15.63:0/2412283516 wait complete. 2023-12-12T11:43:53.192 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.558+0000 7f080734f700 1 Processor -- start 2023-12-12T11:43:53.192 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.558+0000 7f080734f700 1 -- start start 2023-12-12T11:43:53.192 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.559+0000 7f080734f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0800077bb0 0x7f08001133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:53.192 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.559+0000 7f080734f700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0800113910 con 0x7f0800077bb0 2023-12-12T11:43:53.192 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.559+0000 7f08050eb700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0800077bb0 0x7f08001133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:53.192 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.559+0000 7f08050eb700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0800077bb0 0x7f08001133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53854/0 (socket says 172.21.15.63:53854) 2023-12-12T11:43:53.192 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.559+0000 7f08050eb700 1 -- 172.21.15.63:0/93867240 learned_addr learned my addr 172.21.15.63:0/93867240 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:53.193 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.559+0000 7f08050eb700 1 -- 172.21.15.63:0/93867240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07fc0094f0 con 0x7f0800077bb0 2023-12-12T11:43:53.193 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.560+0000 7f08050eb700 1 --2- 172.21.15.63:0/93867240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0800077bb0 0x7f08001133d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f07fc006d40 tx=0x7f07fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:53.193 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.560+0000 7f07f5ffb700 1 -- 172.21.15.63:0/93867240 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f07fc010960 con 0x7f0800077bb0 2023-12-12T11:43:53.193 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.560+0000 7f07f5ffb700 1 -- 172.21.15.63:0/93867240 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f07fc01a430 con 0x7f0800077bb0 2023-12-12T11:43:53.193 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.560+0000 7f080734f700 1 -- 172.21.15.63:0/93867240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0800113b10 con 0x7f0800077bb0 2023-12-12T11:43:53.193 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.560+0000 7f07f5ffb700 1 -- 172.21.15.63:0/93867240 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f07fc0245b0 con 0x7f0800077bb0 2023-12-12T11:43:53.193 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.560+0000 7f080734f700 1 -- 172.21.15.63:0/93867240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0800113f20 con 0x7f0800077bb0 2023-12-12T11:43:53.193 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.561+0000 7f07f5ffb700 1 -- 172.21.15.63:0/93867240 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f07fc01a9f0 con 0x7f0800077bb0 2023-12-12T11:43:53.193 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.561+0000 7f080734f700 1 -- 172.21.15.63:0/93867240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f080004bb80 con 0x7f0800077bb0 2023-12-12T11:43:53.193 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.562+0000 7f07f5ffb700 1 --2- 172.21.15.63:0/93867240 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f07ec0365f0 0x7f07ec038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:53.193 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.562+0000 7f07f5ffb700 1 -- 172.21.15.63:0/93867240 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f07fc04a220 con 0x7f0800077bb0 2023-12-12T11:43:53.193 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.562+0000 7f08048ea700 1 --2- 172.21.15.63:0/93867240 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f07ec0365f0 0x7f07ec038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:53.193 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.563+0000 7f08048ea700 1 --2- 172.21.15.63:0/93867240 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f07ec0365f0 0x7f07ec038aa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f07f0009990 tx=0x7f07f0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:53.194 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.567+0000 7f07f5ffb700 1 -- 172.21.15.63:0/93867240 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f07fc02b8e0 con 0x7f0800077bb0 2023-12-12T11:43:53.194 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.789+0000 7f080734f700 1 -- 172.21.15.63:0/93867240 --> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f08000008d0 con 0x7f07ec0365f0 2023-12-12T11:43:53.194 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.794+0000 7f07f5ffb700 1 -- 172.21.15.63:0/93867240 <== mgr.14120 v2:172.21.15.63:6800/4048286824 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f08000008d0 con 0x7f07ec0365f0 2023-12-12T11:43:53.194 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.797+0000 7f080734f700 1 -- 172.21.15.63:0/93867240 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f07ec0365f0 msgr2=0x7f07ec038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:53.194 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.797+0000 7f080734f700 1 --2- 172.21.15.63:0/93867240 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f07ec0365f0 0x7f07ec038aa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f07f0009990 tx=0x7f07f0006e40 comp rx=0 tx=0).stop 2023-12-12T11:43:53.194 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.797+0000 7f080734f700 1 -- 172.21.15.63:0/93867240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0800077bb0 msgr2=0x7f08001133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:53.194 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.797+0000 7f080734f700 1 --2- 172.21.15.63:0/93867240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0800077bb0 0x7f08001133d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f07fc006d40 tx=0x7f07fc009250 comp rx=0 tx=0).stop 2023-12-12T11:43:53.194 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.797+0000 7f080734f700 1 -- 172.21.15.63:0/93867240 shutdown_connections 2023-12-12T11:43:53.194 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.797+0000 7f080734f700 1 --2- 172.21.15.63:0/93867240 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f07ec0365f0 0x7f07ec038aa0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:53.194 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.797+0000 7f080734f700 1 --2- 172.21.15.63:0/93867240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0800077bb0 0x7f08001133d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:53.194 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.797+0000 7f080734f700 1 -- 172.21.15.63:0/93867240 >> 172.21.15.63:0/93867240 conn(0x7f08000fda50 msgr2=0x7f08000ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:53.194 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.797+0000 7f080734f700 1 -- 172.21.15.63:0/93867240 shutdown_connections 2023-12-12T11:43:53.194 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:52.797+0000 7f080734f700 1 -- 172.21.15.63:0/93867240 wait complete. 2023-12-12T11:43:53.194 INFO:teuthology.orchestra.run.smithi063.stdout:Deploying grafana service with default placement... 2023-12-12T11:43:54.098 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:53 smithi063 ceph-mon[107117]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:43:54.098 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:53 smithi063 ceph-mon[107117]: Saving service prometheus spec with placement count:1 2023-12-12T11:43:54.098 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:53 smithi063 ceph-mon[107117]: from='mgr.14120 172.21.15.63:0/3652348595' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:43:54.098 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:53 smithi063 ceph-mon[107117]: from='mgr.14120 172.21.15.63:0/3652348595' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:43:54.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2023-12-12T11:43:54.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.605+0000 7ff072d67700 1 Processor -- start 2023-12-12T11:43:54.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.606+0000 7ff072d67700 1 -- start start 2023-12-12T11:43:54.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.606+0000 7ff072d67700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff06c077bd0 0x7ff06c0760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:54.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.606+0000 7ff072d67700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c077fe0 con 0x7ff06c077bd0 2023-12-12T11:43:54.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.606+0000 7ff070b03700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff06c077bd0 0x7ff06c0760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:54.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.606+0000 7ff070b03700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff06c077bd0 0x7ff06c0760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53868/0 (socket says 172.21.15.63:53868) 2023-12-12T11:43:54.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.606+0000 7ff070b03700 1 -- 172.21.15.63:0/3016462413 learned_addr learned my addr 172.21.15.63:0/3016462413 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:54.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.607+0000 7ff070b03700 1 -- 172.21.15.63:0/3016462413 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06c076620 con 0x7ff06c077bd0 2023-12-12T11:43:54.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.607+0000 7ff070b03700 1 --2- 172.21.15.63:0/3016462413 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff06c077bd0 0x7ff06c0760e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff0600098e0 tx=0x7ff060009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422384ab4b2aaed server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:54.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.607+0000 7ff06b7fe700 1 -- 172.21.15.63:0/3016462413 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff06000b860 con 0x7ff06c077bd0 2023-12-12T11:43:54.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.607+0000 7ff06b7fe700 1 -- 172.21.15.63:0/3016462413 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff06000be70 con 0x7ff06c077bd0 2023-12-12T11:43:54.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.607+0000 7ff06b7fe700 1 -- 172.21.15.63:0/3016462413 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff060010380 con 0x7ff06c077bd0 2023-12-12T11:43:54.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.608+0000 7ff072d67700 1 -- 172.21.15.63:0/3016462413 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff06c077bd0 msgr2=0x7ff06c0760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:54.265 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.608+0000 7ff072d67700 1 --2- 172.21.15.63:0/3016462413 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff06c077bd0 0x7ff06c0760e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff0600098e0 tx=0x7ff060009250 comp rx=0 tx=0).stop 2023-12-12T11:43:54.265 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.608+0000 7ff072d67700 1 -- 172.21.15.63:0/3016462413 shutdown_connections 2023-12-12T11:43:54.265 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.608+0000 7ff072d67700 1 --2- 172.21.15.63:0/3016462413 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff06c077bd0 0x7ff06c0760e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:54.265 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.608+0000 7ff072d67700 1 -- 172.21.15.63:0/3016462413 >> 172.21.15.63:0/3016462413 conn(0x7ff06c0fda50 msgr2=0x7ff06c0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:54.265 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.608+0000 7ff072d67700 1 -- 172.21.15.63:0/3016462413 shutdown_connections 2023-12-12T11:43:54.265 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.608+0000 7ff072d67700 1 -- 172.21.15.63:0/3016462413 wait complete. 2023-12-12T11:43:54.265 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.609+0000 7ff072d67700 1 Processor -- start 2023-12-12T11:43:54.265 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.609+0000 7ff072d67700 1 -- start start 2023-12-12T11:43:54.265 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.609+0000 7ff072d67700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff06c077bd0 0x7ff06c1133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:54.265 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.609+0000 7ff072d67700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c113900 con 0x7ff06c077bd0 2023-12-12T11:43:54.265 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.610+0000 7ff070b03700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff06c077bd0 0x7ff06c1133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:54.266 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.610+0000 7ff070b03700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff06c077bd0 0x7ff06c1133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53884/0 (socket says 172.21.15.63:53884) 2023-12-12T11:43:54.266 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.610+0000 7ff070b03700 1 -- 172.21.15.63:0/900289169 learned_addr learned my addr 172.21.15.63:0/900289169 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:54.266 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.610+0000 7ff070b03700 1 -- 172.21.15.63:0/900289169 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0600094f0 con 0x7ff06c077bd0 2023-12-12T11:43:54.266 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.610+0000 7ff070b03700 1 --2- 172.21.15.63:0/900289169 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff06c077bd0 0x7ff06c1133c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff060006d40 tx=0x7ff060009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:54.266 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.611+0000 7ff0697fa700 1 -- 172.21.15.63:0/900289169 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff060010960 con 0x7ff06c077bd0 2023-12-12T11:43:54.266 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.611+0000 7ff0697fa700 1 -- 172.21.15.63:0/900289169 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff06001a430 con 0x7ff06c077bd0 2023-12-12T11:43:54.266 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.611+0000 7ff0697fa700 1 -- 172.21.15.63:0/900289169 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff0600245b0 con 0x7ff06c077bd0 2023-12-12T11:43:54.266 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.611+0000 7ff072d67700 1 -- 172.21.15.63:0/900289169 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff06c113b00 con 0x7ff06c077bd0 2023-12-12T11:43:54.266 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.611+0000 7ff072d67700 1 -- 172.21.15.63:0/900289169 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff06c113f10 con 0x7ff06c077bd0 2023-12-12T11:43:54.266 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.612+0000 7ff0697fa700 1 -- 172.21.15.63:0/900289169 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7ff06001a9f0 con 0x7ff06c077bd0 2023-12-12T11:43:54.266 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.612+0000 7ff072d67700 1 -- 172.21.15.63:0/900289169 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff06c04bb80 con 0x7ff06c077bd0 2023-12-12T11:43:54.266 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.613+0000 7ff0697fa700 1 --2- 172.21.15.63:0/900289169 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7ff05c036640 0x7ff05c038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:54.266 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.613+0000 7ff0697fa700 1 -- 172.21.15.63:0/900289169 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ff06004a110 con 0x7ff06c077bd0 2023-12-12T11:43:54.267 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.613+0000 7ff06bfff700 1 --2- 172.21.15.63:0/900289169 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7ff05c036640 0x7ff05c038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:54.267 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.614+0000 7ff06bfff700 1 --2- 172.21.15.63:0/900289169 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7ff05c036640 0x7ff05c038af0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff058009990 tx=0x7ff058006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:54.267 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.621+0000 7ff0697fa700 1 -- 172.21.15.63:0/900289169 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff06002b8c0 con 0x7ff06c077bd0 2023-12-12T11:43:54.267 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.872+0000 7ff072d67700 1 -- 172.21.15.63:0/900289169 --> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7ff06c0008d0 con 0x7ff05c036640 2023-12-12T11:43:54.267 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.877+0000 7ff0697fa700 1 -- 172.21.15.63:0/900289169 <== mgr.14120 v2:172.21.15.63:6800/4048286824 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7ff06c0008d0 con 0x7ff05c036640 2023-12-12T11:43:54.267 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.880+0000 7ff072d67700 1 -- 172.21.15.63:0/900289169 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7ff05c036640 msgr2=0x7ff05c038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:54.267 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.880+0000 7ff072d67700 1 --2- 172.21.15.63:0/900289169 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7ff05c036640 0x7ff05c038af0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff058009990 tx=0x7ff058006e40 comp rx=0 tx=0).stop 2023-12-12T11:43:54.267 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.880+0000 7ff072d67700 1 -- 172.21.15.63:0/900289169 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff06c077bd0 msgr2=0x7ff06c1133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:54.267 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.880+0000 7ff072d67700 1 --2- 172.21.15.63:0/900289169 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff06c077bd0 0x7ff06c1133c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff060006d40 tx=0x7ff060009250 comp rx=0 tx=0).stop 2023-12-12T11:43:54.267 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.880+0000 7ff072d67700 1 -- 172.21.15.63:0/900289169 shutdown_connections 2023-12-12T11:43:54.267 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.880+0000 7ff072d67700 1 --2- 172.21.15.63:0/900289169 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7ff05c036640 0x7ff05c038af0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:54.267 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.880+0000 7ff072d67700 1 --2- 172.21.15.63:0/900289169 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff06c077bd0 0x7ff06c1133c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:54.267 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.880+0000 7ff072d67700 1 -- 172.21.15.63:0/900289169 >> 172.21.15.63:0/900289169 conn(0x7ff06c0fda50 msgr2=0x7ff06c0ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:54.267 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.880+0000 7ff072d67700 1 -- 172.21.15.63:0/900289169 shutdown_connections 2023-12-12T11:43:54.268 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:53.880+0000 7ff072d67700 1 -- 172.21.15.63:0/900289169 wait complete. 2023-12-12T11:43:54.268 INFO:teuthology.orchestra.run.smithi063.stdout:Deploying node-exporter service with default placement... 2023-12-12T11:43:55.197 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:54 smithi063 ceph-mon[107117]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:43:55.197 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:54 smithi063 ceph-mon[107117]: Saving service grafana spec with placement count:1 2023-12-12T11:43:55.198 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:54 smithi063 ceph-mon[107117]: from='mgr.14120 172.21.15.63:0/3652348595' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:43:55.363 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2023-12-12T11:43:55.363 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.726+0000 7effdb7cf700 1 Processor -- start 2023-12-12T11:43:55.363 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.726+0000 7effdb7cf700 1 -- start start 2023-12-12T11:43:55.363 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.726+0000 7effdb7cf700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd4077b90 0x7effd40760a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:55.363 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.726+0000 7effdb7cf700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd4077fa0 con 0x7effd4077b90 2023-12-12T11:43:55.363 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.727+0000 7effd956b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd4077b90 0x7effd40760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:55.363 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.727+0000 7effd956b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd4077b90 0x7effd40760a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53886/0 (socket says 172.21.15.63:53886) 2023-12-12T11:43:55.363 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.727+0000 7effd956b700 1 -- 172.21.15.63:0/13156014 learned_addr learned my addr 172.21.15.63:0/13156014 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:55.363 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.727+0000 7effd956b700 1 -- 172.21.15.63:0/13156014 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd40765e0 con 0x7effd4077b90 2023-12-12T11:43:55.364 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.727+0000 7effd956b700 1 --2- 172.21.15.63:0/13156014 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd4077b90 0x7effd40760a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7effd00098e0 tx=0x7effd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc89b0e97564410 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:55.364 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.728+0000 7effcbfff700 1 -- 172.21.15.63:0/13156014 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7effd000b860 con 0x7effd4077b90 2023-12-12T11:43:55.364 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.728+0000 7effcbfff700 1 -- 172.21.15.63:0/13156014 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7effd000be70 con 0x7effd4077b90 2023-12-12T11:43:55.364 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.728+0000 7effcbfff700 1 -- 172.21.15.63:0/13156014 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7effd0010380 con 0x7effd4077b90 2023-12-12T11:43:55.364 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.728+0000 7effdb7cf700 1 -- 172.21.15.63:0/13156014 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd4077b90 msgr2=0x7effd40760a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:55.364 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.728+0000 7effdb7cf700 1 --2- 172.21.15.63:0/13156014 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd4077b90 0x7effd40760a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7effd00098e0 tx=0x7effd0009250 comp rx=0 tx=0).stop 2023-12-12T11:43:55.364 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.728+0000 7effdb7cf700 1 -- 172.21.15.63:0/13156014 shutdown_connections 2023-12-12T11:43:55.364 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.728+0000 7effdb7cf700 1 --2- 172.21.15.63:0/13156014 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd4077b90 0x7effd40760a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:55.364 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.728+0000 7effdb7cf700 1 -- 172.21.15.63:0/13156014 >> 172.21.15.63:0/13156014 conn(0x7effd40fda50 msgr2=0x7effd40ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:55.364 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.729+0000 7effdb7cf700 1 -- 172.21.15.63:0/13156014 shutdown_connections 2023-12-12T11:43:55.364 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.729+0000 7effdb7cf700 1 -- 172.21.15.63:0/13156014 wait complete. 2023-12-12T11:43:55.364 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.729+0000 7effdb7cf700 1 Processor -- start 2023-12-12T11:43:55.365 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.730+0000 7effdb7cf700 1 -- start start 2023-12-12T11:43:55.365 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.730+0000 7effdb7cf700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd4077b90 0x7effd41133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:55.365 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.730+0000 7effdb7cf700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd4113900 con 0x7effd4077b90 2023-12-12T11:43:55.365 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.730+0000 7effd956b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd4077b90 0x7effd41133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:55.365 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.730+0000 7effd956b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd4077b90 0x7effd41133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53902/0 (socket says 172.21.15.63:53902) 2023-12-12T11:43:55.365 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.730+0000 7effd956b700 1 -- 172.21.15.63:0/1377007640 learned_addr learned my addr 172.21.15.63:0/1377007640 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:55.365 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.731+0000 7effd956b700 1 -- 172.21.15.63:0/1377007640 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd00094f0 con 0x7effd4077b90 2023-12-12T11:43:55.365 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.731+0000 7effd956b700 1 --2- 172.21.15.63:0/1377007640 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd4077b90 0x7effd41133c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7effd0006d40 tx=0x7effd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:55.365 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.731+0000 7effc9ffb700 1 -- 172.21.15.63:0/1377007640 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7effd0010960 con 0x7effd4077b90 2023-12-12T11:43:55.365 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.731+0000 7effc9ffb700 1 -- 172.21.15.63:0/1377007640 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7effd001a430 con 0x7effd4077b90 2023-12-12T11:43:55.366 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.731+0000 7effdb7cf700 1 -- 172.21.15.63:0/1377007640 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd4113b00 con 0x7effd4077b90 2023-12-12T11:43:55.366 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.731+0000 7effc9ffb700 1 -- 172.21.15.63:0/1377007640 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7effd00245b0 con 0x7effd4077b90 2023-12-12T11:43:55.366 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.731+0000 7effdb7cf700 1 -- 172.21.15.63:0/1377007640 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd4113f10 con 0x7effd4077b90 2023-12-12T11:43:55.366 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.732+0000 7effc9ffb700 1 -- 172.21.15.63:0/1377007640 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7effd001a9f0 con 0x7effd4077b90 2023-12-12T11:43:55.366 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.732+0000 7effdb7cf700 1 -- 172.21.15.63:0/1377007640 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd404bb80 con 0x7effd4077b90 2023-12-12T11:43:55.366 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.733+0000 7effc9ffb700 1 --2- 172.21.15.63:0/1377007640 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7effc00365f0 0x7effc0038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:55.366 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.733+0000 7effc9ffb700 1 -- 172.21.15.63:0/1377007640 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7effd004a0e0 con 0x7effd4077b90 2023-12-12T11:43:55.366 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.733+0000 7effd8d6a700 1 --2- 172.21.15.63:0/1377007640 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7effc00365f0 0x7effc0038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:55.366 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.734+0000 7effd8d6a700 1 --2- 172.21.15.63:0/1377007640 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7effc00365f0 0x7effc0038aa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7effc4009990 tx=0x7effc4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:55.366 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.738+0000 7effc9ffb700 1 -- 172.21.15.63:0/1377007640 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7effd002b8c0 con 0x7effd4077b90 2023-12-12T11:43:55.366 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.967+0000 7effdb7cf700 1 -- 172.21.15.63:0/1377007640 --> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7effd410d1f0 con 0x7effc00365f0 2023-12-12T11:43:55.366 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.972+0000 7effc9ffb700 1 -- 172.21.15.63:0/1377007640 <== mgr.14120 v2:172.21.15.63:6800/4048286824 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7effd410d1f0 con 0x7effc00365f0 2023-12-12T11:43:55.367 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.974+0000 7effdb7cf700 1 -- 172.21.15.63:0/1377007640 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7effc00365f0 msgr2=0x7effc0038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:55.367 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.974+0000 7effdb7cf700 1 --2- 172.21.15.63:0/1377007640 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7effc00365f0 0x7effc0038aa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7effc4009990 tx=0x7effc4006e40 comp rx=0 tx=0).stop 2023-12-12T11:43:55.367 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.974+0000 7effdb7cf700 1 -- 172.21.15.63:0/1377007640 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd4077b90 msgr2=0x7effd41133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:55.367 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.974+0000 7effdb7cf700 1 --2- 172.21.15.63:0/1377007640 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd4077b90 0x7effd41133c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7effd0006d40 tx=0x7effd0009250 comp rx=0 tx=0).stop 2023-12-12T11:43:55.367 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.974+0000 7effdb7cf700 1 -- 172.21.15.63:0/1377007640 shutdown_connections 2023-12-12T11:43:55.367 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.974+0000 7effdb7cf700 1 --2- 172.21.15.63:0/1377007640 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7effc00365f0 0x7effc0038aa0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:55.367 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.974+0000 7effdb7cf700 1 --2- 172.21.15.63:0/1377007640 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd4077b90 0x7effd41133c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:55.367 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.974+0000 7effdb7cf700 1 -- 172.21.15.63:0/1377007640 >> 172.21.15.63:0/1377007640 conn(0x7effd40fda50 msgr2=0x7effd40ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:55.367 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.974+0000 7effdb7cf700 1 -- 172.21.15.63:0/1377007640 shutdown_connections 2023-12-12T11:43:55.367 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:54.974+0000 7effdb7cf700 1 -- 172.21.15.63:0/1377007640 wait complete. 2023-12-12T11:43:55.367 INFO:teuthology.orchestra.run.smithi063.stdout:Deploying alertmanager service with default placement... 2023-12-12T11:43:56.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:55 smithi063 ceph-mon[107117]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:43:56.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:55 smithi063 ceph-mon[107117]: Saving service node-exporter spec with placement * 2023-12-12T11:43:56.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:55 smithi063 ceph-mon[107117]: from='mgr.14120 172.21.15.63:0/3652348595' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:43:56.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2023-12-12T11:43:56.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.766+0000 7fb972d83700 1 Processor -- start 2023-12-12T11:43:56.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.767+0000 7fb972d83700 1 -- start start 2023-12-12T11:43:56.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.767+0000 7fb972d83700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96c077bd0 0x7fb96c0760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:56.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.767+0000 7fb972d83700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c077fe0 con 0x7fb96c077bd0 2023-12-12T11:43:56.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.767+0000 7fb970b1f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96c077bd0 0x7fb96c0760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:56.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.767+0000 7fb970b1f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96c077bd0 0x7fb96c0760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53904/0 (socket says 172.21.15.63:53904) 2023-12-12T11:43:56.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.767+0000 7fb970b1f700 1 -- 172.21.15.63:0/1171352660 learned_addr learned my addr 172.21.15.63:0/1171352660 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:56.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.768+0000 7fb970b1f700 1 -- 172.21.15.63:0/1171352660 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96c076620 con 0x7fb96c077bd0 2023-12-12T11:43:56.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.768+0000 7fb970b1f700 1 --2- 172.21.15.63:0/1171352660 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96c077bd0 0x7fb96c0760e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb9600098e0 tx=0x7fb960009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498474b60804309e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:56.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.768+0000 7fb96b7fe700 1 -- 172.21.15.63:0/1171352660 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb96000b860 con 0x7fb96c077bd0 2023-12-12T11:43:56.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.768+0000 7fb96b7fe700 1 -- 172.21.15.63:0/1171352660 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb96000be70 con 0x7fb96c077bd0 2023-12-12T11:43:56.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.768+0000 7fb96b7fe700 1 -- 172.21.15.63:0/1171352660 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb960010380 con 0x7fb96c077bd0 2023-12-12T11:43:56.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.769+0000 7fb972d83700 1 -- 172.21.15.63:0/1171352660 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96c077bd0 msgr2=0x7fb96c0760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:56.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.769+0000 7fb972d83700 1 --2- 172.21.15.63:0/1171352660 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96c077bd0 0x7fb96c0760e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb9600098e0 tx=0x7fb960009250 comp rx=0 tx=0).stop 2023-12-12T11:43:56.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.769+0000 7fb972d83700 1 -- 172.21.15.63:0/1171352660 shutdown_connections 2023-12-12T11:43:56.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.769+0000 7fb972d83700 1 --2- 172.21.15.63:0/1171352660 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96c077bd0 0x7fb96c0760e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:56.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.769+0000 7fb972d83700 1 -- 172.21.15.63:0/1171352660 >> 172.21.15.63:0/1171352660 conn(0x7fb96c0fda50 msgr2=0x7fb96c0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:56.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.769+0000 7fb972d83700 1 -- 172.21.15.63:0/1171352660 shutdown_connections 2023-12-12T11:43:56.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.769+0000 7fb972d83700 1 -- 172.21.15.63:0/1171352660 wait complete. 2023-12-12T11:43:56.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.770+0000 7fb972d83700 1 Processor -- start 2023-12-12T11:43:56.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.770+0000 7fb972d83700 1 -- start start 2023-12-12T11:43:56.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.771+0000 7fb972d83700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96c077bd0 0x7fb96c1133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:56.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.771+0000 7fb972d83700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c113900 con 0x7fb96c077bd0 2023-12-12T11:43:56.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.771+0000 7fb970b1f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96c077bd0 0x7fb96c1133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:56.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.771+0000 7fb970b1f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96c077bd0 0x7fb96c1133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53916/0 (socket says 172.21.15.63:53916) 2023-12-12T11:43:56.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.771+0000 7fb970b1f700 1 -- 172.21.15.63:0/3761641171 learned_addr learned my addr 172.21.15.63:0/3761641171 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:56.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.771+0000 7fb970b1f700 1 -- 172.21.15.63:0/3761641171 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9600094f0 con 0x7fb96c077bd0 2023-12-12T11:43:56.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.772+0000 7fb970b1f700 1 --2- 172.21.15.63:0/3761641171 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96c077bd0 0x7fb96c1133c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb960006d40 tx=0x7fb960009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:56.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.772+0000 7fb9697fa700 1 -- 172.21.15.63:0/3761641171 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb960010960 con 0x7fb96c077bd0 2023-12-12T11:43:56.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.772+0000 7fb9697fa700 1 -- 172.21.15.63:0/3761641171 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb96001a430 con 0x7fb96c077bd0 2023-12-12T11:43:56.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.772+0000 7fb9697fa700 1 -- 172.21.15.63:0/3761641171 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb9600245b0 con 0x7fb96c077bd0 2023-12-12T11:43:56.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.772+0000 7fb972d83700 1 -- 172.21.15.63:0/3761641171 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb96c113b00 con 0x7fb96c077bd0 2023-12-12T11:43:56.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.772+0000 7fb972d83700 1 -- 172.21.15.63:0/3761641171 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb96c113f10 con 0x7fb96c077bd0 2023-12-12T11:43:56.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.773+0000 7fb9697fa700 1 -- 172.21.15.63:0/3761641171 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fb96001a9f0 con 0x7fb96c077bd0 2023-12-12T11:43:56.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.773+0000 7fb972d83700 1 -- 172.21.15.63:0/3761641171 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb96c04bb80 con 0x7fb96c077bd0 2023-12-12T11:43:56.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.774+0000 7fb9697fa700 1 --2- 172.21.15.63:0/3761641171 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fb95c0365f0 0x7fb95c038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:56.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.774+0000 7fb9697fa700 1 -- 172.21.15.63:0/3761641171 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fb96004a160 con 0x7fb96c077bd0 2023-12-12T11:43:56.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.774+0000 7fb96bfff700 1 --2- 172.21.15.63:0/3761641171 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fb95c0365f0 0x7fb95c038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:56.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.774+0000 7fb96bfff700 1 --2- 172.21.15.63:0/3761641171 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fb95c0365f0 0x7fb95c038aa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb958009990 tx=0x7fb958006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:56.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.778+0000 7fb9697fa700 1 -- 172.21.15.63:0/3761641171 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb96002b8e0 con 0x7fb96c077bd0 2023-12-12T11:43:56.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.994+0000 7fb972d83700 1 -- 172.21.15.63:0/3761641171 --> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7fb96c10d1f0 con 0x7fb95c0365f0 2023-12-12T11:43:56.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:55.998+0000 7fb9697fa700 1 -- 172.21.15.63:0/3761641171 <== mgr.14120 v2:172.21.15.63:6800/4048286824 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7fb96c10d1f0 con 0x7fb95c0365f0 2023-12-12T11:43:56.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.000+0000 7fb972d83700 1 -- 172.21.15.63:0/3761641171 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fb95c0365f0 msgr2=0x7fb95c038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:56.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.000+0000 7fb972d83700 1 --2- 172.21.15.63:0/3761641171 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fb95c0365f0 0x7fb95c038aa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb958009990 tx=0x7fb958006e40 comp rx=0 tx=0).stop 2023-12-12T11:43:56.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.000+0000 7fb972d83700 1 -- 172.21.15.63:0/3761641171 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96c077bd0 msgr2=0x7fb96c1133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:56.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.000+0000 7fb972d83700 1 --2- 172.21.15.63:0/3761641171 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96c077bd0 0x7fb96c1133c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb960006d40 tx=0x7fb960009250 comp rx=0 tx=0).stop 2023-12-12T11:43:56.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.001+0000 7fb972d83700 1 -- 172.21.15.63:0/3761641171 shutdown_connections 2023-12-12T11:43:56.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.001+0000 7fb972d83700 1 --2- 172.21.15.63:0/3761641171 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fb95c0365f0 0x7fb95c038aa0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:56.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.001+0000 7fb972d83700 1 --2- 172.21.15.63:0/3761641171 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96c077bd0 0x7fb96c1133c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:56.356 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.001+0000 7fb972d83700 1 -- 172.21.15.63:0/3761641171 >> 172.21.15.63:0/3761641171 conn(0x7fb96c0fda50 msgr2=0x7fb96c0ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:56.356 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.001+0000 7fb972d83700 1 -- 172.21.15.63:0/3761641171 shutdown_connections 2023-12-12T11:43:56.356 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.001+0000 7fb972d83700 1 -- 172.21.15.63:0/3761641171 wait complete. 2023-12-12T11:43:57.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:57 smithi063 ceph-mon[107117]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:43:57.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:57 smithi063 ceph-mon[107117]: Saving service alertmanager spec with placement count:1 2023-12-12T11:43:57.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:57 smithi063 ceph-mon[107117]: from='mgr.14120 172.21.15.63:0/3652348595' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:43:57.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:57 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/1421141830' entity='client.admin' 2023-12-12T11:43:57.351 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.757+0000 7f34a82f0700 1 Processor -- start 2023-12-12T11:43:57.351 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.758+0000 7f34a82f0700 1 -- start start 2023-12-12T11:43:57.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.758+0000 7f34a82f0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a0077bd0 0x7f34a00760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:57.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.758+0000 7f34a82f0700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a0077fe0 con 0x7f34a0077bd0 2023-12-12T11:43:57.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.758+0000 7f34a608c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a0077bd0 0x7f34a00760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:57.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.758+0000 7f34a608c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a0077bd0 0x7f34a00760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53926/0 (socket says 172.21.15.63:53926) 2023-12-12T11:43:57.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.758+0000 7f34a608c700 1 -- 172.21.15.63:0/1185309780 learned_addr learned my addr 172.21.15.63:0/1185309780 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:57.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.759+0000 7f34a608c700 1 -- 172.21.15.63:0/1185309780 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a0076620 con 0x7f34a0077bd0 2023-12-12T11:43:57.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.759+0000 7f34a608c700 1 --2- 172.21.15.63:0/1185309780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a0077bd0 0x7f34a00760e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f349c0098e0 tx=0x7f349c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef199f0d39fa3b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:57.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.759+0000 7f34a508a700 1 -- 172.21.15.63:0/1185309780 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f349c00b860 con 0x7f34a0077bd0 2023-12-12T11:43:57.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.759+0000 7f34a508a700 1 -- 172.21.15.63:0/1185309780 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f349c00be70 con 0x7f34a0077bd0 2023-12-12T11:43:57.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.759+0000 7f34a508a700 1 -- 172.21.15.63:0/1185309780 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f349c010380 con 0x7f34a0077bd0 2023-12-12T11:43:57.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.760+0000 7f34a82f0700 1 -- 172.21.15.63:0/1185309780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a0077bd0 msgr2=0x7f34a00760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:57.352 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.760+0000 7f34a82f0700 1 --2- 172.21.15.63:0/1185309780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a0077bd0 0x7f34a00760e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f349c0098e0 tx=0x7f349c009250 comp rx=0 tx=0).stop 2023-12-12T11:43:57.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.760+0000 7f34a82f0700 1 -- 172.21.15.63:0/1185309780 shutdown_connections 2023-12-12T11:43:57.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.760+0000 7f34a82f0700 1 --2- 172.21.15.63:0/1185309780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a0077bd0 0x7f34a00760e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:57.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.760+0000 7f34a82f0700 1 -- 172.21.15.63:0/1185309780 >> 172.21.15.63:0/1185309780 conn(0x7f34a00fda50 msgr2=0x7f34a00ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:57.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.760+0000 7f34a82f0700 1 -- 172.21.15.63:0/1185309780 shutdown_connections 2023-12-12T11:43:57.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.760+0000 7f34a82f0700 1 -- 172.21.15.63:0/1185309780 wait complete. 2023-12-12T11:43:57.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.761+0000 7f34a82f0700 1 Processor -- start 2023-12-12T11:43:57.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.761+0000 7f34a82f0700 1 -- start start 2023-12-12T11:43:57.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.761+0000 7f34a82f0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a0077bd0 0x7f34a0113390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:57.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.761+0000 7f34a82f0700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a01138d0 con 0x7f34a0077bd0 2023-12-12T11:43:57.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.761+0000 7f34a608c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a0077bd0 0x7f34a0113390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:57.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.761+0000 7f34a608c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a0077bd0 0x7f34a0113390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53930/0 (socket says 172.21.15.63:53930) 2023-12-12T11:43:57.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.761+0000 7f34a608c700 1 -- 172.21.15.63:0/1421141830 learned_addr learned my addr 172.21.15.63:0/1421141830 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:57.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.762+0000 7f34a608c700 1 -- 172.21.15.63:0/1421141830 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c0094f0 con 0x7f34a0077bd0 2023-12-12T11:43:57.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.762+0000 7f34a608c700 1 --2- 172.21.15.63:0/1421141830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a0077bd0 0x7f34a0113390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f349c006d40 tx=0x7f349c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:57.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.762+0000 7f3496ffd700 1 -- 172.21.15.63:0/1421141830 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f349c010960 con 0x7f34a0077bd0 2023-12-12T11:43:57.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.762+0000 7f3496ffd700 1 -- 172.21.15.63:0/1421141830 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f349c01a430 con 0x7f34a0077bd0 2023-12-12T11:43:57.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.762+0000 7f34a82f0700 1 -- 172.21.15.63:0/1421141830 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a0113ad0 con 0x7f34a0077bd0 2023-12-12T11:43:57.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.762+0000 7f3496ffd700 1 -- 172.21.15.63:0/1421141830 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f349c0245b0 con 0x7f34a0077bd0 2023-12-12T11:43:57.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.762+0000 7f34a82f0700 1 -- 172.21.15.63:0/1421141830 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a0113ee0 con 0x7f34a0077bd0 2023-12-12T11:43:57.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.763+0000 7f3496ffd700 1 -- 172.21.15.63:0/1421141830 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f349c010ac0 con 0x7f34a0077bd0 2023-12-12T11:43:57.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.764+0000 7f34a82f0700 1 -- 172.21.15.63:0/1421141830 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a004bb80 con 0x7f34a0077bd0 2023-12-12T11:43:57.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.764+0000 7f3496ffd700 1 --2- 172.21.15.63:0/1421141830 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f348c0365f0 0x7f348c038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:57.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.764+0000 7f3496ffd700 1 -- 172.21.15.63:0/1421141830 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f349c04a1d0 con 0x7f34a0077bd0 2023-12-12T11:43:57.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.764+0000 7f34a588b700 1 --2- 172.21.15.63:0/1421141830 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f348c0365f0 0x7f348c038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:57.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.765+0000 7f34a588b700 1 --2- 172.21.15.63:0/1421141830 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f348c0365f0 0x7f348c038aa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3490009990 tx=0x7f3490006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:57.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.769+0000 7f3496ffd700 1 -- 172.21.15.63:0/1421141830 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f349c02b4d0 con 0x7f34a0077bd0 2023-12-12T11:43:57.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.972+0000 7f34a82f0700 1 -- 172.21.15.63:0/1421141830 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f34a0108540 con 0x7f34a0077bd0 2023-12-12T11:43:57.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.976+0000 7f3496ffd700 1 -- 172.21.15.63:0/1421141830 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f349c02b2f0 con 0x7f34a0077bd0 2023-12-12T11:43:57.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.978+0000 7f34a82f0700 1 -- 172.21.15.63:0/1421141830 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f348c0365f0 msgr2=0x7f348c038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:57.354 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.978+0000 7f34a82f0700 1 --2- 172.21.15.63:0/1421141830 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f348c0365f0 0x7f348c038aa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3490009990 tx=0x7f3490006e40 comp rx=0 tx=0).stop 2023-12-12T11:43:57.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.978+0000 7f34a82f0700 1 -- 172.21.15.63:0/1421141830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a0077bd0 msgr2=0x7f34a0113390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:57.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.978+0000 7f34a82f0700 1 --2- 172.21.15.63:0/1421141830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a0077bd0 0x7f34a0113390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f349c006d40 tx=0x7f349c009250 comp rx=0 tx=0).stop 2023-12-12T11:43:57.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.979+0000 7f34a82f0700 1 -- 172.21.15.63:0/1421141830 shutdown_connections 2023-12-12T11:43:57.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.979+0000 7f34a82f0700 1 --2- 172.21.15.63:0/1421141830 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f348c0365f0 0x7f348c038aa0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:57.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.979+0000 7f34a82f0700 1 --2- 172.21.15.63:0/1421141830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34a0077bd0 0x7f34a0113390 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:57.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.979+0000 7f34a82f0700 1 -- 172.21.15.63:0/1421141830 >> 172.21.15.63:0/1421141830 conn(0x7f34a00fda50 msgr2=0x7f34a00ffe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:57.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.979+0000 7f34a82f0700 1 -- 172.21.15.63:0/1421141830 shutdown_connections 2023-12-12T11:43:57.355 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:56.979+0000 7f34a82f0700 1 -- 172.21.15.63:0/1421141830 wait complete. 2023-12-12T11:43:58.328 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.750+0000 7f411c695700 1 Processor -- start 2023-12-12T11:43:58.328 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.750+0000 7f411c695700 1 -- start start 2023-12-12T11:43:58.329 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.751+0000 7f411c695700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4114077bb0 0x7f41140760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:58.329 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.751+0000 7f411c695700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4114077fc0 con 0x7f4114077bb0 2023-12-12T11:43:58.329 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.751+0000 7f411a431700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4114077bb0 0x7f41140760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:58.329 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.751+0000 7f411a431700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4114077bb0 0x7f41140760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53938/0 (socket says 172.21.15.63:53938) 2023-12-12T11:43:58.329 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.751+0000 7f411a431700 1 -- 172.21.15.63:0/2426658274 learned_addr learned my addr 172.21.15.63:0/2426658274 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:58.329 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.751+0000 7f411a431700 1 -- 172.21.15.63:0/2426658274 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4114076600 con 0x7f4114077bb0 2023-12-12T11:43:58.329 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.752+0000 7f411a431700 1 --2- 172.21.15.63:0/2426658274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4114077bb0 0x7f41140760c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f41100098e0 tx=0x7f4110009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b8f7c922439ba3e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:58.329 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.752+0000 7f411942f700 1 -- 172.21.15.63:0/2426658274 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f411000b860 con 0x7f4114077bb0 2023-12-12T11:43:58.329 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.752+0000 7f411942f700 1 -- 172.21.15.63:0/2426658274 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f411000be70 con 0x7f4114077bb0 2023-12-12T11:43:58.329 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.752+0000 7f411942f700 1 -- 172.21.15.63:0/2426658274 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4110010380 con 0x7f4114077bb0 2023-12-12T11:43:58.329 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.752+0000 7f411c695700 1 -- 172.21.15.63:0/2426658274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4114077bb0 msgr2=0x7f41140760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:58.330 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.752+0000 7f411c695700 1 --2- 172.21.15.63:0/2426658274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4114077bb0 0x7f41140760c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f41100098e0 tx=0x7f4110009250 comp rx=0 tx=0).stop 2023-12-12T11:43:58.330 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.753+0000 7f411c695700 1 -- 172.21.15.63:0/2426658274 shutdown_connections 2023-12-12T11:43:58.330 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.753+0000 7f411c695700 1 --2- 172.21.15.63:0/2426658274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4114077bb0 0x7f41140760c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:58.330 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.753+0000 7f411c695700 1 -- 172.21.15.63:0/2426658274 >> 172.21.15.63:0/2426658274 conn(0x7f41140fda50 msgr2=0x7f41140ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:58.330 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.753+0000 7f411c695700 1 -- 172.21.15.63:0/2426658274 shutdown_connections 2023-12-12T11:43:58.330 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.753+0000 7f411c695700 1 -- 172.21.15.63:0/2426658274 wait complete. 2023-12-12T11:43:58.330 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.753+0000 7f411c695700 1 Processor -- start 2023-12-12T11:43:58.330 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.754+0000 7f411c695700 1 -- start start 2023-12-12T11:43:58.330 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.754+0000 7f411c695700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4114077bb0 0x7f41141133a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:58.330 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.754+0000 7f411c695700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41141138e0 con 0x7f4114077bb0 2023-12-12T11:43:58.330 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.754+0000 7f411a431700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4114077bb0 0x7f41141133a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:58.330 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.754+0000 7f411a431700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4114077bb0 0x7f41141133a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53954/0 (socket says 172.21.15.63:53954) 2023-12-12T11:43:58.330 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.754+0000 7f411a431700 1 -- 172.21.15.63:0/2542751811 learned_addr learned my addr 172.21.15.63:0/2542751811 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:43:58.330 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.754+0000 7f411a431700 1 -- 172.21.15.63:0/2542751811 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41100094f0 con 0x7f4114077bb0 2023-12-12T11:43:58.331 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.755+0000 7f411a431700 1 --2- 172.21.15.63:0/2542751811 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4114077bb0 0x7f41141133a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4110006d40 tx=0x7f4110009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:58.331 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.755+0000 7f410affd700 1 -- 172.21.15.63:0/2542751811 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4110010960 con 0x7f4114077bb0 2023-12-12T11:43:58.331 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.755+0000 7f410affd700 1 -- 172.21.15.63:0/2542751811 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f411001a430 con 0x7f4114077bb0 2023-12-12T11:43:58.331 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.755+0000 7f411c695700 1 -- 172.21.15.63:0/2542751811 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4114113ae0 con 0x7f4114077bb0 2023-12-12T11:43:58.332 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.755+0000 7f410affd700 1 -- 172.21.15.63:0/2542751811 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41100245b0 con 0x7f4114077bb0 2023-12-12T11:43:58.332 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.755+0000 7f411c695700 1 -- 172.21.15.63:0/2542751811 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4114113ef0 con 0x7f4114077bb0 2023-12-12T11:43:58.332 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.756+0000 7f410affd700 1 -- 172.21.15.63:0/2542751811 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f411001a9f0 con 0x7f4114077bb0 2023-12-12T11:43:58.332 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.756+0000 7f411c695700 1 -- 172.21.15.63:0/2542751811 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f411404bb80 con 0x7f4114077bb0 2023-12-12T11:43:58.332 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.757+0000 7f410affd700 1 --2- 172.21.15.63:0/2542751811 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f4100036640 0x7f4100038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:43:58.332 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.757+0000 7f410affd700 1 -- 172.21.15.63:0/2542751811 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f411004a150 con 0x7f4114077bb0 2023-12-12T11:43:58.332 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.757+0000 7f4119c30700 1 --2- 172.21.15.63:0/2542751811 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f4100036640 0x7f4100038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:43:58.332 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.757+0000 7f4119c30700 1 --2- 172.21.15.63:0/2542751811 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f4100036640 0x7f4100038af0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4104009990 tx=0x7f4104006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:43:58.332 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.761+0000 7f410affd700 1 -- 172.21.15.63:0/2542751811 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f411002b8c0 con 0x7f4114077bb0 2023-12-12T11:43:58.332 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.960+0000 7f411c695700 1 -- 172.21.15.63:0/2542751811 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f4114108550 con 0x7f4114077bb0 2023-12-12T11:43:58.332 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.964+0000 7f410affd700 1 -- 172.21.15.63:0/2542751811 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f411002b2f0 con 0x7f4114077bb0 2023-12-12T11:43:58.332 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.966+0000 7f411c695700 1 -- 172.21.15.63:0/2542751811 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f4100036640 msgr2=0x7f4100038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:58.333 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.966+0000 7f411c695700 1 --2- 172.21.15.63:0/2542751811 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f4100036640 0x7f4100038af0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4104009990 tx=0x7f4104006e40 comp rx=0 tx=0).stop 2023-12-12T11:43:58.333 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.966+0000 7f411c695700 1 -- 172.21.15.63:0/2542751811 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4114077bb0 msgr2=0x7f41141133a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:43:58.333 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.966+0000 7f411c695700 1 --2- 172.21.15.63:0/2542751811 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4114077bb0 0x7f41141133a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4110006d40 tx=0x7f4110009250 comp rx=0 tx=0).stop 2023-12-12T11:43:58.333 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.967+0000 7f411c695700 1 -- 172.21.15.63:0/2542751811 shutdown_connections 2023-12-12T11:43:58.333 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.967+0000 7f411c695700 1 --2- 172.21.15.63:0/2542751811 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f4100036640 0x7f4100038af0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:58.333 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.967+0000 7f411c695700 1 --2- 172.21.15.63:0/2542751811 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4114077bb0 0x7f41141133a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:43:58.333 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.967+0000 7f411c695700 1 -- 172.21.15.63:0/2542751811 >> 172.21.15.63:0/2542751811 conn(0x7f41140fda50 msgr2=0x7f41140ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:43:58.333 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.967+0000 7f411c695700 1 -- 172.21.15.63:0/2542751811 shutdown_connections 2023-12-12T11:43:58.333 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:57.967+0000 7f411c695700 1 -- 172.21.15.63:0/2542751811 wait complete. 2023-12-12T11:43:58.333 INFO:teuthology.orchestra.run.smithi063.stdout:Enabling the dashboard module... 2023-12-12T11:43:59.297 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:58 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/2542751811' entity='client.admin' 2023-12-12T11:44:00.232 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:59 smithi063 ceph-mon[107117]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:44:00.232 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:43:59 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/957478881' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-12-12T11:44:00.391 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.726+0000 7f05419e8700 1 Processor -- start 2023-12-12T11:44:00.391 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.726+0000 7f05419e8700 1 -- start start 2023-12-12T11:44:00.391 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.727+0000 7f05419e8700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f053c077bf0 0x7f053c076100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:00.392 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.727+0000 7f05419e8700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053c078000 con 0x7f053c077bf0 2023-12-12T11:44:00.392 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.727+0000 7f053affd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f053c077bf0 0x7f053c076100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:00.392 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.727+0000 7f053affd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f053c077bf0 0x7f053c076100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42926/0 (socket says 172.21.15.63:42926) 2023-12-12T11:44:00.392 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.727+0000 7f053affd700 1 -- 172.21.15.63:0/3244138892 learned_addr learned my addr 172.21.15.63:0/3244138892 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:44:00.392 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.727+0000 7f053affd700 1 -- 172.21.15.63:0/3244138892 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053c076640 con 0x7f053c077bf0 2023-12-12T11:44:00.392 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.728+0000 7f053affd700 1 --2- 172.21.15.63:0/3244138892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f053c077bf0 0x7f053c076100 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f052c0098e0 tx=0x7f052c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e999fa3d51a68a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:00.392 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.728+0000 7f053a7fc700 1 -- 172.21.15.63:0/3244138892 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f052c00b860 con 0x7f053c077bf0 2023-12-12T11:44:00.392 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.728+0000 7f053a7fc700 1 -- 172.21.15.63:0/3244138892 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f052c00be70 con 0x7f053c077bf0 2023-12-12T11:44:00.392 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.728+0000 7f053a7fc700 1 -- 172.21.15.63:0/3244138892 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f052c010380 con 0x7f053c077bf0 2023-12-12T11:44:00.392 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.729+0000 7f05419e8700 1 -- 172.21.15.63:0/3244138892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f053c077bf0 msgr2=0x7f053c076100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:00.392 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.729+0000 7f05419e8700 1 --2- 172.21.15.63:0/3244138892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f053c077bf0 0x7f053c076100 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f052c0098e0 tx=0x7f052c009250 comp rx=0 tx=0).stop 2023-12-12T11:44:00.392 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.729+0000 7f05419e8700 1 -- 172.21.15.63:0/3244138892 shutdown_connections 2023-12-12T11:44:00.392 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.729+0000 7f05419e8700 1 --2- 172.21.15.63:0/3244138892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f053c077bf0 0x7f053c076100 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:00.392 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.729+0000 7f05419e8700 1 -- 172.21.15.63:0/3244138892 >> 172.21.15.63:0/3244138892 conn(0x7f053c0fda50 msgr2=0x7f053c0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:00.393 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.729+0000 7f05419e8700 1 -- 172.21.15.63:0/3244138892 shutdown_connections 2023-12-12T11:44:00.393 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.729+0000 7f05419e8700 1 -- 172.21.15.63:0/3244138892 wait complete. 2023-12-12T11:44:00.393 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.730+0000 7f05419e8700 1 Processor -- start 2023-12-12T11:44:00.393 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.730+0000 7f05419e8700 1 -- start start 2023-12-12T11:44:00.393 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.730+0000 7f05419e8700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f053c077bf0 0x7f053c1133e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:00.393 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.730+0000 7f05419e8700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053c113920 con 0x7f053c077bf0 2023-12-12T11:44:00.393 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.730+0000 7f053affd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f053c077bf0 0x7f053c1133e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:00.393 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.730+0000 7f053affd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f053c077bf0 0x7f053c1133e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42936/0 (socket says 172.21.15.63:42936) 2023-12-12T11:44:00.393 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.731+0000 7f053affd700 1 -- 172.21.15.63:0/957478881 learned_addr learned my addr 172.21.15.63:0/957478881 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:44:00.393 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.731+0000 7f053affd700 1 -- 172.21.15.63:0/957478881 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c0094f0 con 0x7f053c077bf0 2023-12-12T11:44:00.394 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.731+0000 7f053affd700 1 --2- 172.21.15.63:0/957478881 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f053c077bf0 0x7f053c1133e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f052c006d40 tx=0x7f052c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:00.394 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.731+0000 7f05337fe700 1 -- 172.21.15.63:0/957478881 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f052c010960 con 0x7f053c077bf0 2023-12-12T11:44:00.394 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.731+0000 7f05337fe700 1 -- 172.21.15.63:0/957478881 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f052c01a430 con 0x7f053c077bf0 2023-12-12T11:44:00.394 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.731+0000 7f05419e8700 1 -- 172.21.15.63:0/957478881 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053c113b20 con 0x7f053c077bf0 2023-12-12T11:44:00.394 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.731+0000 7f05337fe700 1 -- 172.21.15.63:0/957478881 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f052c0245b0 con 0x7f053c077bf0 2023-12-12T11:44:00.394 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.731+0000 7f05419e8700 1 -- 172.21.15.63:0/957478881 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f053c113f30 con 0x7f053c077bf0 2023-12-12T11:44:00.394 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.732+0000 7f05337fe700 1 -- 172.21.15.63:0/957478881 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f052c010ac0 con 0x7f053c077bf0 2023-12-12T11:44:00.395 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.732+0000 7f05419e8700 1 -- 172.21.15.63:0/957478881 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f053c04bb80 con 0x7f053c077bf0 2023-12-12T11:44:00.395 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.733+0000 7f05337fe700 1 --2- 172.21.15.63:0/957478881 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f05280365f0 0x7f0528038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:00.395 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.733+0000 7f05337fe700 1 -- 172.21.15.63:0/957478881 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f052c04a1d0 con 0x7f053c077bf0 2023-12-12T11:44:00.395 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.733+0000 7f0533fff700 1 --2- 172.21.15.63:0/957478881 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f05280365f0 0x7f0528038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:00.395 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.734+0000 7f0533fff700 1 --2- 172.21.15.63:0/957478881 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f05280365f0 0x7f0528038aa0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0524009990 tx=0x7f0524006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:00.395 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.738+0000 7f05337fe700 1 -- 172.21.15.63:0/957478881 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f052c02b4d0 con 0x7f053c077bf0 2023-12-12T11:44:00.395 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:58.996+0000 7f05419e8700 1 -- 172.21.15.63:0/957478881 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f053c10d180 con 0x7f053c077bf0 2023-12-12T11:44:00.395 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:59.972+0000 7f05337fe700 1 -- 172.21.15.63:0/957478881 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f052c010d70 con 0x7f053c077bf0 2023-12-12T11:44:00.395 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:59.974+0000 7f05337fe700 1 -- 172.21.15.63:0/957478881 <== mon.0 v2:172.21.15.63:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f052c049cf0 con 0x7f053c077bf0 2023-12-12T11:44:00.395 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:59.978+0000 7f05419e8700 1 -- 172.21.15.63:0/957478881 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f05280365f0 msgr2=0x7f0528038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:00.395 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:59.978+0000 7f05419e8700 1 --2- 172.21.15.63:0/957478881 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f05280365f0 0x7f0528038aa0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0524009990 tx=0x7f0524006e40 comp rx=0 tx=0).stop 2023-12-12T11:44:00.395 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:59.978+0000 7f05419e8700 1 -- 172.21.15.63:0/957478881 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f053c077bf0 msgr2=0x7f053c1133e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:00.395 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:59.978+0000 7f05419e8700 1 --2- 172.21.15.63:0/957478881 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f053c077bf0 0x7f053c1133e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f052c006d40 tx=0x7f052c009250 comp rx=0 tx=0).stop 2023-12-12T11:44:00.395 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:59.978+0000 7f05419e8700 1 -- 172.21.15.63:0/957478881 shutdown_connections 2023-12-12T11:44:00.396 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:59.978+0000 7f05419e8700 1 --2- 172.21.15.63:0/957478881 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7f05280365f0 0x7f0528038aa0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:00.396 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:59.978+0000 7f05419e8700 1 --2- 172.21.15.63:0/957478881 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f053c077bf0 0x7f053c1133e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:00.396 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:59.978+0000 7f05419e8700 1 -- 172.21.15.63:0/957478881 >> 172.21.15.63:0/957478881 conn(0x7f053c0fda50 msgr2=0x7f053c0ff270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:00.396 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:59.978+0000 7f05419e8700 1 -- 172.21.15.63:0/957478881 shutdown_connections 2023-12-12T11:44:00.396 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:43:59.978+0000 7f05419e8700 1 -- 172.21.15.63:0/957478881 wait complete. 2023-12-12T11:44:01.288 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:00 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/957478881' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-12-12T11:44:01.289 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:00 smithi063 ceph-mon[107117]: mgrmap e9: smithi063.zjnfdi(active, since 21s) 2023-12-12T11:44:01.456 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout { 2023-12-12T11:44:01.456 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-12-12T11:44:01.456 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-12T11:44:01.457 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "active_name": "smithi063.zjnfdi", 2023-12-12T11:44:01.457 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-12T11:44:01.457 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout } 2023-12-12T11:44:01.457 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.825+0000 7fb921739700 1 Processor -- start 2023-12-12T11:44:01.457 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.825+0000 7fb921739700 1 -- start start 2023-12-12T11:44:01.457 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.825+0000 7fb921739700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb91c070f60 0x7fb91c107340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:01.457 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.825+0000 7fb921739700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c102d30 con 0x7fb91c070f60 2023-12-12T11:44:01.458 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.826+0000 7fb91affd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb91c070f60 0x7fb91c107340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:01.458 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.826+0000 7fb91affd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb91c070f60 0x7fb91c107340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42972/0 (socket says 172.21.15.63:42972) 2023-12-12T11:44:01.458 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.826+0000 7fb91affd700 1 -- 172.21.15.63:0/2525498529 learned_addr learned my addr 172.21.15.63:0/2525498529 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:44:01.458 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.826+0000 7fb91affd700 1 -- 172.21.15.63:0/2525498529 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91c107880 con 0x7fb91c070f60 2023-12-12T11:44:01.459 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.827+0000 7fb91affd700 1 --2- 172.21.15.63:0/2525498529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb91c070f60 0x7fb91c107340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb90c0098e0 tx=0x7fb90c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9667d3979b4c161d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:01.459 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.827+0000 7fb919ffb700 1 -- 172.21.15.63:0/2525498529 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb90c00b860 con 0x7fb91c070f60 2023-12-12T11:44:01.459 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.827+0000 7fb919ffb700 1 -- 172.21.15.63:0/2525498529 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb90c00be70 con 0x7fb91c070f60 2023-12-12T11:44:01.459 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.827+0000 7fb919ffb700 1 -- 172.21.15.63:0/2525498529 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb90c010380 con 0x7fb91c070f60 2023-12-12T11:44:01.459 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.828+0000 7fb921739700 1 -- 172.21.15.63:0/2525498529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb91c070f60 msgr2=0x7fb91c107340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:01.460 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.828+0000 7fb921739700 1 --2- 172.21.15.63:0/2525498529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb91c070f60 0x7fb91c107340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb90c0098e0 tx=0x7fb90c009250 comp rx=0 tx=0).stop 2023-12-12T11:44:01.460 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.828+0000 7fb921739700 1 -- 172.21.15.63:0/2525498529 shutdown_connections 2023-12-12T11:44:01.460 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.828+0000 7fb921739700 1 --2- 172.21.15.63:0/2525498529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb91c070f60 0x7fb91c107340 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:01.460 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.828+0000 7fb921739700 1 -- 172.21.15.63:0/2525498529 >> 172.21.15.63:0/2525498529 conn(0x7fb91c0fc970 msgr2=0x7fb91c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:01.460 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.828+0000 7fb921739700 1 -- 172.21.15.63:0/2525498529 shutdown_connections 2023-12-12T11:44:01.460 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.828+0000 7fb921739700 1 -- 172.21.15.63:0/2525498529 wait complete. 2023-12-12T11:44:01.461 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.829+0000 7fb921739700 1 Processor -- start 2023-12-12T11:44:01.461 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.829+0000 7fb921739700 1 -- start start 2023-12-12T11:44:01.461 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.830+0000 7fb921739700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb91c070f60 0x7fb91c1133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:01.461 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.830+0000 7fb921739700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c113910 con 0x7fb91c070f60 2023-12-12T11:44:01.461 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.830+0000 7fb91affd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb91c070f60 0x7fb91c1133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:01.461 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.830+0000 7fb91affd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb91c070f60 0x7fb91c1133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42980/0 (socket says 172.21.15.63:42980) 2023-12-12T11:44:01.461 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.830+0000 7fb91affd700 1 -- 172.21.15.63:0/2474060615 learned_addr learned my addr 172.21.15.63:0/2474060615 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:44:01.462 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.830+0000 7fb91affd700 1 -- 172.21.15.63:0/2474060615 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90c0094f0 con 0x7fb91c070f60 2023-12-12T11:44:01.462 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.831+0000 7fb91affd700 1 --2- 172.21.15.63:0/2474060615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb91c070f60 0x7fb91c1133d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb90c006d40 tx=0x7fb90c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:01.462 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.831+0000 7fb9037fe700 1 -- 172.21.15.63:0/2474060615 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb90c010960 con 0x7fb91c070f60 2023-12-12T11:44:01.462 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.831+0000 7fb9037fe700 1 -- 172.21.15.63:0/2474060615 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb90c01a430 con 0x7fb91c070f60 2023-12-12T11:44:01.462 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.831+0000 7fb921739700 1 -- 172.21.15.63:0/2474060615 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb91c113b10 con 0x7fb91c070f60 2023-12-12T11:44:01.462 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.831+0000 7fb9037fe700 1 -- 172.21.15.63:0/2474060615 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb90c0245b0 con 0x7fb91c070f60 2023-12-12T11:44:01.462 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.831+0000 7fb921739700 1 -- 172.21.15.63:0/2474060615 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb91c113f20 con 0x7fb91c070f60 2023-12-12T11:44:01.463 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.832+0000 7fb921739700 1 -- 172.21.15.63:0/2474060615 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb91c04bb80 con 0x7fb91c070f60 2023-12-12T11:44:01.463 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.833+0000 7fb9037fe700 1 -- 172.21.15.63:0/2474060615 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7fb90c01a9f0 con 0x7fb91c070f60 2023-12-12T11:44:01.463 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.833+0000 7fb9037fe700 1 --2- 172.21.15.63:0/2474060615 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fb904036690 0x7fb904038b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:01.463 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.833+0000 7fb9037fe700 1 -- 172.21.15.63:0/2474060615 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fb90c04a230 con 0x7fb91c070f60 2023-12-12T11:44:01.463 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.833+0000 7fb91a7fc700 1 -- 172.21.15.63:0/2474060615 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fb904036690 msgr2=0x7fb904038b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/4048286824 2023-12-12T11:44:01.463 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.833+0000 7fb91a7fc700 1 --2- 172.21.15.63:0/2474060615 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fb904036690 0x7fb904038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T11:44:01.464 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:00.838+0000 7fb9037fe700 1 -- 172.21.15.63:0/2474060615 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb90c02b8c0 con 0x7fb91c070f60 2023-12-12T11:44:01.464 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.034+0000 7fb91a7fc700 1 -- 172.21.15.63:0/2474060615 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fb904036690 msgr2=0x7fb904038b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/4048286824 2023-12-12T11:44:01.464 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.034+0000 7fb91a7fc700 1 --2- 172.21.15.63:0/2474060615 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fb904036690 0x7fb904038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-12T11:44:01.464 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.095+0000 7fb921739700 1 -- 172.21.15.63:0/2474060615 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fb91c10d180 con 0x7fb91c070f60 2023-12-12T11:44:01.464 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.095+0000 7fb9037fe700 1 -- 172.21.15.63:0/2474060615 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7fb90c02b2f0 con 0x7fb91c070f60 2023-12-12T11:44:01.464 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.098+0000 7fb921739700 1 -- 172.21.15.63:0/2474060615 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fb904036690 msgr2=0x7fb904038b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-12T11:44:01.464 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.098+0000 7fb921739700 1 --2- 172.21.15.63:0/2474060615 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fb904036690 0x7fb904038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:01.465 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.098+0000 7fb921739700 1 -- 172.21.15.63:0/2474060615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb91c070f60 msgr2=0x7fb91c1133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:01.465 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.098+0000 7fb921739700 1 --2- 172.21.15.63:0/2474060615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb91c070f60 0x7fb91c1133d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb90c006d40 tx=0x7fb90c009250 comp rx=0 tx=0).stop 2023-12-12T11:44:01.465 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.098+0000 7fb921739700 1 -- 172.21.15.63:0/2474060615 shutdown_connections 2023-12-12T11:44:01.465 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.098+0000 7fb921739700 1 --2- 172.21.15.63:0/2474060615 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fb904036690 0x7fb904038b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:01.465 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.098+0000 7fb921739700 1 --2- 172.21.15.63:0/2474060615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb91c070f60 0x7fb91c1133d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:01.465 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.098+0000 7fb921739700 1 -- 172.21.15.63:0/2474060615 >> 172.21.15.63:0/2474060615 conn(0x7fb91c0fc970 msgr2=0x7fb91c0fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:01.466 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.098+0000 7fb921739700 1 -- 172.21.15.63:0/2474060615 shutdown_connections 2023-12-12T11:44:01.466 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.098+0000 7fb921739700 1 -- 172.21.15.63:0/2474060615 wait complete. 2023-12-12T11:44:01.466 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for the mgr to restart... 2023-12-12T11:44:01.466 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for mgr epoch 9... 2023-12-12T11:44:02.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:01 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/2474060615' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-12T11:44:08.852 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:08 smithi063 ceph-mon[107117]: Active manager daemon smithi063.zjnfdi restarted 2023-12-12T11:44:08.853 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:08 smithi063 ceph-mon[107117]: Activating manager daemon smithi063.zjnfdi 2023-12-12T11:44:08.853 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:08 smithi063 ceph-mon[107117]: osdmap e3: 0 total, 0 up, 0 in 2023-12-12T11:44:08.853 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:08 smithi063 ceph-mon[107117]: mgrmap e10: smithi063.zjnfdi(active, starting, since 0.00631946s) 2023-12-12T11:44:08.853 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:08 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-12T11:44:08.853 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:08 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr metadata", "who": "smithi063.zjnfdi", "id": "smithi063.zjnfdi"}]: dispatch 2023-12-12T11:44:08.853 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:08 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-12T11:44:08.853 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:08 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-12T11:44:08.853 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:08 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-12T11:44:08.853 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:08 smithi063 ceph-mon[107117]: Manager daemon smithi063.zjnfdi is now available 2023-12-12T11:44:08.853 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:08 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:44:08.853 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:08 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:44:10.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:09 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.zjnfdi/mirror_snapshot_schedule"}]: dispatch 2023-12-12T11:44:10.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:09 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.zjnfdi/trash_purge_schedule"}]: dispatch 2023-12-12T11:44:10.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:09 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:10.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:09 smithi063 ceph-mon[107117]: mgrmap e11: smithi063.zjnfdi(active, since 1.00784s) 2023-12-12T11:44:10.242 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout { 2023-12-12T11:44:10.242 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-12-12T11:44:10.242 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-12T11:44:10.242 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout } 2023-12-12T11:44:10.242 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.885+0000 7fd89b1de700 1 Processor -- start 2023-12-12T11:44:10.243 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.885+0000 7fd89b1de700 1 -- start start 2023-12-12T11:44:10.243 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.885+0000 7fd89b1de700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8941022d0 0x7fd8941026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:10.243 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.885+0000 7fd89b1de700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd894102c20 con 0x7fd8941022d0 2023-12-12T11:44:10.243 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.886+0000 7fd898f7a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8941022d0 0x7fd8941026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:10.243 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.886+0000 7fd898f7a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8941022d0 0x7fd8941026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42992/0 (socket says 172.21.15.63:42992) 2023-12-12T11:44:10.243 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.886+0000 7fd898f7a700 1 -- 172.21.15.63:0/1226523415 learned_addr learned my addr 172.21.15.63:0/1226523415 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:44:10.243 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.886+0000 7fd898f7a700 1 -- 172.21.15.63:0/1226523415 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd894102d60 con 0x7fd8941022d0 2023-12-12T11:44:10.243 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.886+0000 7fd898f7a700 1 --2- 172.21.15.63:0/1226523415 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8941022d0 0x7fd8941026e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd8880098e0 tx=0x7fd888009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16330d368a850dad server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:10.244 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.886+0000 7fd8937fe700 1 -- 172.21.15.63:0/1226523415 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd88800b860 con 0x7fd8941022d0 2023-12-12T11:44:10.244 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.887+0000 7fd8937fe700 1 -- 172.21.15.63:0/1226523415 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd88800be70 con 0x7fd8941022d0 2023-12-12T11:44:10.244 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.887+0000 7fd8937fe700 1 -- 172.21.15.63:0/1226523415 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd888010380 con 0x7fd8941022d0 2023-12-12T11:44:10.244 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.887+0000 7fd89b1de700 1 -- 172.21.15.63:0/1226523415 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8941022d0 msgr2=0x7fd8941026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:10.244 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.887+0000 7fd89b1de700 1 --2- 172.21.15.63:0/1226523415 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8941022d0 0x7fd8941026e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd8880098e0 tx=0x7fd888009250 comp rx=0 tx=0).stop 2023-12-12T11:44:10.244 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.887+0000 7fd89b1de700 1 -- 172.21.15.63:0/1226523415 shutdown_connections 2023-12-12T11:44:10.244 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.887+0000 7fd89b1de700 1 --2- 172.21.15.63:0/1226523415 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8941022d0 0x7fd8941026e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:10.245 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.887+0000 7fd89b1de700 1 -- 172.21.15.63:0/1226523415 >> 172.21.15.63:0/1226523415 conn(0x7fd8940fda50 msgr2=0x7fd8940ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:10.245 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.887+0000 7fd89b1de700 1 -- 172.21.15.63:0/1226523415 shutdown_connections 2023-12-12T11:44:10.245 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.888+0000 7fd89b1de700 1 -- 172.21.15.63:0/1226523415 wait complete. 2023-12-12T11:44:10.245 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.889+0000 7fd89b1de700 1 Processor -- start 2023-12-12T11:44:10.245 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.889+0000 7fd89b1de700 1 -- start start 2023-12-12T11:44:10.245 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.889+0000 7fd89b1de700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8941022d0 0x7fd894111180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:10.246 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.889+0000 7fd89b1de700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8941116c0 con 0x7fd8941022d0 2023-12-12T11:44:10.246 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.890+0000 7fd898f7a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8941022d0 0x7fd894111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:10.246 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.890+0000 7fd898f7a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8941022d0 0x7fd894111180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43004/0 (socket says 172.21.15.63:43004) 2023-12-12T11:44:10.246 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.890+0000 7fd898f7a700 1 -- 172.21.15.63:0/1941349891 learned_addr learned my addr 172.21.15.63:0/1941349891 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:44:10.246 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.890+0000 7fd898f7a700 1 -- 172.21.15.63:0/1941349891 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8880094f0 con 0x7fd8941022d0 2023-12-12T11:44:10.246 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.890+0000 7fd898f7a700 1 --2- 172.21.15.63:0/1941349891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8941022d0 0x7fd894111180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd88800c010 tx=0x7fd888009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:10.246 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.891+0000 7fd8917fa700 1 -- 172.21.15.63:0/1941349891 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd888010960 con 0x7fd8941022d0 2023-12-12T11:44:10.247 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.891+0000 7fd89b1de700 1 -- 172.21.15.63:0/1941349891 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8941118c0 con 0x7fd8941022d0 2023-12-12T11:44:10.247 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.891+0000 7fd8917fa700 1 -- 172.21.15.63:0/1941349891 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd88801a430 con 0x7fd8941022d0 2023-12-12T11:44:10.247 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.891+0000 7fd89b1de700 1 -- 172.21.15.63:0/1941349891 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd894111cd0 con 0x7fd8941022d0 2023-12-12T11:44:10.247 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.891+0000 7fd8917fa700 1 -- 172.21.15.63:0/1941349891 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd888024550 con 0x7fd8941022d0 2023-12-12T11:44:10.247 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.892+0000 7fd8917fa700 1 -- 172.21.15.63:0/1941349891 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7fd8880246b0 con 0x7fd8941022d0 2023-12-12T11:44:10.247 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.892+0000 7fd8917fa700 1 --2- 172.21.15.63:0/1941349891 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fd884036640 0x7fd884038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:10.247 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.892+0000 7fd8917fa700 1 -- 172.21.15.63:0/1941349891 --> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd884039200 con 0x7fd884036640 2023-12-12T11:44:10.248 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.892+0000 7fd8917fa700 1 -- 172.21.15.63:0/1941349891 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd88804a3e0 con 0x7fd8941022d0 2023-12-12T11:44:10.248 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.892+0000 7fd893fff700 1 -- 172.21.15.63:0/1941349891 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fd884036640 msgr2=0x7fd884038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/4048286824 2023-12-12T11:44:10.248 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:01.892+0000 7fd893fff700 1 --2- 172.21.15.63:0/1941349891 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fd884036640 0x7fd884038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T11:44:10.248 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:02.093+0000 7fd893fff700 1 -- 172.21.15.63:0/1941349891 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fd884036640 msgr2=0x7fd884038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/4048286824 2023-12-12T11:44:10.248 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:02.093+0000 7fd893fff700 1 --2- 172.21.15.63:0/1941349891 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fd884036640 0x7fd884038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-12T11:44:10.248 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:02.494+0000 7fd893fff700 1 -- 172.21.15.63:0/1941349891 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fd884036640 msgr2=0x7fd884038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/4048286824 2023-12-12T11:44:10.248 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:02.494+0000 7fd893fff700 1 --2- 172.21.15.63:0/1941349891 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fd884036640 0x7fd884038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-12T11:44:10.248 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:03.295+0000 7fd893fff700 1 -- 172.21.15.63:0/1941349891 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fd884036640 msgr2=0x7fd884038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/4048286824 2023-12-12T11:44:10.249 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:03.295+0000 7fd893fff700 1 --2- 172.21.15.63:0/1941349891 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fd884036640 0x7fd884038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-12T11:44:10.249 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:04.896+0000 7fd893fff700 1 -- 172.21.15.63:0/1941349891 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fd884036640 msgr2=0x7fd884038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/4048286824 2023-12-12T11:44:10.249 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:04.897+0000 7fd893fff700 1 --2- 172.21.15.63:0/1941349891 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fd884036640 0x7fd884038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-12T11:44:10.249 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:08.100+0000 7fd893fff700 1 -- 172.21.15.63:0/1941349891 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fd884036640 msgr2=0x7fd884038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/4048286824 2023-12-12T11:44:10.249 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:08.100+0000 7fd893fff700 1 --2- 172.21.15.63:0/1941349891 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fd884036640 0x7fd884038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-12-12T11:44:10.249 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:08.719+0000 7fd8917fa700 1 -- 172.21.15.63:0/1941349891 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mgrmap(e 10) v1 ==== 43061+0+0 (secure 0 0 0) 0x7fd88800fdc0 con 0x7fd8941022d0 2023-12-12T11:44:10.249 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:08.719+0000 7fd8917fa700 1 -- 172.21.15.63:0/1941349891 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fd884036640 msgr2=0x7fd884038af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-12T11:44:10.250 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:08.719+0000 7fd8917fa700 1 --2- 172.21.15.63:0/1941349891 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fd884036640 0x7fd884038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:10.250 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:09.719+0000 7fd8917fa700 1 -- 172.21.15.63:0/1941349891 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mgrmap(e 11) v1 ==== 43188+0+0 (secure 0 0 0) 0x7fd888018350 con 0x7fd8941022d0 2023-12-12T11:44:10.250 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:09.719+0000 7fd8917fa700 1 --2- 172.21.15.63:0/1941349891 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fd884039fb0 0x7fd88403c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:10.250 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:09.720+0000 7fd8917fa700 1 -- 172.21.15.63:0/1941349891 --> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd884039200 con 0x7fd884039fb0 2023-12-12T11:44:10.250 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:09.720+0000 7fd893fff700 1 --2- 172.21.15.63:0/1941349891 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fd884039fb0 0x7fd88403c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:10.250 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:09.721+0000 7fd893fff700 1 --2- 172.21.15.63:0/1941349891 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fd884039fb0 0x7fd88403c390 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd8800039d0 tx=0x7fd8800092f0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:10.251 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:09.722+0000 7fd8917fa700 1 -- 172.21.15.63:0/1941349891 <== mgr.14162 v2:172.21.15.63:6800/293571324 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7fd884039200 con 0x7fd884039fb0 2023-12-12T11:44:10.251 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:09.733+0000 7fd89b1de700 1 -- 172.21.15.63:0/1941349891 --> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fd89404bb80 con 0x7fd884039fb0 2023-12-12T11:44:10.251 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:09.734+0000 7fd8917fa700 1 -- 172.21.15.63:0/1941349891 <== mgr.14162 v2:172.21.15.63:6800/293571324 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fd89404bb80 con 0x7fd884039fb0 2023-12-12T11:44:10.251 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:09.734+0000 7fd89b1de700 1 -- 172.21.15.63:0/1941349891 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fd884039fb0 msgr2=0x7fd88403c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:10.251 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:09.734+0000 7fd89b1de700 1 --2- 172.21.15.63:0/1941349891 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fd884039fb0 0x7fd88403c390 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd8800039d0 tx=0x7fd8800092f0 comp rx=0 tx=0).stop 2023-12-12T11:44:10.251 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:09.734+0000 7fd89b1de700 1 -- 172.21.15.63:0/1941349891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8941022d0 msgr2=0x7fd894111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:10.252 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:09.734+0000 7fd89b1de700 1 --2- 172.21.15.63:0/1941349891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8941022d0 0x7fd894111180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd88800c010 tx=0x7fd888009250 comp rx=0 tx=0).stop 2023-12-12T11:44:10.252 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:09.734+0000 7fd89b1de700 1 -- 172.21.15.63:0/1941349891 shutdown_connections 2023-12-12T11:44:10.252 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:09.734+0000 7fd89b1de700 1 --2- 172.21.15.63:0/1941349891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8941022d0 0x7fd894111180 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:10.252 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:09.734+0000 7fd89b1de700 1 --2- 172.21.15.63:0/1941349891 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fd884039fb0 0x7fd88403c390 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:10.252 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:09.734+0000 7fd89b1de700 1 --2- 172.21.15.63:0/1941349891 >> [v2:172.21.15.63:6800/4048286824,v1:172.21.15.63:6801/4048286824] conn(0x7fd884036640 0x7fd884038af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:10.252 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:09.734+0000 7fd89b1de700 1 -- 172.21.15.63:0/1941349891 >> 172.21.15.63:0/1941349891 conn(0x7fd8940fda50 msgr2=0x7fd8940ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:10.252 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:09.734+0000 7fd89b1de700 1 -- 172.21.15.63:0/1941349891 shutdown_connections 2023-12-12T11:44:10.252 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:09.735+0000 7fd89b1de700 1 -- 172.21.15.63:0/1941349891 wait complete. 2023-12-12T11:44:10.252 INFO:teuthology.orchestra.run.smithi063.stdout:mgr epoch 9 is available 2023-12-12T11:44:10.253 INFO:teuthology.orchestra.run.smithi063.stdout:Generating a dashboard self-signed certificate... 2023-12-12T11:44:11.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:10 smithi063 ceph-mon[107117]: [12/Dec/2023:11:44:09] ENGINE Bus STARTING 2023-12-12T11:44:11.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:10 smithi063 ceph-mon[107117]: [12/Dec/2023:11:44:09] ENGINE Serving on https://172.21.15.63:7150 2023-12-12T11:44:11.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:10 smithi063 ceph-mon[107117]: [12/Dec/2023:11:44:09] ENGINE Bus STARTED 2023-12-12T11:44:11.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:10 smithi063 ceph-mon[107117]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-12T11:44:11.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:10 smithi063 ceph-mon[107117]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-12T11:44:11.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:10 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:11.279 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-12-12T11:44:11.279 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.652+0000 7fe15d0bf700 1 Processor -- start 2023-12-12T11:44:11.279 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.652+0000 7fe15d0bf700 1 -- start start 2023-12-12T11:44:11.279 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.652+0000 7fe15d0bf700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe158070f80 0x7fe158104f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:11.279 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.652+0000 7fe15d0bf700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe158105460 con 0x7fe158070f80 2023-12-12T11:44:11.279 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.653+0000 7fe156d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe158070f80 0x7fe158104f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:11.279 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.653+0000 7fe156d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe158070f80 0x7fe158104f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48048/0 (socket says 172.21.15.63:48048) 2023-12-12T11:44:11.279 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.653+0000 7fe156d9d700 1 -- 172.21.15.63:0/867893450 learned_addr learned my addr 172.21.15.63:0/867893450 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:44:11.279 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.653+0000 7fe156d9d700 1 -- 172.21.15.63:0/867893450 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1581055a0 con 0x7fe158070f80 2023-12-12T11:44:11.279 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.654+0000 7fe156d9d700 1 --2- 172.21.15.63:0/867893450 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe158070f80 0x7fe158104f20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe1480098e0 tx=0x7fe148009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dcc114fc9d9b3d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:11.279 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.654+0000 7fe155d9b700 1 -- 172.21.15.63:0/867893450 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe14800b860 con 0x7fe158070f80 2023-12-12T11:44:11.279 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.654+0000 7fe155d9b700 1 -- 172.21.15.63:0/867893450 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe14800be70 con 0x7fe158070f80 2023-12-12T11:44:11.280 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.654+0000 7fe155d9b700 1 -- 172.21.15.63:0/867893450 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe148010380 con 0x7fe158070f80 2023-12-12T11:44:11.280 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.654+0000 7fe15d0bf700 1 -- 172.21.15.63:0/867893450 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe158070f80 msgr2=0x7fe158104f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:11.280 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.654+0000 7fe15d0bf700 1 --2- 172.21.15.63:0/867893450 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe158070f80 0x7fe158104f20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe1480098e0 tx=0x7fe148009250 comp rx=0 tx=0).stop 2023-12-12T11:44:11.280 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.655+0000 7fe15d0bf700 1 -- 172.21.15.63:0/867893450 shutdown_connections 2023-12-12T11:44:11.280 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.655+0000 7fe15d0bf700 1 --2- 172.21.15.63:0/867893450 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe158070f80 0x7fe158104f20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:11.280 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.655+0000 7fe15d0bf700 1 -- 172.21.15.63:0/867893450 >> 172.21.15.63:0/867893450 conn(0x7fe1580fc970 msgr2=0x7fe1580fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:11.280 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.655+0000 7fe15d0bf700 1 -- 172.21.15.63:0/867893450 shutdown_connections 2023-12-12T11:44:11.280 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.655+0000 7fe15d0bf700 1 -- 172.21.15.63:0/867893450 wait complete. 2023-12-12T11:44:11.280 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.655+0000 7fe15d0bf700 1 Processor -- start 2023-12-12T11:44:11.280 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.656+0000 7fe15d0bf700 1 -- start start 2023-12-12T11:44:11.280 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.656+0000 7fe15d0bf700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe158070f80 0x7fe1581133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:11.280 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.656+0000 7fe15d0bf700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe158113900 con 0x7fe158070f80 2023-12-12T11:44:11.280 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.656+0000 7fe156d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe158070f80 0x7fe1581133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:11.280 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.656+0000 7fe156d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe158070f80 0x7fe1581133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48058/0 (socket says 172.21.15.63:48058) 2023-12-12T11:44:11.280 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.656+0000 7fe156d9d700 1 -- 172.21.15.63:0/852431281 learned_addr learned my addr 172.21.15.63:0/852431281 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:44:11.281 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.657+0000 7fe156d9d700 1 -- 172.21.15.63:0/852431281 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1480094f0 con 0x7fe158070f80 2023-12-12T11:44:11.281 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.657+0000 7fe156d9d700 1 --2- 172.21.15.63:0/852431281 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe158070f80 0x7fe1581133c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe1480094c0 tx=0x7fe148009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:11.281 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.657+0000 7fe13f7fe700 1 -- 172.21.15.63:0/852431281 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe148010850 con 0x7fe158070f80 2023-12-12T11:44:11.281 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.657+0000 7fe13f7fe700 1 -- 172.21.15.63:0/852431281 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe148010e60 con 0x7fe158070f80 2023-12-12T11:44:11.281 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.657+0000 7fe13f7fe700 1 -- 172.21.15.63:0/852431281 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe14801a430 con 0x7fe158070f80 2023-12-12T11:44:11.281 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.657+0000 7fe15d0bf700 1 -- 172.21.15.63:0/852431281 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe158113b00 con 0x7fe158070f80 2023-12-12T11:44:11.281 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.657+0000 7fe15d0bf700 1 -- 172.21.15.63:0/852431281 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe158113f10 con 0x7fe158070f80 2023-12-12T11:44:11.281 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.658+0000 7fe13f7fe700 1 -- 172.21.15.63:0/852431281 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 11) v1 ==== 43188+0+0 (secure 0 0 0) 0x7fe1480247b0 con 0x7fe158070f80 2023-12-12T11:44:11.281 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.658+0000 7fe15d0bf700 1 -- 172.21.15.63:0/852431281 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe15804bb80 con 0x7fe158070f80 2023-12-12T11:44:11.281 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.659+0000 7fe13f7fe700 1 --2- 172.21.15.63:0/852431281 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fe140036570 0x7fe140038a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:11.281 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.659+0000 7fe13f7fe700 1 -- 172.21.15.63:0/852431281 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe14804a3b0 con 0x7fe158070f80 2023-12-12T11:44:11.281 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.659+0000 7fe15659c700 1 --2- 172.21.15.63:0/852431281 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fe140036570 0x7fe140038a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:11.281 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.660+0000 7fe15659c700 1 --2- 172.21.15.63:0/852431281 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fe140036570 0x7fe140038a20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe14c009990 tx=0x7fe14c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:11.281 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.664+0000 7fe13f7fe700 1 -- 172.21.15.63:0/852431281 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe148022520 con 0x7fe158070f80 2023-12-12T11:44:11.281 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.890+0000 7fe15d0bf700 1 -- 172.21.15.63:0/852431281 --> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1580008d0 con 0x7fe140036570 2023-12-12T11:44:11.282 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.939+0000 7fe13f7fe700 1 -- 172.21.15.63:0/852431281 <== mgr.14162 v2:172.21.15.63:6800/293571324 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fe1580008d0 con 0x7fe140036570 2023-12-12T11:44:11.282 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.942+0000 7fe15d0bf700 1 -- 172.21.15.63:0/852431281 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fe140036570 msgr2=0x7fe140038a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:11.282 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.942+0000 7fe15d0bf700 1 --2- 172.21.15.63:0/852431281 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fe140036570 0x7fe140038a20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe14c009990 tx=0x7fe14c006e40 comp rx=0 tx=0).stop 2023-12-12T11:44:11.282 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.942+0000 7fe15d0bf700 1 -- 172.21.15.63:0/852431281 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe158070f80 msgr2=0x7fe1581133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:11.282 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.942+0000 7fe15d0bf700 1 --2- 172.21.15.63:0/852431281 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe158070f80 0x7fe1581133c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe1480094c0 tx=0x7fe148009250 comp rx=0 tx=0).stop 2023-12-12T11:44:11.282 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.942+0000 7fe15d0bf700 1 -- 172.21.15.63:0/852431281 shutdown_connections 2023-12-12T11:44:11.282 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.942+0000 7fe15d0bf700 1 --2- 172.21.15.63:0/852431281 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fe140036570 0x7fe140038a20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:11.282 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.942+0000 7fe15d0bf700 1 --2- 172.21.15.63:0/852431281 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe158070f80 0x7fe1581133c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:11.282 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.942+0000 7fe15d0bf700 1 -- 172.21.15.63:0/852431281 >> 172.21.15.63:0/852431281 conn(0x7fe1580fc970 msgr2=0x7fe1580fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:11.282 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.942+0000 7fe15d0bf700 1 -- 172.21.15.63:0/852431281 shutdown_connections 2023-12-12T11:44:11.282 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:10.942+0000 7fe15d0bf700 1 -- 172.21.15.63:0/852431281 wait complete. 2023-12-12T11:44:11.282 INFO:teuthology.orchestra.run.smithi063.stdout:Creating initial admin user... 2023-12-12T11:44:12.200 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:11 smithi063 ceph-mon[107117]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:44:12.200 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:11 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:12.200 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:11 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:12.200 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:11 smithi063 ceph-mon[107117]: mgrmap e12: smithi063.zjnfdi(active, since 2s) 2023-12-12T11:44:12.200 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:11 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:12.652 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$Q5xRTLBWJl1k8cODUZFneuNxfgw0NI5wL82ejajd9oOUbiozw2NDm", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1702381452, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-12-12T11:44:12.652 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.689+0000 7fa714dea700 1 Processor -- start 2023-12-12T11:44:12.652 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.689+0000 7fa714dea700 1 -- start start 2023-12-12T11:44:12.652 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.689+0000 7fa714dea700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7101022d0 0x7fa7101026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:12.652 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.689+0000 7fa714dea700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa710102c20 con 0x7fa7101022d0 2023-12-12T11:44:12.652 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.689+0000 7fa70e59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7101022d0 0x7fa7101026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:12.652 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.690+0000 7fa70e59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7101022d0 0x7fa7101026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48074/0 (socket says 172.21.15.63:48074) 2023-12-12T11:44:12.652 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.690+0000 7fa70e59c700 1 -- 172.21.15.63:0/134253043 learned_addr learned my addr 172.21.15.63:0/134253043 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:44:12.652 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.690+0000 7fa70e59c700 1 -- 172.21.15.63:0/134253043 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa710102d60 con 0x7fa7101022d0 2023-12-12T11:44:12.652 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.690+0000 7fa70e59c700 1 --2- 172.21.15.63:0/134253043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7101022d0 0x7fa7101026e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa7000098e0 tx=0x7fa700009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5843207edd09c2d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:12.653 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.690+0000 7fa70d59a700 1 -- 172.21.15.63:0/134253043 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa70000b860 con 0x7fa7101022d0 2023-12-12T11:44:12.653 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.691+0000 7fa70d59a700 1 -- 172.21.15.63:0/134253043 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa70000be70 con 0x7fa7101022d0 2023-12-12T11:44:12.653 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.691+0000 7fa70d59a700 1 -- 172.21.15.63:0/134253043 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa700010380 con 0x7fa7101022d0 2023-12-12T11:44:12.653 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.691+0000 7fa714dea700 1 -- 172.21.15.63:0/134253043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7101022d0 msgr2=0x7fa7101026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:12.653 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.691+0000 7fa714dea700 1 --2- 172.21.15.63:0/134253043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7101022d0 0x7fa7101026e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa7000098e0 tx=0x7fa700009250 comp rx=0 tx=0).stop 2023-12-12T11:44:12.653 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.691+0000 7fa714dea700 1 -- 172.21.15.63:0/134253043 shutdown_connections 2023-12-12T11:44:12.653 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.691+0000 7fa714dea700 1 --2- 172.21.15.63:0/134253043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7101022d0 0x7fa7101026e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:12.653 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.691+0000 7fa714dea700 1 -- 172.21.15.63:0/134253043 >> 172.21.15.63:0/134253043 conn(0x7fa7100fda50 msgr2=0x7fa7100ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:12.654 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.691+0000 7fa714dea700 1 -- 172.21.15.63:0/134253043 shutdown_connections 2023-12-12T11:44:12.654 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.691+0000 7fa714dea700 1 -- 172.21.15.63:0/134253043 wait complete. 2023-12-12T11:44:12.654 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.692+0000 7fa714dea700 1 Processor -- start 2023-12-12T11:44:12.654 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.692+0000 7fa714dea700 1 -- start start 2023-12-12T11:44:12.654 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.693+0000 7fa714dea700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7101022d0 0x7fa710113370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:12.654 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.693+0000 7fa714dea700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7101138b0 con 0x7fa7101022d0 2023-12-12T11:44:12.654 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.693+0000 7fa70e59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7101022d0 0x7fa710113370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:12.654 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.693+0000 7fa70e59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7101022d0 0x7fa710113370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48084/0 (socket says 172.21.15.63:48084) 2023-12-12T11:44:12.654 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.693+0000 7fa70e59c700 1 -- 172.21.15.63:0/2219750854 learned_addr learned my addr 172.21.15.63:0/2219750854 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:44:12.654 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.693+0000 7fa70e59c700 1 -- 172.21.15.63:0/2219750854 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7000094f0 con 0x7fa7101022d0 2023-12-12T11:44:12.654 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.694+0000 7fa70e59c700 1 --2- 172.21.15.63:0/2219750854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7101022d0 0x7fa710113370 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa70000c010 tx=0x7fa700009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:12.654 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.694+0000 7fa6feffd700 1 -- 172.21.15.63:0/2219750854 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa700010960 con 0x7fa7101022d0 2023-12-12T11:44:12.654 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.694+0000 7fa6feffd700 1 -- 172.21.15.63:0/2219750854 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa70001a430 con 0x7fa7101022d0 2023-12-12T11:44:12.655 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.694+0000 7fa6feffd700 1 -- 172.21.15.63:0/2219750854 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa700019580 con 0x7fa7101022d0 2023-12-12T11:44:12.655 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.694+0000 7fa714dea700 1 -- 172.21.15.63:0/2219750854 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa710113ab0 con 0x7fa7101022d0 2023-12-12T11:44:12.655 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.694+0000 7fa714dea700 1 -- 172.21.15.63:0/2219750854 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa710113ec0 con 0x7fa7101022d0 2023-12-12T11:44:12.655 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.695+0000 7fa714dea700 1 -- 172.21.15.63:0/2219750854 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa71004bb80 con 0x7fa7101022d0 2023-12-12T11:44:12.655 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.695+0000 7fa6feffd700 1 -- 172.21.15.63:0/2219750854 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7fa70001a980 con 0x7fa7101022d0 2023-12-12T11:44:12.655 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.696+0000 7fa6feffd700 1 --2- 172.21.15.63:0/2219750854 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fa6f8036640 0x7fa6f8038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:12.655 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.696+0000 7fa6feffd700 1 -- 172.21.15.63:0/2219750854 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa70004a570 con 0x7fa7101022d0 2023-12-12T11:44:12.655 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.696+0000 7fa70dd9b700 1 --2- 172.21.15.63:0/2219750854 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fa6f8036640 0x7fa6f8038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:12.655 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.697+0000 7fa70dd9b700 1 --2- 172.21.15.63:0/2219750854 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fa6f8036640 0x7fa6f8038af0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa704009990 tx=0x7fa704006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:12.655 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.701+0000 7fa6feffd700 1 -- 172.21.15.63:0/2219750854 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa70002b950 con 0x7fa7101022d0 2023-12-12T11:44:12.656 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:11.920+0000 7fa714dea700 1 -- 172.21.15.63:0/2219750854 --> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fa71005f090 con 0x7fa6f8036640 2023-12-12T11:44:12.656 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:12.170+0000 7fa6feffd700 1 -- 172.21.15.63:0/2219750854 <== mgr.14162 v2:172.21.15.63:6800/293571324 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fa71005f090 con 0x7fa6f8036640 2023-12-12T11:44:12.656 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:12.172+0000 7fa714dea700 1 -- 172.21.15.63:0/2219750854 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fa6f8036640 msgr2=0x7fa6f8038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:12.656 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:12.172+0000 7fa714dea700 1 --2- 172.21.15.63:0/2219750854 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fa6f8036640 0x7fa6f8038af0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa704009990 tx=0x7fa704006e40 comp rx=0 tx=0).stop 2023-12-12T11:44:12.656 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:12.172+0000 7fa714dea700 1 -- 172.21.15.63:0/2219750854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7101022d0 msgr2=0x7fa710113370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:12.656 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:12.172+0000 7fa714dea700 1 --2- 172.21.15.63:0/2219750854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7101022d0 0x7fa710113370 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa70000c010 tx=0x7fa700009250 comp rx=0 tx=0).stop 2023-12-12T11:44:12.656 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:12.172+0000 7fa714dea700 1 -- 172.21.15.63:0/2219750854 shutdown_connections 2023-12-12T11:44:12.656 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:12.172+0000 7fa714dea700 1 --2- 172.21.15.63:0/2219750854 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fa6f8036640 0x7fa6f8038af0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:12.656 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:12.172+0000 7fa714dea700 1 --2- 172.21.15.63:0/2219750854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7101022d0 0x7fa710113370 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:12.656 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:12.172+0000 7fa714dea700 1 -- 172.21.15.63:0/2219750854 >> 172.21.15.63:0/2219750854 conn(0x7fa7100fda50 msgr2=0x7fa7100ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:12.656 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:12.173+0000 7fa714dea700 1 -- 172.21.15.63:0/2219750854 shutdown_connections 2023-12-12T11:44:12.657 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:12.173+0000 7fa714dea700 1 -- 172.21.15.63:0/2219750854 wait complete. 2023-12-12T11:44:12.657 INFO:teuthology.orchestra.run.smithi063.stdout:Fetching dashboard port number... 2023-12-12T11:44:13.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:12 smithi063 ceph-mon[107117]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:44:13.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:12 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:13.774 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 8443 2023-12-12T11:44:13.774 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.220+0000 7ff504363700 1 Processor -- start 2023-12-12T11:44:13.775 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.221+0000 7ff504363700 1 -- start start 2023-12-12T11:44:13.775 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.221+0000 7ff504363700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4fc077bd0 0x7ff4fc0760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:13.775 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.221+0000 7ff504363700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc077fe0 con 0x7ff4fc077bd0 2023-12-12T11:44:13.775 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.221+0000 7ff5020ff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4fc077bd0 0x7ff4fc0760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:13.775 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.221+0000 7ff5020ff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4fc077bd0 0x7ff4fc0760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48086/0 (socket says 172.21.15.63:48086) 2023-12-12T11:44:13.775 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.221+0000 7ff5020ff700 1 -- 172.21.15.63:0/4072769786 learned_addr learned my addr 172.21.15.63:0/4072769786 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:44:13.775 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.222+0000 7ff5020ff700 1 -- 172.21.15.63:0/4072769786 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4fc076620 con 0x7ff4fc077bd0 2023-12-12T11:44:13.775 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.222+0000 7ff5020ff700 1 --2- 172.21.15.63:0/4072769786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4fc077bd0 0x7ff4fc0760e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff4f80098e0 tx=0x7ff4f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b183ce3642a24288 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:13.775 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.222+0000 7ff5010fd700 1 -- 172.21.15.63:0/4072769786 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4f800b860 con 0x7ff4fc077bd0 2023-12-12T11:44:13.775 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.222+0000 7ff5010fd700 1 -- 172.21.15.63:0/4072769786 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff4f800be70 con 0x7ff4fc077bd0 2023-12-12T11:44:13.775 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.222+0000 7ff5010fd700 1 -- 172.21.15.63:0/4072769786 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4f8010380 con 0x7ff4fc077bd0 2023-12-12T11:44:13.775 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.223+0000 7ff504363700 1 -- 172.21.15.63:0/4072769786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4fc077bd0 msgr2=0x7ff4fc0760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:13.776 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.223+0000 7ff504363700 1 --2- 172.21.15.63:0/4072769786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4fc077bd0 0x7ff4fc0760e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff4f80098e0 tx=0x7ff4f8009250 comp rx=0 tx=0).stop 2023-12-12T11:44:13.776 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.223+0000 7ff504363700 1 -- 172.21.15.63:0/4072769786 shutdown_connections 2023-12-12T11:44:13.776 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.223+0000 7ff504363700 1 --2- 172.21.15.63:0/4072769786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4fc077bd0 0x7ff4fc0760e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:13.776 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.223+0000 7ff504363700 1 -- 172.21.15.63:0/4072769786 >> 172.21.15.63:0/4072769786 conn(0x7ff4fc0fda50 msgr2=0x7ff4fc0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:13.776 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.223+0000 7ff504363700 1 -- 172.21.15.63:0/4072769786 shutdown_connections 2023-12-12T11:44:13.776 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.223+0000 7ff504363700 1 -- 172.21.15.63:0/4072769786 wait complete. 2023-12-12T11:44:13.776 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.224+0000 7ff504363700 1 Processor -- start 2023-12-12T11:44:13.776 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.224+0000 7ff504363700 1 -- start start 2023-12-12T11:44:13.776 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.224+0000 7ff504363700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4fc077bd0 0x7ff4fc113370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:13.776 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.224+0000 7ff504363700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc1138b0 con 0x7ff4fc077bd0 2023-12-12T11:44:13.776 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.225+0000 7ff5020ff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4fc077bd0 0x7ff4fc113370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:13.776 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.225+0000 7ff5020ff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4fc077bd0 0x7ff4fc113370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48088/0 (socket says 172.21.15.63:48088) 2023-12-12T11:44:13.777 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.225+0000 7ff5020ff700 1 -- 172.21.15.63:0/2805404366 learned_addr learned my addr 172.21.15.63:0/2805404366 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:44:13.777 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.225+0000 7ff5020ff700 1 -- 172.21.15.63:0/2805404366 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f80094f0 con 0x7ff4fc077bd0 2023-12-12T11:44:13.777 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.225+0000 7ff5020ff700 1 --2- 172.21.15.63:0/2805404366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4fc077bd0 0x7ff4fc113370 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8006d40 tx=0x7ff4f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:13.777 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.225+0000 7ff4f2ffd700 1 -- 172.21.15.63:0/2805404366 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4f8010960 con 0x7ff4fc077bd0 2023-12-12T11:44:13.777 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.225+0000 7ff4f2ffd700 1 -- 172.21.15.63:0/2805404366 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff4f801a430 con 0x7ff4fc077bd0 2023-12-12T11:44:13.777 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.225+0000 7ff4f2ffd700 1 -- 172.21.15.63:0/2805404366 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4f80245b0 con 0x7ff4fc077bd0 2023-12-12T11:44:13.777 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.225+0000 7ff504363700 1 -- 172.21.15.63:0/2805404366 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4fc113ab0 con 0x7ff4fc077bd0 2023-12-12T11:44:13.777 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.226+0000 7ff504363700 1 -- 172.21.15.63:0/2805404366 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4fc113ec0 con 0x7ff4fc077bd0 2023-12-12T11:44:13.777 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.227+0000 7ff4f2ffd700 1 -- 172.21.15.63:0/2805404366 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7ff4f801a9f0 con 0x7ff4fc077bd0 2023-12-12T11:44:13.777 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.227+0000 7ff504363700 1 -- 172.21.15.63:0/2805404366 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4fc04bb80 con 0x7ff4fc077bd0 2023-12-12T11:44:13.777 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.227+0000 7ff4f2ffd700 1 --2- 172.21.15.63:0/2805404366 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7ff4e8036690 0x7ff4e8038b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:13.777 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.227+0000 7ff4f2ffd700 1 -- 172.21.15.63:0/2805404366 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff4f804a300 con 0x7ff4fc077bd0 2023-12-12T11:44:13.777 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.227+0000 7ff5018fe700 1 --2- 172.21.15.63:0/2805404366 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7ff4e8036690 0x7ff4e8038b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:13.778 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.228+0000 7ff5018fe700 1 --2- 172.21.15.63:0/2805404366 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7ff4e8036690 0x7ff4e8038b40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec009990 tx=0x7ff4ec006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:13.778 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.232+0000 7ff4f2ffd700 1 -- 172.21.15.63:0/2805404366 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff4f802b8c0 con 0x7ff4fc077bd0 2023-12-12T11:44:13.778 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.433+0000 7ff504363700 1 -- 172.21.15.63:0/2805404366 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7ff4fc108540 con 0x7ff4fc077bd0 2023-12-12T11:44:13.778 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.434+0000 7ff4f2ffd700 1 -- 172.21.15.63:0/2805404366 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7ff4f802b2f0 con 0x7ff4fc077bd0 2023-12-12T11:44:13.778 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.436+0000 7ff504363700 1 -- 172.21.15.63:0/2805404366 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7ff4e8036690 msgr2=0x7ff4e8038b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:13.778 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.436+0000 7ff504363700 1 --2- 172.21.15.63:0/2805404366 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7ff4e8036690 0x7ff4e8038b40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec009990 tx=0x7ff4ec006e40 comp rx=0 tx=0).stop 2023-12-12T11:44:13.778 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.436+0000 7ff504363700 1 -- 172.21.15.63:0/2805404366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4fc077bd0 msgr2=0x7ff4fc113370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:13.778 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.436+0000 7ff504363700 1 --2- 172.21.15.63:0/2805404366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4fc077bd0 0x7ff4fc113370 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8006d40 tx=0x7ff4f8009250 comp rx=0 tx=0).stop 2023-12-12T11:44:13.778 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.436+0000 7ff504363700 1 -- 172.21.15.63:0/2805404366 shutdown_connections 2023-12-12T11:44:13.778 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.436+0000 7ff504363700 1 --2- 172.21.15.63:0/2805404366 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7ff4e8036690 0x7ff4e8038b40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:13.778 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.436+0000 7ff504363700 1 --2- 172.21.15.63:0/2805404366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4fc077bd0 0x7ff4fc113370 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:13.779 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.436+0000 7ff504363700 1 -- 172.21.15.63:0/2805404366 >> 172.21.15.63:0/2805404366 conn(0x7ff4fc0fda50 msgr2=0x7ff4fc0ffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:13.779 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.436+0000 7ff504363700 1 -- 172.21.15.63:0/2805404366 shutdown_connections 2023-12-12T11:44:13.779 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:13.436+0000 7ff504363700 1 -- 172.21.15.63:0/2805404366 wait complete. 2023-12-12T11:44:13.792 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-12T11:44:13.792 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout disabled 2023-12-12T11:44:13.811 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-12T11:44:13.811 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout inactive 2023-12-12T11:44:13.811 INFO:teuthology.orchestra.run.smithi063.stdout:firewalld.service is not enabled 2023-12-12T11:44:13.811 INFO:teuthology.orchestra.run.smithi063.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-12-12T11:44:13.814 INFO:teuthology.orchestra.run.smithi063.stdout:Ceph Dashboard is now available at: 2023-12-12T11:44:13.814 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:44:13.814 INFO:teuthology.orchestra.run.smithi063.stdout: URL: https://smithi063.front.sepia.ceph.com:8443/ 2023-12-12T11:44:13.814 INFO:teuthology.orchestra.run.smithi063.stdout: User: admin 2023-12-12T11:44:13.814 INFO:teuthology.orchestra.run.smithi063.stdout: Password: k3d4khdvus 2023-12-12T11:44:13.814 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:44:13.814 INFO:teuthology.orchestra.run.smithi063.stdout:Saving cluster configuration to /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config directory 2023-12-12T11:44:13.815 INFO:teuthology.orchestra.run.smithi063.stdout:Enabling autotune for osd_memory_target 2023-12-12T11:44:14.024 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:13 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/2805404366' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-12-12T11:44:14.807 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.250+0000 7f5506466700 1 Processor -- start 2023-12-12T11:44:14.807 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.250+0000 7f5506466700 1 -- start start 2023-12-12T11:44:14.807 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.250+0000 7f5506466700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55001022d0 0x7f55001026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:14.807 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.250+0000 7f5506466700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5500102c20 con 0x7f55001022d0 2023-12-12T11:44:14.807 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.250+0000 7f54fffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55001022d0 0x7f55001026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:14.807 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.251+0000 7f54fffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55001022d0 0x7f55001026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48096/0 (socket says 172.21.15.63:48096) 2023-12-12T11:44:14.808 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.251+0000 7f54fffff700 1 -- 172.21.15.63:0/2153671912 learned_addr learned my addr 172.21.15.63:0/2153671912 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:44:14.808 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.251+0000 7f54fffff700 1 -- 172.21.15.63:0/2153671912 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5500102d60 con 0x7f55001022d0 2023-12-12T11:44:14.808 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.251+0000 7f54fffff700 1 --2- 172.21.15.63:0/2153671912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55001022d0 0x7f55001026e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f54f00098e0 tx=0x7f54f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b70d696ec6d7100b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:14.808 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.251+0000 7f54feffd700 1 -- 172.21.15.63:0/2153671912 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54f000b860 con 0x7f55001022d0 2023-12-12T11:44:14.808 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.251+0000 7f54feffd700 1 -- 172.21.15.63:0/2153671912 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f54f000be70 con 0x7f55001022d0 2023-12-12T11:44:14.808 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.251+0000 7f54feffd700 1 -- 172.21.15.63:0/2153671912 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54f0010380 con 0x7f55001022d0 2023-12-12T11:44:14.808 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.252+0000 7f5506466700 1 -- 172.21.15.63:0/2153671912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55001022d0 msgr2=0x7f55001026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:14.808 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.252+0000 7f5506466700 1 --2- 172.21.15.63:0/2153671912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55001022d0 0x7f55001026e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f54f00098e0 tx=0x7f54f0009250 comp rx=0 tx=0).stop 2023-12-12T11:44:14.808 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.252+0000 7f5506466700 1 -- 172.21.15.63:0/2153671912 shutdown_connections 2023-12-12T11:44:14.808 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.252+0000 7f5506466700 1 --2- 172.21.15.63:0/2153671912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55001022d0 0x7f55001026e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:14.808 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.252+0000 7f5506466700 1 -- 172.21.15.63:0/2153671912 >> 172.21.15.63:0/2153671912 conn(0x7f55000fda50 msgr2=0x7f55000ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:14.808 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.252+0000 7f5506466700 1 -- 172.21.15.63:0/2153671912 shutdown_connections 2023-12-12T11:44:14.808 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.252+0000 7f5506466700 1 -- 172.21.15.63:0/2153671912 wait complete. 2023-12-12T11:44:14.808 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.253+0000 7f5506466700 1 Processor -- start 2023-12-12T11:44:14.808 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.254+0000 7f5506466700 1 -- start start 2023-12-12T11:44:14.809 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.254+0000 7f5506466700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55001022d0 0x7f5500111170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:14.809 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.254+0000 7f5506466700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55001116b0 con 0x7f55001022d0 2023-12-12T11:44:14.809 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.254+0000 7f54fffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55001022d0 0x7f5500111170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:14.809 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.254+0000 7f54fffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55001022d0 0x7f5500111170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48108/0 (socket says 172.21.15.63:48108) 2023-12-12T11:44:14.809 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.254+0000 7f54fffff700 1 -- 172.21.15.63:0/1411959130 learned_addr learned my addr 172.21.15.63:0/1411959130 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:44:14.809 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.255+0000 7f54fffff700 1 -- 172.21.15.63:0/1411959130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f00094f0 con 0x7f55001022d0 2023-12-12T11:44:14.809 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.255+0000 7f54fffff700 1 --2- 172.21.15.63:0/1411959130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55001022d0 0x7f5500111170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f54f000c010 tx=0x7f54f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:14.809 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.255+0000 7f54fcff9700 1 -- 172.21.15.63:0/1411959130 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54f0010960 con 0x7f55001022d0 2023-12-12T11:44:14.809 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.255+0000 7f54fcff9700 1 -- 172.21.15.63:0/1411959130 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f54f001a430 con 0x7f55001022d0 2023-12-12T11:44:14.809 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.255+0000 7f5506466700 1 -- 172.21.15.63:0/1411959130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55001118b0 con 0x7f55001022d0 2023-12-12T11:44:14.809 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.255+0000 7f54fcff9700 1 -- 172.21.15.63:0/1411959130 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54f0019580 con 0x7f55001022d0 2023-12-12T11:44:14.809 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.255+0000 7f5506466700 1 -- 172.21.15.63:0/1411959130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5500111cc0 con 0x7f55001022d0 2023-12-12T11:44:14.809 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.256+0000 7f54fcff9700 1 -- 172.21.15.63:0/1411959130 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f54f001a980 con 0x7f55001022d0 2023-12-12T11:44:14.809 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.256+0000 7f5506466700 1 -- 172.21.15.63:0/1411959130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f550004bb80 con 0x7f55001022d0 2023-12-12T11:44:14.809 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.257+0000 7f54fcff9700 1 --2- 172.21.15.63:0/1411959130 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f54e8036690 0x7f54e8038b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:14.810 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.257+0000 7f54fcff9700 1 -- 172.21.15.63:0/1411959130 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f54f004a570 con 0x7f55001022d0 2023-12-12T11:44:14.810 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.257+0000 7f54ff7fe700 1 --2- 172.21.15.63:0/1411959130 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f54e8036690 0x7f54e8038b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:14.810 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.258+0000 7f54ff7fe700 1 --2- 172.21.15.63:0/1411959130 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f54e8036690 0x7f54e8038b40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009990 tx=0x7f54f4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:14.810 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.262+0000 7f54fcff9700 1 -- 172.21.15.63:0/1411959130 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f54f002bb30 con 0x7f55001022d0 2023-12-12T11:44:14.810 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.464+0000 7f5506466700 1 -- 172.21.15.63:0/1411959130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f55001040b0 con 0x7f55001022d0 2023-12-12T11:44:14.810 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.464+0000 7f54fcff9700 1 -- 172.21.15.63:0/1411959130 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f54f002b300 con 0x7f55001022d0 2023-12-12T11:44:14.810 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.466+0000 7f5506466700 1 -- 172.21.15.63:0/1411959130 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f54e8036690 msgr2=0x7f54e8038b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:14.810 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.466+0000 7f5506466700 1 --2- 172.21.15.63:0/1411959130 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f54e8036690 0x7f54e8038b40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009990 tx=0x7f54f4006e40 comp rx=0 tx=0).stop 2023-12-12T11:44:14.810 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.466+0000 7f5506466700 1 -- 172.21.15.63:0/1411959130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55001022d0 msgr2=0x7f5500111170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:14.810 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.466+0000 7f5506466700 1 --2- 172.21.15.63:0/1411959130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55001022d0 0x7f5500111170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f54f000c010 tx=0x7f54f0009250 comp rx=0 tx=0).stop 2023-12-12T11:44:14.810 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.466+0000 7f5506466700 1 -- 172.21.15.63:0/1411959130 shutdown_connections 2023-12-12T11:44:14.810 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.466+0000 7f5506466700 1 --2- 172.21.15.63:0/1411959130 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f54e8036690 0x7f54e8038b40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:14.810 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.466+0000 7f5506466700 1 --2- 172.21.15.63:0/1411959130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55001022d0 0x7f5500111170 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:14.811 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.466+0000 7f5506466700 1 -- 172.21.15.63:0/1411959130 >> 172.21.15.63:0/1411959130 conn(0x7f55000fda50 msgr2=0x7f55000ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:14.811 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.466+0000 7f5506466700 1 -- 172.21.15.63:0/1411959130 shutdown_connections 2023-12-12T11:44:14.811 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:14.467+0000 7f5506466700 1 -- 172.21.15.63:0/1411959130 wait complete. 2023-12-12T11:44:15.829 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.174+0000 7fa33759f700 1 Processor -- start 2023-12-12T11:44:15.829 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.175+0000 7fa33759f700 1 -- start start 2023-12-12T11:44:15.829 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.175+0000 7fa33759f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa330077bd0 0x7fa3300760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:15.829 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.175+0000 7fa33759f700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa330077fe0 con 0x7fa330077bd0 2023-12-12T11:44:15.829 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.175+0000 7fa33533b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa330077bd0 0x7fa3300760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:15.829 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.175+0000 7fa33533b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa330077bd0 0x7fa3300760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48112/0 (socket says 172.21.15.63:48112) 2023-12-12T11:44:15.829 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.175+0000 7fa33533b700 1 -- 172.21.15.63:0/3418592946 learned_addr learned my addr 172.21.15.63:0/3418592946 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:44:15.829 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.176+0000 7fa33533b700 1 -- 172.21.15.63:0/3418592946 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa330076620 con 0x7fa330077bd0 2023-12-12T11:44:15.829 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.176+0000 7fa33533b700 1 --2- 172.21.15.63:0/3418592946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa330077bd0 0x7fa3300760e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa32c0098e0 tx=0x7fa32c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=283c431cf7c3e9f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:15.829 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.176+0000 7fa327fff700 1 -- 172.21.15.63:0/3418592946 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa32c00b860 con 0x7fa330077bd0 2023-12-12T11:44:15.830 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.176+0000 7fa327fff700 1 -- 172.21.15.63:0/3418592946 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa32c00be70 con 0x7fa330077bd0 2023-12-12T11:44:15.830 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.176+0000 7fa327fff700 1 -- 172.21.15.63:0/3418592946 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa32c010380 con 0x7fa330077bd0 2023-12-12T11:44:15.830 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.177+0000 7fa33759f700 1 -- 172.21.15.63:0/3418592946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa330077bd0 msgr2=0x7fa3300760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:15.830 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.177+0000 7fa33759f700 1 --2- 172.21.15.63:0/3418592946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa330077bd0 0x7fa3300760e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa32c0098e0 tx=0x7fa32c009250 comp rx=0 tx=0).stop 2023-12-12T11:44:15.830 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.177+0000 7fa33759f700 1 -- 172.21.15.63:0/3418592946 shutdown_connections 2023-12-12T11:44:15.830 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.177+0000 7fa33759f700 1 --2- 172.21.15.63:0/3418592946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa330077bd0 0x7fa3300760e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:15.830 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.177+0000 7fa33759f700 1 -- 172.21.15.63:0/3418592946 >> 172.21.15.63:0/3418592946 conn(0x7fa3300fda50 msgr2=0x7fa3300ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:15.830 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.177+0000 7fa33759f700 1 -- 172.21.15.63:0/3418592946 shutdown_connections 2023-12-12T11:44:15.830 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.177+0000 7fa33759f700 1 -- 172.21.15.63:0/3418592946 wait complete. 2023-12-12T11:44:15.830 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.178+0000 7fa33759f700 1 Processor -- start 2023-12-12T11:44:15.830 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.178+0000 7fa33759f700 1 -- start start 2023-12-12T11:44:15.830 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.178+0000 7fa33759f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa330077bd0 0x7fa330113370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:15.830 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.178+0000 7fa33759f700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3301138b0 con 0x7fa330077bd0 2023-12-12T11:44:15.830 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.179+0000 7fa33533b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa330077bd0 0x7fa330113370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:15.831 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.179+0000 7fa33533b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa330077bd0 0x7fa330113370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48122/0 (socket says 172.21.15.63:48122) 2023-12-12T11:44:15.831 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.179+0000 7fa33533b700 1 -- 172.21.15.63:0/1943015680 learned_addr learned my addr 172.21.15.63:0/1943015680 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:44:15.831 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.179+0000 7fa33533b700 1 -- 172.21.15.63:0/1943015680 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32c0094f0 con 0x7fa330077bd0 2023-12-12T11:44:15.831 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.179+0000 7fa33533b700 1 --2- 172.21.15.63:0/1943015680 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa330077bd0 0x7fa330113370 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa32c0094c0 tx=0x7fa32c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:15.831 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.179+0000 7fa325ffb700 1 -- 172.21.15.63:0/1943015680 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa32c010850 con 0x7fa330077bd0 2023-12-12T11:44:15.831 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.179+0000 7fa325ffb700 1 -- 172.21.15.63:0/1943015680 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa32c010e60 con 0x7fa330077bd0 2023-12-12T11:44:15.831 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.179+0000 7fa325ffb700 1 -- 172.21.15.63:0/1943015680 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa32c01a430 con 0x7fa330077bd0 2023-12-12T11:44:15.831 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.179+0000 7fa33759f700 1 -- 172.21.15.63:0/1943015680 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa330113ab0 con 0x7fa330077bd0 2023-12-12T11:44:15.831 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.180+0000 7fa33759f700 1 -- 172.21.15.63:0/1943015680 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa330113ec0 con 0x7fa330077bd0 2023-12-12T11:44:15.831 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.180+0000 7fa33759f700 1 -- 172.21.15.63:0/1943015680 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa33004bb80 con 0x7fa330077bd0 2023-12-12T11:44:15.831 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.181+0000 7fa325ffb700 1 -- 172.21.15.63:0/1943015680 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fa32c0247b0 con 0x7fa330077bd0 2023-12-12T11:44:15.831 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.181+0000 7fa325ffb700 1 --2- 172.21.15.63:0/1943015680 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fa31c0366e0 0x7fa31c038b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:15.831 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.181+0000 7fa325ffb700 1 -- 172.21.15.63:0/1943015680 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa32c04a6c0 con 0x7fa330077bd0 2023-12-12T11:44:15.831 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.181+0000 7fa334b3a700 1 --2- 172.21.15.63:0/1943015680 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fa31c0366e0 0x7fa31c038b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:15.831 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.182+0000 7fa334b3a700 1 --2- 172.21.15.63:0/1943015680 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fa31c0366e0 0x7fa31c038b90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa320009990 tx=0x7fa320006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:15.832 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.186+0000 7fa325ffb700 1 -- 172.21.15.63:0/1943015680 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa32c022520 con 0x7fa330077bd0 2023-12-12T11:44:15.832 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.495+0000 7fa33759f700 1 -- 172.21.15.63:0/1943015680 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fa330108540 con 0x7fa330077bd0 2023-12-12T11:44:15.832 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.497+0000 7fa325ffb700 1 -- 172.21.15.63:0/1943015680 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7fa32c022340 con 0x7fa330077bd0 2023-12-12T11:44:15.832 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.499+0000 7fa33759f700 1 -- 172.21.15.63:0/1943015680 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fa31c0366e0 msgr2=0x7fa31c038b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:15.832 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.499+0000 7fa33759f700 1 --2- 172.21.15.63:0/1943015680 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fa31c0366e0 0x7fa31c038b90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa320009990 tx=0x7fa320006e40 comp rx=0 tx=0).stop 2023-12-12T11:44:15.832 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.499+0000 7fa33759f700 1 -- 172.21.15.63:0/1943015680 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa330077bd0 msgr2=0x7fa330113370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:15.832 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.499+0000 7fa33759f700 1 --2- 172.21.15.63:0/1943015680 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa330077bd0 0x7fa330113370 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa32c0094c0 tx=0x7fa32c009250 comp rx=0 tx=0).stop 2023-12-12T11:44:15.832 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.500+0000 7fa33759f700 1 -- 172.21.15.63:0/1943015680 shutdown_connections 2023-12-12T11:44:15.832 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.500+0000 7fa33759f700 1 --2- 172.21.15.63:0/1943015680 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fa31c0366e0 0x7fa31c038b90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:15.832 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.500+0000 7fa33759f700 1 --2- 172.21.15.63:0/1943015680 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa330077bd0 0x7fa330113370 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:15.832 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.500+0000 7fa33759f700 1 -- 172.21.15.63:0/1943015680 >> 172.21.15.63:0/1943015680 conn(0x7fa3300fda50 msgr2=0x7fa3300ffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:15.832 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.500+0000 7fa33759f700 1 -- 172.21.15.63:0/1943015680 shutdown_connections 2023-12-12T11:44:15.832 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-12T11:44:15.500+0000 7fa33759f700 1 -- 172.21.15.63:0/1943015680 wait complete. 2023-12-12T11:44:15.832 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-12-12T11:44:15.832 INFO:teuthology.orchestra.run.smithi063.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-12-12T11:44:15.833 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:44:15.833 INFO:teuthology.orchestra.run.smithi063.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-12-12T11:44:15.833 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:44:15.833 INFO:teuthology.orchestra.run.smithi063.stdout:Or, if you are only running a single cluster on this host: 2023-12-12T11:44:15.833 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:44:15.833 INFO:teuthology.orchestra.run.smithi063.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-12-12T11:44:15.833 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:44:15.833 INFO:teuthology.orchestra.run.smithi063.stdout:Please consider enabling telemetry to help improve Ceph: 2023-12-12T11:44:15.833 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:44:15.833 INFO:teuthology.orchestra.run.smithi063.stdout: ceph telemetry on 2023-12-12T11:44:15.833 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:44:15.833 INFO:teuthology.orchestra.run.smithi063.stdout:For more information see: 2023-12-12T11:44:15.833 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:44:15.833 INFO:teuthology.orchestra.run.smithi063.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2023-12-12T11:44:15.833 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:44:15.833 INFO:teuthology.orchestra.run.smithi063.stdout:Bootstrap complete. 2023-12-12T11:44:15.887 INFO:tasks.cephadm:Fetching config... 2023-12-12T11:44:15.888 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-12T11:44:15.888 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-12-12T11:44:15.934 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-12-12T11:44:15.934 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-12T11:44:15.934 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-12-12T11:44:16.024 INFO:tasks.cephadm:Fetching mon keyring... 2023-12-12T11:44:16.024 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-12T11:44:16.024 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/keyring of=/dev/stdout 2023-12-12T11:44:16.092 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:15 smithi063 ceph-mon[107117]: mgrmap e13: smithi063.zjnfdi(active, since 6s) 2023-12-12T11:44:16.093 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:15 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/1943015680' entity='client.admin' 2023-12-12T11:44:16.112 INFO:tasks.cephadm:Fetching pub ssh key... 2023-12-12T11:44:16.112 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-12T11:44:16.112 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-12-12T11:44:16.163 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-12-12T11:44:16.163 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLXCLanB34deF1kqKX1KHerLYI2th0MIpecUNtBwjFjSU3o0bSleyOTu6Grln4EGyfMeMX2cCZdvspLELB4FCHOpn/7SU8PsFU3mlU0Rd+KFWsq8dW/0R6XpfrtgI1ZraInoNIUqJtREazf87M+UNSESdegV2IEX8K261azF+pA3bDggSo61DeSJsFRK4hGr049A2kmZ6TCUEvyusZRx2UgrbsGq0XoO7PMRsdpYO/FnyOiQf6EnGSZfL1XyCthJQA9wbNAITP00rLXMYFUZxOXBt+sV3yFfOEizKmGicB5ZRE/CFK1BF/Egc0pUmAkbK9+RX4aEj685xP6m9YkAfwpVQjRbEUymU4FfzXp0wXzSAkvmxwfMHJA0pFJAIb83H7+PwFoQkOSaW5f/qZ/zP8NndQ55hAh86qkxPRMTJ4YLUDOxFJmY3AXFwnqGNpl7wEBCUtBIy0FR18orrp3IRaLhB+N8xvzrkRqi40/kJG2S+Hi5BwVZ0phM+3s17OKkc= ceph-85e33c70-98e3-11ee-95a3-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-12T11:44:16.261 INFO:teuthology.orchestra.run.smithi063.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLXCLanB34deF1kqKX1KHerLYI2th0MIpecUNtBwjFjSU3o0bSleyOTu6Grln4EGyfMeMX2cCZdvspLELB4FCHOpn/7SU8PsFU3mlU0Rd+KFWsq8dW/0R6XpfrtgI1ZraInoNIUqJtREazf87M+UNSESdegV2IEX8K261azF+pA3bDggSo61DeSJsFRK4hGr049A2kmZ6TCUEvyusZRx2UgrbsGq0XoO7PMRsdpYO/FnyOiQf6EnGSZfL1XyCthJQA9wbNAITP00rLXMYFUZxOXBt+sV3yFfOEizKmGicB5ZRE/CFK1BF/Egc0pUmAkbK9+RX4aEj685xP6m9YkAfwpVQjRbEUymU4FfzXp0wXzSAkvmxwfMHJA0pFJAIb83H7+PwFoQkOSaW5f/qZ/zP8NndQ55hAh86qkxPRMTJ4YLUDOxFJmY3AXFwnqGNpl7wEBCUtBIy0FR18orrp3IRaLhB+N8xvzrkRqi40/kJG2S+Hi5BwVZ0phM+3s17OKkc= ceph-85e33c70-98e3-11ee-95a3-87774f69a715 2023-12-12T11:44:16.291 DEBUG:teuthology.orchestra.run.smithi093:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLXCLanB34deF1kqKX1KHerLYI2th0MIpecUNtBwjFjSU3o0bSleyOTu6Grln4EGyfMeMX2cCZdvspLELB4FCHOpn/7SU8PsFU3mlU0Rd+KFWsq8dW/0R6XpfrtgI1ZraInoNIUqJtREazf87M+UNSESdegV2IEX8K261azF+pA3bDggSo61DeSJsFRK4hGr049A2kmZ6TCUEvyusZRx2UgrbsGq0XoO7PMRsdpYO/FnyOiQf6EnGSZfL1XyCthJQA9wbNAITP00rLXMYFUZxOXBt+sV3yFfOEizKmGicB5ZRE/CFK1BF/Egc0pUmAkbK9+RX4aEj685xP6m9YkAfwpVQjRbEUymU4FfzXp0wXzSAkvmxwfMHJA0pFJAIb83H7+PwFoQkOSaW5f/qZ/zP8NndQ55hAh86qkxPRMTJ4YLUDOxFJmY3AXFwnqGNpl7wEBCUtBIy0FR18orrp3IRaLhB+N8xvzrkRqi40/kJG2S+Hi5BwVZ0phM+3s17OKkc= ceph-85e33c70-98e3-11ee-95a3-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-12T11:44:16.395 INFO:teuthology.orchestra.run.smithi093.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLXCLanB34deF1kqKX1KHerLYI2th0MIpecUNtBwjFjSU3o0bSleyOTu6Grln4EGyfMeMX2cCZdvspLELB4FCHOpn/7SU8PsFU3mlU0Rd+KFWsq8dW/0R6XpfrtgI1ZraInoNIUqJtREazf87M+UNSESdegV2IEX8K261azF+pA3bDggSo61DeSJsFRK4hGr049A2kmZ6TCUEvyusZRx2UgrbsGq0XoO7PMRsdpYO/FnyOiQf6EnGSZfL1XyCthJQA9wbNAITP00rLXMYFUZxOXBt+sV3yFfOEizKmGicB5ZRE/CFK1BF/Egc0pUmAkbK9+RX4aEj685xP6m9YkAfwpVQjRbEUymU4FfzXp0wXzSAkvmxwfMHJA0pFJAIb83H7+PwFoQkOSaW5f/qZ/zP8NndQ55hAh86qkxPRMTJ4YLUDOxFJmY3AXFwnqGNpl7wEBCUtBIy0FR18orrp3IRaLhB+N8xvzrkRqi40/kJG2S+Hi5BwVZ0phM+3s17OKkc= ceph-85e33c70-98e3-11ee-95a3-87774f69a715 2023-12-12T11:44:16.424 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-12-12T11:44:16.852 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:44:18.150 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.147+0000 7f3b7dd18700 1 -- 172.21.15.63:0/2419488065 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b780fc870 msgr2=0x7f3b780fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:18.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.147+0000 7f3b7dd18700 1 --2- 172.21.15.63:0/2419488065 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b780fc870 0x7f3b780fcc80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3b680048c0 tx=0x7f3b68009e30 comp rx=0 tx=0).stop 2023-12-12T11:44:18.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.147+0000 7f3b7dd18700 1 -- 172.21.15.63:0/2419488065 shutdown_connections 2023-12-12T11:44:18.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.147+0000 7f3b7dd18700 1 --2- 172.21.15.63:0/2419488065 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b780fc870 0x7f3b780fcc80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:18.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.147+0000 7f3b7dd18700 1 -- 172.21.15.63:0/2419488065 >> 172.21.15.63:0/2419488065 conn(0x7f3b780f7f50 msgr2=0x7f3b780fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:18.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.147+0000 7f3b7dd18700 1 -- 172.21.15.63:0/2419488065 shutdown_connections 2023-12-12T11:44:18.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.147+0000 7f3b7dd18700 1 -- 172.21.15.63:0/2419488065 wait complete. 2023-12-12T11:44:18.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.148+0000 7f3b7dd18700 1 Processor -- start 2023-12-12T11:44:18.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.148+0000 7f3b7dd18700 1 -- start start 2023-12-12T11:44:18.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.149+0000 7f3b7dd18700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b780fc870 0x7f3b78071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:18.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.149+0000 7f3b7dd18700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7806ff90 con 0x7f3b780fc870 2023-12-12T11:44:18.152 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.149+0000 7f3b777fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b780fc870 0x7f3b78071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:18.152 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.149+0000 7f3b777fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b780fc870 0x7f3b78071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55526/0 (socket says 172.21.15.63:55526) 2023-12-12T11:44:18.152 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.149+0000 7f3b777fe700 1 -- 172.21.15.63:0/2889029680 learned_addr learned my addr 172.21.15.63:0/2889029680 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:44:18.152 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.149+0000 7f3b777fe700 1 -- 172.21.15.63:0/2889029680 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b68005040 con 0x7f3b780fc870 2023-12-12T11:44:18.152 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.150+0000 7f3b777fe700 1 --2- 172.21.15.63:0/2889029680 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b780fc870 0x7f3b78071b10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3b6800b690 tx=0x7f3b68009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:18.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.150+0000 7f3b5ffff700 1 -- 172.21.15.63:0/2889029680 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3b68009650 con 0x7f3b780fc870 2023-12-12T11:44:18.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.150+0000 7f3b7dd18700 1 -- 172.21.15.63:0/2889029680 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b78070190 con 0x7f3b780fc870 2023-12-12T11:44:18.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.150+0000 7f3b5ffff700 1 -- 172.21.15.63:0/2889029680 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3b680097b0 con 0x7f3b780fc870 2023-12-12T11:44:18.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.150+0000 7f3b5ffff700 1 -- 172.21.15.63:0/2889029680 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3b6801c5d0 con 0x7f3b780fc870 2023-12-12T11:44:18.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.150+0000 7f3b7dd18700 1 -- 172.21.15.63:0/2889029680 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b78070680 con 0x7f3b780fc870 2023-12-12T11:44:18.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.151+0000 7f3b5ffff700 1 -- 172.21.15.63:0/2889029680 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f3b680139d0 con 0x7f3b780fc870 2023-12-12T11:44:18.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.151+0000 7f3b7dd18700 1 -- 172.21.15.63:0/2889029680 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b78106500 con 0x7f3b780fc870 2023-12-12T11:44:18.154 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.152+0000 7f3b5ffff700 1 --2- 172.21.15.63:0/2889029680 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f3b600366d0 0x7f3b60038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:18.154 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.152+0000 7f3b5ffff700 1 -- 172.21.15.63:0/2889029680 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f3b680499c0 con 0x7f3b780fc870 2023-12-12T11:44:18.154 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.152+0000 7f3b76ffd700 1 --2- 172.21.15.63:0/2889029680 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f3b600366d0 0x7f3b60038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:18.155 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.153+0000 7f3b76ffd700 1 --2- 172.21.15.63:0/2889029680 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f3b600366d0 0x7f3b60038b80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c009990 tx=0x7f3b6c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:18.159 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.157+0000 7f3b5ffff700 1 -- 172.21.15.63:0/2889029680 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3b68025400 con 0x7f3b780fc870 2023-12-12T11:44:18.388 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.386+0000 7f3b7dd18700 1 -- 172.21.15.63:0/2889029680 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f3b7805f270 con 0x7f3b780fc870 2023-12-12T11:44:18.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.389+0000 7f3b5ffff700 1 -- 172.21.15.63:0/2889029680 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f3b68011b60 con 0x7f3b780fc870 2023-12-12T11:44:18.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.392+0000 7f3b7dd18700 1 -- 172.21.15.63:0/2889029680 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f3b600366d0 msgr2=0x7f3b60038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:18.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.392+0000 7f3b7dd18700 1 --2- 172.21.15.63:0/2889029680 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f3b600366d0 0x7f3b60038b80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c009990 tx=0x7f3b6c006e40 comp rx=0 tx=0).stop 2023-12-12T11:44:18.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.392+0000 7f3b7dd18700 1 -- 172.21.15.63:0/2889029680 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b780fc870 msgr2=0x7f3b78071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:18.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.392+0000 7f3b7dd18700 1 --2- 172.21.15.63:0/2889029680 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b780fc870 0x7f3b78071b10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3b6800b690 tx=0x7f3b68009e30 comp rx=0 tx=0).stop 2023-12-12T11:44:18.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.392+0000 7f3b7dd18700 1 -- 172.21.15.63:0/2889029680 shutdown_connections 2023-12-12T11:44:18.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.392+0000 7f3b7dd18700 1 --2- 172.21.15.63:0/2889029680 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f3b600366d0 0x7f3b60038b80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:18.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.392+0000 7f3b7dd18700 1 --2- 172.21.15.63:0/2889029680 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b780fc870 0x7f3b78071b10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:18.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.392+0000 7f3b7dd18700 1 -- 172.21.15.63:0/2889029680 >> 172.21.15.63:0/2889029680 conn(0x7f3b780f7f50 msgr2=0x7f3b780f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:18.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.392+0000 7f3b7dd18700 1 -- 172.21.15.63:0/2889029680 shutdown_connections 2023-12-12T11:44:18.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:18.392+0000 7f3b7dd18700 1 -- 172.21.15.63:0/2889029680 wait complete. 2023-12-12T11:44:18.758 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-12-12T11:44:18.758 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-12-12T11:44:19.203 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:44:19.686 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:19 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/2889029680' entity='client.admin' 2023-12-12T11:44:20.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.768+0000 7f8b7d978700 1 -- 172.21.15.63:0/3067359837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b780fc870 msgr2=0x7f8b780fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:20.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.768+0000 7f8b7d978700 1 --2- 172.21.15.63:0/3067359837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b780fc870 0x7f8b780fcc80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8b680048c0 tx=0x7f8b68009e30 comp rx=0 tx=0).stop 2023-12-12T11:44:20.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.768+0000 7f8b7d978700 1 -- 172.21.15.63:0/3067359837 shutdown_connections 2023-12-12T11:44:20.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.768+0000 7f8b7d978700 1 --2- 172.21.15.63:0/3067359837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b780fc870 0x7f8b780fcc80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:20.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.768+0000 7f8b7d978700 1 -- 172.21.15.63:0/3067359837 >> 172.21.15.63:0/3067359837 conn(0x7f8b780f7f50 msgr2=0x7f8b780fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:20.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.768+0000 7f8b7d978700 1 -- 172.21.15.63:0/3067359837 shutdown_connections 2023-12-12T11:44:20.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.768+0000 7f8b7d978700 1 -- 172.21.15.63:0/3067359837 wait complete. 2023-12-12T11:44:20.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.769+0000 7f8b7d978700 1 Processor -- start 2023-12-12T11:44:20.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.769+0000 7f8b7d978700 1 -- start start 2023-12-12T11:44:20.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.770+0000 7f8b7d978700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b780fc870 0x7f8b7810ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:20.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.770+0000 7f8b7d978700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7810f290 con 0x7f8b780fc870 2023-12-12T11:44:20.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.770+0000 7f8b76ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b780fc870 0x7f8b7810ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:20.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.770+0000 7f8b76ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b780fc870 0x7f8b7810ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55554/0 (socket says 172.21.15.63:55554) 2023-12-12T11:44:20.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.770+0000 7f8b76ffd700 1 -- 172.21.15.63:0/743061760 learned_addr learned my addr 172.21.15.63:0/743061760 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:44:20.773 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.770+0000 7f8b76ffd700 1 -- 172.21.15.63:0/743061760 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b68005040 con 0x7f8b780fc870 2023-12-12T11:44:20.773 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.771+0000 7f8b76ffd700 1 --2- 172.21.15.63:0/743061760 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b780fc870 0x7f8b7810ed50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009330 tx=0x7f8b68009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:20.773 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.771+0000 7f8b5f7fe700 1 -- 172.21.15.63:0/743061760 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b680096b0 con 0x7f8b780fc870 2023-12-12T11:44:20.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.771+0000 7f8b5f7fe700 1 -- 172.21.15.63:0/743061760 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8b68009810 con 0x7f8b780fc870 2023-12-12T11:44:20.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.771+0000 7f8b7d978700 1 -- 172.21.15.63:0/743061760 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b7810f490 con 0x7f8b780fc870 2023-12-12T11:44:20.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.771+0000 7f8b5f7fe700 1 -- 172.21.15.63:0/743061760 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b6801c5b0 con 0x7f8b780fc870 2023-12-12T11:44:20.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.771+0000 7f8b7d978700 1 -- 172.21.15.63:0/743061760 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b7810fff0 con 0x7f8b780fc870 2023-12-12T11:44:20.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.772+0000 7f8b5f7fe700 1 -- 172.21.15.63:0/743061760 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f8b6801c870 con 0x7f8b780fc870 2023-12-12T11:44:20.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.772+0000 7f8b7d978700 1 -- 172.21.15.63:0/743061760 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b7805f270 con 0x7f8b780fc870 2023-12-12T11:44:20.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.773+0000 7f8b5f7fe700 1 --2- 172.21.15.63:0/743061760 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f8b600366d0 0x7f8b60038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:20.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.773+0000 7f8b5f7fe700 1 -- 172.21.15.63:0/743061760 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8b68049b30 con 0x7f8b780fc870 2023-12-12T11:44:20.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.773+0000 7f8b767fc700 1 --2- 172.21.15.63:0/743061760 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f8b600366d0 0x7f8b60038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:20.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.774+0000 7f8b767fc700 1 --2- 172.21.15.63:0/743061760 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f8b600366d0 0x7f8b60038b80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c009990 tx=0x7f8b6c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:20.779 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.778+0000 7f8b5f7fe700 1 -- 172.21.15.63:0/743061760 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8b68011dd0 con 0x7f8b780fc870 2023-12-12T11:44:20.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.993+0000 7f8b7d978700 1 -- 172.21.15.63:0/743061760 --> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b780705a0 con 0x7f8b600366d0 2023-12-12T11:44:20.999 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.997+0000 7f8b5f7fe700 1 -- 172.21.15.63:0/743061760 <== mgr.14162 v2:172.21.15.63:6800/293571324 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8b780705a0 con 0x7f8b600366d0 2023-12-12T11:44:21.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.999+0000 7f8b7d978700 1 -- 172.21.15.63:0/743061760 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f8b600366d0 msgr2=0x7f8b60038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:21.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.999+0000 7f8b7d978700 1 --2- 172.21.15.63:0/743061760 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f8b600366d0 0x7f8b60038b80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c009990 tx=0x7f8b6c006e40 comp rx=0 tx=0).stop 2023-12-12T11:44:21.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.999+0000 7f8b7d978700 1 -- 172.21.15.63:0/743061760 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b780fc870 msgr2=0x7f8b7810ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:21.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.999+0000 7f8b7d978700 1 --2- 172.21.15.63:0/743061760 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b780fc870 0x7f8b7810ed50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009330 tx=0x7f8b68009e30 comp rx=0 tx=0).stop 2023-12-12T11:44:21.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.999+0000 7f8b7d978700 1 -- 172.21.15.63:0/743061760 shutdown_connections 2023-12-12T11:44:21.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.999+0000 7f8b7d978700 1 --2- 172.21.15.63:0/743061760 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f8b600366d0 0x7f8b60038b80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:21.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.999+0000 7f8b7d978700 1 --2- 172.21.15.63:0/743061760 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b780fc870 0x7f8b7810ed50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:21.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.999+0000 7f8b7d978700 1 -- 172.21.15.63:0/743061760 >> 172.21.15.63:0/743061760 conn(0x7f8b780f7f50 msgr2=0x7f8b7806fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:21.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:20.999+0000 7f8b7d978700 1 -- 172.21.15.63:0/743061760 shutdown_connections 2023-12-12T11:44:21.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:21.000+0000 7f8b7d978700 1 -- 172.21.15.63:0/743061760 wait complete. 2023-12-12T11:44:21.282 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:21 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:21.282 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:21 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:21.282 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:21 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "who": "osd/host:smithi063", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:44:21.282 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:21 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:21.282 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:21 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi063", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-12T11:44:21.282 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:21 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi063", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-12T11:44:21.282 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:21 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:44:21.282 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:21 smithi063 ceph-mon[107117]: Deploying daemon crash.smithi063 on smithi063 2023-12-12T11:44:21.282 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:21 smithi063 ceph-mon[107117]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:44:21.282 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:21 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:21.601 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi093 2023-12-12T11:44:21.601 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-12T11:44:21.601 DEBUG:teuthology.orchestra.run.smithi093:> dd of=/etc/ceph/ceph.conf 2023-12-12T11:44:21.651 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-12T11:44:21.652 DEBUG:teuthology.orchestra.run.smithi093:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-12T11:44:21.740 INFO:tasks.cephadm:Adding host smithi093 to orchestrator... 2023-12-12T11:44:21.741 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph orch host add smithi093 2023-12-12T11:44:22.510 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:44:23.691 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:23 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:23.691 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:23 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:23.691 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:23 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:23.691 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:23 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:23.691 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:23 smithi063 ceph-mon[107117]: Deploying daemon node-exporter.smithi063 on smithi063 2023-12-12T11:44:23.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:23.888+0000 7f70bd248700 1 -- 172.21.15.63:0/541010972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70b80fc870 msgr2=0x7f70b80fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:23.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:23.888+0000 7f70bd248700 1 --2- 172.21.15.63:0/541010972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70b80fc870 0x7f70b80fcc80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f70a80048c0 tx=0x7f70a8009e30 comp rx=0 tx=0).stop 2023-12-12T11:44:23.891 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:23.888+0000 7f70bd248700 1 -- 172.21.15.63:0/541010972 shutdown_connections 2023-12-12T11:44:23.891 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:23.888+0000 7f70bd248700 1 --2- 172.21.15.63:0/541010972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70b80fc870 0x7f70b80fcc80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:23.891 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:23.888+0000 7f70bd248700 1 -- 172.21.15.63:0/541010972 >> 172.21.15.63:0/541010972 conn(0x7f70b80f7f50 msgr2=0x7f70b80fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:23.891 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:23.888+0000 7f70bd248700 1 -- 172.21.15.63:0/541010972 shutdown_connections 2023-12-12T11:44:23.891 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:23.888+0000 7f70bd248700 1 -- 172.21.15.63:0/541010972 wait complete. 2023-12-12T11:44:23.892 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:23.889+0000 7f70bd248700 1 Processor -- start 2023-12-12T11:44:23.892 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:23.889+0000 7f70bd248700 1 -- start start 2023-12-12T11:44:23.892 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:23.889+0000 7f70bd248700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70b80fc870 0x7f70b810ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:23.892 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:23.889+0000 7f70bd248700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b810cfd0 con 0x7f70b80fc870 2023-12-12T11:44:23.892 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:23.890+0000 7f70b6d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70b80fc870 0x7f70b810ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:23.892 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:23.890+0000 7f70b6d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70b80fc870 0x7f70b810ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55576/0 (socket says 172.21.15.63:55576) 2023-12-12T11:44:23.892 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:23.890+0000 7f70b6d9d700 1 -- 172.21.15.63:0/495281866 learned_addr learned my addr 172.21.15.63:0/495281866 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:44:23.892 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:23.890+0000 7f70b6d9d700 1 -- 172.21.15.63:0/495281866 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a8005040 con 0x7f70b80fc870 2023-12-12T11:44:23.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:23.890+0000 7f70b6d9d700 1 --2- 172.21.15.63:0/495281866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70b80fc870 0x7f70b810ca90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f70a800b690 tx=0x7f70a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:23.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:23.890+0000 7f709f7fe700 1 -- 172.21.15.63:0/495281866 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f70a8009650 con 0x7f70b80fc870 2023-12-12T11:44:23.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:23.891+0000 7f70bd248700 1 -- 172.21.15.63:0/495281866 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b810d1d0 con 0x7f70b80fc870 2023-12-12T11:44:23.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:23.891+0000 7f709f7fe700 1 -- 172.21.15.63:0/495281866 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f70a80097b0 con 0x7f70b80fc870 2023-12-12T11:44:23.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:23.891+0000 7f709f7fe700 1 -- 172.21.15.63:0/495281866 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f70a801c5d0 con 0x7f70b80fc870 2023-12-12T11:44:23.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:23.891+0000 7f70bd248700 1 -- 172.21.15.63:0/495281866 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b810de70 con 0x7f70b80fc870 2023-12-12T11:44:23.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:23.892+0000 7f709f7fe700 1 -- 172.21.15.63:0/495281866 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f70a80139d0 con 0x7f70b80fc870 2023-12-12T11:44:23.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:23.892+0000 7f70bd248700 1 -- 172.21.15.63:0/495281866 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b805f270 con 0x7f70b80fc870 2023-12-12T11:44:23.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:23.892+0000 7f709f7fe700 1 --2- 172.21.15.63:0/495281866 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f70a00366d0 0x7f70a0038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:23.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:23.892+0000 7f709f7fe700 1 -- 172.21.15.63:0/495281866 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f70a8049a20 con 0x7f70b80fc870 2023-12-12T11:44:23.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:23.893+0000 7f70b659c700 1 --2- 172.21.15.63:0/495281866 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f70a00366d0 0x7f70a0038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:23.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:23.893+0000 7f70b659c700 1 --2- 172.21.15.63:0/495281866 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f70a00366d0 0x7f70a0038b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009990 tx=0x7f70ac006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:23.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:23.898+0000 7f709f7fe700 1 -- 172.21.15.63:0/495281866 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f70a8025400 con 0x7f70b80fc870 2023-12-12T11:44:24.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:24.118+0000 7f70bd248700 1 -- 172.21.15.63:0/495281866 --> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi093", "target": ["mon-mgr", ""]}) v1 -- 0x7f70b810ea30 con 0x7f70a00366d0 2023-12-12T11:44:25.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:24 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:26.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:25 smithi063 ceph-mon[107117]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi093", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:44:26.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:25 smithi063 ceph-mon[107117]: Deploying cephadm binary to smithi093 2023-12-12T11:44:26.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:26.812+0000 7f709f7fe700 1 -- 172.21.15.63:0/495281866 <== mgr.14162 v2:172.21.15.63:6800/293571324 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f70b810ea30 con 0x7f70a00366d0 2023-12-12T11:44:26.815 INFO:teuthology.orchestra.run.smithi063.stdout:Added host 'smithi093' with addr '172.21.15.93' 2023-12-12T11:44:26.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:26.815+0000 7f70bd248700 1 -- 172.21.15.63:0/495281866 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f70a00366d0 msgr2=0x7f70a0038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:26.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:26.815+0000 7f70bd248700 1 --2- 172.21.15.63:0/495281866 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f70a00366d0 0x7f70a0038b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009990 tx=0x7f70ac006e40 comp rx=0 tx=0).stop 2023-12-12T11:44:26.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:26.815+0000 7f70bd248700 1 -- 172.21.15.63:0/495281866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70b80fc870 msgr2=0x7f70b810ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:26.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:26.815+0000 7f70bd248700 1 --2- 172.21.15.63:0/495281866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70b80fc870 0x7f70b810ca90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f70a800b690 tx=0x7f70a8009e30 comp rx=0 tx=0).stop 2023-12-12T11:44:26.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:26.815+0000 7f70bd248700 1 -- 172.21.15.63:0/495281866 shutdown_connections 2023-12-12T11:44:26.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:26.815+0000 7f70bd248700 1 --2- 172.21.15.63:0/495281866 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f70a00366d0 0x7f70a0038b80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:26.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:26.815+0000 7f70bd248700 1 --2- 172.21.15.63:0/495281866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70b80fc870 0x7f70b810ca90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:26.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:26.815+0000 7f70bd248700 1 -- 172.21.15.63:0/495281866 >> 172.21.15.63:0/495281866 conn(0x7f70b80f7f50 msgr2=0x7f70b80f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:26.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:26.815+0000 7f70bd248700 1 -- 172.21.15.63:0/495281866 shutdown_connections 2023-12-12T11:44:26.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:26.815+0000 7f70bd248700 1 -- 172.21.15.63:0/495281866 wait complete. 2023-12-12T11:44:27.209 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph orch host ls --format=json 2023-12-12T11:44:27.651 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:44:27.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:27 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:27.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:27 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:27.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:27 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:27.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:27 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:27.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:27 smithi063 ceph-mon[107117]: Deploying daemon alertmanager.smithi063 on smithi063 2023-12-12T11:44:27.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:27 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:27.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:27 smithi063 ceph-mon[107117]: Added host smithi093 2023-12-12T11:44:30.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:29 smithi063 ceph-mon[107117]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:44:30.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:29 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:30.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.258+0000 7f6068d96700 1 -- 172.21.15.63:0/2177470142 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60640fc870 msgr2=0x7f60640fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:30.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.258+0000 7f6068d96700 1 --2- 172.21.15.63:0/2177470142 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60640fc870 0x7f60640fcc80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f60540048c0 tx=0x7f6054009e30 comp rx=0 tx=0).stop 2023-12-12T11:44:30.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.258+0000 7f6068d96700 1 -- 172.21.15.63:0/2177470142 shutdown_connections 2023-12-12T11:44:30.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.258+0000 7f6068d96700 1 --2- 172.21.15.63:0/2177470142 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60640fc870 0x7f60640fcc80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:30.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.258+0000 7f6068d96700 1 -- 172.21.15.63:0/2177470142 >> 172.21.15.63:0/2177470142 conn(0x7f60640f7f50 msgr2=0x7f60640fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:30.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.258+0000 7f6068d96700 1 -- 172.21.15.63:0/2177470142 shutdown_connections 2023-12-12T11:44:30.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.258+0000 7f6068d96700 1 -- 172.21.15.63:0/2177470142 wait complete. 2023-12-12T11:44:30.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.259+0000 7f6068d96700 1 Processor -- start 2023-12-12T11:44:30.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.259+0000 7f6068d96700 1 -- start start 2023-12-12T11:44:30.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.259+0000 7f6068d96700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60640fc870 0x7f606410ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:30.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.259+0000 7f6068d96700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606410f280 con 0x7f60640fc870 2023-12-12T11:44:30.262 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.260+0000 7f606259c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60640fc870 0x7f606410ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:30.262 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.260+0000 7f606259c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60640fc870 0x7f606410ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51312/0 (socket says 172.21.15.63:51312) 2023-12-12T11:44:30.262 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.260+0000 7f606259c700 1 -- 172.21.15.63:0/1893854933 learned_addr learned my addr 172.21.15.63:0/1893854933 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:44:30.262 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.260+0000 7f606259c700 1 -- 172.21.15.63:0/1893854933 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6054005040 con 0x7f60640fc870 2023-12-12T11:44:30.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.260+0000 7f606259c700 1 --2- 172.21.15.63:0/1893854933 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60640fc870 0x7f606410ed40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f605400b690 tx=0x7f6054009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:30.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.260+0000 7f6052ffd700 1 -- 172.21.15.63:0/1893854933 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6054009650 con 0x7f60640fc870 2023-12-12T11:44:30.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.260+0000 7f6052ffd700 1 -- 172.21.15.63:0/1893854933 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f60540097b0 con 0x7f60640fc870 2023-12-12T11:44:30.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.260+0000 7f6068d96700 1 -- 172.21.15.63:0/1893854933 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f606410f480 con 0x7f60640fc870 2023-12-12T11:44:30.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.260+0000 7f6052ffd700 1 -- 172.21.15.63:0/1893854933 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f605401c5d0 con 0x7f60640fc870 2023-12-12T11:44:30.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.261+0000 7f6068d96700 1 -- 172.21.15.63:0/1893854933 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f606410ffe0 con 0x7f60640fc870 2023-12-12T11:44:30.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.262+0000 7f6068d96700 1 -- 172.21.15.63:0/1893854933 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f606405f270 con 0x7f60640fc870 2023-12-12T11:44:30.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.262+0000 7f6052ffd700 1 -- 172.21.15.63:0/1893854933 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f60540139d0 con 0x7f60640fc870 2023-12-12T11:44:30.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.262+0000 7f6052ffd700 1 --2- 172.21.15.63:0/1893854933 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f604c036720 0x7f604c038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:30.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.262+0000 7f6052ffd700 1 -- 172.21.15.63:0/1893854933 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f60540499a0 con 0x7f60640fc870 2023-12-12T11:44:30.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.262+0000 7f6061d9b700 1 --2- 172.21.15.63:0/1893854933 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f604c036720 0x7f604c038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:30.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.263+0000 7f6061d9b700 1 --2- 172.21.15.63:0/1893854933 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f604c036720 0x7f604c038bd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6058009990 tx=0x7f6058006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:30.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.267+0000 7f6052ffd700 1 -- 172.21.15.63:0/1893854933 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6054025400 con 0x7f60640fc870 2023-12-12T11:44:30.483 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.481+0000 7f6068d96700 1 -- 172.21.15.63:0/1893854933 --> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6064110c40 con 0x7f604c036720 2023-12-12T11:44:30.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.483+0000 7f6052ffd700 1 -- 172.21.15.63:0/1893854933 <== mgr.14162 v2:172.21.15.63:6800/293571324 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+159 (secure 0 0 0) 0x7f6064110c40 con 0x7f604c036720 2023-12-12T11:44:30.485 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:44:30.485 INFO:teuthology.orchestra.run.smithi063.stdout:[{"addr": "172.21.15.63", "hostname": "smithi063", "labels": [], "status": ""}, {"addr": "172.21.15.93", "hostname": "smithi093", "labels": [], "status": ""}] 2023-12-12T11:44:30.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.485+0000 7f6068d96700 1 -- 172.21.15.63:0/1893854933 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f604c036720 msgr2=0x7f604c038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:30.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.485+0000 7f6068d96700 1 --2- 172.21.15.63:0/1893854933 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f604c036720 0x7f604c038bd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6058009990 tx=0x7f6058006e40 comp rx=0 tx=0).stop 2023-12-12T11:44:30.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.485+0000 7f6068d96700 1 -- 172.21.15.63:0/1893854933 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60640fc870 msgr2=0x7f606410ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:30.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.485+0000 7f6068d96700 1 --2- 172.21.15.63:0/1893854933 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60640fc870 0x7f606410ed40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f605400b690 tx=0x7f6054009e30 comp rx=0 tx=0).stop 2023-12-12T11:44:30.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.485+0000 7f6068d96700 1 -- 172.21.15.63:0/1893854933 shutdown_connections 2023-12-12T11:44:30.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.485+0000 7f6068d96700 1 --2- 172.21.15.63:0/1893854933 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f604c036720 0x7f604c038bd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:30.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.485+0000 7f6068d96700 1 --2- 172.21.15.63:0/1893854933 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60640fc870 0x7f606410ed40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:30.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.485+0000 7f6068d96700 1 -- 172.21.15.63:0/1893854933 >> 172.21.15.63:0/1893854933 conn(0x7f60640f7f50 msgr2=0x7f60640f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:30.488 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.485+0000 7f6068d96700 1 -- 172.21.15.63:0/1893854933 shutdown_connections 2023-12-12T11:44:30.488 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:30.485+0000 7f6068d96700 1 -- 172.21.15.63:0/1893854933 wait complete. 2023-12-12T11:44:30.923 INFO:tasks.cephadm:Setting crush tunables to default 2023-12-12T11:44:30.923 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph osd crush tunables default 2023-12-12T11:44:31.624 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:44:32.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:31 smithi063 ceph-mon[107117]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-12T11:44:32.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:31 smithi063 ceph-mon[107117]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:44:33.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:33.473+0000 7f73aa45c700 1 -- 172.21.15.63:0/4269342831 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73a40fc870 msgr2=0x7f73a40fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:33.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:33.473+0000 7f73aa45c700 1 --2- 172.21.15.63:0/4269342831 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73a40fc870 0x7f73a40fcc80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f73940048c0 tx=0x7f7394009e30 comp rx=0 tx=0).stop 2023-12-12T11:44:33.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:33.473+0000 7f73aa45c700 1 -- 172.21.15.63:0/4269342831 shutdown_connections 2023-12-12T11:44:33.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:33.473+0000 7f73aa45c700 1 --2- 172.21.15.63:0/4269342831 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73a40fc870 0x7f73a40fcc80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:33.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:33.473+0000 7f73aa45c700 1 -- 172.21.15.63:0/4269342831 >> 172.21.15.63:0/4269342831 conn(0x7f73a40f7f50 msgr2=0x7f73a40fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:33.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:33.473+0000 7f73aa45c700 1 -- 172.21.15.63:0/4269342831 shutdown_connections 2023-12-12T11:44:33.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:33.473+0000 7f73aa45c700 1 -- 172.21.15.63:0/4269342831 wait complete. 2023-12-12T11:44:33.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:33.474+0000 7f73aa45c700 1 Processor -- start 2023-12-12T11:44:33.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:33.474+0000 7f73aa45c700 1 -- start start 2023-12-12T11:44:33.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:33.475+0000 7f73aa45c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73a40fc870 0x7f73a4071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:33.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:33.475+0000 7f73aa45c700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a406ff90 con 0x7f73a40fc870 2023-12-12T11:44:33.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:33.475+0000 7f73a3fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73a40fc870 0x7f73a4071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:33.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:33.475+0000 7f73a3fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73a40fc870 0x7f73a4071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51328/0 (socket says 172.21.15.63:51328) 2023-12-12T11:44:33.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:33.475+0000 7f73a3fff700 1 -- 172.21.15.63:0/240505998 learned_addr learned my addr 172.21.15.63:0/240505998 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:44:33.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:33.475+0000 7f73a3fff700 1 -- 172.21.15.63:0/240505998 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7394005040 con 0x7f73a40fc870 2023-12-12T11:44:33.478 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:33.475+0000 7f73a3fff700 1 --2- 172.21.15.63:0/240505998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73a40fc870 0x7f73a4071b10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f739400b690 tx=0x7f7394009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:33.478 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:33.476+0000 7f73a0ff9700 1 -- 172.21.15.63:0/240505998 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7394009650 con 0x7f73a40fc870 2023-12-12T11:44:33.478 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:33.476+0000 7f73a0ff9700 1 -- 172.21.15.63:0/240505998 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f73940097b0 con 0x7f73a40fc870 2023-12-12T11:44:33.478 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:33.476+0000 7f73a0ff9700 1 -- 172.21.15.63:0/240505998 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f739401c5d0 con 0x7f73a40fc870 2023-12-12T11:44:33.478 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:33.476+0000 7f73aa45c700 1 -- 172.21.15.63:0/240505998 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a4070190 con 0x7f73a40fc870 2023-12-12T11:44:33.478 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:33.476+0000 7f73aa45c700 1 -- 172.21.15.63:0/240505998 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a4070680 con 0x7f73a40fc870 2023-12-12T11:44:33.478 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:33.477+0000 7f73aa45c700 1 -- 172.21.15.63:0/240505998 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73a4106500 con 0x7f73a40fc870 2023-12-12T11:44:33.478 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:33.477+0000 7f73a0ff9700 1 -- 172.21.15.63:0/240505998 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f73940139d0 con 0x7f73a40fc870 2023-12-12T11:44:33.479 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:33.478+0000 7f73a0ff9700 1 --2- 172.21.15.63:0/240505998 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f738c036720 0x7f738c038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:33.479 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:33.478+0000 7f73a0ff9700 1 -- 172.21.15.63:0/240505998 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f73940499a0 con 0x7f73a40fc870 2023-12-12T11:44:33.479 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:33.478+0000 7f73a37fe700 1 --2- 172.21.15.63:0/240505998 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f738c036720 0x7f738c038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:33.480 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:33.479+0000 7f73a37fe700 1 --2- 172.21.15.63:0/240505998 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f738c036720 0x7f738c038bd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7398009990 tx=0x7f7398006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:33.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:33.483+0000 7f73a0ff9700 1 -- 172.21.15.63:0/240505998 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7394025400 con 0x7f73a40fc870 2023-12-12T11:44:33.710 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:33.708+0000 7f73aa45c700 1 -- 172.21.15.63:0/240505998 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f73a405f270 con 0x7f73a40fc870 2023-12-12T11:44:34.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:33 smithi063 ceph-mon[107117]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:44:34.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:33 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:34.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:33 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:34.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:33 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:34.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:33 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:34.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:33 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:34.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:33 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:34.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:33 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-12T11:44:34.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:33 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:34.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:33 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/240505998' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-12-12T11:44:34.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:33 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:34.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:34.554+0000 7f73a0ff9700 1 -- 172.21.15.63:0/240505998 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f7394011b60 con 0x7f73a40fc870 2023-12-12T11:44:34.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:34.556+0000 7f73aa45c700 1 -- 172.21.15.63:0/240505998 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f738c036720 msgr2=0x7f738c038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:34.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:34.556+0000 7f73aa45c700 1 --2- 172.21.15.63:0/240505998 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f738c036720 0x7f738c038bd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7398009990 tx=0x7f7398006e40 comp rx=0 tx=0).stop 2023-12-12T11:44:34.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:34.556+0000 7f73aa45c700 1 -- 172.21.15.63:0/240505998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73a40fc870 msgr2=0x7f73a4071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:34.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:34.556+0000 7f73aa45c700 1 --2- 172.21.15.63:0/240505998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73a40fc870 0x7f73a4071b10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f739400b690 tx=0x7f7394009e30 comp rx=0 tx=0).stop 2023-12-12T11:44:34.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:34.556+0000 7f73aa45c700 1 -- 172.21.15.63:0/240505998 shutdown_connections 2023-12-12T11:44:34.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:34.556+0000 7f73aa45c700 1 --2- 172.21.15.63:0/240505998 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f738c036720 0x7f738c038bd0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:34.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:34.556+0000 7f73aa45c700 1 --2- 172.21.15.63:0/240505998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73a40fc870 0x7f73a4071b10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:34.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:34.556+0000 7f73aa45c700 1 -- 172.21.15.63:0/240505998 >> 172.21.15.63:0/240505998 conn(0x7f73a40f7f50 msgr2=0x7f73a40f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:34.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:34.557+0000 7f73aa45c700 1 -- 172.21.15.63:0/240505998 shutdown_connections 2023-12-12T11:44:34.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:44:34.557+0000 7f73aa45c700 1 -- 172.21.15.63:0/240505998 wait complete. 2023-12-12T11:44:34.560 INFO:teuthology.orchestra.run.smithi063.stderr:adjusted tunables profile to default 2023-12-12T11:44:34.911 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:34 smithi063 ceph-mon[107117]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-12T11:44:34.911 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:34 smithi063 ceph-mon[107117]: Deploying daemon grafana.smithi063 on smithi063 2023-12-12T11:44:34.911 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:34 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/240505998' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-12T11:44:34.911 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:34 smithi063 ceph-mon[107117]: osdmap e4: 0 total, 0 up, 0 in 2023-12-12T11:44:34.938 INFO:tasks.cephadm:Adding mon.smithi063 on smithi063 2023-12-12T11:44:34.938 INFO:tasks.cephadm:Adding mon.smithi093 on smithi093 2023-12-12T11:44:34.939 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph orch apply mon '2;smithi063:172.21.15.63=smithi063;smithi093:172.21.15.93=smithi093' 2023-12-12T11:44:35.343 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-12T11:44:35.434 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-12T11:44:36.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:35 smithi063 ceph-mon[107117]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:44:36.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:36.783+0000 7fe35cc3f700 1 -- 172.21.15.93:0/870328947 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe358071b60 msgr2=0x7fe35806ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:36.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:36.783+0000 7fe35cc3f700 1 --2- 172.21.15.93:0/870328947 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe358071b60 0x7fe35806ffd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe3480048c0 tx=0x7fe348009e30 comp rx=0 tx=0).stop 2023-12-12T11:44:36.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:36.783+0000 7fe35cc3f700 1 -- 172.21.15.93:0/870328947 shutdown_connections 2023-12-12T11:44:36.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:36.783+0000 7fe35cc3f700 1 --2- 172.21.15.93:0/870328947 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe358071b60 0x7fe35806ffd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:36.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:36.783+0000 7fe35cc3f700 1 -- 172.21.15.93:0/870328947 >> 172.21.15.93:0/870328947 conn(0x7fe3580f7d70 msgr2=0x7fe3580fa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:36.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:36.783+0000 7fe35cc3f700 1 -- 172.21.15.93:0/870328947 shutdown_connections 2023-12-12T11:44:36.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:36.783+0000 7fe35cc3f700 1 -- 172.21.15.93:0/870328947 wait complete. 2023-12-12T11:44:36.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:36.784+0000 7fe35cc3f700 1 Processor -- start 2023-12-12T11:44:36.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:36.784+0000 7fe35cc3f700 1 -- start start 2023-12-12T11:44:36.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:36.784+0000 7fe35cc3f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe358071b60 0x7fe35810ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:36.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:36.784+0000 7fe35cc3f700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35810efc0 con 0x7fe358071b60 2023-12-12T11:44:36.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:36.785+0000 7fe3577fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe358071b60 0x7fe35810ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:36.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:36.785+0000 7fe3577fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe358071b60 0x7fe35810ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.93:55370/0 (socket says 172.21.15.93:55370) 2023-12-12T11:44:36.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:36.785+0000 7fe3577fe700 1 -- 172.21.15.93:0/1268582618 learned_addr learned my addr 172.21.15.93:0/1268582618 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-12-12T11:44:36.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:36.785+0000 7fe3577fe700 1 -- 172.21.15.93:0/1268582618 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe348005040 con 0x7fe358071b60 2023-12-12T11:44:36.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:36.785+0000 7fe3577fe700 1 --2- 172.21.15.93:0/1268582618 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe358071b60 0x7fe35810ea80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe348009040 tx=0x7fe348009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:36.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:36.786+0000 7fe33ffff700 1 -- 172.21.15.93:0/1268582618 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe348009620 con 0x7fe358071b60 2023-12-12T11:44:36.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:36.786+0000 7fe35cc3f700 1 -- 172.21.15.93:0/1268582618 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe35810f1c0 con 0x7fe358071b60 2023-12-12T11:44:36.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:36.786+0000 7fe33ffff700 1 -- 172.21.15.93:0/1268582618 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe348009780 con 0x7fe358071b60 2023-12-12T11:44:36.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:36.786+0000 7fe33ffff700 1 -- 172.21.15.93:0/1268582618 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe34801c5b0 con 0x7fe358071b60 2023-12-12T11:44:36.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:36.786+0000 7fe35cc3f700 1 -- 172.21.15.93:0/1268582618 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe35810fe60 con 0x7fe358071b60 2023-12-12T11:44:36.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:36.787+0000 7fe35cc3f700 1 -- 172.21.15.93:0/1268582618 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe35805f270 con 0x7fe358071b60 2023-12-12T11:44:36.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:36.787+0000 7fe33ffff700 1 -- 172.21.15.93:0/1268582618 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fe348013420 con 0x7fe358071b60 2023-12-12T11:44:36.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:36.787+0000 7fe33ffff700 1 --2- 172.21.15.93:0/1268582618 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fe3400366d0 0x7fe340038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:36.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:36.787+0000 7fe33ffff700 1 -- 172.21.15.93:0/1268582618 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe3480498e0 con 0x7fe358071b60 2023-12-12T11:44:36.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:36.788+0000 7fe356ffd700 1 --2- 172.21.15.93:0/1268582618 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fe3400366d0 0x7fe340038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:36.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:36.788+0000 7fe356ffd700 1 --2- 172.21.15.93:0/1268582618 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fe3400366d0 0x7fe340038b80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe34c009990 tx=0x7fe34c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:36.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:36.793+0000 7fe33ffff700 1 -- 172.21.15.93:0/1268582618 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe348011370 con 0x7fe358071b60 2023-12-12T11:44:36.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:36.991+0000 7fe35cc3f700 1 -- 172.21.15.93:0/1268582618 --> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi063:172.21.15.63=smithi063;smithi093:172.21.15.93=smithi093", "target": ["mon-mgr", ""]}) v1 -- 0x7fe358110a20 con 0x7fe3400366d0 2023-12-12T11:44:37.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:36.998+0000 7fe33ffff700 1 -- 172.21.15.93:0/1268582618 <== mgr.14162 v2:172.21.15.63:6800/293571324 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fe358110a20 con 0x7fe3400366d0 2023-12-12T11:44:37.000 INFO:teuthology.orchestra.run.smithi093.stdout:Scheduled mon update... 2023-12-12T11:44:37.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:37.000+0000 7fe35cc3f700 1 -- 172.21.15.93:0/1268582618 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fe3400366d0 msgr2=0x7fe340038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:37.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:37.000+0000 7fe35cc3f700 1 --2- 172.21.15.93:0/1268582618 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fe3400366d0 0x7fe340038b80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe34c009990 tx=0x7fe34c006e40 comp rx=0 tx=0).stop 2023-12-12T11:44:37.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:37.000+0000 7fe35cc3f700 1 -- 172.21.15.93:0/1268582618 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe358071b60 msgr2=0x7fe35810ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:37.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:37.000+0000 7fe35cc3f700 1 --2- 172.21.15.93:0/1268582618 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe358071b60 0x7fe35810ea80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe348009040 tx=0x7fe348009e30 comp rx=0 tx=0).stop 2023-12-12T11:44:37.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:37.000+0000 7fe35cc3f700 1 -- 172.21.15.93:0/1268582618 shutdown_connections 2023-12-12T11:44:37.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:37.000+0000 7fe35cc3f700 1 --2- 172.21.15.93:0/1268582618 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fe3400366d0 0x7fe340038b80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:37.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:37.000+0000 7fe35cc3f700 1 --2- 172.21.15.93:0/1268582618 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe358071b60 0x7fe35810ea80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:37.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:37.000+0000 7fe35cc3f700 1 -- 172.21.15.93:0/1268582618 >> 172.21.15.93:0/1268582618 conn(0x7fe3580f7d70 msgr2=0x7fe3580f8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:37.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:37.000+0000 7fe35cc3f700 1 -- 172.21.15.93:0/1268582618 shutdown_connections 2023-12-12T11:44:37.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:37.001+0000 7fe35cc3f700 1 -- 172.21.15.93:0/1268582618 wait complete. 2023-12-12T11:44:37.386 DEBUG:teuthology.orchestra.run.smithi093:mon.smithi093> sudo journalctl -f -n 0 -u ceph-85e33c70-98e3-11ee-95a3-87774f69a715@mon.smithi093.service 2023-12-12T11:44:37.390 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-12T11:44:37.391 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-12T11:44:37.462 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:-- Logs begin at Tue 2023-12-12 11:24:57 UTC. -- 2023-12-12T11:44:37.823 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-12T11:44:37.910 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-12T11:44:38.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:37 smithi063 ceph-mon[107117]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:44:38.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:37 smithi063 ceph-mon[107117]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi063:172.21.15.63=smithi063;smithi093:172.21.15.93=smithi093", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:44:38.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:37 smithi063 ceph-mon[107117]: Saving service mon spec with placement smithi063:172.21.15.63=smithi063;smithi093:172.21.15.93=smithi093;count:2 2023-12-12T11:44:38.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:37 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:38.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:38.904+0000 7ffa051c1700 1 -- 172.21.15.93:0/663362942 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa000fc870 msgr2=0x7ffa000fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:38.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:38.904+0000 7ffa051c1700 1 --2- 172.21.15.93:0/663362942 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa000fc870 0x7ffa000fcc80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff9f00048c0 tx=0x7ff9f0009e30 comp rx=0 tx=0).stop 2023-12-12T11:44:38.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:38.904+0000 7ffa051c1700 1 -- 172.21.15.93:0/663362942 shutdown_connections 2023-12-12T11:44:38.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:38.904+0000 7ffa051c1700 1 --2- 172.21.15.93:0/663362942 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa000fc870 0x7ffa000fcc80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:38.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:38.904+0000 7ffa051c1700 1 -- 172.21.15.93:0/663362942 >> 172.21.15.93:0/663362942 conn(0x7ffa000f7f50 msgr2=0x7ffa000fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:38.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:38.904+0000 7ffa051c1700 1 -- 172.21.15.93:0/663362942 shutdown_connections 2023-12-12T11:44:38.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:38.905+0000 7ffa051c1700 1 -- 172.21.15.93:0/663362942 wait complete. 2023-12-12T11:44:38.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:38.905+0000 7ffa051c1700 1 Processor -- start 2023-12-12T11:44:38.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:38.905+0000 7ffa051c1700 1 -- start start 2023-12-12T11:44:38.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:38.906+0000 7ffa051c1700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa000fc870 0x7ffa0010ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:38.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:38.906+0000 7ffa051c1700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0010cfd0 con 0x7ffa000fc870 2023-12-12T11:44:38.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:38.906+0000 7ff9fed9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa000fc870 0x7ffa0010ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:38.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:38.906+0000 7ff9fed9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa000fc870 0x7ffa0010ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.93:55384/0 (socket says 172.21.15.93:55384) 2023-12-12T11:44:38.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:38.906+0000 7ff9fed9d700 1 -- 172.21.15.93:0/4174022373 learned_addr learned my addr 172.21.15.93:0/4174022373 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-12-12T11:44:38.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:38.906+0000 7ff9fed9d700 1 -- 172.21.15.93:0/4174022373 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f0005040 con 0x7ffa000fc870 2023-12-12T11:44:38.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:38.907+0000 7ff9fed9d700 1 --2- 172.21.15.93:0/4174022373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa000fc870 0x7ffa0010ca90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff9f000b690 tx=0x7ff9f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:38.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:38.907+0000 7ff9e77fe700 1 -- 172.21.15.93:0/4174022373 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9f0009650 con 0x7ffa000fc870 2023-12-12T11:44:38.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:38.907+0000 7ffa051c1700 1 -- 172.21.15.93:0/4174022373 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa0010d1d0 con 0x7ffa000fc870 2023-12-12T11:44:38.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:38.907+0000 7ff9e77fe700 1 -- 172.21.15.93:0/4174022373 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff9f00097b0 con 0x7ffa000fc870 2023-12-12T11:44:38.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:38.907+0000 7ff9e77fe700 1 -- 172.21.15.93:0/4174022373 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9f001c5d0 con 0x7ffa000fc870 2023-12-12T11:44:38.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:38.907+0000 7ffa051c1700 1 -- 172.21.15.93:0/4174022373 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa0010de70 con 0x7ffa000fc870 2023-12-12T11:44:38.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:38.908+0000 7ff9e77fe700 1 -- 172.21.15.93:0/4174022373 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7ff9f00139d0 con 0x7ffa000fc870 2023-12-12T11:44:38.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:38.908+0000 7ffa051c1700 1 -- 172.21.15.93:0/4174022373 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa0005f270 con 0x7ffa000fc870 2023-12-12T11:44:38.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:38.908+0000 7ff9e77fe700 1 --2- 172.21.15.93:0/4174022373 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7ff9e8036770 0x7ff9e8038c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:38.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:38.908+0000 7ff9e77fe700 1 -- 172.21.15.93:0/4174022373 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff9f00499e0 con 0x7ffa000fc870 2023-12-12T11:44:38.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:38.909+0000 7ff9fe59c700 1 --2- 172.21.15.93:0/4174022373 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7ff9e8036770 0x7ff9e8038c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:38.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:38.909+0000 7ff9fe59c700 1 --2- 172.21.15.93:0/4174022373 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7ff9e8036770 0x7ff9e8038c20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4009990 tx=0x7ff9f4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:38.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:38.914+0000 7ff9e77fe700 1 -- 172.21.15.93:0/4174022373 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff9f0023300 con 0x7ffa000fc870 2023-12-12T11:44:39.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:39.177+0000 7ffa051c1700 1 -- 172.21.15.93:0/4174022373 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ffa0010e9c0 con 0x7ffa000fc870 2023-12-12T11:44:39.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:39.178+0000 7ff9e77fe700 1 -- 172.21.15.93:0/4174022373 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7ff9f0011b60 con 0x7ffa000fc870 2023-12-12T11:44:39.180 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:44:39.180 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":1,"fsid":"85e33c70-98e3-11ee-95a3-87774f69a715","modified":"2023-12-12T11:43:03.786943Z","created":"2023-12-12T11:43:03.786943Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-12T11:44:39.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:39.180+0000 7ffa051c1700 1 -- 172.21.15.93:0/4174022373 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7ff9e8036770 msgr2=0x7ff9e8038c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:39.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:39.180+0000 7ffa051c1700 1 --2- 172.21.15.93:0/4174022373 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7ff9e8036770 0x7ff9e8038c20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4009990 tx=0x7ff9f4006e40 comp rx=0 tx=0).stop 2023-12-12T11:44:39.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:39.180+0000 7ffa051c1700 1 -- 172.21.15.93:0/4174022373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa000fc870 msgr2=0x7ffa0010ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:39.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:39.180+0000 7ffa051c1700 1 --2- 172.21.15.93:0/4174022373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa000fc870 0x7ffa0010ca90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff9f000b690 tx=0x7ff9f0009e30 comp rx=0 tx=0).stop 2023-12-12T11:44:39.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:39.180+0000 7ffa051c1700 1 -- 172.21.15.93:0/4174022373 shutdown_connections 2023-12-12T11:44:39.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:39.180+0000 7ffa051c1700 1 --2- 172.21.15.93:0/4174022373 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7ff9e8036770 0x7ff9e8038c20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:39.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:39.180+0000 7ffa051c1700 1 --2- 172.21.15.93:0/4174022373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa000fc870 0x7ffa0010ca90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:39.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:39.180+0000 7ffa051c1700 1 -- 172.21.15.93:0/4174022373 >> 172.21.15.93:0/4174022373 conn(0x7ffa000f7f50 msgr2=0x7ffa000f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:39.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:39.180+0000 7ffa051c1700 1 -- 172.21.15.93:0/4174022373 shutdown_connections 2023-12-12T11:44:39.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:39.180+0000 7ffa051c1700 1 -- 172.21.15.93:0/4174022373 wait complete. 2023-12-12T11:44:39.183 INFO:teuthology.orchestra.run.smithi093.stderr:dumped monmap epoch 1 2023-12-12T11:44:40.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:39 smithi063 ceph-mon[107117]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:44:40.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:39 smithi063 ceph-mon[107117]: from='client.? 172.21.15.93:0/4174022373' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:44:40.562 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-12T11:44:40.562 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-12T11:44:40.976 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-12T11:44:41.063 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-12T11:44:42.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.101+0000 7f9b7577d700 1 -- 172.21.15.93:0/1357911900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b700fc6b0 msgr2=0x7f9b700fcac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:42.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.101+0000 7f9b7577d700 1 --2- 172.21.15.93:0/1357911900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b700fc6b0 0x7f9b700fcac0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9b600048c0 tx=0x7f9b60009e30 comp rx=0 tx=0).stop 2023-12-12T11:44:42.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.101+0000 7f9b7577d700 1 -- 172.21.15.93:0/1357911900 shutdown_connections 2023-12-12T11:44:42.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.101+0000 7f9b7577d700 1 --2- 172.21.15.93:0/1357911900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b700fc6b0 0x7f9b700fcac0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:42.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.101+0000 7f9b7577d700 1 -- 172.21.15.93:0/1357911900 >> 172.21.15.93:0/1357911900 conn(0x7f9b700f7d70 msgr2=0x7f9b700fa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:42.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.101+0000 7f9b7577d700 1 -- 172.21.15.93:0/1357911900 shutdown_connections 2023-12-12T11:44:42.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.101+0000 7f9b7577d700 1 -- 172.21.15.93:0/1357911900 wait complete. 2023-12-12T11:44:42.105 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.102+0000 7f9b7577d700 1 Processor -- start 2023-12-12T11:44:42.105 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.102+0000 7f9b7577d700 1 -- start start 2023-12-12T11:44:42.105 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.103+0000 7f9b7577d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b700fc6b0 0x7f9b7010eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:42.106 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.103+0000 7f9b7577d700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7010f040 con 0x7f9b700fc6b0 2023-12-12T11:44:42.106 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.103+0000 7f9b6ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b700fc6b0 0x7f9b7010eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:42.106 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.103+0000 7f9b6ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b700fc6b0 0x7f9b7010eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.93:55408/0 (socket says 172.21.15.93:55408) 2023-12-12T11:44:42.106 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.103+0000 7f9b6ffff700 1 -- 172.21.15.93:0/2578610525 learned_addr learned my addr 172.21.15.93:0/2578610525 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-12-12T11:44:42.106 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.103+0000 7f9b6ffff700 1 -- 172.21.15.93:0/2578610525 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b60005040 con 0x7f9b700fc6b0 2023-12-12T11:44:42.106 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.103+0000 7f9b6ffff700 1 --2- 172.21.15.93:0/2578610525 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b700fc6b0 0x7f9b7010eb00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9b6000b690 tx=0x7f9b60009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:42.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.104+0000 7f9b6cff9700 1 -- 172.21.15.93:0/2578610525 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b60009650 con 0x7f9b700fc6b0 2023-12-12T11:44:42.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.104+0000 7f9b7577d700 1 -- 172.21.15.93:0/2578610525 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b7010f240 con 0x7f9b700fc6b0 2023-12-12T11:44:42.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.104+0000 7f9b6cff9700 1 -- 172.21.15.93:0/2578610525 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9b600097b0 con 0x7f9b700fc6b0 2023-12-12T11:44:42.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.104+0000 7f9b6cff9700 1 -- 172.21.15.93:0/2578610525 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b6001c5d0 con 0x7f9b700fc6b0 2023-12-12T11:44:42.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.104+0000 7f9b7577d700 1 -- 172.21.15.93:0/2578610525 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b7010fee0 con 0x7f9b700fc6b0 2023-12-12T11:44:42.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.105+0000 7f9b6cff9700 1 -- 172.21.15.93:0/2578610525 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f9b60013420 con 0x7f9b700fc6b0 2023-12-12T11:44:42.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.105+0000 7f9b7577d700 1 -- 172.21.15.93:0/2578610525 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b7005f270 con 0x7f9b700fc6b0 2023-12-12T11:44:42.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.105+0000 7f9b6cff9700 1 --2- 172.21.15.93:0/2578610525 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f9b580366d0 0x7f9b58038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:42.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.105+0000 7f9b6cff9700 1 -- 172.21.15.93:0/2578610525 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f9b60049a20 con 0x7f9b700fc6b0 2023-12-12T11:44:42.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.106+0000 7f9b6f7fe700 1 --2- 172.21.15.93:0/2578610525 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f9b580366d0 0x7f9b58038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:42.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.106+0000 7f9b6f7fe700 1 --2- 172.21.15.93:0/2578610525 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f9b580366d0 0x7f9b58038b80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9b64009990 tx=0x7f9b64006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:42.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.112+0000 7f9b6cff9700 1 -- 172.21.15.93:0/2578610525 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9b60025400 con 0x7f9b700fc6b0 2023-12-12T11:44:42.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:42 smithi063 ceph-mon[107117]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:44:42.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.373+0000 7f9b7577d700 1 -- 172.21.15.93:0/2578610525 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9b70110a30 con 0x7f9b700fc6b0 2023-12-12T11:44:42.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.373+0000 7f9b6cff9700 1 -- 172.21.15.93:0/2578610525 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f9b60011370 con 0x7f9b700fc6b0 2023-12-12T11:44:42.376 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:44:42.376 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":1,"fsid":"85e33c70-98e3-11ee-95a3-87774f69a715","modified":"2023-12-12T11:43:03.786943Z","created":"2023-12-12T11:43:03.786943Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-12T11:44:42.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.376+0000 7f9b7577d700 1 -- 172.21.15.93:0/2578610525 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f9b580366d0 msgr2=0x7f9b58038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:42.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.376+0000 7f9b7577d700 1 --2- 172.21.15.93:0/2578610525 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f9b580366d0 0x7f9b58038b80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9b64009990 tx=0x7f9b64006e40 comp rx=0 tx=0).stop 2023-12-12T11:44:42.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.376+0000 7f9b7577d700 1 -- 172.21.15.93:0/2578610525 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b700fc6b0 msgr2=0x7f9b7010eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:42.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.376+0000 7f9b7577d700 1 --2- 172.21.15.93:0/2578610525 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b700fc6b0 0x7f9b7010eb00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9b6000b690 tx=0x7f9b60009e30 comp rx=0 tx=0).stop 2023-12-12T11:44:42.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.376+0000 7f9b7577d700 1 -- 172.21.15.93:0/2578610525 shutdown_connections 2023-12-12T11:44:42.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.376+0000 7f9b7577d700 1 --2- 172.21.15.93:0/2578610525 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f9b580366d0 0x7f9b58038b80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:42.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.376+0000 7f9b7577d700 1 --2- 172.21.15.93:0/2578610525 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b700fc6b0 0x7f9b7010eb00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:42.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.376+0000 7f9b7577d700 1 -- 172.21.15.93:0/2578610525 >> 172.21.15.93:0/2578610525 conn(0x7f9b700f7d70 msgr2=0x7f9b700f8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:42.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.376+0000 7f9b7577d700 1 -- 172.21.15.93:0/2578610525 shutdown_connections 2023-12-12T11:44:42.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:42.376+0000 7f9b7577d700 1 -- 172.21.15.93:0/2578610525 wait complete. 2023-12-12T11:44:42.379 INFO:teuthology.orchestra.run.smithi093.stderr:dumped monmap epoch 1 2023-12-12T11:44:43.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:43 smithi063 ceph-mon[107117]: from='client.? 172.21.15.93:0/2578610525' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:44:43.721 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-12T11:44:43.722 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-12T11:44:44.129 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-12T11:44:44.217 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-12T11:44:44.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:44 smithi063 ceph-mon[107117]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:44:45.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.468+0000 7f1bf3cc6700 1 -- 172.21.15.93:0/1304102755 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bec0fc870 msgr2=0x7f1bec0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:45.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.468+0000 7f1bf3cc6700 1 --2- 172.21.15.93:0/1304102755 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bec0fc870 0x7f1bec0fcc80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1be80048c0 tx=0x7f1be8009e30 comp rx=0 tx=0).stop 2023-12-12T11:44:45.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.468+0000 7f1bf3cc6700 1 -- 172.21.15.93:0/1304102755 shutdown_connections 2023-12-12T11:44:45.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.468+0000 7f1bf3cc6700 1 --2- 172.21.15.93:0/1304102755 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bec0fc870 0x7f1bec0fcc80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:45.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.468+0000 7f1bf3cc6700 1 -- 172.21.15.93:0/1304102755 >> 172.21.15.93:0/1304102755 conn(0x7f1bec0f7f50 msgr2=0x7f1bec0fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:45.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.468+0000 7f1bf3cc6700 1 -- 172.21.15.93:0/1304102755 shutdown_connections 2023-12-12T11:44:45.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.468+0000 7f1bf3cc6700 1 -- 172.21.15.93:0/1304102755 wait complete. 2023-12-12T11:44:45.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.469+0000 7f1bf3cc6700 1 Processor -- start 2023-12-12T11:44:45.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.469+0000 7f1bf3cc6700 1 -- start start 2023-12-12T11:44:45.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.469+0000 7f1bf3cc6700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bec0fc870 0x7f1bec10ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:45.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.469+0000 7f1bf3cc6700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec10f280 con 0x7f1bec0fc870 2023-12-12T11:44:45.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.470+0000 7f1bf1a62700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bec0fc870 0x7f1bec10ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:45.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.470+0000 7f1bf1a62700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bec0fc870 0x7f1bec10ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.93:55418/0 (socket says 172.21.15.93:55418) 2023-12-12T11:44:45.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.470+0000 7f1bf1a62700 1 -- 172.21.15.93:0/1693786867 learned_addr learned my addr 172.21.15.93:0/1693786867 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-12-12T11:44:45.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.470+0000 7f1bf1a62700 1 -- 172.21.15.93:0/1693786867 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be8005040 con 0x7f1bec0fc870 2023-12-12T11:44:45.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.470+0000 7f1bf1a62700 1 --2- 172.21.15.93:0/1693786867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bec0fc870 0x7f1bec10ed40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1be800b690 tx=0x7f1be8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:45.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.470+0000 7f1be27fc700 1 -- 172.21.15.93:0/1693786867 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1be8009650 con 0x7f1bec0fc870 2023-12-12T11:44:45.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.471+0000 7f1be27fc700 1 -- 172.21.15.93:0/1693786867 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1be80097b0 con 0x7f1bec0fc870 2023-12-12T11:44:45.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.471+0000 7f1be27fc700 1 -- 172.21.15.93:0/1693786867 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1be801c5d0 con 0x7f1bec0fc870 2023-12-12T11:44:45.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.471+0000 7f1bf3cc6700 1 -- 172.21.15.93:0/1693786867 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bec10f480 con 0x7f1bec0fc870 2023-12-12T11:44:45.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.471+0000 7f1bf3cc6700 1 -- 172.21.15.93:0/1693786867 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bec10ffe0 con 0x7f1bec0fc870 2023-12-12T11:44:45.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.472+0000 7f1be27fc700 1 -- 172.21.15.93:0/1693786867 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f1be80139d0 con 0x7f1bec0fc870 2023-12-12T11:44:45.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.472+0000 7f1bf3cc6700 1 -- 172.21.15.93:0/1693786867 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bec05f270 con 0x7f1bec0fc870 2023-12-12T11:44:45.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.472+0000 7f1be27fc700 1 --2- 172.21.15.93:0/1693786867 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f1bd8036720 0x7f1bd8038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:45.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.472+0000 7f1be27fc700 1 -- 172.21.15.93:0/1693786867 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f1be80499a0 con 0x7f1bec0fc870 2023-12-12T11:44:45.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.472+0000 7f1bf1261700 1 --2- 172.21.15.93:0/1693786867 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f1bd8036720 0x7f1bd8038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:45.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.473+0000 7f1bf1261700 1 --2- 172.21.15.93:0/1693786867 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f1bd8036720 0x7f1bd8038bd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc009990 tx=0x7f1bdc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:45.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.477+0000 7f1be27fc700 1 -- 172.21.15.93:0/1693786867 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1be8025400 con 0x7f1bec0fc870 2023-12-12T11:44:45.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.743+0000 7f1bf3cc6700 1 -- 172.21.15.93:0/1693786867 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1bec04bb80 con 0x7f1bec0fc870 2023-12-12T11:44:45.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.744+0000 7f1be27fc700 1 -- 172.21.15.93:0/1693786867 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f1be8011b60 con 0x7f1bec0fc870 2023-12-12T11:44:45.746 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:44:45.747 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":1,"fsid":"85e33c70-98e3-11ee-95a3-87774f69a715","modified":"2023-12-12T11:43:03.786943Z","created":"2023-12-12T11:43:03.786943Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-12T11:44:45.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.746+0000 7f1bf3cc6700 1 -- 172.21.15.93:0/1693786867 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f1bd8036720 msgr2=0x7f1bd8038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:45.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.746+0000 7f1bf3cc6700 1 --2- 172.21.15.93:0/1693786867 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f1bd8036720 0x7f1bd8038bd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc009990 tx=0x7f1bdc006e40 comp rx=0 tx=0).stop 2023-12-12T11:44:45.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.746+0000 7f1bf3cc6700 1 -- 172.21.15.93:0/1693786867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bec0fc870 msgr2=0x7f1bec10ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:45.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.746+0000 7f1bf3cc6700 1 --2- 172.21.15.93:0/1693786867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bec0fc870 0x7f1bec10ed40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1be800b690 tx=0x7f1be8009e30 comp rx=0 tx=0).stop 2023-12-12T11:44:45.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.746+0000 7f1bf3cc6700 1 -- 172.21.15.93:0/1693786867 shutdown_connections 2023-12-12T11:44:45.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.746+0000 7f1bf3cc6700 1 --2- 172.21.15.93:0/1693786867 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f1bd8036720 0x7f1bd8038bd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:45.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.746+0000 7f1bf3cc6700 1 --2- 172.21.15.93:0/1693786867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bec0fc870 0x7f1bec10ed40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:45.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.746+0000 7f1bf3cc6700 1 -- 172.21.15.93:0/1693786867 >> 172.21.15.93:0/1693786867 conn(0x7f1bec0f7f50 msgr2=0x7f1bec06fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:45.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.746+0000 7f1bf3cc6700 1 -- 172.21.15.93:0/1693786867 shutdown_connections 2023-12-12T11:44:45.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:45.746+0000 7f1bf3cc6700 1 -- 172.21.15.93:0/1693786867 wait complete. 2023-12-12T11:44:45.750 INFO:teuthology.orchestra.run.smithi093.stderr:dumped monmap epoch 1 2023-12-12T11:44:46.290 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:46 smithi063 ceph-mon[107117]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:44:46.290 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:46 smithi063 ceph-mon[107117]: from='client.? 172.21.15.93:0/1693786867' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:44:47.098 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-12T11:44:47.098 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-12T11:44:47.511 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-12T11:44:47.598 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-12T11:44:47.722 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:47 smithi063 ceph-mon[107117]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:44:48.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.675+0000 7f090bb1a700 1 -- 172.21.15.93:0/97754516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09040fc860 msgr2=0x7f09040fcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:48.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.675+0000 7f090bb1a700 1 --2- 172.21.15.93:0/97754516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09040fc860 0x7f09040fcc70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f09000048c0 tx=0x7f0900009e30 comp rx=0 tx=0).stop 2023-12-12T11:44:48.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.675+0000 7f090bb1a700 1 -- 172.21.15.93:0/97754516 shutdown_connections 2023-12-12T11:44:48.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.675+0000 7f090bb1a700 1 --2- 172.21.15.93:0/97754516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09040fc860 0x7f09040fcc70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:48.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.675+0000 7f090bb1a700 1 -- 172.21.15.93:0/97754516 >> 172.21.15.93:0/97754516 conn(0x7f09040f7fe0 msgr2=0x7f09040fa3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:48.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.675+0000 7f090bb1a700 1 -- 172.21.15.93:0/97754516 shutdown_connections 2023-12-12T11:44:48.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.675+0000 7f090bb1a700 1 -- 172.21.15.93:0/97754516 wait complete. 2023-12-12T11:44:48.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.676+0000 7f090bb1a700 1 Processor -- start 2023-12-12T11:44:48.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.676+0000 7f090bb1a700 1 -- start start 2023-12-12T11:44:48.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.676+0000 7f090bb1a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09040fc860 0x7f090410ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:48.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.676+0000 7f090bb1a700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090410cfb0 con 0x7f09040fc860 2023-12-12T11:44:48.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.677+0000 7f09098b6700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09040fc860 0x7f090410ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:48.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.677+0000 7f09098b6700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09040fc860 0x7f090410ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.93:45052/0 (socket says 172.21.15.93:45052) 2023-12-12T11:44:48.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.677+0000 7f09098b6700 1 -- 172.21.15.93:0/52758524 learned_addr learned my addr 172.21.15.93:0/52758524 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-12-12T11:44:48.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.677+0000 7f09098b6700 1 -- 172.21.15.93:0/52758524 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0900005040 con 0x7f09040fc860 2023-12-12T11:44:48.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.677+0000 7f09098b6700 1 --2- 172.21.15.93:0/52758524 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09040fc860 0x7f090410ca70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0900009040 tx=0x7f0900009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:48.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.677+0000 7f08fa7fc700 1 -- 172.21.15.93:0/52758524 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0900009620 con 0x7f09040fc860 2023-12-12T11:44:48.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.677+0000 7f08fa7fc700 1 -- 172.21.15.93:0/52758524 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0900009780 con 0x7f09040fc860 2023-12-12T11:44:48.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.678+0000 7f090bb1a700 1 -- 172.21.15.93:0/52758524 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090410d1b0 con 0x7f09040fc860 2023-12-12T11:44:48.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.678+0000 7f08fa7fc700 1 -- 172.21.15.93:0/52758524 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f090001c5b0 con 0x7f09040fc860 2023-12-12T11:44:48.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.678+0000 7f090bb1a700 1 -- 172.21.15.93:0/52758524 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090410de50 con 0x7f09040fc860 2023-12-12T11:44:48.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.679+0000 7f08fa7fc700 1 -- 172.21.15.93:0/52758524 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f0900013a60 con 0x7f09040fc860 2023-12-12T11:44:48.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.679+0000 7f090bb1a700 1 -- 172.21.15.93:0/52758524 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f090405f270 con 0x7f09040fc860 2023-12-12T11:44:48.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.679+0000 7f08fa7fc700 1 --2- 172.21.15.93:0/52758524 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f08f0036720 0x7f08f0038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:48.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.679+0000 7f08fa7fc700 1 -- 172.21.15.93:0/52758524 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f0900049880 con 0x7f09040fc860 2023-12-12T11:44:48.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.679+0000 7f09090b5700 1 --2- 172.21.15.93:0/52758524 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f08f0036720 0x7f08f0038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:48.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.680+0000 7f09090b5700 1 --2- 172.21.15.93:0/52758524 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f08f0036720 0x7f08f0038bd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f08f4009990 tx=0x7f08f4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:48.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.685+0000 7f08fa7fc700 1 -- 172.21.15.93:0/52758524 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0900011dd0 con 0x7f09040fc860 2023-12-12T11:44:48.951 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.949+0000 7f090bb1a700 1 -- 172.21.15.93:0/52758524 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f090410e9a0 con 0x7f09040fc860 2023-12-12T11:44:48.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.950+0000 7f08fa7fc700 1 -- 172.21.15.93:0/52758524 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f0900011370 con 0x7f09040fc860 2023-12-12T11:44:48.952 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:44:48.952 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":1,"fsid":"85e33c70-98e3-11ee-95a3-87774f69a715","modified":"2023-12-12T11:43:03.786943Z","created":"2023-12-12T11:43:03.786943Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-12T11:44:48.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.952+0000 7f090bb1a700 1 -- 172.21.15.93:0/52758524 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f08f0036720 msgr2=0x7f08f0038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:48.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.952+0000 7f090bb1a700 1 --2- 172.21.15.93:0/52758524 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f08f0036720 0x7f08f0038bd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f08f4009990 tx=0x7f08f4006e40 comp rx=0 tx=0).stop 2023-12-12T11:44:48.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.952+0000 7f090bb1a700 1 -- 172.21.15.93:0/52758524 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09040fc860 msgr2=0x7f090410ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:48.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.952+0000 7f090bb1a700 1 --2- 172.21.15.93:0/52758524 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09040fc860 0x7f090410ca70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0900009040 tx=0x7f0900009e30 comp rx=0 tx=0).stop 2023-12-12T11:44:48.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.952+0000 7f090bb1a700 1 -- 172.21.15.93:0/52758524 shutdown_connections 2023-12-12T11:44:48.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.952+0000 7f090bb1a700 1 --2- 172.21.15.93:0/52758524 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f08f0036720 0x7f08f0038bd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:48.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.952+0000 7f090bb1a700 1 --2- 172.21.15.93:0/52758524 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09040fc860 0x7f090410ca70 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:48.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.952+0000 7f090bb1a700 1 -- 172.21.15.93:0/52758524 >> 172.21.15.93:0/52758524 conn(0x7f09040f7fe0 msgr2=0x7f09040f8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:48.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.953+0000 7f090bb1a700 1 -- 172.21.15.93:0/52758524 shutdown_connections 2023-12-12T11:44:48.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:48.953+0000 7f090bb1a700 1 -- 172.21.15.93:0/52758524 wait complete. 2023-12-12T11:44:48.956 INFO:teuthology.orchestra.run.smithi093.stderr:dumped monmap epoch 1 2023-12-12T11:44:49.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:48 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:49.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:48 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:49.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:48 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:49.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:48 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:49.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:48 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:49.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:48 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:49.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:48 smithi063 ceph-mon[107117]: Deploying daemon prometheus.smithi063 on smithi063 2023-12-12T11:44:49.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:48 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:50.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:49 smithi063 ceph-mon[107117]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:44:50.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:49 smithi063 ceph-mon[107117]: from='client.? 172.21.15.93:0/52758524' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:44:50.325 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-12T11:44:50.325 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-12T11:44:50.732 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-12T11:44:50.821 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-12T11:44:51.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:51.917+0000 7f728880c700 1 -- 172.21.15.93:0/3956339070 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72840fc870 msgr2=0x7f72840fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:51.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:51.917+0000 7f728880c700 1 --2- 172.21.15.93:0/3956339070 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72840fc870 0x7f72840fcc80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f72740048c0 tx=0x7f7274009e30 comp rx=0 tx=0).stop 2023-12-12T11:44:51.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:51.917+0000 7f728880c700 1 -- 172.21.15.93:0/3956339070 shutdown_connections 2023-12-12T11:44:51.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:51.917+0000 7f728880c700 1 --2- 172.21.15.93:0/3956339070 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72840fc870 0x7f72840fcc80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:51.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:51.917+0000 7f728880c700 1 -- 172.21.15.93:0/3956339070 >> 172.21.15.93:0/3956339070 conn(0x7f72840f7f50 msgr2=0x7f72840fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:51.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:51.917+0000 7f728880c700 1 -- 172.21.15.93:0/3956339070 shutdown_connections 2023-12-12T11:44:51.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:51.918+0000 7f728880c700 1 -- 172.21.15.93:0/3956339070 wait complete. 2023-12-12T11:44:51.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:51.918+0000 7f728880c700 1 Processor -- start 2023-12-12T11:44:51.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:51.918+0000 7f728880c700 1 -- start start 2023-12-12T11:44:51.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:51.919+0000 7f728880c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72840fc870 0x7f728410ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:51.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:51.919+0000 7f728880c700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728410f270 con 0x7f72840fc870 2023-12-12T11:44:51.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:51.919+0000 7f728259c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72840fc870 0x7f728410ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:51.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:51.919+0000 7f728259c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72840fc870 0x7f728410ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.93:45074/0 (socket says 172.21.15.93:45074) 2023-12-12T11:44:51.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:51.919+0000 7f728259c700 1 -- 172.21.15.93:0/2850984007 learned_addr learned my addr 172.21.15.93:0/2850984007 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-12-12T11:44:51.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:51.919+0000 7f728259c700 1 -- 172.21.15.93:0/2850984007 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7274005040 con 0x7f72840fc870 2023-12-12T11:44:51.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:51.920+0000 7f728259c700 1 --2- 172.21.15.93:0/2850984007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72840fc870 0x7f728410ed30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f727400b690 tx=0x7f7274009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:51.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:51.920+0000 7f727affd700 1 -- 172.21.15.93:0/2850984007 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7274009650 con 0x7f72840fc870 2023-12-12T11:44:51.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:51.920+0000 7f728880c700 1 -- 172.21.15.93:0/2850984007 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f728410f470 con 0x7f72840fc870 2023-12-12T11:44:51.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:51.920+0000 7f728880c700 1 -- 172.21.15.93:0/2850984007 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f728410ffd0 con 0x7f72840fc870 2023-12-12T11:44:51.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:51.920+0000 7f727affd700 1 -- 172.21.15.93:0/2850984007 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f72740097b0 con 0x7f72840fc870 2023-12-12T11:44:51.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:51.920+0000 7f727affd700 1 -- 172.21.15.93:0/2850984007 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72740255c0 con 0x7f72840fc870 2023-12-12T11:44:51.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:51.921+0000 7f728880c700 1 -- 172.21.15.93:0/2850984007 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f728404bb80 con 0x7f72840fc870 2023-12-12T11:44:51.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:51.921+0000 7f727affd700 1 -- 172.21.15.93:0/2850984007 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f7274013420 con 0x7f72840fc870 2023-12-12T11:44:51.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:51.921+0000 7f727affd700 1 --2- 172.21.15.93:0/2850984007 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f72700366d0 0x7f7270038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:51.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:51.921+0000 7f727affd700 1 -- 172.21.15.93:0/2850984007 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7274049a30 con 0x7f72840fc870 2023-12-12T11:44:51.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:51.922+0000 7f727bfff700 1 --2- 172.21.15.93:0/2850984007 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f72700366d0 0x7f7270038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:51.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:51.922+0000 7f727bfff700 1 --2- 172.21.15.93:0/2850984007 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f72700366d0 0x7f7270038b80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f726c009990 tx=0x7f726c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:51.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:51.927+0000 7f727affd700 1 -- 172.21.15.93:0/2850984007 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f72740123c0 con 0x7f72840fc870 2023-12-12T11:44:52.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:52.189+0000 7f728880c700 1 -- 172.21.15.93:0/2850984007 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7284110160 con 0x7f72840fc870 2023-12-12T11:44:52.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:52.190+0000 7f727affd700 1 -- 172.21.15.93:0/2850984007 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f7274023300 con 0x7f72840fc870 2023-12-12T11:44:52.192 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:44:52.192 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":1,"fsid":"85e33c70-98e3-11ee-95a3-87774f69a715","modified":"2023-12-12T11:43:03.786943Z","created":"2023-12-12T11:43:03.786943Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-12T11:44:52.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:52.192+0000 7f728880c700 1 -- 172.21.15.93:0/2850984007 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f72700366d0 msgr2=0x7f7270038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:52.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:52.192+0000 7f728880c700 1 --2- 172.21.15.93:0/2850984007 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f72700366d0 0x7f7270038b80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f726c009990 tx=0x7f726c006e40 comp rx=0 tx=0).stop 2023-12-12T11:44:52.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:52.192+0000 7f728880c700 1 -- 172.21.15.93:0/2850984007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72840fc870 msgr2=0x7f728410ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:52.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:52.192+0000 7f728880c700 1 --2- 172.21.15.93:0/2850984007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72840fc870 0x7f728410ed30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f727400b690 tx=0x7f7274009e30 comp rx=0 tx=0).stop 2023-12-12T11:44:52.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:52.192+0000 7f728880c700 1 -- 172.21.15.93:0/2850984007 shutdown_connections 2023-12-12T11:44:52.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:52.192+0000 7f728880c700 1 --2- 172.21.15.93:0/2850984007 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f72700366d0 0x7f7270038b80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:52.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:52.192+0000 7f728880c700 1 --2- 172.21.15.93:0/2850984007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72840fc870 0x7f728410ed30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:52.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:52.192+0000 7f728880c700 1 -- 172.21.15.93:0/2850984007 >> 172.21.15.93:0/2850984007 conn(0x7f72840f7f50 msgr2=0x7f728406fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:52.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:52.192+0000 7f728880c700 1 -- 172.21.15.93:0/2850984007 shutdown_connections 2023-12-12T11:44:52.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:52.192+0000 7f728880c700 1 -- 172.21.15.93:0/2850984007 wait complete. 2023-12-12T11:44:52.195 INFO:teuthology.orchestra.run.smithi093.stderr:dumped monmap epoch 1 2023-12-12T11:44:52.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:51 smithi063 ceph-mon[107117]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:44:53.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:52 smithi063 ceph-mon[107117]: from='client.? 172.21.15.93:0/2850984007' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:44:53.548 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-12T11:44:53.549 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-12T11:44:53.952 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-12T11:44:54.040 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-12T11:44:54.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:53 smithi063 ceph-mon[107117]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:44:55.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.159+0000 7fc2f759e700 1 -- 172.21.15.93:0/75276638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2f8071b60 msgr2=0x7fc2f806ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:55.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.159+0000 7fc2f759e700 1 --2- 172.21.15.93:0/75276638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2f8071b60 0x7fc2f806ffd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80048c0 tx=0x7fc2e8009e30 comp rx=0 tx=0).stop 2023-12-12T11:44:55.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.159+0000 7fc2f759e700 1 -- 172.21.15.93:0/75276638 shutdown_connections 2023-12-12T11:44:55.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.159+0000 7fc2f759e700 1 --2- 172.21.15.93:0/75276638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2f8071b60 0x7fc2f806ffd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:55.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.159+0000 7fc2f759e700 1 -- 172.21.15.93:0/75276638 >> 172.21.15.93:0/75276638 conn(0x7fc2f80f7d70 msgr2=0x7fc2f80fa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:55.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.159+0000 7fc2f759e700 1 -- 172.21.15.93:0/75276638 shutdown_connections 2023-12-12T11:44:55.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.159+0000 7fc2f759e700 1 -- 172.21.15.93:0/75276638 wait complete. 2023-12-12T11:44:55.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.160+0000 7fc2f759e700 1 Processor -- start 2023-12-12T11:44:55.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.160+0000 7fc2f759e700 1 -- start start 2023-12-12T11:44:55.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.160+0000 7fc2f759e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2f8071b60 0x7fc2f810ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:55.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.160+0000 7fc2f759e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f810efc0 con 0x7fc2f8071b60 2023-12-12T11:44:55.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.161+0000 7fc2f659c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2f8071b60 0x7fc2f810ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:55.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.161+0000 7fc2f659c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2f8071b60 0x7fc2f810ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.93:45098/0 (socket says 172.21.15.93:45098) 2023-12-12T11:44:55.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.161+0000 7fc2f659c700 1 -- 172.21.15.93:0/1190014242 learned_addr learned my addr 172.21.15.93:0/1190014242 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-12-12T11:44:55.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.161+0000 7fc2f659c700 1 -- 172.21.15.93:0/1190014242 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e8005040 con 0x7fc2f8071b60 2023-12-12T11:44:55.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.161+0000 7fc2f659c700 1 --2- 172.21.15.93:0/1190014242 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2f8071b60 0x7fc2f810ea80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800b690 tx=0x7fc2e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:55.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.161+0000 7fc2e6ffd700 1 -- 172.21.15.93:0/1190014242 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc2e8009650 con 0x7fc2f8071b60 2023-12-12T11:44:55.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.161+0000 7fc2e6ffd700 1 -- 172.21.15.93:0/1190014242 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc2e80097b0 con 0x7fc2f8071b60 2023-12-12T11:44:55.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.162+0000 7fc2f759e700 1 -- 172.21.15.93:0/1190014242 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f810f1c0 con 0x7fc2f8071b60 2023-12-12T11:44:55.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.162+0000 7fc2e6ffd700 1 -- 172.21.15.93:0/1190014242 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc2e801c5b0 con 0x7fc2f8071b60 2023-12-12T11:44:55.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.162+0000 7fc2f759e700 1 -- 172.21.15.93:0/1190014242 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f810fe60 con 0x7fc2f8071b60 2023-12-12T11:44:55.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.163+0000 7fc2f759e700 1 -- 172.21.15.93:0/1190014242 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f805f270 con 0x7fc2f8071b60 2023-12-12T11:44:55.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.163+0000 7fc2e6ffd700 1 -- 172.21.15.93:0/1190014242 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fc2e8013a60 con 0x7fc2f8071b60 2023-12-12T11:44:55.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.163+0000 7fc2e6ffd700 1 --2- 172.21.15.93:0/1190014242 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fc2e00366d0 0x7fc2e0038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:55.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.163+0000 7fc2e6ffd700 1 -- 172.21.15.93:0/1190014242 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc2e8049910 con 0x7fc2f8071b60 2023-12-12T11:44:55.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.163+0000 7fc2f5d9b700 1 --2- 172.21.15.93:0/1190014242 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fc2e00366d0 0x7fc2e0038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:55.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.164+0000 7fc2f5d9b700 1 --2- 172.21.15.93:0/1190014242 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fc2e00366d0 0x7fc2e0038b80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec009990 tx=0x7fc2ec006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:55.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.172+0000 7fc2e6ffd700 1 -- 172.21.15.93:0/1190014242 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc2e8011550 con 0x7fc2f8071b60 2023-12-12T11:44:55.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.434+0000 7fc2f759e700 1 -- 172.21.15.93:0/1190014242 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc2f81109b0 con 0x7fc2f8071b60 2023-12-12T11:44:55.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.435+0000 7fc2e6ffd700 1 -- 172.21.15.93:0/1190014242 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fc2e8011370 con 0x7fc2f8071b60 2023-12-12T11:44:55.437 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:44:55.437 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":1,"fsid":"85e33c70-98e3-11ee-95a3-87774f69a715","modified":"2023-12-12T11:43:03.786943Z","created":"2023-12-12T11:43:03.786943Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-12T11:44:55.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.437+0000 7fc2f759e700 1 -- 172.21.15.93:0/1190014242 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fc2e00366d0 msgr2=0x7fc2e0038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:55.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.437+0000 7fc2f759e700 1 --2- 172.21.15.93:0/1190014242 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fc2e00366d0 0x7fc2e0038b80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec009990 tx=0x7fc2ec006e40 comp rx=0 tx=0).stop 2023-12-12T11:44:55.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.437+0000 7fc2f759e700 1 -- 172.21.15.93:0/1190014242 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2f8071b60 msgr2=0x7fc2f810ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:55.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.437+0000 7fc2f759e700 1 --2- 172.21.15.93:0/1190014242 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2f8071b60 0x7fc2f810ea80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800b690 tx=0x7fc2e8009e30 comp rx=0 tx=0).stop 2023-12-12T11:44:55.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.437+0000 7fc2f759e700 1 -- 172.21.15.93:0/1190014242 shutdown_connections 2023-12-12T11:44:55.440 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.437+0000 7fc2f759e700 1 --2- 172.21.15.93:0/1190014242 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fc2e00366d0 0x7fc2e0038b80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:55.440 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.437+0000 7fc2f759e700 1 --2- 172.21.15.93:0/1190014242 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2f8071b60 0x7fc2f810ea80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:55.440 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.437+0000 7fc2f759e700 1 -- 172.21.15.93:0/1190014242 >> 172.21.15.93:0/1190014242 conn(0x7fc2f80f7d70 msgr2=0x7fc2f80f8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:55.440 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.437+0000 7fc2f759e700 1 -- 172.21.15.93:0/1190014242 shutdown_connections 2023-12-12T11:44:55.440 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:55.437+0000 7fc2f759e700 1 -- 172.21.15.93:0/1190014242 wait complete. 2023-12-12T11:44:55.440 INFO:teuthology.orchestra.run.smithi093.stderr:dumped monmap epoch 1 2023-12-12T11:44:56.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:55 smithi063 ceph-mon[107117]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:44:56.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:55 smithi063 ceph-mon[107117]: from='client.? 172.21.15.93:0/1190014242' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:44:56.812 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-12T11:44:56.813 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-12T11:44:57.233 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-12T11:44:57.350 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-12T11:44:57.462 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:57 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:57.462 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:57 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:57.462 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:57 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:44:57.462 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:57 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2023-12-12T11:44:57.462 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:57 smithi063 ceph-mon[107117]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:44:58.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.451+0000 7fe4e51c8700 1 -- 172.21.15.93:0/338893834 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4e00fc870 msgr2=0x7fe4e00fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:58.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.451+0000 7fe4e51c8700 1 --2- 172.21.15.93:0/338893834 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4e00fc870 0x7fe4e00fcc80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe4d00048c0 tx=0x7fe4d0009e30 comp rx=0 tx=0).stop 2023-12-12T11:44:58.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.451+0000 7fe4e51c8700 1 -- 172.21.15.93:0/338893834 shutdown_connections 2023-12-12T11:44:58.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.451+0000 7fe4e51c8700 1 --2- 172.21.15.93:0/338893834 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4e00fc870 0x7fe4e00fcc80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:58.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.451+0000 7fe4e51c8700 1 -- 172.21.15.93:0/338893834 >> 172.21.15.93:0/338893834 conn(0x7fe4e00f7f50 msgr2=0x7fe4e00fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:58.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.451+0000 7fe4e51c8700 1 -- 172.21.15.93:0/338893834 shutdown_connections 2023-12-12T11:44:58.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.451+0000 7fe4e51c8700 1 -- 172.21.15.93:0/338893834 wait complete. 2023-12-12T11:44:58.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.452+0000 7fe4e51c8700 1 Processor -- start 2023-12-12T11:44:58.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.452+0000 7fe4e51c8700 1 -- start start 2023-12-12T11:44:58.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.452+0000 7fe4e51c8700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4e00fc870 0x7fe4e010ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:58.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.452+0000 7fe4e51c8700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e010f270 con 0x7fe4e00fc870 2023-12-12T11:44:58.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.453+0000 7fe4ded9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4e00fc870 0x7fe4e010ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:44:58.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.453+0000 7fe4ded9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4e00fc870 0x7fe4e010ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.93:43876/0 (socket says 172.21.15.93:43876) 2023-12-12T11:44:58.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.453+0000 7fe4ded9d700 1 -- 172.21.15.93:0/1732183770 learned_addr learned my addr 172.21.15.93:0/1732183770 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-12-12T11:44:58.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.453+0000 7fe4ded9d700 1 -- 172.21.15.93:0/1732183770 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d0005040 con 0x7fe4e00fc870 2023-12-12T11:44:58.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.453+0000 7fe4ded9d700 1 --2- 172.21.15.93:0/1732183770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4e00fc870 0x7fe4e010ed30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0009330 tx=0x7fe4d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:44:58.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.454+0000 7fe4c77fe700 1 -- 172.21.15.93:0/1732183770 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe4d00096b0 con 0x7fe4e00fc870 2023-12-12T11:44:58.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.454+0000 7fe4c77fe700 1 -- 172.21.15.93:0/1732183770 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe4d0009810 con 0x7fe4e00fc870 2023-12-12T11:44:58.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.454+0000 7fe4e51c8700 1 -- 172.21.15.93:0/1732183770 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e010f470 con 0x7fe4e00fc870 2023-12-12T11:44:58.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.454+0000 7fe4c77fe700 1 -- 172.21.15.93:0/1732183770 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe4d001c5b0 con 0x7fe4e00fc870 2023-12-12T11:44:58.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.454+0000 7fe4e51c8700 1 -- 172.21.15.93:0/1732183770 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e010ffd0 con 0x7fe4e00fc870 2023-12-12T11:44:58.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.455+0000 7fe4e51c8700 1 -- 172.21.15.93:0/1732183770 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e005f270 con 0x7fe4e00fc870 2023-12-12T11:44:58.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.455+0000 7fe4c77fe700 1 -- 172.21.15.93:0/1732183770 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 14) v1 ==== 43351+0+0 (secure 0 0 0) 0x7fe4d0013420 con 0x7fe4e00fc870 2023-12-12T11:44:58.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.455+0000 7fe4c77fe700 1 --2- 172.21.15.93:0/1732183770 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fe4c8036770 0x7fe4c8038c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:44:58.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.455+0000 7fe4c77fe700 1 -- 172.21.15.93:0/1732183770 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe4d0049aa0 con 0x7fe4e00fc870 2023-12-12T11:44:58.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.455+0000 7fe4de59c700 1 -- 172.21.15.93:0/1732183770 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fe4c8036770 msgr2=0x7fe4c8038c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/293571324 2023-12-12T11:44:58.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.455+0000 7fe4de59c700 1 --2- 172.21.15.93:0/1732183770 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fe4c8036770 0x7fe4c8038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T11:44:58.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.461+0000 7fe4c77fe700 1 -- 172.21.15.93:0/1732183770 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe4d00119c0 con 0x7fe4e00fc870 2023-12-12T11:44:58.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:58 smithi063 ceph-mon[107117]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2023-12-12T11:44:58.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:58 smithi063 ceph-mon[107117]: mgrmap e14: smithi063.zjnfdi(active, since 48s) 2023-12-12T11:44:58.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.656+0000 7fe4de59c700 1 -- 172.21.15.93:0/1732183770 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fe4c8036770 msgr2=0x7fe4c8038c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/293571324 2023-12-12T11:44:58.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.656+0000 7fe4de59c700 1 --2- 172.21.15.93:0/1732183770 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fe4c8036770 0x7fe4c8038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-12T11:44:58.727 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.726+0000 7fe4e51c8700 1 -- 172.21.15.93:0/1732183770 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe4e004bb80 con 0x7fe4e00fc870 2023-12-12T11:44:58.728 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.727+0000 7fe4c77fe700 1 -- 172.21.15.93:0/1732183770 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fe4d0011370 con 0x7fe4e00fc870 2023-12-12T11:44:58.728 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:44:58.728 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":1,"fsid":"85e33c70-98e3-11ee-95a3-87774f69a715","modified":"2023-12-12T11:43:03.786943Z","created":"2023-12-12T11:43:03.786943Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-12T11:44:58.730 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.729+0000 7fe4e51c8700 1 -- 172.21.15.93:0/1732183770 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fe4c8036770 msgr2=0x7fe4c8038c20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-12T11:44:58.730 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.729+0000 7fe4e51c8700 1 --2- 172.21.15.93:0/1732183770 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fe4c8036770 0x7fe4c8038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:58.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.729+0000 7fe4e51c8700 1 -- 172.21.15.93:0/1732183770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4e00fc870 msgr2=0x7fe4e010ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:44:58.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.729+0000 7fe4e51c8700 1 --2- 172.21.15.93:0/1732183770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4e00fc870 0x7fe4e010ed30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0009330 tx=0x7fe4d0009e30 comp rx=0 tx=0).stop 2023-12-12T11:44:58.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.729+0000 7fe4e51c8700 1 -- 172.21.15.93:0/1732183770 shutdown_connections 2023-12-12T11:44:58.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.729+0000 7fe4e51c8700 1 --2- 172.21.15.93:0/1732183770 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7fe4c8036770 0x7fe4c8038c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:58.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.729+0000 7fe4e51c8700 1 --2- 172.21.15.93:0/1732183770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4e00fc870 0x7fe4e010ed30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:44:58.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.729+0000 7fe4e51c8700 1 -- 172.21.15.93:0/1732183770 >> 172.21.15.93:0/1732183770 conn(0x7fe4e00f7f50 msgr2=0x7fe4e006fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:44:58.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.729+0000 7fe4e51c8700 1 -- 172.21.15.93:0/1732183770 shutdown_connections 2023-12-12T11:44:58.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:44:58.729+0000 7fe4e51c8700 1 -- 172.21.15.93:0/1732183770 wait complete. 2023-12-12T11:44:58.731 INFO:teuthology.orchestra.run.smithi093.stderr:dumped monmap epoch 1 2023-12-12T11:44:59.506 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:44:59 smithi063 ceph-mon[107117]: from='client.? 172.21.15.93:0/1732183770' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:45:00.110 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-12T11:45:00.111 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-12T11:45:00.530 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-12T11:45:00.618 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-12T11:45:01.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.708+0000 7f5e89e4f700 1 -- 172.21.15.93:0/1979045059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e84065a60 msgr2=0x7f5e840ff2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:45:01.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.708+0000 7f5e89e4f700 1 --2- 172.21.15.93:0/1979045059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e84065a60 0x7f5e840ff2a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5e780048c0 tx=0x7f5e78009e30 comp rx=0 tx=0).stop 2023-12-12T11:45:01.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.709+0000 7f5e89e4f700 1 -- 172.21.15.93:0/1979045059 shutdown_connections 2023-12-12T11:45:01.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.709+0000 7f5e89e4f700 1 --2- 172.21.15.93:0/1979045059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e84065a60 0x7f5e840ff2a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:01.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.709+0000 7f5e89e4f700 1 -- 172.21.15.93:0/1979045059 >> 172.21.15.93:0/1979045059 conn(0x7f5e840f6c70 msgr2=0x7f5e840f90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:45:01.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.709+0000 7f5e89e4f700 1 -- 172.21.15.93:0/1979045059 shutdown_connections 2023-12-12T11:45:01.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.709+0000 7f5e89e4f700 1 -- 172.21.15.93:0/1979045059 wait complete. 2023-12-12T11:45:01.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.709+0000 7f5e89e4f700 1 Processor -- start 2023-12-12T11:45:01.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.710+0000 7f5e89e4f700 1 -- start start 2023-12-12T11:45:01.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.710+0000 7f5e89e4f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e84065a60 0x7f5e8410eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:45:01.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.710+0000 7f5e89e4f700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8410eff0 con 0x7f5e84065a60 2023-12-12T11:45:01.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.710+0000 7f5e88e4d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e84065a60 0x7f5e8410eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:45:01.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.710+0000 7f5e88e4d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e84065a60 0x7f5e8410eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.93:43892/0 (socket says 172.21.15.93:43892) 2023-12-12T11:45:01.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.710+0000 7f5e88e4d700 1 -- 172.21.15.93:0/236445926 learned_addr learned my addr 172.21.15.93:0/236445926 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-12-12T11:45:01.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.711+0000 7f5e88e4d700 1 -- 172.21.15.93:0/236445926 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e78005040 con 0x7f5e84065a60 2023-12-12T11:45:01.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.711+0000 7f5e88e4d700 1 --2- 172.21.15.93:0/236445926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e84065a60 0x7f5e8410eab0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5e78009040 tx=0x7f5e78009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:45:01.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.711+0000 7f5e817fa700 1 -- 172.21.15.93:0/236445926 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5e78009620 con 0x7f5e84065a60 2023-12-12T11:45:01.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.711+0000 7f5e817fa700 1 -- 172.21.15.93:0/236445926 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5e78009780 con 0x7f5e84065a60 2023-12-12T11:45:01.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.711+0000 7f5e89e4f700 1 -- 172.21.15.93:0/236445926 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e8410f1f0 con 0x7f5e84065a60 2023-12-12T11:45:01.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.711+0000 7f5e817fa700 1 -- 172.21.15.93:0/236445926 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5e7801c5b0 con 0x7f5e84065a60 2023-12-12T11:45:01.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.711+0000 7f5e89e4f700 1 -- 172.21.15.93:0/236445926 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e8410fe90 con 0x7f5e84065a60 2023-12-12T11:45:01.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.712+0000 7f5e89e4f700 1 -- 172.21.15.93:0/236445926 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e8405f270 con 0x7f5e84065a60 2023-12-12T11:45:01.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.713+0000 7f5e817fa700 1 -- 172.21.15.93:0/236445926 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 14) v1 ==== 43351+0+0 (secure 0 0 0) 0x7f5e78013a60 con 0x7f5e84065a60 2023-12-12T11:45:01.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.713+0000 7f5e817fa700 1 --2- 172.21.15.93:0/236445926 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f5e74036770 0x7f5e74038c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:45:01.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.713+0000 7f5e817fa700 1 -- 172.21.15.93:0/236445926 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5e780498f0 con 0x7f5e84065a60 2023-12-12T11:45:01.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.713+0000 7f5e83fff700 1 -- 172.21.15.93:0/236445926 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f5e74036770 msgr2=0x7f5e74038c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/293571324 2023-12-12T11:45:01.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.713+0000 7f5e83fff700 1 --2- 172.21.15.93:0/236445926 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f5e74036770 0x7f5e74038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T11:45:01.719 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.718+0000 7f5e817fa700 1 -- 172.21.15.93:0/236445926 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5e78011db0 con 0x7f5e84065a60 2023-12-12T11:45:01.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.914+0000 7f5e83fff700 1 -- 172.21.15.93:0/236445926 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f5e74036770 msgr2=0x7f5e74038c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/293571324 2023-12-12T11:45:01.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.914+0000 7f5e83fff700 1 --2- 172.21.15.93:0/236445926 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f5e74036770 0x7f5e74038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-12T11:45:01.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.983+0000 7f5e89e4f700 1 -- 172.21.15.93:0/236445926 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5e84110210 con 0x7f5e84065a60 2023-12-12T11:45:01.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.984+0000 7f5e817fa700 1 -- 172.21.15.93:0/236445926 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f5e78011370 con 0x7f5e84065a60 2023-12-12T11:45:01.985 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:45:01.985 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":1,"fsid":"85e33c70-98e3-11ee-95a3-87774f69a715","modified":"2023-12-12T11:43:03.786943Z","created":"2023-12-12T11:43:03.786943Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-12T11:45:01.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.986+0000 7f5e89e4f700 1 -- 172.21.15.93:0/236445926 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f5e74036770 msgr2=0x7f5e74038c20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-12T11:45:01.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.986+0000 7f5e89e4f700 1 --2- 172.21.15.93:0/236445926 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f5e74036770 0x7f5e74038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:01.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.986+0000 7f5e89e4f700 1 -- 172.21.15.93:0/236445926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e84065a60 msgr2=0x7f5e8410eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:45:01.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.986+0000 7f5e89e4f700 1 --2- 172.21.15.93:0/236445926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e84065a60 0x7f5e8410eab0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5e78009040 tx=0x7f5e78009e30 comp rx=0 tx=0).stop 2023-12-12T11:45:01.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.986+0000 7f5e89e4f700 1 -- 172.21.15.93:0/236445926 shutdown_connections 2023-12-12T11:45:01.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.986+0000 7f5e89e4f700 1 --2- 172.21.15.93:0/236445926 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f5e74036770 0x7f5e74038c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:01.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.986+0000 7f5e89e4f700 1 --2- 172.21.15.93:0/236445926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e84065a60 0x7f5e8410eab0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:01.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.986+0000 7f5e89e4f700 1 -- 172.21.15.93:0/236445926 >> 172.21.15.93:0/236445926 conn(0x7f5e840f6c70 msgr2=0x7f5e840fb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:45:01.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.986+0000 7f5e89e4f700 1 -- 172.21.15.93:0/236445926 shutdown_connections 2023-12-12T11:45:01.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:01.986+0000 7f5e89e4f700 1 -- 172.21.15.93:0/236445926 wait complete. 2023-12-12T11:45:01.988 INFO:teuthology.orchestra.run.smithi093.stderr:dumped monmap epoch 1 2023-12-12T11:45:02.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:02 smithi063 ceph-mon[107117]: from='client.? 172.21.15.93:0/236445926' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:45:03.332 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-12T11:45:03.332 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-12T11:45:03.746 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-12T11:45:03.834 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-12T11:45:04.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:04.892+0000 7f58c6b4a700 1 -- 172.21.15.93:0/869198381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58c00fc870 msgr2=0x7f58c00fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:45:04.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:04.892+0000 7f58c6b4a700 1 --2- 172.21.15.93:0/869198381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58c00fc870 0x7f58c00fcc80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f58b40048c0 tx=0x7f58b4009e30 comp rx=0 tx=0).stop 2023-12-12T11:45:04.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:04.892+0000 7f58c6b4a700 1 -- 172.21.15.93:0/869198381 shutdown_connections 2023-12-12T11:45:04.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:04.892+0000 7f58c6b4a700 1 --2- 172.21.15.93:0/869198381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58c00fc870 0x7f58c00fcc80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:04.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:04.892+0000 7f58c6b4a700 1 -- 172.21.15.93:0/869198381 >> 172.21.15.93:0/869198381 conn(0x7f58c00f7f50 msgr2=0x7f58c00fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:45:04.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:04.892+0000 7f58c6b4a700 1 -- 172.21.15.93:0/869198381 shutdown_connections 2023-12-12T11:45:04.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:04.892+0000 7f58c6b4a700 1 -- 172.21.15.93:0/869198381 wait complete. 2023-12-12T11:45:04.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:04.893+0000 7f58c6b4a700 1 Processor -- start 2023-12-12T11:45:04.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:04.893+0000 7f58c6b4a700 1 -- start start 2023-12-12T11:45:04.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:04.894+0000 7f58c6b4a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58c00fc870 0x7f58c010ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:45:04.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:04.894+0000 7f58c6b4a700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c010f270 con 0x7f58c00fc870 2023-12-12T11:45:04.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:04.894+0000 7f58c48e6700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58c00fc870 0x7f58c010ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:45:04.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:04.894+0000 7f58c48e6700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58c00fc870 0x7f58c010ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.93:43902/0 (socket says 172.21.15.93:43902) 2023-12-12T11:45:04.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:04.894+0000 7f58c48e6700 1 -- 172.21.15.93:0/3135520003 learned_addr learned my addr 172.21.15.93:0/3135520003 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-12-12T11:45:04.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:04.894+0000 7f58c48e6700 1 -- 172.21.15.93:0/3135520003 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b4005040 con 0x7f58c00fc870 2023-12-12T11:45:04.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:04.895+0000 7f58c48e6700 1 --2- 172.21.15.93:0/3135520003 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58c00fc870 0x7f58c010ed30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f58b400b690 tx=0x7f58b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:45:04.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:04.895+0000 7f58bd7fa700 1 -- 172.21.15.93:0/3135520003 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58b4009650 con 0x7f58c00fc870 2023-12-12T11:45:04.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:04.895+0000 7f58bd7fa700 1 -- 172.21.15.93:0/3135520003 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f58b40097b0 con 0x7f58c00fc870 2023-12-12T11:45:04.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:04.895+0000 7f58c6b4a700 1 -- 172.21.15.93:0/3135520003 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c010f470 con 0x7f58c00fc870 2023-12-12T11:45:04.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:04.895+0000 7f58bd7fa700 1 -- 172.21.15.93:0/3135520003 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58b401c5d0 con 0x7f58c00fc870 2023-12-12T11:45:04.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:04.895+0000 7f58c6b4a700 1 -- 172.21.15.93:0/3135520003 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c010ffd0 con 0x7f58c00fc870 2023-12-12T11:45:04.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:04.896+0000 7f58c6b4a700 1 -- 172.21.15.93:0/3135520003 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c004bb80 con 0x7f58c00fc870 2023-12-12T11:45:04.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:04.896+0000 7f58bd7fa700 1 -- 172.21.15.93:0/3135520003 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 14) v1 ==== 43351+0+0 (secure 0 0 0) 0x7f58b40139d0 con 0x7f58c00fc870 2023-12-12T11:45:04.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:04.896+0000 7f58bd7fa700 1 --2- 172.21.15.93:0/3135520003 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f58b0036770 0x7f58b0038c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:45:04.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:04.896+0000 7f58bd7fa700 1 -- 172.21.15.93:0/3135520003 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f58b4049a50 con 0x7f58c00fc870 2023-12-12T11:45:04.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:04.897+0000 7f58bffff700 1 -- 172.21.15.93:0/3135520003 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f58b0036770 msgr2=0x7f58b0038c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/293571324 2023-12-12T11:45:04.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:04.897+0000 7f58bffff700 1 --2- 172.21.15.93:0/3135520003 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f58b0036770 0x7f58b0038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T11:45:04.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:04.901+0000 7f58bd7fa700 1 -- 172.21.15.93:0/3135520003 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f58b4025400 con 0x7f58c00fc870 2023-12-12T11:45:05.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:05.098+0000 7f58bffff700 1 -- 172.21.15.93:0/3135520003 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f58b0036770 msgr2=0x7f58b0038c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/293571324 2023-12-12T11:45:05.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:05.098+0000 7f58bffff700 1 --2- 172.21.15.93:0/3135520003 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f58b0036770 0x7f58b0038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-12T11:45:05.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:05.167+0000 7f58c6b4a700 1 -- 172.21.15.93:0/3135520003 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f58c0110160 con 0x7f58c00fc870 2023-12-12T11:45:05.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:05.168+0000 7f58bd7fa700 1 -- 172.21.15.93:0/3135520003 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f58b4011b60 con 0x7f58c00fc870 2023-12-12T11:45:05.169 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:45:05.169 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":1,"fsid":"85e33c70-98e3-11ee-95a3-87774f69a715","modified":"2023-12-12T11:43:03.786943Z","created":"2023-12-12T11:43:03.786943Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-12T11:45:05.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:05.170+0000 7f58c6b4a700 1 -- 172.21.15.93:0/3135520003 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f58b0036770 msgr2=0x7f58b0038c20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-12T11:45:05.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:05.170+0000 7f58c6b4a700 1 --2- 172.21.15.93:0/3135520003 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f58b0036770 0x7f58b0038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:05.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:05.170+0000 7f58c6b4a700 1 -- 172.21.15.93:0/3135520003 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58c00fc870 msgr2=0x7f58c010ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:45:05.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:05.170+0000 7f58c6b4a700 1 --2- 172.21.15.93:0/3135520003 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58c00fc870 0x7f58c010ed30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f58b400b690 tx=0x7f58b4009e30 comp rx=0 tx=0).stop 2023-12-12T11:45:05.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:05.170+0000 7f58c6b4a700 1 -- 172.21.15.93:0/3135520003 shutdown_connections 2023-12-12T11:45:05.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:05.170+0000 7f58c6b4a700 1 --2- 172.21.15.93:0/3135520003 >> [v2:172.21.15.63:6800/293571324,v1:172.21.15.63:6801/293571324] conn(0x7f58b0036770 0x7f58b0038c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:05.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:05.170+0000 7f58c6b4a700 1 --2- 172.21.15.93:0/3135520003 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58c00fc870 0x7f58c010ed30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:05.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:05.170+0000 7f58c6b4a700 1 -- 172.21.15.93:0/3135520003 >> 172.21.15.93:0/3135520003 conn(0x7f58c00f7f50 msgr2=0x7f58c006feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:45:05.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:05.170+0000 7f58c6b4a700 1 -- 172.21.15.93:0/3135520003 shutdown_connections 2023-12-12T11:45:05.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:05.170+0000 7f58c6b4a700 1 -- 172.21.15.93:0/3135520003 wait complete. 2023-12-12T11:45:05.172 INFO:teuthology.orchestra.run.smithi093.stderr:dumped monmap epoch 1 2023-12-12T11:45:05.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:05 smithi063 ceph-mon[107117]: from='client.? 172.21.15.93:0/3135520003' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:45:06.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:06 smithi063 ceph-mon[107117]: Active manager daemon smithi063.zjnfdi restarted 2023-12-12T11:45:06.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:06 smithi063 ceph-mon[107117]: Activating manager daemon smithi063.zjnfdi 2023-12-12T11:45:06.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:06 smithi063 ceph-mon[107117]: osdmap e5: 0 total, 0 up, 0 in 2023-12-12T11:45:06.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:06 smithi063 ceph-mon[107117]: mgrmap e15: smithi063.zjnfdi(active, starting, since 0.00338876s) 2023-12-12T11:45:06.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:06 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-12T11:45:06.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:06 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr metadata", "who": "smithi063.zjnfdi", "id": "smithi063.zjnfdi"}]: dispatch 2023-12-12T11:45:06.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:06 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-12T11:45:06.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:06 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-12T11:45:06.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:06 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-12T11:45:06.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:06 smithi063 ceph-mon[107117]: Manager daemon smithi063.zjnfdi is now available 2023-12-12T11:45:06.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:06 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:45:06.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:06 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:45:06.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:06 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:06.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:06 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:45:06.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:06 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.zjnfdi/mirror_snapshot_schedule"}]: dispatch 2023-12-12T11:45:06.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:06 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.zjnfdi/trash_purge_schedule"}]: dispatch 2023-12-12T11:45:06.554 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-12T11:45:06.555 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-12T11:45:06.972 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-12T11:45:07.069 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-12T11:45:07.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:07 smithi063 ceph-mon[107117]: [12/Dec/2023:11:45:06] ENGINE Bus STARTING 2023-12-12T11:45:07.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:07 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:07.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:07 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:07.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:07 smithi063 ceph-mon[107117]: mgrmap e16: smithi063.zjnfdi(active, since 1.00812s) 2023-12-12T11:45:07.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:07 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:08.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.207+0000 7f45b1a96700 1 -- 172.21.15.93:0/2443967428 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45ac0fd3b0 msgr2=0x7f45ac0ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:45:08.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.207+0000 7f45b1a96700 1 --2- 172.21.15.93:0/2443967428 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45ac0fd3b0 0x7f45ac0ff790 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f459c0048c0 tx=0x7f459c009e30 comp rx=0 tx=0).stop 2023-12-12T11:45:08.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.207+0000 7f45b1a96700 1 -- 172.21.15.93:0/2443967428 shutdown_connections 2023-12-12T11:45:08.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.207+0000 7f45b1a96700 1 --2- 172.21.15.93:0/2443967428 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45ac0fd3b0 0x7f45ac0ff790 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:08.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.207+0000 7f45b1a96700 1 -- 172.21.15.93:0/2443967428 >> 172.21.15.93:0/2443967428 conn(0x7f45ac0f6e50 msgr2=0x7f45ac0f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:45:08.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.207+0000 7f45b1a96700 1 -- 172.21.15.93:0/2443967428 shutdown_connections 2023-12-12T11:45:08.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.207+0000 7f45b1a96700 1 -- 172.21.15.93:0/2443967428 wait complete. 2023-12-12T11:45:08.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.208+0000 7f45b1a96700 1 Processor -- start 2023-12-12T11:45:08.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.208+0000 7f45b1a96700 1 -- start start 2023-12-12T11:45:08.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.208+0000 7f45b1a96700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45ac0fd3b0 0x7f45ac10ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:45:08.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.208+0000 7f45b1a96700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac10f280 con 0x7f45ac0fd3b0 2023-12-12T11:45:08.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.209+0000 7f45ab7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45ac0fd3b0 0x7f45ac10ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:45:08.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.209+0000 7f45ab7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45ac0fd3b0 0x7f45ac10ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.93:47726/0 (socket says 172.21.15.93:47726) 2023-12-12T11:45:08.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.209+0000 7f45ab7fe700 1 -- 172.21.15.93:0/3438745612 learned_addr learned my addr 172.21.15.93:0/3438745612 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-12-12T11:45:08.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.209+0000 7f45ab7fe700 1 -- 172.21.15.93:0/3438745612 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459c005040 con 0x7f45ac0fd3b0 2023-12-12T11:45:08.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.209+0000 7f45ab7fe700 1 --2- 172.21.15.93:0/3438745612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45ac0fd3b0 0x7f45ac10ed40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f459c009040 tx=0x7f459c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:45:08.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.210+0000 7f4593fff700 1 -- 172.21.15.93:0/3438745612 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f459c009620 con 0x7f45ac0fd3b0 2023-12-12T11:45:08.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.210+0000 7f45b1a96700 1 -- 172.21.15.93:0/3438745612 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45ac10f480 con 0x7f45ac0fd3b0 2023-12-12T11:45:08.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.210+0000 7f4593fff700 1 -- 172.21.15.93:0/3438745612 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f459c009780 con 0x7f45ac0fd3b0 2023-12-12T11:45:08.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.210+0000 7f4593fff700 1 -- 172.21.15.93:0/3438745612 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f459c01c5b0 con 0x7f45ac0fd3b0 2023-12-12T11:45:08.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.210+0000 7f45b1a96700 1 -- 172.21.15.93:0/3438745612 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45ac10ffe0 con 0x7f45ac0fd3b0 2023-12-12T11:45:08.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.211+0000 7f45b1a96700 1 -- 172.21.15.93:0/3438745612 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45ac05f270 con 0x7f45ac0fd3b0 2023-12-12T11:45:08.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.211+0000 7f4593fff700 1 -- 172.21.15.93:0/3438745612 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 16) v1 ==== 43202+0+0 (secure 0 0 0) 0x7f459c013420 con 0x7f45ac0fd3b0 2023-12-12T11:45:08.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.211+0000 7f4593fff700 1 --2- 172.21.15.93:0/3438745612 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4594036560 0x7f4594038a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:45:08.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.211+0000 7f4593fff700 1 -- 172.21.15.93:0/3438745612 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f459c049720 con 0x7f45ac0fd3b0 2023-12-12T11:45:08.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.212+0000 7f45aaffd700 1 --2- 172.21.15.93:0/3438745612 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4594036560 0x7f4594038a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:45:08.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.212+0000 7f45aaffd700 1 --2- 172.21.15.93:0/3438745612 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4594036560 0x7f4594038a10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f45a0009990 tx=0x7f45a0006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:45:08.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.217+0000 7f4593fff700 1 -- 172.21.15.93:0/3438745612 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f459c0119c0 con 0x7f45ac0fd3b0 2023-12-12T11:45:08.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.228+0000 7f4593fff700 1 -- 172.21.15.93:0/3438745612 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f459c025920 con 0x7f45ac0fd3b0 2023-12-12T11:45:08.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.500+0000 7f45b1a96700 1 -- 172.21.15.93:0/3438745612 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f45ac04bb80 con 0x7f45ac0fd3b0 2023-12-12T11:45:08.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.500+0000 7f4593fff700 1 -- 172.21.15.93:0/3438745612 <== mon.0 v2:172.21.15.63:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f459c017a20 con 0x7f45ac0fd3b0 2023-12-12T11:45:08.503 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:45:08.503 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":1,"fsid":"85e33c70-98e3-11ee-95a3-87774f69a715","modified":"2023-12-12T11:43:03.786943Z","created":"2023-12-12T11:43:03.786943Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-12T11:45:08.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.503+0000 7f45b1a96700 1 -- 172.21.15.93:0/3438745612 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4594036560 msgr2=0x7f4594038a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:45:08.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.503+0000 7f45b1a96700 1 --2- 172.21.15.93:0/3438745612 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4594036560 0x7f4594038a10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f45a0009990 tx=0x7f45a0006e40 comp rx=0 tx=0).stop 2023-12-12T11:45:08.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.503+0000 7f45b1a96700 1 -- 172.21.15.93:0/3438745612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45ac0fd3b0 msgr2=0x7f45ac10ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:45:08.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.503+0000 7f45b1a96700 1 --2- 172.21.15.93:0/3438745612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45ac0fd3b0 0x7f45ac10ed40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f459c009040 tx=0x7f459c009e30 comp rx=0 tx=0).stop 2023-12-12T11:45:08.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.503+0000 7f45b1a96700 1 -- 172.21.15.93:0/3438745612 shutdown_connections 2023-12-12T11:45:08.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.503+0000 7f45b1a96700 1 --2- 172.21.15.93:0/3438745612 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4594036560 0x7f4594038a10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:08.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.503+0000 7f45b1a96700 1 --2- 172.21.15.93:0/3438745612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45ac0fd3b0 0x7f45ac10ed40 secure :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f459c009040 tx=0x7f459c009e30 comp rx=0 tx=0).stop 2023-12-12T11:45:08.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.503+0000 7f45b1a96700 1 -- 172.21.15.93:0/3438745612 >> 172.21.15.93:0/3438745612 conn(0x7f45ac0f6e50 msgr2=0x7f45ac0f7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:45:08.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.503+0000 7f45b1a96700 1 -- 172.21.15.93:0/3438745612 shutdown_connections 2023-12-12T11:45:08.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:08.503+0000 7f45b1a96700 1 -- 172.21.15.93:0/3438745612 wait complete. 2023-12-12T11:45:08.507 INFO:teuthology.orchestra.run.smithi093.stderr:dumped monmap epoch 1 2023-12-12T11:45:08.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:08 smithi063 ceph-mon[107117]: [12/Dec/2023:11:45:06] ENGINE Serving on https://172.21.15.63:7150 2023-12-12T11:45:08.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:08 smithi063 ceph-mon[107117]: [12/Dec/2023:11:45:06] ENGINE Bus STARTED 2023-12-12T11:45:09.547 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:09 smithi063 ceph-mon[107117]: mgrmap e17: smithi063.zjnfdi(active, since 2s) 2023-12-12T11:45:09.547 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:09 smithi063 ceph-mon[107117]: from='client.? 172.21.15.93:0/3438745612' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:45:09.547 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:09 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:09.885 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-12T11:45:09.885 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-12T11:45:10.308 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-12T11:45:10.404 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-12T11:45:10.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:10 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:10.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:10 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:11.836 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:11.833+0000 7f564d2b4700 1 -- 172.21.15.93:0/3276706504 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5648071bc0 msgr2=0x7f5648070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:45:11.836 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:11.833+0000 7f564d2b4700 1 --2- 172.21.15.93:0/3276706504 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5648071bc0 0x7f5648070030 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f56380048c0 tx=0x7f5638009e30 comp rx=0 tx=0).stop 2023-12-12T11:45:11.836 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:11.833+0000 7f564d2b4700 1 -- 172.21.15.93:0/3276706504 shutdown_connections 2023-12-12T11:45:11.836 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:11.833+0000 7f564d2b4700 1 --2- 172.21.15.93:0/3276706504 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5648071bc0 0x7f5648070030 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:11.836 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:11.833+0000 7f564d2b4700 1 -- 172.21.15.93:0/3276706504 >> 172.21.15.93:0/3276706504 conn(0x7f56480f7f50 msgr2=0x7f56480fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:45:11.836 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:11.833+0000 7f564d2b4700 1 -- 172.21.15.93:0/3276706504 shutdown_connections 2023-12-12T11:45:11.836 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:11.833+0000 7f564d2b4700 1 -- 172.21.15.93:0/3276706504 wait complete. 2023-12-12T11:45:11.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:11.834+0000 7f564d2b4700 1 Processor -- start 2023-12-12T11:45:11.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:11.834+0000 7f564d2b4700 1 -- start start 2023-12-12T11:45:11.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:11.835+0000 7f564d2b4700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5648071bc0 0x7f5648113040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:45:11.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:11.835+0000 7f564d2b4700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5648113580 con 0x7f5648071bc0 2023-12-12T11:45:11.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:11.835+0000 7f5646ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5648071bc0 0x7f5648113040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:45:11.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:11.835+0000 7f5646ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5648071bc0 0x7f5648113040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.93:47732/0 (socket says 172.21.15.93:47732) 2023-12-12T11:45:11.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:11.835+0000 7f5646ffd700 1 -- 172.21.15.93:0/916256051 learned_addr learned my addr 172.21.15.93:0/916256051 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-12-12T11:45:11.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:11.835+0000 7f5646ffd700 1 -- 172.21.15.93:0/916256051 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5638005040 con 0x7f5648071bc0 2023-12-12T11:45:11.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:11.836+0000 7f5646ffd700 1 --2- 172.21.15.93:0/916256051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5648071bc0 0x7f5648113040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5638009040 tx=0x7f5638009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:45:11.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:11.836+0000 7f562f7fe700 1 -- 172.21.15.93:0/916256051 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5638009620 con 0x7f5648071bc0 2023-12-12T11:45:11.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:11.836+0000 7f562f7fe700 1 -- 172.21.15.93:0/916256051 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5638009780 con 0x7f5648071bc0 2023-12-12T11:45:11.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:11.836+0000 7f562f7fe700 1 -- 172.21.15.93:0/916256051 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f563801c5b0 con 0x7f5648071bc0 2023-12-12T11:45:11.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:11.836+0000 7f564d2b4700 1 -- 172.21.15.93:0/916256051 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5648113780 con 0x7f5648071bc0 2023-12-12T11:45:11.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:11.836+0000 7f564d2b4700 1 -- 172.21.15.93:0/916256051 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5648114420 con 0x7f5648071bc0 2023-12-12T11:45:11.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:11.837+0000 7f562f7fe700 1 -- 172.21.15.93:0/916256051 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f5638013420 con 0x7f5648071bc0 2023-12-12T11:45:11.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:11.837+0000 7f564d2b4700 1 -- 172.21.15.93:0/916256051 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f564805f270 con 0x7f5648071bc0 2023-12-12T11:45:11.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:11.837+0000 7f562f7fe700 1 --2- 172.21.15.93:0/916256051 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f5630036810 0x7f5630038cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:45:11.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:11.837+0000 7f562f7fe700 1 -- 172.21.15.93:0/916256051 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f5638049a60 con 0x7f5648071bc0 2023-12-12T11:45:11.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:11.838+0000 7f56467fc700 1 --2- 172.21.15.93:0/916256051 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f5630036810 0x7f5630038cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:45:11.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:11.838+0000 7f56467fc700 1 --2- 172.21.15.93:0/916256051 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f5630036810 0x7f5630038cc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f563c009990 tx=0x7f563c006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:45:11.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:11.843+0000 7f562f7fe700 1 -- 172.21.15.93:0/916256051 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f56380119c0 con 0x7f5648071bc0 2023-12-12T11:45:12.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:11 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:12.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:11 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:12.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:11 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "who": "osd/host:smithi063", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:45:12.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:11 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:12.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:11 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:12.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:11 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:12.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:11 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:12.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:11 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "who": "osd/host:smithi093", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:45:12.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:11 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:45:12.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:11 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:45:12.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:12.132+0000 7f564d2b4700 1 -- 172.21.15.93:0/916256051 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5648114f70 con 0x7f5648071bc0 2023-12-12T11:45:12.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:12.132+0000 7f562f7fe700 1 -- 172.21.15.93:0/916256051 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f5638011370 con 0x7f5648071bc0 2023-12-12T11:45:12.135 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:45:12.135 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":1,"fsid":"85e33c70-98e3-11ee-95a3-87774f69a715","modified":"2023-12-12T11:43:03.786943Z","created":"2023-12-12T11:43:03.786943Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-12T11:45:12.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:12.135+0000 7f564d2b4700 1 -- 172.21.15.93:0/916256051 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f5630036810 msgr2=0x7f5630038cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:45:12.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:12.135+0000 7f564d2b4700 1 --2- 172.21.15.93:0/916256051 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f5630036810 0x7f5630038cc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f563c009990 tx=0x7f563c006e40 comp rx=0 tx=0).stop 2023-12-12T11:45:12.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:12.135+0000 7f564d2b4700 1 -- 172.21.15.93:0/916256051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5648071bc0 msgr2=0x7f5648113040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:45:12.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:12.135+0000 7f564d2b4700 1 --2- 172.21.15.93:0/916256051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5648071bc0 0x7f5648113040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5638009040 tx=0x7f5638009e30 comp rx=0 tx=0).stop 2023-12-12T11:45:12.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:12.135+0000 7f564d2b4700 1 -- 172.21.15.93:0/916256051 shutdown_connections 2023-12-12T11:45:12.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:12.135+0000 7f564d2b4700 1 --2- 172.21.15.93:0/916256051 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f5630036810 0x7f5630038cc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:12.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:12.135+0000 7f564d2b4700 1 --2- 172.21.15.93:0/916256051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5648071bc0 0x7f5648113040 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:12.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:12.135+0000 7f564d2b4700 1 -- 172.21.15.93:0/916256051 >> 172.21.15.93:0/916256051 conn(0x7f56480f7f50 msgr2=0x7f56480f8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:45:12.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:12.135+0000 7f564d2b4700 1 -- 172.21.15.93:0/916256051 shutdown_connections 2023-12-12T11:45:12.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:12.135+0000 7f564d2b4700 1 -- 172.21.15.93:0/916256051 wait complete. 2023-12-12T11:45:12.138 INFO:teuthology.orchestra.run.smithi093.stderr:dumped monmap epoch 1 2023-12-12T11:45:13.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:12 smithi063 ceph-mon[107117]: Updating smithi063:/etc/ceph/ceph.conf 2023-12-12T11:45:13.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:12 smithi063 ceph-mon[107117]: Updating smithi093:/etc/ceph/ceph.conf 2023-12-12T11:45:13.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:12 smithi063 ceph-mon[107117]: from='client.? 172.21.15.93:0/916256051' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:45:13.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:12 smithi063 ceph-mon[107117]: Updating smithi093:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-12T11:45:13.561 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-12T11:45:13.562 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-12T11:45:13.974 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-12T11:45:14.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:13 smithi063 ceph-mon[107117]: Updating smithi063:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-12T11:45:14.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:13 smithi063 ceph-mon[107117]: Updating smithi093:/etc/ceph/ceph.client.admin.keyring 2023-12-12T11:45:14.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:13 smithi063 ceph-mon[107117]: Updating smithi063:/etc/ceph/ceph.client.admin.keyring 2023-12-12T11:45:15.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.104+0000 7f276589b700 1 -- 172.21.15.93:0/3118482215 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27601028d0 msgr2=0x7f2760102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:45:15.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.104+0000 7f276589b700 1 --2- 172.21.15.93:0/3118482215 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27601028d0 0x7f2760102ca0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f27500048c0 tx=0x7f2750009e30 comp rx=0 tx=0).stop 2023-12-12T11:45:15.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.104+0000 7f276589b700 1 -- 172.21.15.93:0/3118482215 shutdown_connections 2023-12-12T11:45:15.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.104+0000 7f276589b700 1 --2- 172.21.15.93:0/3118482215 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27601028d0 0x7f2760102ca0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:15.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.104+0000 7f276589b700 1 -- 172.21.15.93:0/3118482215 >> 172.21.15.93:0/3118482215 conn(0x7f27600f8410 msgr2=0x7f27600fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:45:15.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.104+0000 7f276589b700 1 -- 172.21.15.93:0/3118482215 shutdown_connections 2023-12-12T11:45:15.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.104+0000 7f276589b700 1 -- 172.21.15.93:0/3118482215 wait complete. 2023-12-12T11:45:15.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.105+0000 7f276589b700 1 Processor -- start 2023-12-12T11:45:15.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.105+0000 7f276589b700 1 -- start start 2023-12-12T11:45:15.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.106+0000 7f276589b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27601028d0 0x7f2760114df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:45:15.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.106+0000 7f276589b700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2760115330 con 0x7f27601028d0 2023-12-12T11:45:15.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.106+0000 7f275effd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27601028d0 0x7f2760114df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:45:15.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.106+0000 7f275effd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27601028d0 0x7f2760114df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.93:47758/0 (socket says 172.21.15.93:47758) 2023-12-12T11:45:15.109 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.106+0000 7f275effd700 1 -- 172.21.15.93:0/1101438655 learned_addr learned my addr 172.21.15.93:0/1101438655 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-12-12T11:45:15.109 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.106+0000 7f275effd700 1 -- 172.21.15.93:0/1101438655 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2750005040 con 0x7f27601028d0 2023-12-12T11:45:15.109 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.107+0000 7f275effd700 1 --2- 172.21.15.93:0/1101438655 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27601028d0 0x7f2760114df0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2750009040 tx=0x7f2750009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:45:15.109 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.107+0000 7f27477fe700 1 -- 172.21.15.93:0/1101438655 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2750004e60 con 0x7f27601028d0 2023-12-12T11:45:15.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.107+0000 7f276589b700 1 -- 172.21.15.93:0/1101438655 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2760115530 con 0x7f27601028d0 2023-12-12T11:45:15.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.107+0000 7f27477fe700 1 -- 172.21.15.93:0/1101438655 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2750009650 con 0x7f27601028d0 2023-12-12T11:45:15.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.107+0000 7f27477fe700 1 -- 172.21.15.93:0/1101438655 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f275001c3f0 con 0x7f27601028d0 2023-12-12T11:45:15.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.107+0000 7f276589b700 1 -- 172.21.15.93:0/1101438655 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27601159a0 con 0x7f27601028d0 2023-12-12T11:45:15.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.108+0000 7f27477fe700 1 -- 172.21.15.93:0/1101438655 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f27500097c0 con 0x7f27601028d0 2023-12-12T11:45:15.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.108+0000 7f276589b700 1 -- 172.21.15.93:0/1101438655 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f276005f270 con 0x7f27601028d0 2023-12-12T11:45:15.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.109+0000 7f27477fe700 1 --2- 172.21.15.93:0/1101438655 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f27480367c0 0x7f2748038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:45:15.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.109+0000 7f27477fe700 1 -- 172.21.15.93:0/1101438655 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f2750049a80 con 0x7f27601028d0 2023-12-12T11:45:15.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.109+0000 7f275e7fc700 1 --2- 172.21.15.93:0/1101438655 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f27480367c0 0x7f2748038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:45:15.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.110+0000 7f275e7fc700 1 --2- 172.21.15.93:0/1101438655 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f27480367c0 0x7f2748038c70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2754009990 tx=0x7f2754006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:45:15.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.113+0000 7f27477fe700 1 -- 172.21.15.93:0/1101438655 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2750011960 con 0x7f27601028d0 2023-12-12T11:45:15.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:14 smithi063 ceph-mon[107117]: Updating smithi093:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-12T11:45:15.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:14 smithi063 ceph-mon[107117]: Updating smithi063:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-12T11:45:15.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:14 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:15.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:14 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:15.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:14 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:15.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:14 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:15.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:14 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:15.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:14 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi093", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-12T11:45:15.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:14 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi093", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-12T11:45:15.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:14 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:45:15.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:14 smithi063 ceph-mon[107117]: Deploying daemon crash.smithi093 on smithi093 2023-12-12T11:45:15.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.402+0000 7f276589b700 1 -- 172.21.15.93:0/1101438655 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2760106a80 con 0x7f27601028d0 2023-12-12T11:45:15.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.403+0000 7f27477fe700 1 -- 172.21.15.93:0/1101438655 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f2750011370 con 0x7f27601028d0 2023-12-12T11:45:15.406 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:45:15.406 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":1,"fsid":"85e33c70-98e3-11ee-95a3-87774f69a715","modified":"2023-12-12T11:43:03.786943Z","created":"2023-12-12T11:43:03.786943Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-12T11:45:15.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.405+0000 7f276589b700 1 -- 172.21.15.93:0/1101438655 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f27480367c0 msgr2=0x7f2748038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:45:15.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.405+0000 7f276589b700 1 --2- 172.21.15.93:0/1101438655 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f27480367c0 0x7f2748038c70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2754009990 tx=0x7f2754006e40 comp rx=0 tx=0).stop 2023-12-12T11:45:15.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.405+0000 7f276589b700 1 -- 172.21.15.93:0/1101438655 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27601028d0 msgr2=0x7f2760114df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:45:15.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.405+0000 7f276589b700 1 --2- 172.21.15.93:0/1101438655 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27601028d0 0x7f2760114df0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2750009040 tx=0x7f2750009e30 comp rx=0 tx=0).stop 2023-12-12T11:45:15.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.406+0000 7f276589b700 1 -- 172.21.15.93:0/1101438655 shutdown_connections 2023-12-12T11:45:15.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.406+0000 7f276589b700 1 --2- 172.21.15.93:0/1101438655 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f27480367c0 0x7f2748038c70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:15.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.406+0000 7f276589b700 1 --2- 172.21.15.93:0/1101438655 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27601028d0 0x7f2760114df0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:15.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.406+0000 7f276589b700 1 -- 172.21.15.93:0/1101438655 >> 172.21.15.93:0/1101438655 conn(0x7f27600f8410 msgr2=0x7f276006fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:45:15.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.406+0000 7f276589b700 1 -- 172.21.15.93:0/1101438655 shutdown_connections 2023-12-12T11:45:15.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:15.406+0000 7f276589b700 1 -- 172.21.15.93:0/1101438655 wait complete. 2023-12-12T11:45:15.409 INFO:teuthology.orchestra.run.smithi093.stderr:dumped monmap epoch 1 2023-12-12T11:45:16.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:15 smithi063 ceph-mon[107117]: from='client.? 172.21.15.93:0/1101438655' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:45:17.092 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-12T11:45:17.092 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-12T11:45:17.527 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-12T11:45:18.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.698+0000 7f949d04d700 1 -- 172.21.15.93:0/3725684144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94981028d0 msgr2=0x7f9498102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:45:18.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.698+0000 7f949d04d700 1 --2- 172.21.15.93:0/3725684144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94981028d0 0x7f9498102ca0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f94880048c0 tx=0x7f9488009e30 comp rx=0 tx=0).stop 2023-12-12T11:45:18.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.698+0000 7f949d04d700 1 -- 172.21.15.93:0/3725684144 shutdown_connections 2023-12-12T11:45:18.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.698+0000 7f949d04d700 1 --2- 172.21.15.93:0/3725684144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94981028d0 0x7f9498102ca0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:18.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.698+0000 7f949d04d700 1 -- 172.21.15.93:0/3725684144 >> 172.21.15.93:0/3725684144 conn(0x7f94980f8410 msgr2=0x7f94980fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:45:18.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.698+0000 7f949d04d700 1 -- 172.21.15.93:0/3725684144 shutdown_connections 2023-12-12T11:45:18.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.698+0000 7f949d04d700 1 -- 172.21.15.93:0/3725684144 wait complete. 2023-12-12T11:45:18.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.699+0000 7f949d04d700 1 Processor -- start 2023-12-12T11:45:18.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.699+0000 7f949d04d700 1 -- start start 2023-12-12T11:45:18.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.700+0000 7f949d04d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94981028d0 0x7f9498114ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:45:18.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.700+0000 7f949d04d700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9498115400 con 0x7f94981028d0 2023-12-12T11:45:18.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.700+0000 7f9496d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94981028d0 0x7f9498114ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:45:18.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.700+0000 7f9496d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94981028d0 0x7f9498114ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.93:37570/0 (socket says 172.21.15.93:37570) 2023-12-12T11:45:18.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.700+0000 7f9496d9d700 1 -- 172.21.15.93:0/1529841643 learned_addr learned my addr 172.21.15.93:0/1529841643 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-12-12T11:45:18.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.701+0000 7f9496d9d700 1 -- 172.21.15.93:0/1529841643 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9488005040 con 0x7f94981028d0 2023-12-12T11:45:18.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.701+0000 7f9496d9d700 1 --2- 172.21.15.93:0/1529841643 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94981028d0 0x7f9498114ec0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9488009040 tx=0x7f9488009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:45:18.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.701+0000 7f947f7fe700 1 -- 172.21.15.93:0/1529841643 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9488004e60 con 0x7f94981028d0 2023-12-12T11:45:18.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.701+0000 7f949d04d700 1 -- 172.21.15.93:0/1529841643 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9498115600 con 0x7f94981028d0 2023-12-12T11:45:18.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.701+0000 7f947f7fe700 1 -- 172.21.15.93:0/1529841643 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9488009650 con 0x7f94981028d0 2023-12-12T11:45:18.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.701+0000 7f947f7fe700 1 -- 172.21.15.93:0/1529841643 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f948801c3f0 con 0x7f94981028d0 2023-12-12T11:45:18.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.701+0000 7f949d04d700 1 -- 172.21.15.93:0/1529841643 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9498115a70 con 0x7f94981028d0 2023-12-12T11:45:18.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.702+0000 7f949d04d700 1 -- 172.21.15.93:0/1529841643 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f949805f270 con 0x7f94981028d0 2023-12-12T11:45:18.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.702+0000 7f947f7fe700 1 -- 172.21.15.93:0/1529841643 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f94880097c0 con 0x7f94981028d0 2023-12-12T11:45:18.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.703+0000 7f947f7fe700 1 --2- 172.21.15.93:0/1529841643 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f94800367c0 0x7f9480038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:45:18.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.703+0000 7f947f7fe700 1 -- 172.21.15.93:0/1529841643 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f9488049a80 con 0x7f94981028d0 2023-12-12T11:45:18.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.703+0000 7f949659c700 1 --2- 172.21.15.93:0/1529841643 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f94800367c0 0x7f9480038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:45:18.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.704+0000 7f949659c700 1 --2- 172.21.15.93:0/1529841643 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f94800367c0 0x7f9480038c70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f948c009990 tx=0x7f948c006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:45:18.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.708+0000 7f947f7fe700 1 -- 172.21.15.93:0/1529841643 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9488011940 con 0x7f94981028d0 2023-12-12T11:45:18.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:18 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:18.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:18 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:18.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:18 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:18.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:18 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:18.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:18 smithi063 ceph-mon[107117]: Deploying daemon node-exporter.smithi093 on smithi093 2023-12-12T11:45:18.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.990+0000 7f949d04d700 1 -- 172.21.15.93:0/1529841643 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9498110530 con 0x7f94981028d0 2023-12-12T11:45:18.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.991+0000 7f947f7fe700 1 -- 172.21.15.93:0/1529841643 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f9488011370 con 0x7f94981028d0 2023-12-12T11:45:18.993 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:45:18.993 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":1,"fsid":"85e33c70-98e3-11ee-95a3-87774f69a715","modified":"2023-12-12T11:43:03.786943Z","created":"2023-12-12T11:43:03.786943Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-12T11:45:18.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.993+0000 7f949d04d700 1 -- 172.21.15.93:0/1529841643 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f94800367c0 msgr2=0x7f9480038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:45:18.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.993+0000 7f949d04d700 1 --2- 172.21.15.93:0/1529841643 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f94800367c0 0x7f9480038c70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f948c009990 tx=0x7f948c006e40 comp rx=0 tx=0).stop 2023-12-12T11:45:18.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.993+0000 7f949d04d700 1 -- 172.21.15.93:0/1529841643 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94981028d0 msgr2=0x7f9498114ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:45:18.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.993+0000 7f949d04d700 1 --2- 172.21.15.93:0/1529841643 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94981028d0 0x7f9498114ec0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9488009040 tx=0x7f9488009e30 comp rx=0 tx=0).stop 2023-12-12T11:45:18.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.993+0000 7f949d04d700 1 -- 172.21.15.93:0/1529841643 shutdown_connections 2023-12-12T11:45:18.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.993+0000 7f949d04d700 1 --2- 172.21.15.93:0/1529841643 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f94800367c0 0x7f9480038c70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:18.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.993+0000 7f949d04d700 1 --2- 172.21.15.93:0/1529841643 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94981028d0 0x7f9498114ec0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:18.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.994+0000 7f949d04d700 1 -- 172.21.15.93:0/1529841643 >> 172.21.15.93:0/1529841643 conn(0x7f94980f8410 msgr2=0x7f94980fa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:45:18.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.994+0000 7f949d04d700 1 -- 172.21.15.93:0/1529841643 shutdown_connections 2023-12-12T11:45:18.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:18.994+0000 7f949d04d700 1 -- 172.21.15.93:0/1529841643 wait complete. 2023-12-12T11:45:18.997 INFO:teuthology.orchestra.run.smithi093.stderr:dumped monmap epoch 1 2023-12-12T11:45:19.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:19 smithi063 ceph-mon[107117]: from='client.? 172.21.15.93:0/1529841643' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:45:20.368 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-12T11:45:20.369 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-12T11:45:20.843 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-12T11:45:22.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:21 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:22.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:21 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:45:22.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:21 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:22.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:21 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:22.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:21 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:22.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:21 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:22.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:21 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi093.nbtltu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-12T11:45:22.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:21 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi093.nbtltu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-12T11:45:22.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:21 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-12T11:45:22.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:21 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:45:22.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.357+0000 7f4ededce700 1 -- 172.21.15.93:0/847828497 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ed806ffe0 msgr2=0x7f4ed80703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:45:22.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.357+0000 7f4ededce700 1 --2- 172.21.15.93:0/847828497 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ed806ffe0 0x7f4ed80703b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc0048c0 tx=0x7f4ecc009e30 comp rx=0 tx=0).stop 2023-12-12T11:45:22.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.358+0000 7f4ededce700 1 -- 172.21.15.93:0/847828497 shutdown_connections 2023-12-12T11:45:22.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.358+0000 7f4ededce700 1 --2- 172.21.15.93:0/847828497 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ed806ffe0 0x7f4ed80703b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:22.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.358+0000 7f4ededce700 1 -- 172.21.15.93:0/847828497 >> 172.21.15.93:0/847828497 conn(0x7f4ed80f8410 msgr2=0x7f4ed80fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:45:22.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.358+0000 7f4ededce700 1 -- 172.21.15.93:0/847828497 shutdown_connections 2023-12-12T11:45:22.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.358+0000 7f4ededce700 1 -- 172.21.15.93:0/847828497 wait complete. 2023-12-12T11:45:22.361 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.358+0000 7f4ededce700 1 Processor -- start 2023-12-12T11:45:22.361 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.359+0000 7f4ededce700 1 -- start start 2023-12-12T11:45:22.361 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.359+0000 7f4ededce700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ed806ffe0 0x7f4ed8114da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:45:22.361 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.359+0000 7f4ededce700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed81152e0 con 0x7f4ed806ffe0 2023-12-12T11:45:22.362 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.359+0000 7f4edcb6a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ed806ffe0 0x7f4ed8114da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:45:22.362 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.359+0000 7f4edcb6a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ed806ffe0 0x7f4ed8114da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.93:37594/0 (socket says 172.21.15.93:37594) 2023-12-12T11:45:22.362 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.359+0000 7f4edcb6a700 1 -- 172.21.15.93:0/2331657313 learned_addr learned my addr 172.21.15.93:0/2331657313 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-12-12T11:45:22.362 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.360+0000 7f4edcb6a700 1 -- 172.21.15.93:0/2331657313 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ecc005040 con 0x7f4ed806ffe0 2023-12-12T11:45:22.362 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.360+0000 7f4edcb6a700 1 --2- 172.21.15.93:0/2331657313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ed806ffe0 0x7f4ed8114da0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc009300 tx=0x7f4ecc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:45:22.362 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.360+0000 7f4ed57fa700 1 -- 172.21.15.93:0/2331657313 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ecc004e60 con 0x7f4ed806ffe0 2023-12-12T11:45:22.363 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.360+0000 7f4ededce700 1 -- 172.21.15.93:0/2331657313 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed81154e0 con 0x7f4ed806ffe0 2023-12-12T11:45:22.363 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.360+0000 7f4ed57fa700 1 -- 172.21.15.93:0/2331657313 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4ecc013420 con 0x7f4ed806ffe0 2023-12-12T11:45:22.363 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.360+0000 7f4ed57fa700 1 -- 172.21.15.93:0/2331657313 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ecc01c5b0 con 0x7f4ed806ffe0 2023-12-12T11:45:22.363 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.361+0000 7f4ededce700 1 -- 172.21.15.93:0/2331657313 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed8115950 con 0x7f4ed806ffe0 2023-12-12T11:45:22.364 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.361+0000 7f4ededce700 1 -- 172.21.15.93:0/2331657313 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed805f270 con 0x7f4ed806ffe0 2023-12-12T11:45:22.364 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.362+0000 7f4ed57fa700 1 -- 172.21.15.93:0/2331657313 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f4ecc0139e0 con 0x7f4ed806ffe0 2023-12-12T11:45:22.364 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.362+0000 7f4ed57fa700 1 --2- 172.21.15.93:0/2331657313 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4ec8036810 0x7f4ec8038cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:45:22.364 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.362+0000 7f4ed57fa700 1 -- 172.21.15.93:0/2331657313 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f4ecc049a60 con 0x7f4ed806ffe0 2023-12-12T11:45:22.364 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.362+0000 7f4ed7fff700 1 --2- 172.21.15.93:0/2331657313 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4ec8036810 0x7f4ec8038cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:45:22.365 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.363+0000 7f4ed7fff700 1 --2- 172.21.15.93:0/2331657313 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4ec8036810 0x7f4ec8038cc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4009990 tx=0x7f4ec4006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:45:22.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.368+0000 7f4ed57fa700 1 -- 172.21.15.93:0/2331657313 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4ecc011960 con 0x7f4ed806ffe0 2023-12-12T11:45:22.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.669+0000 7f4ededce700 1 -- 172.21.15.93:0/2331657313 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4ed81103b0 con 0x7f4ed806ffe0 2023-12-12T11:45:22.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.669+0000 7f4ed57fa700 1 -- 172.21.15.93:0/2331657313 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f4ecc011370 con 0x7f4ed806ffe0 2023-12-12T11:45:22.672 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:45:22.672 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":1,"fsid":"85e33c70-98e3-11ee-95a3-87774f69a715","modified":"2023-12-12T11:43:03.786943Z","created":"2023-12-12T11:43:03.786943Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-12T11:45:22.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.672+0000 7f4ededce700 1 -- 172.21.15.93:0/2331657313 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4ec8036810 msgr2=0x7f4ec8038cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:45:22.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.672+0000 7f4ededce700 1 --2- 172.21.15.93:0/2331657313 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4ec8036810 0x7f4ec8038cc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4009990 tx=0x7f4ec4006e40 comp rx=0 tx=0).stop 2023-12-12T11:45:22.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.672+0000 7f4ededce700 1 -- 172.21.15.93:0/2331657313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ed806ffe0 msgr2=0x7f4ed8114da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:45:22.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.672+0000 7f4ededce700 1 --2- 172.21.15.93:0/2331657313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ed806ffe0 0x7f4ed8114da0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc009300 tx=0x7f4ecc009e30 comp rx=0 tx=0).stop 2023-12-12T11:45:22.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.672+0000 7f4ededce700 1 -- 172.21.15.93:0/2331657313 shutdown_connections 2023-12-12T11:45:22.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.672+0000 7f4ededce700 1 --2- 172.21.15.93:0/2331657313 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4ec8036810 0x7f4ec8038cc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:22.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.672+0000 7f4ededce700 1 --2- 172.21.15.93:0/2331657313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ed806ffe0 0x7f4ed8114da0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:22.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.672+0000 7f4ededce700 1 -- 172.21.15.93:0/2331657313 >> 172.21.15.93:0/2331657313 conn(0x7f4ed80f8410 msgr2=0x7f4ed81033d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:45:22.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.672+0000 7f4ededce700 1 -- 172.21.15.93:0/2331657313 shutdown_connections 2023-12-12T11:45:22.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:22.672+0000 7f4ededce700 1 -- 172.21.15.93:0/2331657313 wait complete. 2023-12-12T11:45:22.675 INFO:teuthology.orchestra.run.smithi093.stderr:dumped monmap epoch 1 2023-12-12T11:45:23.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:22 smithi063 ceph-mon[107117]: Deploying daemon mgr.smithi093.nbtltu on smithi093 2023-12-12T11:45:23.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:22 smithi063 ceph-mon[107117]: from='client.? 172.21.15.93:0/2331657313' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:45:24.289 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-12T11:45:24.290 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-12T11:45:24.769 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-12T11:45:25.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:25 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:25.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:25 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:25.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:25 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:25.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:25 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:25.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:25 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-12T11:45:25.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:25 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:45:26.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.473+0000 7fdf2fe50700 1 -- 172.21.15.93:0/976714950 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf2806ff60 msgr2=0x7fdf28070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:45:26.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.473+0000 7fdf2fe50700 1 --2- 172.21.15.93:0/976714950 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf2806ff60 0x7fdf28070330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdf240048c0 tx=0x7fdf24009e30 comp rx=0 tx=0).stop 2023-12-12T11:45:26.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.473+0000 7fdf2fe50700 1 -- 172.21.15.93:0/976714950 shutdown_connections 2023-12-12T11:45:26.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.473+0000 7fdf2fe50700 1 --2- 172.21.15.93:0/976714950 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf2806ff60 0x7fdf28070330 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:26.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.473+0000 7fdf2fe50700 1 -- 172.21.15.93:0/976714950 >> 172.21.15.93:0/976714950 conn(0x7fdf280f8410 msgr2=0x7fdf280fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:45:26.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.473+0000 7fdf2fe50700 1 -- 172.21.15.93:0/976714950 shutdown_connections 2023-12-12T11:45:26.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.473+0000 7fdf2fe50700 1 -- 172.21.15.93:0/976714950 wait complete. 2023-12-12T11:45:26.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.474+0000 7fdf2fe50700 1 Processor -- start 2023-12-12T11:45:26.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.475+0000 7fdf2fe50700 1 -- start start 2023-12-12T11:45:26.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.475+0000 7fdf2fe50700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf2806ff60 0x7fdf28114db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:45:26.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.475+0000 7fdf2fe50700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf281152f0 con 0x7fdf2806ff60 2023-12-12T11:45:26.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.476+0000 7fdf2dbec700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf2806ff60 0x7fdf28114db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:45:26.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.476+0000 7fdf2dbec700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf2806ff60 0x7fdf28114db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.93:49536/0 (socket says 172.21.15.93:49536) 2023-12-12T11:45:26.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.476+0000 7fdf2dbec700 1 -- 172.21.15.93:0/4195804752 learned_addr learned my addr 172.21.15.93:0/4195804752 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-12-12T11:45:26.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.476+0000 7fdf2dbec700 1 -- 172.21.15.93:0/4195804752 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf24005040 con 0x7fdf2806ff60 2023-12-12T11:45:26.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.476+0000 7fdf2dbec700 1 --2- 172.21.15.93:0/4195804752 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf2806ff60 0x7fdf28114db0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdf24009040 tx=0x7fdf24009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:45:26.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.477+0000 7fdf1e7fc700 1 -- 172.21.15.93:0/4195804752 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf24004e60 con 0x7fdf2806ff60 2023-12-12T11:45:26.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.477+0000 7fdf2fe50700 1 -- 172.21.15.93:0/4195804752 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf281154f0 con 0x7fdf2806ff60 2023-12-12T11:45:26.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.477+0000 7fdf1e7fc700 1 -- 172.21.15.93:0/4195804752 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdf24009650 con 0x7fdf2806ff60 2023-12-12T11:45:26.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.477+0000 7fdf1e7fc700 1 -- 172.21.15.93:0/4195804752 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf2401c3f0 con 0x7fdf2806ff60 2023-12-12T11:45:26.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.477+0000 7fdf2fe50700 1 -- 172.21.15.93:0/4195804752 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf28115960 con 0x7fdf2806ff60 2023-12-12T11:45:26.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.478+0000 7fdf1e7fc700 1 -- 172.21.15.93:0/4195804752 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7fdf2401c6b0 con 0x7fdf2806ff60 2023-12-12T11:45:26.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.478+0000 7fdf2fe50700 1 -- 172.21.15.93:0/4195804752 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf2805f270 con 0x7fdf2806ff60 2023-12-12T11:45:26.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.479+0000 7fdf1e7fc700 1 --2- 172.21.15.93:0/4195804752 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fdf140367c0 0x7fdf14038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:45:26.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.479+0000 7fdf1e7fc700 1 -- 172.21.15.93:0/4195804752 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fdf240499e0 con 0x7fdf2806ff60 2023-12-12T11:45:26.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.479+0000 7fdf2d3eb700 1 --2- 172.21.15.93:0/4195804752 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fdf140367c0 0x7fdf14038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:45:26.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.480+0000 7fdf2d3eb700 1 --2- 172.21.15.93:0/4195804752 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fdf140367c0 0x7fdf14038c70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009990 tx=0x7fdf18006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:45:26.486 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.484+0000 7fdf1e7fc700 1 -- 172.21.15.93:0/4195804752 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdf24025400 con 0x7fdf2806ff60 2023-12-12T11:45:26.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:26 smithi063 ceph-mon[107117]: Deploying daemon mon.smithi093 on smithi093 2023-12-12T11:45:26.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:26 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:26.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.794+0000 7fdf2fe50700 1 -- 172.21.15.93:0/4195804752 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fdf28108c80 con 0x7fdf2806ff60 2023-12-12T11:45:26.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.795+0000 7fdf1e7fc700 1 -- 172.21.15.93:0/4195804752 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fdf240491f0 con 0x7fdf2806ff60 2023-12-12T11:45:26.798 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:45:26.798 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":1,"fsid":"85e33c70-98e3-11ee-95a3-87774f69a715","modified":"2023-12-12T11:43:03.786943Z","created":"2023-12-12T11:43:03.786943Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-12T11:45:26.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.799+0000 7fdf2fe50700 1 -- 172.21.15.93:0/4195804752 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fdf140367c0 msgr2=0x7fdf14038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:45:26.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.799+0000 7fdf2fe50700 1 --2- 172.21.15.93:0/4195804752 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fdf140367c0 0x7fdf14038c70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009990 tx=0x7fdf18006e40 comp rx=0 tx=0).stop 2023-12-12T11:45:26.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.799+0000 7fdf2fe50700 1 -- 172.21.15.93:0/4195804752 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf2806ff60 msgr2=0x7fdf28114db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:45:26.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.799+0000 7fdf2fe50700 1 --2- 172.21.15.93:0/4195804752 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf2806ff60 0x7fdf28114db0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdf24009040 tx=0x7fdf24009e30 comp rx=0 tx=0).stop 2023-12-12T11:45:26.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.799+0000 7fdf2fe50700 1 -- 172.21.15.93:0/4195804752 shutdown_connections 2023-12-12T11:45:26.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.799+0000 7fdf2fe50700 1 --2- 172.21.15.93:0/4195804752 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fdf140367c0 0x7fdf14038c70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:26.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.799+0000 7fdf2fe50700 1 --2- 172.21.15.93:0/4195804752 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf2806ff60 0x7fdf28114db0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:26.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.799+0000 7fdf2fe50700 1 -- 172.21.15.93:0/4195804752 >> 172.21.15.93:0/4195804752 conn(0x7fdf280f8410 msgr2=0x7fdf28103450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:45:26.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.799+0000 7fdf2fe50700 1 -- 172.21.15.93:0/4195804752 shutdown_connections 2023-12-12T11:45:26.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:26.800+0000 7fdf2fe50700 1 -- 172.21.15.93:0/4195804752 wait complete. 2023-12-12T11:45:26.803 INFO:teuthology.orchestra.run.smithi093.stderr:dumped monmap epoch 1 2023-12-12T11:45:27.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 systemd[1]: Starting Ceph mon.smithi093 for 85e33c70-98e3-11ee-95a3-87774f69a715... 2023-12-12T11:45:27.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:27 smithi063 ceph-mon[107117]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:27.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:27 smithi063 ceph-mon[107117]: from='client.? 172.21.15.93:0/4195804752' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:45:27.975 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 bash[115875]: fac71666a805187473d4dfbff0cc28c55a9edbee331beda999acdb682d8a4982 2023-12-12T11:45:27.975 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: set uid:gid to 167:167 (ceph:ceph) 2023-12-12T11:45:27.976 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable), process ceph-mon, pid 7 2023-12-12T11:45:27.976 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: pidfile_write: ignore empty --pid-file 2023-12-12T11:45:27.976 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 systemd[1]: Started Ceph mon.smithi093 for 85e33c70-98e3-11ee-95a3-87774f69a715. 2023-12-12T11:45:27.976 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: load: jerasure load: lrc 2023-12-12T11:45:27.976 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: RocksDB version: 6.15.5 2023-12-12T11:45:27.976 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-12-12T11:45:27.977 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Compile date Dec 11 2023 2023-12-12T11:45:27.977 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: DB SUMMARY 2023-12-12T11:45:27.977 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: DB Session ID: 33IY8SJYRKEXTZI4JRQS 2023-12-12T11:45:27.977 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: CURRENT file: CURRENT 2023-12-12T11:45:27.977 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: IDENTITY file: IDENTITY 2023-12-12T11:45:27.977 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2023-12-12T11:45:27.978 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi093/store.db dir, Total Num: 0, files: 2023-12-12T11:45:27.978 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi093/store.db: 000004.log size: 511 ; 2023-12-12T11:45:27.978 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.error_if_exists: 0 2023-12-12T11:45:27.978 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.create_if_missing: 0 2023-12-12T11:45:27.978 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.paranoid_checks: 1 2023-12-12T11:45:27.978 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-12T11:45:27.979 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.env: 0x55763fb59a80 2023-12-12T11:45:27.979 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.fs: Posix File System 2023-12-12T11:45:27.979 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.info_log: 0x557640b74780 2023-12-12T11:45:27.979 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.max_file_opening_threads: 16 2023-12-12T11:45:27.979 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.statistics: (nil) 2023-12-12T11:45:27.979 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.use_fsync: 0 2023-12-12T11:45:27.979 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.max_log_file_size: 0 2023-12-12T11:45:27.979 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-12T11:45:27.979 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-12T11:45:27.980 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.keep_log_file_num: 1000 2023-12-12T11:45:27.980 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.recycle_log_file_num: 0 2023-12-12T11:45:27.980 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.allow_fallocate: 1 2023-12-12T11:45:27.980 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.allow_mmap_reads: 0 2023-12-12T11:45:27.980 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.allow_mmap_writes: 0 2023-12-12T11:45:27.980 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.use_direct_reads: 0 2023-12-12T11:45:27.980 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-12T11:45:27.980 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.create_missing_column_families: 0 2023-12-12T11:45:27.980 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.db_log_dir: 2023-12-12T11:45:27.981 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi093/store.db 2023-12-12T11:45:27.981 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-12T11:45:27.981 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-12T11:45:27.981 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-12T11:45:27.981 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-12T11:45:27.981 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-12T11:45:27.981 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-12T11:45:27.981 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.advise_random_on_open: 1 2023-12-12T11:45:27.981 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.db_write_buffer_size: 0 2023-12-12T11:45:27.982 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.write_buffer_manager: 0x5576418e49f0 2023-12-12T11:45:27.982 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-12T11:45:27.982 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-12-12T11:45:27.982 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-12T11:45:27.982 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-12T11:45:27.982 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.rate_limiter: (nil) 2023-12-12T11:45:27.982 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-12T11:45:27.982 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.wal_recovery_mode: 2 2023-12-12T11:45:27.983 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.enable_thread_tracking: 0 2023-12-12T11:45:27.983 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.enable_pipelined_write: 0 2023-12-12T11:45:27.983 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.unordered_write: 0 2023-12-12T11:45:27.983 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-12T11:45:27.983 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-12T11:45:27.983 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-12T11:45:27.983 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-12T11:45:27.983 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.row_cache: None 2023-12-12T11:45:27.984 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.wal_filter: None 2023-12-12T11:45:27.984 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-12T11:45:27.984 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.allow_ingest_behind: 0 2023-12-12T11:45:27.984 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.preserve_deletes: 0 2023-12-12T11:45:27.984 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.two_write_queues: 0 2023-12-12T11:45:27.984 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.manual_wal_flush: 0 2023-12-12T11:45:27.984 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.atomic_flush: 0 2023-12-12T11:45:27.984 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-12T11:45:27.984 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-12T11:45:27.984 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-12T11:45:27.984 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.log_readahead_size: 0 2023-12-12T11:45:27.984 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-12T11:45:27.984 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.best_efforts_recovery: 0 2023-12-12T11:45:27.984 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-12T11:45:27.984 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-12T11:45:27.985 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.allow_data_in_errors: 0 2023-12-12T11:45:27.985 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.db_host_id: __hostname__ 2023-12-12T11:45:27.985 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.max_background_jobs: 2 2023-12-12T11:45:27.985 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.max_background_compactions: -1 2023-12-12T11:45:27.985 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.max_subcompactions: 1 2023-12-12T11:45:27.985 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-12T11:45:27.985 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-12T11:45:27.985 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-12T11:45:27.985 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.max_total_wal_size: 0 2023-12-12T11:45:27.985 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-12T11:45:27.985 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-12T11:45:27.985 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-12T11:45:27.985 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-12T11:45:27.985 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.max_open_files: -1 2023-12-12T11:45:27.986 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.bytes_per_sync: 0 2023-12-12T11:45:27.986 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-12T11:45:27.986 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-12T11:45:27.986 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.compaction_readahead_size: 0 2023-12-12T11:45:27.986 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.max_background_flushes: -1 2023-12-12T11:45:27.986 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Compression algorithms supported: 2023-12-12T11:45:27.986 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-12T11:45:27.986 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: kZSTD supported: 0 2023-12-12T11:45:27.986 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: kXpressCompression supported: 0 2023-12-12T11:45:27.986 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: kLZ4HCCompression supported: 1 2023-12-12T11:45:27.986 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: kZlibCompression supported: 1 2023-12-12T11:45:27.986 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: kSnappyCompression supported: 1 2023-12-12T11:45:27.986 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: kLZ4Compression supported: 1 2023-12-12T11:45:27.986 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: kBZip2Compression supported: 0 2023-12-12T11:45:27.987 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-12T11:45:27.987 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi093/store.db/MANIFEST-000003 2023-12-12T11:45:27.987 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2023-12-12T11:45:27.987 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-12T11:45:27.987 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.merge_operator: 2023-12-12T11:45:27.987 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.compaction_filter: None 2023-12-12T11:45:27.987 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.compaction_filter_factory: None 2023-12-12T11:45:27.987 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.sst_partitioner_factory: None 2023-12-12T11:45:27.987 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-12T11:45:27.987 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-12T11:45:27.987 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557640bc4f90) 2023-12-12T11:45:27.987 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: cache_index_and_filter_blocks: 1 2023-12-12T11:45:27.987 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-12T11:45:27.987 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-12T11:45:27.987 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: pin_top_level_index_and_filter: 1 2023-12-12T11:45:27.988 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: index_type: 0 2023-12-12T11:45:27.988 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: data_block_index_type: 0 2023-12-12T11:45:27.988 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: index_shortening: 1 2023-12-12T11:45:27.988 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-12T11:45:27.988 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: hash_index_allow_collision: 1 2023-12-12T11:45:27.988 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: checksum: 1 2023-12-12T11:45:27.988 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: no_block_cache: 0 2023-12-12T11:45:27.988 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: block_cache: 0x557640bf7090 2023-12-12T11:45:27.988 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: block_cache_name: BinnedLRUCache 2023-12-12T11:45:27.988 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: block_cache_options: 2023-12-12T11:45:27.988 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: capacity : 536870912 2023-12-12T11:45:27.988 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: num_shard_bits : 4 2023-12-12T11:45:27.988 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: strict_capacity_limit : 0 2023-12-12T11:45:27.988 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: high_pri_pool_ratio: 0.000 2023-12-12T11:45:27.989 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: block_cache_compressed: (nil) 2023-12-12T11:45:27.989 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: persistent_cache: (nil) 2023-12-12T11:45:27.989 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: block_size: 4096 2023-12-12T11:45:27.989 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: block_size_deviation: 10 2023-12-12T11:45:27.989 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: block_restart_interval: 16 2023-12-12T11:45:27.989 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: index_block_restart_interval: 1 2023-12-12T11:45:27.989 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: metadata_block_size: 4096 2023-12-12T11:45:27.989 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: partition_filters: 0 2023-12-12T11:45:27.989 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: use_delta_encoding: 1 2023-12-12T11:45:27.989 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2023-12-12T11:45:27.989 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: whole_key_filtering: 1 2023-12-12T11:45:27.989 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: verify_compression: 0 2023-12-12T11:45:27.989 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: read_amp_bytes_per_bit: 0 2023-12-12T11:45:27.989 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: format_version: 4 2023-12-12T11:45:27.989 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: enable_index_compression: 1 2023-12-12T11:45:27.989 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: block_align: 0 2023-12-12T11:45:27.990 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.write_buffer_size: 33554432 2023-12-12T11:45:27.990 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.max_write_buffer_number: 2 2023-12-12T11:45:27.990 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.compression: NoCompression 2023-12-12T11:45:27.990 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.bottommost_compression: Disabled 2023-12-12T11:45:27.990 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.prefix_extractor: nullptr 2023-12-12T11:45:27.990 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-12T11:45:27.990 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.num_levels: 7 2023-12-12T11:45:27.990 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-12T11:45:27.990 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-12T11:45:27.990 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-12T11:45:27.990 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-12T11:45:27.990 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-12T11:45:27.990 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-12T11:45:27.991 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-12T11:45:27.991 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-12T11:45:27.991 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-12T11:45:27.991 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-12T11:45:27.991 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-12T11:45:27.991 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.compression_opts.level: 32767 2023-12-12T11:45:27.991 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.compression_opts.strategy: 0 2023-12-12T11:45:27.991 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-12T11:45:27.991 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-12T11:45:27.991 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-12T11:45:27.991 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.compression_opts.enabled: false 2023-12-12T11:45:27.991 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-12T11:45:27.991 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-12T11:45:27.991 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-12T11:45:27.991 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.target_file_size_base: 67108864 2023-12-12T11:45:27.992 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-12T11:45:27.992 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-12T11:45:27.992 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-12T11:45:27.992 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-12T11:45:27.992 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-12T11:45:27.992 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-12T11:45:27.992 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-12T11:45:27.992 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-12T11:45:27.992 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-12T11:45:27.992 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-12T11:45:27.992 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-12T11:45:27.992 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-12T11:45:27.992 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-12T11:45:27.992 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.arena_block_size: 4194304 2023-12-12T11:45:27.992 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-12T11:45:27.993 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-12T11:45:27.993 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-12-12T11:45:27.993 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.disable_auto_compactions: 0 2023-12-12T11:45:27.993 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-12T11:45:27.993 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-12T11:45:27.993 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-12T11:45:27.993 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-12T11:45:27.993 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-12T11:45:27.993 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-12T11:45:27.993 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-12T11:45:27.993 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-12T11:45:27.993 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-12T11:45:27.993 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-12T11:45:27.993 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.table_properties_collectors: 2023-12-12T11:45:27.993 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.inplace_update_support: 0 2023-12-12T11:45:27.994 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-12T11:45:27.994 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-12T11:45:27.994 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-12T11:45:27.994 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-12T11:45:27.994 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.bloom_locality: 0 2023-12-12T11:45:27.994 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.max_successive_merges: 0 2023-12-12T11:45:27.994 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-12T11:45:27.994 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.paranoid_file_checks: 0 2023-12-12T11:45:27.994 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.force_consistency_checks: 1 2023-12-12T11:45:27.994 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.report_bg_io_stats: 0 2023-12-12T11:45:27.994 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.ttl: 2592000 2023-12-12T11:45:27.994 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-12T11:45:27.994 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.enable_blob_files: false 2023-12-12T11:45:27.994 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.min_blob_size: 0 2023-12-12T11:45:27.994 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.blob_file_size: 268435456 2023-12-12T11:45:27.995 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-12T11:45:27.995 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-12T11:45:27.995 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-12T11:45:27.995 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi093/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-12T11:45:27.995 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2023-12-12T11:45:27.995 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: [db/version_set.cc:4082] Creating manifest 7 2023-12-12T11:45:27.995 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702381527831867, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-12-12T11:45:27.995 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2023-12-12T11:45:27.995 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-12-12T11:45:27.995 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702381527832443, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1545, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1702381527, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "da635135-4875-40ac-a671-88ceaf0546de", "db_session_id": "33IY8SJYRKEXTZI4JRQS"}} 2023-12-12T11:45:27.995 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: [db/version_set.cc:4082] Creating manifest 9 2023-12-12T11:45:27.995 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702381527833039, "job": 1, "event": "recovery_finished"} 2023-12-12T11:45:27.995 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi093/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-12T11:45:27.995 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x557640b8b180 2023-12-12T11:45:27.996 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: DB pointer 0x557640c60000 2023-12-12T11:45:27.996 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2023-12-12T11:45:27.996 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: rocksdb: [db/db_impl/db_impl.cc:903] 2023-12-12T11:45:27.996 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: ** DB Stats ** 2023-12-12T11:45:27.996 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-12T11:45:27.996 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-12T11:45:27.996 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-12T11:45:27.996 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-12T11:45:27.996 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-12T11:45:27.996 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-12-12T11:45:27.996 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-12T11:45:27.996 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: 2023-12-12T11:45:27.996 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: ** Compaction Stats [default] ** 2023-12-12T11:45:27.996 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-12T11:45:27.996 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-12T11:45:27.997 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 2023-12-12T11:45:27.997 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 2023-12-12T11:45:27.997 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 2023-12-12T11:45:27.997 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: 2023-12-12T11:45:27.997 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: ** Compaction Stats [default] ** 2023-12-12T11:45:27.997 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-12T11:45:27.997 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-12T11:45:27.997 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.8 0.00 0.00 1 0.001 0 0 2023-12-12T11:45:27.997 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-12T11:45:27.997 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-12T11:45:27.997 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-12T11:45:27.997 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-12T11:45:27.997 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-12T11:45:27.997 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-12T11:45:27.997 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Cumulative compaction: 0.00 GB write, 0.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-12T11:45:27.998 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Interval compaction: 0.00 GB write, 0.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-12T11:45:27.998 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-12T11:45:27.998 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: 2023-12-12T11:45:27.998 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-12T11:45:27.998 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: 2023-12-12T11:45:27.998 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: ** Compaction Stats [default] ** 2023-12-12T11:45:27.998 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-12T11:45:27.998 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-12T11:45:27.998 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 2023-12-12T11:45:27.998 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 2023-12-12T11:45:27.998 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-12-12T11:45:27.998 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: 2023-12-12T11:45:27.998 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: ** Compaction Stats [default] ** 2023-12-12T11:45:27.998 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-12T11:45:27.998 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-12T11:45:27.999 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.8 0.00 0.00 1 0.001 0 0 2023-12-12T11:45:27.999 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-12T11:45:27.999 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-12T11:45:27.999 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-12T11:45:27.999 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-12T11:45:27.999 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-12T11:45:27.999 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-12T11:45:27.999 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Cumulative compaction: 0.00 GB write, 0.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-12T11:45:27.999 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-12T11:45:27.999 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-12T11:45:27.999 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: 2023-12-12T11:45:27.999 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-12T11:45:27.999 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: mon.smithi093 does not exist in monmap, will attempt to join an existing cluster 2023-12-12T11:45:27.999 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: using public_addr v2:172.21.15.93:0/0 -> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] 2023-12-12T11:45:27.999 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: starting mon.smithi093 rank -1 at public addrs [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] at bind addrs [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi093 fsid 85e33c70-98e3-11ee-95a3-87774f69a715 2023-12-12T11:45:28.000 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: mon.smithi093@-1(???) e0 preinit fsid 85e33c70-98e3-11ee-95a3-87774f69a715 2023-12-12T11:45:28.000 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: mon.smithi093@-1(synchronizing).mds e1 new map 2023-12-12T11:45:28.000 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: mon.smithi093@-1(synchronizing).mds e1 print_map 2023-12-12T11:45:28.000 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: e1 2023-12-12T11:45:28.000 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-12T11:45:28.000 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:45:28.000 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: legacy client fscid: -1 2023-12-12T11:45:28.000 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: 2023-12-12T11:45:28.000 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: No filesystems configured 2023-12-12T11:45:28.000 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: mon.smithi093@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-12-12T11:45:28.000 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: mon.smithi093@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-12-12T11:45:28.000 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: mon.smithi093@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-12-12T11:45:28.000 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: mon.smithi093@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-12-12T11:45:28.000 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: mon.smithi093@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-12-12T11:45:28.000 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: mon.smithi093@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-12-12T11:45:28.001 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: mon.smithi093@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2023-12-12T11:45:28.001 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: mon.smithi093@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-12T11:45:28.001 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: mon.smithi093@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-12T11:45:28.001 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: mon.smithi093@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-12T11:45:28.001 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: mon.smithi093@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-12T11:45:28.001 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.001 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.001 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.001 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.001 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: Deploying daemon alertmanager.smithi063 on smithi063 2023-12-12T11:45:28.001 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.002 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: Added host smithi093 2023-12-12T11:45:28.002 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:28.002 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.002 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-12T11:45:28.002 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:28.002 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:28.002 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.003 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.003 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.003 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.003 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.003 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.003 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-12T11:45:28.003 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.003 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/240505998' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-12-12T11:45:28.003 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.004 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-12T11:45:28.004 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: Deploying daemon grafana.smithi063 on smithi063 2023-12-12T11:45:28.004 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/240505998' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-12T11:45:28.004 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: osdmap e4: 0 total, 0 up, 0 in 2023-12-12T11:45:28.004 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:28.004 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:28.004 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi063:172.21.15.63=smithi063;smithi093:172.21.15.93=smithi093", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:45:28.005 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: Saving service mon spec with placement smithi063:172.21.15.63=smithi063;smithi093:172.21.15.93=smithi093;count:2 2023-12-12T11:45:28.005 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.005 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:28.005 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='client.? 172.21.15.93:0/4174022373' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:45:28.005 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:28.005 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='client.? 172.21.15.93:0/2578610525' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:45:28.006 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:28.006 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:28.006 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='client.? 172.21.15.93:0/1693786867' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:45:28.006 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:28.006 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.006 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.006 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.007 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.007 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.007 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.007 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: Deploying daemon prometheus.smithi063 on smithi063 2023-12-12T11:45:28.007 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.007 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:28.007 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='client.? 172.21.15.93:0/52758524' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:45:28.007 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:28.008 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='client.? 172.21.15.93:0/2850984007' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:45:28.008 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:28.008 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:28.008 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='client.? 172.21.15.93:0/1190014242' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:45:28.008 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.008 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.008 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.008 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2023-12-12T11:45:28.009 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:28.009 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14162 172.21.15.63:0/1488713374' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2023-12-12T11:45:28.009 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: mgrmap e14: smithi063.zjnfdi(active, since 48s) 2023-12-12T11:45:28.009 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='client.? 172.21.15.93:0/1732183770' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:45:28.009 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='client.? 172.21.15.93:0/236445926' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:45:28.009 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='client.? 172.21.15.93:0/3135520003' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:45:28.009 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: Active manager daemon smithi063.zjnfdi restarted 2023-12-12T11:45:28.010 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: Activating manager daemon smithi063.zjnfdi 2023-12-12T11:45:28.010 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: osdmap e5: 0 total, 0 up, 0 in 2023-12-12T11:45:28.010 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: mgrmap e15: smithi063.zjnfdi(active, starting, since 0.00338876s) 2023-12-12T11:45:28.010 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-12T11:45:28.010 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr metadata", "who": "smithi063.zjnfdi", "id": "smithi063.zjnfdi"}]: dispatch 2023-12-12T11:45:28.010 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-12T11:45:28.011 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-12T11:45:28.011 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-12T11:45:28.011 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: Manager daemon smithi063.zjnfdi is now available 2023-12-12T11:45:28.011 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:45:28.011 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:45:28.011 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.011 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:45:28.011 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.zjnfdi/mirror_snapshot_schedule"}]: dispatch 2023-12-12T11:45:28.011 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.zjnfdi/trash_purge_schedule"}]: dispatch 2023-12-12T11:45:28.012 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: [12/Dec/2023:11:45:06] ENGINE Bus STARTING 2023-12-12T11:45:28.012 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.012 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.012 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: mgrmap e16: smithi063.zjnfdi(active, since 1.00812s) 2023-12-12T11:45:28.012 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.012 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: [12/Dec/2023:11:45:06] ENGINE Serving on https://172.21.15.63:7150 2023-12-12T11:45:28.012 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: [12/Dec/2023:11:45:06] ENGINE Bus STARTED 2023-12-12T11:45:28.012 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: mgrmap e17: smithi063.zjnfdi(active, since 2s) 2023-12-12T11:45:28.012 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='client.? 172.21.15.93:0/3438745612' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:45:28.013 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.013 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.013 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.013 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.013 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.013 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "who": "osd/host:smithi063", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:45:28.013 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.013 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.013 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.013 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.013 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "who": "osd/host:smithi093", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:45:28.013 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:45:28.013 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:45:28.013 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: Updating smithi063:/etc/ceph/ceph.conf 2023-12-12T11:45:28.014 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: Updating smithi093:/etc/ceph/ceph.conf 2023-12-12T11:45:28.014 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='client.? 172.21.15.93:0/916256051' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:45:28.014 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: Updating smithi093:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-12T11:45:28.014 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: Updating smithi063:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-12T11:45:28.014 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: Updating smithi093:/etc/ceph/ceph.client.admin.keyring 2023-12-12T11:45:28.014 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: Updating smithi063:/etc/ceph/ceph.client.admin.keyring 2023-12-12T11:45:28.014 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: Updating smithi093:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-12T11:45:28.014 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: Updating smithi063:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-12T11:45:28.014 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.014 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.014 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.014 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.014 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.014 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi093", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-12T11:45:28.015 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi093", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-12T11:45:28.015 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:45:28.015 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: Deploying daemon crash.smithi093 on smithi093 2023-12-12T11:45:28.015 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='client.? 172.21.15.93:0/1101438655' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:45:28.015 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.015 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.015 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.015 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.015 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: Deploying daemon node-exporter.smithi093 on smithi093 2023-12-12T11:45:28.015 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='client.? 172.21.15.93:0/1529841643' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:45:28.015 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.015 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:45:28.015 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.015 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.015 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.016 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.016 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi093.nbtltu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-12T11:45:28.016 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi093.nbtltu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-12T11:45:28.016 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-12T11:45:28.016 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:45:28.016 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: Deploying daemon mgr.smithi093.nbtltu on smithi093 2023-12-12T11:45:28.016 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='client.? 172.21.15.93:0/2331657313' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:45:28.016 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.016 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.016 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.016 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.016 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-12T11:45:28.016 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:45:28.016 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: Deploying daemon mon.smithi093 on smithi093 2023-12-12T11:45:28.016 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:28.017 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:28.017 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: from='client.? 172.21.15.93:0/4195804752' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:45:28.017 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:27 smithi093 ceph-mon[115914]: mon.smithi093@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2023-12-12T11:45:28.207 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-12T11:45:28.208 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-12T11:45:28.639 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi093/config 2023-12-12T11:45:32.969 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:32 smithi093 ceph-mon[115914]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:32.969 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:32 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-12T11:45:32.969 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:32 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi093"}]: dispatch 2023-12-12T11:45:32.969 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:32 smithi093 ceph-mon[115914]: mon.smithi063 calling monitor election 2023-12-12T11:45:32.969 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:32 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi093"}]: dispatch 2023-12-12T11:45:32.969 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:32 smithi093 ceph-mon[115914]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:32.969 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:32 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi093"}]: dispatch 2023-12-12T11:45:32.969 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:32 smithi093 ceph-mon[115914]: mon.smithi093 calling monitor election 2023-12-12T11:45:32.969 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:32 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi093"}]: dispatch 2023-12-12T11:45:32.969 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:32 smithi093 ceph-mon[115914]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:32.969 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:32 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi093"}]: dispatch 2023-12-12T11:45:32.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:32 smithi093 ceph-mon[115914]: from='mgr.? 172.21.15.93:0/2885571974' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi093.nbtltu/crt"}]: dispatch 2023-12-12T11:45:32.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:32 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi093"}]: dispatch 2023-12-12T11:45:32.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:32 smithi093 ceph-mon[115914]: mon.smithi063 is new leader, mons smithi063,smithi093 in quorum (ranks 0,1) 2023-12-12T11:45:32.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:32 smithi093 ceph-mon[115914]: monmap e2: 2 mons at {smithi063=[v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0],smithi093=[v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-12T11:45:32.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:32 smithi093 ceph-mon[115914]: fsmap 2023-12-12T11:45:32.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:32 smithi093 ceph-mon[115914]: osdmap e5: 0 total, 0 up, 0 in 2023-12-12T11:45:32.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:32 smithi093 ceph-mon[115914]: mgrmap e17: smithi063.zjnfdi(active, since 27s) 2023-12-12T11:45:32.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:32 smithi093 ceph-mon[115914]: Standby manager daemon smithi093.nbtltu started 2023-12-12T11:45:32.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:32 smithi093 ceph-mon[115914]: from='mgr.? 172.21.15.93:0/2885571974' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-12T11:45:32.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:32 smithi093 ceph-mon[115914]: overall HEALTH_OK 2023-12-12T11:45:32.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:32 smithi093 ceph-mon[115914]: from='mgr.? 172.21.15.93:0/2885571974' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi093.nbtltu/key"}]: dispatch 2023-12-12T11:45:32.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:32 smithi093 ceph-mon[115914]: from='mgr.? 172.21.15.93:0/2885571974' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-12T11:45:32.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:32 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:32.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:32 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:32.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:32 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:32.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:32 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:32.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:32 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:32.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.991+0000 7f6bd864c700 1 -- 172.21.15.93:0/3102655659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6bbc003580 msgr2=0x7f6bbc005a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:45:32.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.991+0000 7f6bd864c700 1 --2- 172.21.15.93:0/3102655659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6bbc003580 0x7f6bbc005a00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6bd006ff10 tx=0x7f6bcc00b040 comp rx=0 tx=0).stop 2023-12-12T11:45:32.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.991+0000 7f6bd864c700 1 -- 172.21.15.93:0/3102655659 shutdown_connections 2023-12-12T11:45:32.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.991+0000 7f6bd864c700 1 --2- 172.21.15.93:0/3102655659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6bbc003580 0x7f6bbc005a00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:32.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.991+0000 7f6bd864c700 1 -- 172.21.15.93:0/3102655659 >> 172.21.15.93:0/3102655659 conn(0x7f6bd00f8510 msgr2=0x7f6bd00fa920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:45:32.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.992+0000 7f6bd864c700 1 -- 172.21.15.93:0/3102655659 shutdown_connections 2023-12-12T11:45:32.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.992+0000 7f6bd864c700 1 -- 172.21.15.93:0/3102655659 wait complete. 2023-12-12T11:45:32.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.993+0000 7f6bd864c700 1 Processor -- start 2023-12-12T11:45:32.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.993+0000 7f6bd864c700 1 -- start start 2023-12-12T11:45:32.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.994+0000 7f6bd864c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bbc003580 0x7f6bd0114f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:45:32.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.994+0000 7f6bd864c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6bd0115470 0x7f6bd010edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:45:32.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.994+0000 7f6bd864c700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd0115a80 con 0x7f6bd0115470 2023-12-12T11:45:32.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.994+0000 7f6bd864c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd010f310 con 0x7f6bbc003580 2023-12-12T11:45:32.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.994+0000 7f6bd63e8700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bbc003580 0x7f6bd0114f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:45:32.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.994+0000 7f6bd63e8700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bbc003580 0x7f6bd0114f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:40338/0 (socket says 172.21.15.93:40338) 2023-12-12T11:45:32.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.994+0000 7f6bd5be7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6bd0115470 0x7f6bd010edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:45:32.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.994+0000 7f6bd63e8700 1 -- 172.21.15.93:0/3938690240 learned_addr learned my addr 172.21.15.93:0/3938690240 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-12-12T11:45:32.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.994+0000 7f6bd63e8700 1 -- 172.21.15.93:0/3938690240 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bbc003580 msgr2=0x7f6bd0114f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-12T11:45:32.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.994+0000 7f6bd63e8700 1 -- 172.21.15.93:0/3938690240 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bbc003580 msgr2=0x7f6bd0114f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-12T11:45:32.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.994+0000 7f6bd63e8700 1 --2- 172.21.15.93:0/3938690240 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bbc003580 0x7f6bd0114f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-12T11:45:32.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.994+0000 7f6bd63e8700 1 --2- 172.21.15.93:0/3938690240 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bbc003580 0x7f6bd0114f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T11:45:32.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.994+0000 7f6bd5be7700 1 -- 172.21.15.93:0/3938690240 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bbc003580 msgr2=0x7f6bd0114f30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-12T11:45:32.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.994+0000 7f6bd5be7700 1 --2- 172.21.15.93:0/3938690240 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bbc003580 0x7f6bd0114f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:32.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.994+0000 7f6bd5be7700 1 -- 172.21.15.93:0/3938690240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bcc005040 con 0x7f6bd0115470 2023-12-12T11:45:32.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.995+0000 7f6bd5be7700 1 --2- 172.21.15.93:0/3938690240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6bd0115470 0x7f6bd010edd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6bc000b790 tx=0x7f6bc00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:45:32.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.995+0000 7f6bc6ffd700 1 -- 172.21.15.93:0/3938690240 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bc0011810 con 0x7f6bd0115470 2023-12-12T11:45:32.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.995+0000 7f6bc6ffd700 1 -- 172.21.15.93:0/3938690240 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6bc0011e20 con 0x7f6bd0115470 2023-12-12T11:45:32.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.995+0000 7f6bd864c700 1 -- 172.21.15.93:0/3938690240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd010f5f0 con 0x7f6bd0115470 2023-12-12T11:45:32.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.995+0000 7f6bc6ffd700 1 -- 172.21.15.93:0/3938690240 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bc000f2e0 con 0x7f6bd0115470 2023-12-12T11:45:32.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.995+0000 7f6bd864c700 1 -- 172.21.15.93:0/3938690240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd010fb30 con 0x7f6bd0115470 2023-12-12T11:45:32.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.996+0000 7f6bd864c700 1 -- 172.21.15.93:0/3938690240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd005f270 con 0x7f6bd0115470 2023-12-12T11:45:32.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.997+0000 7f6bc6ffd700 1 -- 172.21.15.93:0/3938690240 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f6bc0010380 con 0x7f6bd0115470 2023-12-12T11:45:33.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.998+0000 7f6bc6ffd700 1 --2- 172.21.15.93:0/3938690240 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f6bb4069020 0x7f6bb406b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:45:33.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.998+0000 7f6bc6ffd700 1 -- 172.21.15.93:0/3938690240 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f6bc0085fc0 con 0x7f6bd0115470 2023-12-12T11:45:33.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.998+0000 7f6bd63e8700 1 --2- 172.21.15.93:0/3938690240 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f6bb4069020 0x7f6bb406b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:45:33.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:32.999+0000 7f6bd63e8700 1 --2- 172.21.15.93:0/3938690240 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f6bb4069020 0x7f6bb406b4d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc0047e0 tx=0x7f6bcc00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:45:33.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:33.004+0000 7f6bc6ffd700 1 -- 172.21.15.93:0/3938690240 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6bc0056ee0 con 0x7f6bd0115470 2023-12-12T11:45:33.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:32 smithi063 ceph-mon[107117]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:33.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:32 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-12T11:45:33.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:32 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi093"}]: dispatch 2023-12-12T11:45:33.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:32 smithi063 ceph-mon[107117]: mon.smithi063 calling monitor election 2023-12-12T11:45:33.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:32 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi093"}]: dispatch 2023-12-12T11:45:33.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:32 smithi063 ceph-mon[107117]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:33.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:32 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi093"}]: dispatch 2023-12-12T11:45:33.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:32 smithi063 ceph-mon[107117]: mon.smithi093 calling monitor election 2023-12-12T11:45:33.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:32 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi093"}]: dispatch 2023-12-12T11:45:33.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:32 smithi063 ceph-mon[107117]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:33.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:32 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi093"}]: dispatch 2023-12-12T11:45:33.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:32 smithi063 ceph-mon[107117]: from='mgr.? 172.21.15.93:0/2885571974' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi093.nbtltu/crt"}]: dispatch 2023-12-12T11:45:33.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:32 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi093"}]: dispatch 2023-12-12T11:45:33.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:32 smithi063 ceph-mon[107117]: mon.smithi063 is new leader, mons smithi063,smithi093 in quorum (ranks 0,1) 2023-12-12T11:45:33.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:32 smithi063 ceph-mon[107117]: monmap e2: 2 mons at {smithi063=[v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0],smithi093=[v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-12T11:45:33.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:32 smithi063 ceph-mon[107117]: fsmap 2023-12-12T11:45:33.296 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:32 smithi063 ceph-mon[107117]: osdmap e5: 0 total, 0 up, 0 in 2023-12-12T11:45:33.296 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:32 smithi063 ceph-mon[107117]: mgrmap e17: smithi063.zjnfdi(active, since 27s) 2023-12-12T11:45:33.296 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:32 smithi063 ceph-mon[107117]: Standby manager daemon smithi093.nbtltu started 2023-12-12T11:45:33.296 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:32 smithi063 ceph-mon[107117]: from='mgr.? 172.21.15.93:0/2885571974' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-12T11:45:33.296 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:32 smithi063 ceph-mon[107117]: overall HEALTH_OK 2023-12-12T11:45:33.296 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:32 smithi063 ceph-mon[107117]: from='mgr.? 172.21.15.93:0/2885571974' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi093.nbtltu/key"}]: dispatch 2023-12-12T11:45:33.296 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:32 smithi063 ceph-mon[107117]: from='mgr.? 172.21.15.93:0/2885571974' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-12T11:45:33.296 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:32 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:33.296 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:32 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:33.296 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:32 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:33.296 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:32 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:33.296 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:32 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:33.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:33.307+0000 7f6bd864c700 1 -- 172.21.15.93:0/3938690240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6bd01067b0 con 0x7f6bd0115470 2023-12-12T11:45:33.310 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:33.307+0000 7f6bc6ffd700 1 -- 172.21.15.93:0/3938690240 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1013 (secure 0 0 0) 0x7f6bc0015090 con 0x7f6bd0115470 2023-12-12T11:45:33.310 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-12T11:45:33.310 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":2,"fsid":"85e33c70-98e3-11ee-95a3-87774f69a715","modified":"2023-12-12T11:45:27.878507Z","created":"2023-12-12T11:43:03.786943Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi093","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:3300","nonce":0},{"type":"v1","addr":"172.21.15.93:6789","nonce":0}]},"addr":"172.21.15.93:6789/0","public_addr":"172.21.15.93:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-12-12T11:45:33.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:33.310+0000 7f6bd864c700 1 -- 172.21.15.93:0/3938690240 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f6bb4069020 msgr2=0x7f6bb406b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:45:33.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:33.310+0000 7f6bd864c700 1 --2- 172.21.15.93:0/3938690240 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f6bb4069020 0x7f6bb406b4d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc0047e0 tx=0x7f6bcc00b040 comp rx=0 tx=0).stop 2023-12-12T11:45:33.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:33.310+0000 7f6bd864c700 1 -- 172.21.15.93:0/3938690240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6bd0115470 msgr2=0x7f6bd010edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:45:33.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:33.310+0000 7f6bd864c700 1 --2- 172.21.15.93:0/3938690240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6bd0115470 0x7f6bd010edd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6bc000b790 tx=0x7f6bc00091a0 comp rx=0 tx=0).stop 2023-12-12T11:45:33.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:33.310+0000 7f6bd864c700 1 -- 172.21.15.93:0/3938690240 shutdown_connections 2023-12-12T11:45:33.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:33.310+0000 7f6bd864c700 1 --2- 172.21.15.93:0/3938690240 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bbc003580 0x7f6bd0114f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:33.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:33.310+0000 7f6bd864c700 1 --2- 172.21.15.93:0/3938690240 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f6bb4069020 0x7f6bb406b4d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:33.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:33.310+0000 7f6bd864c700 1 --2- 172.21.15.93:0/3938690240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6bd0115470 0x7f6bd010edd0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:33.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:33.310+0000 7f6bd864c700 1 -- 172.21.15.93:0/3938690240 >> 172.21.15.93:0/3938690240 conn(0x7f6bd00f8510 msgr2=0x7f6bd0100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:45:33.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:33.310+0000 7f6bd864c700 1 -- 172.21.15.93:0/3938690240 shutdown_connections 2023-12-12T11:45:33.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:45:33.310+0000 7f6bd864c700 1 -- 172.21.15.93:0/3938690240 wait complete. 2023-12-12T11:45:33.314 INFO:teuthology.orchestra.run.smithi093.stderr:dumped monmap epoch 2 2023-12-12T11:45:33.708 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-12-12T11:45:33.709 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph config generate-minimal-conf 2023-12-12T11:45:34.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:33 smithi063 ceph-mon[107117]: mgrmap e18: smithi063.zjnfdi(active, since 27s), standbys: smithi093.nbtltu 2023-12-12T11:45:34.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:33 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr metadata", "who": "smithi093.nbtltu", "id": "smithi093.nbtltu"}]: dispatch 2023-12-12T11:45:34.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:33 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:45:34.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:33 smithi063 ceph-mon[107117]: from='client.? 172.21.15.93:0/3938690240' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:45:34.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:33 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi093"}]: dispatch 2023-12-12T11:45:34.147 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:45:34.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:33 smithi093 ceph-mon[115914]: mgrmap e18: smithi063.zjnfdi(active, since 27s), standbys: smithi093.nbtltu 2023-12-12T11:45:34.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:33 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr metadata", "who": "smithi093.nbtltu", "id": "smithi093.nbtltu"}]: dispatch 2023-12-12T11:45:34.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:33 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:45:34.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:33 smithi093 ceph-mon[115914]: from='client.? 172.21.15.93:0/3938690240' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-12T11:45:34.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:33 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi093"}]: dispatch 2023-12-12T11:45:35.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:34 smithi093 ceph-mon[115914]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:35.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:34 smithi063 ceph-mon[107117]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:35.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.381+0000 7f318518a700 1 -- 172.21.15.63:0/1398212930 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31801028d0 msgr2=0x7f3180102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:45:35.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.381+0000 7f318518a700 1 --2- 172.21.15.63:0/1398212930 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31801028d0 0x7f3180102ca0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f31700048c0 tx=0x7f3170009e30 comp rx=0 tx=0).stop 2023-12-12T11:45:35.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.381+0000 7f318518a700 1 -- 172.21.15.63:0/1398212930 shutdown_connections 2023-12-12T11:45:35.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.381+0000 7f318518a700 1 --2- 172.21.15.63:0/1398212930 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31801028d0 0x7f3180102ca0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:35.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.381+0000 7f318518a700 1 -- 172.21.15.63:0/1398212930 >> 172.21.15.63:0/1398212930 conn(0x7f31800f8410 msgr2=0x7f31800fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:45:35.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.381+0000 7f318518a700 1 -- 172.21.15.63:0/1398212930 shutdown_connections 2023-12-12T11:45:35.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.381+0000 7f318518a700 1 -- 172.21.15.63:0/1398212930 wait complete. 2023-12-12T11:45:35.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.382+0000 7f318518a700 1 Processor -- start 2023-12-12T11:45:35.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.382+0000 7f318518a700 1 -- start start 2023-12-12T11:45:35.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.382+0000 7f318518a700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31801028d0 0x7f3180114ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:45:35.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.382+0000 7f318518a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3180115410 0x7f318010ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:45:35.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.382+0000 7f318518a700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3180115a20 con 0x7f3180115410 2023-12-12T11:45:35.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.382+0000 7f318518a700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318010f2b0 con 0x7f31801028d0 2023-12-12T11:45:35.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.383+0000 7f317e59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3180115410 0x7f318010ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:45:35.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.383+0000 7f317e59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3180115410 0x7f318010ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52598/0 (socket says 172.21.15.63:52598) 2023-12-12T11:45:35.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.383+0000 7f317e59c700 1 -- 172.21.15.63:0/4061829886 learned_addr learned my addr 172.21.15.63:0/4061829886 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:45:35.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.383+0000 7f317ed9d700 1 --2- 172.21.15.63:0/4061829886 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31801028d0 0x7f3180114ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:45:35.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.383+0000 7f317ed9d700 1 -- 172.21.15.63:0/4061829886 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31801028d0 msgr2=0x7f3180114ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-12T11:45:35.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.383+0000 7f317ed9d700 1 -- 172.21.15.63:0/4061829886 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31801028d0 msgr2=0x7f3180114ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-12T11:45:35.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.383+0000 7f317ed9d700 1 --2- 172.21.15.63:0/4061829886 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31801028d0 0x7f3180114ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-12T11:45:35.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.383+0000 7f317ed9d700 1 --2- 172.21.15.63:0/4061829886 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31801028d0 0x7f3180114ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T11:45:35.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.383+0000 7f317e59c700 1 -- 172.21.15.63:0/4061829886 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31801028d0 msgr2=0x7f3180114ed0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-12T11:45:35.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.383+0000 7f317e59c700 1 --2- 172.21.15.63:0/4061829886 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31801028d0 0x7f3180114ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:35.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.383+0000 7f317e59c700 1 -- 172.21.15.63:0/4061829886 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3170005040 con 0x7f3180115410 2023-12-12T11:45:35.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.384+0000 7f317e59c700 1 --2- 172.21.15.63:0/4061829886 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3180115410 0x7f318010ed70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f317400b790 tx=0x7f3174009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:45:35.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.384+0000 7f31677fe700 1 -- 172.21.15.63:0/4061829886 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3174010870 con 0x7f3180115410 2023-12-12T11:45:35.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.384+0000 7f31677fe700 1 -- 172.21.15.63:0/4061829886 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3174010e80 con 0x7f3180115410 2023-12-12T11:45:35.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.384+0000 7f318518a700 1 -- 172.21.15.63:0/4061829886 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f318010f590 con 0x7f3180115410 2023-12-12T11:45:35.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.384+0000 7f31677fe700 1 -- 172.21.15.63:0/4061829886 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f317400d3b0 con 0x7f3180115410 2023-12-12T11:45:35.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.384+0000 7f318518a700 1 -- 172.21.15.63:0/4061829886 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318010fb50 con 0x7f3180115410 2023-12-12T11:45:35.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.385+0000 7f318518a700 1 -- 172.21.15.63:0/4061829886 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f318005f270 con 0x7f3180115410 2023-12-12T11:45:35.388 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.386+0000 7f31677fe700 1 -- 172.21.15.63:0/4061829886 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f317400f3e0 con 0x7f3180115410 2023-12-12T11:45:35.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.388+0000 7f31677fe700 1 --2- 172.21.15.63:0/4061829886 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f3168069040 0x7f316806b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:45:35.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.388+0000 7f31677fe700 1 -- 172.21.15.63:0/4061829886 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f3174086270 con 0x7f3180115410 2023-12-12T11:45:35.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.388+0000 7f317ed9d700 1 --2- 172.21.15.63:0/4061829886 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f3168069040 0x7f316806b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:45:35.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.389+0000 7f317ed9d700 1 --2- 172.21.15.63:0/4061829886 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f3168069040 0x7f316806b4f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f317000b3b0 tx=0x7f3170009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:45:35.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.391+0000 7f31677fe700 1 -- 172.21.15.63:0/4061829886 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3174057210 con 0x7f3180115410 2023-12-12T11:45:35.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.599+0000 7f318518a700 1 -- 172.21.15.63:0/4061829886 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f3180110550 con 0x7f3180115410 2023-12-12T11:45:35.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.600+0000 7f31677fe700 1 -- 172.21.15.63:0/4061829886 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+223 (secure 0 0 0) 0x7f31740140f0 con 0x7f3180115410 2023-12-12T11:45:35.602 INFO:teuthology.orchestra.run.smithi063.stdout:# minimal ceph.conf for 85e33c70-98e3-11ee-95a3-87774f69a715 2023-12-12T11:45:35.602 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2023-12-12T11:45:35.602 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 85e33c70-98e3-11ee-95a3-87774f69a715 2023-12-12T11:45:35.602 INFO:teuthology.orchestra.run.smithi063.stdout: mon_host = [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] 2023-12-12T11:45:35.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.602+0000 7f318518a700 1 -- 172.21.15.63:0/4061829886 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f3168069040 msgr2=0x7f316806b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:45:35.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.602+0000 7f318518a700 1 --2- 172.21.15.63:0/4061829886 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f3168069040 0x7f316806b4f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f317000b3b0 tx=0x7f3170009e30 comp rx=0 tx=0).stop 2023-12-12T11:45:35.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.602+0000 7f318518a700 1 -- 172.21.15.63:0/4061829886 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3180115410 msgr2=0x7f318010ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:45:35.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.602+0000 7f318518a700 1 --2- 172.21.15.63:0/4061829886 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3180115410 0x7f318010ed70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f317400b790 tx=0x7f3174009250 comp rx=0 tx=0).stop 2023-12-12T11:45:35.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.603+0000 7f318518a700 1 -- 172.21.15.63:0/4061829886 shutdown_connections 2023-12-12T11:45:35.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.603+0000 7f318518a700 1 --2- 172.21.15.63:0/4061829886 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31801028d0 0x7f3180114ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:35.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.603+0000 7f318518a700 1 --2- 172.21.15.63:0/4061829886 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f3168069040 0x7f316806b4f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:35.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.603+0000 7f318518a700 1 --2- 172.21.15.63:0/4061829886 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3180115410 0x7f318010ed70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:35.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.603+0000 7f318518a700 1 -- 172.21.15.63:0/4061829886 >> 172.21.15.63:0/4061829886 conn(0x7f31800f8410 msgr2=0x7f318006fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:45:35.606 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.603+0000 7f318518a700 1 -- 172.21.15.63:0/4061829886 shutdown_connections 2023-12-12T11:45:35.606 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:35.603+0000 7f318518a700 1 -- 172.21.15.63:0/4061829886 wait complete. 2023-12-12T11:45:36.019 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-12-12T11:45:36.019 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-12T11:45:36.019 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/ceph.conf 2023-12-12T11:45:36.098 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-12T11:45:36.098 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-12T11:45:36.212 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-12T11:45:36.212 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/ceph/ceph.conf 2023-12-12T11:45:36.285 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-12T11:45:36.285 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-12T11:45:36.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:36 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:36.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:36 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:36.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:36 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:45:36.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:36 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:45:36.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:36 smithi063 ceph-mon[107117]: Updating smithi063:/etc/ceph/ceph.conf 2023-12-12T11:45:36.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:36 smithi063 ceph-mon[107117]: Updating smithi093:/etc/ceph/ceph.conf 2023-12-12T11:45:36.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:36 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/4061829886' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:45:36.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:36 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:45:36.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:36 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:36.387 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:36 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:36.388 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:36 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:36.388 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:36 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:45:36.388 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:36 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:45:36.388 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:36 smithi093 ceph-mon[115914]: Updating smithi063:/etc/ceph/ceph.conf 2023-12-12T11:45:36.388 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:36 smithi093 ceph-mon[115914]: Updating smithi093:/etc/ceph/ceph.conf 2023-12-12T11:45:36.388 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:36 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/4061829886' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:45:36.388 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:36 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:45:36.388 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:36 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:36.394 INFO:tasks.cephadm:Deploying OSDs... 2023-12-12T11:45:36.394 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-12T11:45:36.394 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/scratch_devs of=/dev/stdout 2023-12-12T11:45:36.440 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-12T11:45:36.441 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_1 2023-12-12T11:45:36.528 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-12T11:45:36.528 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T11:45:36.529 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-12-12T11:45:36.529 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T11:45:36.529 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T11:45:36.529 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2023-12-12 11:44:55.451568420 +0000 2023-12-12T11:45:36.529 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2023-12-12 11:37:21.583558221 +0000 2023-12-12T11:45:36.529 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2023-12-12 11:37:21.583558221 +0000 2023-12-12T11:45:36.529 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2023-12-12 11:37:21.556558760 +0000 2023-12-12T11:45:36.529 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-12T11:45:36.639 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2023-12-12T11:45:36.639 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2023-12-12T11:45:36.639 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000274564 s, 1.9 MB/s 2023-12-12T11:45:36.642 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-12T11:45:36.694 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_2 2023-12-12T11:45:36.741 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-12T11:45:36.741 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T11:45:36.741 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-12-12T11:45:36.741 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T11:45:36.742 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T11:45:36.742 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2023-12-12 11:44:55.451568420 +0000 2023-12-12T11:45:36.742 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2023-12-12 11:37:22.432541272 +0000 2023-12-12T11:45:36.742 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2023-12-12 11:37:22.432541272 +0000 2023-12-12T11:45:36.742 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2023-12-12 11:37:22.408541752 +0000 2023-12-12T11:45:36.742 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-12T11:45:36.811 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2023-12-12T11:45:36.812 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2023-12-12T11:45:36.812 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000291172 s, 1.8 MB/s 2023-12-12T11:45:36.814 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-12T11:45:36.863 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_3 2023-12-12T11:45:36.909 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-12T11:45:36.910 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T11:45:36.910 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-12-12T11:45:36.910 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T11:45:36.910 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T11:45:36.910 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2023-12-12 11:44:55.452568400 +0000 2023-12-12T11:45:36.910 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2023-12-12 11:37:23.276524424 +0000 2023-12-12T11:45:36.910 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2023-12-12 11:37:23.276524424 +0000 2023-12-12T11:45:36.910 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2023-12-12 11:37:23.249524963 +0000 2023-12-12T11:45:36.910 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-12T11:45:36.981 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2023-12-12T11:45:36.981 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2023-12-12T11:45:36.981 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000350225 s, 1.5 MB/s 2023-12-12T11:45:36.986 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-12T11:45:37.037 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_4 2023-12-12T11:45:37.085 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-12T11:45:37.085 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T11:45:37.085 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-12-12T11:45:37.085 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T11:45:37.085 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T11:45:37.085 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2023-12-12 11:44:55.452568400 +0000 2023-12-12T11:45:37.085 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2023-12-12 11:37:24.137507236 +0000 2023-12-12T11:45:37.085 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2023-12-12 11:37:24.137507236 +0000 2023-12-12T11:45:37.085 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2023-12-12 11:37:24.113507715 +0000 2023-12-12T11:45:37.086 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-12T11:45:37.158 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2023-12-12T11:45:37.158 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2023-12-12T11:45:37.158 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000308835 s, 1.7 MB/s 2023-12-12T11:45:37.162 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-12T11:45:37.216 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-12T11:45:37.216 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/scratch_devs of=/dev/stdout 2023-12-12T11:45:37.266 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-12T11:45:37.266 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_1 2023-12-12T11:45:37.315 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-12T11:45:37.315 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T11:45:37.315 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-12-12T11:45:37.315 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T11:45:37.315 INFO:teuthology.orchestra.run.smithi093.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T11:45:37.315 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2023-12-12 11:45:27.169541101 +0000 2023-12-12T11:45:37.315 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2023-12-12 11:37:10.776034622 +0000 2023-12-12T11:45:37.316 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2023-12-12 11:37:10.776034622 +0000 2023-12-12T11:45:37.316 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: 2023-12-12 11:37:10.746035256 +0000 2023-12-12T11:45:37.316 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-12T11:45:37.383 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2023-12-12T11:45:37.383 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2023-12-12T11:45:37.383 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000488797 s, 1.0 MB/s 2023-12-12T11:45:37.385 DEBUG:teuthology.orchestra.run.smithi093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-12T11:45:37.433 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_2 2023-12-12T11:45:37.479 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-12T11:45:37.480 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T11:45:37.480 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-12-12T11:45:37.480 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T11:45:37.480 INFO:teuthology.orchestra.run.smithi093.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T11:45:37.480 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2023-12-12 11:45:27.169541101 +0000 2023-12-12T11:45:37.480 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2023-12-12 11:37:11.625016690 +0000 2023-12-12T11:45:37.480 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2023-12-12 11:37:11.625016690 +0000 2023-12-12T11:45:37.480 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: 2023-12-12 11:37:11.600017218 +0000 2023-12-12T11:45:37.480 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-12T11:45:37.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:37 smithi063 ceph-mon[107117]: Updating smithi063:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-12T11:45:37.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:37 smithi063 ceph-mon[107117]: Updating smithi093:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-12T11:45:37.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:37 smithi063 ceph-mon[107117]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:37.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:37 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:37.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:37 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:37.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:37 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:37.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:37 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:37.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:37 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:37.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:37 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-12T11:45:37.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:37 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-12T11:45:37.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:37 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:45:37.580 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:37 smithi093 ceph-mon[115914]: Updating smithi063:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-12T11:45:37.581 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:37 smithi093 ceph-mon[115914]: Updating smithi093:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-12T11:45:37.581 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:37 smithi093 ceph-mon[115914]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:37.581 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:37 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:37.581 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:37 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:37.581 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:37 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:37.581 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:37 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:37.581 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:37 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:37.581 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:37 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-12T11:45:37.581 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:37 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-12T11:45:37.581 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:37 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:45:37.586 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2023-12-12T11:45:37.587 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2023-12-12T11:45:37.587 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000283788 s, 1.8 MB/s 2023-12-12T11:45:37.589 DEBUG:teuthology.orchestra.run.smithi093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-12T11:45:37.637 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_3 2023-12-12T11:45:37.684 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-12T11:45:37.684 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T11:45:37.684 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-12-12T11:45:37.684 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T11:45:37.684 INFO:teuthology.orchestra.run.smithi093.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T11:45:37.684 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2023-12-12 11:45:27.169541101 +0000 2023-12-12T11:45:37.684 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2023-12-12 11:37:12.455999138 +0000 2023-12-12T11:45:37.684 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2023-12-12 11:37:12.455999138 +0000 2023-12-12T11:45:37.684 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: 2023-12-12 11:37:12.432999624 +0000 2023-12-12T11:45:37.684 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-12T11:45:37.751 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2023-12-12T11:45:37.751 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2023-12-12T11:45:37.751 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000290895 s, 1.8 MB/s 2023-12-12T11:45:37.754 DEBUG:teuthology.orchestra.run.smithi093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-12T11:45:37.802 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_4 2023-12-12T11:45:37.851 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-12T11:45:37.852 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T11:45:37.852 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-12-12T11:45:37.852 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T11:45:37.852 INFO:teuthology.orchestra.run.smithi093.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T11:45:37.852 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2023-12-12 11:45:27.170541080 +0000 2023-12-12T11:45:37.852 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2023-12-12 11:37:13.307981142 +0000 2023-12-12T11:45:37.852 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2023-12-12 11:37:13.307981142 +0000 2023-12-12T11:45:37.852 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: 2023-12-12 11:37:13.281981691 +0000 2023-12-12T11:45:37.852 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-12T11:45:37.920 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2023-12-12T11:45:37.920 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2023-12-12T11:45:37.920 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000277873 s, 1.8 MB/s 2023-12-12T11:45:37.922 DEBUG:teuthology.orchestra.run.smithi093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-12T11:45:37.970 INFO:tasks.cephadm:Deploying osd.0 on smithi063 with /dev/vg_nvme/lv_4... 2023-12-12T11:45:37.971 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-12T11:45:38.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:38 smithi063 ceph-mon[107117]: Reconfiguring mon.smithi063 (unknown last config time)... 2023-12-12T11:45:38.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:38 smithi063 ceph-mon[107117]: Reconfiguring daemon mon.smithi063 on smithi063 2023-12-12T11:45:38.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:38 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:38.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:38 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:38.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:38 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi063.zjnfdi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-12T11:45:38.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:38 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-12T11:45:38.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:38 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:45:38.629 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:45:38.720 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:38 smithi093 ceph-mon[115914]: Reconfiguring mon.smithi063 (unknown last config time)... 2023-12-12T11:45:38.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:38 smithi093 ceph-mon[115914]: Reconfiguring daemon mon.smithi063 on smithi063 2023-12-12T11:45:38.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:38 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:38.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:38 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:38.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:38 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi063.zjnfdi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-12T11:45:38.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:38 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-12T11:45:38.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:38 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:45:39.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:39 smithi063 ceph-mon[107117]: Reconfiguring mgr.smithi063.zjnfdi (unknown last config time)... 2023-12-12T11:45:39.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:39 smithi063 ceph-mon[107117]: Reconfiguring daemon mgr.smithi063.zjnfdi on smithi063 2023-12-12T11:45:39.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:39 smithi063 ceph-mon[107117]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:39.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:39 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:39.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:39 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:39.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:39 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi063", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-12T11:45:39.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:39 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:45:39.720 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:39 smithi093 ceph-mon[115914]: Reconfiguring mgr.smithi063.zjnfdi (unknown last config time)... 2023-12-12T11:45:39.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:39 smithi093 ceph-mon[115914]: Reconfiguring daemon mgr.smithi063.zjnfdi on smithi063 2023-12-12T11:45:39.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:39 smithi093 ceph-mon[115914]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:39.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:39 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:39.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:39 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:39.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:39 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi063", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-12T11:45:39.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:39 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:45:40.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:40 smithi063 ceph-mon[107117]: Reconfiguring crash.smithi063 (monmap changed)... 2023-12-12T11:45:40.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:40 smithi063 ceph-mon[107117]: Reconfiguring daemon crash.smithi063 on smithi063 2023-12-12T11:45:40.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:40 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:40.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:40 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:40.591 INFO:teuthology.orchestra.run.smithi063.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-12T11:45:40.591 INFO:teuthology.orchestra.run.smithi063.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-12T11:45:40.591 INFO:teuthology.orchestra.run.smithi063.stderr: stderr: 10+0 records in 2023-12-12T11:45:40.591 INFO:teuthology.orchestra.run.smithi063.stderr:10+0 records out 2023-12-12T11:45:40.591 INFO:teuthology.orchestra.run.smithi063.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0575838 s, 182 MB/s 2023-12-12T11:45:40.591 INFO:teuthology.orchestra.run.smithi063.stderr: stderr: 2023-12-12T11:45:40.591 INFO:teuthology.orchestra.run.smithi063.stderr:--> Zapping successful for: 2023-12-12T11:45:40.720 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:40 smithi093 ceph-mon[115914]: Reconfiguring crash.smithi063 (monmap changed)... 2023-12-12T11:45:40.720 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:40 smithi093 ceph-mon[115914]: Reconfiguring daemon crash.smithi063 on smithi063 2023-12-12T11:45:40.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:40 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:40.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:40 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:40.967 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi063:vg_nvme/lv_4 2023-12-12T11:45:41.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:41 smithi063 ceph-mon[107117]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:41.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:41 smithi063 ceph-mon[107117]: Reconfiguring alertmanager.smithi063 (dependencies changed)... 2023-12-12T11:45:41.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:41 smithi063 ceph-mon[107117]: Reconfiguring daemon alertmanager.smithi063 on smithi063 2023-12-12T11:45:41.679 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:45:41.720 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:41 smithi093 ceph-mon[115914]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:41.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:41 smithi093 ceph-mon[115914]: Reconfiguring alertmanager.smithi063 (dependencies changed)... 2023-12-12T11:45:41.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:41 smithi093 ceph-mon[115914]: Reconfiguring daemon alertmanager.smithi063 on smithi063 2023-12-12T11:45:42.693 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:42 smithi063 ceph-mon[107117]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:42.720 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:42 smithi093 ceph-mon[115914]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:43.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.262+0000 7f587e98f700 1 -- 172.21.15.63:0/2072392482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58780fcbf0 msgr2=0x7f58780fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:45:43.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.262+0000 7f587e98f700 1 --2- 172.21.15.63:0/2072392482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58780fcbf0 0x7f58780fd000 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5868004940 tx=0x7f5868009e30 comp rx=0 tx=0).stop 2023-12-12T11:45:43.266 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.262+0000 7f587e98f700 1 -- 172.21.15.63:0/2072392482 shutdown_connections 2023-12-12T11:45:43.266 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.262+0000 7f587e98f700 1 --2- 172.21.15.63:0/2072392482 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f58780fde00 0x7f58780fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:43.266 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.262+0000 7f587e98f700 1 --2- 172.21.15.63:0/2072392482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58780fcbf0 0x7f58780fd000 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:43.266 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.262+0000 7f587e98f700 1 -- 172.21.15.63:0/2072392482 >> 172.21.15.63:0/2072392482 conn(0x7f58780f82d0 msgr2=0x7f58780fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:45:43.266 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.262+0000 7f587e98f700 1 -- 172.21.15.63:0/2072392482 shutdown_connections 2023-12-12T11:45:43.266 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.262+0000 7f587e98f700 1 -- 172.21.15.63:0/2072392482 wait complete. 2023-12-12T11:45:43.266 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.263+0000 7f587e98f700 1 Processor -- start 2023-12-12T11:45:43.266 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.263+0000 7f587e98f700 1 -- start start 2023-12-12T11:45:43.267 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.264+0000 7f587e98f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58780fcbf0 0x7f587810f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:45:43.267 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.264+0000 7f587e98f700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f58780fde00 0x7f587810fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:45:43.267 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.264+0000 7f587e98f700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5878110280 con 0x7f58780fcbf0 2023-12-12T11:45:43.267 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.264+0000 7f587e98f700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5878110b20 con 0x7f58780fde00 2023-12-12T11:45:43.267 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.264+0000 7f5877fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58780fcbf0 0x7f587810f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:45:43.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.265+0000 7f5877fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58780fcbf0 0x7f587810f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54764/0 (socket says 172.21.15.63:54764) 2023-12-12T11:45:43.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.265+0000 7f5877fff700 1 -- 172.21.15.63:0/3837418737 learned_addr learned my addr 172.21.15.63:0/3837418737 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:45:43.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.265+0000 7f5877fff700 1 -- 172.21.15.63:0/3837418737 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f58780fde00 msgr2=0x7f587810fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:45:43.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.265+0000 7f5877fff700 1 --2- 172.21.15.63:0/3837418737 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f58780fde00 0x7f587810fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:45:43.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.265+0000 7f5877fff700 1 -- 172.21.15.63:0/3837418737 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5868005040 con 0x7f58780fcbf0 2023-12-12T11:45:43.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.265+0000 7f5877fff700 1 --2- 172.21.15.63:0/3837418737 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58780fcbf0 0x7f587810f740 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5868000c00 tx=0x7f5868009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:45:43.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.265+0000 7f5874ff9700 1 -- 172.21.15.63:0/3837418737 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f586800e040 con 0x7f58780fcbf0 2023-12-12T11:45:43.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.265+0000 7f5874ff9700 1 -- 172.21.15.63:0/3837418737 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f586800bc50 con 0x7f58780fcbf0 2023-12-12T11:45:43.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.266+0000 7f587e98f700 1 -- 172.21.15.63:0/3837418737 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5878110da0 con 0x7f58780fcbf0 2023-12-12T11:45:43.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.266+0000 7f5874ff9700 1 -- 172.21.15.63:0/3837418737 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f586801c630 con 0x7f58780fcbf0 2023-12-12T11:45:43.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.266+0000 7f587e98f700 1 -- 172.21.15.63:0/3837418737 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58781112e0 con 0x7f58780fcbf0 2023-12-12T11:45:43.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.267+0000 7f587e98f700 1 -- 172.21.15.63:0/3837418737 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5878101ea0 con 0x7f58780fcbf0 2023-12-12T11:45:43.270 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.268+0000 7f5874ff9700 1 -- 172.21.15.63:0/3837418737 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f5868013420 con 0x7f58780fcbf0 2023-12-12T11:45:43.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.269+0000 7f5874ff9700 1 --2- 172.21.15.63:0/3837418737 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f5860068ed0 0x7f586006b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:45:43.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.269+0000 7f5874ff9700 1 -- 172.21.15.63:0/3837418737 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f5868086fd0 con 0x7f58780fcbf0 2023-12-12T11:45:43.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.270+0000 7f58777fe700 1 --2- 172.21.15.63:0/3837418737 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f5860068ed0 0x7f586006b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:45:43.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.270+0000 7f58777fe700 1 --2- 172.21.15.63:0/3837418737 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f5860068ed0 0x7f586006b380 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f586c004d00 tx=0x7f586c009ce0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:45:43.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.274+0000 7f5874ff9700 1 -- 172.21.15.63:0/3837418737 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5868057f70 con 0x7f58780fcbf0 2023-12-12T11:45:43.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:45:43.502+0000 7f587e98f700 1 -- 172.21.15.63:0/3837418737 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f5878111720 con 0x7f5860068ed0 2023-12-12T11:45:43.739 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:43 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-12T11:45:43.739 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:43 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-12T11:45:43.739 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:43 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:45:43.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:43 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-12T11:45:43.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:43 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-12T11:45:43.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:43 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:45:44.574 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:44 smithi063 ceph-mon[107117]: from='client.14246 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:45:44.574 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:44 smithi063 ceph-mon[107117]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:44.575 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:44 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:44.575 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:44 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:44.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:44 smithi093 ceph-mon[115914]: from='client.14246 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:45:44.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:44 smithi093 ceph-mon[115914]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:44.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:44 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:44.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:44 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:45.870 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:45 smithi063 ceph-mon[107117]: Reconfiguring grafana.smithi063 (dependencies changed)... 2023-12-12T11:45:45.870 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:45 smithi063 ceph-mon[107117]: Reconfiguring daemon grafana.smithi063 on smithi063 2023-12-12T11:45:45.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:45 smithi093 ceph-mon[115914]: Reconfiguring grafana.smithi063 (dependencies changed)... 2023-12-12T11:45:45.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:45 smithi093 ceph-mon[115914]: Reconfiguring daemon grafana.smithi063 on smithi063 2023-12-12T11:45:46.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:46 smithi093 ceph-mon[115914]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:47.016 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:46 smithi063 ceph-mon[107117]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:48.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:48 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:48.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:48 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:48.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:48 smithi093 ceph-mon[115914]: Reconfiguring prometheus.smithi063 (dependencies changed)... 2023-12-12T11:45:48.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:48 smithi093 ceph-mon[115914]: Reconfiguring daemon prometheus.smithi063 on smithi063 2023-12-12T11:45:48.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:48 smithi093 ceph-mon[115914]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:49.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:48 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:49.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:48 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:49.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:48 smithi063 ceph-mon[107117]: Reconfiguring prometheus.smithi063 (dependencies changed)... 2023-12-12T11:45:49.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:48 smithi063 ceph-mon[107117]: Reconfiguring daemon prometheus.smithi063 on smithi063 2023-12-12T11:45:49.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:48 smithi063 ceph-mon[107117]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:49.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:49 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/3636258080' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b09da78-38a4-46a4-bf22-b1d21103b497"}]: dispatch 2023-12-12T11:45:49.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:49 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/3636258080' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b09da78-38a4-46a4-bf22-b1d21103b497"}]': finished 2023-12-12T11:45:49.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:49 smithi093 ceph-mon[115914]: osdmap e6: 1 total, 0 up, 1 in 2023-12-12T11:45:49.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:49 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-12T11:45:50.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:49 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/3636258080' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b09da78-38a4-46a4-bf22-b1d21103b497"}]: dispatch 2023-12-12T11:45:50.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:49 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/3636258080' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b09da78-38a4-46a4-bf22-b1d21103b497"}]': finished 2023-12-12T11:45:50.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:49 smithi063 ceph-mon[107117]: osdmap e6: 1 total, 0 up, 1 in 2023-12-12T11:45:50.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:49 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-12T11:45:50.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:50 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/3766196651' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-12T11:45:50.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:50 smithi093 ceph-mon[115914]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:51.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:50 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/3766196651' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-12T11:45:51.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:50 smithi063 ceph-mon[107117]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:51.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:51 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:45:52.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:51 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:45:52.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:52 smithi093 ceph-mon[115914]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:53.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:52 smithi063 ceph-mon[107117]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:55.145 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:54 smithi063 ceph-mon[107117]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:55.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:54 smithi093 ceph-mon[115914]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:56.971 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:56 smithi063 ceph-mon[107117]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:56.971 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:56 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:56.971 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:56 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:56.971 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:56 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi093", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-12T11:45:56.971 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:56 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:45:57.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:56 smithi093 ceph-mon[115914]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:57.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:56 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:57.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:56 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:57.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:56 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi093", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-12T11:45:57.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:56 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:45:57.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:57 smithi093 ceph-mon[115914]: Reconfiguring crash.smithi093 (monmap changed)... 2023-12-12T11:45:57.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:57 smithi093 ceph-mon[115914]: Reconfiguring daemon crash.smithi093 on smithi093 2023-12-12T11:45:58.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:57 smithi063 ceph-mon[107117]: Reconfiguring crash.smithi093 (monmap changed)... 2023-12-12T11:45:58.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:57 smithi063 ceph-mon[107117]: Reconfiguring daemon crash.smithi093 on smithi093 2023-12-12T11:45:59.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:58 smithi093 ceph-mon[115914]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:59.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:58 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:59.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:58 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:59.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:58 smithi093 ceph-mon[115914]: Reconfiguring mgr.smithi093.nbtltu (monmap changed)... 2023-12-12T11:45:59.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:58 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi093.nbtltu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-12T11:45:59.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:58 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-12T11:45:59.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:58 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:45:59.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:58 smithi093 ceph-mon[115914]: Reconfiguring daemon mgr.smithi093.nbtltu on smithi093 2023-12-12T11:45:59.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:58 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-12T11:45:59.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:58 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:45:59.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:45:58 smithi093 ceph-mon[115914]: Deploying daemon osd.0 on smithi063 2023-12-12T11:45:59.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:58 smithi063 ceph-mon[107117]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:45:59.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:58 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:59.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:58 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:45:59.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:58 smithi063 ceph-mon[107117]: Reconfiguring mgr.smithi093.nbtltu (monmap changed)... 2023-12-12T11:45:59.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:58 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi093.nbtltu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-12T11:45:59.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:58 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-12T11:45:59.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:58 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:45:59.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:58 smithi063 ceph-mon[107117]: Reconfiguring daemon mgr.smithi093.nbtltu on smithi093 2023-12-12T11:45:59.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:58 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-12T11:45:59.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:58 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:45:59.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:45:58 smithi063 ceph-mon[107117]: Deploying daemon osd.0 on smithi063 2023-12-12T11:46:00.162 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:00 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:00.162 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:00 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:00.163 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:00 smithi063 ceph-mon[107117]: Reconfiguring mon.smithi093 (monmap changed)... 2023-12-12T11:46:00.163 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:00 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-12T11:46:00.163 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:00 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-12T11:46:00.163 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:00 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:46:00.163 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:00 smithi063 ceph-mon[107117]: Reconfiguring daemon mon.smithi093 on smithi093 2023-12-12T11:46:00.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:00 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:00.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:00 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:00.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:00 smithi093 ceph-mon[115914]: Reconfiguring mon.smithi093 (monmap changed)... 2023-12-12T11:46:00.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:00 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-12T11:46:00.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:00 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-12T11:46:00.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:00 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:46:00.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:00 smithi093 ceph-mon[115914]: Reconfiguring daemon mon.smithi093 on smithi093 2023-12-12T11:46:01.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:01 smithi093 ceph-mon[115914]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:46:01.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:01 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:01.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:01 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:01.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:01 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-12T11:46:01.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:01 smithi093 ceph-mon[115914]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-12T11:46:01.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:01 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi063.front.sepia.ceph.com:9093"}]: dispatch 2023-12-12T11:46:01.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:01 smithi093 ceph-mon[115914]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi063.front.sepia.ceph.com:9093"}]: dispatch 2023-12-12T11:46:01.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:01 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:01.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:01 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-12T11:46:01.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:01 smithi093 ceph-mon[115914]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-12T11:46:01.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:01 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi063.front.sepia.ceph.com:3000"}]: dispatch 2023-12-12T11:46:01.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:01 smithi093 ceph-mon[115914]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi063.front.sepia.ceph.com:3000"}]: dispatch 2023-12-12T11:46:01.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:01 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:01.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:01 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-12T11:46:01.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:01 smithi093 ceph-mon[115914]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-12T11:46:01.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:01 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi063.front.sepia.ceph.com:9095"}]: dispatch 2023-12-12T11:46:01.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:01 smithi093 ceph-mon[115914]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi063.front.sepia.ceph.com:9095"}]: dispatch 2023-12-12T11:46:01.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:01 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:01.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:01 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:46:01.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:01 smithi063 ceph-mon[107117]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:46:01.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:01 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:01.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:01 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:01.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:01 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-12T11:46:01.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:01 smithi063 ceph-mon[107117]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-12T11:46:01.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:01 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi063.front.sepia.ceph.com:9093"}]: dispatch 2023-12-12T11:46:01.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:01 smithi063 ceph-mon[107117]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi063.front.sepia.ceph.com:9093"}]: dispatch 2023-12-12T11:46:01.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:01 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:01.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:01 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-12T11:46:01.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:01 smithi063 ceph-mon[107117]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-12T11:46:01.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:01 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi063.front.sepia.ceph.com:3000"}]: dispatch 2023-12-12T11:46:01.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:01 smithi063 ceph-mon[107117]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi063.front.sepia.ceph.com:3000"}]: dispatch 2023-12-12T11:46:01.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:01 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:01.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:01 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-12T11:46:01.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:01 smithi063 ceph-mon[107117]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-12T11:46:01.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:01 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi063.front.sepia.ceph.com:9095"}]: dispatch 2023-12-12T11:46:01.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:01 smithi063 ceph-mon[107117]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi063.front.sepia.ceph.com:9095"}]: dispatch 2023-12-12T11:46:01.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:01 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:01.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:01 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:46:03.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:02 smithi063 ceph-mon[107117]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:46:03.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:02 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:03.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:02 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:03.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:02 smithi093 ceph-mon[115914]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:46:03.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:02 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:03.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:02 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:04.765 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:04 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:04.765 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:04 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:04.765 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:04 smithi063 ceph-mon[107117]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:46:04.765 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:04 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:04.765 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:04 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:04.766 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:04 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:46:04.766 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:04 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:46:04.766 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:04 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:04.766 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:04 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:46:04.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:04 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:04.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:04 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:04.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:04 smithi093 ceph-mon[115914]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:46:04.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:04 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:04.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:04 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:04.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:04 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:46:04.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:04 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:46:04.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:04 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:04.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:04 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:46:06.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:05 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:46:06.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:05 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:46:06.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:06.571+0000 7f5874ff9700 1 -- 172.21.15.63:0/3837418737 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5878111720 con 0x7f5860068ed0 2023-12-12T11:46:06.574 INFO:teuthology.orchestra.run.smithi063.stdout:Created osd(s) 0 on host 'smithi063' 2023-12-12T11:46:06.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:06.574+0000 7f587e98f700 1 -- 172.21.15.63:0/3837418737 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f5860068ed0 msgr2=0x7f586006b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:46:06.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:06.574+0000 7f587e98f700 1 --2- 172.21.15.63:0/3837418737 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f5860068ed0 0x7f586006b380 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f586c004d00 tx=0x7f586c009ce0 comp rx=0 tx=0).stop 2023-12-12T11:46:06.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:06.574+0000 7f587e98f700 1 -- 172.21.15.63:0/3837418737 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58780fcbf0 msgr2=0x7f587810f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:46:06.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:06.574+0000 7f587e98f700 1 --2- 172.21.15.63:0/3837418737 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58780fcbf0 0x7f587810f740 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5868000c00 tx=0x7f5868009e30 comp rx=0 tx=0).stop 2023-12-12T11:46:06.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:06.574+0000 7f587e98f700 1 -- 172.21.15.63:0/3837418737 shutdown_connections 2023-12-12T11:46:06.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:06.574+0000 7f587e98f700 1 --2- 172.21.15.63:0/3837418737 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f5860068ed0 0x7f586006b380 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:46:06.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:06.574+0000 7f587e98f700 1 --2- 172.21.15.63:0/3837418737 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58780fcbf0 0x7f587810f740 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:46:06.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:06.574+0000 7f587e98f700 1 --2- 172.21.15.63:0/3837418737 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f58780fde00 0x7f587810fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:46:06.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:06.574+0000 7f587e98f700 1 -- 172.21.15.63:0/3837418737 >> 172.21.15.63:0/3837418737 conn(0x7f58780f82d0 msgr2=0x7f58780ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:46:06.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:06.574+0000 7f587e98f700 1 -- 172.21.15.63:0/3837418737 shutdown_connections 2023-12-12T11:46:06.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:06.574+0000 7f587e98f700 1 -- 172.21.15.63:0/3837418737 wait complete. 2023-12-12T11:46:07.262 DEBUG:teuthology.orchestra.run.smithi063:osd.0> sudo journalctl -f -n 0 -u ceph-85e33c70-98e3-11ee-95a3-87774f69a715@osd.0.service 2023-12-12T11:46:07.266 INFO:tasks.cephadm:Deploying osd.1 on smithi063 with /dev/vg_nvme/lv_3... 2023-12-12T11:46:07.266 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-12T11:46:07.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:07 smithi063 ceph-mon[107117]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:46:07.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:07 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:07.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:07 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:07.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:07 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:07.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:07 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:07.348 INFO:journalctl@ceph.osd.0.smithi063.stdout:-- Logs begin at Tue 2023-12-12 11:27:09 UTC. -- 2023-12-12T11:46:07.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:07 smithi093 ceph-mon[115914]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:46:07.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:07 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:07.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:07 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:07.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:07 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:07.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:07 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:07.651 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:46:07 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-0[130381]: 2023-12-12T11:46:07.410+0000 7efd8e598540 -1 osd.0 0 log_to_monitors true 2023-12-12T11:46:07.866 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:46:08.389 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:08 smithi063 ceph-mon[107117]: from='osd.0 [v2:172.21.15.63:6802/2424092816,v1:172.21.15.63:6803/2424092816]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-12T11:46:08.389 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:08 smithi063 ceph-mon[107117]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-12T11:46:08.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:08 smithi093 ceph-mon[115914]: from='osd.0 [v2:172.21.15.63:6802/2424092816,v1:172.21.15.63:6803/2424092816]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-12T11:46:08.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:08 smithi093 ceph-mon[115914]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-12T11:46:09.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:09 smithi093 ceph-mon[115914]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:46:09.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:09 smithi093 ceph-mon[115914]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-12T11:46:09.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:09 smithi093 ceph-mon[115914]: osdmap e7: 1 total, 0 up, 1 in 2023-12-12T11:46:09.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:09 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-12T11:46:09.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:09 smithi093 ceph-mon[115914]: from='osd.0 [v2:172.21.15.63:6802/2424092816,v1:172.21.15.63:6803/2424092816]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2023-12-12T11:46:09.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:09 smithi093 ceph-mon[115914]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2023-12-12T11:46:09.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:09 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:09.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:09 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:09.506 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:09 smithi063 ceph-mon[107117]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:46:09.506 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:09 smithi063 ceph-mon[107117]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-12T11:46:09.506 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:09 smithi063 ceph-mon[107117]: osdmap e7: 1 total, 0 up, 1 in 2023-12-12T11:46:09.506 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:09 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-12T11:46:09.506 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:09 smithi063 ceph-mon[107117]: from='osd.0 [v2:172.21.15.63:6802/2424092816,v1:172.21.15.63:6803/2424092816]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2023-12-12T11:46:09.507 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:09 smithi063 ceph-mon[107117]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2023-12-12T11:46:09.507 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:09 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:09.507 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:09 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:09.507 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:46:09 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-0[130381]: 2023-12-12T11:46:09.205+0000 7efd84d7d700 -1 osd.0 0 waiting for initial osdmap 2023-12-12T11:46:09.507 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:46:09 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-0[130381]: 2023-12-12T11:46:09.211+0000 7efd7fb78700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T11:46:09.617 INFO:teuthology.orchestra.run.smithi063.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-12T11:46:09.618 INFO:teuthology.orchestra.run.smithi063.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-12T11:46:09.618 INFO:teuthology.orchestra.run.smithi063.stderr: stderr: 10+0 records in 2023-12-12T11:46:09.618 INFO:teuthology.orchestra.run.smithi063.stderr:10+0 records out 2023-12-12T11:46:09.618 INFO:teuthology.orchestra.run.smithi063.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0330939 s, 317 MB/s 2023-12-12T11:46:09.618 INFO:teuthology.orchestra.run.smithi063.stderr:--> Zapping successful for: 2023-12-12T11:46:09.942 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi063:vg_nvme/lv_3 2023-12-12T11:46:10.404 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:46:10.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:10 smithi093 ceph-mon[115914]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2023-12-12T11:46:10.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:10 smithi093 ceph-mon[115914]: osdmap e8: 1 total, 0 up, 1 in 2023-12-12T11:46:10.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:10 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-12T11:46:10.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:10 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-12T11:46:10.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:10 smithi063 ceph-mon[107117]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2023-12-12T11:46:10.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:10 smithi063 ceph-mon[107117]: osdmap e8: 1 total, 0 up, 1 in 2023-12-12T11:46:10.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:10 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-12T11:46:10.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:10 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-12T11:46:11.212 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:11 smithi063 ceph-mon[107117]: purged_snaps scrub starts 2023-12-12T11:46:11.212 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:11 smithi063 ceph-mon[107117]: purged_snaps scrub ok 2023-12-12T11:46:11.212 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:11 smithi063 ceph-mon[107117]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:46:11.212 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:11 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-12T11:46:11.213 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:11 smithi063 ceph-mon[107117]: osd.0 [v2:172.21.15.63:6802/2424092816,v1:172.21.15.63:6803/2424092816] boot 2023-12-12T11:46:11.213 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:11 smithi063 ceph-mon[107117]: osdmap e9: 1 total, 1 up, 1 in 2023-12-12T11:46:11.213 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:11 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-12T11:46:11.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:11 smithi093 ceph-mon[115914]: purged_snaps scrub starts 2023-12-12T11:46:11.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:11 smithi093 ceph-mon[115914]: purged_snaps scrub ok 2023-12-12T11:46:11.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:11 smithi093 ceph-mon[115914]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-12T11:46:11.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:11 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-12T11:46:11.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:11 smithi093 ceph-mon[115914]: osd.0 [v2:172.21.15.63:6802/2424092816,v1:172.21.15.63:6803/2424092816] boot 2023-12-12T11:46:11.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:11 smithi093 ceph-mon[115914]: osdmap e9: 1 total, 1 up, 1 in 2023-12-12T11:46:11.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:11 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-12T11:46:11.562 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.560+0000 7f6675ffb700 1 -- 172.21.15.63:0/1336189049 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f666c00bba0 con 0x7f6678070570 2023-12-12T11:46:11.562 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.560+0000 7f667d79f700 1 -- 172.21.15.63:0/1336189049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6678070570 msgr2=0x7f66780709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:46:11.562 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.560+0000 7f667d79f700 1 --2- 172.21.15.63:0/1336189049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6678070570 0x7f66780709c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f666c004940 tx=0x7f666c009e30 comp rx=0 tx=0).stop 2023-12-12T11:46:11.563 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.560+0000 7f667d79f700 1 -- 172.21.15.63:0/1336189049 shutdown_connections 2023-12-12T11:46:11.563 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.560+0000 7f667d79f700 1 --2- 172.21.15.63:0/1336189049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6678070570 0x7f66780709c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:46:11.563 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.560+0000 7f667d79f700 1 --2- 172.21.15.63:0/1336189049 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6678071bc0 0x7f6678070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:46:11.563 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.560+0000 7f667d79f700 1 -- 172.21.15.63:0/1336189049 >> 172.21.15.63:0/1336189049 conn(0x7f66780f82d0 msgr2=0x7f66780fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:46:11.563 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.560+0000 7f667d79f700 1 -- 172.21.15.63:0/1336189049 shutdown_connections 2023-12-12T11:46:11.563 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.560+0000 7f667d79f700 1 -- 172.21.15.63:0/1336189049 wait complete. 2023-12-12T11:46:11.563 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.561+0000 7f667d79f700 1 Processor -- start 2023-12-12T11:46:11.563 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.561+0000 7f667d79f700 1 -- start start 2023-12-12T11:46:11.564 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.562+0000 7f667d79f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6678070570 0x7f667810f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:46:11.564 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.562+0000 7f667d79f700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6678071bc0 0x7f667810fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:46:11.564 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.562+0000 7f667d79f700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66781103a0 con 0x7f6678070570 2023-12-12T11:46:11.564 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.562+0000 7f667d79f700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6678110c40 con 0x7f6678071bc0 2023-12-12T11:46:11.564 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.562+0000 7f6676ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6678070570 0x7f667810f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:46:11.564 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.562+0000 7f6676ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6678070570 0x7f667810f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54472/0 (socket says 172.21.15.63:54472) 2023-12-12T11:46:11.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.562+0000 7f6676ffd700 1 -- 172.21.15.63:0/1076358489 learned_addr learned my addr 172.21.15.63:0/1076358489 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:46:11.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.562+0000 7f66767fc700 1 --2- 172.21.15.63:0/1076358489 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6678071bc0 0x7f667810fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:46:11.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.563+0000 7f6676ffd700 1 -- 172.21.15.63:0/1076358489 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6678071bc0 msgr2=0x7f667810fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:46:11.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.563+0000 7f6676ffd700 1 --2- 172.21.15.63:0/1076358489 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6678071bc0 0x7f667810fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:46:11.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.563+0000 7f6676ffd700 1 -- 172.21.15.63:0/1076358489 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f666c005040 con 0x7f6678070570 2023-12-12T11:46:11.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.563+0000 7f66767fc700 1 --2- 172.21.15.63:0/1076358489 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6678071bc0 0x7f667810fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T11:46:11.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.563+0000 7f6676ffd700 1 --2- 172.21.15.63:0/1076358489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6678070570 0x7f667810f860 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6668002a50 tx=0x7f66680046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:46:11.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.563+0000 7f665f7fe700 1 -- 172.21.15.63:0/1076358489 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6668007cc0 con 0x7f6678070570 2023-12-12T11:46:11.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.563+0000 7f665f7fe700 1 -- 172.21.15.63:0/1076358489 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f666800f040 con 0x7f6678070570 2023-12-12T11:46:11.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.563+0000 7f665f7fe700 1 -- 172.21.15.63:0/1076358489 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6668009540 con 0x7f6678070570 2023-12-12T11:46:11.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.563+0000 7f667d79f700 1 -- 172.21.15.63:0/1076358489 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6678110f20 con 0x7f6678070570 2023-12-12T11:46:11.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.563+0000 7f667d79f700 1 -- 172.21.15.63:0/1076358489 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6678111460 con 0x7f6678070570 2023-12-12T11:46:11.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.565+0000 7f667d79f700 1 -- 172.21.15.63:0/1076358489 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66781096f0 con 0x7f6678070570 2023-12-12T11:46:11.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.565+0000 7f665f7fe700 1 -- 172.21.15.63:0/1076358489 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f66680096a0 con 0x7f6678070570 2023-12-12T11:46:11.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.567+0000 7f665f7fe700 1 --2- 172.21.15.63:0/1076358489 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f6660068ed0 0x7f666006b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:46:11.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.567+0000 7f665f7fe700 1 -- 172.21.15.63:0/1076358489 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7f6668085cb0 con 0x7f6678070570 2023-12-12T11:46:11.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.567+0000 7f66767fc700 1 --2- 172.21.15.63:0/1076358489 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f6660068ed0 0x7f666006b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:46:11.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.568+0000 7f66767fc700 1 --2- 172.21.15.63:0/1076358489 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f6660068ed0 0x7f666006b380 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f666c00b3b0 tx=0x7f666c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:46:11.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.571+0000 7f665f7fe700 1 -- 172.21.15.63:0/1076358489 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f66680569f0 con 0x7f6678070570 2023-12-12T11:46:11.790 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:11.788+0000 7f667d79f700 1 -- 172.21.15.63:0/1076358489 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f66781116d0 con 0x7f6660068ed0 2023-12-12T11:46:12.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:12 smithi093 ceph-mon[115914]: osdmap e10: 1 total, 1 up, 1 in 2023-12-12T11:46:12.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:12 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-12T11:46:12.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:12 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-12T11:46:12.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:12 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:46:12.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:12 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:12.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:12 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:12.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:12 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:46:12.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:12 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:12.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:12 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:46:12.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:12 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:46:12.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:12 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:12.533 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:12 smithi063 ceph-mon[107117]: osdmap e10: 1 total, 1 up, 1 in 2023-12-12T11:46:12.533 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:12 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-12T11:46:12.533 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:12 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-12T11:46:12.534 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:12 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:46:12.534 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:12 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:12.534 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:12 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:12.534 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:12 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:46:12.534 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:12 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:12.534 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:12 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:46:12.534 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:12 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:46:12.534 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:12 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:13.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:13 smithi093 ceph-mon[115914]: from='client.14264 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:46:13.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:13 smithi093 ceph-mon[115914]: pgmap v31: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-12T11:46:13.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:13 smithi093 ceph-mon[115914]: Detected new or changed devices on smithi063 2023-12-12T11:46:13.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:13 smithi093 ceph-mon[115914]: Adjusting osd_memory_target on smithi063 to 13047M 2023-12-12T11:46:13.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:13 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:46:13.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:13 smithi063 ceph-mon[107117]: from='client.14264 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:46:13.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:13 smithi063 ceph-mon[107117]: pgmap v31: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-12T11:46:13.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:13 smithi063 ceph-mon[107117]: Detected new or changed devices on smithi063 2023-12-12T11:46:13.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:13 smithi063 ceph-mon[107117]: Adjusting osd_memory_target on smithi063 to 13047M 2023-12-12T11:46:13.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:13 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:46:15.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:15 smithi093 ceph-mon[115914]: pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-12T11:46:15.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:15 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:15.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:15 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:15.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:15 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/4183406180' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b45154ac-c018-4aa6-89d4-f22bd94b66c1"}]: dispatch 2023-12-12T11:46:15.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:15 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/4183406180' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b45154ac-c018-4aa6-89d4-f22bd94b66c1"}]': finished 2023-12-12T11:46:15.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:15 smithi093 ceph-mon[115914]: osdmap e11: 2 total, 1 up, 2 in 2023-12-12T11:46:15.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:15 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-12T11:46:15.473 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:15 smithi063 ceph-mon[107117]: pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-12T11:46:15.473 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:15 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:15.473 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:15 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:15.473 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:15 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/4183406180' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b45154ac-c018-4aa6-89d4-f22bd94b66c1"}]: dispatch 2023-12-12T11:46:15.473 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:15 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/4183406180' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b45154ac-c018-4aa6-89d4-f22bd94b66c1"}]': finished 2023-12-12T11:46:15.473 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:15 smithi063 ceph-mon[107117]: osdmap e11: 2 total, 1 up, 2 in 2023-12-12T11:46:15.473 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:15 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-12T11:46:16.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:16 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/2612141783' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-12T11:46:16.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:16 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/2612141783' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-12T11:46:17.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:17 smithi093 ceph-mon[115914]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-12T11:46:17.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:17 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:17.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:17 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:17.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:17 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:46:17.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:17 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:46:17.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:17 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:17.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:17 smithi063 ceph-mon[107117]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-12T11:46:17.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:17 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:17.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:17 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:17.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:17 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:46:17.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:17 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:46:17.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:17 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:19.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:19 smithi063 ceph-mon[107117]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-12T11:46:19.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:19 smithi093 ceph-mon[115914]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-12T11:46:21.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:21 smithi063 ceph-mon[107117]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-12T11:46:21.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:21 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:46:21.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:21 smithi093 ceph-mon[115914]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-12T11:46:21.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:21 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:46:22.246 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:22 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-12T11:46:22.246 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:22 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:46:22.246 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:22 smithi063 ceph-mon[107117]: Deploying daemon osd.1 on smithi063 2023-12-12T11:46:22.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:22 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-12T11:46:22.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:22 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:46:22.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:22 smithi093 ceph-mon[115914]: Deploying daemon osd.1 on smithi063 2023-12-12T11:46:23.448 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:23 smithi063 ceph-mon[107117]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-12T11:46:23.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:23 smithi093 ceph-mon[115914]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-12T11:46:25.440 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:25 smithi063 ceph-mon[107117]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-12T11:46:25.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:25 smithi093 ceph-mon[115914]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-12T11:46:27.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:27 smithi063 ceph-mon[107117]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-12T11:46:27.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:27 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:27.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:27 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:46:27.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:27 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:27.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:27 smithi093 ceph-mon[115914]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-12T11:46:27.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:27.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:46:27.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:27 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:29.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:29.444+0000 7f665f7fe700 1 -- 172.21.15.63:0/1076358489 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f66781116d0 con 0x7f6660068ed0 2023-12-12T11:46:29.446 INFO:teuthology.orchestra.run.smithi063.stdout:Created osd(s) 1 on host 'smithi063' 2023-12-12T11:46:29.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:29.446+0000 7f667d79f700 1 -- 172.21.15.63:0/1076358489 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f6660068ed0 msgr2=0x7f666006b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:46:29.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:29.446+0000 7f667d79f700 1 --2- 172.21.15.63:0/1076358489 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f6660068ed0 0x7f666006b380 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f666c00b3b0 tx=0x7f666c009e30 comp rx=0 tx=0).stop 2023-12-12T11:46:29.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:29.446+0000 7f667d79f700 1 -- 172.21.15.63:0/1076358489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6678070570 msgr2=0x7f667810f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:46:29.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:29.446+0000 7f667d79f700 1 --2- 172.21.15.63:0/1076358489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6678070570 0x7f667810f860 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6668002a50 tx=0x7f66680046b0 comp rx=0 tx=0).stop 2023-12-12T11:46:29.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:29.446+0000 7f667d79f700 1 -- 172.21.15.63:0/1076358489 shutdown_connections 2023-12-12T11:46:29.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:29.446+0000 7f667d79f700 1 --2- 172.21.15.63:0/1076358489 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f6660068ed0 0x7f666006b380 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:46:29.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:29.446+0000 7f667d79f700 1 --2- 172.21.15.63:0/1076358489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6678070570 0x7f667810f860 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:46:29.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:29.446+0000 7f667d79f700 1 --2- 172.21.15.63:0/1076358489 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6678071bc0 0x7f667810fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:46:29.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:29.446+0000 7f667d79f700 1 -- 172.21.15.63:0/1076358489 >> 172.21.15.63:0/1076358489 conn(0x7f66780f82d0 msgr2=0x7f6678103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:46:29.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:29.446+0000 7f667d79f700 1 -- 172.21.15.63:0/1076358489 shutdown_connections 2023-12-12T11:46:29.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:29.447+0000 7f667d79f700 1 -- 172.21.15.63:0/1076358489 wait complete. 2023-12-12T11:46:29.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:29 smithi093 ceph-mon[115914]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-12T11:46:29.473 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:29 smithi063 ceph-mon[107117]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-12T11:46:29.884 DEBUG:teuthology.orchestra.run.smithi063:osd.1> sudo journalctl -f -n 0 -u ceph-85e33c70-98e3-11ee-95a3-87774f69a715@osd.1.service 2023-12-12T11:46:29.889 INFO:tasks.cephadm:Deploying osd.2 on smithi063 with /dev/vg_nvme/lv_2... 2023-12-12T11:46:29.889 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-12T11:46:29.972 INFO:journalctl@ceph.osd.1.smithi063.stdout:-- Logs begin at Tue 2023-12-12 11:27:09 UTC. -- 2023-12-12T11:46:30.506 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:46:30.544 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:46:30 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-1[139948]: 2023-12-12T11:46:30.251+0000 7fc24f8a6540 -1 osd.1 0 log_to_monitors true 2023-12-12T11:46:30.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:30 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:30.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:30 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:30.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:30 smithi063 ceph-mon[107117]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-12T11:46:30.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:30 smithi063 ceph-mon[107117]: from='osd.1 [v2:172.21.15.63:6810/1292346728,v1:172.21.15.63:6811/1292346728]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-12T11:46:30.720 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:30 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:30.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:30 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:30.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:30 smithi093 ceph-mon[115914]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-12T11:46:30.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:30 smithi093 ceph-mon[115914]: from='osd.1 [v2:172.21.15.63:6810/1292346728,v1:172.21.15.63:6811/1292346728]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-12T11:46:31.699 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:46:31 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-1[139948]: 2023-12-12T11:46:31.429+0000 7fc24608b700 -1 osd.1 0 waiting for initial osdmap 2023-12-12T11:46:31.699 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:46:31 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-1[139948]: 2023-12-12T11:46:31.435+0000 7fc240e86700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T11:46:31.699 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:31 smithi063 ceph-mon[107117]: from='osd.1 [v2:172.21.15.63:6810/1292346728,v1:172.21.15.63:6811/1292346728]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-12T11:46:31.699 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:31 smithi063 ceph-mon[107117]: osdmap e12: 2 total, 1 up, 2 in 2023-12-12T11:46:31.699 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:31 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-12T11:46:31.700 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:31 smithi063 ceph-mon[107117]: from='osd.1 [v2:172.21.15.63:6810/1292346728,v1:172.21.15.63:6811/1292346728]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2023-12-12T11:46:31.700 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:31 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:31.700 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:31 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:31.720 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:31 smithi093 ceph-mon[115914]: from='osd.1 [v2:172.21.15.63:6810/1292346728,v1:172.21.15.63:6811/1292346728]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-12T11:46:31.720 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:31 smithi093 ceph-mon[115914]: osdmap e12: 2 total, 1 up, 2 in 2023-12-12T11:46:31.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:31 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-12T11:46:31.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:31 smithi093 ceph-mon[115914]: from='osd.1 [v2:172.21.15.63:6810/1292346728,v1:172.21.15.63:6811/1292346728]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2023-12-12T11:46:31.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:31 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:31.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:31 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:32.420 INFO:teuthology.orchestra.run.smithi063.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-12T11:46:32.420 INFO:teuthology.orchestra.run.smithi063.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-12T11:46:32.420 INFO:teuthology.orchestra.run.smithi063.stderr: stderr: 10+0 records in 2023-12-12T11:46:32.420 INFO:teuthology.orchestra.run.smithi063.stderr:10+0 records out 2023-12-12T11:46:32.420 INFO:teuthology.orchestra.run.smithi063.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0589796 s, 178 MB/s 2023-12-12T11:46:32.420 INFO:teuthology.orchestra.run.smithi063.stderr: stderr: 2023-12-12T11:46:32.420 INFO:teuthology.orchestra.run.smithi063.stderr:--> Zapping successful for: 2023-12-12T11:46:32.670 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:32 smithi063 ceph-mon[107117]: from='osd.1 [v2:172.21.15.63:6810/1292346728,v1:172.21.15.63:6811/1292346728]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2023-12-12T11:46:32.670 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:32 smithi063 ceph-mon[107117]: osdmap e13: 2 total, 1 up, 2 in 2023-12-12T11:46:32.670 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:32 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-12T11:46:32.670 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:32 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-12T11:46:32.670 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:32 smithi063 ceph-mon[107117]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-12T11:46:32.720 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:32 smithi093 ceph-mon[115914]: from='osd.1 [v2:172.21.15.63:6810/1292346728,v1:172.21.15.63:6811/1292346728]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2023-12-12T11:46:32.720 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:32 smithi093 ceph-mon[115914]: osdmap e13: 2 total, 1 up, 2 in 2023-12-12T11:46:32.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:32 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-12T11:46:32.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:32 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-12T11:46:32.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:32 smithi093 ceph-mon[115914]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-12T11:46:32.867 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi063:vg_nvme/lv_2 2023-12-12T11:46:33.364 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:46:33.720 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:33 smithi093 ceph-mon[115914]: purged_snaps scrub starts 2023-12-12T11:46:33.720 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:33 smithi093 ceph-mon[115914]: purged_snaps scrub ok 2023-12-12T11:46:33.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:33 smithi093 ceph-mon[115914]: osd.1 [v2:172.21.15.63:6810/1292346728,v1:172.21.15.63:6811/1292346728] boot 2023-12-12T11:46:33.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:33 smithi093 ceph-mon[115914]: osdmap e14: 2 total, 2 up, 2 in 2023-12-12T11:46:33.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:33 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-12T11:46:33.721 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:33 smithi063 ceph-mon[107117]: purged_snaps scrub starts 2023-12-12T11:46:33.721 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:33 smithi063 ceph-mon[107117]: purged_snaps scrub ok 2023-12-12T11:46:33.721 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:33 smithi063 ceph-mon[107117]: osd.1 [v2:172.21.15.63:6810/1292346728,v1:172.21.15.63:6811/1292346728] boot 2023-12-12T11:46:33.721 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:33 smithi063 ceph-mon[107117]: osdmap e14: 2 total, 2 up, 2 in 2023-12-12T11:46:33.721 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:33 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-12T11:46:34.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.724+0000 7f86780f0700 1 -- 172.21.15.63:0/38170749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8670070510 msgr2=0x7f8670070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:46:34.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.724+0000 7f86780f0700 1 --2- 172.21.15.63:0/38170749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8670070510 0x7f8670070980 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8660004940 tx=0x7f8660009e30 comp rx=0 tx=0).stop 2023-12-12T11:46:34.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.724+0000 7f86780f0700 1 -- 172.21.15.63:0/38170749 shutdown_connections 2023-12-12T11:46:34.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.724+0000 7f86780f0700 1 --2- 172.21.15.63:0/38170749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8670070510 0x7f8670070980 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:46:34.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.724+0000 7f86780f0700 1 --2- 172.21.15.63:0/38170749 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8670071b60 0x7f867006ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:46:34.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.724+0000 7f86780f0700 1 -- 172.21.15.63:0/38170749 >> 172.21.15.63:0/38170749 conn(0x7f86700f82d0 msgr2=0x7f86700fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:46:34.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.724+0000 7f86780f0700 1 -- 172.21.15.63:0/38170749 shutdown_connections 2023-12-12T11:46:34.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.724+0000 7f86780f0700 1 -- 172.21.15.63:0/38170749 wait complete. 2023-12-12T11:46:34.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.725+0000 7f86780f0700 1 Processor -- start 2023-12-12T11:46:34.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.725+0000 7f86780f0700 1 -- start start 2023-12-12T11:46:34.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.726+0000 7f86780f0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8670070510 0x7f867010f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:46:34.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.726+0000 7f86780f0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8670071b60 0x7f867010fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:46:34.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.726+0000 7f86780f0700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86701102f0 con 0x7f8670071b60 2023-12-12T11:46:34.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.726+0000 7f86780f0700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8670110b90 con 0x7f8670070510 2023-12-12T11:46:34.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.726+0000 7f8675e8c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8670070510 0x7f867010f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:46:34.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.726+0000 7f867568b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8670071b60 0x7f867010fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:46:34.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.726+0000 7f8675e8c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8670070510 0x7f867010f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:38988/0 (socket says 172.21.15.63:38988) 2023-12-12T11:46:34.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.726+0000 7f8675e8c700 1 -- 172.21.15.63:0/732217674 learned_addr learned my addr 172.21.15.63:0/732217674 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:46:34.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.726+0000 7f8675e8c700 1 -- 172.21.15.63:0/732217674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8670071b60 msgr2=0x7f867010fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:46:34.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.726+0000 7f8675e8c700 1 --2- 172.21.15.63:0/732217674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8670071b60 0x7f867010fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:46:34.730 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.726+0000 7f8675e8c700 1 -- 172.21.15.63:0/732217674 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8660005040 con 0x7f8670070510 2023-12-12T11:46:34.730 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.726+0000 7f867568b700 1 --2- 172.21.15.63:0/732217674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8670071b60 0x7f867010fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T11:46:34.730 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.727+0000 7f8675e8c700 1 --2- 172.21.15.63:0/732217674 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8670070510 0x7f867010f7b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f866c002a80 tx=0x7f866c0046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:46:34.730 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.727+0000 7f86667fc700 1 -- 172.21.15.63:0/732217674 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f866c007cc0 con 0x7f8670070510 2023-12-12T11:46:34.730 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.727+0000 7f86667fc700 1 -- 172.21.15.63:0/732217674 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f866c00f040 con 0x7f8670070510 2023-12-12T11:46:34.730 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.727+0000 7f86780f0700 1 -- 172.21.15.63:0/732217674 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8670110e70 con 0x7f8670070510 2023-12-12T11:46:34.730 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.727+0000 7f86667fc700 1 -- 172.21.15.63:0/732217674 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f866c00da60 con 0x7f8670070510 2023-12-12T11:46:34.730 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.727+0000 7f86780f0700 1 -- 172.21.15.63:0/732217674 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86701113b0 con 0x7f8670070510 2023-12-12T11:46:34.730 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.728+0000 7f86780f0700 1 -- 172.21.15.63:0/732217674 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86701096f0 con 0x7f8670070510 2023-12-12T11:46:34.731 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.729+0000 7f86667fc700 1 -- 172.21.15.63:0/732217674 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f866c00dbc0 con 0x7f8670070510 2023-12-12T11:46:34.732 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.730+0000 7f86667fc700 1 --2- 172.21.15.63:0/732217674 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f865c068ed0 0x7f865c06b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:46:34.732 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.730+0000 7f86667fc700 1 -- 172.21.15.63:0/732217674 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7f866c085da0 con 0x7f8670070510 2023-12-12T11:46:34.732 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.730+0000 7f867568b700 1 --2- 172.21.15.63:0/732217674 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f865c068ed0 0x7f865c06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:46:34.733 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.731+0000 7f867568b700 1 --2- 172.21.15.63:0/732217674 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f865c068ed0 0x7f865c06b380 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8660004890 tx=0x7f8660009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:46:34.737 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.735+0000 7f86667fc700 1 -- 172.21.15.63:0/732217674 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f866c0568b0 con 0x7f8670070510 2023-12-12T11:46:34.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:34 smithi063 ceph-mon[107117]: osdmap e15: 2 total, 2 up, 2 in 2023-12-12T11:46:34.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:34 smithi063 ceph-mon[107117]: pgmap v47: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-12T11:46:34.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:34 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:34.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:34 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:34.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:34 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:46:34.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:34 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:46:34.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:34 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:34.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:34 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:46:34.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:34 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:46:34.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:34 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:34.952 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:34.950+0000 7f86780f0700 1 -- 172.21.15.63:0/732217674 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f86701115d0 con 0x7f865c068ed0 2023-12-12T11:46:34.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:34 smithi093 ceph-mon[115914]: osdmap e15: 2 total, 2 up, 2 in 2023-12-12T11:46:34.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:34 smithi093 ceph-mon[115914]: pgmap v47: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-12T11:46:34.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:34 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:34.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:34 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:34.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:34 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:46:34.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:34 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:46:34.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:34 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:34.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:34 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:46:34.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:34 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:46:34.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:34 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:35.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:35 smithi063 ceph-mon[107117]: Detected new or changed devices on smithi063 2023-12-12T11:46:35.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:35 smithi063 ceph-mon[107117]: Adjusting osd_memory_target on smithi063 to 6523M 2023-12-12T11:46:35.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:35 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:46:35.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:35 smithi063 ceph-mon[107117]: from='client.24129 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:46:35.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:35 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-12T11:46:35.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:35 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-12T11:46:35.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:35 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:46:35.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:35 smithi093 ceph-mon[115914]: Detected new or changed devices on smithi063 2023-12-12T11:46:35.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:35 smithi093 ceph-mon[115914]: Adjusting osd_memory_target on smithi063 to 6523M 2023-12-12T11:46:35.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:35 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:46:35.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:35 smithi093 ceph-mon[115914]: from='client.24129 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:46:35.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:35 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-12T11:46:35.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:35 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-12T11:46:35.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:35 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:46:36.788 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:36 smithi063 ceph-mon[107117]: pgmap v48: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-12T11:46:36.788 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:36 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:46:36.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:36 smithi093 ceph-mon[115914]: pgmap v48: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-12T11:46:36.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:36 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:46:38.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:37 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/1230013422' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2fcdfc7f-334e-427a-8e1e-b95578c88db5"}]: dispatch 2023-12-12T11:46:38.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:37 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/1230013422' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2fcdfc7f-334e-427a-8e1e-b95578c88db5"}]': finished 2023-12-12T11:46:38.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:37 smithi093 ceph-mon[115914]: osdmap e16: 3 total, 2 up, 3 in 2023-12-12T11:46:38.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:37 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-12T11:46:38.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:37 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/1230013422' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2fcdfc7f-334e-427a-8e1e-b95578c88db5"}]: dispatch 2023-12-12T11:46:38.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:37 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/1230013422' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2fcdfc7f-334e-427a-8e1e-b95578c88db5"}]': finished 2023-12-12T11:46:38.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:37 smithi063 ceph-mon[107117]: osdmap e16: 3 total, 2 up, 3 in 2023-12-12T11:46:38.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:37 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-12T11:46:39.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:38 smithi093 ceph-mon[115914]: pgmap v49: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-12T11:46:39.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:38 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/3882095215' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-12T11:46:39.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:38 smithi063 ceph-mon[107117]: pgmap v49: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-12T11:46:39.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:38 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/3882095215' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-12T11:46:40.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:40 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:40.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:40 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:40.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:40 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:46:40.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:40 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:46:40.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:40 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:40.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:40 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:40.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:40 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:40.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:40 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:46:40.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:40 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:46:40.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:40 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:41.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:41 smithi093 ceph-mon[115914]: pgmap v51: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-12T11:46:41.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:41 smithi063 ceph-mon[107117]: pgmap v51: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-12T11:46:42.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:42 smithi063 ceph-mon[107117]: pgmap v52: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-12T11:46:42.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:42 smithi093 ceph-mon[115914]: pgmap v52: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-12T11:46:45.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:44 smithi093 ceph-mon[115914]: pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-12T11:46:45.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:44 smithi063 ceph-mon[107117]: pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-12T11:46:46.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:45 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-12T11:46:46.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:45 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:46:46.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:45 smithi093 ceph-mon[115914]: Deploying daemon osd.2 on smithi063 2023-12-12T11:46:46.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:45 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-12T11:46:46.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:45 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:46:46.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:45 smithi063 ceph-mon[107117]: Deploying daemon osd.2 on smithi063 2023-12-12T11:46:47.110 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:46 smithi063 ceph-mon[107117]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-12T11:46:47.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:46 smithi093 ceph-mon[115914]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-12T11:46:49.202 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:48 smithi063 ceph-mon[107117]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-12T11:46:49.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:48 smithi093 ceph-mon[115914]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-12T11:46:51.112 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:50 smithi063 ceph-mon[107117]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-12T11:46:51.113 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:50 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:51.113 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:50 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:51.113 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:50 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:46:51.113 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:50 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:46:51.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:50 smithi093 ceph-mon[115914]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-12T11:46:51.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:50 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:51.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:50 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:51.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:50 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:46:51.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:50 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:46:52.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:52 smithi063 ceph-mon[107117]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-12T11:46:52.952 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:52.949+0000 7f86667fc700 1 -- 172.21.15.63:0/732217674 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f86701115d0 con 0x7f865c068ed0 2023-12-12T11:46:52.952 INFO:teuthology.orchestra.run.smithi063.stdout:Created osd(s) 2 on host 'smithi063' 2023-12-12T11:46:52.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:52.952+0000 7f86780f0700 1 -- 172.21.15.63:0/732217674 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f865c068ed0 msgr2=0x7f865c06b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:46:52.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:52.952+0000 7f86780f0700 1 --2- 172.21.15.63:0/732217674 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f865c068ed0 0x7f865c06b380 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8660004890 tx=0x7f8660009e30 comp rx=0 tx=0).stop 2023-12-12T11:46:52.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:52.952+0000 7f86780f0700 1 -- 172.21.15.63:0/732217674 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8670070510 msgr2=0x7f867010f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:46:52.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:52.952+0000 7f86780f0700 1 --2- 172.21.15.63:0/732217674 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8670070510 0x7f867010f7b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f866c002a80 tx=0x7f866c0046b0 comp rx=0 tx=0).stop 2023-12-12T11:46:52.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:52.952+0000 7f86780f0700 1 -- 172.21.15.63:0/732217674 shutdown_connections 2023-12-12T11:46:52.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:52.952+0000 7f86780f0700 1 --2- 172.21.15.63:0/732217674 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8670070510 0x7f867010f7b0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:46:52.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:52.952+0000 7f86780f0700 1 --2- 172.21.15.63:0/732217674 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f865c068ed0 0x7f865c06b380 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:46:52.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:52.952+0000 7f86780f0700 1 --2- 172.21.15.63:0/732217674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8670071b60 0x7f867010fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:46:52.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:52.952+0000 7f86780f0700 1 -- 172.21.15.63:0/732217674 >> 172.21.15.63:0/732217674 conn(0x7f86700f82d0 msgr2=0x7f86700fa670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:46:52.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:52.952+0000 7f86780f0700 1 -- 172.21.15.63:0/732217674 shutdown_connections 2023-12-12T11:46:52.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:46:52.952+0000 7f86780f0700 1 -- 172.21.15.63:0/732217674 wait complete. 2023-12-12T11:46:52.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:52 smithi093 ceph-mon[115914]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-12T11:46:53.429 DEBUG:teuthology.orchestra.run.smithi063:osd.2> sudo journalctl -f -n 0 -u ceph-85e33c70-98e3-11ee-95a3-87774f69a715@osd.2.service 2023-12-12T11:46:53.433 INFO:tasks.cephadm:Deploying osd.3 on smithi093 with /dev/vg_nvme/lv_4... 2023-12-12T11:46:53.433 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-12T11:46:53.510 INFO:journalctl@ceph.osd.2.smithi063.stdout:-- Logs begin at Tue 2023-12-12 11:27:09 UTC. -- 2023-12-12T11:46:53.856 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi093/config 2023-12-12T11:46:54.156 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:53 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:54.156 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:53 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:54.156 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:53 smithi093 ceph-mon[115914]: from='osd.2 [v2:172.21.15.63:6818/3760392553,v1:172.21.15.63:6819/3760392553]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-12T11:46:54.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:53 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:54.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:53 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:54.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:53 smithi063 ceph-mon[107117]: from='osd.2 [v2:172.21.15.63:6818/3760392553,v1:172.21.15.63:6819/3760392553]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-12T11:46:54.295 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:46:53 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-2[149451]: 2023-12-12T11:46:53.887+0000 7fe8e6224540 -1 osd.2 0 log_to_monitors true 2023-12-12T11:46:55.176 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:46:54 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-2[149451]: 2023-12-12T11:46:54.921+0000 7fe8dca09700 -1 osd.2 0 waiting for initial osdmap 2023-12-12T11:46:55.176 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:46:54 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-2[149451]: 2023-12-12T11:46:54.928+0000 7fe8d7804700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T11:46:55.177 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:54 smithi063 ceph-mon[107117]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-12T11:46:55.177 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:54 smithi063 ceph-mon[107117]: from='osd.2 [v2:172.21.15.63:6818/3760392553,v1:172.21.15.63:6819/3760392553]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-12T11:46:55.177 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:54 smithi063 ceph-mon[107117]: osdmap e17: 3 total, 2 up, 3 in 2023-12-12T11:46:55.177 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:54 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-12T11:46:55.177 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:54 smithi063 ceph-mon[107117]: from='osd.2 [v2:172.21.15.63:6818/3760392553,v1:172.21.15.63:6819/3760392553]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2023-12-12T11:46:55.177 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:54 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:55.177 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:54 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:55.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:54 smithi093 ceph-mon[115914]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-12T11:46:55.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:54 smithi093 ceph-mon[115914]: from='osd.2 [v2:172.21.15.63:6818/3760392553,v1:172.21.15.63:6819/3760392553]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-12T11:46:55.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:54 smithi093 ceph-mon[115914]: osdmap e17: 3 total, 2 up, 3 in 2023-12-12T11:46:55.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:54 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-12T11:46:55.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:54 smithi093 ceph-mon[115914]: from='osd.2 [v2:172.21.15.63:6818/3760392553,v1:172.21.15.63:6819/3760392553]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2023-12-12T11:46:55.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:54 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:55.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:54 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:55.433 INFO:teuthology.orchestra.run.smithi093.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-12T11:46:55.433 INFO:teuthology.orchestra.run.smithi093.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-12T11:46:55.433 INFO:teuthology.orchestra.run.smithi093.stderr: stderr: 10+0 records in 2023-12-12T11:46:55.433 INFO:teuthology.orchestra.run.smithi093.stderr:10+0 records out 2023-12-12T11:46:55.433 INFO:teuthology.orchestra.run.smithi093.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0303071 s, 346 MB/s 2023-12-12T11:46:55.433 INFO:teuthology.orchestra.run.smithi093.stderr:--> Zapping successful for: 2023-12-12T11:46:55.806 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi093:vg_nvme/lv_4 2023-12-12T11:46:56.214 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi093/config 2023-12-12T11:46:56.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:55 smithi093 ceph-mon[115914]: from='osd.2 [v2:172.21.15.63:6818/3760392553,v1:172.21.15.63:6819/3760392553]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2023-12-12T11:46:56.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:55 smithi093 ceph-mon[115914]: osdmap e18: 3 total, 2 up, 3 in 2023-12-12T11:46:56.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:55 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-12T11:46:56.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:55 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-12T11:46:56.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:55 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-12T11:46:56.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:55 smithi063 ceph-mon[107117]: from='osd.2 [v2:172.21.15.63:6818/3760392553,v1:172.21.15.63:6819/3760392553]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2023-12-12T11:46:56.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:55 smithi063 ceph-mon[107117]: osdmap e18: 3 total, 2 up, 3 in 2023-12-12T11:46:56.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:55 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-12T11:46:56.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:55 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-12T11:46:56.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:55 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-12T11:46:56.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:56 smithi093 ceph-mon[115914]: purged_snaps scrub starts 2023-12-12T11:46:56.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:56 smithi093 ceph-mon[115914]: purged_snaps scrub ok 2023-12-12T11:46:56.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:56 smithi093 ceph-mon[115914]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-12T11:46:56.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:56 smithi093 ceph-mon[115914]: osd.2 [v2:172.21.15.63:6818/3760392553,v1:172.21.15.63:6819/3760392553] boot 2023-12-12T11:46:56.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:56 smithi093 ceph-mon[115914]: osdmap e19: 3 total, 3 up, 3 in 2023-12-12T11:46:56.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:56 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-12T11:46:57.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:56 smithi063 ceph-mon[107117]: purged_snaps scrub starts 2023-12-12T11:46:57.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:56 smithi063 ceph-mon[107117]: purged_snaps scrub ok 2023-12-12T11:46:57.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:56 smithi063 ceph-mon[107117]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-12T11:46:57.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:56 smithi063 ceph-mon[107117]: osd.2 [v2:172.21.15.63:6818/3760392553,v1:172.21.15.63:6819/3760392553] boot 2023-12-12T11:46:57.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:56 smithi063 ceph-mon[107117]: osdmap e19: 3 total, 3 up, 3 in 2023-12-12T11:46:57.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:56 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-12T11:46:57.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.319+0000 7feeb5432700 1 -- 172.21.15.93:0/3922713796 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feeb0070510 msgr2=0x7feeb0070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:46:57.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.319+0000 7feeb5432700 1 --2- 172.21.15.93:0/3922713796 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feeb0070510 0x7feeb0070980 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7feea4004940 tx=0x7feea4009e30 comp rx=0 tx=0).stop 2023-12-12T11:46:57.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.319+0000 7feeb5432700 1 -- 172.21.15.93:0/3922713796 shutdown_connections 2023-12-12T11:46:57.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.319+0000 7feeb5432700 1 --2- 172.21.15.93:0/3922713796 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feeb0070510 0x7feeb0070980 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:46:57.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.319+0000 7feeb5432700 1 --2- 172.21.15.93:0/3922713796 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feeb0071b60 0x7feeb006ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:46:57.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.319+0000 7feeb5432700 1 -- 172.21.15.93:0/3922713796 >> 172.21.15.93:0/3922713796 conn(0x7feeb00f82d0 msgr2=0x7feeb00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:46:57.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.319+0000 7feeb5432700 1 -- 172.21.15.93:0/3922713796 shutdown_connections 2023-12-12T11:46:57.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.319+0000 7feeb5432700 1 -- 172.21.15.93:0/3922713796 wait complete. 2023-12-12T11:46:57.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.320+0000 7feeb5432700 1 Processor -- start 2023-12-12T11:46:57.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.320+0000 7feeb5432700 1 -- start start 2023-12-12T11:46:57.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.321+0000 7feeb5432700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feeb0070510 0x7feeb010f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:46:57.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.321+0000 7feeb5432700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feeb0071b60 0x7feeb010fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:46:57.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.321+0000 7feeb5432700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb0110330 con 0x7feeb0071b60 2023-12-12T11:46:57.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.321+0000 7feeb5432700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb0110bd0 con 0x7feeb0070510 2023-12-12T11:46:57.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.321+0000 7feeaeffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feeb0070510 0x7feeb010f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:46:57.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.321+0000 7feeae7fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feeb0071b60 0x7feeb010fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:46:57.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.321+0000 7feeaeffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feeb0070510 0x7feeb010f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39492/0 (socket says 172.21.15.93:39492) 2023-12-12T11:46:57.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.321+0000 7feeaeffd700 1 -- 172.21.15.93:0/3089511450 learned_addr learned my addr 172.21.15.93:0/3089511450 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-12-12T11:46:57.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.321+0000 7feeaeffd700 1 -- 172.21.15.93:0/3089511450 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feeb0071b60 msgr2=0x7feeb010fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:46:57.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.321+0000 7feeaeffd700 1 --2- 172.21.15.93:0/3089511450 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feeb0071b60 0x7feeb010fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:46:57.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.321+0000 7feeaeffd700 1 -- 172.21.15.93:0/3089511450 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea4005040 con 0x7feeb0070510 2023-12-12T11:46:57.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.321+0000 7feeae7fc700 1 --2- 172.21.15.93:0/3089511450 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feeb0071b60 0x7feeb010fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T11:46:57.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.322+0000 7feeaeffd700 1 --2- 172.21.15.93:0/3089511450 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feeb0070510 0x7feeb010f7f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7feea000c8c0 tx=0x7feea00044c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:46:57.325 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.322+0000 7fee977fe700 1 -- 172.21.15.93:0/3089511450 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feea000a760 con 0x7feeb0070510 2023-12-12T11:46:57.325 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.322+0000 7feeb5432700 1 -- 172.21.15.93:0/3089511450 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb0110eb0 con 0x7feeb0070510 2023-12-12T11:46:57.325 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.322+0000 7fee977fe700 1 -- 172.21.15.93:0/3089511450 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7feea000ad70 con 0x7feeb0070510 2023-12-12T11:46:57.325 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.322+0000 7fee977fe700 1 -- 172.21.15.93:0/3089511450 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feea00113a0 con 0x7feeb0070510 2023-12-12T11:46:57.325 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.322+0000 7feeb5432700 1 -- 172.21.15.93:0/3089511450 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb01113f0 con 0x7feeb0070510 2023-12-12T11:46:57.326 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.323+0000 7feeb5432700 1 -- 172.21.15.93:0/3089511450 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb01096f0 con 0x7feeb0070510 2023-12-12T11:46:57.326 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.324+0000 7fee977fe700 1 -- 172.21.15.93:0/3089511450 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7feea0012400 con 0x7feeb0070510 2023-12-12T11:46:57.327 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.325+0000 7fee977fe700 1 --2- 172.21.15.93:0/3089511450 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fee98068ed0 0x7fee9806b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:46:57.327 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.325+0000 7fee977fe700 1 -- 172.21.15.93:0/3089511450 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 2842+0+0 (secure 0 0 0) 0x7feea0086380 con 0x7feeb0070510 2023-12-12T11:46:57.327 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.325+0000 7feeae7fc700 1 --2- 172.21.15.93:0/3089511450 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fee98068ed0 0x7fee9806b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:46:57.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.326+0000 7feeae7fc700 1 --2- 172.21.15.93:0/3089511450 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fee98068ed0 0x7fee9806b380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feea4004f90 tx=0x7feea4009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:46:57.332 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.330+0000 7fee977fe700 1 -- 172.21.15.93:0/3089511450 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7feea0056d60 con 0x7feeb0070510 2023-12-12T11:46:57.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:46:57.529+0000 7feeb5432700 1 -- 172.21.15.93:0/3089511450 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi093:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7feeb0111670 con 0x7fee98068ed0 2023-12-12T11:46:58.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:58 smithi063 ceph-mon[107117]: osdmap e20: 3 total, 3 up, 3 in 2023-12-12T11:46:58.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:58 smithi063 ceph-mon[107117]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi093:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:46:58.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:58 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-12T11:46:58.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:58 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-12T11:46:58.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:58 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:46:58.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:58 smithi063 ceph-mon[107117]: Detected new or changed devices on smithi063 2023-12-12T11:46:58.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:58 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:58.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:58 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:58.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:58 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:46:58.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:58 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:46:58.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:58 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:46:58.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:58 smithi063 ceph-mon[107117]: Adjusting osd_memory_target on smithi063 to 4349M 2023-12-12T11:46:58.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:58 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:58.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:58 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:46:58.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:58 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:46:58.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:58 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:58.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:58 smithi063 ceph-mon[107117]: pgmap v64: 0 pgs: ; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-12T11:46:58.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:58 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-12-12T11:46:58.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:58 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:46:58.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:58 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:46:58.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:58 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:46:58.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:58 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:58.864 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:58 smithi093 ceph-mon[115914]: osdmap e20: 3 total, 3 up, 3 in 2023-12-12T11:46:58.864 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:58 smithi093 ceph-mon[115914]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi093:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:46:58.864 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:58 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-12T11:46:58.864 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:58 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-12T11:46:58.864 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:58 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:46:58.864 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:58 smithi093 ceph-mon[115914]: Detected new or changed devices on smithi063 2023-12-12T11:46:58.865 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:58 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:58.865 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:58 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:58.865 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:58 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:46:58.865 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:58 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:46:58.865 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:58 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:46:58.865 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:58 smithi093 ceph-mon[115914]: Adjusting osd_memory_target on smithi063 to 4349M 2023-12-12T11:46:58.865 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:58 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:58.865 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:58 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:46:58.865 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:58 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:46:58.865 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:58 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:46:58.865 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:58 smithi093 ceph-mon[115914]: pgmap v64: 0 pgs: ; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-12T11:46:58.865 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:58 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-12-12T11:46:58.865 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:58 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:46:58.865 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:58 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:46:58.866 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:58 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:46:58.866 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:58 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:00.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:59 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2023-12-12T11:47:00.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:59 smithi063 ceph-mon[107117]: osdmap e21: 3 total, 3 up, 3 in 2023-12-12T11:47:00.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:46:59 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-12T11:47:00.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:59 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2023-12-12T11:47:00.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:59 smithi093 ceph-mon[115914]: osdmap e21: 3 total, 3 up, 3 in 2023-12-12T11:47:00.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:46:59 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-12T11:47:00.544 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:47:00 smithi063 sudo[155365]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-12T11:47:00.544 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:47:00 smithi063 sudo[155365]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-12T11:47:00.544 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:47:00 smithi063 sudo[155365]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-12T11:47:00.544 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:47:00 smithi063 sudo[155365]: pam_unix(sudo:session): session closed for user root 2023-12-12T11:47:01.024 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:00 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-12T11:47:01.024 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:00 smithi093 ceph-mon[115914]: osdmap e22: 3 total, 3 up, 3 in 2023-12-12T11:47:01.024 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:00 smithi093 ceph-mon[115914]: from='client.? 172.21.15.93:0/3261678688' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79666eff-9c6a-4170-b1b6-9fee68b62865"}]: dispatch 2023-12-12T11:47:01.024 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:00 smithi093 ceph-mon[115914]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79666eff-9c6a-4170-b1b6-9fee68b62865"}]: dispatch 2023-12-12T11:47:01.024 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:00 smithi093 ceph-mon[115914]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "79666eff-9c6a-4170-b1b6-9fee68b62865"}]': finished 2023-12-12T11:47:01.024 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:00 smithi093 ceph-mon[115914]: osdmap e23: 4 total, 3 up, 4 in 2023-12-12T11:47:01.024 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:00 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-12T11:47:01.024 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:00 smithi093 ceph-mon[115914]: pgmap v68: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-12T11:47:01.024 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:00 smithi093 ceph-mon[115914]: from='client.? 172.21.15.93:0/2453089073' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-12T11:47:01.044 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:47:00 smithi063 sudo[155368]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-12T11:47:01.044 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:47:00 smithi063 sudo[155368]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-12T11:47:01.044 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:47:00 smithi063 sudo[155368]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-12T11:47:01.044 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:47:00 smithi063 sudo[155368]: pam_unix(sudo:session): session closed for user root 2023-12-12T11:47:01.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:00 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-12T11:47:01.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:00 smithi063 ceph-mon[107117]: osdmap e22: 3 total, 3 up, 3 in 2023-12-12T11:47:01.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:00 smithi063 ceph-mon[107117]: from='client.? 172.21.15.93:0/3261678688' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79666eff-9c6a-4170-b1b6-9fee68b62865"}]: dispatch 2023-12-12T11:47:01.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:00 smithi063 ceph-mon[107117]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79666eff-9c6a-4170-b1b6-9fee68b62865"}]: dispatch 2023-12-12T11:47:01.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:00 smithi063 ceph-mon[107117]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "79666eff-9c6a-4170-b1b6-9fee68b62865"}]': finished 2023-12-12T11:47:01.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:00 smithi063 ceph-mon[107117]: osdmap e23: 4 total, 3 up, 4 in 2023-12-12T11:47:01.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:00 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-12T11:47:01.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:00 smithi063 ceph-mon[107117]: pgmap v68: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-12T11:47:01.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:00 smithi063 ceph-mon[107117]: from='client.? 172.21.15.93:0/2453089073' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-12T11:47:01.794 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:47:01 smithi063 sudo[155371]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-12T11:47:01.794 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:47:01 smithi063 sudo[155371]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-12T11:47:01.794 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:47:01 smithi063 sudo[155371]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-12T11:47:01.794 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:47:01 smithi063 sudo[155371]: pam_unix(sudo:session): session closed for user root 2023-12-12T11:47:02.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:01 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:02.295 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:47:02 smithi063 sudo[155374]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-12T11:47:02.295 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:47:02 smithi063 sudo[155374]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-12T11:47:02.295 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:47:02 smithi063 sudo[155374]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-12T11:47:02.295 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:47:02 smithi063 sudo[155374]: pam_unix(sudo:session): session closed for user root 2023-12-12T11:47:02.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:01 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:02.485 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:02.483+0000 7fee977fe700 1 -- 172.21.15.93:0/3089511450 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7feea0018d70 con 0x7feeb0070510 2023-12-12T11:47:02.990 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:47:02 smithi063 sudo[155377]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-12T11:47:02.990 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:47:02 smithi063 sudo[155377]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-12T11:47:02.990 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:47:02 smithi063 sudo[155377]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-12T11:47:02.990 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:47:02 smithi063 sudo[155377]: pam_unix(sudo:session): session closed for user root 2023-12-12T11:47:03.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:02 smithi063 ceph-mon[107117]: pgmap v69: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2023-12-12T11:47:03.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:02 smithi063 ceph-mon[107117]: mgrmap e19: smithi063.zjnfdi(active, since 116s), standbys: smithi093.nbtltu 2023-12-12T11:47:03.294 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:47:03 smithi063 sudo[155380]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-12T11:47:03.295 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:47:03 smithi063 sudo[155380]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-12T11:47:03.295 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:47:03 smithi063 sudo[155380]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-12T11:47:03.295 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:47:03 smithi063 sudo[155380]: pam_unix(sudo:session): session closed for user root 2023-12-12T11:47:03.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:02 smithi093 ceph-mon[115914]: pgmap v69: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2023-12-12T11:47:03.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:02 smithi093 ceph-mon[115914]: mgrmap e19: smithi063.zjnfdi(active, since 116s), standbys: smithi093.nbtltu 2023-12-12T11:47:04.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:03 smithi063 sudo[155383]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-12T11:47:04.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:03 smithi063 sudo[155383]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-12T11:47:04.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:03 smithi063 sudo[155383]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-12T11:47:04.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:03 smithi063 sudo[155383]: pam_unix(sudo:session): session closed for user root 2023-12-12T11:47:04.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:04 smithi063 sudo[155386]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-12T11:47:04.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:04 smithi063 sudo[155386]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-12T11:47:04.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:04 smithi063 sudo[155386]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-12T11:47:04.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:04 smithi063 sudo[155386]: pam_unix(sudo:session): session closed for user root 2023-12-12T11:47:05.061 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:04 smithi093 sudo[121514]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-12T11:47:05.061 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:04 smithi093 sudo[121514]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-12T11:47:05.061 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:04 smithi093 sudo[121514]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-12T11:47:05.061 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:04 smithi093 sudo[121514]: pam_unix(sudo:session): session closed for user root 2023-12-12T11:47:05.634 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:05 smithi093 sudo[121577]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-12T11:47:05.634 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:05 smithi093 sudo[121577]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-12T11:47:05.634 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:05 smithi093 sudo[121577]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-12T11:47:05.634 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:05 smithi093 sudo[121577]: pam_unix(sudo:session): session closed for user root 2023-12-12T11:47:05.634 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:05 smithi093 ceph-mon[115914]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-12T11:47:05.634 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:05 smithi093 ceph-mon[115914]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-12T11:47:05.634 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:05 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-12T11:47:05.634 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:05 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi093"}]: dispatch 2023-12-12T11:47:05.634 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:05 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-12T11:47:05.634 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:05 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi093"}]: dispatch 2023-12-12T11:47:05.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:05 smithi063 ceph-mon[107117]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-12T11:47:05.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:05 smithi063 ceph-mon[107117]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-12T11:47:05.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:05 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-12T11:47:05.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:05 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi093"}]: dispatch 2023-12-12T11:47:05.798 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:05 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-12T11:47:05.798 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:05 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi093"}]: dispatch 2023-12-12T11:47:06.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:06 smithi093 ceph-mon[115914]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-12T11:47:06.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:06 smithi093 ceph-mon[115914]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-12T11:47:06.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:06 smithi093 ceph-mon[115914]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-12T11:47:06.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:06 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:06.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:06 smithi093 ceph-mon[115914]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-12T11:47:06.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:06 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:47:06.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:06 smithi063 ceph-mon[107117]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-12T11:47:06.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:06 smithi063 ceph-mon[107117]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-12T11:47:06.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:06 smithi063 ceph-mon[107117]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-12T11:47:06.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:06 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:06.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:06 smithi063 ceph-mon[107117]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-12T11:47:06.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:06 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:47:07.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:07 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-12T11:47:07.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:07 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:47:07.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:07 smithi063 ceph-mon[107117]: Deploying daemon osd.3 on smithi093 2023-12-12T11:47:07.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:07 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-12T11:47:07.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:07 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:47:07.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:07 smithi093 ceph-mon[115914]: Deploying daemon osd.3 on smithi093 2023-12-12T11:47:08.720 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:08 smithi093 ceph-mon[115914]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-12T11:47:08.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:08 smithi063 ceph-mon[107117]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-12T11:47:10.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:10 smithi093 ceph-mon[115914]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-12-12T11:47:11.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:10 smithi063 ceph-mon[107117]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-12-12T11:47:12.616 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:12 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:12.616 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:12 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:12.616 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:12 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:47:12.616 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:12 smithi093 ceph-mon[115914]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-12-12T11:47:12.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:12 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:12.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:12 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:12.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:12 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:47:12.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:12 smithi063 ceph-mon[107117]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-12-12T11:47:14.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:14.540+0000 7fee977fe700 1 -- 172.21.15.93:0/3089511450 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7feeb0111670 con 0x7fee98068ed0 2023-12-12T11:47:14.543 INFO:teuthology.orchestra.run.smithi093.stdout:Created osd(s) 3 on host 'smithi093' 2023-12-12T11:47:14.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:14.542+0000 7feeb5432700 1 -- 172.21.15.93:0/3089511450 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fee98068ed0 msgr2=0x7fee9806b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:47:14.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:14.542+0000 7feeb5432700 1 --2- 172.21.15.93:0/3089511450 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fee98068ed0 0x7fee9806b380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feea4004f90 tx=0x7feea4009e30 comp rx=0 tx=0).stop 2023-12-12T11:47:14.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:14.542+0000 7feeb5432700 1 -- 172.21.15.93:0/3089511450 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feeb0070510 msgr2=0x7feeb010f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:47:14.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:14.542+0000 7feeb5432700 1 --2- 172.21.15.93:0/3089511450 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feeb0070510 0x7feeb010f7f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7feea000c8c0 tx=0x7feea00044c0 comp rx=0 tx=0).stop 2023-12-12T11:47:14.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:14.542+0000 7feeb5432700 1 -- 172.21.15.93:0/3089511450 shutdown_connections 2023-12-12T11:47:14.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:14.542+0000 7feeb5432700 1 --2- 172.21.15.93:0/3089511450 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feeb0070510 0x7feeb010f7f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:47:14.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:14.542+0000 7feeb5432700 1 --2- 172.21.15.93:0/3089511450 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fee98068ed0 0x7fee9806b380 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:47:14.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:14.542+0000 7feeb5432700 1 --2- 172.21.15.93:0/3089511450 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feeb0071b60 0x7feeb010fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:47:14.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:14.542+0000 7feeb5432700 1 -- 172.21.15.93:0/3089511450 >> 172.21.15.93:0/3089511450 conn(0x7feeb00f82d0 msgr2=0x7feeb00fa670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:47:14.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:14.543+0000 7feeb5432700 1 -- 172.21.15.93:0/3089511450 shutdown_connections 2023-12-12T11:47:14.546 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:14.543+0000 7feeb5432700 1 -- 172.21.15.93:0/3089511450 wait complete. 2023-12-12T11:47:14.914 DEBUG:teuthology.orchestra.run.smithi093:osd.3> sudo journalctl -f -n 0 -u ceph-85e33c70-98e3-11ee-95a3-87774f69a715@osd.3.service 2023-12-12T11:47:14.919 INFO:tasks.cephadm:Deploying osd.4 on smithi093 with /dev/vg_nvme/lv_3... 2023-12-12T11:47:14.919 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-12T11:47:15.000 INFO:journalctl@ceph.osd.3.smithi093.stdout:-- Logs begin at Tue 2023-12-12 11:24:57 UTC. -- 2023-12-12T11:47:15.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:14 smithi093 ceph-mon[115914]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2023-12-12T11:47:15.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:14 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:15.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:14 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:15.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:14 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:47:15.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:14 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:47:15.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:14 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:15.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:14 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:15.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:14 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:15.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:14 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:47:15.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:14 smithi063 ceph-mon[107117]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2023-12-12T11:47:15.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:14 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:15.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:14 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:15.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:14 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:47:15.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:14 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:47:15.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:14 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:15.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:14 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:15.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:14 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:15.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:14 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:47:15.597 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi093/config 2023-12-12T11:47:15.790 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 11:47:15 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-3[122322]: 2023-12-12T11:47:15.516+0000 7f0c03f65540 -1 osd.3 0 log_to_monitors true 2023-12-12T11:47:16.088 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:15 smithi093 ceph-mon[115914]: from='osd.3 [v2:172.21.15.93:6800/3547672003,v1:172.21.15.93:6801/3547672003]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-12T11:47:16.088 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:15 smithi093 ceph-mon[115914]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-12T11:47:16.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:15 smithi063 ceph-mon[107117]: from='osd.3 [v2:172.21.15.93:6800/3547672003,v1:172.21.15.93:6801/3547672003]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-12T11:47:16.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:15 smithi063 ceph-mon[107117]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-12T11:47:17.221 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 11:47:16 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-3[122322]: 2023-12-12T11:47:16.854+0000 7f0bfa74a700 -1 osd.3 0 waiting for initial osdmap 2023-12-12T11:47:17.221 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 11:47:16 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-3[122322]: 2023-12-12T11:47:16.864+0000 7f0bf5545700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T11:47:17.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:16 smithi093 ceph-mon[115914]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2023-12-12T11:47:17.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:16 smithi093 ceph-mon[115914]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-12T11:47:17.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:16 smithi093 ceph-mon[115914]: osdmap e24: 4 total, 3 up, 4 in 2023-12-12T11:47:17.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:16 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-12T11:47:17.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:16 smithi093 ceph-mon[115914]: from='osd.3 [v2:172.21.15.93:6800/3547672003,v1:172.21.15.93:6801/3547672003]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-12T11:47:17.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:16 smithi093 ceph-mon[115914]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-12T11:47:17.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:16 smithi063 ceph-mon[107117]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2023-12-12T11:47:17.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:16 smithi063 ceph-mon[107117]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-12T11:47:17.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:16 smithi063 ceph-mon[107117]: osdmap e24: 4 total, 3 up, 4 in 2023-12-12T11:47:17.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:16 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-12T11:47:17.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:16 smithi063 ceph-mon[107117]: from='osd.3 [v2:172.21.15.93:6800/3547672003,v1:172.21.15.93:6801/3547672003]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-12T11:47:17.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:16 smithi063 ceph-mon[107117]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-12T11:47:17.383 INFO:teuthology.orchestra.run.smithi093.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-12T11:47:17.384 INFO:teuthology.orchestra.run.smithi093.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-12T11:47:17.384 INFO:teuthology.orchestra.run.smithi093.stderr: stderr: 10+0 records in 2023-12-12T11:47:17.384 INFO:teuthology.orchestra.run.smithi093.stderr:10+0 records out 2023-12-12T11:47:17.384 INFO:teuthology.orchestra.run.smithi093.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0563411 s, 186 MB/s 2023-12-12T11:47:17.384 INFO:teuthology.orchestra.run.smithi093.stderr:--> Zapping successful for: 2023-12-12T11:47:17.805 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi093:vg_nvme/lv_3 2023-12-12T11:47:18.130 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:17 smithi093 ceph-mon[115914]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]': finished 2023-12-12T11:47:18.130 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:17 smithi093 ceph-mon[115914]: osdmap e25: 4 total, 3 up, 4 in 2023-12-12T11:47:18.130 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:17 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-12T11:47:18.130 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:17 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-12T11:47:18.130 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:17 smithi093 ceph-mon[115914]: osd.3 [v2:172.21.15.93:6800/3547672003,v1:172.21.15.93:6801/3547672003] boot 2023-12-12T11:47:18.131 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:17 smithi093 ceph-mon[115914]: osdmap e26: 4 total, 4 up, 4 in 2023-12-12T11:47:18.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:17 smithi063 ceph-mon[107117]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]': finished 2023-12-12T11:47:18.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:17 smithi063 ceph-mon[107117]: osdmap e25: 4 total, 3 up, 4 in 2023-12-12T11:47:18.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:17 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-12T11:47:18.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:17 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-12T11:47:18.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:17 smithi063 ceph-mon[107117]: osd.3 [v2:172.21.15.93:6800/3547672003,v1:172.21.15.93:6801/3547672003] boot 2023-12-12T11:47:18.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:17 smithi063 ceph-mon[107117]: osdmap e26: 4 total, 4 up, 4 in 2023-12-12T11:47:18.388 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi093/config 2023-12-12T11:47:19.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:18 smithi093 ceph-mon[115914]: purged_snaps scrub starts 2023-12-12T11:47:19.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:18 smithi093 ceph-mon[115914]: purged_snaps scrub ok 2023-12-12T11:47:19.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:18 smithi093 ceph-mon[115914]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-12T11:47:19.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:18 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-12T11:47:19.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:18 smithi093 ceph-mon[115914]: Detected new or changed devices on smithi093 2023-12-12T11:47:19.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:18 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:19.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:18 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:19.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:18 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:47:19.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:18 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:19.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:18 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:47:19.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:18 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:47:19.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:18 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:19.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:18 smithi063 ceph-mon[107117]: purged_snaps scrub starts 2023-12-12T11:47:19.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:18 smithi063 ceph-mon[107117]: purged_snaps scrub ok 2023-12-12T11:47:19.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:18 smithi063 ceph-mon[107117]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-12T11:47:19.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:18 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-12T11:47:19.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:18 smithi063 ceph-mon[107117]: Detected new or changed devices on smithi093 2023-12-12T11:47:19.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:18 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:19.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:18 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:19.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:18 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:47:19.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:18 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:19.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:18 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:47:19.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:18 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:47:19.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:18 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:19.577 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.575+0000 7f8f9e690700 1 -- 172.21.15.93:0/4063853017 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f980fde00 msgr2=0x7f8f980fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:47:19.578 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.575+0000 7f8f9e690700 1 --2- 172.21.15.93:0/4063853017 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f980fde00 0x7f8f980fe250 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c004940 tx=0x7f8f8c009e30 comp rx=0 tx=0).stop 2023-12-12T11:47:19.578 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.575+0000 7f8f9e690700 1 -- 172.21.15.93:0/4063853017 shutdown_connections 2023-12-12T11:47:19.578 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.575+0000 7f8f9e690700 1 --2- 172.21.15.93:0/4063853017 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f980fde00 0x7f8f980fe250 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:47:19.578 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.575+0000 7f8f9e690700 1 --2- 172.21.15.93:0/4063853017 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f980fcbf0 0x7f8f980fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:47:19.578 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.575+0000 7f8f9e690700 1 -- 172.21.15.93:0/4063853017 >> 172.21.15.93:0/4063853017 conn(0x7f8f980f82d0 msgr2=0x7f8f980fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:47:19.578 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.575+0000 7f8f9e690700 1 -- 172.21.15.93:0/4063853017 shutdown_connections 2023-12-12T11:47:19.578 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.575+0000 7f8f9e690700 1 -- 172.21.15.93:0/4063853017 wait complete. 2023-12-12T11:47:19.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.576+0000 7f8f9e690700 1 Processor -- start 2023-12-12T11:47:19.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.576+0000 7f8f9e690700 1 -- start start 2023-12-12T11:47:19.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.576+0000 7f8f9e690700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f980fcbf0 0x7f8f98071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:47:19.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.576+0000 7f8f9e690700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f980fde00 0x7f8f9806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:47:19.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.576+0000 7f8f9e690700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f98111250 con 0x7f8f980fde00 2023-12-12T11:47:19.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.576+0000 7f8f9e690700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f981113c0 con 0x7f8f980fcbf0 2023-12-12T11:47:19.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.576+0000 7f8f97fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f980fcbf0 0x7f8f98071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:47:19.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.577+0000 7f8f97fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f980fcbf0 0x7f8f98071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58092/0 (socket says 172.21.15.93:58092) 2023-12-12T11:47:19.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.577+0000 7f8f97fff700 1 -- 172.21.15.93:0/2115551027 learned_addr learned my addr 172.21.15.93:0/2115551027 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-12-12T11:47:19.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.577+0000 7f8f977fe700 1 --2- 172.21.15.93:0/2115551027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f980fde00 0x7f8f9806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:47:19.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.577+0000 7f8f97fff700 1 -- 172.21.15.93:0/2115551027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f980fde00 msgr2=0x7f8f9806ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:47:19.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.577+0000 7f8f97fff700 1 --2- 172.21.15.93:0/2115551027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f980fde00 0x7f8f9806ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:47:19.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.577+0000 7f8f97fff700 1 -- 172.21.15.93:0/2115551027 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f8c005040 con 0x7f8f980fcbf0 2023-12-12T11:47:19.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.577+0000 7f8f97fff700 1 --2- 172.21.15.93:0/2115551027 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f980fcbf0 0x7f8f98071b10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8f8800c8e0 tx=0x7f8f880044c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:47:19.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.577+0000 7f8f94ff9700 1 -- 172.21.15.93:0/2115551027 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f8800a760 con 0x7f8f980fcbf0 2023-12-12T11:47:19.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.577+0000 7f8f94ff9700 1 -- 172.21.15.93:0/2115551027 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8f8800ad70 con 0x7f8f980fcbf0 2023-12-12T11:47:19.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.577+0000 7f8f94ff9700 1 -- 172.21.15.93:0/2115551027 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f880113a0 con 0x7f8f980fcbf0 2023-12-12T11:47:19.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.577+0000 7f8f9e690700 1 -- 172.21.15.93:0/2115551027 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f980705f0 con 0x7f8f980fcbf0 2023-12-12T11:47:19.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.578+0000 7f8f9e690700 1 -- 172.21.15.93:0/2115551027 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f98070b30 con 0x7f8f980fcbf0 2023-12-12T11:47:19.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.579+0000 7f8f9e690700 1 -- 172.21.15.93:0/2115551027 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f980fbf50 con 0x7f8f980fcbf0 2023-12-12T11:47:19.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.579+0000 7f8f94ff9700 1 -- 172.21.15.93:0/2115551027 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f8f88012400 con 0x7f8f980fcbf0 2023-12-12T11:47:19.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.580+0000 7f8f94ff9700 1 --2- 172.21.15.93:0/2115551027 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f8f80068f70 0x7f8f8006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:47:19.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.581+0000 7f8f94ff9700 1 -- 172.21.15.93:0/2115551027 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 3799+0+0 (secure 0 0 0) 0x7f8f880866f0 con 0x7f8f980fcbf0 2023-12-12T11:47:19.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.581+0000 7f8f977fe700 1 --2- 172.21.15.93:0/2115551027 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f8f80068f70 0x7f8f8006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:47:19.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.581+0000 7f8f977fe700 1 --2- 172.21.15.93:0/2115551027 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f8f80068f70 0x7f8f8006b420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00b3b0 tx=0x7f8f8c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:47:19.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.585+0000 7f8f94ff9700 1 -- 172.21.15.93:0/2115551027 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8f88056cb0 con 0x7f8f980fcbf0 2023-12-12T11:47:19.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:19.784+0000 7f8f9e690700 1 -- 172.21.15.93:0/2115551027 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi093:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f98102750 con 0x7f8f80068f70 2023-12-12T11:47:20.213 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:19 smithi063 ceph-mon[107117]: Adjusting osd_memory_target on smithi093 to 16119M 2023-12-12T11:47:20.213 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:19 smithi063 ceph-mon[107117]: osdmap e27: 4 total, 4 up, 4 in 2023-12-12T11:47:20.213 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:19 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-12T11:47:20.213 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:19 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-12T11:47:20.213 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:19 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:47:20.213 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:19 smithi063 ceph-mon[107117]: osdmap e28: 4 total, 4 up, 4 in 2023-12-12T11:47:20.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:19 smithi093 ceph-mon[115914]: Adjusting osd_memory_target on smithi093 to 16119M 2023-12-12T11:47:20.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:19 smithi093 ceph-mon[115914]: osdmap e27: 4 total, 4 up, 4 in 2023-12-12T11:47:20.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:19 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-12T11:47:20.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:19 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-12T11:47:20.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:19 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:47:20.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:19 smithi093 ceph-mon[115914]: osdmap e28: 4 total, 4 up, 4 in 2023-12-12T11:47:21.164 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:20 smithi093 ceph-mon[115914]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi093:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:47:21.164 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:20 smithi093 ceph-mon[115914]: pgmap v82: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-12T11:47:21.164 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:20 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:47:21.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:20 smithi063 ceph-mon[107117]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi093:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:47:21.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:20 smithi063 ceph-mon[107117]: pgmap v82: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-12T11:47:21.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:20 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:47:22.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:21 smithi093 ceph-mon[115914]: osdmap e29: 4 total, 4 up, 4 in 2023-12-12T11:47:22.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:21 smithi093 ceph-mon[115914]: osdmap e30: 4 total, 4 up, 4 in 2023-12-12T11:47:22.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:21 smithi063 ceph-mon[107117]: osdmap e29: 4 total, 4 up, 4 in 2023-12-12T11:47:22.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:21 smithi063 ceph-mon[107117]: osdmap e30: 4 total, 4 up, 4 in 2023-12-12T11:47:23.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:22 smithi093 ceph-mon[115914]: pgmap v85: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-12T11:47:23.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:22 smithi093 ceph-mon[115914]: from='client.? 172.21.15.93:0/3449409854' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af069a18-59ca-4e55-a09c-9d4be6e10cf7"}]: dispatch 2023-12-12T11:47:23.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:22 smithi093 ceph-mon[115914]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af069a18-59ca-4e55-a09c-9d4be6e10cf7"}]: dispatch 2023-12-12T11:47:23.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:22 smithi093 ceph-mon[115914]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "af069a18-59ca-4e55-a09c-9d4be6e10cf7"}]': finished 2023-12-12T11:47:23.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:22 smithi093 ceph-mon[115914]: osdmap e31: 5 total, 4 up, 5 in 2023-12-12T11:47:23.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:22 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-12T11:47:23.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:22 smithi093 ceph-mon[115914]: from='client.? 172.21.15.93:0/1058743740' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-12T11:47:23.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:22 smithi063 ceph-mon[107117]: pgmap v85: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-12T11:47:23.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:22 smithi063 ceph-mon[107117]: from='client.? 172.21.15.93:0/3449409854' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af069a18-59ca-4e55-a09c-9d4be6e10cf7"}]: dispatch 2023-12-12T11:47:23.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:22 smithi063 ceph-mon[107117]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af069a18-59ca-4e55-a09c-9d4be6e10cf7"}]: dispatch 2023-12-12T11:47:23.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:22 smithi063 ceph-mon[107117]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "af069a18-59ca-4e55-a09c-9d4be6e10cf7"}]': finished 2023-12-12T11:47:23.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:22 smithi063 ceph-mon[107117]: osdmap e31: 5 total, 4 up, 5 in 2023-12-12T11:47:23.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:22 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-12T11:47:23.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:22 smithi063 ceph-mon[107117]: from='client.? 172.21.15.93:0/1058743740' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-12T11:47:25.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:24 smithi093 ceph-mon[115914]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-12-12T11:47:25.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:24 smithi063 ceph-mon[107117]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-12-12T11:47:27.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:26 smithi093 ceph-mon[115914]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2023-12-12T11:47:27.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:26 smithi063 ceph-mon[107117]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2023-12-12T11:47:29.082 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:28 smithi093 ceph-mon[115914]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-12-12T11:47:29.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:28 smithi063 ceph-mon[107117]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-12-12T11:47:30.129 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:29 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-12T11:47:30.129 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:29 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:47:30.129 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:29 smithi093 ceph-mon[115914]: Deploying daemon osd.4 on smithi093 2023-12-12T11:47:30.212 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:29 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-12T11:47:30.212 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:29 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:47:30.212 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:29 smithi063 ceph-mon[107117]: Deploying daemon osd.4 on smithi093 2023-12-12T11:47:31.153 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:30 smithi093 ceph-mon[115914]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-12T11:47:31.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:30 smithi063 ceph-mon[107117]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-12T11:47:32.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:32 smithi093 ceph-mon[115914]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-12T11:47:32.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:32 smithi063 ceph-mon[107117]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-12T11:47:34.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:34 smithi093 ceph-mon[115914]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2023-12-12T11:47:34.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:34 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:47:34.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:34 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:34.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:34 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:35.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:34 smithi063 ceph-mon[107117]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2023-12-12T11:47:35.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:34 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:47:35.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:34 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:35.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:34 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:35.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:35 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:47:36.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:35 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:47:36.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:36.803+0000 7f8f94ff9700 1 -- 172.21.15.93:0/2115551027 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8f98102750 con 0x7f8f80068f70 2023-12-12T11:47:36.806 INFO:teuthology.orchestra.run.smithi093.stdout:Created osd(s) 4 on host 'smithi093' 2023-12-12T11:47:36.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:36.805+0000 7f8f9e690700 1 -- 172.21.15.93:0/2115551027 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f8f80068f70 msgr2=0x7f8f8006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:47:36.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:36.805+0000 7f8f9e690700 1 --2- 172.21.15.93:0/2115551027 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f8f80068f70 0x7f8f8006b420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00b3b0 tx=0x7f8f8c009e30 comp rx=0 tx=0).stop 2023-12-12T11:47:36.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:36.805+0000 7f8f9e690700 1 -- 172.21.15.93:0/2115551027 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f980fcbf0 msgr2=0x7f8f98071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:47:36.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:36.805+0000 7f8f9e690700 1 --2- 172.21.15.93:0/2115551027 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f980fcbf0 0x7f8f98071b10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8f8800c8e0 tx=0x7f8f880044c0 comp rx=0 tx=0).stop 2023-12-12T11:47:36.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:36.805+0000 7f8f9e690700 1 -- 172.21.15.93:0/2115551027 shutdown_connections 2023-12-12T11:47:36.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:36.805+0000 7f8f9e690700 1 --2- 172.21.15.93:0/2115551027 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f980fcbf0 0x7f8f98071b10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:47:36.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:36.805+0000 7f8f9e690700 1 --2- 172.21.15.93:0/2115551027 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f8f80068f70 0x7f8f8006b420 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:47:36.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:36.805+0000 7f8f9e690700 1 --2- 172.21.15.93:0/2115551027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f980fde00 0x7f8f9806ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:47:36.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:36.805+0000 7f8f9e690700 1 -- 172.21.15.93:0/2115551027 >> 172.21.15.93:0/2115551027 conn(0x7f8f980f82d0 msgr2=0x7f8f98101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:47:36.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:36.806+0000 7f8f9e690700 1 -- 172.21.15.93:0/2115551027 shutdown_connections 2023-12-12T11:47:36.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:36.806+0000 7f8f9e690700 1 -- 172.21.15.93:0/2115551027 wait complete. 2023-12-12T11:47:36.986 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:36 smithi093 ceph-mon[115914]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-12T11:47:36.986 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:36 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:36.986 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:36 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:36.986 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:36 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:36.986 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:36 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:37.215 DEBUG:teuthology.orchestra.run.smithi093:osd.4> sudo journalctl -f -n 0 -u ceph-85e33c70-98e3-11ee-95a3-87774f69a715@osd.4.service 2023-12-12T11:47:37.219 INFO:tasks.cephadm:Deploying osd.5 on smithi093 with /dev/vg_nvme/lv_2... 2023-12-12T11:47:37.220 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-12T11:47:37.293 INFO:journalctl@ceph.osd.4.smithi093.stdout:-- Logs begin at Tue 2023-12-12 11:24:57 UTC. -- 2023-12-12T11:47:37.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:36 smithi063 ceph-mon[107117]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-12T11:47:37.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:36 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:37.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:36 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:37.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:36 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:37.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:36 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:37.701 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi093/config 2023-12-12T11:47:38.220 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 11:47:37 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-4[130879]: 2023-12-12T11:47:37.993+0000 7ffa5f9e5540 -1 osd.4 0 log_to_monitors true 2023-12-12T11:47:39.185 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:38 smithi093 ceph-mon[115914]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-12T11:47:39.185 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:38 smithi093 ceph-mon[115914]: from='osd.4 [v2:172.21.15.93:6808/612058290,v1:172.21.15.93:6809/612058290]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-12T11:47:39.185 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:38 smithi093 ceph-mon[115914]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-12T11:47:39.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:38 smithi063 ceph-mon[107117]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-12T11:47:39.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:38 smithi063 ceph-mon[107117]: from='osd.4 [v2:172.21.15.93:6808/612058290,v1:172.21.15.93:6809/612058290]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-12T11:47:39.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:38 smithi063 ceph-mon[107117]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-12T11:47:39.671 INFO:teuthology.orchestra.run.smithi093.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-12T11:47:39.671 INFO:teuthology.orchestra.run.smithi093.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-12T11:47:39.671 INFO:teuthology.orchestra.run.smithi093.stderr: stderr: 10+0 records in 2023-12-12T11:47:39.671 INFO:teuthology.orchestra.run.smithi093.stderr:10+0 records out 2023-12-12T11:47:39.671 INFO:teuthology.orchestra.run.smithi093.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0567264 s, 185 MB/s 2023-12-12T11:47:39.671 INFO:teuthology.orchestra.run.smithi093.stderr:--> Zapping successful for: 2023-12-12T11:47:39.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:39 smithi093 ceph-mon[115914]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-12T11:47:39.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:39 smithi093 ceph-mon[115914]: osdmap e32: 5 total, 4 up, 5 in 2023-12-12T11:47:39.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:39 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-12T11:47:39.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:39 smithi093 ceph-mon[115914]: from='osd.4 [v2:172.21.15.93:6808/612058290,v1:172.21.15.93:6809/612058290]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-12T11:47:39.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:39 smithi093 ceph-mon[115914]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-12T11:47:39.972 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 11:47:39 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-4[130879]: 2023-12-12T11:47:39.899+0000 7ffa561ca700 -1 osd.4 0 waiting for initial osdmap 2023-12-12T11:47:39.972 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 11:47:39 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-4[130879]: 2023-12-12T11:47:39.908+0000 7ffa527c8700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T11:47:40.086 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi093:vg_nvme/lv_2 2023-12-12T11:47:40.213 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:39 smithi063 ceph-mon[107117]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-12T11:47:40.213 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:39 smithi063 ceph-mon[107117]: osdmap e32: 5 total, 4 up, 5 in 2023-12-12T11:47:40.213 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:39 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-12T11:47:40.213 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:39 smithi063 ceph-mon[107117]: from='osd.4 [v2:172.21.15.93:6808/612058290,v1:172.21.15.93:6809/612058290]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-12T11:47:40.213 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:39 smithi063 ceph-mon[107117]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-12T11:47:40.569 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi093/config 2023-12-12T11:47:41.023 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:40 smithi093 ceph-mon[115914]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-12T11:47:41.023 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:40 smithi093 ceph-mon[115914]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]': finished 2023-12-12T11:47:41.023 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:40 smithi093 ceph-mon[115914]: osdmap e33: 5 total, 4 up, 5 in 2023-12-12T11:47:41.023 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:40 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-12T11:47:41.023 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:40 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-12T11:47:41.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:40 smithi063 ceph-mon[107117]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-12T11:47:41.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:40 smithi063 ceph-mon[107117]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]': finished 2023-12-12T11:47:41.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:40 smithi063 ceph-mon[107117]: osdmap e33: 5 total, 4 up, 5 in 2023-12-12T11:47:41.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:40 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-12T11:47:41.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:40 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-12T11:47:42.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.095+0000 7f68de210700 1 -- 172.21.15.93:0/3610230763 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68d80fde00 msgr2=0x7f68d80fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:47:42.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.095+0000 7f68de210700 1 --2- 172.21.15.93:0/3610230763 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68d80fde00 0x7f68d80fe250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f68cc004940 tx=0x7f68cc009e30 comp rx=0 tx=0).stop 2023-12-12T11:47:42.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.095+0000 7f68de210700 1 -- 172.21.15.93:0/3610230763 shutdown_connections 2023-12-12T11:47:42.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.095+0000 7f68de210700 1 --2- 172.21.15.93:0/3610230763 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68d80fde00 0x7f68d80fe250 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:47:42.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.095+0000 7f68de210700 1 --2- 172.21.15.93:0/3610230763 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68d80fcbf0 0x7f68d80fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:47:42.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.095+0000 7f68de210700 1 -- 172.21.15.93:0/3610230763 >> 172.21.15.93:0/3610230763 conn(0x7f68d80f82d0 msgr2=0x7f68d80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:47:42.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.095+0000 7f68de210700 1 -- 172.21.15.93:0/3610230763 shutdown_connections 2023-12-12T11:47:42.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.095+0000 7f68de210700 1 -- 172.21.15.93:0/3610230763 wait complete. 2023-12-12T11:47:42.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.096+0000 7f68de210700 1 Processor -- start 2023-12-12T11:47:42.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.096+0000 7f68de210700 1 -- start start 2023-12-12T11:47:42.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.096+0000 7f68de210700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68d80fcbf0 0x7f68d8071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:47:42.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.096+0000 7f68de210700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68d80fde00 0x7f68d806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:47:42.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.096+0000 7f68de210700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d8070590 con 0x7f68d80fcbf0 2023-12-12T11:47:42.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.096+0000 7f68de210700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d8070700 con 0x7f68d80fde00 2023-12-12T11:47:42.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.097+0000 7f68d6ffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68d80fde00 0x7f68d806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:47:42.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.097+0000 7f68d6ffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68d80fde00 0x7f68d806ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:54776/0 (socket says 172.21.15.93:54776) 2023-12-12T11:47:42.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.097+0000 7f68d6ffd700 1 -- 172.21.15.93:0/1734676681 learned_addr learned my addr 172.21.15.93:0/1734676681 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-12-12T11:47:42.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.097+0000 7f68d77fe700 1 --2- 172.21.15.93:0/1734676681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68d80fcbf0 0x7f68d8071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:47:42.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.097+0000 7f68d6ffd700 1 -- 172.21.15.93:0/1734676681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68d80fcbf0 msgr2=0x7f68d8071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:47:42.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.097+0000 7f68d6ffd700 1 --2- 172.21.15.93:0/1734676681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68d80fcbf0 0x7f68d8071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:47:42.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.097+0000 7f68d6ffd700 1 -- 172.21.15.93:0/1734676681 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68cc005040 con 0x7f68d80fde00 2023-12-12T11:47:42.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.097+0000 7f68d6ffd700 1 --2- 172.21.15.93:0/1734676681 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68d80fde00 0x7f68d806ff90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f68cc009fd0 tx=0x7f68cc009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:47:42.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.097+0000 7f68bffff700 1 -- 172.21.15.93:0/1734676681 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68cc00e040 con 0x7f68d80fde00 2023-12-12T11:47:42.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.098+0000 7f68bffff700 1 -- 172.21.15.93:0/1734676681 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f68cc004290 con 0x7f68d80fde00 2023-12-12T11:47:42.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.098+0000 7f68bffff700 1 -- 172.21.15.93:0/1734676681 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68cc01c3f0 con 0x7f68d80fde00 2023-12-12T11:47:42.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.098+0000 7f68de210700 1 -- 172.21.15.93:0/1734676681 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d8070980 con 0x7f68d80fde00 2023-12-12T11:47:42.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.098+0000 7f68de210700 1 -- 172.21.15.93:0/1734676681 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d81155a0 con 0x7f68d80fde00 2023-12-12T11:47:42.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.099+0000 7f68de210700 1 -- 172.21.15.93:0/1734676681 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d804bb80 con 0x7f68d80fde00 2023-12-12T11:47:42.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.099+0000 7f68bffff700 1 -- 172.21.15.93:0/1734676681 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f68cc013420 con 0x7f68d80fde00 2023-12-12T11:47:42.103 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.101+0000 7f68bffff700 1 --2- 172.21.15.93:0/1734676681 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f68c0068f70 0x7f68c006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:47:42.103 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.101+0000 7f68bffff700 1 -- 172.21.15.93:0/1734676681 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4202+0+0 (secure 0 0 0) 0x7f68cc087d20 con 0x7f68d80fde00 2023-12-12T11:47:42.103 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.101+0000 7f68d77fe700 1 --2- 172.21.15.93:0/1734676681 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f68c0068f70 0x7f68c006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:47:42.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.102+0000 7f68d77fe700 1 --2- 172.21.15.93:0/1734676681 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f68c0068f70 0x7f68c006b420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f68c8007fd0 tx=0x7f68c8009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:47:42.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.106+0000 7f68bffff700 1 -- 172.21.15.93:0/1734676681 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f68cc0580f0 con 0x7f68d80fde00 2023-12-12T11:47:42.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:41 smithi093 ceph-mon[115914]: purged_snaps scrub starts 2023-12-12T11:47:42.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:41 smithi093 ceph-mon[115914]: purged_snaps scrub ok 2023-12-12T11:47:42.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:41 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-12T11:47:42.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:41 smithi093 ceph-mon[115914]: osd.4 [v2:172.21.15.93:6808/612058290,v1:172.21.15.93:6809/612058290] boot 2023-12-12T11:47:42.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:41 smithi093 ceph-mon[115914]: osdmap e34: 5 total, 5 up, 5 in 2023-12-12T11:47:42.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:41 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-12T11:47:42.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:41 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:42.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:41 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:42.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:41 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:47:42.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:41 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:47:42.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:41 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:42.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:41 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:47:42.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:41 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:47:42.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:41 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:42.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:41 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:47:42.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:41 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:47:42.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:41 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:47:42.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:41 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:42.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:41 smithi063 ceph-mon[107117]: purged_snaps scrub starts 2023-12-12T11:47:42.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:41 smithi063 ceph-mon[107117]: purged_snaps scrub ok 2023-12-12T11:47:42.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:41 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-12T11:47:42.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:41 smithi063 ceph-mon[107117]: osd.4 [v2:172.21.15.93:6808/612058290,v1:172.21.15.93:6809/612058290] boot 2023-12-12T11:47:42.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:41 smithi063 ceph-mon[107117]: osdmap e34: 5 total, 5 up, 5 in 2023-12-12T11:47:42.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:41 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-12T11:47:42.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:41 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:42.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:41 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:42.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:41 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:47:42.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:41 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:47:42.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:41 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:42.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:41 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:47:42.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:41 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:47:42.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:41 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:42.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:41 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:47:42.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:41 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:47:42.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:41 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:47:42.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:41 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:42.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:42.304+0000 7f68de210700 1 -- 172.21.15.93:0/1734676681 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi093:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f68d8102750 con 0x7f68c0068f70 2023-12-12T11:47:43.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:42 smithi093 ceph-mon[115914]: Detected new or changed devices on smithi093 2023-12-12T11:47:43.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:42 smithi093 ceph-mon[115914]: Adjusting osd_memory_target on smithi093 to 8059M 2023-12-12T11:47:43.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:42 smithi093 ceph-mon[115914]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-12T11:47:43.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:42 smithi093 ceph-mon[115914]: from='client.24185 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi093:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:47:43.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:42 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-12T11:47:43.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:42 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-12T11:47:43.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:42 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:47:43.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:42 smithi093 ceph-mon[115914]: osdmap e35: 5 total, 5 up, 5 in 2023-12-12T11:47:43.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:42 smithi063 ceph-mon[107117]: Detected new or changed devices on smithi093 2023-12-12T11:47:43.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:42 smithi063 ceph-mon[107117]: Adjusting osd_memory_target on smithi093 to 8059M 2023-12-12T11:47:43.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:42 smithi063 ceph-mon[107117]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-12T11:47:43.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:42 smithi063 ceph-mon[107117]: from='client.24185 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi093:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:47:43.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:42 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-12T11:47:43.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:42 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-12T11:47:43.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:42 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:47:43.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:42 smithi063 ceph-mon[107117]: osdmap e35: 5 total, 5 up, 5 in 2023-12-12T11:47:45.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:44 smithi093 ceph-mon[115914]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-12T11:47:45.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:44 smithi093 ceph-mon[115914]: from='client.? 172.21.15.93:0/367695544' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66901eb6-442c-4808-a5d3-958fd4b8f18d"}]: dispatch 2023-12-12T11:47:45.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:44 smithi093 ceph-mon[115914]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66901eb6-442c-4808-a5d3-958fd4b8f18d"}]: dispatch 2023-12-12T11:47:45.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:44 smithi093 ceph-mon[115914]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "66901eb6-442c-4808-a5d3-958fd4b8f18d"}]': finished 2023-12-12T11:47:45.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:44 smithi093 ceph-mon[115914]: osdmap e36: 6 total, 5 up, 6 in 2023-12-12T11:47:45.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:44 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-12T11:47:45.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:44 smithi063 ceph-mon[107117]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-12T11:47:45.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:44 smithi063 ceph-mon[107117]: from='client.? 172.21.15.93:0/367695544' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66901eb6-442c-4808-a5d3-958fd4b8f18d"}]: dispatch 2023-12-12T11:47:45.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:44 smithi063 ceph-mon[107117]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66901eb6-442c-4808-a5d3-958fd4b8f18d"}]: dispatch 2023-12-12T11:47:45.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:44 smithi063 ceph-mon[107117]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "66901eb6-442c-4808-a5d3-958fd4b8f18d"}]': finished 2023-12-12T11:47:45.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:44 smithi063 ceph-mon[107117]: osdmap e36: 6 total, 5 up, 6 in 2023-12-12T11:47:45.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:44 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-12T11:47:46.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:45 smithi093 ceph-mon[115914]: from='client.? 172.21.15.93:0/2094406921' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-12T11:47:46.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:45 smithi063 ceph-mon[107117]: from='client.? 172.21.15.93:0/2094406921' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-12T11:47:47.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:46 smithi093 ceph-mon[115914]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-12T11:47:47.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:46 smithi063 ceph-mon[107117]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-12T11:47:49.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:48 smithi093 ceph-mon[115914]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-12T11:47:49.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:48 smithi063 ceph-mon[107117]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-12T11:47:51.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:50 smithi093 ceph-mon[115914]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-12T11:47:51.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:50 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:47:51.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:50 smithi063 ceph-mon[107117]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-12T11:47:51.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:50 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:47:52.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:52 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-12T11:47:52.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:52 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:47:52.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:52 smithi063 ceph-mon[107117]: Deploying daemon osd.5 on smithi093 2023-12-12T11:47:52.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:52 smithi063 ceph-mon[107117]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-12T11:47:52.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:52 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-12T11:47:52.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:52 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:47:52.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:52 smithi093 ceph-mon[115914]: Deploying daemon osd.5 on smithi093 2023-12-12T11:47:52.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:52 smithi093 ceph-mon[115914]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-12T11:47:55.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:54 smithi093 ceph-mon[115914]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-12T11:47:55.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:54 smithi063 ceph-mon[107117]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-12T11:47:57.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:56 smithi093 ceph-mon[115914]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-12T11:47:57.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:56 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:57.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:56 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:57.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:56 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:47:57.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:56 smithi063 ceph-mon[107117]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-12T11:47:57.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:56 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:57.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:56 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:47:57.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:56 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:47:59.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:47:58 smithi093 ceph-mon[115914]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-12T11:47:59.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:47:58 smithi063 ceph-mon[107117]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-12T11:47:59.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:59.673+0000 7f68bffff700 1 -- 172.21.15.93:0/1734676681 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f68d8102750 con 0x7f68c0068f70 2023-12-12T11:47:59.676 INFO:teuthology.orchestra.run.smithi093.stdout:Created osd(s) 5 on host 'smithi093' 2023-12-12T11:47:59.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:59.675+0000 7f68de210700 1 -- 172.21.15.93:0/1734676681 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f68c0068f70 msgr2=0x7f68c006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:47:59.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:59.675+0000 7f68de210700 1 --2- 172.21.15.93:0/1734676681 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f68c0068f70 0x7f68c006b420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f68c8007fd0 tx=0x7f68c8009040 comp rx=0 tx=0).stop 2023-12-12T11:47:59.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:59.675+0000 7f68de210700 1 -- 172.21.15.93:0/1734676681 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68d80fde00 msgr2=0x7f68d806ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:47:59.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:59.675+0000 7f68de210700 1 --2- 172.21.15.93:0/1734676681 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68d80fde00 0x7f68d806ff90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f68cc009fd0 tx=0x7f68cc009e30 comp rx=0 tx=0).stop 2023-12-12T11:47:59.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:59.675+0000 7f68de210700 1 -- 172.21.15.93:0/1734676681 shutdown_connections 2023-12-12T11:47:59.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:59.675+0000 7f68de210700 1 --2- 172.21.15.93:0/1734676681 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f68c0068f70 0x7f68c006b420 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:47:59.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:59.675+0000 7f68de210700 1 --2- 172.21.15.93:0/1734676681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68d80fcbf0 0x7f68d8071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:47:59.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:59.675+0000 7f68de210700 1 --2- 172.21.15.93:0/1734676681 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68d80fde00 0x7f68d806ff90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:47:59.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:59.675+0000 7f68de210700 1 -- 172.21.15.93:0/1734676681 >> 172.21.15.93:0/1734676681 conn(0x7f68d80f82d0 msgr2=0x7f68d8101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:47:59.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:59.676+0000 7f68de210700 1 -- 172.21.15.93:0/1734676681 shutdown_connections 2023-12-12T11:47:59.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:47:59.676+0000 7f68de210700 1 -- 172.21.15.93:0/1734676681 wait complete. 2023-12-12T11:48:00.132 DEBUG:teuthology.orchestra.run.smithi093:osd.5> sudo journalctl -f -n 0 -u ceph-85e33c70-98e3-11ee-95a3-87774f69a715@osd.5.service 2023-12-12T11:48:00.136 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2023-12-12T11:48:00.136 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph osd stat -f json 2023-12-12T11:48:00.213 INFO:journalctl@ceph.osd.5.smithi093.stdout:-- Logs begin at Tue 2023-12-12 11:24:57 UTC. -- 2023-12-12T11:48:00.461 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:00 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:48:00.461 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:00 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:48:00.461 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:00 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:48:00.461 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:00 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:48:00.461 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:00 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:48:00.462 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:00 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:48:00.462 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:00 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:48:00.462 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:00 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:48:00.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:00 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:48:00.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:00 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:48:00.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:00 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:48:00.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:00 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:48:00.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:00 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:48:00.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:00 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:48:00.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:00 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:48:00.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:00 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:48:00.583 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:00.890 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 11:48:00 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[138979]: 2023-12-12T11:48:00.628+0000 7fd6166d1540 -1 osd.5 0 log_to_monitors true 2023-12-12T11:48:01.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:01 smithi093 ceph-mon[115914]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-12T11:48:01.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:01 smithi093 ceph-mon[115914]: from='osd.5 [v2:172.21.15.93:6816/2174153230,v1:172.21.15.93:6817/2174153230]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-12T11:48:01.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:01 smithi093 ceph-mon[115914]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-12T11:48:01.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:01 smithi063 ceph-mon[107117]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-12T11:48:01.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:01 smithi063 ceph-mon[107117]: from='osd.5 [v2:172.21.15.93:6816/2174153230,v1:172.21.15.93:6817/2174153230]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-12T11:48:01.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:01 smithi063 ceph-mon[107117]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-12T11:48:01.834 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.831+0000 7f4d6359e700 1 -- 172.21.15.63:0/3020112972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d64071bc0 msgr2=0x7f4d64070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:01.834 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.831+0000 7f4d6359e700 1 --2- 172.21.15.63:0/3020112972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d64071bc0 0x7f4d64070030 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4d54009ce0 tx=0x7f4d54004d10 comp rx=0 tx=0).stop 2023-12-12T11:48:01.834 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.831+0000 7f4d6359e700 1 -- 172.21.15.63:0/3020112972 shutdown_connections 2023-12-12T11:48:01.834 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.831+0000 7f4d6359e700 1 --2- 172.21.15.63:0/3020112972 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d64070570 0x7f4d640709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:01.834 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.831+0000 7f4d6359e700 1 --2- 172.21.15.63:0/3020112972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d64071bc0 0x7f4d64070030 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:01.834 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.831+0000 7f4d6359e700 1 -- 172.21.15.63:0/3020112972 >> 172.21.15.63:0/3020112972 conn(0x7f4d640f8090 msgr2=0x7f4d640fa4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:01.834 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.831+0000 7f4d6359e700 1 -- 172.21.15.63:0/3020112972 shutdown_connections 2023-12-12T11:48:01.835 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.832+0000 7f4d6359e700 1 -- 172.21.15.63:0/3020112972 wait complete. 2023-12-12T11:48:01.836 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.832+0000 7f4d6359e700 1 Processor -- start 2023-12-12T11:48:01.836 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.832+0000 7f4d6359e700 1 -- start start 2023-12-12T11:48:01.836 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.833+0000 7f4d6359e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d64070570 0x7f4d6410f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:01.836 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.833+0000 7f4d6359e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d64071bc0 0x7f4d6410fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:01.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.833+0000 7f4d6359e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d64110020 con 0x7f4d64071bc0 2023-12-12T11:48:01.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.833+0000 7f4d6359e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d641108c0 con 0x7f4d64070570 2023-12-12T11:48:01.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.833+0000 7f4d5bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d64071bc0 0x7f4d6410fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:01.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.833+0000 7f4d5bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d64071bc0 0x7f4d6410fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40116/0 (socket says 172.21.15.63:40116) 2023-12-12T11:48:01.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.833+0000 7f4d5bfff700 1 -- 172.21.15.63:0/4261084533 learned_addr learned my addr 172.21.15.63:0/4261084533 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:48:01.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.833+0000 7f4d6259c700 1 --2- 172.21.15.63:0/4261084533 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d64070570 0x7f4d6410f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:01.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.833+0000 7f4d5bfff700 1 -- 172.21.15.63:0/4261084533 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d64070570 msgr2=0x7f4d6410f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:01.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.833+0000 7f4d5bfff700 1 --2- 172.21.15.63:0/4261084533 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d64070570 0x7f4d6410f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:01.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.833+0000 7f4d5bfff700 1 -- 172.21.15.63:0/4261084533 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d54009940 con 0x7f4d64071bc0 2023-12-12T11:48:01.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.834+0000 7f4d5bfff700 1 --2- 172.21.15.63:0/4261084533 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d64071bc0 0x7f4d6410fa20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c00eb40 tx=0x7f4d4c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:01.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.834+0000 7f4d5affd700 1 -- 172.21.15.63:0/4261084533 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d4c007cc0 con 0x7f4d64071bc0 2023-12-12T11:48:01.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.834+0000 7f4d6359e700 1 -- 172.21.15.63:0/4261084533 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d64110b40 con 0x7f4d64071bc0 2023-12-12T11:48:01.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.834+0000 7f4d5affd700 1 -- 172.21.15.63:0/4261084533 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4d4c00f040 con 0x7f4d64071bc0 2023-12-12T11:48:01.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.834+0000 7f4d5affd700 1 -- 172.21.15.63:0/4261084533 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d4c00c990 con 0x7f4d64071bc0 2023-12-12T11:48:01.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.834+0000 7f4d6359e700 1 -- 172.21.15.63:0/4261084533 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d64111080 con 0x7f4d64071bc0 2023-12-12T11:48:01.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.835+0000 7f4d6359e700 1 -- 172.21.15.63:0/4261084533 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6404bb80 con 0x7f4d64071bc0 2023-12-12T11:48:01.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.836+0000 7f4d5affd700 1 -- 172.21.15.63:0/4261084533 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f4d4c00cc00 con 0x7f4d64071bc0 2023-12-12T11:48:01.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.837+0000 7f4d5affd700 1 --2- 172.21.15.63:0/4261084533 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4d50068f60 0x7f4d5006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:01.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.837+0000 7f4d5affd700 1 -- 172.21.15.63:0/4261084533 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4338+0+0 (secure 0 0 0) 0x7f4d4c086770 con 0x7f4d64071bc0 2023-12-12T11:48:01.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.838+0000 7f4d6259c700 1 --2- 172.21.15.63:0/4261084533 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4d50068f60 0x7f4d5006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:01.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.838+0000 7f4d6259c700 1 --2- 172.21.15.63:0/4261084533 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4d50068f60 0x7f4d5006b410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4d5400ba30 tx=0x7f4d54004d10 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:01.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:01.841+0000 7f4d5affd700 1 -- 172.21.15.63:0/4261084533 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4d4c056be0 con 0x7f4d64071bc0 2023-12-12T11:48:02.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:02.048+0000 7f4d6359e700 1 -- 172.21.15.63:0/4261084533 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f4d64107580 con 0x7f4d64071bc0 2023-12-12T11:48:02.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:02.048+0000 7f4d5affd700 1 -- 172.21.15.63:0/4261084533 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v37) v1 ==== 74+0+130 (secure 0 0 0) 0x7f4d4c056770 con 0x7f4d64071bc0 2023-12-12T11:48:02.051 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:48:02.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:02.050+0000 7f4d6359e700 1 -- 172.21.15.63:0/4261084533 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4d50068f60 msgr2=0x7f4d5006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:02.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:02.050+0000 7f4d6359e700 1 --2- 172.21.15.63:0/4261084533 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4d50068f60 0x7f4d5006b410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4d5400ba30 tx=0x7f4d54004d10 comp rx=0 tx=0).stop 2023-12-12T11:48:02.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:02.050+0000 7f4d6359e700 1 -- 172.21.15.63:0/4261084533 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d64071bc0 msgr2=0x7f4d6410fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:02.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:02.050+0000 7f4d6359e700 1 --2- 172.21.15.63:0/4261084533 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d64071bc0 0x7f4d6410fa20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c00eb40 tx=0x7f4d4c00b040 comp rx=0 tx=0).stop 2023-12-12T11:48:02.054 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:02.051+0000 7f4d6359e700 1 -- 172.21.15.63:0/4261084533 shutdown_connections 2023-12-12T11:48:02.054 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:02.051+0000 7f4d6359e700 1 --2- 172.21.15.63:0/4261084533 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d64070570 0x7f4d6410f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:02.054 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:02.051+0000 7f4d6359e700 1 --2- 172.21.15.63:0/4261084533 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4d50068f60 0x7f4d5006b410 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:02.054 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:02.051+0000 7f4d6359e700 1 --2- 172.21.15.63:0/4261084533 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d64071bc0 0x7f4d6410fa20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:02.054 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:02.051+0000 7f4d6359e700 1 -- 172.21.15.63:0/4261084533 >> 172.21.15.63:0/4261084533 conn(0x7f4d640f8090 msgr2=0x7f4d64102880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:02.054 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:02.051+0000 7f4d6359e700 1 -- 172.21.15.63:0/4261084533 shutdown_connections 2023-12-12T11:48:02.054 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:02.051+0000 7f4d6359e700 1 -- 172.21.15.63:0/4261084533 wait complete. 2023-12-12T11:48:02.473 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":37,"num_osds":6,"num_up_osds":5,"osd_up_since":1702381660,"num_in_osds":6,"osd_in_since":1702381664,"num_remapped_pgs":0} 2023-12-12T11:48:02.721 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 11:48:02 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[138979]: 2023-12-12T11:48:02.330+0000 7fd60ceb6700 -1 osd.5 0 waiting for initial osdmap 2023-12-12T11:48:02.721 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 11:48:02 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[138979]: 2023-12-12T11:48:02.342+0000 7fd609cb5700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T11:48:02.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:02 smithi093 ceph-mon[115914]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-12T11:48:02.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:02 smithi093 ceph-mon[115914]: osdmap e37: 6 total, 5 up, 6 in 2023-12-12T11:48:02.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:02 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-12T11:48:02.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:02 smithi093 ceph-mon[115914]: from='osd.5 [v2:172.21.15.93:6816/2174153230,v1:172.21.15.93:6817/2174153230]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-12T11:48:02.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:02 smithi093 ceph-mon[115914]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-12T11:48:02.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:02 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/4261084533' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-12T11:48:02.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:02 smithi063 ceph-mon[107117]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-12T11:48:02.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:02 smithi063 ceph-mon[107117]: osdmap e37: 6 total, 5 up, 6 in 2023-12-12T11:48:02.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:02 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-12T11:48:02.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:02 smithi063 ceph-mon[107117]: from='osd.5 [v2:172.21.15.93:6816/2174153230,v1:172.21.15.93:6817/2174153230]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-12T11:48:02.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:02 smithi063 ceph-mon[107117]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-12T11:48:02.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:02 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/4261084533' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-12T11:48:03.474 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph osd stat -f json 2023-12-12T11:48:03.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:03 smithi093 ceph-mon[115914]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-12T11:48:03.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:03 smithi093 ceph-mon[115914]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]': finished 2023-12-12T11:48:03.723 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:03 smithi093 ceph-mon[115914]: osdmap e38: 6 total, 5 up, 6 in 2023-12-12T11:48:03.724 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:03 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-12T11:48:03.724 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:03 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-12T11:48:03.725 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:03 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:48:03.725 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:03 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:48:03.725 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:03 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:48:03.725 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:03 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:48:03.726 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:03 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:48:03.726 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:03 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:48:03.726 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:03 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:48:03.726 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:03 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:48:03.727 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:03 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:48:03.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:03 smithi063 ceph-mon[107117]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-12T11:48:03.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:03 smithi063 ceph-mon[107117]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]': finished 2023-12-12T11:48:03.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:03 smithi063 ceph-mon[107117]: osdmap e38: 6 total, 5 up, 6 in 2023-12-12T11:48:03.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:03 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-12T11:48:03.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:03 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-12T11:48:03.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:03 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:48:03.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:03 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:48:03.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:03 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:48:03.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:03 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:48:03.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:03 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:48:03.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:03 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:48:03.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:03 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:48:03.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:03 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:48:03.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:03 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:48:03.917 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:04.591 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:04 smithi063 ceph-mon[107117]: purged_snaps scrub starts 2023-12-12T11:48:04.591 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:04 smithi063 ceph-mon[107117]: purged_snaps scrub ok 2023-12-12T11:48:04.591 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:04 smithi063 ceph-mon[107117]: Detected new or changed devices on smithi093 2023-12-12T11:48:04.591 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:04 smithi063 ceph-mon[107117]: Adjusting osd_memory_target on smithi093 to 5373M 2023-12-12T11:48:04.591 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:04 smithi063 ceph-mon[107117]: osd.5 [v2:172.21.15.93:6816/2174153230,v1:172.21.15.93:6817/2174153230] boot 2023-12-12T11:48:04.591 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:04 smithi063 ceph-mon[107117]: osdmap e39: 6 total, 6 up, 6 in 2023-12-12T11:48:04.591 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:04 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-12T11:48:04.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:04 smithi093 ceph-mon[115914]: purged_snaps scrub starts 2023-12-12T11:48:04.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:04 smithi093 ceph-mon[115914]: purged_snaps scrub ok 2023-12-12T11:48:04.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:04 smithi093 ceph-mon[115914]: Detected new or changed devices on smithi093 2023-12-12T11:48:04.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:04 smithi093 ceph-mon[115914]: Adjusting osd_memory_target on smithi093 to 5373M 2023-12-12T11:48:04.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:04 smithi093 ceph-mon[115914]: osd.5 [v2:172.21.15.93:6816/2174153230,v1:172.21.15.93:6817/2174153230] boot 2023-12-12T11:48:04.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:04 smithi093 ceph-mon[115914]: osdmap e39: 6 total, 6 up, 6 in 2023-12-12T11:48:04.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:04 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-12T11:48:05.073 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.070+0000 7ff863512700 1 -- 172.21.15.63:0/3091525486 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff85c0fcbf0 msgr2=0x7ff85c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:05.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.070+0000 7ff863512700 1 --2- 172.21.15.63:0/3091525486 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff85c0fcbf0 0x7ff85c0fd000 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff858004940 tx=0x7ff858009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:05.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.070+0000 7ff863512700 1 -- 172.21.15.63:0/3091525486 shutdown_connections 2023-12-12T11:48:05.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.070+0000 7ff863512700 1 --2- 172.21.15.63:0/3091525486 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff85c0fde00 0x7ff85c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:05.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.070+0000 7ff863512700 1 --2- 172.21.15.63:0/3091525486 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff85c0fcbf0 0x7ff85c0fd000 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:05.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.070+0000 7ff863512700 1 -- 172.21.15.63:0/3091525486 >> 172.21.15.63:0/3091525486 conn(0x7ff85c0f82d0 msgr2=0x7ff85c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:05.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.070+0000 7ff863512700 1 -- 172.21.15.63:0/3091525486 shutdown_connections 2023-12-12T11:48:05.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.071+0000 7ff863512700 1 -- 172.21.15.63:0/3091525486 wait complete. 2023-12-12T11:48:05.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.071+0000 7ff863512700 1 Processor -- start 2023-12-12T11:48:05.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.071+0000 7ff863512700 1 -- start start 2023-12-12T11:48:05.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.072+0000 7ff863512700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff85c0fcbf0 0x7ff85c10d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.072+0000 7ff863512700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff85c0fde00 0x7ff85c10daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.072+0000 7ff863512700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c10e0a0 con 0x7ff85c0fcbf0 2023-12-12T11:48:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.072+0000 7ff863512700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c10e940 con 0x7ff85c0fde00 2023-12-12T11:48:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.072+0000 7ff8612ae700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff85c0fcbf0 0x7ff85c10d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.072+0000 7ff8612ae700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff85c0fcbf0 0x7ff85c10d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40142/0 (socket says 172.21.15.63:40142) 2023-12-12T11:48:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.072+0000 7ff8612ae700 1 -- 172.21.15.63:0/4081862616 learned_addr learned my addr 172.21.15.63:0/4081862616 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:48:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.072+0000 7ff860aad700 1 --2- 172.21.15.63:0/4081862616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff85c0fde00 0x7ff85c10daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.072+0000 7ff8612ae700 1 -- 172.21.15.63:0/4081862616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff85c0fde00 msgr2=0x7ff85c10daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.072+0000 7ff8612ae700 1 --2- 172.21.15.63:0/4081862616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff85c0fde00 0x7ff85c10daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.072+0000 7ff8612ae700 1 -- 172.21.15.63:0/4081862616 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff858005040 con 0x7ff85c0fcbf0 2023-12-12T11:48:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.073+0000 7ff8612ae700 1 --2- 172.21.15.63:0/4081862616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff85c0fcbf0 0x7ff85c10d560 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff858000c00 tx=0x7ff858009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.073+0000 7ff851ffb700 1 -- 172.21.15.63:0/4081862616 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff85800e040 con 0x7ff85c0fcbf0 2023-12-12T11:48:05.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.073+0000 7ff851ffb700 1 -- 172.21.15.63:0/4081862616 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff858013420 con 0x7ff85c0fcbf0 2023-12-12T11:48:05.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.073+0000 7ff851ffb700 1 -- 172.21.15.63:0/4081862616 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff85801c630 con 0x7ff85c0fcbf0 2023-12-12T11:48:05.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.073+0000 7ff863512700 1 -- 172.21.15.63:0/4081862616 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff85c10ebc0 con 0x7ff85c0fcbf0 2023-12-12T11:48:05.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.073+0000 7ff863512700 1 -- 172.21.15.63:0/4081862616 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff85c10f100 con 0x7ff85c0fcbf0 2023-12-12T11:48:05.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.074+0000 7ff863512700 1 -- 172.21.15.63:0/4081862616 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff85c04bb80 con 0x7ff85c0fcbf0 2023-12-12T11:48:05.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.075+0000 7ff851ffb700 1 -- 172.21.15.63:0/4081862616 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff858013590 con 0x7ff85c0fcbf0 2023-12-12T11:48:05.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.076+0000 7ff851ffb700 1 --2- 172.21.15.63:0/4081862616 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff848068f70 0x7ff84806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:05.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.076+0000 7ff851ffb700 1 -- 172.21.15.63:0/4081862616 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff858087cf0 con 0x7ff85c0fcbf0 2023-12-12T11:48:05.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.076+0000 7ff860aad700 1 --2- 172.21.15.63:0/4081862616 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff848068f70 0x7ff84806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:05.079 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.077+0000 7ff860aad700 1 --2- 172.21.15.63:0/4081862616 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff848068f70 0x7ff84806b420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff84c004f40 tx=0x7ff84c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:05.083 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.081+0000 7ff851ffb700 1 -- 172.21.15.63:0/4081862616 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff858057f70 con 0x7ff85c0fcbf0 2023-12-12T11:48:05.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.284+0000 7ff863512700 1 -- 172.21.15.63:0/4081862616 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7ff85c10f7c0 con 0x7ff85c0fcbf0 2023-12-12T11:48:05.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.284+0000 7ff851ffb700 1 -- 172.21.15.63:0/4081862616 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) v1 ==== 74+0+130 (secure 0 0 0) 0x7ff858013840 con 0x7ff85c0fcbf0 2023-12-12T11:48:05.287 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:48:05.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.286+0000 7ff863512700 1 -- 172.21.15.63:0/4081862616 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff848068f70 msgr2=0x7ff84806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:05.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.286+0000 7ff863512700 1 --2- 172.21.15.63:0/4081862616 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff848068f70 0x7ff84806b420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff84c004f40 tx=0x7ff84c00b040 comp rx=0 tx=0).stop 2023-12-12T11:48:05.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.286+0000 7ff863512700 1 -- 172.21.15.63:0/4081862616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff85c0fcbf0 msgr2=0x7ff85c10d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:05.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.286+0000 7ff863512700 1 --2- 172.21.15.63:0/4081862616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff85c0fcbf0 0x7ff85c10d560 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff858000c00 tx=0x7ff858009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:05.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.287+0000 7ff863512700 1 -- 172.21.15.63:0/4081862616 shutdown_connections 2023-12-12T11:48:05.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.287+0000 7ff863512700 1 --2- 172.21.15.63:0/4081862616 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff848068f70 0x7ff84806b420 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:05.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.287+0000 7ff863512700 1 --2- 172.21.15.63:0/4081862616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff85c0fcbf0 0x7ff85c10d560 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:05.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.287+0000 7ff863512700 1 --2- 172.21.15.63:0/4081862616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff85c0fde00 0x7ff85c10daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:05.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.287+0000 7ff863512700 1 -- 172.21.15.63:0/4081862616 >> 172.21.15.63:0/4081862616 conn(0x7ff85c0f82d0 msgr2=0x7ff85c101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:05.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.287+0000 7ff863512700 1 -- 172.21.15.63:0/4081862616 shutdown_connections 2023-12-12T11:48:05.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:05.287+0000 7ff863512700 1 -- 172.21.15.63:0/4081862616 wait complete. 2023-12-12T11:48:05.599 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:05 smithi063 ceph-mon[107117]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-12T11:48:05.599 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:05 smithi063 ceph-mon[107117]: osdmap e40: 6 total, 6 up, 6 in 2023-12-12T11:48:05.599 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:05 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/4081862616' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-12T11:48:05.627 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1702381683,"num_in_osds":6,"osd_in_since":1702381664,"num_remapped_pgs":0} 2023-12-12T11:48:05.627 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph osd dump --format=json 2023-12-12T11:48:05.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:05 smithi093 ceph-mon[115914]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-12T11:48:05.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:05 smithi093 ceph-mon[115914]: osdmap e40: 6 total, 6 up, 6 in 2023-12-12T11:48:05.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:05 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/4081862616' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-12T11:48:06.063 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:06.541 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:06 smithi063 ceph-mon[107117]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:06.541 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:06 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:48:06.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:06 smithi093 ceph-mon[115914]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:06.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:06 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:48:07.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.188+0000 7f36967a6700 1 -- 172.21.15.63:0/980661271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36901035a0 msgr2=0x7f36900fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:07.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.188+0000 7f36967a6700 1 --2- 172.21.15.63:0/980661271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36901035a0 0x7f36900fcc10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3684004940 tx=0x7f3684009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:07.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.188+0000 7f36967a6700 1 -- 172.21.15.63:0/980661271 shutdown_connections 2023-12-12T11:48:07.192 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.188+0000 7f36967a6700 1 --2- 172.21.15.63:0/980661271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36901035a0 0x7f36900fcc10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:07.192 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.188+0000 7f36967a6700 1 --2- 172.21.15.63:0/980661271 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3690102c00 0x7f3690102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:07.192 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.188+0000 7f36967a6700 1 -- 172.21.15.63:0/980661271 >> 172.21.15.63:0/980661271 conn(0x7f36900f8790 msgr2=0x7f36900faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:07.192 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.188+0000 7f36967a6700 1 -- 172.21.15.63:0/980661271 shutdown_connections 2023-12-12T11:48:07.192 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.188+0000 7f36967a6700 1 -- 172.21.15.63:0/980661271 wait complete. 2023-12-12T11:48:07.192 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.189+0000 7f36967a6700 1 Processor -- start 2023-12-12T11:48:07.193 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.190+0000 7f36967a6700 1 -- start start 2023-12-12T11:48:07.193 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.190+0000 7f36967a6700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3690102c00 0x7f3690113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:07.193 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.190+0000 7f36967a6700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36901035a0 0x7f3690113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:07.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.190+0000 7f36967a6700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3690114210 con 0x7f3690102c00 2023-12-12T11:48:07.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.190+0000 7f36967a6700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369010d500 con 0x7f36901035a0 2023-12-12T11:48:07.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.190+0000 7f368ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3690102c00 0x7f3690113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:07.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.190+0000 7f368ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3690102c00 0x7f3690113680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40170/0 (socket says 172.21.15.63:40170) 2023-12-12T11:48:07.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.190+0000 7f368ffff700 1 -- 172.21.15.63:0/2848609688 learned_addr learned my addr 172.21.15.63:0/2848609688 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:48:07.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.190+0000 7f368f7fe700 1 --2- 172.21.15.63:0/2848609688 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36901035a0 0x7f3690113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:07.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.190+0000 7f368ffff700 1 -- 172.21.15.63:0/2848609688 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36901035a0 msgr2=0x7f3690113bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:07.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.191+0000 7f368ffff700 1 --2- 172.21.15.63:0/2848609688 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36901035a0 0x7f3690113bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:07.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.191+0000 7f368ffff700 1 -- 172.21.15.63:0/2848609688 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3684005040 con 0x7f3690102c00 2023-12-12T11:48:07.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.191+0000 7f368f7fe700 1 --2- 172.21.15.63:0/2848609688 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36901035a0 0x7f3690113bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T11:48:07.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.191+0000 7f368ffff700 1 --2- 172.21.15.63:0/2848609688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3690102c00 0x7f3690113680 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f368000c8c0 tx=0x7f36800044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:07.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.191+0000 7f368cff9700 1 -- 172.21.15.63:0/2848609688 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f368000a980 con 0x7f3690102c00 2023-12-12T11:48:07.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.191+0000 7f368cff9700 1 -- 172.21.15.63:0/2848609688 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f368000ce60 con 0x7f3690102c00 2023-12-12T11:48:07.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.191+0000 7f36967a6700 1 -- 172.21.15.63:0/2848609688 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f369010d7e0 con 0x7f3690102c00 2023-12-12T11:48:07.195 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.191+0000 7f368cff9700 1 -- 172.21.15.63:0/2848609688 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36800113a0 con 0x7f3690102c00 2023-12-12T11:48:07.195 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.191+0000 7f36967a6700 1 -- 172.21.15.63:0/2848609688 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369010dd20 con 0x7f3690102c00 2023-12-12T11:48:07.195 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.192+0000 7f36967a6700 1 -- 172.21.15.63:0/2848609688 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3690113330 con 0x7f3690102c00 2023-12-12T11:48:07.195 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.193+0000 7f368cff9700 1 -- 172.21.15.63:0/2848609688 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f3680012400 con 0x7f3690102c00 2023-12-12T11:48:07.197 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.194+0000 7f368cff9700 1 --2- 172.21.15.63:0/2848609688 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f3678068f70 0x7f367806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:07.197 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.195+0000 7f368cff9700 1 -- 172.21.15.63:0/2848609688 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3680086ba0 con 0x7f3690102c00 2023-12-12T11:48:07.197 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.195+0000 7f368f7fe700 1 --2- 172.21.15.63:0/2848609688 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f3678068f70 0x7f367806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:07.197 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.195+0000 7f368f7fe700 1 --2- 172.21.15.63:0/2848609688 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f3678068f70 0x7f367806b420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f368400b3b0 tx=0x7f3684009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:07.201 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.199+0000 7f368cff9700 1 -- 172.21.15.63:0/2848609688 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3680056e40 con 0x7f3690102c00 2023-12-12T11:48:07.404 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.402+0000 7f36967a6700 1 -- 172.21.15.63:0/2848609688 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36901050d0 con 0x7f3690102c00 2023-12-12T11:48:07.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.403+0000 7f368cff9700 1 -- 172.21.15.63:0/2848609688 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11044 (secure 0 0 0) 0x7f36800569d0 con 0x7f3690102c00 2023-12-12T11:48:07.406 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:48:07.406 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":40,"fsid":"85e33c70-98e3-11ee-95a3-87774f69a715","created":"2023-12-12T11:43:06.421058+0000","modified":"2023-12-12T11:48:04.333096+0000","last_up_change":"2023-12-12T11:48:03.326525+0000","last_in_change":"2023-12-12T11:47:44.737839+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T11:46:58.373192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"6b09da78-38a4-46a4-bf22-b1d21103b497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2424092816},{"type":"v1","addr":"172.21.15.63:6803","nonce":2424092816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2424092816},{"type":"v1","addr":"172.21.15.63:6805","nonce":2424092816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2424092816},{"type":"v1","addr":"172.21.15.63:6809","nonce":2424092816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2424092816},{"type":"v1","addr":"172.21.15.63:6807","nonce":2424092816}]},"public_addr":"172.21.15.63:6803/2424092816","cluster_addr":"172.21.15.63:6805/2424092816","heartbeat_back_addr":"172.21.15.63:6809/2424092816","heartbeat_front_addr":"172.21.15.63:6807/2424092816","state":["exists","up"]},{"osd":1,"uuid":"b45154ac-c018-4aa6-89d4-f22bd94b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":1292346728},{"type":"v1","addr":"172.21.15.63:6811","nonce":1292346728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":1292346728},{"type":"v1","addr":"172.21.15.63:6813","nonce":1292346728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":1292346728},{"type":"v1","addr":"172.21.15.63:6817","nonce":1292346728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":1292346728},{"type":"v1","addr":"172.21.15.63:6815","nonce":1292346728}]},"public_addr":"172.21.15.63:6811/1292346728","cluster_addr":"172.21.15.63:6813/1292346728","heartbeat_back_addr":"172.21.15.63:6817/1292346728","heartbeat_front_addr":"172.21.15.63:6815/1292346728","state":["exists","up"]},{"osd":2,"uuid":"2fcdfc7f-334e-427a-8e1e-b95578c88db5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3760392553},{"type":"v1","addr":"172.21.15.63:6819","nonce":3760392553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":3760392553},{"type":"v1","addr":"172.21.15.63:6821","nonce":3760392553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":3760392553},{"type":"v1","addr":"172.21.15.63:6825","nonce":3760392553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":3760392553},{"type":"v1","addr":"172.21.15.63:6823","nonce":3760392553}]},"public_addr":"172.21.15.63:6819/3760392553","cluster_addr":"172.21.15.63:6821/3760392553","heartbeat_back_addr":"172.21.15.63:6825/3760392553","heartbeat_front_addr":"172.21.15.63:6823/3760392553","state":["exists","up"]},{"osd":3,"uuid":"79666eff-9c6a-4170-b1b6-9fee68b62865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":3547672003},{"type":"v1","addr":"172.21.15.93:6801","nonce":3547672003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":3547672003},{"type":"v1","addr":"172.21.15.93:6803","nonce":3547672003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":3547672003},{"type":"v1","addr":"172.21.15.93:6807","nonce":3547672003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":3547672003},{"type":"v1","addr":"172.21.15.93:6805","nonce":3547672003}]},"public_addr":"172.21.15.93:6801/3547672003","cluster_addr":"172.21.15.93:6803/3547672003","heartbeat_back_addr":"172.21.15.93:6807/3547672003","heartbeat_front_addr":"172.21.15.93:6805/3547672003","state":["exists","up"]},{"osd":4,"uuid":"af069a18-59ca-4e55-a09c-9d4be6e10cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":612058290},{"type":"v1","addr":"172.21.15.93:6809","nonce":612058290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":612058290},{"type":"v1","addr":"172.21.15.93:6811","nonce":612058290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":612058290},{"type":"v1","addr":"172.21.15.93:6815","nonce":612058290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":612058290},{"type":"v1","addr":"172.21.15.93:6813","nonce":612058290}]},"public_addr":"172.21.15.93:6809/612058290","cluster_addr":"172.21.15.93:6811/612058290","heartbeat_back_addr":"172.21.15.93:6815/612058290","heartbeat_front_addr":"172.21.15.93:6813/612058290","state":["exists","up"]},{"osd":5,"uuid":"66901eb6-442c-4808-a5d3-958fd4b8f18d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2174153230},{"type":"v1","addr":"172.21.15.93:6817","nonce":2174153230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2174153230},{"type":"v1","addr":"172.21.15.93:6819","nonce":2174153230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2174153230},{"type":"v1","addr":"172.21.15.93:6823","nonce":2174153230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2174153230},{"type":"v1","addr":"172.21.15.93:6821","nonce":2174153230}]},"public_addr":"172.21.15.93:6817/2174153230","cluster_addr":"172.21.15.93:6819/2174153230","heartbeat_back_addr":"172.21.15.93:6823/2174153230","heartbeat_front_addr":"172.21.15.93:6821/2174153230","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:46:08.420691+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:46:31.277938+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:46:54.903181+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:47:16.535347+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:47:38.988069+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:48:01.641629+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:6801/293571324":"2023-12-13T11:45:05.780140+0000","172.21.15.63:6800/293571324":"2023-12-13T11:45:05.780140+0000","172.21.15.63:0/1972560506":"2023-12-13T11:45:05.780140+0000","172.21.15.63:0/1443572827":"2023-12-13T11:45:05.780140+0000","172.21.15.63:0/2015988516":"2023-12-13T11:45:05.780140+0000","172.21.15.63:0/1601381023":"2023-12-13T11:44:08.715291+0000","172.21.15.63:0/545666177":"2023-12-13T11:44:08.715291+0000","172.21.15.63:6800/1972453923":"2023-12-13T11:43:38.661897+0000","172.21.15.63:6800/4048286824":"2023-12-13T11:44:08.715291+0000","172.21.15.63:6801/1972453923":"2023-12-13T11:43:38.661897+0000","172.21.15.63:0/90805296":"2023-12-13T11:43:38.661897+0000","172.21.15.63:6801/4048286824":"2023-12-13T11:44:08.715291+0000","172.21.15.63:0/2270429505":"2023-12-13T11:44:08.715291+0000","172.21.15.63:0/3524404486":"2023-12-13T11:43:38.661897+0000","172.21.15.63:0/1089809755":"2023-12-13T11:43:38.661897+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T11:48:07.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.405+0000 7f36967a6700 1 -- 172.21.15.63:0/2848609688 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f3678068f70 msgr2=0x7f367806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:07.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.405+0000 7f36967a6700 1 --2- 172.21.15.63:0/2848609688 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f3678068f70 0x7f367806b420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f368400b3b0 tx=0x7f3684009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:07.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.405+0000 7f36967a6700 1 -- 172.21.15.63:0/2848609688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3690102c00 msgr2=0x7f3690113680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:07.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.405+0000 7f36967a6700 1 --2- 172.21.15.63:0/2848609688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3690102c00 0x7f3690113680 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f368000c8c0 tx=0x7f36800044c0 comp rx=0 tx=0).stop 2023-12-12T11:48:07.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.405+0000 7f36967a6700 1 -- 172.21.15.63:0/2848609688 shutdown_connections 2023-12-12T11:48:07.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.405+0000 7f36967a6700 1 --2- 172.21.15.63:0/2848609688 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f3678068f70 0x7f367806b420 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:07.409 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.405+0000 7f36967a6700 1 --2- 172.21.15.63:0/2848609688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3690102c00 0x7f3690113680 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:07.409 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.405+0000 7f36967a6700 1 --2- 172.21.15.63:0/2848609688 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36901035a0 0x7f3690113bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:07.409 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.405+0000 7f36967a6700 1 -- 172.21.15.63:0/2848609688 >> 172.21.15.63:0/2848609688 conn(0x7f36900f8790 msgr2=0x7f36900fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:07.409 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.406+0000 7f36967a6700 1 -- 172.21.15.63:0/2848609688 shutdown_connections 2023-12-12T11:48:07.409 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:07.406+0000 7f36967a6700 1 -- 172.21.15.63:0/2848609688 wait complete. 2023-12-12T11:48:07.766 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:07 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/2848609688' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-12T11:48:07.790 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T11:46:58.373192+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-12T11:48:07.791 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph osd pool get .mgr pg_num 2023-12-12T11:48:07.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:07 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/2848609688' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-12T11:48:08.227 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:08.724 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:08 smithi063 ceph-mon[107117]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:08.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:08 smithi093 ceph-mon[115914]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:09.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.426+0000 7f17d1e63700 1 -- 172.21.15.63:0/380142626 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17cc0fdc10 msgr2=0x7f17cc0fdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:09.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.426+0000 7f17d1e63700 1 --2- 172.21.15.63:0/380142626 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17cc0fdc10 0x7f17cc0fdfe0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f17bc004940 tx=0x7f17bc009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:09.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.426+0000 7f17d1e63700 1 -- 172.21.15.63:0/380142626 shutdown_connections 2023-12-12T11:48:09.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.426+0000 7f17d1e63700 1 --2- 172.21.15.63:0/380142626 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17cc0fe5b0 0x7f17cc106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:09.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.426+0000 7f17d1e63700 1 --2- 172.21.15.63:0/380142626 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17cc0fdc10 0x7f17cc0fdfe0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:09.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.426+0000 7f17d1e63700 1 -- 172.21.15.63:0/380142626 >> 172.21.15.63:0/380142626 conn(0x7f17cc0f76c0 msgr2=0x7f17cc0f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:09.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.426+0000 7f17d1e63700 1 -- 172.21.15.63:0/380142626 shutdown_connections 2023-12-12T11:48:09.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.426+0000 7f17d1e63700 1 -- 172.21.15.63:0/380142626 wait complete. 2023-12-12T11:48:09.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.427+0000 7f17d1e63700 1 Processor -- start 2023-12-12T11:48:09.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.427+0000 7f17d1e63700 1 -- start start 2023-12-12T11:48:09.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.428+0000 7f17d1e63700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17cc0fdc10 0x7f17cc113630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:09.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.428+0000 7f17d1e63700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17cc0fe5b0 0x7f17cc113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:09.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.428+0000 7f17d1e63700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc114200 con 0x7f17cc0fdc10 2023-12-12T11:48:09.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.428+0000 7f17d1e63700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc10d4f0 con 0x7f17cc0fe5b0 2023-12-12T11:48:09.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.428+0000 7f17cb7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17cc0fdc10 0x7f17cc113630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:09.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.428+0000 7f17cb7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17cc0fdc10 0x7f17cc113630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60952/0 (socket says 172.21.15.63:60952) 2023-12-12T11:48:09.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.428+0000 7f17cb7fe700 1 -- 172.21.15.63:0/1381241509 learned_addr learned my addr 172.21.15.63:0/1381241509 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:48:09.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.429+0000 7f17caffd700 1 --2- 172.21.15.63:0/1381241509 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17cc0fe5b0 0x7f17cc113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:09.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.429+0000 7f17cb7fe700 1 -- 172.21.15.63:0/1381241509 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17cc0fe5b0 msgr2=0x7f17cc113bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:09.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.429+0000 7f17cb7fe700 1 --2- 172.21.15.63:0/1381241509 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17cc0fe5b0 0x7f17cc113bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:09.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.429+0000 7f17cb7fe700 1 -- 172.21.15.63:0/1381241509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17bc005040 con 0x7f17cc0fdc10 2023-12-12T11:48:09.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.429+0000 7f17caffd700 1 --2- 172.21.15.63:0/1381241509 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17cc0fe5b0 0x7f17cc113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T11:48:09.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.429+0000 7f17cb7fe700 1 --2- 172.21.15.63:0/1381241509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17cc0fdc10 0x7f17cc113630 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f17bc009390 tx=0x7f17bc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:09.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.429+0000 7f17b3fff700 1 -- 172.21.15.63:0/1381241509 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17bc00e040 con 0x7f17cc0fdc10 2023-12-12T11:48:09.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.429+0000 7f17b3fff700 1 -- 172.21.15.63:0/1381241509 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f17bc004290 con 0x7f17cc0fdc10 2023-12-12T11:48:09.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.429+0000 7f17d1e63700 1 -- 172.21.15.63:0/1381241509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17cc10d720 con 0x7f17cc0fdc10 2023-12-12T11:48:09.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.429+0000 7f17b3fff700 1 -- 172.21.15.63:0/1381241509 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17bc01c3f0 con 0x7f17cc0fdc10 2023-12-12T11:48:09.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.429+0000 7f17d1e63700 1 -- 172.21.15.63:0/1381241509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17cc10dc60 con 0x7f17cc0fdc10 2023-12-12T11:48:09.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.430+0000 7f17d1e63700 1 -- 172.21.15.63:0/1381241509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17cc104200 con 0x7f17cc0fdc10 2023-12-12T11:48:09.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.431+0000 7f17b3fff700 1 -- 172.21.15.63:0/1381241509 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f17bc00bc50 con 0x7f17cc0fdc10 2023-12-12T11:48:09.434 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.432+0000 7f17b3fff700 1 --2- 172.21.15.63:0/1381241509 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f17b4068f70 0x7f17b406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:09.434 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.432+0000 7f17b3fff700 1 -- 172.21.15.63:0/1381241509 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f17bc087d10 con 0x7f17cc0fdc10 2023-12-12T11:48:09.434 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.432+0000 7f17caffd700 1 --2- 172.21.15.63:0/1381241509 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f17b4068f70 0x7f17b406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:09.435 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.433+0000 7f17caffd700 1 --2- 172.21.15.63:0/1381241509 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f17b4068f70 0x7f17b406b420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f17c0009fd0 tx=0x7f17c000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:09.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.437+0000 7f17b3fff700 1 -- 172.21.15.63:0/1381241509 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f17bc058050 con 0x7f17cc0fdc10 2023-12-12T11:48:09.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.638+0000 7f17d1e63700 1 -- 172.21.15.63:0/1381241509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f17cc109b70 con 0x7f17cc0fdc10 2023-12-12T11:48:09.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.638+0000 7f17b3fff700 1 -- 172.21.15.63:0/1381241509 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f17bc057be0 con 0x7f17cc0fdc10 2023-12-12T11:48:09.641 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-12T11:48:09.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.640+0000 7f17d1e63700 1 -- 172.21.15.63:0/1381241509 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f17b4068f70 msgr2=0x7f17b406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:09.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.640+0000 7f17d1e63700 1 --2- 172.21.15.63:0/1381241509 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f17b4068f70 0x7f17b406b420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f17c0009fd0 tx=0x7f17c000b040 comp rx=0 tx=0).stop 2023-12-12T11:48:09.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.640+0000 7f17d1e63700 1 -- 172.21.15.63:0/1381241509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17cc0fdc10 msgr2=0x7f17cc113630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:09.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.640+0000 7f17d1e63700 1 --2- 172.21.15.63:0/1381241509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17cc0fdc10 0x7f17cc113630 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f17bc009390 tx=0x7f17bc009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:09.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.641+0000 7f17d1e63700 1 -- 172.21.15.63:0/1381241509 shutdown_connections 2023-12-12T11:48:09.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.641+0000 7f17d1e63700 1 --2- 172.21.15.63:0/1381241509 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f17b4068f70 0x7f17b406b420 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:09.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.641+0000 7f17d1e63700 1 --2- 172.21.15.63:0/1381241509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17cc0fdc10 0x7f17cc113630 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:09.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.641+0000 7f17d1e63700 1 --2- 172.21.15.63:0/1381241509 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17cc0fe5b0 0x7f17cc113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:09.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.641+0000 7f17d1e63700 1 -- 172.21.15.63:0/1381241509 >> 172.21.15.63:0/1381241509 conn(0x7f17cc0f76c0 msgr2=0x7f17cc101380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:09.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.641+0000 7f17d1e63700 1 -- 172.21.15.63:0/1381241509 shutdown_connections 2023-12-12T11:48:09.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:09.641+0000 7f17d1e63700 1 -- 172.21.15.63:0/1381241509 wait complete. 2023-12-12T11:48:09.965 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:09 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/1381241509' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-12T11:48:09.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:09 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/1381241509' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-12T11:48:09.993 INFO:tasks.cephadm:Setting up client nodes... 2023-12-12T11:48:09.993 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-12T11:48:10.427 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:10.916 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:10 smithi063 ceph-mon[107117]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:10.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:10 smithi093 ceph-mon[115914]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:11.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.630+0000 7efcbd5df700 1 -- 172.21.15.63:0/1064632589 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcb80fcbf0 msgr2=0x7efcb80fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:11.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.630+0000 7efcbd5df700 1 --2- 172.21.15.63:0/1064632589 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcb80fcbf0 0x7efcb80fd000 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efca8004940 tx=0x7efca8009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:11.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.630+0000 7efcbd5df700 1 -- 172.21.15.63:0/1064632589 shutdown_connections 2023-12-12T11:48:11.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.630+0000 7efcbd5df700 1 --2- 172.21.15.63:0/1064632589 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcb80fde00 0x7efcb80fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:11.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.630+0000 7efcbd5df700 1 --2- 172.21.15.63:0/1064632589 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcb80fcbf0 0x7efcb80fd000 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:11.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.630+0000 7efcbd5df700 1 -- 172.21.15.63:0/1064632589 >> 172.21.15.63:0/1064632589 conn(0x7efcb80f82d0 msgr2=0x7efcb80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:11.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.630+0000 7efcbd5df700 1 -- 172.21.15.63:0/1064632589 shutdown_connections 2023-12-12T11:48:11.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.630+0000 7efcbd5df700 1 -- 172.21.15.63:0/1064632589 wait complete. 2023-12-12T11:48:11.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.631+0000 7efcbd5df700 1 Processor -- start 2023-12-12T11:48:11.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.631+0000 7efcbd5df700 1 -- start start 2023-12-12T11:48:11.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.631+0000 7efcbd5df700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcb80fcbf0 0x7efcb810f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:11.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.631+0000 7efcbd5df700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcb80fde00 0x7efcb810fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:11.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.631+0000 7efcbd5df700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb81102a0 con 0x7efcb80fde00 2023-12-12T11:48:11.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.631+0000 7efcbd5df700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb8110b40 con 0x7efcb80fcbf0 2023-12-12T11:48:11.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.632+0000 7efcb67fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcb80fde00 0x7efcb810fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:11.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.632+0000 7efcb67fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcb80fde00 0x7efcb810fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60964/0 (socket says 172.21.15.63:60964) 2023-12-12T11:48:11.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.632+0000 7efcb67fc700 1 -- 172.21.15.63:0/2354925318 learned_addr learned my addr 172.21.15.63:0/2354925318 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:48:11.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.632+0000 7efcb6ffd700 1 --2- 172.21.15.63:0/2354925318 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcb80fcbf0 0x7efcb810f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:11.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.632+0000 7efcb67fc700 1 -- 172.21.15.63:0/2354925318 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcb80fcbf0 msgr2=0x7efcb810f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:11.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.632+0000 7efcb67fc700 1 --2- 172.21.15.63:0/2354925318 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcb80fcbf0 0x7efcb810f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:11.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.632+0000 7efcb67fc700 1 -- 172.21.15.63:0/2354925318 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca8005040 con 0x7efcb80fde00 2023-12-12T11:48:11.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.632+0000 7efcb67fc700 1 --2- 172.21.15.63:0/2354925318 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcb80fde00 0x7efcb810fca0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efcac002a50 tx=0x7efcac0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:11.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.633+0000 7efc9f7fe700 1 -- 172.21.15.63:0/2354925318 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcac007cc0 con 0x7efcb80fde00 2023-12-12T11:48:11.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.633+0000 7efc9f7fe700 1 -- 172.21.15.63:0/2354925318 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efcac00f040 con 0x7efcb80fde00 2023-12-12T11:48:11.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.633+0000 7efcbd5df700 1 -- 172.21.15.63:0/2354925318 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb8110e20 con 0x7efcb80fde00 2023-12-12T11:48:11.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.633+0000 7efc9f7fe700 1 -- 172.21.15.63:0/2354925318 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcac00d9c0 con 0x7efcb80fde00 2023-12-12T11:48:11.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.633+0000 7efcbd5df700 1 -- 172.21.15.63:0/2354925318 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb8111360 con 0x7efcb80fde00 2023-12-12T11:48:11.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.634+0000 7efcbd5df700 1 -- 172.21.15.63:0/2354925318 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb8101ea0 con 0x7efcb80fde00 2023-12-12T11:48:11.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.635+0000 7efc9f7fe700 1 -- 172.21.15.63:0/2354925318 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7efcac00db20 con 0x7efcb80fde00 2023-12-12T11:48:11.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.636+0000 7efc9f7fe700 1 --2- 172.21.15.63:0/2354925318 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7efca0068f70 0x7efca006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:11.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.636+0000 7efc9f7fe700 1 -- 172.21.15.63:0/2354925318 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7efcac086740 con 0x7efcb80fde00 2023-12-12T11:48:11.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.636+0000 7efcb6ffd700 1 --2- 172.21.15.63:0/2354925318 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7efca0068f70 0x7efca006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:11.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.637+0000 7efcb6ffd700 1 --2- 172.21.15.63:0/2354925318 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7efca0068f70 0x7efca006b420 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efca800b7d0 tx=0x7efca8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:11.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.640+0000 7efc9f7fe700 1 -- 172.21.15.63:0/2354925318 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7efcac056940 con 0x7efcb80fde00 2023-12-12T11:48:11.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.927+0000 7efcbd5df700 1 -- 172.21.15.63:0/2354925318 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7efcb804bb80 con 0x7efcb80fde00 2023-12-12T11:48:11.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.932+0000 7efc9f7fe700 1 -- 172.21.15.63:0/2354925318 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7efcac0564d0 con 0x7efcb80fde00 2023-12-12T11:48:11.934 INFO:teuthology.orchestra.run.smithi063.stdout:[client.0] 2023-12-12T11:48:11.934 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQB7SHhlmjdhNxAAWJzdLIZk9TpJ1ATiwm52kg== 2023-12-12T11:48:11.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.934+0000 7efcbd5df700 1 -- 172.21.15.63:0/2354925318 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7efca0068f70 msgr2=0x7efca006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:11.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.934+0000 7efcbd5df700 1 --2- 172.21.15.63:0/2354925318 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7efca0068f70 0x7efca006b420 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efca800b7d0 tx=0x7efca8009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:11.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.934+0000 7efcbd5df700 1 -- 172.21.15.63:0/2354925318 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcb80fde00 msgr2=0x7efcb810fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:11.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.934+0000 7efcbd5df700 1 --2- 172.21.15.63:0/2354925318 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcb80fde00 0x7efcb810fca0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efcac002a50 tx=0x7efcac0046b0 comp rx=0 tx=0).stop 2023-12-12T11:48:11.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.934+0000 7efcbd5df700 1 -- 172.21.15.63:0/2354925318 shutdown_connections 2023-12-12T11:48:11.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.934+0000 7efcbd5df700 1 --2- 172.21.15.63:0/2354925318 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcb80fcbf0 0x7efcb810f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:11.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.934+0000 7efcbd5df700 1 --2- 172.21.15.63:0/2354925318 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7efca0068f70 0x7efca006b420 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:11.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.934+0000 7efcbd5df700 1 --2- 172.21.15.63:0/2354925318 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcb80fde00 0x7efcb810fca0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:11.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.934+0000 7efcbd5df700 1 -- 172.21.15.63:0/2354925318 >> 172.21.15.63:0/2354925318 conn(0x7efcb80f82d0 msgr2=0x7efcb80ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:11.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.934+0000 7efcbd5df700 1 -- 172.21.15.63:0/2354925318 shutdown_connections 2023-12-12T11:48:11.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:11.934+0000 7efcbd5df700 1 -- 172.21.15.63:0/2354925318 wait complete. 2023-12-12T11:48:12.354 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-12T11:48:12.354 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-12-12T11:48:12.354 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-12T11:48:12.454 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-12T11:48:12.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:12 smithi063 ceph-mon[107117]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:12.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:12 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/2354925318' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-12T11:48:12.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:12 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/2354925318' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-12T11:48:12.880 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi093/config 2023-12-12T11:48:12.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:12 smithi093 ceph-mon[115914]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:12.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:12 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/2354925318' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-12T11:48:12.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:12 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/2354925318' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-12T11:48:14.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.075+0000 7ff36495e700 1 -- 172.21.15.93:0/1792759468 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3600fdc00 msgr2=0x7ff3600fe050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:14.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.075+0000 7ff36495e700 1 --2- 172.21.15.93:0/1792759468 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3600fdc00 0x7ff3600fe050 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff348004940 tx=0x7ff348009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:14.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.075+0000 7ff36495e700 1 -- 172.21.15.93:0/1792759468 shutdown_connections 2023-12-12T11:48:14.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.075+0000 7ff36495e700 1 --2- 172.21.15.93:0/1792759468 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3600fdc00 0x7ff3600fe050 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:14.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.075+0000 7ff36495e700 1 --2- 172.21.15.93:0/1792759468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3600fc9f0 0x7ff3600fce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:14.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.075+0000 7ff36495e700 1 -- 172.21.15.93:0/1792759468 >> 172.21.15.93:0/1792759468 conn(0x7ff3600f8090 msgr2=0x7ff3600fa4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:14.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.075+0000 7ff36495e700 1 -- 172.21.15.93:0/1792759468 shutdown_connections 2023-12-12T11:48:14.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.075+0000 7ff36495e700 1 -- 172.21.15.93:0/1792759468 wait complete. 2023-12-12T11:48:14.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.075+0000 7ff36495e700 1 Processor -- start 2023-12-12T11:48:14.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.076+0000 7ff36495e700 1 -- start start 2023-12-12T11:48:14.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.076+0000 7ff36495e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3600fc9f0 0x7ff360071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:14.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.076+0000 7ff36495e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3600fdc00 0x7ff36006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:14.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.076+0000 7ff36495e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff360070620 con 0x7ff3600fdc00 2023-12-12T11:48:14.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.076+0000 7ff36495e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff360070790 con 0x7ff3600fc9f0 2023-12-12T11:48:14.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.076+0000 7ff35f7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3600fc9f0 0x7ff360071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:14.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.076+0000 7ff35f7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3600fc9f0 0x7ff360071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:36946/0 (socket says 172.21.15.93:36946) 2023-12-12T11:48:14.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.076+0000 7ff35f7fe700 1 -- 172.21.15.93:0/1842244301 learned_addr learned my addr 172.21.15.93:0/1842244301 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-12-12T11:48:14.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.076+0000 7ff357fff700 1 --2- 172.21.15.93:0/1842244301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3600fdc00 0x7ff36006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:14.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.076+0000 7ff35f7fe700 1 -- 172.21.15.93:0/1842244301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3600fdc00 msgr2=0x7ff36006ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:14.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.077+0000 7ff35f7fe700 1 --2- 172.21.15.93:0/1842244301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3600fdc00 0x7ff36006ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:14.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.077+0000 7ff35f7fe700 1 -- 172.21.15.93:0/1842244301 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff348005040 con 0x7ff3600fc9f0 2023-12-12T11:48:14.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.077+0000 7ff35f7fe700 1 --2- 172.21.15.93:0/1842244301 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3600fc9f0 0x7ff360071b10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff35000b790 tx=0x7ff350009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:14.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.077+0000 7ff35cff9700 1 -- 172.21.15.93:0/1842244301 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff35000f6f0 con 0x7ff3600fc9f0 2023-12-12T11:48:14.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.077+0000 7ff35cff9700 1 -- 172.21.15.93:0/1842244301 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff35000fd00 con 0x7ff3600fc9f0 2023-12-12T11:48:14.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.077+0000 7ff36495e700 1 -- 172.21.15.93:0/1842244301 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff360070a70 con 0x7ff3600fc9f0 2023-12-12T11:48:14.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.077+0000 7ff35cff9700 1 -- 172.21.15.93:0/1842244301 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3500103a0 con 0x7ff3600fc9f0 2023-12-12T11:48:14.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.077+0000 7ff36495e700 1 -- 172.21.15.93:0/1842244301 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3601154e0 con 0x7ff3600fc9f0 2023-12-12T11:48:14.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.078+0000 7ff36495e700 1 -- 172.21.15.93:0/1842244301 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff36004bb80 con 0x7ff3600fc9f0 2023-12-12T11:48:14.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.079+0000 7ff35cff9700 1 -- 172.21.15.93:0/1842244301 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff35000f850 con 0x7ff3600fc9f0 2023-12-12T11:48:14.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.080+0000 7ff35cff9700 1 --2- 172.21.15.93:0/1842244301 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff34c068f70 0x7ff34c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:14.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.080+0000 7ff35cff9700 1 -- 172.21.15.93:0/1842244301 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff350086880 con 0x7ff3600fc9f0 2023-12-12T11:48:14.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.081+0000 7ff357fff700 1 --2- 172.21.15.93:0/1842244301 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff34c068f70 0x7ff34c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:14.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.081+0000 7ff357fff700 1 --2- 172.21.15.93:0/1842244301 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff34c068f70 0x7ff34c06b420 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff348004f90 tx=0x7ff348009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:14.086 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.085+0000 7ff35cff9700 1 -- 172.21.15.93:0/1842244301 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff350056a80 con 0x7ff3600fc9f0 2023-12-12T11:48:14.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.347+0000 7ff36495e700 1 -- 172.21.15.93:0/1842244301 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7ff360115880 con 0x7ff3600fc9f0 2023-12-12T11:48:14.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.352+0000 7ff35cff9700 1 -- 172.21.15.93:0/1842244301 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7ff350056610 con 0x7ff3600fc9f0 2023-12-12T11:48:14.356 INFO:teuthology.orchestra.run.smithi093.stdout:[client.1] 2023-12-12T11:48:14.356 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQB+SHhl3iTGFBAA13u1SRa6Q3PSOnGvwYZP8w== 2023-12-12T11:48:14.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.355+0000 7ff36495e700 1 -- 172.21.15.93:0/1842244301 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff34c068f70 msgr2=0x7ff34c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:14.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.355+0000 7ff36495e700 1 --2- 172.21.15.93:0/1842244301 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff34c068f70 0x7ff34c06b420 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff348004f90 tx=0x7ff348009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:14.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.355+0000 7ff36495e700 1 -- 172.21.15.93:0/1842244301 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3600fc9f0 msgr2=0x7ff360071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:14.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.355+0000 7ff36495e700 1 --2- 172.21.15.93:0/1842244301 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3600fc9f0 0x7ff360071b10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff35000b790 tx=0x7ff350009220 comp rx=0 tx=0).stop 2023-12-12T11:48:14.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.355+0000 7ff36495e700 1 -- 172.21.15.93:0/1842244301 shutdown_connections 2023-12-12T11:48:14.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.355+0000 7ff36495e700 1 --2- 172.21.15.93:0/1842244301 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3600fc9f0 0x7ff360071b10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:14.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.355+0000 7ff36495e700 1 --2- 172.21.15.93:0/1842244301 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff34c068f70 0x7ff34c06b420 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:14.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.355+0000 7ff36495e700 1 --2- 172.21.15.93:0/1842244301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3600fdc00 0x7ff36006ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:14.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.355+0000 7ff36495e700 1 -- 172.21.15.93:0/1842244301 >> 172.21.15.93:0/1842244301 conn(0x7ff3600f8090 msgr2=0x7ff360100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:14.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.355+0000 7ff36495e700 1 -- 172.21.15.93:0/1842244301 shutdown_connections 2023-12-12T11:48:14.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-12T11:48:14.355+0000 7ff36495e700 1 -- 172.21.15.93:0/1842244301 wait complete. 2023-12-12T11:48:14.742 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-12T11:48:14.742 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2023-12-12T11:48:14.742 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-12T11:48:14.841 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-12T11:48:14.841 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-12-12T11:48:14.841 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph mgr dump --format=json 2023-12-12T11:48:14.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:14 smithi093 ceph-mon[115914]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:14.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:14 smithi093 ceph-mon[115914]: from='client.? 172.21.15.93:0/1842244301' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-12T11:48:14.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:14 smithi093 ceph-mon[115914]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-12T11:48:14.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:14 smithi093 ceph-mon[115914]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-12T11:48:15.283 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:15.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:14 smithi063 ceph-mon[107117]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:15.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:14 smithi063 ceph-mon[107117]: from='client.? 172.21.15.93:0/1842244301' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-12T11:48:15.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:14 smithi063 ceph-mon[107117]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-12T11:48:15.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:14 smithi063 ceph-mon[107117]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-12T11:48:16.422 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.419+0000 7fd77d4af700 1 -- 172.21.15.63:0/1665414091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7781035a0 msgr2=0x7fd7780fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:16.422 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.419+0000 7fd77d4af700 1 --2- 172.21.15.63:0/1665414091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7781035a0 0x7fd7780fcc10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd76c004940 tx=0x7fd76c009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:16.422 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.419+0000 7fd77d4af700 1 -- 172.21.15.63:0/1665414091 shutdown_connections 2023-12-12T11:48:16.422 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.419+0000 7fd77d4af700 1 --2- 172.21.15.63:0/1665414091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7781035a0 0x7fd7780fcc10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:16.423 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.419+0000 7fd77d4af700 1 --2- 172.21.15.63:0/1665414091 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd778102c00 0x7fd778102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:16.423 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.419+0000 7fd77d4af700 1 -- 172.21.15.63:0/1665414091 >> 172.21.15.63:0/1665414091 conn(0x7fd7780f8790 msgr2=0x7fd7780faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:16.423 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.420+0000 7fd77d4af700 1 -- 172.21.15.63:0/1665414091 shutdown_connections 2023-12-12T11:48:16.423 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.420+0000 7fd77d4af700 1 -- 172.21.15.63:0/1665414091 wait complete. 2023-12-12T11:48:16.423 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.420+0000 7fd77d4af700 1 Processor -- start 2023-12-12T11:48:16.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.421+0000 7fd77d4af700 1 -- start start 2023-12-12T11:48:16.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.421+0000 7fd77d4af700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd778102c00 0x7fd778113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:16.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.421+0000 7fd77d4af700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7781035a0 0x7fd778113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:16.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.421+0000 7fd77d4af700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd778114210 con 0x7fd7781035a0 2023-12-12T11:48:16.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.421+0000 7fd77d4af700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77810d500 con 0x7fd778102c00 2023-12-12T11:48:16.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.421+0000 7fd7767fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7781035a0 0x7fd778113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:16.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.421+0000 7fd7767fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7781035a0 0x7fd778113bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60978/0 (socket says 172.21.15.63:60978) 2023-12-12T11:48:16.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.421+0000 7fd7767fc700 1 -- 172.21.15.63:0/3187131077 learned_addr learned my addr 172.21.15.63:0/3187131077 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:48:16.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.422+0000 7fd776ffd700 1 --2- 172.21.15.63:0/3187131077 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd778102c00 0x7fd778113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:16.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.422+0000 7fd7767fc700 1 -- 172.21.15.63:0/3187131077 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd778102c00 msgr2=0x7fd778113680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:16.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.422+0000 7fd7767fc700 1 --2- 172.21.15.63:0/3187131077 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd778102c00 0x7fd778113680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:16.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.422+0000 7fd7767fc700 1 -- 172.21.15.63:0/3187131077 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76c005040 con 0x7fd7781035a0 2023-12-12T11:48:16.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.422+0000 7fd7767fc700 1 --2- 172.21.15.63:0/3187131077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7781035a0 0x7fd778113bc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd76c009360 tx=0x7fd76c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:16.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.422+0000 7fd75f7fe700 1 -- 172.21.15.63:0/3187131077 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd76c00e040 con 0x7fd7781035a0 2023-12-12T11:48:16.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.422+0000 7fd75f7fe700 1 -- 172.21.15.63:0/3187131077 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd76c00bc50 con 0x7fd7781035a0 2023-12-12T11:48:16.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.422+0000 7fd77d4af700 1 -- 172.21.15.63:0/3187131077 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd77810d780 con 0x7fd7781035a0 2023-12-12T11:48:16.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.422+0000 7fd75f7fe700 1 -- 172.21.15.63:0/3187131077 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd76c01c630 con 0x7fd7781035a0 2023-12-12T11:48:16.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.422+0000 7fd77d4af700 1 -- 172.21.15.63:0/3187131077 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd77810dcc0 con 0x7fd7781035a0 2023-12-12T11:48:16.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.423+0000 7fd77d4af700 1 -- 172.21.15.63:0/3187131077 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd778113310 con 0x7fd7781035a0 2023-12-12T11:48:16.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.424+0000 7fd75f7fe700 1 -- 172.21.15.63:0/3187131077 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fd76c013420 con 0x7fd7781035a0 2023-12-12T11:48:16.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.426+0000 7fd75f7fe700 1 --2- 172.21.15.63:0/3187131077 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fd760068f70 0x7fd76006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:16.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.426+0000 7fd75f7fe700 1 -- 172.21.15.63:0/3187131077 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd76c087eb0 con 0x7fd7781035a0 2023-12-12T11:48:16.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.426+0000 7fd776ffd700 1 --2- 172.21.15.63:0/3187131077 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fd760068f70 0x7fd76006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:16.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.427+0000 7fd776ffd700 1 --2- 172.21.15.63:0/3187131077 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fd760068f70 0x7fd76006b420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd768004990 tx=0x7fd768009ee0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:16.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.430+0000 7fd75f7fe700 1 -- 172.21.15.63:0/3187131077 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd76c058130 con 0x7fd7781035a0 2023-12-12T11:48:16.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.688+0000 7fd77d4af700 1 -- 172.21.15.63:0/3187131077 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fd7781050d0 con 0x7fd7781035a0 2023-12-12T11:48:16.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.692+0000 7fd75f7fe700 1 -- 172.21.15.63:0/3187131077 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+166777 (secure 0 0 0) 0x7fd76c057cc0 con 0x7fd7781035a0 2023-12-12T11:48:16.696 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:48:16.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.695+0000 7fd77d4af700 1 -- 172.21.15.63:0/3187131077 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fd760068f70 msgr2=0x7fd76006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:16.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.695+0000 7fd77d4af700 1 --2- 172.21.15.63:0/3187131077 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fd760068f70 0x7fd76006b420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd768004990 tx=0x7fd768009ee0 comp rx=0 tx=0).stop 2023-12-12T11:48:16.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.695+0000 7fd77d4af700 1 -- 172.21.15.63:0/3187131077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7781035a0 msgr2=0x7fd778113bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:16.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.695+0000 7fd77d4af700 1 --2- 172.21.15.63:0/3187131077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7781035a0 0x7fd778113bc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd76c009360 tx=0x7fd76c009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:16.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.695+0000 7fd77d4af700 1 -- 172.21.15.63:0/3187131077 shutdown_connections 2023-12-12T11:48:16.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.695+0000 7fd77d4af700 1 --2- 172.21.15.63:0/3187131077 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd778102c00 0x7fd778113680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:16.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.695+0000 7fd77d4af700 1 --2- 172.21.15.63:0/3187131077 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fd760068f70 0x7fd76006b420 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:16.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.695+0000 7fd77d4af700 1 --2- 172.21.15.63:0/3187131077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7781035a0 0x7fd778113bc0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:16.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.695+0000 7fd77d4af700 1 -- 172.21.15.63:0/3187131077 >> 172.21.15.63:0/3187131077 conn(0x7fd7780f8790 msgr2=0x7fd7780fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:16.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.695+0000 7fd77d4af700 1 -- 172.21.15.63:0/3187131077 shutdown_connections 2023-12-12T11:48:16.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:16.695+0000 7fd77d4af700 1 -- 172.21.15.63:0/3187131077 wait complete. 2023-12-12T11:48:17.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:16 smithi063 ceph-mon[107117]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:17.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:16 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/3187131077' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-12T11:48:17.105 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":19,"active_gid":14208,"active_name":"smithi063.zjnfdi","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3841315087},{"type":"v1","addr":"172.21.15.63:6801","nonce":3841315087}]},"active_addr":"172.21.15.63:6801/3841315087","active_change":"2023-12-12T11:45:05.780251+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14232,"name":"smithi093.nbtltu","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.63:8443/","prometheus":"http://172.21.15.63:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":2136521491}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":1747856225}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":2550373170}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":3710081653}]}]} 2023-12-12T11:48:17.109 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-12-12T11:48:17.109 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-12-12T11:48:17.109 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph osd dump --format=json 2023-12-12T11:48:17.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:16 smithi093 ceph-mon[115914]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:17.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:16 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/3187131077' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-12T11:48:17.543 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:18.630 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.627+0000 7fd9bd095700 1 -- 172.21.15.63:0/3881461897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9b8102c00 msgr2=0x7fd9b8102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:18.631 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.627+0000 7fd9bd095700 1 --2- 172.21.15.63:0/3881461897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9b8102c00 0x7fd9b8102fd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8004940 tx=0x7fd9a8009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:18.631 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.627+0000 7fd9bd095700 1 -- 172.21.15.63:0/3881461897 shutdown_connections 2023-12-12T11:48:18.631 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.627+0000 7fd9bd095700 1 --2- 172.21.15.63:0/3881461897 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9b81035a0 0x7fd9b80fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:18.631 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.627+0000 7fd9bd095700 1 --2- 172.21.15.63:0/3881461897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9b8102c00 0x7fd9b8102fd0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:18.631 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.627+0000 7fd9bd095700 1 -- 172.21.15.63:0/3881461897 >> 172.21.15.63:0/3881461897 conn(0x7fd9b80f8790 msgr2=0x7fd9b80faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:18.631 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.627+0000 7fd9bd095700 1 -- 172.21.15.63:0/3881461897 shutdown_connections 2023-12-12T11:48:18.631 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.627+0000 7fd9bd095700 1 -- 172.21.15.63:0/3881461897 wait complete. 2023-12-12T11:48:18.631 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.628+0000 7fd9bd095700 1 Processor -- start 2023-12-12T11:48:18.631 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.628+0000 7fd9bd095700 1 -- start start 2023-12-12T11:48:18.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.629+0000 7fd9bd095700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9b8102c00 0x7fd9b81136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:18.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.629+0000 7fd9bd095700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9b81035a0 0x7fd9b8113bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:18.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.629+0000 7fd9bd095700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b81142d0 con 0x7fd9b8102c00 2023-12-12T11:48:18.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.629+0000 7fd9bd095700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b810d590 con 0x7fd9b81035a0 2023-12-12T11:48:18.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.629+0000 7fd9b6d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9b8102c00 0x7fd9b81136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:18.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.629+0000 7fd9b6d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9b8102c00 0x7fd9b81136b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56994/0 (socket says 172.21.15.63:56994) 2023-12-12T11:48:18.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.629+0000 7fd9b6d9d700 1 -- 172.21.15.63:0/2680078035 learned_addr learned my addr 172.21.15.63:0/2680078035 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:48:18.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.629+0000 7fd9b659c700 1 --2- 172.21.15.63:0/2680078035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9b81035a0 0x7fd9b8113bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:18.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.630+0000 7fd9b6d9d700 1 -- 172.21.15.63:0/2680078035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9b81035a0 msgr2=0x7fd9b8113bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:18.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.630+0000 7fd9b6d9d700 1 --2- 172.21.15.63:0/2680078035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9b81035a0 0x7fd9b8113bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:18.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.630+0000 7fd9b6d9d700 1 -- 172.21.15.63:0/2680078035 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a8005040 con 0x7fd9b8102c00 2023-12-12T11:48:18.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.630+0000 7fd9b659c700 1 --2- 172.21.15.63:0/2680078035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9b81035a0 0x7fd9b8113bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T11:48:18.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.630+0000 7fd9b6d9d700 1 --2- 172.21.15.63:0/2680078035 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9b8102c00 0x7fd9b81136b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8009360 tx=0x7fd9a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:18.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.630+0000 7fd99f7fe700 1 -- 172.21.15.63:0/2680078035 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9a800e040 con 0x7fd9b8102c00 2023-12-12T11:48:18.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.630+0000 7fd99f7fe700 1 -- 172.21.15.63:0/2680078035 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd9a800bc50 con 0x7fd9b8102c00 2023-12-12T11:48:18.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.630+0000 7fd99f7fe700 1 -- 172.21.15.63:0/2680078035 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9a801c630 con 0x7fd9b8102c00 2023-12-12T11:48:18.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.630+0000 7fd9bd095700 1 -- 172.21.15.63:0/2680078035 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b810d810 con 0x7fd9b8102c00 2023-12-12T11:48:18.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.630+0000 7fd9bd095700 1 -- 172.21.15.63:0/2680078035 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b810dd50 con 0x7fd9b8102c00 2023-12-12T11:48:18.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.631+0000 7fd9bd095700 1 -- 172.21.15.63:0/2680078035 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b80fff10 con 0x7fd9b8102c00 2023-12-12T11:48:18.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.632+0000 7fd99f7fe700 1 -- 172.21.15.63:0/2680078035 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fd9a8013420 con 0x7fd9b8102c00 2023-12-12T11:48:18.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.633+0000 7fd99f7fe700 1 --2- 172.21.15.63:0/2680078035 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fd9a0068f70 0x7fd9a006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:18.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.633+0000 7fd99f7fe700 1 -- 172.21.15.63:0/2680078035 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd9a8087d40 con 0x7fd9b8102c00 2023-12-12T11:48:18.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.633+0000 7fd9b659c700 1 --2- 172.21.15.63:0/2680078035 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fd9a0068f70 0x7fd9a006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:18.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.634+0000 7fd9b659c700 1 --2- 172.21.15.63:0/2680078035 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fd9a0068f70 0x7fd9a006b420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac006fd0 tx=0x7fd9ac008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:18.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.637+0000 7fd99f7fe700 1 -- 172.21.15.63:0/2680078035 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd9a8057fc0 con 0x7fd9b8102c00 2023-12-12T11:48:18.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.842+0000 7fd9bd095700 1 -- 172.21.15.63:0/2680078035 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9b804bb80 con 0x7fd9b8102c00 2023-12-12T11:48:18.845 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.843+0000 7fd99f7fe700 1 -- 172.21.15.63:0/2680078035 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11044 (secure 0 0 0) 0x7fd9a8057b50 con 0x7fd9b8102c00 2023-12-12T11:48:18.845 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:48:18.845 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":40,"fsid":"85e33c70-98e3-11ee-95a3-87774f69a715","created":"2023-12-12T11:43:06.421058+0000","modified":"2023-12-12T11:48:04.333096+0000","last_up_change":"2023-12-12T11:48:03.326525+0000","last_in_change":"2023-12-12T11:47:44.737839+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T11:46:58.373192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"6b09da78-38a4-46a4-bf22-b1d21103b497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2424092816},{"type":"v1","addr":"172.21.15.63:6803","nonce":2424092816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2424092816},{"type":"v1","addr":"172.21.15.63:6805","nonce":2424092816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2424092816},{"type":"v1","addr":"172.21.15.63:6809","nonce":2424092816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2424092816},{"type":"v1","addr":"172.21.15.63:6807","nonce":2424092816}]},"public_addr":"172.21.15.63:6803/2424092816","cluster_addr":"172.21.15.63:6805/2424092816","heartbeat_back_addr":"172.21.15.63:6809/2424092816","heartbeat_front_addr":"172.21.15.63:6807/2424092816","state":["exists","up"]},{"osd":1,"uuid":"b45154ac-c018-4aa6-89d4-f22bd94b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":1292346728},{"type":"v1","addr":"172.21.15.63:6811","nonce":1292346728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":1292346728},{"type":"v1","addr":"172.21.15.63:6813","nonce":1292346728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":1292346728},{"type":"v1","addr":"172.21.15.63:6817","nonce":1292346728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":1292346728},{"type":"v1","addr":"172.21.15.63:6815","nonce":1292346728}]},"public_addr":"172.21.15.63:6811/1292346728","cluster_addr":"172.21.15.63:6813/1292346728","heartbeat_back_addr":"172.21.15.63:6817/1292346728","heartbeat_front_addr":"172.21.15.63:6815/1292346728","state":["exists","up"]},{"osd":2,"uuid":"2fcdfc7f-334e-427a-8e1e-b95578c88db5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3760392553},{"type":"v1","addr":"172.21.15.63:6819","nonce":3760392553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":3760392553},{"type":"v1","addr":"172.21.15.63:6821","nonce":3760392553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":3760392553},{"type":"v1","addr":"172.21.15.63:6825","nonce":3760392553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":3760392553},{"type":"v1","addr":"172.21.15.63:6823","nonce":3760392553}]},"public_addr":"172.21.15.63:6819/3760392553","cluster_addr":"172.21.15.63:6821/3760392553","heartbeat_back_addr":"172.21.15.63:6825/3760392553","heartbeat_front_addr":"172.21.15.63:6823/3760392553","state":["exists","up"]},{"osd":3,"uuid":"79666eff-9c6a-4170-b1b6-9fee68b62865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":3547672003},{"type":"v1","addr":"172.21.15.93:6801","nonce":3547672003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":3547672003},{"type":"v1","addr":"172.21.15.93:6803","nonce":3547672003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":3547672003},{"type":"v1","addr":"172.21.15.93:6807","nonce":3547672003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":3547672003},{"type":"v1","addr":"172.21.15.93:6805","nonce":3547672003}]},"public_addr":"172.21.15.93:6801/3547672003","cluster_addr":"172.21.15.93:6803/3547672003","heartbeat_back_addr":"172.21.15.93:6807/3547672003","heartbeat_front_addr":"172.21.15.93:6805/3547672003","state":["exists","up"]},{"osd":4,"uuid":"af069a18-59ca-4e55-a09c-9d4be6e10cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":612058290},{"type":"v1","addr":"172.21.15.93:6809","nonce":612058290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":612058290},{"type":"v1","addr":"172.21.15.93:6811","nonce":612058290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":612058290},{"type":"v1","addr":"172.21.15.93:6815","nonce":612058290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":612058290},{"type":"v1","addr":"172.21.15.93:6813","nonce":612058290}]},"public_addr":"172.21.15.93:6809/612058290","cluster_addr":"172.21.15.93:6811/612058290","heartbeat_back_addr":"172.21.15.93:6815/612058290","heartbeat_front_addr":"172.21.15.93:6813/612058290","state":["exists","up"]},{"osd":5,"uuid":"66901eb6-442c-4808-a5d3-958fd4b8f18d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2174153230},{"type":"v1","addr":"172.21.15.93:6817","nonce":2174153230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2174153230},{"type":"v1","addr":"172.21.15.93:6819","nonce":2174153230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2174153230},{"type":"v1","addr":"172.21.15.93:6823","nonce":2174153230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2174153230},{"type":"v1","addr":"172.21.15.93:6821","nonce":2174153230}]},"public_addr":"172.21.15.93:6817/2174153230","cluster_addr":"172.21.15.93:6819/2174153230","heartbeat_back_addr":"172.21.15.93:6823/2174153230","heartbeat_front_addr":"172.21.15.93:6821/2174153230","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:46:08.420691+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:46:31.277938+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:46:54.903181+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:47:16.535347+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:47:38.988069+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:48:01.641629+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:6801/293571324":"2023-12-13T11:45:05.780140+0000","172.21.15.63:6800/293571324":"2023-12-13T11:45:05.780140+0000","172.21.15.63:0/1972560506":"2023-12-13T11:45:05.780140+0000","172.21.15.63:0/1443572827":"2023-12-13T11:45:05.780140+0000","172.21.15.63:0/2015988516":"2023-12-13T11:45:05.780140+0000","172.21.15.63:0/1601381023":"2023-12-13T11:44:08.715291+0000","172.21.15.63:0/545666177":"2023-12-13T11:44:08.715291+0000","172.21.15.63:6800/1972453923":"2023-12-13T11:43:38.661897+0000","172.21.15.63:6800/4048286824":"2023-12-13T11:44:08.715291+0000","172.21.15.63:6801/1972453923":"2023-12-13T11:43:38.661897+0000","172.21.15.63:0/90805296":"2023-12-13T11:43:38.661897+0000","172.21.15.63:6801/4048286824":"2023-12-13T11:44:08.715291+0000","172.21.15.63:0/2270429505":"2023-12-13T11:44:08.715291+0000","172.21.15.63:0/3524404486":"2023-12-13T11:43:38.661897+0000","172.21.15.63:0/1089809755":"2023-12-13T11:43:38.661897+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T11:48:18.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.845+0000 7fd9bd095700 1 -- 172.21.15.63:0/2680078035 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fd9a0068f70 msgr2=0x7fd9a006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:18.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.845+0000 7fd9bd095700 1 --2- 172.21.15.63:0/2680078035 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fd9a0068f70 0x7fd9a006b420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac006fd0 tx=0x7fd9ac008040 comp rx=0 tx=0).stop 2023-12-12T11:48:18.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.845+0000 7fd9bd095700 1 -- 172.21.15.63:0/2680078035 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9b8102c00 msgr2=0x7fd9b81136b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:18.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.845+0000 7fd9bd095700 1 --2- 172.21.15.63:0/2680078035 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9b8102c00 0x7fd9b81136b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8009360 tx=0x7fd9a8009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:18.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.845+0000 7fd9bd095700 1 -- 172.21.15.63:0/2680078035 shutdown_connections 2023-12-12T11:48:18.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.845+0000 7fd9bd095700 1 --2- 172.21.15.63:0/2680078035 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fd9a0068f70 0x7fd9a006b420 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:18.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.845+0000 7fd9bd095700 1 --2- 172.21.15.63:0/2680078035 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9b8102c00 0x7fd9b81136b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:18.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.845+0000 7fd9bd095700 1 --2- 172.21.15.63:0/2680078035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9b81035a0 0x7fd9b8113bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:18.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.845+0000 7fd9bd095700 1 -- 172.21.15.63:0/2680078035 >> 172.21.15.63:0/2680078035 conn(0x7fd9b80f8790 msgr2=0x7fd9b80fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:18.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.845+0000 7fd9bd095700 1 -- 172.21.15.63:0/2680078035 shutdown_connections 2023-12-12T11:48:18.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:18.845+0000 7fd9bd095700 1 -- 172.21.15.63:0/2680078035 wait complete. 2023-12-12T11:48:19.189 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:18 smithi063 ceph-mon[107117]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:19.189 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:18 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/2680078035' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-12T11:48:19.216 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-12-12T11:48:19.216 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph osd dump --format=json 2023-12-12T11:48:19.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:18 smithi093 ceph-mon[115914]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:19.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:18 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/2680078035' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-12T11:48:19.647 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:20.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.855+0000 7f449af19700 1 -- 172.21.15.63:0/3599959598 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f449406ffe0 msgr2=0x7f44940703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:20.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.855+0000 7f449af19700 1 --2- 172.21.15.63:0/3599959598 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f449406ffe0 0x7f44940703b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4488004970 tx=0x7f4488009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:20.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.855+0000 7f449af19700 1 -- 172.21.15.63:0/3599959598 shutdown_connections 2023-12-12T11:48:20.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.855+0000 7f449af19700 1 --2- 172.21.15.63:0/3599959598 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44940708f0 0x7f4494108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:20.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.855+0000 7f449af19700 1 --2- 172.21.15.63:0/3599959598 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f449406ffe0 0x7f44940703b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:20.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.855+0000 7f449af19700 1 -- 172.21.15.63:0/3599959598 >> 172.21.15.63:0/3599959598 conn(0x7f44940f8790 msgr2=0x7f44940faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:20.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.855+0000 7f449af19700 1 -- 172.21.15.63:0/3599959598 shutdown_connections 2023-12-12T11:48:20.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.855+0000 7f449af19700 1 -- 172.21.15.63:0/3599959598 wait complete. 2023-12-12T11:48:20.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.856+0000 7f449af19700 1 Processor -- start 2023-12-12T11:48:20.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.856+0000 7f449af19700 1 -- start start 2023-12-12T11:48:20.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.856+0000 7f449af19700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f449406ffe0 0x7f44941157f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:20.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.856+0000 7f449af19700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44940708f0 0x7f4494115d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:20.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.856+0000 7f449af19700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4494116380 con 0x7f449406ffe0 2023-12-12T11:48:20.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.856+0000 7f449af19700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449410f6b0 con 0x7f44940708f0 2023-12-12T11:48:20.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.857+0000 7f4498cb5700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f449406ffe0 0x7f44941157f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:20.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.857+0000 7f4498cb5700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f449406ffe0 0x7f44941157f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57012/0 (socket says 172.21.15.63:57012) 2023-12-12T11:48:20.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.857+0000 7f4498cb5700 1 -- 172.21.15.63:0/2064684532 learned_addr learned my addr 172.21.15.63:0/2064684532 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:48:20.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.857+0000 7f4493fff700 1 --2- 172.21.15.63:0/2064684532 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44940708f0 0x7f4494115d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:20.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.857+0000 7f4498cb5700 1 -- 172.21.15.63:0/2064684532 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44940708f0 msgr2=0x7f4494115d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:20.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.857+0000 7f4498cb5700 1 --2- 172.21.15.63:0/2064684532 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44940708f0 0x7f4494115d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:20.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.857+0000 7f4498cb5700 1 -- 172.21.15.63:0/2064684532 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4488005040 con 0x7f449406ffe0 2023-12-12T11:48:20.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.857+0000 7f4498cb5700 1 --2- 172.21.15.63:0/2064684532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f449406ffe0 0x7f44941157f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4488004f50 tx=0x7f4488009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:20.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.858+0000 7f44917fa700 1 -- 172.21.15.63:0/2064684532 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f448800e040 con 0x7f449406ffe0 2023-12-12T11:48:20.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.858+0000 7f44917fa700 1 -- 172.21.15.63:0/2064684532 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f448800bc10 con 0x7f449406ffe0 2023-12-12T11:48:20.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.858+0000 7f449af19700 1 -- 172.21.15.63:0/2064684532 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f449410f930 con 0x7f449406ffe0 2023-12-12T11:48:20.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.858+0000 7f44917fa700 1 -- 172.21.15.63:0/2064684532 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f448801c630 con 0x7f449406ffe0 2023-12-12T11:48:20.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.858+0000 7f449af19700 1 -- 172.21.15.63:0/2064684532 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f449410fe70 con 0x7f449406ffe0 2023-12-12T11:48:20.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.859+0000 7f449af19700 1 -- 172.21.15.63:0/2064684532 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44941065d0 con 0x7f449406ffe0 2023-12-12T11:48:20.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.860+0000 7f44917fa700 1 -- 172.21.15.63:0/2064684532 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f4488013420 con 0x7f449406ffe0 2023-12-12T11:48:20.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.861+0000 7f44917fa700 1 --2- 172.21.15.63:0/2064684532 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4484068f70 0x7f448406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:20.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.861+0000 7f44917fa700 1 -- 172.21.15.63:0/2064684532 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f4488087ec0 con 0x7f449406ffe0 2023-12-12T11:48:20.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.861+0000 7f4493fff700 1 --2- 172.21.15.63:0/2064684532 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4484068f70 0x7f448406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:20.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.862+0000 7f4493fff700 1 --2- 172.21.15.63:0/2064684532 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4484068f70 0x7f448406b420 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4494111020 tx=0x7f4480009ee0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:20.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:20.865+0000 7f44917fa700 1 -- 172.21.15.63:0/2064684532 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f44880580e0 con 0x7f449406ffe0 2023-12-12T11:48:21.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:21.071+0000 7f449af19700 1 -- 172.21.15.63:0/2064684532 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f449404bb80 con 0x7f449406ffe0 2023-12-12T11:48:21.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:21.072+0000 7f44917fa700 1 -- 172.21.15.63:0/2064684532 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11044 (secure 0 0 0) 0x7f4488013e60 con 0x7f449406ffe0 2023-12-12T11:48:21.075 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:48:21.075 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":40,"fsid":"85e33c70-98e3-11ee-95a3-87774f69a715","created":"2023-12-12T11:43:06.421058+0000","modified":"2023-12-12T11:48:04.333096+0000","last_up_change":"2023-12-12T11:48:03.326525+0000","last_in_change":"2023-12-12T11:47:44.737839+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T11:46:58.373192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"6b09da78-38a4-46a4-bf22-b1d21103b497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2424092816},{"type":"v1","addr":"172.21.15.63:6803","nonce":2424092816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2424092816},{"type":"v1","addr":"172.21.15.63:6805","nonce":2424092816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2424092816},{"type":"v1","addr":"172.21.15.63:6809","nonce":2424092816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2424092816},{"type":"v1","addr":"172.21.15.63:6807","nonce":2424092816}]},"public_addr":"172.21.15.63:6803/2424092816","cluster_addr":"172.21.15.63:6805/2424092816","heartbeat_back_addr":"172.21.15.63:6809/2424092816","heartbeat_front_addr":"172.21.15.63:6807/2424092816","state":["exists","up"]},{"osd":1,"uuid":"b45154ac-c018-4aa6-89d4-f22bd94b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":1292346728},{"type":"v1","addr":"172.21.15.63:6811","nonce":1292346728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":1292346728},{"type":"v1","addr":"172.21.15.63:6813","nonce":1292346728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":1292346728},{"type":"v1","addr":"172.21.15.63:6817","nonce":1292346728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":1292346728},{"type":"v1","addr":"172.21.15.63:6815","nonce":1292346728}]},"public_addr":"172.21.15.63:6811/1292346728","cluster_addr":"172.21.15.63:6813/1292346728","heartbeat_back_addr":"172.21.15.63:6817/1292346728","heartbeat_front_addr":"172.21.15.63:6815/1292346728","state":["exists","up"]},{"osd":2,"uuid":"2fcdfc7f-334e-427a-8e1e-b95578c88db5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3760392553},{"type":"v1","addr":"172.21.15.63:6819","nonce":3760392553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":3760392553},{"type":"v1","addr":"172.21.15.63:6821","nonce":3760392553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":3760392553},{"type":"v1","addr":"172.21.15.63:6825","nonce":3760392553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":3760392553},{"type":"v1","addr":"172.21.15.63:6823","nonce":3760392553}]},"public_addr":"172.21.15.63:6819/3760392553","cluster_addr":"172.21.15.63:6821/3760392553","heartbeat_back_addr":"172.21.15.63:6825/3760392553","heartbeat_front_addr":"172.21.15.63:6823/3760392553","state":["exists","up"]},{"osd":3,"uuid":"79666eff-9c6a-4170-b1b6-9fee68b62865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":3547672003},{"type":"v1","addr":"172.21.15.93:6801","nonce":3547672003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":3547672003},{"type":"v1","addr":"172.21.15.93:6803","nonce":3547672003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":3547672003},{"type":"v1","addr":"172.21.15.93:6807","nonce":3547672003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":3547672003},{"type":"v1","addr":"172.21.15.93:6805","nonce":3547672003}]},"public_addr":"172.21.15.93:6801/3547672003","cluster_addr":"172.21.15.93:6803/3547672003","heartbeat_back_addr":"172.21.15.93:6807/3547672003","heartbeat_front_addr":"172.21.15.93:6805/3547672003","state":["exists","up"]},{"osd":4,"uuid":"af069a18-59ca-4e55-a09c-9d4be6e10cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":612058290},{"type":"v1","addr":"172.21.15.93:6809","nonce":612058290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":612058290},{"type":"v1","addr":"172.21.15.93:6811","nonce":612058290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":612058290},{"type":"v1","addr":"172.21.15.93:6815","nonce":612058290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":612058290},{"type":"v1","addr":"172.21.15.93:6813","nonce":612058290}]},"public_addr":"172.21.15.93:6809/612058290","cluster_addr":"172.21.15.93:6811/612058290","heartbeat_back_addr":"172.21.15.93:6815/612058290","heartbeat_front_addr":"172.21.15.93:6813/612058290","state":["exists","up"]},{"osd":5,"uuid":"66901eb6-442c-4808-a5d3-958fd4b8f18d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2174153230},{"type":"v1","addr":"172.21.15.93:6817","nonce":2174153230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2174153230},{"type":"v1","addr":"172.21.15.93:6819","nonce":2174153230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2174153230},{"type":"v1","addr":"172.21.15.93:6823","nonce":2174153230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2174153230},{"type":"v1","addr":"172.21.15.93:6821","nonce":2174153230}]},"public_addr":"172.21.15.93:6817/2174153230","cluster_addr":"172.21.15.93:6819/2174153230","heartbeat_back_addr":"172.21.15.93:6823/2174153230","heartbeat_front_addr":"172.21.15.93:6821/2174153230","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:46:08.420691+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:46:31.277938+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:46:54.903181+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:47:16.535347+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:47:38.988069+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:48:01.641629+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:6801/293571324":"2023-12-13T11:45:05.780140+0000","172.21.15.63:6800/293571324":"2023-12-13T11:45:05.780140+0000","172.21.15.63:0/1972560506":"2023-12-13T11:45:05.780140+0000","172.21.15.63:0/1443572827":"2023-12-13T11:45:05.780140+0000","172.21.15.63:0/2015988516":"2023-12-13T11:45:05.780140+0000","172.21.15.63:0/1601381023":"2023-12-13T11:44:08.715291+0000","172.21.15.63:0/545666177":"2023-12-13T11:44:08.715291+0000","172.21.15.63:6800/1972453923":"2023-12-13T11:43:38.661897+0000","172.21.15.63:6800/4048286824":"2023-12-13T11:44:08.715291+0000","172.21.15.63:6801/1972453923":"2023-12-13T11:43:38.661897+0000","172.21.15.63:0/90805296":"2023-12-13T11:43:38.661897+0000","172.21.15.63:6801/4048286824":"2023-12-13T11:44:08.715291+0000","172.21.15.63:0/2270429505":"2023-12-13T11:44:08.715291+0000","172.21.15.63:0/3524404486":"2023-12-13T11:43:38.661897+0000","172.21.15.63:0/1089809755":"2023-12-13T11:43:38.661897+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T11:48:21.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:21.075+0000 7f449af19700 1 -- 172.21.15.63:0/2064684532 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4484068f70 msgr2=0x7f448406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:21.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:21.075+0000 7f449af19700 1 --2- 172.21.15.63:0/2064684532 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4484068f70 0x7f448406b420 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4494111020 tx=0x7f4480009ee0 comp rx=0 tx=0).stop 2023-12-12T11:48:21.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:21.075+0000 7f449af19700 1 -- 172.21.15.63:0/2064684532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f449406ffe0 msgr2=0x7f44941157f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:21.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:21.075+0000 7f449af19700 1 --2- 172.21.15.63:0/2064684532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f449406ffe0 0x7f44941157f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4488004f50 tx=0x7f4488009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:21.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:21.075+0000 7f449af19700 1 -- 172.21.15.63:0/2064684532 shutdown_connections 2023-12-12T11:48:21.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:21.075+0000 7f449af19700 1 --2- 172.21.15.63:0/2064684532 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4484068f70 0x7f448406b420 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:21.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:21.075+0000 7f449af19700 1 --2- 172.21.15.63:0/2064684532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f449406ffe0 0x7f44941157f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:21.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:21.075+0000 7f449af19700 1 --2- 172.21.15.63:0/2064684532 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44940708f0 0x7f4494115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:21.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:21.075+0000 7f449af19700 1 -- 172.21.15.63:0/2064684532 >> 172.21.15.63:0/2064684532 conn(0x7f44940f8790 msgr2=0x7f4494103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:21.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:21.075+0000 7f449af19700 1 -- 172.21.15.63:0/2064684532 shutdown_connections 2023-12-12T11:48:21.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:21.075+0000 7f449af19700 1 -- 172.21.15.63:0/2064684532 wait complete. 2023-12-12T11:48:21.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:20 smithi093 ceph-mon[115914]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:21.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:20 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:48:21.272 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:20 smithi063 ceph-mon[107117]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:21.273 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:20 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:48:21.456 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2023-12-12T11:48:21.457 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2023-12-12T11:48:21.457 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2023-12-12T11:48:21.458 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2023-12-12T11:48:21.458 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2023-12-12T11:48:21.459 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2023-12-12T11:48:22.151 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:22.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:21 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/2064684532' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-12T11:48:22.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:21 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/2064684532' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-12T11:48:22.561 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:23.120 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:23.142 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:22 smithi063 ceph-mon[107117]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:23.205 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:23.206 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:23.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:22 smithi093 ceph-mon[115914]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:23.702 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:23.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.794+0000 7f1c5bb3d700 1 -- 172.21.15.63:0/4001812462 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c54071c10 msgr2=0x7f1c5406ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:23.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.794+0000 7f1c5bb3d700 1 --2- 172.21.15.63:0/4001812462 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c54071c10 0x7f1c5406ffe0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1c50004970 tx=0x7f1c50009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:23.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.794+0000 7f1c5bb3d700 1 -- 172.21.15.63:0/4001812462 shutdown_connections 2023-12-12T11:48:23.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.794+0000 7f1c5bb3d700 1 --2- 172.21.15.63:0/4001812462 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c54070520 0x7f1c54070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:23.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.794+0000 7f1c5bb3d700 1 --2- 172.21.15.63:0/4001812462 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c54071c10 0x7f1c5406ffe0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:23.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.794+0000 7f1c5bb3d700 1 -- 172.21.15.63:0/4001812462 >> 172.21.15.63:0/4001812462 conn(0x7f1c540f8790 msgr2=0x7f1c540faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:23.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.794+0000 7f1c5bb3d700 1 -- 172.21.15.63:0/4001812462 shutdown_connections 2023-12-12T11:48:23.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.794+0000 7f1c5bb3d700 1 -- 172.21.15.63:0/4001812462 wait complete. 2023-12-12T11:48:23.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.795+0000 7f1c5bb3d700 1 Processor -- start 2023-12-12T11:48:23.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.795+0000 7f1c5bb3d700 1 -- start start 2023-12-12T11:48:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.796+0000 7f1c5bb3d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c54070520 0x7f1c54119ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.796+0000 7f1c5bb3d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c54071c10 0x7f1c5411a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.796+0000 7f1c5bb3d700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5411a870 con 0x7f1c54070520 2023-12-12T11:48:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.796+0000 7f1c5bb3d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c54113bc0 con 0x7f1c54071c10 2023-12-12T11:48:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.796+0000 7f1c590d8700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c54071c10 0x7f1c5411a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:23.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.796+0000 7f1c590d8700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c54071c10 0x7f1c5411a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:49300/0 (socket says 172.21.15.63:49300) 2023-12-12T11:48:23.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.796+0000 7f1c590d8700 1 -- 172.21.15.63:0/434647519 learned_addr learned my addr 172.21.15.63:0/434647519 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:48:23.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.796+0000 7f1c598d9700 1 --2- 172.21.15.63:0/434647519 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c54070520 0x7f1c54119ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:23.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.797+0000 7f1c590d8700 1 -- 172.21.15.63:0/434647519 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c54070520 msgr2=0x7f1c54119ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:23.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.797+0000 7f1c590d8700 1 --2- 172.21.15.63:0/434647519 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c54070520 0x7f1c54119ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:23.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.797+0000 7f1c590d8700 1 -- 172.21.15.63:0/434647519 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c50005040 con 0x7f1c54071c10 2023-12-12T11:48:23.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.797+0000 7f1c598d9700 1 --2- 172.21.15.63:0/434647519 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c54070520 0x7f1c54119ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T11:48:23.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.797+0000 7f1c590d8700 1 --2- 172.21.15.63:0/434647519 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c54071c10 0x7f1c5411a220 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1c44002a50 tx=0x7f1c440046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:23.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.798+0000 7f1c4a7fc700 1 -- 172.21.15.63:0/434647519 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c44007cc0 con 0x7f1c54071c10 2023-12-12T11:48:23.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.798+0000 7f1c4a7fc700 1 -- 172.21.15.63:0/434647519 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1c4400f040 con 0x7f1c54071c10 2023-12-12T11:48:23.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.798+0000 7f1c4a7fc700 1 -- 172.21.15.63:0/434647519 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c4400d9c0 con 0x7f1c54071c10 2023-12-12T11:48:23.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.799+0000 7f1c5bb3d700 1 -- 172.21.15.63:0/434647519 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c54113ea0 con 0x7f1c54071c10 2023-12-12T11:48:23.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.799+0000 7f1c5bb3d700 1 -- 172.21.15.63:0/434647519 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c541143b0 con 0x7f1c54071c10 2023-12-12T11:48:23.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.800+0000 7f1c5bb3d700 1 -- 172.21.15.63:0/434647519 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1c541148a0 con 0x7f1c54071c10 2023-12-12T11:48:23.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.801+0000 7f1c4a7fc700 1 -- 172.21.15.63:0/434647519 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f1c4400db20 con 0x7f1c54071c10 2023-12-12T11:48:23.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.802+0000 7f1c4a7fc700 1 --2- 172.21.15.63:0/434647519 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f1c40068f70 0x7f1c4006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:23.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.802+0000 7f1c4a7fc700 1 -- 172.21.15.63:0/434647519 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1c440860b0 con 0x7f1c54071c10 2023-12-12T11:48:23.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.802+0000 7f1c4a7fc700 1 --2- 172.21.15.63:0/434647519 >> [v2:172.21.15.93:6816/2174153230,v1:172.21.15.93:6817/2174153230] conn(0x7f1c4006ec40 0x7f1c40071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.802+0000 7f1c4a7fc700 1 -- 172.21.15.63:0/434647519 --> [v2:172.21.15.93:6816/2174153230,v1:172.21.15.93:6817/2174153230] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c40071700 con 0x7f1c4006ec40 2023-12-12T11:48:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.802+0000 7f1c4a7fc700 1 -- 172.21.15.63:0/434647519 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c44088600 con 0x7f1c54071c10 2023-12-12T11:48:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.802+0000 7f1c598d9700 1 --2- 172.21.15.63:0/434647519 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f1c40068f70 0x7f1c4006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.803+0000 7f1c5a0da700 1 --2- 172.21.15.63:0/434647519 >> [v2:172.21.15.93:6816/2174153230,v1:172.21.15.93:6817/2174153230] conn(0x7f1c4006ec40 0x7f1c40071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.803+0000 7f1c598d9700 1 --2- 172.21.15.63:0/434647519 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f1c40068f70 0x7f1c4006b420 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1c50004940 tx=0x7f1c50009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:23.806 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.804+0000 7f1c5a0da700 1 --2- 172.21.15.63:0/434647519 >> [v2:172.21.15.93:6816/2174153230,v1:172.21.15.93:6817/2174153230] conn(0x7f1c4006ec40 0x7f1c40071050 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:23.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.805+0000 7f1c4a7fc700 1 -- 172.21.15.63:0/434647519 <== osd.5 v2:172.21.15.93:6816/2174153230 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f1c40071700 con 0x7f1c4006ec40 2023-12-12T11:48:23.826 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.824+0000 7f1c5bb3d700 1 -- 172.21.15.63:0/434647519 --> [v2:172.21.15.93:6816/2174153230,v1:172.21.15.93:6817/2174153230] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1c54114a60 con 0x7f1c4006ec40 2023-12-12T11:48:23.827 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.825+0000 7f1c4a7fc700 1 -- 172.21.15.63:0/434647519 <== osd.5 v2:172.21.15.93:6816/2174153230 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f1c54114a60 con 0x7f1c4006ec40 2023-12-12T11:48:23.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.825+0000 7f1c5bb3d700 1 -- 172.21.15.63:0/434647519 >> [v2:172.21.15.93:6816/2174153230,v1:172.21.15.93:6817/2174153230] conn(0x7f1c4006ec40 msgr2=0x7f1c40071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:23.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.825+0000 7f1c5bb3d700 1 --2- 172.21.15.63:0/434647519 >> [v2:172.21.15.93:6816/2174153230,v1:172.21.15.93:6817/2174153230] conn(0x7f1c4006ec40 0x7f1c40071050 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:23.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.825+0000 7f1c5bb3d700 1 -- 172.21.15.63:0/434647519 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f1c40068f70 msgr2=0x7f1c4006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:23.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.825+0000 7f1c5bb3d700 1 --2- 172.21.15.63:0/434647519 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f1c40068f70 0x7f1c4006b420 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1c50004940 tx=0x7f1c50009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:23.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.825+0000 7f1c5bb3d700 1 -- 172.21.15.63:0/434647519 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c54071c10 msgr2=0x7f1c5411a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:23.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.825+0000 7f1c5bb3d700 1 --2- 172.21.15.63:0/434647519 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c54071c10 0x7f1c5411a220 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1c44002a50 tx=0x7f1c440046b0 comp rx=0 tx=0).stop 2023-12-12T11:48:23.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.825+0000 7f1c5bb3d700 1 -- 172.21.15.63:0/434647519 shutdown_connections 2023-12-12T11:48:23.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.825+0000 7f1c5bb3d700 1 --2- 172.21.15.63:0/434647519 >> [v2:172.21.15.93:6816/2174153230,v1:172.21.15.93:6817/2174153230] conn(0x7f1c4006ec40 0x7f1c40071050 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:23.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.825+0000 7f1c5bb3d700 1 --2- 172.21.15.63:0/434647519 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f1c40068f70 0x7f1c4006b420 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:23.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.825+0000 7f1c5bb3d700 1 --2- 172.21.15.63:0/434647519 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c54070520 0x7f1c54119ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:23.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.826+0000 7f1c5bb3d700 1 --2- 172.21.15.63:0/434647519 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c54071c10 0x7f1c5411a220 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:23.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.826+0000 7f1c5bb3d700 1 -- 172.21.15.63:0/434647519 >> 172.21.15.63:0/434647519 conn(0x7f1c540f8790 msgr2=0x7f1c540faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:23.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.826+0000 7f1c5bb3d700 1 -- 172.21.15.63:0/434647519 shutdown_connections 2023-12-12T11:48:23.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:23.826+0000 7f1c5bb3d700 1 -- 172.21.15.63:0/434647519 wait complete. 2023-12-12T11:48:24.944 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:24 smithi063 ceph-mon[107117]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:24.976 INFO:teuthology.orchestra.run.smithi063.stdout:167503724551 2023-12-12T11:48:24.976 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.5 2023-12-12T11:48:25.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:24 smithi093 ceph-mon[115914]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:25.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.608+0000 7f9037695700 1 -- 172.21.15.63:0/3294519187 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9030070520 msgr2=0x7f9030070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:25.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.608+0000 7f9037695700 1 --2- 172.21.15.63:0/3294519187 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9030070520 0x7f9030070990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9020004970 tx=0x7f9020009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:25.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.608+0000 7f9037695700 1 -- 172.21.15.63:0/3294519187 shutdown_connections 2023-12-12T11:48:25.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.608+0000 7f9037695700 1 --2- 172.21.15.63:0/3294519187 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9030070520 0x7f9030070990 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:25.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.608+0000 7f9037695700 1 --2- 172.21.15.63:0/3294519187 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9030071c10 0x7f903006ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:25.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.608+0000 7f9037695700 1 -- 172.21.15.63:0/3294519187 >> 172.21.15.63:0/3294519187 conn(0x7f90300f8790 msgr2=0x7f90300faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:25.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.609+0000 7f9037695700 1 -- 172.21.15.63:0/3294519187 shutdown_connections 2023-12-12T11:48:25.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.609+0000 7f9037695700 1 -- 172.21.15.63:0/3294519187 wait complete. 2023-12-12T11:48:25.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.609+0000 7f9037695700 1 Processor -- start 2023-12-12T11:48:25.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.610+0000 7f9037695700 1 -- start start 2023-12-12T11:48:25.613 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.610+0000 7f9037695700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9030070520 0x7f9030119c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:25.613 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.610+0000 7f9037695700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9030071c10 0x7f903011a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:25.613 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.610+0000 7f9037695700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903011a790 con 0x7f9030071c10 2023-12-12T11:48:25.613 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.610+0000 7f9037695700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9030113ac0 con 0x7f9030070520 2023-12-12T11:48:25.613 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.610+0000 7f9034c30700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9030071c10 0x7f903011a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:25.613 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.610+0000 7f9034c30700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9030071c10 0x7f903011a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57046/0 (socket says 172.21.15.63:57046) 2023-12-12T11:48:25.613 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.610+0000 7f9034c30700 1 -- 172.21.15.63:0/3181747580 learned_addr learned my addr 172.21.15.63:0/3181747580 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:48:25.614 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.610+0000 7f9035431700 1 --2- 172.21.15.63:0/3181747580 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9030070520 0x7f9030119c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:25.614 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.611+0000 7f9034c30700 1 -- 172.21.15.63:0/3181747580 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9030070520 msgr2=0x7f9030119c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:25.614 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.611+0000 7f9034c30700 1 --2- 172.21.15.63:0/3181747580 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9030070520 0x7f9030119c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:25.614 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.611+0000 7f9034c30700 1 -- 172.21.15.63:0/3181747580 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9020005040 con 0x7f9030071c10 2023-12-12T11:48:25.614 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.611+0000 7f9034c30700 1 --2- 172.21.15.63:0/3181747580 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9030071c10 0x7f903011a140 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9020004f50 tx=0x7f9020009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:25.614 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.611+0000 7f9025ffb700 1 -- 172.21.15.63:0/3181747580 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f902000e040 con 0x7f9030071c10 2023-12-12T11:48:25.615 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.611+0000 7f9037695700 1 -- 172.21.15.63:0/3181747580 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9030113d40 con 0x7f9030071c10 2023-12-12T11:48:25.615 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.611+0000 7f9025ffb700 1 -- 172.21.15.63:0/3181747580 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f902000bc10 con 0x7f9030071c10 2023-12-12T11:48:25.615 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.611+0000 7f9025ffb700 1 -- 172.21.15.63:0/3181747580 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f902001c630 con 0x7f9030071c10 2023-12-12T11:48:25.615 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.612+0000 7f9037695700 1 -- 172.21.15.63:0/3181747580 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9030114280 con 0x7f9030071c10 2023-12-12T11:48:25.615 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.612+0000 7f9037695700 1 -- 172.21.15.63:0/3181747580 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f90301147e0 con 0x7f9030071c10 2023-12-12T11:48:25.616 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.614+0000 7f9025ffb700 1 -- 172.21.15.63:0/3181747580 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f9020013960 con 0x7f9030071c10 2023-12-12T11:48:25.617 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.615+0000 7f9025ffb700 1 --2- 172.21.15.63:0/3181747580 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f901c068f70 0x7f901c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:25.617 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.615+0000 7f9025ffb700 1 -- 172.21.15.63:0/3181747580 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9020087e70 con 0x7f9030071c10 2023-12-12T11:48:25.617 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.615+0000 7f9035431700 1 --2- 172.21.15.63:0/3181747580 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f901c068f70 0x7f901c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:25.617 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.615+0000 7f9025ffb700 1 --2- 172.21.15.63:0/3181747580 >> [v2:172.21.15.93:6800/3547672003,v1:172.21.15.93:6801/3547672003] conn(0x7f901c06ec40 0x7f901c071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:25.617 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.615+0000 7f9025ffb700 1 -- 172.21.15.63:0/3181747580 --> [v2:172.21.15.93:6800/3547672003,v1:172.21.15.93:6801/3547672003] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f901c071700 con 0x7f901c06ec40 2023-12-12T11:48:25.617 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.615+0000 7f9025ffb700 1 -- 172.21.15.63:0/3181747580 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f902008d470 con 0x7f9030071c10 2023-12-12T11:48:25.617 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.615+0000 7f9035431700 1 --2- 172.21.15.63:0/3181747580 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f901c068f70 0x7f901c06b420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f902c004f40 tx=0x7f902c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:25.618 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.615+0000 7f9035c32700 1 --2- 172.21.15.63:0/3181747580 >> [v2:172.21.15.93:6800/3547672003,v1:172.21.15.93:6801/3547672003] conn(0x7f901c06ec40 0x7f901c071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:25.618 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.616+0000 7f9035c32700 1 --2- 172.21.15.63:0/3181747580 >> [v2:172.21.15.93:6800/3547672003,v1:172.21.15.93:6801/3547672003] conn(0x7f901c06ec40 0x7f901c071050 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:25.619 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.617+0000 7f9025ffb700 1 -- 172.21.15.63:0/3181747580 <== osd.3 v2:172.21.15.93:6800/3547672003 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f901c071700 con 0x7f901c06ec40 2023-12-12T11:48:25.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.633+0000 7f9037695700 1 -- 172.21.15.63:0/3181747580 --> [v2:172.21.15.93:6800/3547672003,v1:172.21.15.93:6801/3547672003] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f903005e340 con 0x7f901c06ec40 2023-12-12T11:48:25.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.634+0000 7f9025ffb700 1 -- 172.21.15.63:0/3181747580 <== osd.3 v2:172.21.15.93:6800/3547672003 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f903005e340 con 0x7f901c06ec40 2023-12-12T11:48:25.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.634+0000 7f9037695700 1 -- 172.21.15.63:0/3181747580 >> [v2:172.21.15.93:6800/3547672003,v1:172.21.15.93:6801/3547672003] conn(0x7f901c06ec40 msgr2=0x7f901c071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:25.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.634+0000 7f9037695700 1 --2- 172.21.15.63:0/3181747580 >> [v2:172.21.15.93:6800/3547672003,v1:172.21.15.93:6801/3547672003] conn(0x7f901c06ec40 0x7f901c071050 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:25.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.634+0000 7f9037695700 1 -- 172.21.15.63:0/3181747580 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f901c068f70 msgr2=0x7f901c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:25.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.634+0000 7f9037695700 1 --2- 172.21.15.63:0/3181747580 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f901c068f70 0x7f901c06b420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f902c004f40 tx=0x7f902c00b040 comp rx=0 tx=0).stop 2023-12-12T11:48:25.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.634+0000 7f9037695700 1 -- 172.21.15.63:0/3181747580 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9030071c10 msgr2=0x7f903011a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:25.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.634+0000 7f9037695700 1 --2- 172.21.15.63:0/3181747580 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9030071c10 0x7f903011a140 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9020004f50 tx=0x7f9020009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:25.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.635+0000 7f9037695700 1 -- 172.21.15.63:0/3181747580 shutdown_connections 2023-12-12T11:48:25.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.635+0000 7f9037695700 1 --2- 172.21.15.63:0/3181747580 >> [v2:172.21.15.93:6800/3547672003,v1:172.21.15.93:6801/3547672003] conn(0x7f901c06ec40 0x7f901c071050 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:25.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.635+0000 7f9037695700 1 --2- 172.21.15.63:0/3181747580 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9030070520 0x7f9030119c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:25.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.635+0000 7f9037695700 1 --2- 172.21.15.63:0/3181747580 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f901c068f70 0x7f901c06b420 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:25.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.635+0000 7f9037695700 1 --2- 172.21.15.63:0/3181747580 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9030071c10 0x7f903011a140 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:25.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.635+0000 7f9037695700 1 -- 172.21.15.63:0/3181747580 >> 172.21.15.63:0/3181747580 conn(0x7f90300f8790 msgr2=0x7f90300fa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:25.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.635+0000 7f9037695700 1 -- 172.21.15.63:0/3181747580 shutdown_connections 2023-12-12T11:48:25.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.635+0000 7f9037695700 1 -- 172.21.15.63:0/3181747580 wait complete. 2023-12-12T11:48:25.730 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.728+0000 7ff1209d8700 1 -- 172.21.15.63:0/2245410541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff11c065390 msgr2=0x7ff11c065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:25.731 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.728+0000 7ff1209d8700 1 --2- 172.21.15.63:0/2245410541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff11c065390 0x7ff11c065800 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff110004940 tx=0x7ff110009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:25.731 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.728+0000 7ff1209d8700 1 -- 172.21.15.63:0/2245410541 shutdown_connections 2023-12-12T11:48:25.731 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.728+0000 7ff1209d8700 1 --2- 172.21.15.63:0/2245410541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff11c065390 0x7ff11c065800 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:25.731 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.728+0000 7ff1209d8700 1 --2- 172.21.15.63:0/2245410541 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff11c102c20 0x7ff11c102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:25.731 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.728+0000 7ff1209d8700 1 -- 172.21.15.63:0/2245410541 >> 172.21.15.63:0/2245410541 conn(0x7ff11c0719b0 msgr2=0x7ff11c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:25.731 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.728+0000 7ff1209d8700 1 -- 172.21.15.63:0/2245410541 shutdown_connections 2023-12-12T11:48:25.731 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.728+0000 7ff1209d8700 1 -- 172.21.15.63:0/2245410541 wait complete. 2023-12-12T11:48:25.732 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.729+0000 7ff1209d8700 1 Processor -- start 2023-12-12T11:48:25.732 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.730+0000 7ff1209d8700 1 -- start start 2023-12-12T11:48:25.732 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.730+0000 7ff1209d8700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff11c065390 0x7ff11c0fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:25.732 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.730+0000 7ff1209d8700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff11c102c20 0x7ff11c0fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:25.732 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.730+0000 7ff1209d8700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c0fc730 con 0x7ff11c102c20 2023-12-12T11:48:25.732 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.730+0000 7ff1209d8700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c0fc8a0 con 0x7ff11c065390 2023-12-12T11:48:25.733 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.731+0000 7ff119d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff11c102c20 0x7ff11c0fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:25.733 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.731+0000 7ff119d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff11c102c20 0x7ff11c0fc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57072/0 (socket says 172.21.15.63:57072) 2023-12-12T11:48:25.733 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.731+0000 7ff119d9b700 1 -- 172.21.15.63:0/2058038879 learned_addr learned my addr 172.21.15.63:0/2058038879 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:48:25.733 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.731+0000 7ff11a59c700 1 --2- 172.21.15.63:0/2058038879 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff11c065390 0x7ff11c0fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:25.733 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.731+0000 7ff119d9b700 1 -- 172.21.15.63:0/2058038879 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff11c065390 msgr2=0x7ff11c0fbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:25.733 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.731+0000 7ff119d9b700 1 --2- 172.21.15.63:0/2058038879 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff11c065390 0x7ff11c0fbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:25.733 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.731+0000 7ff119d9b700 1 -- 172.21.15.63:0/2058038879 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10c005040 con 0x7ff11c102c20 2023-12-12T11:48:25.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.731+0000 7ff11a59c700 1 --2- 172.21.15.63:0/2058038879 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff11c065390 0x7ff11c0fbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T11:48:25.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.731+0000 7ff119d9b700 1 --2- 172.21.15.63:0/2058038879 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff11c102c20 0x7ff11c0fc130 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff110008d80 tx=0x7ff110009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:25.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.732+0000 7ff10affd700 1 -- 172.21.15.63:0/2058038879 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff11000e030 con 0x7ff11c102c20 2023-12-12T11:48:25.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.732+0000 7ff10affd700 1 -- 172.21.15.63:0/2058038879 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff110004290 con 0x7ff11c102c20 2023-12-12T11:48:25.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.732+0000 7ff10affd700 1 -- 172.21.15.63:0/2058038879 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff11001ce60 con 0x7ff11c102c20 2023-12-12T11:48:25.735 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.732+0000 7ff1209d8700 1 -- 172.21.15.63:0/2058038879 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff110005040 con 0x7ff11c102c20 2023-12-12T11:48:25.735 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.732+0000 7ff1209d8700 1 -- 172.21.15.63:0/2058038879 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff11c119af0 con 0x7ff11c102c20 2023-12-12T11:48:25.735 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.733+0000 7ff1209d8700 1 -- 172.21.15.63:0/2058038879 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff11c05e300 con 0x7ff11c102c20 2023-12-12T11:48:25.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.734+0000 7ff10affd700 1 -- 172.21.15.63:0/2058038879 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff11001c690 con 0x7ff11c102c20 2023-12-12T11:48:25.737 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.735+0000 7ff10affd700 1 --2- 172.21.15.63:0/2058038879 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff104068f70 0x7ff10406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:25.737 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.735+0000 7ff10affd700 1 -- 172.21.15.63:0/2058038879 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff1100884b0 con 0x7ff11c102c20 2023-12-12T11:48:25.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.735+0000 7ff11a59c700 1 --2- 172.21.15.63:0/2058038879 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff104068f70 0x7ff10406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:25.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.735+0000 7ff10affd700 1 --2- 172.21.15.63:0/2058038879 >> [v2:172.21.15.63:6818/3760392553,v1:172.21.15.63:6819/3760392553] conn(0x7ff10406ec40 0x7ff104071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:25.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.735+0000 7ff10affd700 1 -- 172.21.15.63:0/2058038879 --> [v2:172.21.15.63:6818/3760392553,v1:172.21.15.63:6819/3760392553] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff104071700 con 0x7ff10406ec40 2023-12-12T11:48:25.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.735+0000 7ff10affd700 1 -- 172.21.15.63:0/2058038879 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff11008aa00 con 0x7ff11c102c20 2023-12-12T11:48:25.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.736+0000 7ff11ad9d700 1 --2- 172.21.15.63:0/2058038879 >> [v2:172.21.15.63:6818/3760392553,v1:172.21.15.63:6819/3760392553] conn(0x7ff10406ec40 0x7ff104071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:25.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.736+0000 7ff11a59c700 1 --2- 172.21.15.63:0/2058038879 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff104068f70 0x7ff10406b420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff10c009fd0 tx=0x7ff10c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:25.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.736+0000 7ff11ad9d700 1 --2- 172.21.15.63:0/2058038879 >> [v2:172.21.15.63:6818/3760392553,v1:172.21.15.63:6819/3760392553] conn(0x7ff10406ec40 0x7ff104071050 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:25.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.738+0000 7ff10affd700 1 -- 172.21.15.63:0/2058038879 <== osd.2 v2:172.21.15.63:6818/3760392553 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7ff104071700 con 0x7ff10406ec40 2023-12-12T11:48:25.761 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.759+0000 7ff1209d8700 1 -- 172.21.15.63:0/2058038879 --> [v2:172.21.15.63:6818/3760392553,v1:172.21.15.63:6819/3760392553] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff11c05e730 con 0x7ff10406ec40 2023-12-12T11:48:25.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.760+0000 7ff10affd700 1 -- 172.21.15.63:0/2058038879 <== osd.2 v2:172.21.15.63:6818/3760392553 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff11c05e730 con 0x7ff10406ec40 2023-12-12T11:48:25.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.760+0000 7ff1209d8700 1 -- 172.21.15.63:0/2058038879 >> [v2:172.21.15.63:6818/3760392553,v1:172.21.15.63:6819/3760392553] conn(0x7ff10406ec40 msgr2=0x7ff104071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:25.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.760+0000 7ff1209d8700 1 --2- 172.21.15.63:0/2058038879 >> [v2:172.21.15.63:6818/3760392553,v1:172.21.15.63:6819/3760392553] conn(0x7ff10406ec40 0x7ff104071050 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:25.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.760+0000 7ff1209d8700 1 -- 172.21.15.63:0/2058038879 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff104068f70 msgr2=0x7ff10406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:25.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.760+0000 7ff1209d8700 1 --2- 172.21.15.63:0/2058038879 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff104068f70 0x7ff10406b420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff10c009fd0 tx=0x7ff10c009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:25.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.760+0000 7ff1209d8700 1 -- 172.21.15.63:0/2058038879 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff11c102c20 msgr2=0x7ff11c0fc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:25.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.760+0000 7ff1209d8700 1 --2- 172.21.15.63:0/2058038879 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff11c102c20 0x7ff11c0fc130 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff110008d80 tx=0x7ff110009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:25.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.761+0000 7ff1209d8700 1 -- 172.21.15.63:0/2058038879 shutdown_connections 2023-12-12T11:48:25.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.761+0000 7ff1209d8700 1 --2- 172.21.15.63:0/2058038879 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff11c065390 0x7ff11c0fbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:25.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.761+0000 7ff1209d8700 1 --2- 172.21.15.63:0/2058038879 >> [v2:172.21.15.63:6818/3760392553,v1:172.21.15.63:6819/3760392553] conn(0x7ff10406ec40 0x7ff104071050 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:25.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.761+0000 7ff1209d8700 1 --2- 172.21.15.63:0/2058038879 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff104068f70 0x7ff10406b420 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:25.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.761+0000 7ff1209d8700 1 --2- 172.21.15.63:0/2058038879 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff11c102c20 0x7ff11c0fc130 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:25.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.761+0000 7ff1209d8700 1 -- 172.21.15.63:0/2058038879 >> 172.21.15.63:0/2058038879 conn(0x7ff11c0719b0 msgr2=0x7ff11c0fab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:25.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.761+0000 7ff1209d8700 1 -- 172.21.15.63:0/2058038879 shutdown_connections 2023-12-12T11:48:25.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:25.761+0000 7ff1209d8700 1 -- 172.21.15.63:0/2058038879 wait complete. 2023-12-12T11:48:26.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.272+0000 7f6436365700 1 -- 172.21.15.63:0/1817786810 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6430101b00 msgr2=0x7f6430101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:26.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.272+0000 7f6436365700 1 --2- 172.21.15.63:0/1817786810 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6430101b00 0x7f6430101ed0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6420004880 tx=0x7f6420009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.272+0000 7f6436365700 1 -- 172.21.15.63:0/1817786810 shutdown_connections 2023-12-12T11:48:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.272+0000 7f6436365700 1 --2- 172.21.15.63:0/1817786810 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64300fbb40 0x7f64300fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.272+0000 7f6436365700 1 --2- 172.21.15.63:0/1817786810 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6430101b00 0x7f6430101ed0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.272+0000 7f6436365700 1 -- 172.21.15.63:0/1817786810 >> 172.21.15.63:0/1817786810 conn(0x7f64300719b0 msgr2=0x7f6430071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.272+0000 7f6436365700 1 -- 172.21.15.63:0/1817786810 shutdown_connections 2023-12-12T11:48:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.272+0000 7f6436365700 1 -- 172.21.15.63:0/1817786810 wait complete. 2023-12-12T11:48:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.273+0000 7f6436365700 1 Processor -- start 2023-12-12T11:48:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.274+0000 7f6436365700 1 -- start start 2023-12-12T11:48:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.274+0000 7f6436365700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64300fbb40 0x7f64301113e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.274+0000 7f6436365700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6430101b00 0x7f6430111920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.274+0000 7f6436365700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6430111f70 con 0x7f64300fbb40 2023-12-12T11:48:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.274+0000 7f6436365700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643010b280 con 0x7f6430101b00 2023-12-12T11:48:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.274+0000 7f642ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64300fbb40 0x7f64301113e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.274+0000 7f642ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64300fbb40 0x7f64301113e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57096/0 (socket says 172.21.15.63:57096) 2023-12-12T11:48:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.274+0000 7f642ffff700 1 -- 172.21.15.63:0/3690020550 learned_addr learned my addr 172.21.15.63:0/3690020550 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:48:26.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.275+0000 7f642f7fe700 1 --2- 172.21.15.63:0/3690020550 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6430101b00 0x7f6430111920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:26.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.275+0000 7f642ffff700 1 -- 172.21.15.63:0/3690020550 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6430101b00 msgr2=0x7f6430111920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:26.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.275+0000 7f642ffff700 1 --2- 172.21.15.63:0/3690020550 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6430101b00 0x7f6430111920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:26.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.275+0000 7f642ffff700 1 -- 172.21.15.63:0/3690020550 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6424005040 con 0x7f64300fbb40 2023-12-12T11:48:26.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.275+0000 7f642ffff700 1 --2- 172.21.15.63:0/3690020550 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64300fbb40 0x7f64301113e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f64200041d0 tx=0x7f6420009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:26.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.276+0000 7f642cff9700 1 -- 172.21.15.63:0/3690020550 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f642000e030 con 0x7f64300fbb40 2023-12-12T11:48:26.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.276+0000 7f6436365700 1 -- 172.21.15.63:0/3690020550 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6420005040 con 0x7f64300fbb40 2023-12-12T11:48:26.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.276+0000 7f642cff9700 1 -- 172.21.15.63:0/3690020550 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f642001c400 con 0x7f64300fbb40 2023-12-12T11:48:26.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.276+0000 7f642cff9700 1 -- 172.21.15.63:0/3690020550 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6420012600 con 0x7f64300fbb40 2023-12-12T11:48:26.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.276+0000 7f6436365700 1 -- 172.21.15.63:0/3690020550 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f643010b8b0 con 0x7f64300fbb40 2023-12-12T11:48:26.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.276+0000 7f6436365700 1 -- 172.21.15.63:0/3690020550 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f643010be50 con 0x7f64300fbb40 2023-12-12T11:48:26.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.279+0000 7f642cff9700 1 -- 172.21.15.63:0/3690020550 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f642001c570 con 0x7f64300fbb40 2023-12-12T11:48:26.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.280+0000 7f642cff9700 1 --2- 172.21.15.63:0/3690020550 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f641806b180 0x7f641806d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:26.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.280+0000 7f642cff9700 1 -- 172.21.15.63:0/3690020550 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6420088c00 con 0x7f64300fbb40 2023-12-12T11:48:26.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.280+0000 7f642f7fe700 1 --2- 172.21.15.63:0/3690020550 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f641806b180 0x7f641806d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:26.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.280+0000 7f642cff9700 1 --2- 172.21.15.63:0/3690020550 >> [v2:172.21.15.63:6810/1292346728,v1:172.21.15.63:6811/1292346728] conn(0x7f6418070e50 0x7f6418073260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:26.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.280+0000 7f642cff9700 1 -- 172.21.15.63:0/3690020550 --> [v2:172.21.15.63:6810/1292346728,v1:172.21.15.63:6811/1292346728] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6418073910 con 0x7f6418070e50 2023-12-12T11:48:26.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.280+0000 7f642cff9700 1 -- 172.21.15.63:0/3690020550 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6420088f40 con 0x7f64300fbb40 2023-12-12T11:48:26.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.281+0000 7f6434902700 1 --2- 172.21.15.63:0/3690020550 >> [v2:172.21.15.63:6810/1292346728,v1:172.21.15.63:6811/1292346728] conn(0x7f6418070e50 0x7f6418073260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:26.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.281+0000 7f642f7fe700 1 --2- 172.21.15.63:0/3690020550 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f641806b180 0x7f641806d630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f643010cc80 tx=0x7f642400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:26.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.281+0000 7f6434902700 1 --2- 172.21.15.63:0/3690020550 >> [v2:172.21.15.63:6810/1292346728,v1:172.21.15.63:6811/1292346728] conn(0x7f6418070e50 0x7f6418073260 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:26.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.282+0000 7f642cff9700 1 -- 172.21.15.63:0/3690020550 <== osd.1 v2:172.21.15.63:6810/1292346728 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f6418073910 con 0x7f6418070e50 2023-12-12T11:48:26.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.298+0000 7f6436365700 1 -- 172.21.15.63:0/3690020550 --> [v2:172.21.15.63:6810/1292346728,v1:172.21.15.63:6811/1292346728] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f64300734d0 con 0x7f6418070e50 2023-12-12T11:48:26.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.299+0000 7f642cff9700 1 -- 172.21.15.63:0/3690020550 <== osd.1 v2:172.21.15.63:6810/1292346728 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f64300734d0 con 0x7f6418070e50 2023-12-12T11:48:26.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.299+0000 7f6436365700 1 -- 172.21.15.63:0/3690020550 >> [v2:172.21.15.63:6810/1292346728,v1:172.21.15.63:6811/1292346728] conn(0x7f6418070e50 msgr2=0x7f6418073260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:26.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.299+0000 7f6436365700 1 --2- 172.21.15.63:0/3690020550 >> [v2:172.21.15.63:6810/1292346728,v1:172.21.15.63:6811/1292346728] conn(0x7f6418070e50 0x7f6418073260 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:26.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.299+0000 7f6436365700 1 -- 172.21.15.63:0/3690020550 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f641806b180 msgr2=0x7f641806d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:26.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.299+0000 7f6436365700 1 --2- 172.21.15.63:0/3690020550 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f641806b180 0x7f641806d630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f643010cc80 tx=0x7f642400b040 comp rx=0 tx=0).stop 2023-12-12T11:48:26.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.299+0000 7f6436365700 1 -- 172.21.15.63:0/3690020550 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64300fbb40 msgr2=0x7f64301113e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:26.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.299+0000 7f6436365700 1 --2- 172.21.15.63:0/3690020550 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64300fbb40 0x7f64301113e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f64200041d0 tx=0x7f6420009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:26.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.299+0000 7f6436365700 1 -- 172.21.15.63:0/3690020550 shutdown_connections 2023-12-12T11:48:26.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.299+0000 7f6436365700 1 --2- 172.21.15.63:0/3690020550 >> [v2:172.21.15.63:6810/1292346728,v1:172.21.15.63:6811/1292346728] conn(0x7f6418070e50 0x7f6418073260 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:26.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.299+0000 7f6436365700 1 --2- 172.21.15.63:0/3690020550 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f641806b180 0x7f641806d630 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:26.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.299+0000 7f6436365700 1 --2- 172.21.15.63:0/3690020550 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64300fbb40 0x7f64301113e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:26.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.299+0000 7f6436365700 1 --2- 172.21.15.63:0/3690020550 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6430101b00 0x7f6430111920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:26.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.299+0000 7f6436365700 1 -- 172.21.15.63:0/3690020550 >> 172.21.15.63:0/3690020550 conn(0x7f64300719b0 msgr2=0x7f64300faa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:26.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.300+0000 7f6436365700 1 -- 172.21.15.63:0/3690020550 shutdown_connections 2023-12-12T11:48:26.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.300+0000 7f6436365700 1 -- 172.21.15.63:0/3690020550 wait complete. 2023-12-12T11:48:26.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.309+0000 7f2992a3d700 1 -- 172.21.15.63:0/2572217644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f298c0fbb40 msgr2=0x7f298c0fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:26.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.309+0000 7f2992a3d700 1 --2- 172.21.15.63:0/2572217644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f298c0fbb40 0x7f298c0fbfb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2980004940 tx=0x7f2980009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:26.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.309+0000 7f2992a3d700 1 -- 172.21.15.63:0/2572217644 shutdown_connections 2023-12-12T11:48:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.309+0000 7f2992a3d700 1 --2- 172.21.15.63:0/2572217644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f298c0fbb40 0x7f298c0fbfb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.309+0000 7f2992a3d700 1 --2- 172.21.15.63:0/2572217644 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f298c101b00 0x7f298c101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.309+0000 7f2992a3d700 1 -- 172.21.15.63:0/2572217644 >> 172.21.15.63:0/2572217644 conn(0x7f298c0719b0 msgr2=0x7f298c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.309+0000 7f2992a3d700 1 -- 172.21.15.63:0/2572217644 shutdown_connections 2023-12-12T11:48:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.309+0000 7f2992a3d700 1 -- 172.21.15.63:0/2572217644 wait complete. 2023-12-12T11:48:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.310+0000 7f2992a3d700 1 Processor -- start 2023-12-12T11:48:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.310+0000 7f2992a3d700 1 -- start start 2023-12-12T11:48:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.311+0000 7f2992a3d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f298c0fbb40 0x7f298c1136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.311+0000 7f2992a3d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f298c101b00 0x7f298c113c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.311+0000 7f2992a3d700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c114290 con 0x7f298c0fbb40 2023-12-12T11:48:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.311+0000 7f2992a3d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c10d580 con 0x7f298c101b00 2023-12-12T11:48:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.311+0000 7f298bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f298c0fbb40 0x7f298c1136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.311+0000 7f298bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f298c0fbb40 0x7f298c1136c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57114/0 (socket says 172.21.15.63:57114) 2023-12-12T11:48:26.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.311+0000 7f298bfff700 1 -- 172.21.15.63:0/823674466 learned_addr learned my addr 172.21.15.63:0/823674466 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:48:26.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.311+0000 7f298b7fe700 1 --2- 172.21.15.63:0/823674466 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f298c101b00 0x7f298c113c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:26.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.312+0000 7f298bfff700 1 -- 172.21.15.63:0/823674466 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f298c101b00 msgr2=0x7f298c113c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:26.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.312+0000 7f298bfff700 1 --2- 172.21.15.63:0/823674466 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f298c101b00 0x7f298c113c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:26.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.312+0000 7f298bfff700 1 -- 172.21.15.63:0/823674466 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2980005040 con 0x7f298c0fbb40 2023-12-12T11:48:26.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.312+0000 7f298bfff700 1 --2- 172.21.15.63:0/823674466 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f298c0fbb40 0x7f298c1136c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f297c002a50 tx=0x7f297c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:26.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.312+0000 7f2988ff9700 1 -- 172.21.15.63:0/823674466 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f297c007cc0 con 0x7f298c0fbb40 2023-12-12T11:48:26.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.312+0000 7f2988ff9700 1 -- 172.21.15.63:0/823674466 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f297c00f040 con 0x7f298c0fbb40 2023-12-12T11:48:26.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.312+0000 7f2992a3d700 1 -- 172.21.15.63:0/823674466 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298c10d810 con 0x7f298c0fbb40 2023-12-12T11:48:26.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.312+0000 7f2988ff9700 1 -- 172.21.15.63:0/823674466 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f297c00d9c0 con 0x7f298c0fbb40 2023-12-12T11:48:26.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.312+0000 7f2992a3d700 1 -- 172.21.15.63:0/823674466 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f298c10dd50 con 0x7f298c0fbb40 2023-12-12T11:48:26.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.313+0000 7f2992a3d700 1 -- 172.21.15.63:0/823674466 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f298c10e1f0 con 0x7f298c0fbb40 2023-12-12T11:48:26.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.314+0000 7f2988ff9700 1 -- 172.21.15.63:0/823674466 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f297c00db20 con 0x7f298c0fbb40 2023-12-12T11:48:26.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.316+0000 7f2988ff9700 1 --2- 172.21.15.63:0/823674466 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f2974068f70 0x7f297406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:26.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.316+0000 7f2988ff9700 1 -- 172.21.15.63:0/823674466 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f297c087210 con 0x7f298c0fbb40 2023-12-12T11:48:26.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.316+0000 7f298b7fe700 1 --2- 172.21.15.63:0/823674466 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f2974068f70 0x7f297406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:26.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.316+0000 7f2988ff9700 1 --2- 172.21.15.63:0/823674466 >> [v2:172.21.15.63:6802/2424092816,v1:172.21.15.63:6803/2424092816] conn(0x7f297406ec40 0x7f2974071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:26.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.316+0000 7f2988ff9700 1 -- 172.21.15.63:0/823674466 --> [v2:172.21.15.63:6802/2424092816,v1:172.21.15.63:6803/2424092816] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2974071700 con 0x7f297406ec40 2023-12-12T11:48:26.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.316+0000 7f2988ff9700 1 -- 172.21.15.63:0/823674466 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f297c0875f0 con 0x7f298c0fbb40 2023-12-12T11:48:26.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.316+0000 7f2990fda700 1 --2- 172.21.15.63:0/823674466 >> [v2:172.21.15.63:6802/2424092816,v1:172.21.15.63:6803/2424092816] conn(0x7f297406ec40 0x7f2974071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:26.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.317+0000 7f298b7fe700 1 --2- 172.21.15.63:0/823674466 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f2974068f70 0x7f297406b420 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f298c10ef60 tx=0x7f2980009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:26.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.317+0000 7f2990fda700 1 --2- 172.21.15.63:0/823674466 >> [v2:172.21.15.63:6802/2424092816,v1:172.21.15.63:6803/2424092816] conn(0x7f297406ec40 0x7f2974071050 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:26.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.318+0000 7f2988ff9700 1 -- 172.21.15.63:0/823674466 <== osd.0 v2:172.21.15.63:6802/2424092816 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f2974071700 con 0x7f297406ec40 2023-12-12T11:48:26.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.334+0000 7f2992a3d700 1 -- 172.21.15.63:0/823674466 --> [v2:172.21.15.63:6802/2424092816,v1:172.21.15.63:6803/2424092816] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f298c0734d0 con 0x7f297406ec40 2023-12-12T11:48:26.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.334+0000 7f2988ff9700 1 -- 172.21.15.63:0/823674466 <== osd.0 v2:172.21.15.63:6802/2424092816 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f298c0734d0 con 0x7f297406ec40 2023-12-12T11:48:26.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.335+0000 7f2992a3d700 1 -- 172.21.15.63:0/823674466 >> [v2:172.21.15.63:6802/2424092816,v1:172.21.15.63:6803/2424092816] conn(0x7f297406ec40 msgr2=0x7f2974071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:26.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.335+0000 7f2992a3d700 1 --2- 172.21.15.63:0/823674466 >> [v2:172.21.15.63:6802/2424092816,v1:172.21.15.63:6803/2424092816] conn(0x7f297406ec40 0x7f2974071050 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:26.338 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.335+0000 7f2992a3d700 1 -- 172.21.15.63:0/823674466 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f2974068f70 msgr2=0x7f297406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:26.338 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.335+0000 7f2992a3d700 1 --2- 172.21.15.63:0/823674466 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f2974068f70 0x7f297406b420 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f298c10ef60 tx=0x7f2980009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:26.338 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.335+0000 7f2992a3d700 1 -- 172.21.15.63:0/823674466 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f298c0fbb40 msgr2=0x7f298c1136c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:26.338 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.335+0000 7f2992a3d700 1 --2- 172.21.15.63:0/823674466 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f298c0fbb40 0x7f298c1136c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f297c002a50 tx=0x7f297c0046b0 comp rx=0 tx=0).stop 2023-12-12T11:48:26.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.335+0000 7f2992a3d700 1 -- 172.21.15.63:0/823674466 shutdown_connections 2023-12-12T11:48:26.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.335+0000 7f2992a3d700 1 --2- 172.21.15.63:0/823674466 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f2974068f70 0x7f297406b420 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:26.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.335+0000 7f2992a3d700 1 --2- 172.21.15.63:0/823674466 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f298c0fbb40 0x7f298c1136c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:26.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.335+0000 7f2992a3d700 1 --2- 172.21.15.63:0/823674466 >> [v2:172.21.15.63:6802/2424092816,v1:172.21.15.63:6803/2424092816] conn(0x7f297406ec40 0x7f2974071050 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:26.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.335+0000 7f2992a3d700 1 --2- 172.21.15.63:0/823674466 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f298c101b00 0x7f298c113c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:26.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.335+0000 7f2992a3d700 1 -- 172.21.15.63:0/823674466 >> 172.21.15.63:0/823674466 conn(0x7f298c0719b0 msgr2=0x7f298c065550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:26.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.335+0000 7f2992a3d700 1 -- 172.21.15.63:0/823674466 shutdown_connections 2023-12-12T11:48:26.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:26.335+0000 7f2992a3d700 1 -- 172.21.15.63:0/823674466 wait complete. 2023-12-12T11:48:26.903 INFO:teuthology.orchestra.run.smithi063.stdout:111669149712 2023-12-12T11:48:26.903 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.3 2023-12-12T11:48:27.039 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:26 smithi063 ceph-mon[107117]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:27.066 INFO:teuthology.orchestra.run.smithi063.stdout:81604378645 2023-12-12T11:48:27.066 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.2 2023-12-12T11:48:27.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:26 smithi093 ceph-mon[115914]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:27.560 INFO:teuthology.orchestra.run.smithi063.stdout:60129542170 2023-12-12T11:48:27.561 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.1 2023-12-12T11:48:27.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.451+0000 7f29d9b5e700 1 -- 172.21.15.63:0/1227083344 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29d40fca30 msgr2=0x7f29d40fcea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:27.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.451+0000 7f29d9b5e700 1 --2- 172.21.15.63:0/1227083344 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29d40fca30 0x7f29d40fcea0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f29c0004940 tx=0x7f29c0009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:27.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.451+0000 7f29d9b5e700 1 -- 172.21.15.63:0/1227083344 shutdown_connections 2023-12-12T11:48:27.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.451+0000 7f29d9b5e700 1 --2- 172.21.15.63:0/1227083344 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29d40fca30 0x7f29d40fcea0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:27.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.451+0000 7f29d9b5e700 1 --2- 172.21.15.63:0/1227083344 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f29d4102a70 0x7f29d4102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:27.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.451+0000 7f29d9b5e700 1 -- 172.21.15.63:0/1227083344 >> 172.21.15.63:0/1227083344 conn(0x7f29d40f8590 msgr2=0x7f29d40fa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:27.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.451+0000 7f29d9b5e700 1 -- 172.21.15.63:0/1227083344 shutdown_connections 2023-12-12T11:48:27.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.451+0000 7f29d9b5e700 1 -- 172.21.15.63:0/1227083344 wait complete. 2023-12-12T11:48:27.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.452+0000 7f29d9b5e700 1 Processor -- start 2023-12-12T11:48:27.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.452+0000 7f29d9b5e700 1 -- start start 2023-12-12T11:48:27.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.453+0000 7f29d9b5e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29d40fca30 0x7f29d41133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:27.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.453+0000 7f29d9b5e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f29d4102a70 0x7f29d4113910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:27.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.453+0000 7f29d9b5e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d4113f60 con 0x7f29d40fca30 2023-12-12T11:48:27.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.453+0000 7f29d9b5e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d410d2b0 con 0x7f29d4102a70 2023-12-12T11:48:27.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.453+0000 7f29d8b5c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29d40fca30 0x7f29d41133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:27.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.453+0000 7f29d8b5c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29d40fca30 0x7f29d41133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57130/0 (socket says 172.21.15.63:57130) 2023-12-12T11:48:27.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.453+0000 7f29d8b5c700 1 -- 172.21.15.63:0/2655283702 learned_addr learned my addr 172.21.15.63:0/2655283702 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:48:27.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.453+0000 7f29d3fff700 1 --2- 172.21.15.63:0/2655283702 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f29d4102a70 0x7f29d4113910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:27.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.453+0000 7f29d8b5c700 1 -- 172.21.15.63:0/2655283702 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f29d4102a70 msgr2=0x7f29d4113910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:27.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.453+0000 7f29d8b5c700 1 --2- 172.21.15.63:0/2655283702 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f29d4102a70 0x7f29d4113910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:27.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.453+0000 7f29d8b5c700 1 -- 172.21.15.63:0/2655283702 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c0005040 con 0x7f29d40fca30 2023-12-12T11:48:27.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.453+0000 7f29d8b5c700 1 --2- 172.21.15.63:0/2655283702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29d40fca30 0x7f29d41133d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f29c8002a50 tx=0x7f29c80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:27.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.454+0000 7f29d17fa700 1 -- 172.21.15.63:0/2655283702 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29c8007cc0 con 0x7f29d40fca30 2023-12-12T11:48:27.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.454+0000 7f29d17fa700 1 -- 172.21.15.63:0/2655283702 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f29c800f040 con 0x7f29d40fca30 2023-12-12T11:48:27.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.454+0000 7f29d17fa700 1 -- 172.21.15.63:0/2655283702 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29c800d9c0 con 0x7f29d40fca30 2023-12-12T11:48:27.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.454+0000 7f29d9b5e700 1 -- 172.21.15.63:0/2655283702 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d410d590 con 0x7f29d40fca30 2023-12-12T11:48:27.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.454+0000 7f29d9b5e700 1 -- 172.21.15.63:0/2655283702 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d410db50 con 0x7f29d40fca30 2023-12-12T11:48:27.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.455+0000 7f29d9b5e700 1 -- 172.21.15.63:0/2655283702 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f29d410e0c0 con 0x7f29d40fca30 2023-12-12T11:48:27.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.456+0000 7f29d17fa700 1 -- 172.21.15.63:0/2655283702 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f29c800db20 con 0x7f29d40fca30 2023-12-12T11:48:27.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.457+0000 7f29d17fa700 1 --2- 172.21.15.63:0/2655283702 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f29c4068f60 0x7f29c406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:27.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.457+0000 7f29d17fa700 1 -- 172.21.15.63:0/2655283702 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f29c8086740 con 0x7f29d40fca30 2023-12-12T11:48:27.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.457+0000 7f29d17fa700 1 --2- 172.21.15.63:0/2655283702 >> [v2:172.21.15.93:6808/612058290,v1:172.21.15.93:6809/612058290] conn(0x7f29c406ec30 0x7f29c4071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:27.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.457+0000 7f29d3fff700 1 --2- 172.21.15.63:0/2655283702 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f29c4068f60 0x7f29c406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:27.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.457+0000 7f29d17fa700 1 -- 172.21.15.63:0/2655283702 --> [v2:172.21.15.93:6808/612058290,v1:172.21.15.93:6809/612058290] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f29c40716f0 con 0x7f29c406ec30 2023-12-12T11:48:27.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.457+0000 7f29d17fa700 1 -- 172.21.15.63:0/2655283702 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29c8088c90 con 0x7f29d40fca30 2023-12-12T11:48:27.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.457+0000 7f29d3fff700 1 --2- 172.21.15.63:0/2655283702 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f29c4068f60 0x7f29c406b410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f29c0004f90 tx=0x7f29c0009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:27.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.458+0000 7f29d935d700 1 --2- 172.21.15.63:0/2655283702 >> [v2:172.21.15.93:6808/612058290,v1:172.21.15.93:6809/612058290] conn(0x7f29c406ec30 0x7f29c4071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:27.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.458+0000 7f29d935d700 1 --2- 172.21.15.63:0/2655283702 >> [v2:172.21.15.93:6808/612058290,v1:172.21.15.93:6809/612058290] conn(0x7f29c406ec30 0x7f29c4071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:27.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.459+0000 7f29d17fa700 1 -- 172.21.15.63:0/2655283702 <== osd.4 v2:172.21.15.93:6808/612058290 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f29c40716f0 con 0x7f29c406ec30 2023-12-12T11:48:27.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.475+0000 7f29d9b5e700 1 -- 172.21.15.63:0/2655283702 --> [v2:172.21.15.93:6808/612058290,v1:172.21.15.93:6809/612058290] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f29d405e2f0 con 0x7f29c406ec30 2023-12-12T11:48:27.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.476+0000 7f29d17fa700 1 -- 172.21.15.63:0/2655283702 <== osd.4 v2:172.21.15.93:6808/612058290 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f29d405e2f0 con 0x7f29c406ec30 2023-12-12T11:48:27.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.476+0000 7f29d9b5e700 1 -- 172.21.15.63:0/2655283702 >> [v2:172.21.15.93:6808/612058290,v1:172.21.15.93:6809/612058290] conn(0x7f29c406ec30 msgr2=0x7f29c4071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:27.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.476+0000 7f29d9b5e700 1 --2- 172.21.15.63:0/2655283702 >> [v2:172.21.15.93:6808/612058290,v1:172.21.15.93:6809/612058290] conn(0x7f29c406ec30 0x7f29c4071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:27.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.476+0000 7f29d9b5e700 1 -- 172.21.15.63:0/2655283702 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f29c4068f60 msgr2=0x7f29c406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:27.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.476+0000 7f29d9b5e700 1 --2- 172.21.15.63:0/2655283702 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f29c4068f60 0x7f29c406b410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f29c0004f90 tx=0x7f29c0009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:27.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.476+0000 7f29d9b5e700 1 -- 172.21.15.63:0/2655283702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29d40fca30 msgr2=0x7f29d41133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:27.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.476+0000 7f29d9b5e700 1 --2- 172.21.15.63:0/2655283702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29d40fca30 0x7f29d41133d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f29c8002a50 tx=0x7f29c80046b0 comp rx=0 tx=0).stop 2023-12-12T11:48:27.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.476+0000 7f29d9b5e700 1 -- 172.21.15.63:0/2655283702 shutdown_connections 2023-12-12T11:48:27.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.476+0000 7f29d9b5e700 1 --2- 172.21.15.63:0/2655283702 >> [v2:172.21.15.93:6808/612058290,v1:172.21.15.93:6809/612058290] conn(0x7f29c406ec30 0x7f29c4071040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:27.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.476+0000 7f29d9b5e700 1 --2- 172.21.15.63:0/2655283702 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f29c4068f60 0x7f29c406b410 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:27.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.476+0000 7f29d9b5e700 1 --2- 172.21.15.63:0/2655283702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29d40fca30 0x7f29d41133d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:27.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.476+0000 7f29d9b5e700 1 --2- 172.21.15.63:0/2655283702 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f29d4102a70 0x7f29d4113910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:27.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.476+0000 7f29d9b5e700 1 -- 172.21.15.63:0/2655283702 >> 172.21.15.63:0/2655283702 conn(0x7f29d40f8590 msgr2=0x7f29d40fa020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:27.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.476+0000 7f29d9b5e700 1 -- 172.21.15.63:0/2655283702 shutdown_connections 2023-12-12T11:48:27.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:27.476+0000 7f29d9b5e700 1 -- 172.21.15.63:0/2655283702 wait complete. 2023-12-12T11:48:27.868 INFO:teuthology.orchestra.run.smithi063.stdout:38654705694 2023-12-12T11:48:27.868 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.0 2023-12-12T11:48:27.893 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:27.944 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:28.184 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:28.226 INFO:teuthology.orchestra.run.smithi063.stdout:146028888076 2023-12-12T11:48:28.227 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.4 2023-12-12T11:48:29.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:28 smithi063 ceph-mon[107117]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:29.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:28 smithi093 ceph-mon[115914]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:29.302 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:30.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.113+0000 7f1103385700 1 -- 172.21.15.63:0/3773599599 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10fc102c20 msgr2=0x7f10fc102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:30.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.113+0000 7f1103385700 1 --2- 172.21.15.63:0/3773599599 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10fc102c20 0x7f10fc102ff0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f10f8004940 tx=0x7f10f8009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:30.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.113+0000 7f1103385700 1 -- 172.21.15.63:0/3773599599 shutdown_connections 2023-12-12T11:48:30.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.113+0000 7f1103385700 1 --2- 172.21.15.63:0/3773599599 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10fc065390 0x7f10fc065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:30.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.113+0000 7f1103385700 1 --2- 172.21.15.63:0/3773599599 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10fc102c20 0x7f10fc102ff0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:30.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.113+0000 7f1103385700 1 -- 172.21.15.63:0/3773599599 >> 172.21.15.63:0/3773599599 conn(0x7f10fc0719b0 msgr2=0x7f10fc071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:30.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.113+0000 7f1103385700 1 -- 172.21.15.63:0/3773599599 shutdown_connections 2023-12-12T11:48:30.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.113+0000 7f1103385700 1 -- 172.21.15.63:0/3773599599 wait complete. 2023-12-12T11:48:30.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.114+0000 7f1103385700 1 Processor -- start 2023-12-12T11:48:30.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.114+0000 7f1103385700 1 -- start start 2023-12-12T11:48:30.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.115+0000 7f1103385700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10fc065390 0x7f10fc119c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:30.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.115+0000 7f1103385700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10fc102c20 0x7f10fc11a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:30.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.115+0000 7f1103385700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc11a820 con 0x7f10fc102c20 2023-12-12T11:48:30.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.115+0000 7f1103385700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc10b320 con 0x7f10fc065390 2023-12-12T11:48:30.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.115+0000 7f1100920700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10fc102c20 0x7f10fc11a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:30.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.115+0000 7f1100920700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10fc102c20 0x7f10fc11a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45768/0 (socket says 172.21.15.63:45768) 2023-12-12T11:48:30.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.115+0000 7f1100920700 1 -- 172.21.15.63:0/2040099473 learned_addr learned my addr 172.21.15.63:0/2040099473 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:48:30.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.115+0000 7f1101121700 1 --2- 172.21.15.63:0/2040099473 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10fc065390 0x7f10fc119c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:30.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.115+0000 7f1100920700 1 -- 172.21.15.63:0/2040099473 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10fc065390 msgr2=0x7f10fc119c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:30.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.115+0000 7f1100920700 1 --2- 172.21.15.63:0/2040099473 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10fc065390 0x7f10fc119c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:30.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.115+0000 7f1100920700 1 -- 172.21.15.63:0/2040099473 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f8005040 con 0x7f10fc102c20 2023-12-12T11:48:30.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.116+0000 7f1100920700 1 --2- 172.21.15.63:0/2040099473 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10fc102c20 0x7f10fc11a1d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f10ec002a50 tx=0x7f10ec0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:30.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.116+0000 7f10f1ffb700 1 -- 172.21.15.63:0/2040099473 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10ec007cc0 con 0x7f10fc102c20 2023-12-12T11:48:30.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.116+0000 7f10f1ffb700 1 -- 172.21.15.63:0/2040099473 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f10ec00f040 con 0x7f10fc102c20 2023-12-12T11:48:30.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.116+0000 7f1103385700 1 -- 172.21.15.63:0/2040099473 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10fc10b600 con 0x7f10fc102c20 2023-12-12T11:48:30.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.116+0000 7f10f1ffb700 1 -- 172.21.15.63:0/2040099473 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10ec00d9c0 con 0x7f10fc102c20 2023-12-12T11:48:30.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.116+0000 7f1103385700 1 -- 172.21.15.63:0/2040099473 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10fc10bb40 con 0x7f10fc102c20 2023-12-12T11:48:30.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.117+0000 7f1103385700 1 -- 172.21.15.63:0/2040099473 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10fc0734d0 con 0x7f10fc102c20 2023-12-12T11:48:30.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.118+0000 7f10f1ffb700 1 -- 172.21.15.63:0/2040099473 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f10ec00db20 con 0x7f10fc102c20 2023-12-12T11:48:30.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.119+0000 7f10f1ffb700 1 --2- 172.21.15.63:0/2040099473 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f10e8068f70 0x7f10e806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:30.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.119+0000 7f10f1ffb700 1 -- 172.21.15.63:0/2040099473 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f10ec086d80 con 0x7f10fc102c20 2023-12-12T11:48:30.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.119+0000 7f1101121700 1 --2- 172.21.15.63:0/2040099473 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f10e8068f70 0x7f10e806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:30.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.120+0000 7f1101121700 1 --2- 172.21.15.63:0/2040099473 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f10e8068f70 0x7f10e806b420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f10f80043d0 tx=0x7f10f8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:30.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.123+0000 7f10f1ffb700 1 -- 172.21.15.63:0/2040099473 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f10ec0570b0 con 0x7f10fc102c20 2023-12-12T11:48:30.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.315+0000 7f532d841700 1 -- 172.21.15.63:0/328303554 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5328071c10 msgr2=0x7f532806ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:30.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.315+0000 7f532d841700 1 --2- 172.21.15.63:0/328303554 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5328071c10 0x7f532806ffe0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5318004970 tx=0x7f5318009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:30.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.315+0000 7f532d841700 1 -- 172.21.15.63:0/328303554 shutdown_connections 2023-12-12T11:48:30.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.315+0000 7f532d841700 1 --2- 172.21.15.63:0/328303554 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5328070520 0x7f5328070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:30.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.315+0000 7f532d841700 1 --2- 172.21.15.63:0/328303554 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5328071c10 0x7f532806ffe0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:30.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.315+0000 7f532d841700 1 -- 172.21.15.63:0/328303554 >> 172.21.15.63:0/328303554 conn(0x7f53280f8790 msgr2=0x7f53280faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:30.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.315+0000 7f532d841700 1 -- 172.21.15.63:0/328303554 shutdown_connections 2023-12-12T11:48:30.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.315+0000 7f532d841700 1 -- 172.21.15.63:0/328303554 wait complete. 2023-12-12T11:48:30.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.316+0000 7f532d841700 1 Processor -- start 2023-12-12T11:48:30.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.316+0000 7f532d841700 1 -- start start 2023-12-12T11:48:30.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.316+0000 7f532d841700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5328070520 0x7f532806a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:30.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.317+0000 7f532d841700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5328071c10 0x7f532806ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:30.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.317+0000 7f532d841700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532806fb30 con 0x7f5328071c10 2023-12-12T11:48:30.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.317+0000 7f532d841700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532806fc70 con 0x7f5328070520 2023-12-12T11:48:30.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.317+0000 7f53267fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5328071c10 0x7f532806ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:30.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.317+0000 7f53267fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5328071c10 0x7f532806ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45786/0 (socket says 172.21.15.63:45786) 2023-12-12T11:48:30.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.317+0000 7f53267fc700 1 -- 172.21.15.63:0/2452192826 learned_addr learned my addr 172.21.15.63:0/2452192826 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:48:30.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.317+0000 7f5326ffd700 1 --2- 172.21.15.63:0/2452192826 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5328070520 0x7f532806a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:30.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.317+0000 7f53267fc700 1 -- 172.21.15.63:0/2452192826 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5328070520 msgr2=0x7f532806a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:30.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.317+0000 7f53267fc700 1 --2- 172.21.15.63:0/2452192826 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5328070520 0x7f532806a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:30.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.317+0000 7f53267fc700 1 -- 172.21.15.63:0/2452192826 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5318005040 con 0x7f5328071c10 2023-12-12T11:48:30.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.318+0000 7f53267fc700 1 --2- 172.21.15.63:0/2452192826 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5328071c10 0x7f532806ada0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f531c00eb40 tx=0x7f531c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:30.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.318+0000 7f530f7fe700 1 -- 172.21.15.63:0/2452192826 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f531c007cc0 con 0x7f5328071c10 2023-12-12T11:48:30.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.318+0000 7f530f7fe700 1 -- 172.21.15.63:0/2452192826 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f531c00f040 con 0x7f5328071c10 2023-12-12T11:48:30.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.318+0000 7f530f7fe700 1 -- 172.21.15.63:0/2452192826 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f531c00c990 con 0x7f5328071c10 2023-12-12T11:48:30.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.318+0000 7f532d841700 1 -- 172.21.15.63:0/2452192826 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f532806b3a0 con 0x7f5328071c10 2023-12-12T11:48:30.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.318+0000 7f532d841700 1 -- 172.21.15.63:0/2452192826 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5328126bb0 con 0x7f5328071c10 2023-12-12T11:48:30.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.319+0000 7f532d841700 1 -- 172.21.15.63:0/2452192826 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53280fe0b0 con 0x7f5328071c10 2023-12-12T11:48:30.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.320+0000 7f530f7fe700 1 -- 172.21.15.63:0/2452192826 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f531c00caf0 con 0x7f5328071c10 2023-12-12T11:48:30.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.321+0000 7f530f7fe700 1 --2- 172.21.15.63:0/2452192826 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f5310068f70 0x7f531006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:30.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.321+0000 7f530f7fe700 1 -- 172.21.15.63:0/2452192826 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f531c086850 con 0x7f5328071c10 2023-12-12T11:48:30.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.322+0000 7f5326ffd700 1 --2- 172.21.15.63:0/2452192826 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f5310068f70 0x7f531006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:30.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.323+0000 7f5326ffd700 1 --2- 172.21.15.63:0/2452192826 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f5310068f70 0x7f531006b420 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5318009fd0 tx=0x7f5318009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:30.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.329+0000 7f530f7fe700 1 -- 172.21.15.63:0/2452192826 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f531c0530f0 con 0x7f5328071c10 2023-12-12T11:48:30.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.356+0000 7f1103385700 1 -- 172.21.15.63:0/2040099473 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f10fc0fcc00 con 0x7f10fc102c20 2023-12-12T11:48:30.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.356+0000 7f10f1ffb700 1 -- 172.21.15.63:0/2040099473 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f10ec056c40 con 0x7f10fc102c20 2023-12-12T11:48:30.358 INFO:teuthology.orchestra.run.smithi063.stdout:81604378646 2023-12-12T11:48:30.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.358+0000 7f1103385700 1 -- 172.21.15.63:0/2040099473 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f10e8068f70 msgr2=0x7f10e806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:30.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.358+0000 7f1103385700 1 --2- 172.21.15.63:0/2040099473 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f10e8068f70 0x7f10e806b420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f10f80043d0 tx=0x7f10f8009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:30.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.358+0000 7f1103385700 1 -- 172.21.15.63:0/2040099473 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10fc102c20 msgr2=0x7f10fc11a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:30.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.358+0000 7f1103385700 1 --2- 172.21.15.63:0/2040099473 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10fc102c20 0x7f10fc11a1d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f10ec002a50 tx=0x7f10ec0046b0 comp rx=0 tx=0).stop 2023-12-12T11:48:30.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.359+0000 7f1103385700 1 -- 172.21.15.63:0/2040099473 shutdown_connections 2023-12-12T11:48:30.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.359+0000 7f1103385700 1 --2- 172.21.15.63:0/2040099473 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10fc065390 0x7f10fc119c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:30.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.359+0000 7f1103385700 1 --2- 172.21.15.63:0/2040099473 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f10e8068f70 0x7f10e806b420 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:30.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.359+0000 7f1103385700 1 --2- 172.21.15.63:0/2040099473 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10fc102c20 0x7f10fc11a1d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:30.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.359+0000 7f1103385700 1 -- 172.21.15.63:0/2040099473 >> 172.21.15.63:0/2040099473 conn(0x7f10fc0719b0 msgr2=0x7f10fc105980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:30.362 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.359+0000 7f1103385700 1 -- 172.21.15.63:0/2040099473 shutdown_connections 2023-12-12T11:48:30.362 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.359+0000 7f1103385700 1 -- 172.21.15.63:0/2040099473 wait complete. 2023-12-12T11:48:30.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.563+0000 7f532d841700 1 -- 172.21.15.63:0/2452192826 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f532804bb80 con 0x7f5328071c10 2023-12-12T11:48:30.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.563+0000 7f530f7fe700 1 -- 172.21.15.63:0/2452192826 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f531c056710 con 0x7f5328071c10 2023-12-12T11:48:30.566 INFO:teuthology.orchestra.run.smithi063.stdout:111669149713 2023-12-12T11:48:30.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.565+0000 7f532d841700 1 -- 172.21.15.63:0/2452192826 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f5310068f70 msgr2=0x7f531006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:30.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.565+0000 7f532d841700 1 --2- 172.21.15.63:0/2452192826 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f5310068f70 0x7f531006b420 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5318009fd0 tx=0x7f5318009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:30.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.565+0000 7f532d841700 1 -- 172.21.15.63:0/2452192826 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5328071c10 msgr2=0x7f532806ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:30.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.565+0000 7f532d841700 1 --2- 172.21.15.63:0/2452192826 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5328071c10 0x7f532806ada0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f531c00eb40 tx=0x7f531c00b040 comp rx=0 tx=0).stop 2023-12-12T11:48:30.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.566+0000 7f532d841700 1 -- 172.21.15.63:0/2452192826 shutdown_connections 2023-12-12T11:48:30.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.566+0000 7f532d841700 1 --2- 172.21.15.63:0/2452192826 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5328070520 0x7f532806a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:30.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.566+0000 7f532d841700 1 --2- 172.21.15.63:0/2452192826 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f5310068f70 0x7f531006b420 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:30.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.566+0000 7f532d841700 1 --2- 172.21.15.63:0/2452192826 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5328071c10 0x7f532806ada0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:30.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.566+0000 7f532d841700 1 -- 172.21.15.63:0/2452192826 >> 172.21.15.63:0/2452192826 conn(0x7f53280f8790 msgr2=0x7f53280faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:30.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.566+0000 7f532d841700 1 -- 172.21.15.63:0/2452192826 shutdown_connections 2023-12-12T11:48:30.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.566+0000 7f532d841700 1 -- 172.21.15.63:0/2452192826 wait complete. 2023-12-12T11:48:30.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.648+0000 7f5f5ad8c700 1 -- 172.21.15.63:0/755880258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f540708f0 msgr2=0x7f5f54108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:30.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.648+0000 7f5f5ad8c700 1 --2- 172.21.15.63:0/755880258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f540708f0 0x7f5f54108f10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5f40004970 tx=0x7f5f40009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:30.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.649+0000 7f5f5ad8c700 1 -- 172.21.15.63:0/755880258 shutdown_connections 2023-12-12T11:48:30.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.649+0000 7f5f5ad8c700 1 --2- 172.21.15.63:0/755880258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f540708f0 0x7f5f54108f10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:30.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.649+0000 7f5f5ad8c700 1 --2- 172.21.15.63:0/755880258 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f5406ffe0 0x7f5f540703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:30.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.649+0000 7f5f5ad8c700 1 -- 172.21.15.63:0/755880258 >> 172.21.15.63:0/755880258 conn(0x7f5f540f8790 msgr2=0x7f5f540faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:30.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.649+0000 7f5f5ad8c700 1 -- 172.21.15.63:0/755880258 shutdown_connections 2023-12-12T11:48:30.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.649+0000 7f5f5ad8c700 1 -- 172.21.15.63:0/755880258 wait complete. 2023-12-12T11:48:30.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.649+0000 7f5f5ad8c700 1 Processor -- start 2023-12-12T11:48:30.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.650+0000 7f5f5ad8c700 1 -- start start 2023-12-12T11:48:30.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.650+0000 7f5f5ad8c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f5406ffe0 0x7f5f54115810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:30.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.650+0000 7f5f5ad8c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f540708f0 0x7f5f54115d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:30.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.650+0000 7f5f5ad8c700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f541163a0 con 0x7f5f540708f0 2023-12-12T11:48:30.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.650+0000 7f5f5ad8c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5410f6d0 con 0x7f5f5406ffe0 2023-12-12T11:48:30.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.650+0000 7f5f53fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f540708f0 0x7f5f54115d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:30.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.650+0000 7f5f53fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f540708f0 0x7f5f54115d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45802/0 (socket says 172.21.15.63:45802) 2023-12-12T11:48:30.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.650+0000 7f5f53fff700 1 -- 172.21.15.63:0/3382923050 learned_addr learned my addr 172.21.15.63:0/3382923050 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:48:30.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.650+0000 7f5f58b28700 1 --2- 172.21.15.63:0/3382923050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f5406ffe0 0x7f5f54115810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:30.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.651+0000 7f5f53fff700 1 -- 172.21.15.63:0/3382923050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f5406ffe0 msgr2=0x7f5f54115810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:30.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.651+0000 7f5f53fff700 1 --2- 172.21.15.63:0/3382923050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f5406ffe0 0x7f5f54115810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:30.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.651+0000 7f5f53fff700 1 -- 172.21.15.63:0/3382923050 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f40005040 con 0x7f5f540708f0 2023-12-12T11:48:30.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.651+0000 7f5f53fff700 1 --2- 172.21.15.63:0/3382923050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f540708f0 0x7f5f54115d50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5f40004f50 tx=0x7f5f40009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:30.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.651+0000 7f5f517fa700 1 -- 172.21.15.63:0/3382923050 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f4000e040 con 0x7f5f540708f0 2023-12-12T11:48:30.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.651+0000 7f5f5ad8c700 1 -- 172.21.15.63:0/3382923050 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f5410f950 con 0x7f5f540708f0 2023-12-12T11:48:30.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.651+0000 7f5f517fa700 1 -- 172.21.15.63:0/3382923050 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5f40013420 con 0x7f5f540708f0 2023-12-12T11:48:30.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.651+0000 7f5f517fa700 1 -- 172.21.15.63:0/3382923050 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f4001c630 con 0x7f5f540708f0 2023-12-12T11:48:30.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.651+0000 7f5f5ad8c700 1 -- 172.21.15.63:0/3382923050 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f5410fe90 con 0x7f5f540708f0 2023-12-12T11:48:30.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.653+0000 7f5f5ad8c700 1 -- 172.21.15.63:0/3382923050 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f541065d0 con 0x7f5f540708f0 2023-12-12T11:48:30.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.654+0000 7f5f517fa700 1 -- 172.21.15.63:0/3382923050 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f5f40013a00 con 0x7f5f540708f0 2023-12-12T11:48:30.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.654+0000 7f5f517fa700 1 --2- 172.21.15.63:0/3382923050 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f5f44068f70 0x7f5f4406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:30.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.655+0000 7f5f517fa700 1 -- 172.21.15.63:0/3382923050 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5f40087c70 con 0x7f5f540708f0 2023-12-12T11:48:30.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.655+0000 7f5f58b28700 1 --2- 172.21.15.63:0/3382923050 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f5f44068f70 0x7f5f4406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:30.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.655+0000 7f5f58b28700 1 --2- 172.21.15.63:0/3382923050 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f5f44068f70 0x7f5f4406b420 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009fd0 tx=0x7f5f4800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:30.661 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.659+0000 7f5f517fa700 1 -- 172.21.15.63:0/3382923050 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5f40057fc0 con 0x7f5f540708f0 2023-12-12T11:48:30.686 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:30.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.890+0000 7f5f5ad8c700 1 -- 172.21.15.63:0/3382923050 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5f5410bdb0 con 0x7f5f540708f0 2023-12-12T11:48:30.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.891+0000 7f5f517fa700 1 -- 172.21.15.63:0/3382923050 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f40057b50 con 0x7f5f540708f0 2023-12-12T11:48:30.893 INFO:teuthology.orchestra.run.smithi063.stdout:167503724553 2023-12-12T11:48:30.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.893+0000 7f5f5ad8c700 1 -- 172.21.15.63:0/3382923050 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f5f44068f70 msgr2=0x7f5f4406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:30.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.893+0000 7f5f5ad8c700 1 --2- 172.21.15.63:0/3382923050 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f5f44068f70 0x7f5f4406b420 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009fd0 tx=0x7f5f4800b040 comp rx=0 tx=0).stop 2023-12-12T11:48:30.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.893+0000 7f5f5ad8c700 1 -- 172.21.15.63:0/3382923050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f540708f0 msgr2=0x7f5f54115d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:30.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.893+0000 7f5f5ad8c700 1 --2- 172.21.15.63:0/3382923050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f540708f0 0x7f5f54115d50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5f40004f50 tx=0x7f5f40009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:30.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.893+0000 7f5f5ad8c700 1 -- 172.21.15.63:0/3382923050 shutdown_connections 2023-12-12T11:48:30.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.893+0000 7f5f5ad8c700 1 --2- 172.21.15.63:0/3382923050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f5406ffe0 0x7f5f54115810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:30.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.893+0000 7f5f5ad8c700 1 --2- 172.21.15.63:0/3382923050 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f5f44068f70 0x7f5f4406b420 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:30.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.893+0000 7f5f5ad8c700 1 --2- 172.21.15.63:0/3382923050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f540708f0 0x7f5f54115d50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:30.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.893+0000 7f5f5ad8c700 1 -- 172.21.15.63:0/3382923050 >> 172.21.15.63:0/3382923050 conn(0x7f5f540f8790 msgr2=0x7f5f54103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:30.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.893+0000 7f5f5ad8c700 1 -- 172.21.15.63:0/3382923050 shutdown_connections 2023-12-12T11:48:30.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:30.893+0000 7f5f5ad8c700 1 -- 172.21.15.63:0/3382923050 wait complete. 2023-12-12T11:48:31.147 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:30 smithi063 ceph-mon[107117]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:31.147 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:30 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/2040099473' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-12T11:48:31.147 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:30 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/2452192826' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-12T11:48:31.147 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:30 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/3382923050' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-12T11:48:31.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:30 smithi093 ceph-mon[115914]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:31.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:30 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/2040099473' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-12T11:48:31.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:30 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/2452192826' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-12T11:48:31.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:30 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/3382923050' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-12T11:48:31.262 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:31.655 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149712 got 111669149713 for osd.3 2023-12-12T11:48:31.655 DEBUG:teuthology.parallel:result is None 2023-12-12T11:48:32.185 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.139+0000 7f56775d7700 1 -- 172.21.15.63:0/2449170953 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56701035a0 msgr2=0x7f56700fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:32.185 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.139+0000 7f56775d7700 1 --2- 172.21.15.63:0/2449170953 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56701035a0 0x7f56700fcc10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5660004940 tx=0x7f5660009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:32.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.139+0000 7f56775d7700 1 -- 172.21.15.63:0/2449170953 shutdown_connections 2023-12-12T11:48:32.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.139+0000 7f56775d7700 1 --2- 172.21.15.63:0/2449170953 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56701035a0 0x7f56700fcc10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:32.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.139+0000 7f56775d7700 1 --2- 172.21.15.63:0/2449170953 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5670102c00 0x7f5670102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:32.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.139+0000 7f56775d7700 1 -- 172.21.15.63:0/2449170953 >> 172.21.15.63:0/2449170953 conn(0x7f56700f8790 msgr2=0x7f56700faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:32.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.139+0000 7f56775d7700 1 -- 172.21.15.63:0/2449170953 shutdown_connections 2023-12-12T11:48:32.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.139+0000 7f56775d7700 1 -- 172.21.15.63:0/2449170953 wait complete. 2023-12-12T11:48:32.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.140+0000 7f56775d7700 1 Processor -- start 2023-12-12T11:48:32.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.140+0000 7f56775d7700 1 -- start start 2023-12-12T11:48:32.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.141+0000 7f56775d7700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5670102c00 0x7f5670115830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:32.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.141+0000 7f56775d7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56701035a0 0x7f5670115d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:32.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.141+0000 7f56775d7700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56701163c0 con 0x7f56701035a0 2023-12-12T11:48:32.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.141+0000 7f56775d7700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567010f6f0 con 0x7f5670102c00 2023-12-12T11:48:32.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.141+0000 7f5674b72700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56701035a0 0x7f5670115d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:32.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.141+0000 7f5674b72700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56701035a0 0x7f5670115d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45814/0 (socket says 172.21.15.63:45814) 2023-12-12T11:48:32.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.141+0000 7f5674b72700 1 -- 172.21.15.63:0/3974066853 learned_addr learned my addr 172.21.15.63:0/3974066853 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:48:32.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.141+0000 7f5674b72700 1 -- 172.21.15.63:0/3974066853 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5670102c00 msgr2=0x7f5670115830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:32.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.141+0000 7f5674b72700 1 --2- 172.21.15.63:0/3974066853 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5670102c00 0x7f5670115830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:32.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.141+0000 7f5674b72700 1 -- 172.21.15.63:0/3974066853 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5660005040 con 0x7f56701035a0 2023-12-12T11:48:32.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.141+0000 7f5674b72700 1 --2- 172.21.15.63:0/3974066853 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56701035a0 0x7f5670115d70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5660009380 tx=0x7f5660009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:32.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.142+0000 7f5665ffb700 1 -- 172.21.15.63:0/3974066853 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f566000e040 con 0x7f56701035a0 2023-12-12T11:48:32.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.142+0000 7f56775d7700 1 -- 172.21.15.63:0/3974066853 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f567010f970 con 0x7f56701035a0 2023-12-12T11:48:32.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.142+0000 7f5665ffb700 1 -- 172.21.15.63:0/3974066853 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f566000bc50 con 0x7f56701035a0 2023-12-12T11:48:32.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.142+0000 7f5665ffb700 1 -- 172.21.15.63:0/3974066853 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f566001c3f0 con 0x7f56701035a0 2023-12-12T11:48:32.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.142+0000 7f56775d7700 1 -- 172.21.15.63:0/3974066853 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f567010feb0 con 0x7f56701035a0 2023-12-12T11:48:32.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.143+0000 7f56775d7700 1 -- 172.21.15.63:0/3974066853 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56700fc390 con 0x7f56701035a0 2023-12-12T11:48:32.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.144+0000 7f5665ffb700 1 -- 172.21.15.63:0/3974066853 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f5660013420 con 0x7f56701035a0 2023-12-12T11:48:32.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.145+0000 7f5665ffb700 1 --2- 172.21.15.63:0/3974066853 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f565c068f60 0x7f565c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:32.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.145+0000 7f5665ffb700 1 -- 172.21.15.63:0/3974066853 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5660087eb0 con 0x7f56701035a0 2023-12-12T11:48:32.188 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.145+0000 7f5675373700 1 --2- 172.21.15.63:0/3974066853 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f565c068f60 0x7f565c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:32.188 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.146+0000 7f5675373700 1 --2- 172.21.15.63:0/3974066853 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f565c068f60 0x7f565c06b410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f566c004d00 tx=0x7f566c009ce0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:32.188 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.150+0000 7f5665ffb700 1 -- 172.21.15.63:0/3974066853 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f56600580b0 con 0x7f56701035a0 2023-12-12T11:48:32.246 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724551 got 167503724553 for osd.5 2023-12-12T11:48:32.246 DEBUG:teuthology.parallel:result is None 2023-12-12T11:48:32.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.367+0000 7f56775d7700 1 -- 172.21.15.63:0/3974066853 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f567004bb80 con 0x7f56701035a0 2023-12-12T11:48:32.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.368+0000 7f5665ffb700 1 -- 172.21.15.63:0/3974066853 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5660057c40 con 0x7f56701035a0 2023-12-12T11:48:32.370 INFO:teuthology.orchestra.run.smithi063.stdout:60129542171 2023-12-12T11:48:32.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.370+0000 7f56775d7700 1 -- 172.21.15.63:0/3974066853 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f565c068f60 msgr2=0x7f565c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:32.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.370+0000 7f56775d7700 1 --2- 172.21.15.63:0/3974066853 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f565c068f60 0x7f565c06b410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f566c004d00 tx=0x7f566c009ce0 comp rx=0 tx=0).stop 2023-12-12T11:48:32.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.370+0000 7f56775d7700 1 -- 172.21.15.63:0/3974066853 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56701035a0 msgr2=0x7f5670115d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:32.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.370+0000 7f56775d7700 1 --2- 172.21.15.63:0/3974066853 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56701035a0 0x7f5670115d70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5660009380 tx=0x7f5660009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:32.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.370+0000 7f56775d7700 1 -- 172.21.15.63:0/3974066853 shutdown_connections 2023-12-12T11:48:32.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.370+0000 7f56775d7700 1 --2- 172.21.15.63:0/3974066853 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5670102c00 0x7f5670115830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:32.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.370+0000 7f56775d7700 1 --2- 172.21.15.63:0/3974066853 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f565c068f60 0x7f565c06b410 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:32.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.370+0000 7f56775d7700 1 --2- 172.21.15.63:0/3974066853 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56701035a0 0x7f5670115d70 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:32.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.370+0000 7f56775d7700 1 -- 172.21.15.63:0/3974066853 >> 172.21.15.63:0/3974066853 conn(0x7f56700f8790 msgr2=0x7f56700fa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:32.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.370+0000 7f56775d7700 1 -- 172.21.15.63:0/3974066853 shutdown_connections 2023-12-12T11:48:32.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:32.370+0000 7f56775d7700 1 -- 172.21.15.63:0/3974066853 wait complete. 2023-12-12T11:48:32.569 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378645 got 81604378646 for osd.2 2023-12-12T11:48:32.569 DEBUG:teuthology.parallel:result is None 2023-12-12T11:48:32.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:32 smithi063 ceph-mon[107117]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:32.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:32 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/3974066853' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-12T11:48:32.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:32 smithi093 ceph-mon[115914]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:32.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:32 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/3974066853' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-12T11:48:33.198 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542170 got 60129542171 for osd.1 2023-12-12T11:48:33.198 DEBUG:teuthology.parallel:result is None 2023-12-12T11:48:33.587 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.584+0000 7f706e28a700 1 -- 172.21.15.63:0/1180931018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70680fb950 msgr2=0x7f70680fbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:33.587 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.584+0000 7f706e28a700 1 --2- 172.21.15.63:0/1180931018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70680fb950 0x7f70680fbd20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7058004940 tx=0x7f7058009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:33.587 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.585+0000 7f706e28a700 1 -- 172.21.15.63:0/1180931018 shutdown_connections 2023-12-12T11:48:33.587 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.585+0000 7f706e28a700 1 --2- 172.21.15.63:0/1180931018 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f70680fc260 0x7f7068108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:33.587 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.585+0000 7f706e28a700 1 --2- 172.21.15.63:0/1180931018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70680fb950 0x7f70680fbd20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:33.587 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.585+0000 7f706e28a700 1 -- 172.21.15.63:0/1180931018 >> 172.21.15.63:0/1180931018 conn(0x7f70680f7680 msgr2=0x7f70680f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:33.588 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.585+0000 7f706e28a700 1 -- 172.21.15.63:0/1180931018 shutdown_connections 2023-12-12T11:48:33.588 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.585+0000 7f706e28a700 1 -- 172.21.15.63:0/1180931018 wait complete. 2023-12-12T11:48:33.589 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.585+0000 7f706e28a700 1 Processor -- start 2023-12-12T11:48:33.589 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.586+0000 7f706e28a700 1 -- start start 2023-12-12T11:48:33.589 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.586+0000 7f706e28a700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f70680fb950 0x7f70681157d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:33.589 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.586+0000 7f706e28a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70680fc260 0x7f7068115d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:33.589 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.586+0000 7f706e28a700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7068116360 con 0x7f70680fc260 2023-12-12T11:48:33.589 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.586+0000 7f706e28a700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706810f690 con 0x7f70680fb950 2023-12-12T11:48:33.589 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.586+0000 7f70677fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70680fc260 0x7f7068115d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:33.589 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.586+0000 7f70677fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70680fc260 0x7f7068115d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45822/0 (socket says 172.21.15.63:45822) 2023-12-12T11:48:33.589 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.586+0000 7f70677fe700 1 -- 172.21.15.63:0/2173078979 learned_addr learned my addr 172.21.15.63:0/2173078979 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:48:33.589 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.587+0000 7f7067fff700 1 --2- 172.21.15.63:0/2173078979 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f70680fb950 0x7f70681157d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:33.590 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.587+0000 7f70677fe700 1 -- 172.21.15.63:0/2173078979 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f70680fb950 msgr2=0x7f70681157d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:33.590 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.587+0000 7f70677fe700 1 --2- 172.21.15.63:0/2173078979 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f70680fb950 0x7f70681157d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:33.590 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.587+0000 7f70677fe700 1 -- 172.21.15.63:0/2173078979 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7058005040 con 0x7f70680fc260 2023-12-12T11:48:33.590 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.587+0000 7f70677fe700 1 --2- 172.21.15.63:0/2173078979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70680fc260 0x7f7068115d10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f705c002a50 tx=0x7f705c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:33.590 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.587+0000 7f7064ff9700 1 -- 172.21.15.63:0/2173078979 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f705c007cc0 con 0x7f70680fc260 2023-12-12T11:48:33.590 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.587+0000 7f7064ff9700 1 -- 172.21.15.63:0/2173078979 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f705c00f040 con 0x7f70680fc260 2023-12-12T11:48:33.591 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.587+0000 7f706e28a700 1 -- 172.21.15.63:0/2173078979 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f706810f970 con 0x7f70680fc260 2023-12-12T11:48:33.591 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.587+0000 7f7064ff9700 1 -- 172.21.15.63:0/2173078979 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f705c009540 con 0x7f70680fc260 2023-12-12T11:48:33.591 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.587+0000 7f706e28a700 1 -- 172.21.15.63:0/2173078979 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f706810feb0 con 0x7f70680fc260 2023-12-12T11:48:33.591 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.589+0000 7f706e28a700 1 -- 172.21.15.63:0/2173078979 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70681066f0 con 0x7f70680fc260 2023-12-12T11:48:33.591 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.589+0000 7f7064ff9700 1 -- 172.21.15.63:0/2173078979 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f705c0096a0 con 0x7f70680fc260 2023-12-12T11:48:33.594 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.591+0000 7f7064ff9700 1 --2- 172.21.15.63:0/2173078979 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f7050068f70 0x7f705006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:33.594 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.591+0000 7f7064ff9700 1 -- 172.21.15.63:0/2173078979 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f705c086780 con 0x7f70680fc260 2023-12-12T11:48:33.594 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.591+0000 7f7067fff700 1 --2- 172.21.15.63:0/2173078979 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f7050068f70 0x7f705006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:33.594 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.592+0000 7f7067fff700 1 --2- 172.21.15.63:0/2173078979 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f7050068f70 0x7f705006b420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f705800b840 tx=0x7f7058009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:33.596 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.594+0000 7f7064ff9700 1 -- 172.21.15.63:0/2173078979 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f705c056a20 con 0x7f70680fc260 2023-12-12T11:48:33.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.688+0000 7fbb48b0f700 1 -- 172.21.15.63:0/3887029003 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb44103590 msgr2=0x7fbb440fcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:33.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.688+0000 7fbb48b0f700 1 --2- 172.21.15.63:0/3887029003 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb44103590 0x7fbb440fcc00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbb38004940 tx=0x7fbb38009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:33.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.688+0000 7fbb48b0f700 1 -- 172.21.15.63:0/3887029003 shutdown_connections 2023-12-12T11:48:33.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.688+0000 7fbb48b0f700 1 --2- 172.21.15.63:0/3887029003 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb44103590 0x7fbb440fcc00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:33.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.688+0000 7fbb48b0f700 1 --2- 172.21.15.63:0/3887029003 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb44102bf0 0x7fbb44102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:33.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.688+0000 7fbb48b0f700 1 -- 172.21.15.63:0/3887029003 >> 172.21.15.63:0/3887029003 conn(0x7fbb440f87a0 msgr2=0x7fbb440fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:33.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.688+0000 7fbb48b0f700 1 -- 172.21.15.63:0/3887029003 shutdown_connections 2023-12-12T11:48:33.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.688+0000 7fbb48b0f700 1 -- 172.21.15.63:0/3887029003 wait complete. 2023-12-12T11:48:33.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.689+0000 7fbb48b0f700 1 Processor -- start 2023-12-12T11:48:33.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.689+0000 7fbb48b0f700 1 -- start start 2023-12-12T11:48:33.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.689+0000 7fbb48b0f700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb44102bf0 0x7fbb441157f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:33.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.689+0000 7fbb48b0f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb44103590 0x7fbb44115d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:33.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.690+0000 7fbb48b0f700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb44116380 con 0x7fbb44103590 2023-12-12T11:48:33.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.690+0000 7fbb48b0f700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4410f6b0 con 0x7fbb44102bf0 2023-12-12T11:48:33.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.690+0000 7fbb41d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb44103590 0x7fbb44115d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:33.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.690+0000 7fbb41d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb44103590 0x7fbb44115d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45840/0 (socket says 172.21.15.63:45840) 2023-12-12T11:48:33.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.690+0000 7fbb41d9b700 1 -- 172.21.15.63:0/2514343623 learned_addr learned my addr 172.21.15.63:0/2514343623 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:48:33.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.690+0000 7fbb4259c700 1 --2- 172.21.15.63:0/2514343623 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb44102bf0 0x7fbb441157f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:33.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.690+0000 7fbb41d9b700 1 -- 172.21.15.63:0/2514343623 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb44102bf0 msgr2=0x7fbb441157f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:33.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.690+0000 7fbb41d9b700 1 --2- 172.21.15.63:0/2514343623 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb44102bf0 0x7fbb441157f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:33.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.690+0000 7fbb41d9b700 1 -- 172.21.15.63:0/2514343623 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb38005040 con 0x7fbb44103590 2023-12-12T11:48:33.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.691+0000 7fbb41d9b700 1 --2- 172.21.15.63:0/2514343623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb44103590 0x7fbb44115d30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbb38009fd0 tx=0x7fbb38009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:33.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.691+0000 7fbb32ffd700 1 -- 172.21.15.63:0/2514343623 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb38021070 con 0x7fbb44103590 2023-12-12T11:48:33.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.691+0000 7fbb48b0f700 1 -- 172.21.15.63:0/2514343623 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb4410f930 con 0x7fbb44103590 2023-12-12T11:48:33.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.691+0000 7fbb32ffd700 1 -- 172.21.15.63:0/2514343623 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbb380093b0 con 0x7fbb44103590 2023-12-12T11:48:33.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.691+0000 7fbb32ffd700 1 -- 172.21.15.63:0/2514343623 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb3800e070 con 0x7fbb44103590 2023-12-12T11:48:33.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.691+0000 7fbb48b0f700 1 -- 172.21.15.63:0/2514343623 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb4410fe10 con 0x7fbb44103590 2023-12-12T11:48:33.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.692+0000 7fbb48b0f700 1 -- 172.21.15.63:0/2514343623 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb440fc3a0 con 0x7fbb44103590 2023-12-12T11:48:33.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.693+0000 7fbb32ffd700 1 -- 172.21.15.63:0/2514343623 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fbb38013a50 con 0x7fbb44103590 2023-12-12T11:48:33.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.694+0000 7fbb32ffd700 1 --2- 172.21.15.63:0/2514343623 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fbb2c068f70 0x7fbb2c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:33.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.694+0000 7fbb32ffd700 1 -- 172.21.15.63:0/2514343623 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fbb38087cb0 con 0x7fbb44103590 2023-12-12T11:48:33.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.694+0000 7fbb4259c700 1 --2- 172.21.15.63:0/2514343623 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fbb2c068f70 0x7fbb2c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:33.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.695+0000 7fbb4259c700 1 --2- 172.21.15.63:0/2514343623 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fbb2c068f70 0x7fbb2c06b420 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbb34009b80 tx=0x7fbb3400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:33.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.702+0000 7fbb32ffd700 1 -- 172.21.15.63:0/2514343623 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fbb38057eb0 con 0x7fbb44103590 2023-12-12T11:48:33.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.811+0000 7f706e28a700 1 -- 172.21.15.63:0/2173078979 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f706810bd80 con 0x7f70680fc260 2023-12-12T11:48:33.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.811+0000 7f7064ff9700 1 -- 172.21.15.63:0/2173078979 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f705c0565b0 con 0x7f70680fc260 2023-12-12T11:48:33.814 INFO:teuthology.orchestra.run.smithi063.stdout:146028888076 2023-12-12T11:48:33.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.814+0000 7f706e28a700 1 -- 172.21.15.63:0/2173078979 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f7050068f70 msgr2=0x7f705006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:33.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.814+0000 7f706e28a700 1 --2- 172.21.15.63:0/2173078979 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f7050068f70 0x7f705006b420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f705800b840 tx=0x7f7058009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:33.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.814+0000 7f706e28a700 1 -- 172.21.15.63:0/2173078979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70680fc260 msgr2=0x7f7068115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:33.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.814+0000 7f706e28a700 1 --2- 172.21.15.63:0/2173078979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70680fc260 0x7f7068115d10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f705c002a50 tx=0x7f705c0046b0 comp rx=0 tx=0).stop 2023-12-12T11:48:33.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.814+0000 7f706e28a700 1 -- 172.21.15.63:0/2173078979 shutdown_connections 2023-12-12T11:48:33.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.814+0000 7f706e28a700 1 --2- 172.21.15.63:0/2173078979 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f70680fb950 0x7f70681157d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:33.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.814+0000 7f706e28a700 1 --2- 172.21.15.63:0/2173078979 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f7050068f70 0x7f705006b420 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:33.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.814+0000 7f706e28a700 1 --2- 172.21.15.63:0/2173078979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70680fc260 0x7f7068115d10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:33.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.814+0000 7f706e28a700 1 -- 172.21.15.63:0/2173078979 >> 172.21.15.63:0/2173078979 conn(0x7f70680f7680 msgr2=0x7f70680f8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:33.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.814+0000 7f706e28a700 1 -- 172.21.15.63:0/2173078979 shutdown_connections 2023-12-12T11:48:33.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.814+0000 7f706e28a700 1 -- 172.21.15.63:0/2173078979 wait complete. 2023-12-12T11:48:33.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.922+0000 7fbb48b0f700 1 -- 172.21.15.63:0/2514343623 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbb440fc3a0 con 0x7fbb44103590 2023-12-12T11:48:33.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.923+0000 7fbb32ffd700 1 -- 172.21.15.63:0/2514343623 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbb38057a40 con 0x7fbb44103590 2023-12-12T11:48:33.925 INFO:teuthology.orchestra.run.smithi063.stdout:38654705695 2023-12-12T11:48:33.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.925+0000 7fbb48b0f700 1 -- 172.21.15.63:0/2514343623 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fbb2c068f70 msgr2=0x7fbb2c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:33.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.925+0000 7fbb48b0f700 1 --2- 172.21.15.63:0/2514343623 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fbb2c068f70 0x7fbb2c06b420 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbb34009b80 tx=0x7fbb3400b040 comp rx=0 tx=0).stop 2023-12-12T11:48:33.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.925+0000 7fbb48b0f700 1 -- 172.21.15.63:0/2514343623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb44103590 msgr2=0x7fbb44115d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:33.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.925+0000 7fbb48b0f700 1 --2- 172.21.15.63:0/2514343623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb44103590 0x7fbb44115d30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbb38009fd0 tx=0x7fbb38009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:33.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.925+0000 7fbb48b0f700 1 -- 172.21.15.63:0/2514343623 shutdown_connections 2023-12-12T11:48:33.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.925+0000 7fbb48b0f700 1 --2- 172.21.15.63:0/2514343623 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb44102bf0 0x7fbb441157f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:33.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.925+0000 7fbb48b0f700 1 --2- 172.21.15.63:0/2514343623 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fbb2c068f70 0x7fbb2c06b420 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:33.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.925+0000 7fbb48b0f700 1 --2- 172.21.15.63:0/2514343623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb44103590 0x7fbb44115d30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:33.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.925+0000 7fbb48b0f700 1 -- 172.21.15.63:0/2514343623 >> 172.21.15.63:0/2514343623 conn(0x7fbb440f87a0 msgr2=0x7fbb440fa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:33.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.925+0000 7fbb48b0f700 1 -- 172.21.15.63:0/2514343623 shutdown_connections 2023-12-12T11:48:33.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:33.925+0000 7fbb48b0f700 1 -- 172.21.15.63:0/2514343623 wait complete. 2023-12-12T11:48:34.216 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:33 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/2173078979' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-12T11:48:34.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:33 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/2173078979' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-12T11:48:34.239 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888076 got 146028888076 for osd.4 2023-12-12T11:48:34.239 DEBUG:teuthology.parallel:result is None 2023-12-12T11:48:34.431 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705694 got 38654705695 for osd.0 2023-12-12T11:48:34.431 DEBUG:teuthology.parallel:result is None 2023-12-12T11:48:34.431 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-12-12T11:48:34.431 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph pg dump --format=json 2023-12-12T11:48:34.866 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:35.159 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:34 smithi063 ceph-mon[107117]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:35.159 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:34 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/2514343623' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-12T11:48:35.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:34 smithi093 ceph-mon[115914]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:35.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:34 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/2514343623' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-12T11:48:35.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:35.994+0000 7fe760eba700 1 -- 172.21.15.63:0/2995173258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe75c103540 msgr2=0x7fe75c0fcbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:35.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:35.994+0000 7fe760eba700 1 --2- 172.21.15.63:0/2995173258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe75c103540 0x7fe75c0fcbb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe744004940 tx=0x7fe744009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:35.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:35.995+0000 7fe760eba700 1 -- 172.21.15.63:0/2995173258 shutdown_connections 2023-12-12T11:48:35.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:35.995+0000 7fe760eba700 1 --2- 172.21.15.63:0/2995173258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe75c103540 0x7fe75c0fcbb0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:35.998 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:35.995+0000 7fe760eba700 1 --2- 172.21.15.63:0/2995173258 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe75c102ba0 0x7fe75c102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:35.998 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:35.995+0000 7fe760eba700 1 -- 172.21.15.63:0/2995173258 >> 172.21.15.63:0/2995173258 conn(0x7fe75c0f8730 msgr2=0x7fe75c0fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:35.998 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:35.995+0000 7fe760eba700 1 -- 172.21.15.63:0/2995173258 shutdown_connections 2023-12-12T11:48:35.998 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:35.995+0000 7fe760eba700 1 -- 172.21.15.63:0/2995173258 wait complete. 2023-12-12T11:48:35.999 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:35.995+0000 7fe760eba700 1 Processor -- start 2023-12-12T11:48:35.999 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:35.996+0000 7fe760eba700 1 -- start start 2023-12-12T11:48:35.999 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:35.996+0000 7fe760eba700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe75c102ba0 0x7fe75c1157a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:35.999 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:35.996+0000 7fe760eba700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe75c103540 0x7fe75c115ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:35.999 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:35.996+0000 7fe760eba700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c116330 con 0x7fe75c103540 2023-12-12T11:48:36.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:35.996+0000 7fe760eba700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c10f660 con 0x7fe75c102ba0 2023-12-12T11:48:36.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:35.996+0000 7fe753fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe75c103540 0x7fe75c115ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:36.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:35.996+0000 7fe753fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe75c103540 0x7fe75c115ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45854/0 (socket says 172.21.15.63:45854) 2023-12-12T11:48:36.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:35.996+0000 7fe753fff700 1 -- 172.21.15.63:0/3674753780 learned_addr learned my addr 172.21.15.63:0/3674753780 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:48:36.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:35.996+0000 7fe75a59c700 1 --2- 172.21.15.63:0/3674753780 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe75c102ba0 0x7fe75c1157a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:36.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:35.997+0000 7fe753fff700 1 -- 172.21.15.63:0/3674753780 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe75c102ba0 msgr2=0x7fe75c1157a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:36.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:35.997+0000 7fe753fff700 1 --2- 172.21.15.63:0/3674753780 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe75c102ba0 0x7fe75c1157a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:36.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:35.997+0000 7fe753fff700 1 -- 172.21.15.63:0/3674753780 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe744005040 con 0x7fe75c103540 2023-12-12T11:48:36.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:35.997+0000 7fe753fff700 1 --2- 172.21.15.63:0/3674753780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe75c103540 0x7fe75c115ce0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe744009180 tx=0x7fe744009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:36.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:35.997+0000 7fe752ffd700 1 -- 172.21.15.63:0/3674753780 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe74400e040 con 0x7fe75c103540 2023-12-12T11:48:36.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:35.997+0000 7fe752ffd700 1 -- 172.21.15.63:0/3674753780 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe744004290 con 0x7fe75c103540 2023-12-12T11:48:36.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:35.997+0000 7fe752ffd700 1 -- 172.21.15.63:0/3674753780 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe74401c3f0 con 0x7fe75c103540 2023-12-12T11:48:36.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:35.997+0000 7fe760eba700 1 -- 172.21.15.63:0/3674753780 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe75c10f8e0 con 0x7fe75c103540 2023-12-12T11:48:36.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:35.997+0000 7fe760eba700 1 -- 172.21.15.63:0/3674753780 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe75c10fe50 con 0x7fe75c103540 2023-12-12T11:48:36.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:35.998+0000 7fe760eba700 1 -- 172.21.15.63:0/3674753780 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe75c0fc330 con 0x7fe75c103540 2023-12-12T11:48:36.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:35.999+0000 7fe752ffd700 1 -- 172.21.15.63:0/3674753780 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fe744013770 con 0x7fe75c103540 2023-12-12T11:48:36.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:36.000+0000 7fe752ffd700 1 --2- 172.21.15.63:0/3674753780 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fe748068f70 0x7fe74806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:36.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:36.000+0000 7fe752ffd700 1 -- 172.21.15.63:0/3674753780 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe744087d10 con 0x7fe75c103540 2023-12-12T11:48:36.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:36.000+0000 7fe75a59c700 1 --2- 172.21.15.63:0/3674753780 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fe748068f70 0x7fe74806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:36.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:36.001+0000 7fe75a59c700 1 --2- 172.21.15.63:0/3674753780 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fe748068f70 0x7fe74806b420 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe74c004f40 tx=0x7fe74c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:36.006 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:36.004+0000 7fe752ffd700 1 -- 172.21.15.63:0/3674753780 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe744058060 con 0x7fe75c103540 2023-12-12T11:48:36.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:35 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:48:36.203 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:36.201+0000 7fe760eba700 1 -- 172.21.15.63:0/3674753780 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe75c04bb80 con 0x7fe748068f70 2023-12-12T11:48:36.204 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:36.202+0000 7fe752ffd700 1 -- 172.21.15.63:0/3674753780 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+24328 (secure 0 0 0) 0x7fe75c04bb80 con 0x7fe748068f70 2023-12-12T11:48:36.205 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:48:36.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:36.204+0000 7fe760eba700 1 -- 172.21.15.63:0/3674753780 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fe748068f70 msgr2=0x7fe74806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:36.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:36.204+0000 7fe760eba700 1 --2- 172.21.15.63:0/3674753780 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fe748068f70 0x7fe74806b420 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe74c004f40 tx=0x7fe74c00b040 comp rx=0 tx=0).stop 2023-12-12T11:48:36.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:36.204+0000 7fe760eba700 1 -- 172.21.15.63:0/3674753780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe75c103540 msgr2=0x7fe75c115ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:36.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:36.205+0000 7fe760eba700 1 --2- 172.21.15.63:0/3674753780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe75c103540 0x7fe75c115ce0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe744009180 tx=0x7fe744009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:36.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:36.205+0000 7fe760eba700 1 -- 172.21.15.63:0/3674753780 shutdown_connections 2023-12-12T11:48:36.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:36.205+0000 7fe760eba700 1 --2- 172.21.15.63:0/3674753780 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe75c102ba0 0x7fe75c1157a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:36.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:36.205+0000 7fe760eba700 1 --2- 172.21.15.63:0/3674753780 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fe748068f70 0x7fe74806b420 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:36.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:36.205+0000 7fe760eba700 1 --2- 172.21.15.63:0/3674753780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe75c103540 0x7fe75c115ce0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:36.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:36.205+0000 7fe760eba700 1 -- 172.21.15.63:0/3674753780 >> 172.21.15.63:0/3674753780 conn(0x7fe75c0f8730 msgr2=0x7fe75c0fa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:36.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:36.205+0000 7fe760eba700 1 -- 172.21.15.63:0/3674753780 shutdown_connections 2023-12-12T11:48:36.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:36.205+0000 7fe760eba700 1 -- 172.21.15.63:0/3674753780 wait complete. 2023-12-12T11:48:36.208 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2023-12-12T11:48:36.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:35 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:48:36.526 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2023-12-12T11:48:35.821419+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787604,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683308,"statfs":{"total":575970213888,"available":574139707392,"internally_reserved":0,"allocated":3969024,"data_stored":2603946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001964"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":189,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T11:48:03.732224+0000","last_change":"2023-12-12T11:47:40.914527+0000","last_active":"2023-12-12T11:48:03.732224+0000","last_peered":"2023-12-12T11:48:03.732224+0000","last_clean":"2023-12-12T11:48:03.732224+0000","last_became_active":"2023-12-12T11:47:40.914112+0000","last_became_peered":"2023-12-12T11:47:40.914112+0000","last_unstale":"2023-12-12T11:48:03.732224+0000","last_undegraded":"2023-12-12T11:48:03.732224+0000","last_fullsized":"2023-12-12T11:48:03.732224+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T11:46:58.732152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T11:46:58.732152+0000","last_clean_scrub_stamp":"2023-12-12T11:46:58.732152+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T23:39:13.746321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724554,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":138807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":4,"up_from":34,"seq":146028888077,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":138807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149714,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":729175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 11:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.44},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.52700000000000002}]},{"osd":1,"last update":"Tue Dec 12 11:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.45900000000000002}]},{"osd":2,"last update":"Tue Dec 12 11:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378647,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":138807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 11:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.41699999999999998}]},{"osd":1,"last update":"Tue Dec 12 11:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.505}]},{"osd":3,"last update":"Tue Dec 12 11:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.66500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]}]},{"osd":0,"up_from":9,"seq":38654705695,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":729175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 11:47:33 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.313},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.34599999999999997}]},{"osd":2,"last update":"Tue Dec 12 11:47:57 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.36199999999999999}]},{"osd":3,"last update":"Tue Dec 12 11:48:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.54900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542172,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":729175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 11:47:34 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.437},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.32100000000000001}]},{"osd":2,"last update":"Tue Dec 12 11:47:56 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.40999999999999998}]},{"osd":3,"last update":"Tue Dec 12 11:48:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.629},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.68100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T11:48:36.527 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph pg dump --format=json 2023-12-12T11:48:36.967 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:37.143 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:36 smithi063 ceph-mon[107117]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:37.143 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:36 smithi063 ceph-mon[107117]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-12T11:48:37.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:36 smithi093 ceph-mon[115914]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:37.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:36 smithi093 ceph-mon[115914]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-12T11:48:38.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.058+0000 7f512b5af700 1 -- 172.21.15.63:0/73853043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5124102c00 msgr2=0x7f5124102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:38.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.058+0000 7f512b5af700 1 --2- 172.21.15.63:0/73853043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5124102c00 0x7f5124102fd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5120004940 tx=0x7f5120009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:38.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.058+0000 7f512b5af700 1 -- 172.21.15.63:0/73853043 shutdown_connections 2023-12-12T11:48:38.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.058+0000 7f512b5af700 1 --2- 172.21.15.63:0/73853043 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f51241035a0 0x7f51240fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:38.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.058+0000 7f512b5af700 1 --2- 172.21.15.63:0/73853043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5124102c00 0x7f5124102fd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:38.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.058+0000 7f512b5af700 1 -- 172.21.15.63:0/73853043 >> 172.21.15.63:0/73853043 conn(0x7f51240f8790 msgr2=0x7f51240faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:38.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.058+0000 7f512b5af700 1 -- 172.21.15.63:0/73853043 shutdown_connections 2023-12-12T11:48:38.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.058+0000 7f512b5af700 1 -- 172.21.15.63:0/73853043 wait complete. 2023-12-12T11:48:38.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.059+0000 7f512b5af700 1 Processor -- start 2023-12-12T11:48:38.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.059+0000 7f512b5af700 1 -- start start 2023-12-12T11:48:38.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.060+0000 7f512b5af700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5124102c00 0x7f5124115850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:38.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.060+0000 7f512b5af700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f51241035a0 0x7f5124115d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:38.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.060+0000 7f512b5af700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51241163e0 con 0x7f5124102c00 2023-12-12T11:48:38.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.060+0000 7f512b5af700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512410f710 con 0x7f51241035a0 2023-12-12T11:48:38.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.060+0000 7f512934b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5124102c00 0x7f5124115850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:38.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.060+0000 7f512934b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5124102c00 0x7f5124115850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51946/0 (socket says 172.21.15.63:51946) 2023-12-12T11:48:38.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.060+0000 7f512934b700 1 -- 172.21.15.63:0/1182513468 learned_addr learned my addr 172.21.15.63:0/1182513468 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:48:38.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.060+0000 7f5128b4a700 1 --2- 172.21.15.63:0/1182513468 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f51241035a0 0x7f5124115d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:38.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.060+0000 7f512934b700 1 -- 172.21.15.63:0/1182513468 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f51241035a0 msgr2=0x7f5124115d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:38.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.060+0000 7f512934b700 1 --2- 172.21.15.63:0/1182513468 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f51241035a0 0x7f5124115d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:38.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.060+0000 7f512934b700 1 -- 172.21.15.63:0/1182513468 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5120005040 con 0x7f5124102c00 2023-12-12T11:48:38.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.060+0000 7f5128b4a700 1 --2- 172.21.15.63:0/1182513468 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f51241035a0 0x7f5124115d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T11:48:38.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.061+0000 7f512934b700 1 --2- 172.21.15.63:0/1182513468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5124102c00 0x7f5124115850 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5120009fd0 tx=0x7f5120009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:38.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.061+0000 7f5119ffb700 1 -- 172.21.15.63:0/1182513468 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f512000e040 con 0x7f5124102c00 2023-12-12T11:48:38.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.061+0000 7f5119ffb700 1 -- 172.21.15.63:0/1182513468 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f512000bc50 con 0x7f5124102c00 2023-12-12T11:48:38.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.061+0000 7f5119ffb700 1 -- 172.21.15.63:0/1182513468 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5120013ea0 con 0x7f5124102c00 2023-12-12T11:48:38.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.061+0000 7f512b5af700 1 -- 172.21.15.63:0/1182513468 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f512410f990 con 0x7f5124102c00 2023-12-12T11:48:38.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.061+0000 7f512b5af700 1 -- 172.21.15.63:0/1182513468 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512410fed0 con 0x7f5124102c00 2023-12-12T11:48:38.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.062+0000 7f512b5af700 1 -- 172.21.15.63:0/1182513468 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51240fc390 con 0x7f5124102c00 2023-12-12T11:48:38.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.063+0000 7f5119ffb700 1 -- 172.21.15.63:0/1182513468 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f5120013420 con 0x7f5124102c00 2023-12-12T11:48:38.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.064+0000 7f5119ffb700 1 --2- 172.21.15.63:0/1182513468 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f5110068f70 0x7f511006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:38.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.064+0000 7f5119ffb700 1 -- 172.21.15.63:0/1182513468 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5120087f90 con 0x7f5124102c00 2023-12-12T11:48:38.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.064+0000 7f5128b4a700 1 --2- 172.21.15.63:0/1182513468 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f5110068f70 0x7f511006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:38.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.065+0000 7f5128b4a700 1 --2- 172.21.15.63:0/1182513468 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f5110068f70 0x7f511006b420 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5114009fd0 tx=0x7f511400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:38.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.069+0000 7f5119ffb700 1 -- 172.21.15.63:0/1182513468 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5120058190 con 0x7f5124102c00 2023-12-12T11:48:38.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.266+0000 7f512b5af700 1 -- 172.21.15.63:0/1182513468 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5124110ea0 con 0x7f5110068f70 2023-12-12T11:48:38.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.267+0000 7f5119ffb700 1 -- 172.21.15.63:0/1182513468 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+24312 (secure 0 0 0) 0x7f5124110ea0 con 0x7f5110068f70 2023-12-12T11:48:38.270 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:48:38.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.269+0000 7f512b5af700 1 -- 172.21.15.63:0/1182513468 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f5110068f70 msgr2=0x7f511006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:38.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.269+0000 7f512b5af700 1 --2- 172.21.15.63:0/1182513468 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f5110068f70 0x7f511006b420 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5114009fd0 tx=0x7f511400b040 comp rx=0 tx=0).stop 2023-12-12T11:48:38.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.269+0000 7f512b5af700 1 -- 172.21.15.63:0/1182513468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5124102c00 msgr2=0x7f5124115850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:38.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.269+0000 7f512b5af700 1 --2- 172.21.15.63:0/1182513468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5124102c00 0x7f5124115850 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5120009fd0 tx=0x7f5120009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:38.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.270+0000 7f512b5af700 1 -- 172.21.15.63:0/1182513468 shutdown_connections 2023-12-12T11:48:38.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.270+0000 7f512b5af700 1 --2- 172.21.15.63:0/1182513468 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f5110068f70 0x7f511006b420 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:38.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.270+0000 7f512b5af700 1 --2- 172.21.15.63:0/1182513468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5124102c00 0x7f5124115850 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:38.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.270+0000 7f512b5af700 1 --2- 172.21.15.63:0/1182513468 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f51241035a0 0x7f5124115d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:38.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.270+0000 7f512b5af700 1 -- 172.21.15.63:0/1182513468 >> 172.21.15.63:0/1182513468 conn(0x7f51240f8790 msgr2=0x7f51240fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:38.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.270+0000 7f512b5af700 1 -- 172.21.15.63:0/1182513468 shutdown_connections 2023-12-12T11:48:38.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:38.270+0000 7f512b5af700 1 -- 172.21.15.63:0/1182513468 wait complete. 2023-12-12T11:48:38.273 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2023-12-12T11:48:38.657 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2023-12-12T11:48:37.821866+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787604,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683308,"statfs":{"total":575970213888,"available":574139707392,"internally_reserved":0,"allocated":3969024,"data_stored":2603946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002069"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":189,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T11:48:03.732224+0000","last_change":"2023-12-12T11:47:40.914527+0000","last_active":"2023-12-12T11:48:03.732224+0000","last_peered":"2023-12-12T11:48:03.732224+0000","last_clean":"2023-12-12T11:48:03.732224+0000","last_became_active":"2023-12-12T11:47:40.914112+0000","last_became_peered":"2023-12-12T11:47:40.914112+0000","last_unstale":"2023-12-12T11:48:03.732224+0000","last_undegraded":"2023-12-12T11:48:03.732224+0000","last_fullsized":"2023-12-12T11:48:03.732224+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T11:46:58.732152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T11:46:58.732152+0000","last_clean_scrub_stamp":"2023-12-12T11:46:58.732152+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T23:39:13.746321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724554,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":138807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":4,"up_from":34,"seq":146028888078,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":138807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":3,"up_from":26,"seq":111669149714,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":729175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 11:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.44},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.52700000000000002}]},{"osd":1,"last update":"Tue Dec 12 11:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.45900000000000002}]},{"osd":2,"last update":"Tue Dec 12 11:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378648,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":138807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 11:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.76300000000000001}]},{"osd":1,"last update":"Tue Dec 12 11:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.98799999999999999}]},{"osd":3,"last update":"Tue Dec 12 11:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.0800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]}]},{"osd":0,"up_from":9,"seq":38654705696,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":729175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 11:48:34 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.377,"15min":0.374},"min":{"1min":0.28100000000000003,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41099999999999998,"15min":0.40899999999999997},"min":{"1min":0.32600000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.73499999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.377}]},{"osd":2,"last update":"Tue Dec 12 11:47:57 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.436},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.36499999999999999}]},{"osd":3,"last update":"Tue Dec 12 11:48:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.73599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542172,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":729175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 11:47:34 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.437},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.32100000000000001}]},{"osd":2,"last update":"Tue Dec 12 11:47:56 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.40999999999999998}]},{"osd":3,"last update":"Tue Dec 12 11:48:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.629},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.68100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T11:48:38.658 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-12-12T11:48:38.658 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-12T11:48:38.658 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-12-12T11:48:38.659 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph health --format=json 2023-12-12T11:48:39.093 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:39.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:38 smithi093 ceph-mon[115914]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:39.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:38 smithi093 ceph-mon[115914]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-12T11:48:39.240 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:38 smithi063 ceph-mon[107117]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:39.240 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:38 smithi063 ceph-mon[107117]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-12T11:48:40.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.218+0000 7f4d64503700 1 -- 172.21.15.63:0/3563322711 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d5c1035a0 msgr2=0x7f4d5c0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:40.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.218+0000 7f4d64503700 1 --2- 172.21.15.63:0/3563322711 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d5c1035a0 0x7f4d5c0fcc10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c004940 tx=0x7f4d4c009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:40.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.218+0000 7f4d64503700 1 -- 172.21.15.63:0/3563322711 shutdown_connections 2023-12-12T11:48:40.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.218+0000 7f4d64503700 1 --2- 172.21.15.63:0/3563322711 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d5c1035a0 0x7f4d5c0fcc10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:40.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.218+0000 7f4d64503700 1 --2- 172.21.15.63:0/3563322711 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d5c102c00 0x7f4d5c102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:40.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.218+0000 7f4d64503700 1 -- 172.21.15.63:0/3563322711 >> 172.21.15.63:0/3563322711 conn(0x7f4d5c0f8790 msgr2=0x7f4d5c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:40.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.218+0000 7f4d64503700 1 -- 172.21.15.63:0/3563322711 shutdown_connections 2023-12-12T11:48:40.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.218+0000 7f4d64503700 1 -- 172.21.15.63:0/3563322711 wait complete. 2023-12-12T11:48:40.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.218+0000 7f4d64503700 1 Processor -- start 2023-12-12T11:48:40.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.219+0000 7f4d64503700 1 -- start start 2023-12-12T11:48:40.223 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.219+0000 7f4d64503700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d5c102c00 0x7f4d5c06ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:40.223 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.219+0000 7f4d64503700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d5c1035a0 0x7f4d5c070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:40.223 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.219+0000 7f4d64503700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c070a80 con 0x7f4d5c1035a0 2023-12-12T11:48:40.223 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.219+0000 7f4d64503700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c070bf0 con 0x7f4d5c102c00 2023-12-12T11:48:40.223 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.219+0000 7f4d61a9e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d5c1035a0 0x7f4d5c070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:40.223 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.219+0000 7f4d61a9e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d5c1035a0 0x7f4d5c070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51964/0 (socket says 172.21.15.63:51964) 2023-12-12T11:48:40.224 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.219+0000 7f4d61a9e700 1 -- 172.21.15.63:0/1853747200 learned_addr learned my addr 172.21.15.63:0/1853747200 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:48:40.224 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.220+0000 7f4d6229f700 1 --2- 172.21.15.63:0/1853747200 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d5c102c00 0x7f4d5c06ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:40.224 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.220+0000 7f4d61a9e700 1 -- 172.21.15.63:0/1853747200 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d5c102c00 msgr2=0x7f4d5c06ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:40.224 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.220+0000 7f4d61a9e700 1 --2- 172.21.15.63:0/1853747200 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d5c102c00 0x7f4d5c06ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:40.224 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.220+0000 7f4d61a9e700 1 -- 172.21.15.63:0/1853747200 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c005040 con 0x7f4d5c1035a0 2023-12-12T11:48:40.224 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.220+0000 7f4d6229f700 1 --2- 172.21.15.63:0/1853747200 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d5c102c00 0x7f4d5c06ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T11:48:40.224 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.220+0000 7f4d61a9e700 1 --2- 172.21.15.63:0/1853747200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d5c1035a0 0x7f4d5c070480 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c009fd0 tx=0x7f4d4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:40.224 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.220+0000 7f4d52ffd700 1 -- 172.21.15.63:0/1853747200 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d4c021070 con 0x7f4d5c1035a0 2023-12-12T11:48:40.224 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.220+0000 7f4d52ffd700 1 -- 172.21.15.63:0/1853747200 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4d4c01c400 con 0x7f4d5c1035a0 2023-12-12T11:48:40.224 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.220+0000 7f4d64503700 1 -- 172.21.15.63:0/1853747200 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d5c119810 con 0x7f4d5c1035a0 2023-12-12T11:48:40.224 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.220+0000 7f4d52ffd700 1 -- 172.21.15.63:0/1853747200 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d4c00e070 con 0x7f4d5c1035a0 2023-12-12T11:48:40.224 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.221+0000 7f4d64503700 1 -- 172.21.15.63:0/1853747200 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d5c119c10 con 0x7f4d5c1035a0 2023-12-12T11:48:40.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.222+0000 7f4d64503700 1 -- 172.21.15.63:0/1853747200 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d5c0fc390 con 0x7f4d5c1035a0 2023-12-12T11:48:40.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.222+0000 7f4d52ffd700 1 -- 172.21.15.63:0/1853747200 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f4d4c01c570 con 0x7f4d5c1035a0 2023-12-12T11:48:40.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.223+0000 7f4d52ffd700 1 --2- 172.21.15.63:0/1853747200 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4d48068f70 0x7f4d4806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:40.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.223+0000 7f4d52ffd700 1 -- 172.21.15.63:0/1853747200 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f4d4c087b30 con 0x7f4d5c1035a0 2023-12-12T11:48:40.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.224+0000 7f4d6229f700 1 --2- 172.21.15.63:0/1853747200 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4d48068f70 0x7f4d4806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:40.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.224+0000 7f4d6229f700 1 --2- 172.21.15.63:0/1853747200 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4d48068f70 0x7f4d4806b420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4d58004600 tx=0x7f4d5800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:40.230 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.228+0000 7f4d52ffd700 1 -- 172.21.15.63:0/1853747200 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4d4c0543e0 con 0x7f4d5c1035a0 2023-12-12T11:48:40.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.472+0000 7f4d64503700 1 -- 172.21.15.63:0/1853747200 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4d5c119e80 con 0x7f4d5c1035a0 2023-12-12T11:48:40.475 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.472+0000 7f4d52ffd700 1 -- 172.21.15.63:0/1853747200 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f4d4c057a00 con 0x7f4d5c1035a0 2023-12-12T11:48:40.475 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:48:40.475 INFO:teuthology.orchestra.run.smithi063.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-12T11:48:40.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.475+0000 7f4d64503700 1 -- 172.21.15.63:0/1853747200 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4d48068f70 msgr2=0x7f4d4806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:40.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.475+0000 7f4d64503700 1 --2- 172.21.15.63:0/1853747200 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4d48068f70 0x7f4d4806b420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4d58004600 tx=0x7f4d5800b040 comp rx=0 tx=0).stop 2023-12-12T11:48:40.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.475+0000 7f4d64503700 1 -- 172.21.15.63:0/1853747200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d5c1035a0 msgr2=0x7f4d5c070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:40.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.475+0000 7f4d64503700 1 --2- 172.21.15.63:0/1853747200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d5c1035a0 0x7f4d5c070480 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c009fd0 tx=0x7f4d4c009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:40.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.475+0000 7f4d64503700 1 -- 172.21.15.63:0/1853747200 shutdown_connections 2023-12-12T11:48:40.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.475+0000 7f4d64503700 1 --2- 172.21.15.63:0/1853747200 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d5c102c00 0x7f4d5c06ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:40.478 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.475+0000 7f4d64503700 1 --2- 172.21.15.63:0/1853747200 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4d48068f70 0x7f4d4806b420 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:40.478 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.475+0000 7f4d64503700 1 --2- 172.21.15.63:0/1853747200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d5c1035a0 0x7f4d5c070480 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:40.478 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.475+0000 7f4d64503700 1 -- 172.21.15.63:0/1853747200 >> 172.21.15.63:0/1853747200 conn(0x7f4d5c0f8790 msgr2=0x7f4d5c0fa240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:40.478 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.475+0000 7f4d64503700 1 -- 172.21.15.63:0/1853747200 shutdown_connections 2023-12-12T11:48:40.478 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:40.475+0000 7f4d64503700 1 -- 172.21.15.63:0/1853747200 wait complete. 2023-12-12T11:48:40.893 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-12-12T11:48:40.894 INFO:tasks.cephadm:Setup complete, yielding 2023-12-12T11:48:40.894 INFO:teuthology.run_tasks:Running task print... 2023-12-12T11:48:40.903 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2023-12-12T11:48:40.903 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-12T11:48:40.911 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi063.front.sepia.ceph.com 2023-12-12T11:48:40.912 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2023-12-12T11:48:41.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:40 smithi093 ceph-mon[115914]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:41.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:40 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/1853747200' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-12T11:48:41.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:40 smithi063 ceph-mon[107117]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:41.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:40 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/1853747200' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-12T11:48:41.348 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:42.592 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.590+0000 7f99c9f6b700 1 -- 172.21.15.63:0/1739770221 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99c4100050 msgr2=0x7f99c4102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:42.593 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.590+0000 7f99c9f6b700 1 --2- 172.21.15.63:0/1739770221 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99c4100050 0x7f99c4102430 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f99b8004940 tx=0x7f99b8009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:42.593 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.590+0000 7f99c9f6b700 1 -- 172.21.15.63:0/1739770221 shutdown_connections 2023-12-12T11:48:42.593 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.590+0000 7f99c9f6b700 1 --2- 172.21.15.63:0/1739770221 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99c4100050 0x7f99c4102430 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:42.593 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.590+0000 7f99c9f6b700 1 --2- 172.21.15.63:0/1739770221 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99c40fd730 0x7f99c40ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:42.593 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.590+0000 7f99c9f6b700 1 -- 172.21.15.63:0/1739770221 >> 172.21.15.63:0/1739770221 conn(0x7f99c40f7190 msgr2=0x7f99c40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:42.593 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.590+0000 7f99c9f6b700 1 -- 172.21.15.63:0/1739770221 shutdown_connections 2023-12-12T11:48:42.593 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.590+0000 7f99c9f6b700 1 -- 172.21.15.63:0/1739770221 wait complete. 2023-12-12T11:48:42.594 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.591+0000 7f99c9f6b700 1 Processor -- start 2023-12-12T11:48:42.594 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.592+0000 7f99c9f6b700 1 -- start start 2023-12-12T11:48:42.595 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.592+0000 7f99c9f6b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99c40fd730 0x7f99c410d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:42.595 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.592+0000 7f99c9f6b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99c4100050 0x7f99c410da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:42.595 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.592+0000 7f99c9f6b700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c410e070 con 0x7f99c40fd730 2023-12-12T11:48:42.595 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.592+0000 7f99c9f6b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c410e910 con 0x7f99c4100050 2023-12-12T11:48:42.595 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.592+0000 7f99c37fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99c40fd730 0x7f99c410d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:42.595 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.592+0000 7f99c37fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99c40fd730 0x7f99c410d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51976/0 (socket says 172.21.15.63:51976) 2023-12-12T11:48:42.595 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.592+0000 7f99c37fe700 1 -- 172.21.15.63:0/2247248748 learned_addr learned my addr 172.21.15.63:0/2247248748 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:48:42.595 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.593+0000 7f99c2ffd700 1 --2- 172.21.15.63:0/2247248748 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99c4100050 0x7f99c410da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:42.595 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.593+0000 7f99c37fe700 1 -- 172.21.15.63:0/2247248748 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99c4100050 msgr2=0x7f99c410da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:42.595 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.593+0000 7f99c37fe700 1 --2- 172.21.15.63:0/2247248748 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99c4100050 0x7f99c410da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:42.596 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.593+0000 7f99c37fe700 1 -- 172.21.15.63:0/2247248748 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b8005040 con 0x7f99c40fd730 2023-12-12T11:48:42.596 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.593+0000 7f99c2ffd700 1 --2- 172.21.15.63:0/2247248748 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99c4100050 0x7f99c410da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T11:48:42.596 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.593+0000 7f99c37fe700 1 --2- 172.21.15.63:0/2247248748 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99c40fd730 0x7f99c410d530 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f99b4002a50 tx=0x7f99b40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:42.596 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.593+0000 7f99abfff700 1 -- 172.21.15.63:0/2247248748 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99b4007cc0 con 0x7f99c40fd730 2023-12-12T11:48:42.596 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.593+0000 7f99abfff700 1 -- 172.21.15.63:0/2247248748 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f99b400f040 con 0x7f99c40fd730 2023-12-12T11:48:42.596 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.593+0000 7f99c9f6b700 1 -- 172.21.15.63:0/2247248748 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99c410ebf0 con 0x7f99c40fd730 2023-12-12T11:48:42.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.593+0000 7f99abfff700 1 -- 172.21.15.63:0/2247248748 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99b4009540 con 0x7f99c40fd730 2023-12-12T11:48:42.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.593+0000 7f99c9f6b700 1 -- 172.21.15.63:0/2247248748 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c410f130 con 0x7f99c40fd730 2023-12-12T11:48:42.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.594+0000 7f99c9f6b700 1 -- 172.21.15.63:0/2247248748 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99c41075c0 con 0x7f99c40fd730 2023-12-12T11:48:42.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.595+0000 7f99abfff700 1 -- 172.21.15.63:0/2247248748 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f99b40096a0 con 0x7f99c40fd730 2023-12-12T11:48:42.598 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.596+0000 7f99abfff700 1 --2- 172.21.15.63:0/2247248748 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f99ac068f70 0x7f99ac06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:42.598 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.596+0000 7f99abfff700 1 -- 172.21.15.63:0/2247248748 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f99b4086820 con 0x7f99c40fd730 2023-12-12T11:48:42.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.597+0000 7f99c2ffd700 1 --2- 172.21.15.63:0/2247248748 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f99ac068f70 0x7f99ac06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:42.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.597+0000 7f99c2ffd700 1 --2- 172.21.15.63:0/2247248748 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f99ac068f70 0x7f99ac06b420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f99b8004f90 tx=0x7f99b8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:42.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.601+0000 7f99abfff700 1 -- 172.21.15.63:0/2247248748 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f99b4056a20 con 0x7f99c40fd730 2023-12-12T11:48:42.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:42 smithi063 ceph-mon[107117]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:42.806 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.804+0000 7f99c9f6b700 1 -- 172.21.15.63:0/2247248748 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f99c404bb80 con 0x7f99c40fd730 2023-12-12T11:48:42.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.809+0000 7f99abfff700 1 -- 172.21.15.63:0/2247248748 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f99b40565b0 con 0x7f99c40fd730 2023-12-12T11:48:42.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.812+0000 7f99c9f6b700 1 -- 172.21.15.63:0/2247248748 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f99ac068f70 msgr2=0x7f99ac06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:42.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.812+0000 7f99c9f6b700 1 --2- 172.21.15.63:0/2247248748 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f99ac068f70 0x7f99ac06b420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f99b8004f90 tx=0x7f99b8009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:42.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.812+0000 7f99c9f6b700 1 -- 172.21.15.63:0/2247248748 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99c40fd730 msgr2=0x7f99c410d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:42.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.812+0000 7f99c9f6b700 1 --2- 172.21.15.63:0/2247248748 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99c40fd730 0x7f99c410d530 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f99b4002a50 tx=0x7f99b40046b0 comp rx=0 tx=0).stop 2023-12-12T11:48:42.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.812+0000 7f99c9f6b700 1 -- 172.21.15.63:0/2247248748 shutdown_connections 2023-12-12T11:48:42.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.812+0000 7f99c9f6b700 1 --2- 172.21.15.63:0/2247248748 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f99ac068f70 0x7f99ac06b420 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:42.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.812+0000 7f99c9f6b700 1 --2- 172.21.15.63:0/2247248748 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99c40fd730 0x7f99c410d530 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:42.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.812+0000 7f99c9f6b700 1 --2- 172.21.15.63:0/2247248748 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99c4100050 0x7f99c410da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:42.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.812+0000 7f99c9f6b700 1 -- 172.21.15.63:0/2247248748 >> 172.21.15.63:0/2247248748 conn(0x7f99c40f7190 msgr2=0x7f99c40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:42.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.812+0000 7f99c9f6b700 1 -- 172.21.15.63:0/2247248748 shutdown_connections 2023-12-12T11:48:42.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:42.812+0000 7f99c9f6b700 1 -- 172.21.15.63:0/2247248748 wait complete. 2023-12-12T11:48:42.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:42 smithi093 ceph-mon[115914]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:43.294 INFO:teuthology.run_tasks:Running task print... 2023-12-12T11:48:43.303 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2023-12-12T11:48:43.303 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-12T11:48:43.316 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi063.front.sepia.ceph.com 2023-12-12T11:48:43.317 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- bash -c 'ceph orch status' 2023-12-12T11:48:43.783 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:44.132 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:43 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/2247248748' entity='client.admin' 2023-12-12T11:48:44.132 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:43 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:48:44.132 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:43 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:48:44.133 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:43 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:48:44.133 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:43 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:48:44.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:43 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/2247248748' entity='client.admin' 2023-12-12T11:48:44.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:43 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:48:44.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:43 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:48:44.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:43 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:48:44.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:43 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:48:44.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.979+0000 7f54e8cda700 1 -- 172.21.15.63:0/3270874337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54e40fde00 msgr2=0x7f54e40fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:44.982 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.979+0000 7f54e8cda700 1 --2- 172.21.15.63:0/3270874337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54e40fde00 0x7f54e40fe250 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f54d8004940 tx=0x7f54d8009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:44.982 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.979+0000 7f54e8cda700 1 -- 172.21.15.63:0/3270874337 shutdown_connections 2023-12-12T11:48:44.982 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.979+0000 7f54e8cda700 1 --2- 172.21.15.63:0/3270874337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54e40fde00 0x7f54e40fe250 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:44.982 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.979+0000 7f54e8cda700 1 --2- 172.21.15.63:0/3270874337 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f54e40fcbf0 0x7f54e40fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:44.982 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.979+0000 7f54e8cda700 1 -- 172.21.15.63:0/3270874337 >> 172.21.15.63:0/3270874337 conn(0x7f54e40f82d0 msgr2=0x7f54e40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:44.982 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.979+0000 7f54e8cda700 1 -- 172.21.15.63:0/3270874337 shutdown_connections 2023-12-12T11:48:44.982 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.979+0000 7f54e8cda700 1 -- 172.21.15.63:0/3270874337 wait complete. 2023-12-12T11:48:44.983 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.980+0000 7f54e8cda700 1 Processor -- start 2023-12-12T11:48:44.983 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.981+0000 7f54e8cda700 1 -- start start 2023-12-12T11:48:44.983 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.981+0000 7f54e8cda700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54e40fcbf0 0x7f54e4071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:44.983 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.981+0000 7f54e8cda700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f54e40fde00 0x7f54e406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:44.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.981+0000 7f54e8cda700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e4070620 con 0x7f54e40fcbf0 2023-12-12T11:48:44.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.981+0000 7f54e8cda700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e4070790 con 0x7f54e40fde00 2023-12-12T11:48:44.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.981+0000 7f54e259c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54e40fcbf0 0x7f54e4071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:44.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.981+0000 7f54e259c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54e40fcbf0 0x7f54e4071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51988/0 (socket says 172.21.15.63:51988) 2023-12-12T11:48:44.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.981+0000 7f54e259c700 1 -- 172.21.15.63:0/2803413985 learned_addr learned my addr 172.21.15.63:0/2803413985 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:48:44.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.982+0000 7f54e1d9b700 1 --2- 172.21.15.63:0/2803413985 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f54e40fde00 0x7f54e406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:44.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.982+0000 7f54e259c700 1 -- 172.21.15.63:0/2803413985 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f54e40fde00 msgr2=0x7f54e406ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:44.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.982+0000 7f54e259c700 1 --2- 172.21.15.63:0/2803413985 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f54e40fde00 0x7f54e406ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:44.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.982+0000 7f54e259c700 1 -- 172.21.15.63:0/2803413985 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d8005040 con 0x7f54e40fcbf0 2023-12-12T11:48:44.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.982+0000 7f54e259c700 1 --2- 172.21.15.63:0/2803413985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54e40fcbf0 0x7f54e4071b10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f54d400b790 tx=0x7f54d4009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:44.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.982+0000 7f54d2ffd700 1 -- 172.21.15.63:0/2803413985 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54d400f6f0 con 0x7f54e40fcbf0 2023-12-12T11:48:44.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.982+0000 7f54d2ffd700 1 -- 172.21.15.63:0/2803413985 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f54d400fd00 con 0x7f54e40fcbf0 2023-12-12T11:48:44.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.982+0000 7f54d2ffd700 1 -- 172.21.15.63:0/2803413985 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54d4011e90 con 0x7f54e40fcbf0 2023-12-12T11:48:44.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.982+0000 7f54e8cda700 1 -- 172.21.15.63:0/2803413985 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e4070a70 con 0x7f54e40fcbf0 2023-12-12T11:48:44.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.983+0000 7f54e8cda700 1 -- 172.21.15.63:0/2803413985 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e41155a0 con 0x7f54e40fcbf0 2023-12-12T11:48:44.986 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.984+0000 7f54e8cda700 1 -- 172.21.15.63:0/2803413985 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e404bb80 con 0x7f54e40fcbf0 2023-12-12T11:48:44.986 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.984+0000 7f54d2ffd700 1 -- 172.21.15.63:0/2803413985 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f54d400f850 con 0x7f54e40fcbf0 2023-12-12T11:48:44.987 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.985+0000 7f54d2ffd700 1 --2- 172.21.15.63:0/2803413985 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f54cc068f70 0x7f54cc06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:44.987 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.985+0000 7f54d2ffd700 1 -- 172.21.15.63:0/2803413985 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f54d40867b0 con 0x7f54e40fcbf0 2023-12-12T11:48:44.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.986+0000 7f54e1d9b700 1 --2- 172.21.15.63:0/2803413985 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f54cc068f70 0x7f54cc06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:44.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.986+0000 7f54e1d9b700 1 --2- 172.21.15.63:0/2803413985 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f54cc068f70 0x7f54cc06b420 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f54d80043d0 tx=0x7f54d8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:44.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:44.989+0000 7f54d2ffd700 1 -- 172.21.15.63:0/2803413985 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f54d4056af0 con 0x7f54e40fcbf0 2023-12-12T11:48:45.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:44 smithi063 ceph-mon[107117]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:45.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:45.210+0000 7f54e8cda700 1 -- 172.21.15.63:0/2803413985 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f54e4102750 con 0x7f54cc068f70 2023-12-12T11:48:45.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:45.211+0000 7f54d2ffd700 1 -- 172.21.15.63:0/2803413985 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f54e4102750 con 0x7f54cc068f70 2023-12-12T11:48:45.214 INFO:teuthology.orchestra.run.smithi063.stdout:Backend: cephadm 2023-12-12T11:48:45.214 INFO:teuthology.orchestra.run.smithi063.stdout:Available: Yes 2023-12-12T11:48:45.214 INFO:teuthology.orchestra.run.smithi063.stdout:Paused: No 2023-12-12T11:48:45.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:45.213+0000 7f54e8cda700 1 -- 172.21.15.63:0/2803413985 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f54cc068f70 msgr2=0x7f54cc06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:45.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:45.213+0000 7f54e8cda700 1 --2- 172.21.15.63:0/2803413985 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f54cc068f70 0x7f54cc06b420 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f54d80043d0 tx=0x7f54d8009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:45.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:45.213+0000 7f54e8cda700 1 -- 172.21.15.63:0/2803413985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54e40fcbf0 msgr2=0x7f54e4071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:45.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:45.213+0000 7f54e8cda700 1 --2- 172.21.15.63:0/2803413985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54e40fcbf0 0x7f54e4071b10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f54d400b790 tx=0x7f54d4009220 comp rx=0 tx=0).stop 2023-12-12T11:48:45.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:45.213+0000 7f54e8cda700 1 -- 172.21.15.63:0/2803413985 shutdown_connections 2023-12-12T11:48:45.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:45.213+0000 7f54e8cda700 1 --2- 172.21.15.63:0/2803413985 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f54cc068f70 0x7f54cc06b420 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:45.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:45.213+0000 7f54e8cda700 1 --2- 172.21.15.63:0/2803413985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54e40fcbf0 0x7f54e4071b10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:45.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:45.213+0000 7f54e8cda700 1 --2- 172.21.15.63:0/2803413985 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f54e40fde00 0x7f54e406ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:45.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:45.213+0000 7f54e8cda700 1 -- 172.21.15.63:0/2803413985 >> 172.21.15.63:0/2803413985 conn(0x7f54e40f82d0 msgr2=0x7f54e4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:45.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:45.214+0000 7f54e8cda700 1 -- 172.21.15.63:0/2803413985 shutdown_connections 2023-12-12T11:48:45.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:45.214+0000 7f54e8cda700 1 -- 172.21.15.63:0/2803413985 wait complete. 2023-12-12T11:48:45.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:44 smithi093 ceph-mon[115914]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:45.616 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- bash -c 'ceph orch ps' 2023-12-12T11:48:46.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:45 smithi063 ceph-mon[107117]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:48:46.054 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:46.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:45 smithi093 ceph-mon[115914]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:48:47.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:46 smithi093 ceph-mon[115914]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:47.230 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.228+0000 7fe6d72db700 1 -- 172.21.15.63:0/3162920496 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6d00fdc10 msgr2=0x7fe6d00fe060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:47.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.228+0000 7fe6d72db700 1 --2- 172.21.15.63:0/3162920496 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6d00fdc10 0x7fe6d00fe060 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0004940 tx=0x7fe6c0009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:47.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.228+0000 7fe6d72db700 1 -- 172.21.15.63:0/3162920496 shutdown_connections 2023-12-12T11:48:47.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.228+0000 7fe6d72db700 1 --2- 172.21.15.63:0/3162920496 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6d00fdc10 0x7fe6d00fe060 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:47.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.228+0000 7fe6d72db700 1 --2- 172.21.15.63:0/3162920496 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6d00fca00 0x7fe6d00fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:47.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.228+0000 7fe6d72db700 1 -- 172.21.15.63:0/3162920496 >> 172.21.15.63:0/3162920496 conn(0x7fe6d00f80e0 msgr2=0x7fe6d00fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:47.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.228+0000 7fe6d72db700 1 -- 172.21.15.63:0/3162920496 shutdown_connections 2023-12-12T11:48:47.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.228+0000 7fe6d72db700 1 -- 172.21.15.63:0/3162920496 wait complete. 2023-12-12T11:48:47.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.229+0000 7fe6d72db700 1 Processor -- start 2023-12-12T11:48:47.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.229+0000 7fe6d72db700 1 -- start start 2023-12-12T11:48:47.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.230+0000 7fe6d72db700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6d00fca00 0x7fe6d010d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:47.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.230+0000 7fe6d72db700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6d00fdc10 0x7fe6d010d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:47.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.230+0000 7fe6d72db700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d010de40 con 0x7fe6d00fca00 2023-12-12T11:48:47.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.230+0000 7fe6d72db700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d010e6e0 con 0x7fe6d00fdc10 2023-12-12T11:48:47.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.230+0000 7fe6d62d9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6d00fca00 0x7fe6d010d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:47.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.230+0000 7fe6d62d9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6d00fca00 0x7fe6d010d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52002/0 (socket says 172.21.15.63:52002) 2023-12-12T11:48:47.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.230+0000 7fe6d62d9700 1 -- 172.21.15.63:0/1524967342 learned_addr learned my addr 172.21.15.63:0/1524967342 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:48:47.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.230+0000 7fe6d5ad8700 1 --2- 172.21.15.63:0/1524967342 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6d00fdc10 0x7fe6d010d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:47.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.231+0000 7fe6d62d9700 1 -- 172.21.15.63:0/1524967342 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6d00fdc10 msgr2=0x7fe6d010d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:47.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.231+0000 7fe6d62d9700 1 --2- 172.21.15.63:0/1524967342 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6d00fdc10 0x7fe6d010d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:47.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.231+0000 7fe6d62d9700 1 -- 172.21.15.63:0/1524967342 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c0005040 con 0x7fe6d00fca00 2023-12-12T11:48:47.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.231+0000 7fe6d62d9700 1 --2- 172.21.15.63:0/1524967342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6d00fca00 0x7fe6d010d300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc002a80 tx=0x7fe6cc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:47.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.231+0000 7fe6c6ffd700 1 -- 172.21.15.63:0/1524967342 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6cc007cc0 con 0x7fe6d00fca00 2023-12-12T11:48:47.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.231+0000 7fe6c6ffd700 1 -- 172.21.15.63:0/1524967342 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe6cc00f040 con 0x7fe6d00fca00 2023-12-12T11:48:47.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.231+0000 7fe6c6ffd700 1 -- 172.21.15.63:0/1524967342 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6cc00da20 con 0x7fe6d00fca00 2023-12-12T11:48:47.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.231+0000 7fe6d72db700 1 -- 172.21.15.63:0/1524967342 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d010e9c0 con 0x7fe6d00fca00 2023-12-12T11:48:47.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.231+0000 7fe6d72db700 1 -- 172.21.15.63:0/1524967342 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d010ef00 con 0x7fe6d00fca00 2023-12-12T11:48:47.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.232+0000 7fe6d72db700 1 -- 172.21.15.63:0/1524967342 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d004bb80 con 0x7fe6d00fca00 2023-12-12T11:48:47.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.233+0000 7fe6c6ffd700 1 -- 172.21.15.63:0/1524967342 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fe6cc00db80 con 0x7fe6d00fca00 2023-12-12T11:48:47.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.234+0000 7fe6c6ffd700 1 --2- 172.21.15.63:0/1524967342 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fe6bc068f70 0x7fe6bc06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:47.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.234+0000 7fe6c6ffd700 1 -- 172.21.15.63:0/1524967342 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe6cc0868e0 con 0x7fe6d00fca00 2023-12-12T11:48:47.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.234+0000 7fe6d5ad8700 1 --2- 172.21.15.63:0/1524967342 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fe6bc068f70 0x7fe6bc06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:47.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.235+0000 7fe6d5ad8700 1 --2- 172.21.15.63:0/1524967342 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fe6bc068f70 0x7fe6bc06b420 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0004f90 tx=0x7fe6c0009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:47.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.239+0000 7fe6c6ffd700 1 -- 172.21.15.63:0/1524967342 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe6cc056a60 con 0x7fe6d00fca00 2023-12-12T11:48:47.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:46 smithi063 ceph-mon[107117]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:47.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.449+0000 7fe6d72db700 1 -- 172.21.15.63:0/1524967342 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6d0102560 con 0x7fe6bc068f70 2023-12-12T11:48:47.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.458+0000 7fe6c6ffd700 1 -- 172.21.15.63:0/1524967342 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2718 (secure 0 0 0) 0x7fe6d0102560 con 0x7fe6bc068f70 2023-12-12T11:48:47.460 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-12T11:48:47.460 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (3m) 113s ago 4m 15.0M - 0.25.0 c8568f914cd2 cd61d03c786f 2023-12-12T11:48:47.460 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (4m) 113s ago 4m 7818k - 17.2.7-123-gbef78a51 ae6196193935 ee4415610fae 2023-12-12T11:48:47.460 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi093 smithi093 running (3m) 48s ago 3m 7810k - 17.2.7-123-gbef78a51 ae6196193935 f64e68742cfe 2023-12-12T11:48:47.460 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (3m) 113s ago 3m 80.2M - 9.4.7 954c08fa6188 2eeaef85f231 2023-12-12T11:48:47.460 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.zjnfdi smithi063 *:9283 running (5m) 113s ago 5m 489M - 17.2.7-123-gbef78a51 ae6196193935 1b9efe5a68d3 2023-12-12T11:48:47.460 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi093.nbtltu smithi093 *:8443,9283 running (3m) 48s ago 3m 441M - 17.2.7-123-gbef78a51 ae6196193935 ecfd38b909a0 2023-12-12T11:48:47.461 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (5m) 113s ago 5m 56.4M 2048M 17.2.7-123-gbef78a51 ae6196193935 ee8e9d7455f9 2023-12-12T11:48:47.461 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi093 smithi093 running (3m) 48s ago 3m 51.0M 2048M 17.2.7-123-gbef78a51 ae6196193935 fac71666a805 2023-12-12T11:48:47.461 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (4m) 113s ago 4m 8464k - 1.5.0 0da6a335fe13 9c94f98d1396 2023-12-12T11:48:47.461 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi093 smithi093 *:9100 running (3m) 48s ago 3m 8493k - 1.5.0 0da6a335fe13 55fa35accdef 2023-12-12T11:48:47.461 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (2m) 113s ago 2m 39.5M 4349M 17.2.7-123-gbef78a51 ae6196193935 636790d2b28c 2023-12-12T11:48:47.461 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (2m) 113s ago 2m 38.8M 4349M 17.2.7-123-gbef78a51 ae6196193935 5388a4bc6b12 2023-12-12T11:48:47.461 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (117s) 113s ago 117s 11.9M 4349M 17.2.7-123-gbef78a51 ae6196193935 9eb2483337c8 2023-12-12T11:48:47.461 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi093 running (96s) 48s ago 96s 44.1M 5373M 17.2.7-123-gbef78a51 ae6196193935 5b2bb36b5843 2023-12-12T11:48:47.461 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi093 running (73s) 48s ago 73s 40.4M 5373M 17.2.7-123-gbef78a51 ae6196193935 7dc3f04b04cb 2023-12-12T11:48:47.461 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi093 running (51s) 48s ago 50s 11.8M 5373M 17.2.7-123-gbef78a51 ae6196193935 16fe8e4668f1 2023-12-12T11:48:47.461 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (2m) 113s ago 3m 34.1M - 2.43.0 a07b618ecd1d 14c481676fd7 2023-12-12T11:48:47.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.460+0000 7fe6d72db700 1 -- 172.21.15.63:0/1524967342 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fe6bc068f70 msgr2=0x7fe6bc06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:47.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.460+0000 7fe6d72db700 1 --2- 172.21.15.63:0/1524967342 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fe6bc068f70 0x7fe6bc06b420 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0004f90 tx=0x7fe6c0009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:47.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.460+0000 7fe6d72db700 1 -- 172.21.15.63:0/1524967342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6d00fca00 msgr2=0x7fe6d010d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:47.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.460+0000 7fe6d72db700 1 --2- 172.21.15.63:0/1524967342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6d00fca00 0x7fe6d010d300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc002a80 tx=0x7fe6cc004600 comp rx=0 tx=0).stop 2023-12-12T11:48:47.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.460+0000 7fe6d72db700 1 -- 172.21.15.63:0/1524967342 shutdown_connections 2023-12-12T11:48:47.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.460+0000 7fe6d72db700 1 --2- 172.21.15.63:0/1524967342 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fe6bc068f70 0x7fe6bc06b420 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:47.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.460+0000 7fe6d72db700 1 --2- 172.21.15.63:0/1524967342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6d00fca00 0x7fe6d010d300 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:47.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.460+0000 7fe6d72db700 1 --2- 172.21.15.63:0/1524967342 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6d00fdc10 0x7fe6d010d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:47.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.460+0000 7fe6d72db700 1 -- 172.21.15.63:0/1524967342 >> 172.21.15.63:0/1524967342 conn(0x7fe6d00f80e0 msgr2=0x7fe6d0100e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:47.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.460+0000 7fe6d72db700 1 -- 172.21.15.63:0/1524967342 shutdown_connections 2023-12-12T11:48:47.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:47.460+0000 7fe6d72db700 1 -- 172.21.15.63:0/1524967342 wait complete. 2023-12-12T11:48:47.864 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- bash -c 'ceph orch ls' 2023-12-12T11:48:48.294 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:49.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:48 smithi063 ceph-mon[107117]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:48:49.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:48 smithi063 ceph-mon[107117]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:49.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:48 smithi093 ceph-mon[115914]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:48:49.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:48 smithi093 ceph-mon[115914]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:49.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.493+0000 7f4e2d087700 1 -- 172.21.15.63:0/2629714667 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e280fde00 msgr2=0x7f4e280fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:49.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.493+0000 7f4e2d087700 1 --2- 172.21.15.63:0/2629714667 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e280fde00 0x7f4e280fe250 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c004940 tx=0x7f4e1c009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:49.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.493+0000 7f4e2d087700 1 -- 172.21.15.63:0/2629714667 shutdown_connections 2023-12-12T11:48:49.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.493+0000 7f4e2d087700 1 --2- 172.21.15.63:0/2629714667 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e280fde00 0x7f4e280fe250 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:49.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.493+0000 7f4e2d087700 1 --2- 172.21.15.63:0/2629714667 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e280fcbf0 0x7f4e280fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:49.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.493+0000 7f4e2d087700 1 -- 172.21.15.63:0/2629714667 >> 172.21.15.63:0/2629714667 conn(0x7f4e280f82d0 msgr2=0x7f4e280fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:49.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.493+0000 7f4e2d087700 1 -- 172.21.15.63:0/2629714667 shutdown_connections 2023-12-12T11:48:49.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.493+0000 7f4e2d087700 1 -- 172.21.15.63:0/2629714667 wait complete. 2023-12-12T11:48:49.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.494+0000 7f4e2d087700 1 Processor -- start 2023-12-12T11:48:49.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.494+0000 7f4e2d087700 1 -- start start 2023-12-12T11:48:49.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.495+0000 7f4e2d087700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e280fcbf0 0x7f4e2810d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:49.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.495+0000 7f4e2d087700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e280fde00 0x7f4e2810dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:49.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.495+0000 7f4e2d087700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2810e0c0 con 0x7f4e280fcbf0 2023-12-12T11:48:49.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.495+0000 7f4e2d087700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2810e960 con 0x7f4e280fde00 2023-12-12T11:48:49.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.495+0000 7f4e26d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e280fcbf0 0x7f4e2810d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:49.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.495+0000 7f4e26d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e280fcbf0 0x7f4e2810d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49344/0 (socket says 172.21.15.63:49344) 2023-12-12T11:48:49.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.495+0000 7f4e26d9d700 1 -- 172.21.15.63:0/2040758558 learned_addr learned my addr 172.21.15.63:0/2040758558 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:48:49.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.495+0000 7f4e2659c700 1 --2- 172.21.15.63:0/2040758558 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e280fde00 0x7f4e2810dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:49.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.495+0000 7f4e26d9d700 1 -- 172.21.15.63:0/2040758558 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e280fde00 msgr2=0x7f4e2810dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:49.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.495+0000 7f4e26d9d700 1 --2- 172.21.15.63:0/2040758558 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e280fde00 0x7f4e2810dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:49.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.495+0000 7f4e26d9d700 1 -- 172.21.15.63:0/2040758558 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e1c005040 con 0x7f4e280fcbf0 2023-12-12T11:48:49.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.496+0000 7f4e26d9d700 1 --2- 172.21.15.63:0/2040758558 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e280fcbf0 0x7f4e2810d580 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4e18002a80 tx=0x7f4e18004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:49.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.496+0000 7f4e0f7fe700 1 -- 172.21.15.63:0/2040758558 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e18007cc0 con 0x7f4e280fcbf0 2023-12-12T11:48:49.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.496+0000 7f4e2d087700 1 -- 172.21.15.63:0/2040758558 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e2810ec40 con 0x7f4e280fcbf0 2023-12-12T11:48:49.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.496+0000 7f4e0f7fe700 1 -- 172.21.15.63:0/2040758558 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4e1800f040 con 0x7f4e280fcbf0 2023-12-12T11:48:49.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.496+0000 7f4e0f7fe700 1 -- 172.21.15.63:0/2040758558 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e1800d9c0 con 0x7f4e280fcbf0 2023-12-12T11:48:49.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.496+0000 7f4e2d087700 1 -- 172.21.15.63:0/2040758558 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e2810f180 con 0x7f4e280fcbf0 2023-12-12T11:48:49.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.497+0000 7f4e2d087700 1 -- 172.21.15.63:0/2040758558 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e2804bb80 con 0x7f4e280fcbf0 2023-12-12T11:48:49.500 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.498+0000 7f4e0f7fe700 1 -- 172.21.15.63:0/2040758558 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f4e1800db20 con 0x7f4e280fcbf0 2023-12-12T11:48:49.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.499+0000 7f4e0f7fe700 1 --2- 172.21.15.63:0/2040758558 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4e10068f70 0x7f4e1006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:49.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.499+0000 7f4e0f7fe700 1 -- 172.21.15.63:0/2040758558 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f4e18086780 con 0x7f4e280fcbf0 2023-12-12T11:48:49.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.499+0000 7f4e2659c700 1 --2- 172.21.15.63:0/2040758558 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4e10068f70 0x7f4e1006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:49.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.500+0000 7f4e2659c700 1 --2- 172.21.15.63:0/2040758558 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4e10068f70 0x7f4e1006b420 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c0043d0 tx=0x7f4e1c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:49.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.503+0000 7f4e0f7fe700 1 -- 172.21.15.63:0/2040758558 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4e180569a0 con 0x7f4e280fcbf0 2023-12-12T11:48:49.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.719+0000 7f4e2d087700 1 -- 172.21.15.63:0/2040758558 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e2810f7e0 con 0x7f4e10068f70 2023-12-12T11:48:49.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.723+0000 7f4e0f7fe700 1 -- 172.21.15.63:0/2040758558 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1161 (secure 0 0 0) 0x7f4e2810f7e0 con 0x7f4e10068f70 2023-12-12T11:48:49.725 INFO:teuthology.orchestra.run.smithi063.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-12-12T11:48:49.725 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager ?:9093,9094 1/1 115s ago 4m count:1 2023-12-12T11:48:49.725 INFO:teuthology.orchestra.run.smithi063.stdout:crash 2/2 115s ago 4m * 2023-12-12T11:48:49.725 INFO:teuthology.orchestra.run.smithi063.stdout:grafana ?:3000 1/1 115s ago 4m count:1 2023-12-12T11:48:49.726 INFO:teuthology.orchestra.run.smithi063.stdout:mgr 2/2 115s ago 4m count:2 2023-12-12T11:48:49.726 INFO:teuthology.orchestra.run.smithi063.stdout:mon 2/2 115s ago 4m smithi063:172.21.15.63=smithi063;smithi093:172.21.15.93=smithi093;count:2 2023-12-12T11:48:49.726 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter ?:9100 2/2 115s ago 4m * 2023-12-12T11:48:49.726 INFO:teuthology.orchestra.run.smithi063.stdout:osd 6 115s ago - 2023-12-12T11:48:49.726 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus ?:9095 1/1 115s ago 4m count:1 2023-12-12T11:48:49.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.725+0000 7f4e2d087700 1 -- 172.21.15.63:0/2040758558 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4e10068f70 msgr2=0x7f4e1006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:49.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.725+0000 7f4e2d087700 1 --2- 172.21.15.63:0/2040758558 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4e10068f70 0x7f4e1006b420 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c0043d0 tx=0x7f4e1c009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:49.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.725+0000 7f4e2d087700 1 -- 172.21.15.63:0/2040758558 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e280fcbf0 msgr2=0x7f4e2810d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:49.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.725+0000 7f4e2d087700 1 --2- 172.21.15.63:0/2040758558 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e280fcbf0 0x7f4e2810d580 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4e18002a80 tx=0x7f4e18004600 comp rx=0 tx=0).stop 2023-12-12T11:48:49.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.726+0000 7f4e2d087700 1 -- 172.21.15.63:0/2040758558 shutdown_connections 2023-12-12T11:48:49.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.726+0000 7f4e2d087700 1 --2- 172.21.15.63:0/2040758558 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4e10068f70 0x7f4e1006b420 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:49.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.726+0000 7f4e2d087700 1 --2- 172.21.15.63:0/2040758558 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e280fcbf0 0x7f4e2810d580 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:49.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.726+0000 7f4e2d087700 1 --2- 172.21.15.63:0/2040758558 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e280fde00 0x7f4e2810dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:49.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.726+0000 7f4e2d087700 1 -- 172.21.15.63:0/2040758558 >> 172.21.15.63:0/2040758558 conn(0x7f4e280f82d0 msgr2=0x7f4e28101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:49.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.726+0000 7f4e2d087700 1 -- 172.21.15.63:0/2040758558 shutdown_connections 2023-12-12T11:48:49.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:49.726+0000 7f4e2d087700 1 -- 172.21.15.63:0/2040758558 wait complete. 2023-12-12T11:48:50.176 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- bash -c 'ceph orch host ls' 2023-12-12T11:48:50.609 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:51.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:50 smithi063 ceph-mon[107117]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:48:51.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:50 smithi063 ceph-mon[107117]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:51.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:50 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:48:51.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:50 smithi093 ceph-mon[115914]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:48:51.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:50 smithi093 ceph-mon[115914]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:51.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:50 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:48:51.872 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.869+0000 7f0b43fff700 1 -- 172.21.15.63:0/794966227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b440fca00 msgr2=0x7f0b440fce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:51.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.869+0000 7f0b43fff700 1 --2- 172.21.15.63:0/794966227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b440fca00 0x7f0b440fce10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0b34004940 tx=0x7f0b34009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:51.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.869+0000 7f0b43fff700 1 -- 172.21.15.63:0/794966227 shutdown_connections 2023-12-12T11:48:51.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.869+0000 7f0b43fff700 1 --2- 172.21.15.63:0/794966227 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0b440fdc10 0x7f0b440fe060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:51.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.869+0000 7f0b43fff700 1 --2- 172.21.15.63:0/794966227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b440fca00 0x7f0b440fce10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:51.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.869+0000 7f0b43fff700 1 -- 172.21.15.63:0/794966227 >> 172.21.15.63:0/794966227 conn(0x7f0b440f80e0 msgr2=0x7f0b440fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:51.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.869+0000 7f0b43fff700 1 -- 172.21.15.63:0/794966227 shutdown_connections 2023-12-12T11:48:51.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.869+0000 7f0b43fff700 1 -- 172.21.15.63:0/794966227 wait complete. 2023-12-12T11:48:51.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.870+0000 7f0b43fff700 1 Processor -- start 2023-12-12T11:48:51.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.870+0000 7f0b43fff700 1 -- start start 2023-12-12T11:48:51.874 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.871+0000 7f0b43fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0b440fca00 0x7f0b4410f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:51.874 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.871+0000 7f0b43fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b440fdc10 0x7f0b4410fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:51.874 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.871+0000 7f0b43fff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b44110030 con 0x7f0b440fdc10 2023-12-12T11:48:51.874 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.871+0000 7f0b43fff700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b441108d0 con 0x7f0b440fca00 2023-12-12T11:48:51.874 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.871+0000 7f0b427fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b440fdc10 0x7f0b4410fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:51.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.871+0000 7f0b427fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b440fdc10 0x7f0b4410fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49358/0 (socket says 172.21.15.63:49358) 2023-12-12T11:48:51.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.871+0000 7f0b427fc700 1 -- 172.21.15.63:0/3382918714 learned_addr learned my addr 172.21.15.63:0/3382918714 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:48:51.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.871+0000 7f0b42ffd700 1 --2- 172.21.15.63:0/3382918714 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0b440fca00 0x7f0b4410f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:51.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.871+0000 7f0b427fc700 1 -- 172.21.15.63:0/3382918714 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0b440fca00 msgr2=0x7f0b4410f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:51.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.871+0000 7f0b427fc700 1 --2- 172.21.15.63:0/3382918714 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0b440fca00 0x7f0b4410f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:51.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.871+0000 7f0b427fc700 1 -- 172.21.15.63:0/3382918714 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b34005040 con 0x7f0b440fdc10 2023-12-12T11:48:51.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.871+0000 7f0b42ffd700 1 --2- 172.21.15.63:0/3382918714 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0b440fca00 0x7f0b4410f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T11:48:51.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.872+0000 7f0b427fc700 1 --2- 172.21.15.63:0/3382918714 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b440fdc10 0x7f0b4410fa30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0b38002a50 tx=0x7f0b380046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:51.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.872+0000 7f0b2b7fe700 1 -- 172.21.15.63:0/3382918714 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b38007cc0 con 0x7f0b440fdc10 2023-12-12T11:48:51.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.872+0000 7f0b43fff700 1 -- 172.21.15.63:0/3382918714 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b44110bb0 con 0x7f0b440fdc10 2023-12-12T11:48:51.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.872+0000 7f0b2b7fe700 1 -- 172.21.15.63:0/3382918714 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0b3800f040 con 0x7f0b440fdc10 2023-12-12T11:48:51.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.872+0000 7f0b2b7fe700 1 -- 172.21.15.63:0/3382918714 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b38009540 con 0x7f0b440fdc10 2023-12-12T11:48:51.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.872+0000 7f0b43fff700 1 -- 172.21.15.63:0/3382918714 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b441110f0 con 0x7f0b440fdc10 2023-12-12T11:48:51.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.873+0000 7f0b43fff700 1 -- 172.21.15.63:0/3382918714 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b44101cb0 con 0x7f0b440fdc10 2023-12-12T11:48:51.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.874+0000 7f0b2b7fe700 1 -- 172.21.15.63:0/3382918714 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f0b380096a0 con 0x7f0b440fdc10 2023-12-12T11:48:51.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.875+0000 7f0b2b7fe700 1 --2- 172.21.15.63:0/3382918714 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f0b2c068f70 0x7f0b2c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:51.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.875+0000 7f0b2b7fe700 1 -- 172.21.15.63:0/3382918714 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0b38086930 con 0x7f0b440fdc10 2023-12-12T11:48:51.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.875+0000 7f0b42ffd700 1 --2- 172.21.15.63:0/3382918714 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f0b2c068f70 0x7f0b2c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:51.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.876+0000 7f0b42ffd700 1 --2- 172.21.15.63:0/3382918714 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f0b2c068f70 0x7f0b2c06b420 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0b34004f90 tx=0x7f0b34009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:51.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:51.879+0000 7f0b2b7fe700 1 -- 172.21.15.63:0/3382918714 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0b38056ab0 con 0x7f0b440fdc10 2023-12-12T11:48:52.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:52.096+0000 7f0b43fff700 1 -- 172.21.15.63:0/3382918714 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b44111480 con 0x7f0b2c068f70 2023-12-12T11:48:52.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:52.098+0000 7f0b2b7fe700 1 -- 172.21.15.63:0/3382918714 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+145 (secure 0 0 0) 0x7f0b44111480 con 0x7f0b2c068f70 2023-12-12T11:48:52.100 INFO:teuthology.orchestra.run.smithi063.stdout:HOST ADDR LABELS STATUS 2023-12-12T11:48:52.100 INFO:teuthology.orchestra.run.smithi063.stdout:smithi063 172.21.15.63 2023-12-12T11:48:52.100 INFO:teuthology.orchestra.run.smithi063.stdout:smithi093 172.21.15.93 2023-12-12T11:48:52.100 INFO:teuthology.orchestra.run.smithi063.stdout:2 hosts in cluster 2023-12-12T11:48:52.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:52.100+0000 7f0b43fff700 1 -- 172.21.15.63:0/3382918714 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f0b2c068f70 msgr2=0x7f0b2c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:52.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:52.100+0000 7f0b43fff700 1 --2- 172.21.15.63:0/3382918714 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f0b2c068f70 0x7f0b2c06b420 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0b34004f90 tx=0x7f0b34009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:52.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:52.100+0000 7f0b43fff700 1 -- 172.21.15.63:0/3382918714 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b440fdc10 msgr2=0x7f0b4410fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:52.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:52.100+0000 7f0b43fff700 1 --2- 172.21.15.63:0/3382918714 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b440fdc10 0x7f0b4410fa30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0b38002a50 tx=0x7f0b380046b0 comp rx=0 tx=0).stop 2023-12-12T11:48:52.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:52.100+0000 7f0b43fff700 1 -- 172.21.15.63:0/3382918714 shutdown_connections 2023-12-12T11:48:52.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:52.100+0000 7f0b43fff700 1 --2- 172.21.15.63:0/3382918714 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0b440fca00 0x7f0b4410f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:52.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:52.100+0000 7f0b43fff700 1 --2- 172.21.15.63:0/3382918714 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f0b2c068f70 0x7f0b2c06b420 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:52.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:52.100+0000 7f0b43fff700 1 --2- 172.21.15.63:0/3382918714 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b440fdc10 0x7f0b4410fa30 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:52.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:52.100+0000 7f0b43fff700 1 -- 172.21.15.63:0/3382918714 >> 172.21.15.63:0/3382918714 conn(0x7f0b440f80e0 msgr2=0x7f0b440fee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:52.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:52.100+0000 7f0b43fff700 1 -- 172.21.15.63:0/3382918714 shutdown_connections 2023-12-12T11:48:52.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:52.100+0000 7f0b43fff700 1 -- 172.21.15.63:0/3382918714 wait complete. 2023-12-12T11:48:52.526 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- bash -c 'ceph orch device ls' 2023-12-12T11:48:52.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:52 smithi063 ceph-mon[107117]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:52.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:52 smithi063 ceph-mon[107117]: from='client.14464 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:48:52.960 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:52.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:52 smithi093 ceph-mon[115914]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:52.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:52 smithi093 ceph-mon[115914]: from='client.14464 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:48:54.206 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.203+0000 7ff1130f0700 1 -- 172.21.15.63:0/2634503958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10c0fc9f0 msgr2=0x7ff10c0fce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:54.206 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.203+0000 7ff1130f0700 1 --2- 172.21.15.63:0/2634503958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10c0fc9f0 0x7ff10c0fce00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff108004940 tx=0x7ff108009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:54.206 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.203+0000 7ff1130f0700 1 -- 172.21.15.63:0/2634503958 shutdown_connections 2023-12-12T11:48:54.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.203+0000 7ff1130f0700 1 --2- 172.21.15.63:0/2634503958 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff10c0fdc00 0x7ff10c0fe050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:54.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.203+0000 7ff1130f0700 1 --2- 172.21.15.63:0/2634503958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10c0fc9f0 0x7ff10c0fce00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:54.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.203+0000 7ff1130f0700 1 -- 172.21.15.63:0/2634503958 >> 172.21.15.63:0/2634503958 conn(0x7ff10c0f8090 msgr2=0x7ff10c0fa4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:54.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.203+0000 7ff1130f0700 1 -- 172.21.15.63:0/2634503958 shutdown_connections 2023-12-12T11:48:54.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.203+0000 7ff1130f0700 1 -- 172.21.15.63:0/2634503958 wait complete. 2023-12-12T11:48:54.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.204+0000 7ff1130f0700 1 Processor -- start 2023-12-12T11:48:54.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.204+0000 7ff1130f0700 1 -- start start 2023-12-12T11:48:54.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.205+0000 7ff1130f0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff10c0fc9f0 0x7ff10c071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:54.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.205+0000 7ff1130f0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10c0fdc00 0x7ff10c06ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:54.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.205+0000 7ff1130f0700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c070590 con 0x7ff10c0fdc00 2023-12-12T11:48:54.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.205+0000 7ff1130f0700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c070700 con 0x7ff10c0fc9f0 2023-12-12T11:48:54.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.205+0000 7ff1118ed700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10c0fdc00 0x7ff10c06ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:54.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.205+0000 7ff1118ed700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10c0fdc00 0x7ff10c06ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49386/0 (socket says 172.21.15.63:49386) 2023-12-12T11:48:54.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.205+0000 7ff1118ed700 1 -- 172.21.15.63:0/3215791572 learned_addr learned my addr 172.21.15.63:0/3215791572 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:48:54.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.205+0000 7ff1120ee700 1 --2- 172.21.15.63:0/3215791572 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff10c0fc9f0 0x7ff10c071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:54.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.205+0000 7ff1118ed700 1 -- 172.21.15.63:0/3215791572 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff10c0fc9f0 msgr2=0x7ff10c071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:54.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.205+0000 7ff1118ed700 1 --2- 172.21.15.63:0/3215791572 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff10c0fc9f0 0x7ff10c071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:54.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.205+0000 7ff1118ed700 1 -- 172.21.15.63:0/3215791572 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff108005040 con 0x7ff10c0fdc00 2023-12-12T11:48:54.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.206+0000 7ff1118ed700 1 --2- 172.21.15.63:0/3215791572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10c0fdc00 0x7ff10c06ff90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc00eb40 tx=0x7ff0fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:54.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.206+0000 7ff102ffd700 1 -- 172.21.15.63:0/3215791572 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0fc007cc0 con 0x7ff10c0fdc00 2023-12-12T11:48:54.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.206+0000 7ff102ffd700 1 -- 172.21.15.63:0/3215791572 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff0fc00f040 con 0x7ff10c0fdc00 2023-12-12T11:48:54.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.206+0000 7ff1130f0700 1 -- 172.21.15.63:0/3215791572 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff10c070980 con 0x7ff10c0fdc00 2023-12-12T11:48:54.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.206+0000 7ff102ffd700 1 -- 172.21.15.63:0/3215791572 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0fc00c990 con 0x7ff10c0fdc00 2023-12-12T11:48:54.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.206+0000 7ff1130f0700 1 -- 172.21.15.63:0/3215791572 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff10c1152a0 con 0x7ff10c0fdc00 2023-12-12T11:48:54.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.207+0000 7ff1130f0700 1 -- 172.21.15.63:0/3215791572 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff10c04bb80 con 0x7ff10c0fdc00 2023-12-12T11:48:54.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.208+0000 7ff102ffd700 1 -- 172.21.15.63:0/3215791572 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff0fc00caf0 con 0x7ff10c0fdc00 2023-12-12T11:48:54.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.209+0000 7ff102ffd700 1 --2- 172.21.15.63:0/3215791572 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff0f8068f70 0x7ff0f806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:54.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.209+0000 7ff102ffd700 1 -- 172.21.15.63:0/3215791572 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff0fc086570 con 0x7ff10c0fdc00 2023-12-12T11:48:54.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.209+0000 7ff1120ee700 1 --2- 172.21.15.63:0/3215791572 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff0f8068f70 0x7ff0f806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:54.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.209+0000 7ff1120ee700 1 --2- 172.21.15.63:0/3215791572 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff0f8068f70 0x7ff0f806b420 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff1080136a0 tx=0x7ff108009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:54.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.213+0000 7ff102ffd700 1 -- 172.21.15.63:0/3215791572 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff0fc04da00 con 0x7ff10c0fdc00 2023-12-12T11:48:54.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.422+0000 7ff1130f0700 1 -- 172.21.15.63:0/3215791572 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff10c102550 con 0x7ff0f8068f70 2023-12-12T11:48:54.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.424+0000 7ff102ffd700 1 -- 172.21.15.63:0/3215791572 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7ff10c102550 con 0x7ff0f8068f70 2023-12-12T11:48:54.426 INFO:teuthology.orchestra.run.smithi063.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-12-12T11:48:54.426 INFO:teuthology.orchestra.run.smithi063.stdout:smithi063 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5344005B400BGN 372G No 116s ago Has a FileSystem, LVM detected 2023-12-12T11:48:54.426 INFO:teuthology.orchestra.run.smithi063.stdout:smithi093 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040150400BGN 372G No 51s ago Has a FileSystem, LVM detected 2023-12-12T11:48:54.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.426+0000 7ff1130f0700 1 -- 172.21.15.63:0/3215791572 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff0f8068f70 msgr2=0x7ff0f806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:54.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.426+0000 7ff1130f0700 1 --2- 172.21.15.63:0/3215791572 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff0f8068f70 0x7ff0f806b420 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff1080136a0 tx=0x7ff108009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:54.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.426+0000 7ff1130f0700 1 -- 172.21.15.63:0/3215791572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10c0fdc00 msgr2=0x7ff10c06ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:54.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.426+0000 7ff1130f0700 1 --2- 172.21.15.63:0/3215791572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10c0fdc00 0x7ff10c06ff90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc00eb40 tx=0x7ff0fc00b040 comp rx=0 tx=0).stop 2023-12-12T11:48:54.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.426+0000 7ff1130f0700 1 -- 172.21.15.63:0/3215791572 shutdown_connections 2023-12-12T11:48:54.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.426+0000 7ff1130f0700 1 --2- 172.21.15.63:0/3215791572 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff10c0fc9f0 0x7ff10c071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:54.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.426+0000 7ff1130f0700 1 --2- 172.21.15.63:0/3215791572 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff0f8068f70 0x7ff0f806b420 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:54.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.426+0000 7ff1130f0700 1 --2- 172.21.15.63:0/3215791572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff10c0fdc00 0x7ff10c06ff90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:54.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.426+0000 7ff1130f0700 1 -- 172.21.15.63:0/3215791572 >> 172.21.15.63:0/3215791572 conn(0x7ff10c0f8090 msgr2=0x7ff10c100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:54.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.426+0000 7ff1130f0700 1 -- 172.21.15.63:0/3215791572 shutdown_connections 2023-12-12T11:48:54.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:54.426+0000 7ff1130f0700 1 -- 172.21.15.63:0/3215791572 wait complete. 2023-12-12T11:48:54.824 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-12T11:48:54.835 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi063.front.sepia.ceph.com 2023-12-12T11:48:54.835 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- bash -c 'ceph fs volume create cephfs --placement=4' 2023-12-12T11:48:55.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:54 smithi093 ceph-mon[115914]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:55.271 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:55.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:54 smithi063 ceph-mon[107117]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:56.046 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:55 smithi063 ceph-mon[107117]: from='client.14468 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:48:56.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:55 smithi093 ceph-mon[115914]: from='client.14468 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:48:56.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.454+0000 7ff24dc47700 1 -- 172.21.15.63:0/1647893675 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff248102100 msgr2=0x7ff2481044e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:56.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.454+0000 7ff24dc47700 1 --2- 172.21.15.63:0/1647893675 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff248102100 0x7ff2481044e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff23c004940 tx=0x7ff23c009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:56.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.454+0000 7ff24dc47700 1 -- 172.21.15.63:0/1647893675 shutdown_connections 2023-12-12T11:48:56.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.454+0000 7ff24dc47700 1 --2- 172.21.15.63:0/1647893675 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff248102100 0x7ff2481044e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:56.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.454+0000 7ff24dc47700 1 --2- 172.21.15.63:0/1647893675 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff248066070 0x7ff248101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:56.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.454+0000 7ff24dc47700 1 -- 172.21.15.63:0/1647893675 >> 172.21.15.63:0/1647893675 conn(0x7ff2480f7190 msgr2=0x7ff2480f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:56.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.454+0000 7ff24dc47700 1 -- 172.21.15.63:0/1647893675 shutdown_connections 2023-12-12T11:48:56.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.454+0000 7ff24dc47700 1 -- 172.21.15.63:0/1647893675 wait complete. 2023-12-12T11:48:56.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.455+0000 7ff24dc47700 1 Processor -- start 2023-12-12T11:48:56.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.455+0000 7ff24dc47700 1 -- start start 2023-12-12T11:48:56.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.455+0000 7ff24dc47700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff248066070 0x7ff24810f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:56.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.456+0000 7ff24dc47700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff248102100 0x7ff24810fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:56.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.456+0000 7ff24dc47700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2481103a0 con 0x7ff248066070 2023-12-12T11:48:56.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.456+0000 7ff24dc47700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff248110c40 con 0x7ff248102100 2023-12-12T11:48:56.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.456+0000 7ff2477fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff248066070 0x7ff24810f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:56.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.456+0000 7ff2477fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff248066070 0x7ff24810f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49418/0 (socket says 172.21.15.63:49418) 2023-12-12T11:48:56.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.456+0000 7ff2477fe700 1 -- 172.21.15.63:0/1520204622 learned_addr learned my addr 172.21.15.63:0/1520204622 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:48:56.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.456+0000 7ff246ffd700 1 --2- 172.21.15.63:0/1520204622 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff248102100 0x7ff24810fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:56.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.456+0000 7ff2477fe700 1 -- 172.21.15.63:0/1520204622 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff248102100 msgr2=0x7ff24810fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:56.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.456+0000 7ff2477fe700 1 --2- 172.21.15.63:0/1520204622 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff248102100 0x7ff24810fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:56.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.456+0000 7ff2477fe700 1 -- 172.21.15.63:0/1520204622 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23c005040 con 0x7ff248066070 2023-12-12T11:48:56.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.457+0000 7ff2477fe700 1 --2- 172.21.15.63:0/1520204622 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff248066070 0x7ff24810f860 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff23800c8c0 tx=0x7ff2380044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:56.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.457+0000 7ff22ffff700 1 -- 172.21.15.63:0/1520204622 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff23800a760 con 0x7ff248066070 2023-12-12T11:48:56.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.457+0000 7ff22ffff700 1 -- 172.21.15.63:0/1520204622 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff23800ad70 con 0x7ff248066070 2023-12-12T11:48:56.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.457+0000 7ff24dc47700 1 -- 172.21.15.63:0/1520204622 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff248110f20 con 0x7ff248066070 2023-12-12T11:48:56.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.457+0000 7ff22ffff700 1 -- 172.21.15.63:0/1520204622 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2380113a0 con 0x7ff248066070 2023-12-12T11:48:56.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.457+0000 7ff24dc47700 1 -- 172.21.15.63:0/1520204622 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff248111460 con 0x7ff248066070 2023-12-12T11:48:56.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.458+0000 7ff24dc47700 1 -- 172.21.15.63:0/1520204622 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff248109700 con 0x7ff248066070 2023-12-12T11:48:56.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.459+0000 7ff22ffff700 1 -- 172.21.15.63:0/1520204622 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff238012400 con 0x7ff248066070 2023-12-12T11:48:56.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.460+0000 7ff22ffff700 1 --2- 172.21.15.63:0/1520204622 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff230068f70 0x7ff23006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:48:56.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.460+0000 7ff22ffff700 1 -- 172.21.15.63:0/1520204622 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff238086b70 con 0x7ff248066070 2023-12-12T11:48:56.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.460+0000 7ff246ffd700 1 --2- 172.21.15.63:0/1520204622 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff230068f70 0x7ff23006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:48:56.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.461+0000 7ff246ffd700 1 --2- 172.21.15.63:0/1520204622 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff230068f70 0x7ff23006b420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff23c00b7d0 tx=0x7ff23c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:48:56.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.464+0000 7ff22ffff700 1 -- 172.21.15.63:0/1520204622 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff238056d70 con 0x7ff248066070 2023-12-12T11:48:56.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:56.699+0000 7ff24dc47700 1 -- 172.21.15.63:0/1520204622 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2481116e0 con 0x7ff230068f70 2023-12-12T11:48:57.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:57 smithi093 ceph-mon[115914]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:57.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:57 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2023-12-12T11:48:57.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:57 smithi063 ceph-mon[107117]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:57.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:57 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2023-12-12T11:48:58.530 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:58 smithi063 ceph-mon[107117]: from='client.14472 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:48:58.530 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:58 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2023-12-12T11:48:58.530 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:58 smithi063 ceph-mon[107117]: osdmap e41: 6 total, 6 up, 6 in 2023-12-12T11:48:58.530 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:58 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2023-12-12T11:48:58.530 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:58 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-mon-smithi063[107093]: 2023-12-12T11:48:58.522+0000 7f998d8ed700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-12T11:48:58.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:58.550+0000 7ff22ffff700 1 -- 172.21.15.63:0/1520204622 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff2481116e0 con 0x7ff230068f70 2023-12-12T11:48:58.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:58.553+0000 7ff24dc47700 1 -- 172.21.15.63:0/1520204622 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff230068f70 msgr2=0x7ff23006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:58.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:58.553+0000 7ff24dc47700 1 --2- 172.21.15.63:0/1520204622 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff230068f70 0x7ff23006b420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff23c00b7d0 tx=0x7ff23c009e30 comp rx=0 tx=0).stop 2023-12-12T11:48:58.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:58.553+0000 7ff24dc47700 1 -- 172.21.15.63:0/1520204622 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff248066070 msgr2=0x7ff24810f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:48:58.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:58.553+0000 7ff24dc47700 1 --2- 172.21.15.63:0/1520204622 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff248066070 0x7ff24810f860 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff23800c8c0 tx=0x7ff2380044c0 comp rx=0 tx=0).stop 2023-12-12T11:48:58.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:58.554+0000 7ff24dc47700 1 -- 172.21.15.63:0/1520204622 shutdown_connections 2023-12-12T11:48:58.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:58.554+0000 7ff24dc47700 1 --2- 172.21.15.63:0/1520204622 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff230068f70 0x7ff23006b420 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:58.557 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:58.554+0000 7ff24dc47700 1 --2- 172.21.15.63:0/1520204622 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff248066070 0x7ff24810f860 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:58.557 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:58.554+0000 7ff24dc47700 1 --2- 172.21.15.63:0/1520204622 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff248102100 0x7ff24810fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:48:58.557 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:58.554+0000 7ff24dc47700 1 -- 172.21.15.63:0/1520204622 >> 172.21.15.63:0/1520204622 conn(0x7ff2480f7190 msgr2=0x7ff2480f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:48:58.557 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:58.554+0000 7ff24dc47700 1 -- 172.21.15.63:0/1520204622 shutdown_connections 2023-12-12T11:48:58.557 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:48:58.555+0000 7ff24dc47700 1 -- 172.21.15.63:0/1520204622 wait complete. 2023-12-12T11:48:58.720 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:58 smithi093 ceph-mon[115914]: from='client.14472 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:48:58.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:58 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2023-12-12T11:48:58.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:58 smithi093 ceph-mon[115914]: osdmap e41: 6 total, 6 up, 6 in 2023-12-12T11:48:58.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:58 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2023-12-12T11:48:59.020 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-12T11:48:59.360 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:59 smithi063 ceph-mon[107117]: pgmap v145: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:59.360 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:59 smithi063 ceph-mon[107117]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-12-12T11:48:59.360 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:59 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2023-12-12T11:48:59.360 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:59 smithi063 ceph-mon[107117]: osdmap e42: 6 total, 6 up, 6 in 2023-12-12T11:48:59.360 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:59 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2023-12-12T11:48:59.360 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:59 smithi063 ceph-mon[107117]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-12T11:48:59.360 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:59 smithi063 ceph-mon[107117]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-12T11:48:59.360 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:59 smithi063 ceph-mon[107117]: osdmap e43: 6 total, 6 up, 6 in 2023-12-12T11:48:59.360 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:59 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2023-12-12T11:48:59.361 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:59 smithi063 ceph-mon[107117]: fsmap cephfs:0 2023-12-12T11:48:59.361 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:59 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:48:59.361 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:59 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:48:59.361 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:59 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:48:59.361 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:59 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:48:59.361 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:59 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:48:59.361 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:59 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi063.bdqbnp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-12T11:48:59.361 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:59 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi063.bdqbnp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-12T11:48:59.361 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:48:59 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:48:59.674 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:48:59.720 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:59 smithi093 ceph-mon[115914]: pgmap v145: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:48:59.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:59 smithi093 ceph-mon[115914]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-12-12T11:48:59.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:59 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2023-12-12T11:48:59.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:59 smithi093 ceph-mon[115914]: osdmap e42: 6 total, 6 up, 6 in 2023-12-12T11:48:59.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:59 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2023-12-12T11:48:59.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:59 smithi093 ceph-mon[115914]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-12T11:48:59.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:59 smithi093 ceph-mon[115914]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-12T11:48:59.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:59 smithi093 ceph-mon[115914]: osdmap e43: 6 total, 6 up, 6 in 2023-12-12T11:48:59.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:59 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2023-12-12T11:48:59.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:59 smithi093 ceph-mon[115914]: fsmap cephfs:0 2023-12-12T11:48:59.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:59 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:48:59.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:59 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:48:59.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:59 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:48:59.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:59 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:48:59.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:59 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:48:59.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:59 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi063.bdqbnp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-12T11:48:59.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:59 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi063.bdqbnp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-12T11:48:59.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:48:59 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:49:00.525 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:00 smithi063 ceph-mon[107117]: Saving service mds.cephfs spec with placement count:4 2023-12-12T11:49:00.525 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:00 smithi063 ceph-mon[107117]: Deploying daemon mds.cephfs.smithi063.bdqbnp on smithi063 2023-12-12T11:49:00.525 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:00 smithi063 ceph-mon[107117]: osdmap e44: 6 total, 6 up, 6 in 2023-12-12T11:49:00.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:00 smithi093 ceph-mon[115914]: Saving service mds.cephfs spec with placement count:4 2023-12-12T11:49:00.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:00 smithi093 ceph-mon[115914]: Deploying daemon mds.cephfs.smithi063.bdqbnp on smithi063 2023-12-12T11:49:00.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:00 smithi093 ceph-mon[115914]: osdmap e44: 6 total, 6 up, 6 in 2023-12-12T11:49:01.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:01 smithi063 ceph-mon[107117]: pgmap v149: 65 pgs: 16 creating+peering, 35 unknown, 14 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:49:01.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:01 smithi063 ceph-mon[107117]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-12-12T11:49:01.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:01 smithi063 ceph-mon[107117]: osdmap e45: 6 total, 6 up, 6 in 2023-12-12T11:49:01.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.376+0000 7f5119484700 1 -- 172.21.15.63:0/1295029580 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5114071bc0 msgr2=0x7f5114070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:01.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.376+0000 7f5119484700 1 --2- 172.21.15.63:0/1295029580 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5114071bc0 0x7f5114070030 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5104004940 tx=0x7f5104009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:01.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.377+0000 7f5119484700 1 -- 172.21.15.63:0/1295029580 shutdown_connections 2023-12-12T11:49:01.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.377+0000 7f5119484700 1 --2- 172.21.15.63:0/1295029580 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5114070570 0x7f51140709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:01.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.377+0000 7f5119484700 1 --2- 172.21.15.63:0/1295029580 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5114071bc0 0x7f5114070030 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:01.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.377+0000 7f5119484700 1 -- 172.21.15.63:0/1295029580 >> 172.21.15.63:0/1295029580 conn(0x7f51140f82d0 msgr2=0x7f51140fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:01.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.377+0000 7f5119484700 1 -- 172.21.15.63:0/1295029580 shutdown_connections 2023-12-12T11:49:01.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.377+0000 7f5119484700 1 -- 172.21.15.63:0/1295029580 wait complete. 2023-12-12T11:49:01.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.378+0000 7f5119484700 1 Processor -- start 2023-12-12T11:49:01.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.378+0000 7f5119484700 1 -- start start 2023-12-12T11:49:01.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.378+0000 7f5119484700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5114070570 0x7f511410f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:01.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.378+0000 7f5119484700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5114071bc0 0x7f511410fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:01.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.378+0000 7f5119484700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5114110420 con 0x7f5114071bc0 2023-12-12T11:49:01.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.378+0000 7f5119484700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5114110cc0 con 0x7f5114070570 2023-12-12T11:49:01.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.379+0000 7f51127fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5114071bc0 0x7f511410fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:01.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.379+0000 7f51127fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5114071bc0 0x7f511410fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58814/0 (socket says 172.21.15.63:58814) 2023-12-12T11:49:01.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.379+0000 7f51127fc700 1 -- 172.21.15.63:0/1152743269 learned_addr learned my addr 172.21.15.63:0/1152743269 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:49:01.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.379+0000 7f5112ffd700 1 --2- 172.21.15.63:0/1152743269 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5114070570 0x7f511410f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:01.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.379+0000 7f5112ffd700 1 -- 172.21.15.63:0/1152743269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5114071bc0 msgr2=0x7f511410fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:01.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.379+0000 7f5112ffd700 1 --2- 172.21.15.63:0/1152743269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5114071bc0 0x7f511410fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:01.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.379+0000 7f5112ffd700 1 -- 172.21.15.63:0/1152743269 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5104005040 con 0x7f5114070570 2023-12-12T11:49:01.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.380+0000 7f5112ffd700 1 --2- 172.21.15.63:0/1152743269 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5114070570 0x7f511410f8e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5104004940 tx=0x7f5104009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:01.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.380+0000 7f50fb7fe700 1 -- 172.21.15.63:0/1152743269 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f510400e040 con 0x7f5114070570 2023-12-12T11:49:01.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.380+0000 7f50fb7fe700 1 -- 172.21.15.63:0/1152743269 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f510401c430 con 0x7f5114070570 2023-12-12T11:49:01.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.380+0000 7f50fb7fe700 1 -- 172.21.15.63:0/1152743269 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5104013660 con 0x7f5114070570 2023-12-12T11:49:01.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.380+0000 7f5119484700 1 -- 172.21.15.63:0/1152743269 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5114110f40 con 0x7f5114070570 2023-12-12T11:49:01.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.380+0000 7f5119484700 1 -- 172.21.15.63:0/1152743269 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5114111480 con 0x7f5114070570 2023-12-12T11:49:01.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.382+0000 7f5119484700 1 -- 172.21.15.63:0/1152743269 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51141096f0 con 0x7f5114070570 2023-12-12T11:49:01.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.383+0000 7f50fb7fe700 1 -- 172.21.15.63:0/1152743269 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f510401c5a0 con 0x7f5114070570 2023-12-12T11:49:01.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.385+0000 7f50fb7fe700 1 --2- 172.21.15.63:0/1152743269 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f50fc068f70 0x7f50fc06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:01.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.385+0000 7f50fb7fe700 1 -- 172.21.15.63:0/1152743269 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f51040879f0 con 0x7f5114070570 2023-12-12T11:49:01.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.385+0000 7f51127fc700 1 --2- 172.21.15.63:0/1152743269 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f50fc068f70 0x7f50fc06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:01.388 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.386+0000 7f51127fc700 1 --2- 172.21.15.63:0/1152743269 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f50fc068f70 0x7f50fc06b420 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f51080041d0 tx=0x7f510800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:01.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.389+0000 7f50fb7fe700 1 -- 172.21.15.63:0/1152743269 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5104057930 con 0x7f5114070570 2023-12-12T11:49:01.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:01 smithi093 ceph-mon[115914]: pgmap v149: 65 pgs: 16 creating+peering, 35 unknown, 14 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:49:01.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:01 smithi093 ceph-mon[115914]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-12-12T11:49:01.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:01 smithi093 ceph-mon[115914]: osdmap e45: 6 total, 6 up, 6 in 2023-12-12T11:49:01.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.669+0000 7f5119484700 1 -- 172.21.15.63:0/1152743269 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f511404bb80 con 0x7f5114070570 2023-12-12T11:49:01.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.670+0000 7f50fb7fe700 1 -- 172.21.15.63:0/1152743269 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 3 v3) v1 ==== 75+0+1247 (secure 0 0 0) 0x7f51040574c0 con 0x7f5114070570 2023-12-12T11:49:01.672 INFO:teuthology.orchestra.run.smithi063.stdout:e3 2023-12-12T11:49:01.672 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-12T11:49:01.672 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:49:01.672 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-12T11:49:01.672 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:49:01.672 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-12T11:49:01.672 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-12T11:49:01.672 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 3 2023-12-12T11:49:01.672 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-12T11:49:01.672 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-12T11:48:58.523481+0000 2023-12-12T11:49:01.673 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-12T11:49:01.504989+0000 2023-12-12T11:49:01.673 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-12T11:49:01.673 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-12T11:49:01.673 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-12T11:49:01.673 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-12T11:49:01.673 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-12T11:49:01.673 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-12T11:49:01.673 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-12T11:49:01.673 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 0 2023-12-12T11:49:01.673 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:49:01.673 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 1 2023-12-12T11:49:01.673 INFO:teuthology.orchestra.run.smithi063.stdout:in 0 2023-12-12T11:49:01.673 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=24311} 2023-12-12T11:49:01.673 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-12T11:49:01.673 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-12T11:49:01.674 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-12T11:49:01.674 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-12T11:49:01.674 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-12T11:49:01.674 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data disabled 2023-12-12T11:49:01.674 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-12T11:49:01.674 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 0 2023-12-12T11:49:01.674 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.bdqbnp{0:24311} state up:creating seq 1 addr [v2:172.21.15.63:6826/2809808942,v1:172.21.15.63:6827/2809808942] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:49:01.674 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:49:01.674 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:49:01.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.672+0000 7f5119484700 1 -- 172.21.15.63:0/1152743269 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f50fc068f70 msgr2=0x7f50fc06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:01.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.672+0000 7f5119484700 1 --2- 172.21.15.63:0/1152743269 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f50fc068f70 0x7f50fc06b420 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f51080041d0 tx=0x7f510800b040 comp rx=0 tx=0).stop 2023-12-12T11:49:01.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.672+0000 7f5119484700 1 -- 172.21.15.63:0/1152743269 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5114070570 msgr2=0x7f511410f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:01.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.672+0000 7f5119484700 1 --2- 172.21.15.63:0/1152743269 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5114070570 0x7f511410f8e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5104004940 tx=0x7f5104009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:01.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.672+0000 7f5119484700 1 -- 172.21.15.63:0/1152743269 shutdown_connections 2023-12-12T11:49:01.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.672+0000 7f5119484700 1 --2- 172.21.15.63:0/1152743269 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5114070570 0x7f511410f8e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:01.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.672+0000 7f5119484700 1 --2- 172.21.15.63:0/1152743269 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f50fc068f70 0x7f50fc06b420 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:01.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.672+0000 7f5119484700 1 --2- 172.21.15.63:0/1152743269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5114071bc0 0x7f511410fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:01.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.672+0000 7f5119484700 1 -- 172.21.15.63:0/1152743269 >> 172.21.15.63:0/1152743269 conn(0x7f51140f82d0 msgr2=0x7f5114103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:01.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.672+0000 7f5119484700 1 -- 172.21.15.63:0/1152743269 shutdown_connections 2023-12-12T11:49:01.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:01.672+0000 7f5119484700 1 -- 172.21.15.63:0/1152743269 wait complete. 2023-12-12T11:49:01.676 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 3 2023-12-12T11:49:02.083 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-12T11:49:02.093 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi063.front.sepia.ceph.com 2023-12-12T11:49:02.094 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- bash -c 'ceph fs set cephfs max_mds 1' 2023-12-12T11:49:02.535 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:49:02.717 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:02 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:02.717 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:02 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:02.717 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:02 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:02.718 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:02 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi093.rhaqsh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-12T11:49:02.718 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:02 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi093.rhaqsh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-12T11:49:02.718 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:02 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:49:02.718 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:02 smithi093 ceph-mon[115914]: Deploying daemon mds.cephfs.smithi093.rhaqsh on smithi093 2023-12-12T11:49:02.718 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:02 smithi093 ceph-mon[115914]: daemon mds.cephfs.smithi063.bdqbnp assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2023-12-12T11:49:02.718 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:02 smithi093 ceph-mon[115914]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-12T11:49:02.718 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:02 smithi093 ceph-mon[115914]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-12T11:49:02.718 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:02 smithi093 ceph-mon[115914]: Cluster is now healthy 2023-12-12T11:49:02.718 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:02 smithi093 ceph-mon[115914]: mds.? [v2:172.21.15.63:6826/2809808942,v1:172.21.15.63:6827/2809808942] up:boot 2023-12-12T11:49:02.718 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:02 smithi093 ceph-mon[115914]: fsmap cephfs:1 {0=cephfs.smithi063.bdqbnp=up:creating} 2023-12-12T11:49:02.718 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:02 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.bdqbnp"}]: dispatch 2023-12-12T11:49:02.718 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:02 smithi093 ceph-mon[115914]: daemon mds.cephfs.smithi063.bdqbnp is now active in filesystem cephfs as rank 0 2023-12-12T11:49:02.718 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:02 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/1152743269' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:49:02.719 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:02 smithi093 ceph-mon[115914]: pgmap v151: 65 pgs: 16 creating+peering, 26 unknown, 23 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:49:02.721 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:02 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:02.721 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:02 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:02.722 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:02 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:02.722 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:02 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi093.rhaqsh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-12T11:49:02.722 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:02 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi093.rhaqsh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-12T11:49:02.722 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:02 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:49:02.722 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:02 smithi063 ceph-mon[107117]: Deploying daemon mds.cephfs.smithi093.rhaqsh on smithi093 2023-12-12T11:49:02.722 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:02 smithi063 ceph-mon[107117]: daemon mds.cephfs.smithi063.bdqbnp assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2023-12-12T11:49:02.722 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:02 smithi063 ceph-mon[107117]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-12T11:49:02.722 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:02 smithi063 ceph-mon[107117]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-12T11:49:02.722 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:02 smithi063 ceph-mon[107117]: Cluster is now healthy 2023-12-12T11:49:02.722 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:02 smithi063 ceph-mon[107117]: mds.? [v2:172.21.15.63:6826/2809808942,v1:172.21.15.63:6827/2809808942] up:boot 2023-12-12T11:49:02.722 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:02 smithi063 ceph-mon[107117]: fsmap cephfs:1 {0=cephfs.smithi063.bdqbnp=up:creating} 2023-12-12T11:49:02.722 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:02 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.bdqbnp"}]: dispatch 2023-12-12T11:49:02.722 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:02 smithi063 ceph-mon[107117]: daemon mds.cephfs.smithi063.bdqbnp is now active in filesystem cephfs as rank 0 2023-12-12T11:49:02.722 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:02 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/1152743269' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:49:02.723 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:02 smithi063 ceph-mon[107117]: pgmap v151: 65 pgs: 16 creating+peering, 26 unknown, 23 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:49:03.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.638+0000 7f0f11e04700 1 -- 172.21.15.63:0/735716718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f0c0fcbf0 msgr2=0x7f0f0c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:03.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.638+0000 7f0f11e04700 1 --2- 172.21.15.63:0/735716718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f0c0fcbf0 0x7f0f0c0fd000 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0efc004940 tx=0x7f0efc009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:03.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.638+0000 7f0f11e04700 1 -- 172.21.15.63:0/735716718 shutdown_connections 2023-12-12T11:49:03.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.638+0000 7f0f11e04700 1 --2- 172.21.15.63:0/735716718 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f0c0fde00 0x7f0f0c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:03.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.638+0000 7f0f11e04700 1 --2- 172.21.15.63:0/735716718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f0c0fcbf0 0x7f0f0c0fd000 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:03.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.638+0000 7f0f11e04700 1 -- 172.21.15.63:0/735716718 >> 172.21.15.63:0/735716718 conn(0x7f0f0c0f82d0 msgr2=0x7f0f0c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:03.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.638+0000 7f0f11e04700 1 -- 172.21.15.63:0/735716718 shutdown_connections 2023-12-12T11:49:03.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.638+0000 7f0f11e04700 1 -- 172.21.15.63:0/735716718 wait complete. 2023-12-12T11:49:03.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.639+0000 7f0f11e04700 1 Processor -- start 2023-12-12T11:49:03.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.639+0000 7f0f11e04700 1 -- start start 2023-12-12T11:49:03.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.639+0000 7f0f11e04700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f0c0fcbf0 0x7f0f0c10d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:03.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.639+0000 7f0f11e04700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f0c0fde00 0x7f0f0c10dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:03.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.639+0000 7f0f11e04700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c10e170 con 0x7f0f0c0fde00 2023-12-12T11:49:03.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.639+0000 7f0f11e04700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c10e9b0 con 0x7f0f0c0fcbf0 2023-12-12T11:49:03.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.639+0000 7f0f0affd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f0c0fde00 0x7f0f0c10dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:03.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.640+0000 7f0f0b7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f0c0fcbf0 0x7f0f0c10d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:03.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.640+0000 7f0f0affd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f0c0fde00 0x7f0f0c10dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58850/0 (socket says 172.21.15.63:58850) 2023-12-12T11:49:03.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.640+0000 7f0f0affd700 1 -- 172.21.15.63:0/3375635594 learned_addr learned my addr 172.21.15.63:0/3375635594 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:49:03.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.640+0000 7f0f0affd700 1 -- 172.21.15.63:0/3375635594 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f0c0fcbf0 msgr2=0x7f0f0c10d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:03.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.640+0000 7f0f0affd700 1 --2- 172.21.15.63:0/3375635594 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f0c0fcbf0 0x7f0f0c10d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:03.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.640+0000 7f0f0affd700 1 -- 172.21.15.63:0/3375635594 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0efc005040 con 0x7f0f0c0fde00 2023-12-12T11:49:03.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.640+0000 7f0f0affd700 1 --2- 172.21.15.63:0/3375635594 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f0c0fde00 0x7f0f0c10dae0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0f0000b790 tx=0x7f0f00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:03.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.640+0000 7f0ef3fff700 1 -- 172.21.15.63:0/3375635594 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f0000f6f0 con 0x7f0f0c0fde00 2023-12-12T11:49:03.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.641+0000 7f0f11e04700 1 -- 172.21.15.63:0/3375635594 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f0c10ec90 con 0x7f0f0c0fde00 2023-12-12T11:49:03.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.641+0000 7f0ef3fff700 1 -- 172.21.15.63:0/3375635594 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0f0000fd00 con 0x7f0f0c0fde00 2023-12-12T11:49:03.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.641+0000 7f0ef3fff700 1 -- 172.21.15.63:0/3375635594 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f000103a0 con 0x7f0f0c0fde00 2023-12-12T11:49:03.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.641+0000 7f0f11e04700 1 -- 172.21.15.63:0/3375635594 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f0c10f1d0 con 0x7f0f0c0fde00 2023-12-12T11:49:03.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.642+0000 7f0f11e04700 1 -- 172.21.15.63:0/3375635594 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f0c04bb80 con 0x7f0f0c0fde00 2023-12-12T11:49:03.645 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.643+0000 7f0ef3fff700 1 -- 172.21.15.63:0/3375635594 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f0f0000f850 con 0x7f0f0c0fde00 2023-12-12T11:49:03.646 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.644+0000 7f0ef3fff700 1 --2- 172.21.15.63:0/3375635594 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f0ef4068f70 0x7f0ef406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:03.646 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.644+0000 7f0ef3fff700 1 -- 172.21.15.63:0/3375635594 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f0f00086b80 con 0x7f0f0c0fde00 2023-12-12T11:49:03.646 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.644+0000 7f0f0b7fe700 1 --2- 172.21.15.63:0/3375635594 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f0ef4068f70 0x7f0ef406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:03.646 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.644+0000 7f0f0b7fe700 1 --2- 172.21.15.63:0/3375635594 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f0ef4068f70 0x7f0ef406b420 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0efc0043d0 tx=0x7f0efc009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:03.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.648+0000 7f0ef3fff700 1 -- 172.21.15.63:0/3375635594 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0f00056ac0 con 0x7f0f0c0fde00 2023-12-12T11:49:03.779 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:03 smithi093 ceph-mon[115914]: mds.? [v2:172.21.15.63:6826/2809808942,v1:172.21.15.63:6827/2809808942] up:active 2023-12-12T11:49:03.779 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:03 smithi093 ceph-mon[115914]: fsmap cephfs:1 {0=cephfs.smithi063.bdqbnp=up:active} 2023-12-12T11:49:03.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:03 smithi063 ceph-mon[107117]: mds.? [v2:172.21.15.63:6826/2809808942,v1:172.21.15.63:6827/2809808942] up:active 2023-12-12T11:49:03.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:03 smithi063 ceph-mon[107117]: fsmap cephfs:1 {0=cephfs.smithi063.bdqbnp=up:active} 2023-12-12T11:49:03.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:03.900+0000 7f0f11e04700 1 -- 172.21.15.63:0/3375635594 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f0f0c10f730 con 0x7f0f0c0fde00 2023-12-12T11:49:04.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:04.521+0000 7f0ef3fff700 1 -- 172.21.15.63:0/3375635594 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v5) v1 ==== 105+0+0 (secure 0 0 0) 0x7f0f00056650 con 0x7f0f0c0fde00 2023-12-12T11:49:04.527 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:04.524+0000 7f0f11e04700 1 -- 172.21.15.63:0/3375635594 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f0ef4068f70 msgr2=0x7f0ef406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:04.527 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:04.524+0000 7f0f11e04700 1 --2- 172.21.15.63:0/3375635594 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f0ef4068f70 0x7f0ef406b420 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0efc0043d0 tx=0x7f0efc009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:04.527 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:04.524+0000 7f0f11e04700 1 -- 172.21.15.63:0/3375635594 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f0c0fde00 msgr2=0x7f0f0c10dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:04.527 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:04.524+0000 7f0f11e04700 1 --2- 172.21.15.63:0/3375635594 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f0c0fde00 0x7f0f0c10dae0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0f0000b790 tx=0x7f0f00009250 comp rx=0 tx=0).stop 2023-12-12T11:49:04.527 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:04.524+0000 7f0f11e04700 1 -- 172.21.15.63:0/3375635594 shutdown_connections 2023-12-12T11:49:04.527 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:04.524+0000 7f0f11e04700 1 --2- 172.21.15.63:0/3375635594 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f0c0fcbf0 0x7f0f0c10d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:04.528 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:04.524+0000 7f0f11e04700 1 --2- 172.21.15.63:0/3375635594 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f0ef4068f70 0x7f0ef406b420 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:04.528 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:04.524+0000 7f0f11e04700 1 --2- 172.21.15.63:0/3375635594 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f0c0fde00 0x7f0f0c10dae0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:04.528 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:04.524+0000 7f0f11e04700 1 -- 172.21.15.63:0/3375635594 >> 172.21.15.63:0/3375635594 conn(0x7f0f0c0f82d0 msgr2=0x7f0f0c101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:04.528 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:04.525+0000 7f0f11e04700 1 -- 172.21.15.63:0/3375635594 shutdown_connections 2023-12-12T11:49:04.528 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:04.525+0000 7f0f11e04700 1 -- 172.21.15.63:0/3375635594 wait complete. 2023-12-12T11:49:05.105 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:04 smithi063 ceph-mon[107117]: pgmap v152: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 6 op/s 2023-12-12T11:49:05.105 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:04 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:05.105 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:04 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:05.105 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:04 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/3375635594' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2023-12-12T11:49:05.105 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:04 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:05.105 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:04 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi063.aevpzg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-12T11:49:05.105 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:04 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi063.aevpzg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-12T11:49:05.105 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:04 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:49:05.105 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:04 smithi063 ceph-mon[107117]: Deploying daemon mds.cephfs.smithi063.aevpzg on smithi063 2023-12-12T11:49:05.106 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:04 smithi063 ceph-mon[107117]: mds.? [v2:172.21.15.93:6824/3161864019,v1:172.21.15.93:6825/3161864019] up:boot 2023-12-12T11:49:05.106 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:04 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/3375635594' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2023-12-12T11:49:05.106 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:04 smithi063 ceph-mon[107117]: fsmap cephfs:1 {0=cephfs.smithi063.bdqbnp=up:active} 1 up:standby 2023-12-12T11:49:05.106 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:04 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi093.rhaqsh"}]: dispatch 2023-12-12T11:49:05.106 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:04 smithi063 ceph-mon[107117]: fsmap cephfs:1 {0=cephfs.smithi063.bdqbnp=up:active} 1 up:standby 2023-12-12T11:49:05.107 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-12T11:49:05.120 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi063.front.sepia.ceph.com 2023-12-12T11:49:05.120 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2023-12-12T11:49:05.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:04 smithi093 ceph-mon[115914]: pgmap v152: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 6 op/s 2023-12-12T11:49:05.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:04 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:05.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:04 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:05.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:04 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/3375635594' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2023-12-12T11:49:05.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:04 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:05.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:04 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi063.aevpzg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-12T11:49:05.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:04 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi063.aevpzg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-12T11:49:05.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:04 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:49:05.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:04 smithi093 ceph-mon[115914]: Deploying daemon mds.cephfs.smithi063.aevpzg on smithi063 2023-12-12T11:49:05.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:04 smithi093 ceph-mon[115914]: mds.? [v2:172.21.15.93:6824/3161864019,v1:172.21.15.93:6825/3161864019] up:boot 2023-12-12T11:49:05.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:04 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/3375635594' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2023-12-12T11:49:05.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:04 smithi093 ceph-mon[115914]: fsmap cephfs:1 {0=cephfs.smithi063.bdqbnp=up:active} 1 up:standby 2023-12-12T11:49:05.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:04 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi093.rhaqsh"}]: dispatch 2023-12-12T11:49:05.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:04 smithi093 ceph-mon[115914]: fsmap cephfs:1 {0=cephfs.smithi063.bdqbnp=up:active} 1 up:standby 2023-12-12T11:49:05.587 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:49:06.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:05 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:49:06.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:05 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:49:07.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.183+0000 7fcf2b3ce700 1 -- 172.21.15.63:0/2391444264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcf240fcbf0 msgr2=0x7fcf240fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:07.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.183+0000 7fcf2b3ce700 1 --2- 172.21.15.63:0/2391444264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcf240fcbf0 0x7fcf240fd000 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcf20004940 tx=0x7fcf20009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:07.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.184+0000 7fcf2b3ce700 1 -- 172.21.15.63:0/2391444264 shutdown_connections 2023-12-12T11:49:07.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.184+0000 7fcf2b3ce700 1 --2- 172.21.15.63:0/2391444264 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf240fde00 0x7fcf240fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:07.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.184+0000 7fcf2b3ce700 1 --2- 172.21.15.63:0/2391444264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcf240fcbf0 0x7fcf240fd000 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:07.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.184+0000 7fcf2b3ce700 1 -- 172.21.15.63:0/2391444264 >> 172.21.15.63:0/2391444264 conn(0x7fcf240f82d0 msgr2=0x7fcf240fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:07.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.184+0000 7fcf2b3ce700 1 -- 172.21.15.63:0/2391444264 shutdown_connections 2023-12-12T11:49:07.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.184+0000 7fcf2b3ce700 1 -- 172.21.15.63:0/2391444264 wait complete. 2023-12-12T11:49:07.188 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.184+0000 7fcf2b3ce700 1 Processor -- start 2023-12-12T11:49:07.188 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.185+0000 7fcf2b3ce700 1 -- start start 2023-12-12T11:49:07.188 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.185+0000 7fcf2b3ce700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcf240fcbf0 0x7fcf2410f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:07.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.185+0000 7fcf2b3ce700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf240fde00 0x7fcf2410fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:07.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.185+0000 7fcf2b3ce700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf241102a0 con 0x7fcf240fcbf0 2023-12-12T11:49:07.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.185+0000 7fcf2b3ce700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf24110b40 con 0x7fcf240fde00 2023-12-12T11:49:07.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.185+0000 7fcf2916a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcf240fcbf0 0x7fcf2410f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:07.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.185+0000 7fcf2916a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcf240fcbf0 0x7fcf2410f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58890/0 (socket says 172.21.15.63:58890) 2023-12-12T11:49:07.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.185+0000 7fcf2916a700 1 -- 172.21.15.63:0/549526227 learned_addr learned my addr 172.21.15.63:0/549526227 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:49:07.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.185+0000 7fcf28969700 1 --2- 172.21.15.63:0/549526227 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf240fde00 0x7fcf2410fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:07.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.186+0000 7fcf2916a700 1 -- 172.21.15.63:0/549526227 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf240fde00 msgr2=0x7fcf2410fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:07.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.186+0000 7fcf2916a700 1 --2- 172.21.15.63:0/549526227 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf240fde00 0x7fcf2410fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:07.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.186+0000 7fcf2916a700 1 -- 172.21.15.63:0/549526227 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf20005040 con 0x7fcf240fcbf0 2023-12-12T11:49:07.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.186+0000 7fcf2916a700 1 --2- 172.21.15.63:0/549526227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcf240fcbf0 0x7fcf2410f760 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcf20009360 tx=0x7fcf20009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:07.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.186+0000 7fcf19ffb700 1 -- 172.21.15.63:0/549526227 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf2000e040 con 0x7fcf240fcbf0 2023-12-12T11:49:07.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.186+0000 7fcf2b3ce700 1 -- 172.21.15.63:0/549526227 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf24110dc0 con 0x7fcf240fcbf0 2023-12-12T11:49:07.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.186+0000 7fcf19ffb700 1 -- 172.21.15.63:0/549526227 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcf20004290 con 0x7fcf240fcbf0 2023-12-12T11:49:07.190 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.186+0000 7fcf19ffb700 1 -- 172.21.15.63:0/549526227 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf2001c630 con 0x7fcf240fcbf0 2023-12-12T11:49:07.190 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.186+0000 7fcf2b3ce700 1 -- 172.21.15.63:0/549526227 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf24111300 con 0x7fcf240fcbf0 2023-12-12T11:49:07.190 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.187+0000 7fcf2b3ce700 1 -- 172.21.15.63:0/549526227 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf24101ea0 con 0x7fcf240fcbf0 2023-12-12T11:49:07.190 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.188+0000 7fcf19ffb700 1 -- 172.21.15.63:0/549526227 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fcf20013960 con 0x7fcf240fcbf0 2023-12-12T11:49:07.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.189+0000 7fcf19ffb700 1 --2- 172.21.15.63:0/549526227 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fcf10068f70 0x7fcf1006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:07.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.189+0000 7fcf19ffb700 1 -- 172.21.15.63:0/549526227 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fcf20088210 con 0x7fcf240fcbf0 2023-12-12T11:49:07.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.189+0000 7fcf28969700 1 --2- 172.21.15.63:0/549526227 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fcf10068f70 0x7fcf1006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:07.192 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.190+0000 7fcf28969700 1 --2- 172.21.15.63:0/549526227 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fcf10068f70 0x7fcf1006b420 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcf14004990 tx=0x7fcf14009ee0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:07.196 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.194+0000 7fcf19ffb700 1 -- 172.21.15.63:0/549526227 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fcf200580d0 con 0x7fcf240fcbf0 2023-12-12T11:49:07.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:06 smithi093 ceph-mon[115914]: pgmap v153: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 842 B/s wr, 5 op/s 2023-12-12T11:49:07.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:06 smithi063 ceph-mon[107117]: pgmap v153: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 842 B/s wr, 5 op/s 2023-12-12T11:49:07.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.442+0000 7fcf2b3ce700 1 -- 172.21.15.63:0/549526227 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcf2404bb80 con 0x7fcf240fcbf0 2023-12-12T11:49:07.871 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.869+0000 7fcf19ffb700 1 -- 172.21.15.63:0/549526227 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcf20057c60 con 0x7fcf240fcbf0 2023-12-12T11:49:07.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.871+0000 7fcf2b3ce700 1 -- 172.21.15.63:0/549526227 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fcf10068f70 msgr2=0x7fcf1006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:07.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.871+0000 7fcf2b3ce700 1 --2- 172.21.15.63:0/549526227 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fcf10068f70 0x7fcf1006b420 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcf14004990 tx=0x7fcf14009ee0 comp rx=0 tx=0).stop 2023-12-12T11:49:07.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.871+0000 7fcf2b3ce700 1 -- 172.21.15.63:0/549526227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcf240fcbf0 msgr2=0x7fcf2410f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:07.874 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.871+0000 7fcf2b3ce700 1 --2- 172.21.15.63:0/549526227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcf240fcbf0 0x7fcf2410f760 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcf20009360 tx=0x7fcf20009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:07.874 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.871+0000 7fcf2b3ce700 1 -- 172.21.15.63:0/549526227 shutdown_connections 2023-12-12T11:49:07.874 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.871+0000 7fcf2b3ce700 1 --2- 172.21.15.63:0/549526227 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fcf10068f70 0x7fcf1006b420 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:07.874 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.871+0000 7fcf2b3ce700 1 --2- 172.21.15.63:0/549526227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcf240fcbf0 0x7fcf2410f760 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:07.874 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.871+0000 7fcf2b3ce700 1 --2- 172.21.15.63:0/549526227 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf240fde00 0x7fcf2410fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:07.874 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.871+0000 7fcf2b3ce700 1 -- 172.21.15.63:0/549526227 >> 172.21.15.63:0/549526227 conn(0x7fcf240f82d0 msgr2=0x7fcf240ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:07.874 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.871+0000 7fcf2b3ce700 1 -- 172.21.15.63:0/549526227 shutdown_connections 2023-12-12T11:49:07.874 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:07.871+0000 7fcf2b3ce700 1 -- 172.21.15.63:0/549526227 wait complete. 2023-12-12T11:49:08.189 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:08 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:08.189 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:08 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:08.189 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:08 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:08.189 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:08 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi093.swdqms", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-12T11:49:08.189 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:08 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi093.swdqms", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-12T11:49:08.189 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:08 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:49:08.189 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:08 smithi093 ceph-mon[115914]: Deploying daemon mds.cephfs.smithi093.swdqms on smithi093 2023-12-12T11:49:08.189 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:08 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/549526227' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2023-12-12T11:49:08.189 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:08 smithi093 ceph-mon[115914]: mds.? [v2:172.21.15.63:6828/3709000039,v1:172.21.15.63:6829/3709000039] up:boot 2023-12-12T11:49:08.189 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:08 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/549526227' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2023-12-12T11:49:08.189 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:08 smithi093 ceph-mon[115914]: fsmap cephfs:1 {0=cephfs.smithi063.bdqbnp=up:active} 2 up:standby 2023-12-12T11:49:08.190 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:08 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.aevpzg"}]: dispatch 2023-12-12T11:49:08.254 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:08 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:08.254 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:08 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:08.254 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:08 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:08.254 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:08 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi093.swdqms", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-12T11:49:08.254 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:08 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi093.swdqms", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-12T11:49:08.255 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:08 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:49:08.255 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:08 smithi063 ceph-mon[107117]: Deploying daemon mds.cephfs.smithi093.swdqms on smithi093 2023-12-12T11:49:08.255 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:08 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/549526227' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2023-12-12T11:49:08.255 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:08 smithi063 ceph-mon[107117]: mds.? [v2:172.21.15.63:6828/3709000039,v1:172.21.15.63:6829/3709000039] up:boot 2023-12-12T11:49:08.255 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:08 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/549526227' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2023-12-12T11:49:08.255 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:08 smithi063 ceph-mon[107117]: fsmap cephfs:1 {0=cephfs.smithi063.bdqbnp=up:active} 2 up:standby 2023-12-12T11:49:08.255 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:08 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.aevpzg"}]: dispatch 2023-12-12T11:49:08.277 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-12T11:49:08.288 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi063.front.sepia.ceph.com 2023-12-12T11:49:08.288 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2023-12-12T11:49:08.726 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:49:09.200 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:09 smithi063 ceph-mon[107117]: pgmap v154: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s wr, 5 op/s 2023-12-12T11:49:09.437 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:09 smithi093 ceph-mon[115914]: pgmap v154: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s wr, 5 op/s 2023-12-12T11:49:09.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.884+0000 7fbb1afa4700 1 -- 172.21.15.63:0/4184864851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb140fde00 msgr2=0x7fbb140fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:09.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.884+0000 7fbb1afa4700 1 --2- 172.21.15.63:0/4184864851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb140fde00 0x7fbb140fe250 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbb00004940 tx=0x7fbb00009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:09.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.884+0000 7fbb1afa4700 1 -- 172.21.15.63:0/4184864851 shutdown_connections 2023-12-12T11:49:09.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.884+0000 7fbb1afa4700 1 --2- 172.21.15.63:0/4184864851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb140fde00 0x7fbb140fe250 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:09.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.884+0000 7fbb1afa4700 1 --2- 172.21.15.63:0/4184864851 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb140fcbf0 0x7fbb140fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:09.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.884+0000 7fbb1afa4700 1 -- 172.21.15.63:0/4184864851 >> 172.21.15.63:0/4184864851 conn(0x7fbb140f82d0 msgr2=0x7fbb140fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:09.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.884+0000 7fbb1afa4700 1 -- 172.21.15.63:0/4184864851 shutdown_connections 2023-12-12T11:49:09.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.884+0000 7fbb1afa4700 1 -- 172.21.15.63:0/4184864851 wait complete. 2023-12-12T11:49:09.888 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.885+0000 7fbb1afa4700 1 Processor -- start 2023-12-12T11:49:09.888 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.885+0000 7fbb1afa4700 1 -- start start 2023-12-12T11:49:09.888 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.886+0000 7fbb1afa4700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb140fcbf0 0x7fbb1410d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:09.888 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.886+0000 7fbb1afa4700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb140fde00 0x7fbb1410da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:09.888 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.886+0000 7fbb1afa4700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1410e030 con 0x7fbb140fde00 2023-12-12T11:49:09.889 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.886+0000 7fbb1afa4700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1410e8d0 con 0x7fbb140fcbf0 2023-12-12T11:49:09.889 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.886+0000 7fbb13fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb140fde00 0x7fbb1410da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:09.889 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.886+0000 7fbb13fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb140fde00 0x7fbb1410da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35932/0 (socket says 172.21.15.63:35932) 2023-12-12T11:49:09.889 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.886+0000 7fbb13fff700 1 -- 172.21.15.63:0/1703571870 learned_addr learned my addr 172.21.15.63:0/1703571870 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:49:09.889 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.886+0000 7fbb18d40700 1 --2- 172.21.15.63:0/1703571870 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb140fcbf0 0x7fbb1410d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:09.889 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.887+0000 7fbb13fff700 1 -- 172.21.15.63:0/1703571870 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb140fcbf0 msgr2=0x7fbb1410d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:09.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.887+0000 7fbb13fff700 1 --2- 172.21.15.63:0/1703571870 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb140fcbf0 0x7fbb1410d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:09.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.887+0000 7fbb13fff700 1 -- 172.21.15.63:0/1703571870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb00005040 con 0x7fbb140fde00 2023-12-12T11:49:09.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.887+0000 7fbb13fff700 1 --2- 172.21.15.63:0/1703571870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb140fde00 0x7fbb1410da30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbb00009fd0 tx=0x7fbb00009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:09.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.887+0000 7fbb117fa700 1 -- 172.21.15.63:0/1703571870 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb00021070 con 0x7fbb140fde00 2023-12-12T11:49:09.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.887+0000 7fbb117fa700 1 -- 172.21.15.63:0/1703571870 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbb0001c400 con 0x7fbb140fde00 2023-12-12T11:49:09.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.887+0000 7fbb117fa700 1 -- 172.21.15.63:0/1703571870 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb0000e070 con 0x7fbb140fde00 2023-12-12T11:49:09.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.887+0000 7fbb1afa4700 1 -- 172.21.15.63:0/1703571870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb1410eb50 con 0x7fbb140fde00 2023-12-12T11:49:09.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.888+0000 7fbb1afa4700 1 -- 172.21.15.63:0/1703571870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb1410f090 con 0x7fbb140fde00 2023-12-12T11:49:09.891 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.889+0000 7fbb1afa4700 1 -- 172.21.15.63:0/1703571870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb1404bb80 con 0x7fbb140fde00 2023-12-12T11:49:09.892 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.890+0000 7fbb117fa700 1 -- 172.21.15.63:0/1703571870 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fbb0001ca00 con 0x7fbb140fde00 2023-12-12T11:49:09.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.891+0000 7fbb117fa700 1 --2- 172.21.15.63:0/1703571870 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fbb04068f70 0x7fbb0406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:09.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.891+0000 7fbb117fa700 1 -- 172.21.15.63:0/1703571870 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fbb00087fe0 con 0x7fbb140fde00 2023-12-12T11:49:09.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.891+0000 7fbb18d40700 1 --2- 172.21.15.63:0/1703571870 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fbb04068f70 0x7fbb0406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:09.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.892+0000 7fbb18d40700 1 --2- 172.21.15.63:0/1703571870 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fbb04068f70 0x7fbb0406b420 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009b80 tx=0x7fbb0800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:09.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:09.896+0000 7fbb117fa700 1 -- 172.21.15.63:0/1703571870 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fbb00057f00 con 0x7fbb140fde00 2023-12-12T11:49:10.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:10.150+0000 7fbb1afa4700 1 -- 172.21.15.63:0/1703571870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbb14105590 con 0x7fbb140fde00 2023-12-12T11:49:10.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:10 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:10.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:10 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:10.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:10 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:10.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:10 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:10.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:10 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:10.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:10 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:49:10.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:10 smithi063 ceph-mon[107117]: pgmap v155: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2023-12-12T11:49:10.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:10 smithi063 ceph-mon[107117]: mds.? [v2:172.21.15.93:6826/3307558569,v1:172.21.15.93:6827/3307558569] up:boot 2023-12-12T11:49:10.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:10 smithi063 ceph-mon[107117]: fsmap cephfs:1 {0=cephfs.smithi063.bdqbnp=up:active} 3 up:standby 2023-12-12T11:49:10.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:10 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi093.swdqms"}]: dispatch 2023-12-12T11:49:10.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:10 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/1703571870' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-12T11:49:10.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:10 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:10.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:10 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:10.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:10 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:10.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:10 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:10.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:10 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:10.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:10 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:49:10.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:10 smithi093 ceph-mon[115914]: pgmap v155: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2023-12-12T11:49:10.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:10 smithi093 ceph-mon[115914]: mds.? [v2:172.21.15.93:6826/3307558569,v1:172.21.15.93:6827/3307558569] up:boot 2023-12-12T11:49:10.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:10 smithi093 ceph-mon[115914]: fsmap cephfs:1 {0=cephfs.smithi063.bdqbnp=up:active} 3 up:standby 2023-12-12T11:49:10.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:10 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi093.swdqms"}]: dispatch 2023-12-12T11:49:10.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:10 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/1703571870' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-12T11:49:11.106 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:11.104+0000 7fbb117fa700 1 -- 172.21.15.63:0/1703571870 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v9) v1 ==== 168+0+0 (secure 0 0 0) 0x7fbb00057a90 con 0x7fbb140fde00 2023-12-12T11:49:11.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:11.106+0000 7fbb1afa4700 1 -- 172.21.15.63:0/1703571870 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fbb04068f70 msgr2=0x7fbb0406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:11.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:11.106+0000 7fbb1afa4700 1 --2- 172.21.15.63:0/1703571870 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fbb04068f70 0x7fbb0406b420 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009b80 tx=0x7fbb0800b040 comp rx=0 tx=0).stop 2023-12-12T11:49:11.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:11.106+0000 7fbb1afa4700 1 -- 172.21.15.63:0/1703571870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb140fde00 msgr2=0x7fbb1410da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:11.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:11.106+0000 7fbb1afa4700 1 --2- 172.21.15.63:0/1703571870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb140fde00 0x7fbb1410da30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbb00009fd0 tx=0x7fbb00009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:11.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:11.106+0000 7fbb1afa4700 1 -- 172.21.15.63:0/1703571870 shutdown_connections 2023-12-12T11:49:11.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:11.107+0000 7fbb1afa4700 1 --2- 172.21.15.63:0/1703571870 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb140fcbf0 0x7fbb1410d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:11.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:11.107+0000 7fbb1afa4700 1 --2- 172.21.15.63:0/1703571870 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fbb04068f70 0x7fbb0406b420 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:11.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:11.107+0000 7fbb1afa4700 1 --2- 172.21.15.63:0/1703571870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb140fde00 0x7fbb1410da30 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:11.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:11.107+0000 7fbb1afa4700 1 -- 172.21.15.63:0/1703571870 >> 172.21.15.63:0/1703571870 conn(0x7fbb140f82d0 msgr2=0x7fbb14101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:11.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:11.107+0000 7fbb1afa4700 1 -- 172.21.15.63:0/1703571870 shutdown_connections 2023-12-12T11:49:11.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:11.107+0000 7fbb1afa4700 1 -- 172.21.15.63:0/1703571870 wait complete. 2023-12-12T11:49:11.111 INFO:teuthology.orchestra.run.smithi063.stderr:inline data enabled 2023-12-12T11:49:11.608 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-12T11:49:11.620 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi063.front.sepia.ceph.com 2023-12-12T11:49:11.621 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-12T11:49:12.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:11 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:12.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:11 smithi063 ceph-mon[107117]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2023-12-12T11:49:12.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:11 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/1703571870' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2023-12-12T11:49:12.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:11 smithi063 ceph-mon[107117]: mds.? [v2:172.21.15.63:6828/3709000039,v1:172.21.15.63:6829/3709000039] up:standby 2023-12-12T11:49:12.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:11 smithi063 ceph-mon[107117]: Dropping low affinity active daemon mds.cephfs.smithi063.bdqbnp in favor of higher affinity standby. 2023-12-12T11:49:12.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:11 smithi063 ceph-mon[107117]: Replacing daemon mds.cephfs.smithi063.bdqbnp as rank 0 with standby daemon mds.cephfs.smithi063.aevpzg 2023-12-12T11:49:12.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:11 smithi063 ceph-mon[107117]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-12-12T11:49:12.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:11 smithi063 ceph-mon[107117]: fsmap cephfs:1 {0=cephfs.smithi063.bdqbnp=up:active} 3 up:standby 2023-12-12T11:49:12.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:11 smithi063 ceph-mon[107117]: osdmap e46: 6 total, 6 up, 6 in 2023-12-12T11:49:12.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:11 smithi063 ceph-mon[107117]: fsmap cephfs:1/1 {0=cephfs.smithi063.aevpzg=up:replay} 2 up:standby 2023-12-12T11:49:12.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:11 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:12.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:11 smithi093 ceph-mon[115914]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2023-12-12T11:49:12.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:11 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/1703571870' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2023-12-12T11:49:12.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:11 smithi093 ceph-mon[115914]: mds.? [v2:172.21.15.63:6828/3709000039,v1:172.21.15.63:6829/3709000039] up:standby 2023-12-12T11:49:12.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:11 smithi093 ceph-mon[115914]: Dropping low affinity active daemon mds.cephfs.smithi063.bdqbnp in favor of higher affinity standby. 2023-12-12T11:49:12.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:11 smithi093 ceph-mon[115914]: Replacing daemon mds.cephfs.smithi063.bdqbnp as rank 0 with standby daemon mds.cephfs.smithi063.aevpzg 2023-12-12T11:49:12.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:11 smithi093 ceph-mon[115914]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-12-12T11:49:12.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:11 smithi093 ceph-mon[115914]: fsmap cephfs:1 {0=cephfs.smithi063.bdqbnp=up:active} 3 up:standby 2023-12-12T11:49:12.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:11 smithi093 ceph-mon[115914]: osdmap e46: 6 total, 6 up, 6 in 2023-12-12T11:49:12.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:11 smithi093 ceph-mon[115914]: fsmap cephfs:1/1 {0=cephfs.smithi063.aevpzg=up:replay} 2 up:standby 2023-12-12T11:49:12.314 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:49:13.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:12 smithi093 ceph-mon[115914]: pgmap v157: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 204 B/s rd, 1.3 KiB/s wr, 4 op/s 2023-12-12T11:49:13.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:12 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:13.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:12 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:13.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:12 smithi093 ceph-mon[115914]: mds.? [v2:172.21.15.63:6828/3709000039,v1:172.21.15.63:6829/3709000039] up:reconnect 2023-12-12T11:49:13.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:12 smithi093 ceph-mon[115914]: mds.? [v2:172.21.15.63:6826/2191270944,v1:172.21.15.63:6827/2191270944] up:boot 2023-12-12T11:49:13.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:12 smithi093 ceph-mon[115914]: mds.? [v2:172.21.15.93:6824/3161864019,v1:172.21.15.93:6825/3161864019] up:standby 2023-12-12T11:49:13.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:12 smithi093 ceph-mon[115914]: fsmap cephfs:1/1 {0=cephfs.smithi063.aevpzg=up:reconnect} 3 up:standby 2023-12-12T11:49:13.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:12 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.bdqbnp"}]: dispatch 2023-12-12T11:49:13.257 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:12 smithi063 ceph-mon[107117]: pgmap v157: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 204 B/s rd, 1.3 KiB/s wr, 4 op/s 2023-12-12T11:49:13.258 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:12 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:13.258 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:12 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:13.258 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:12 smithi063 ceph-mon[107117]: mds.? [v2:172.21.15.63:6828/3709000039,v1:172.21.15.63:6829/3709000039] up:reconnect 2023-12-12T11:49:13.258 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:12 smithi063 ceph-mon[107117]: mds.? [v2:172.21.15.63:6826/2191270944,v1:172.21.15.63:6827/2191270944] up:boot 2023-12-12T11:49:13.258 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:12 smithi063 ceph-mon[107117]: mds.? [v2:172.21.15.93:6824/3161864019,v1:172.21.15.93:6825/3161864019] up:standby 2023-12-12T11:49:13.258 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:12 smithi063 ceph-mon[107117]: fsmap cephfs:1/1 {0=cephfs.smithi063.aevpzg=up:reconnect} 3 up:standby 2023-12-12T11:49:13.258 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:12 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.bdqbnp"}]: dispatch 2023-12-12T11:49:13.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.763+0000 7f8ef8ccf700 1 -- 172.21.15.63:0/2688780750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ef40fde00 msgr2=0x7f8ef40fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:13.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.763+0000 7f8ef8ccf700 1 --2- 172.21.15.63:0/2688780750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ef40fde00 0x7f8ef40fe250 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8004940 tx=0x7f8ee8009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:13.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.763+0000 7f8ef8ccf700 1 -- 172.21.15.63:0/2688780750 shutdown_connections 2023-12-12T11:49:13.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.763+0000 7f8ef8ccf700 1 --2- 172.21.15.63:0/2688780750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ef40fde00 0x7f8ef40fe250 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:13.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.763+0000 7f8ef8ccf700 1 --2- 172.21.15.63:0/2688780750 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ef40fcbf0 0x7f8ef40fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:13.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.763+0000 7f8ef8ccf700 1 -- 172.21.15.63:0/2688780750 >> 172.21.15.63:0/2688780750 conn(0x7f8ef40f82d0 msgr2=0x7f8ef40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:13.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.763+0000 7f8ef8ccf700 1 -- 172.21.15.63:0/2688780750 shutdown_connections 2023-12-12T11:49:13.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.763+0000 7f8ef8ccf700 1 -- 172.21.15.63:0/2688780750 wait complete. 2023-12-12T11:49:13.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.764+0000 7f8ef8ccf700 1 Processor -- start 2023-12-12T11:49:13.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.765+0000 7f8ef8ccf700 1 -- start start 2023-12-12T11:49:13.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.765+0000 7f8ef8ccf700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ef40fcbf0 0x7f8ef410d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:13.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.765+0000 7f8ef8ccf700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ef40fde00 0x7f8ef410da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:13.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.765+0000 7f8ef8ccf700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef410e030 con 0x7f8ef40fde00 2023-12-12T11:49:13.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.765+0000 7f8ef8ccf700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef410e8d0 con 0x7f8ef40fcbf0 2023-12-12T11:49:13.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.765+0000 7f8ef1d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ef40fde00 0x7f8ef410da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:13.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.766+0000 7f8ef1d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ef40fde00 0x7f8ef410da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35966/0 (socket says 172.21.15.63:35966) 2023-12-12T11:49:13.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.766+0000 7f8ef1d9b700 1 -- 172.21.15.63:0/1116221724 learned_addr learned my addr 172.21.15.63:0/1116221724 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:49:13.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.766+0000 7f8ef259c700 1 --2- 172.21.15.63:0/1116221724 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ef40fcbf0 0x7f8ef410d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:13.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.766+0000 7f8ef1d9b700 1 -- 172.21.15.63:0/1116221724 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ef40fcbf0 msgr2=0x7f8ef410d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:13.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.766+0000 7f8ef1d9b700 1 --2- 172.21.15.63:0/1116221724 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ef40fcbf0 0x7f8ef410d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:13.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.766+0000 7f8ef1d9b700 1 -- 172.21.15.63:0/1116221724 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee8005040 con 0x7f8ef40fde00 2023-12-12T11:49:13.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.766+0000 7f8ef259c700 1 --2- 172.21.15.63:0/1116221724 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ef40fcbf0 0x7f8ef410d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T11:49:13.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.766+0000 7f8ef1d9b700 1 --2- 172.21.15.63:0/1116221724 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ef40fde00 0x7f8ef410da30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8009fd0 tx=0x7f8ee8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:13.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.766+0000 7f8ee2ffd700 1 -- 172.21.15.63:0/1116221724 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ee8021070 con 0x7f8ef40fde00 2023-12-12T11:49:13.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.766+0000 7f8ee2ffd700 1 -- 172.21.15.63:0/1116221724 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8ee801c400 con 0x7f8ef40fde00 2023-12-12T11:49:13.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.766+0000 7f8ee2ffd700 1 -- 172.21.15.63:0/1116221724 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ee800e070 con 0x7f8ef40fde00 2023-12-12T11:49:13.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.766+0000 7f8ef8ccf700 1 -- 172.21.15.63:0/1116221724 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef410eb50 con 0x7f8ef40fde00 2023-12-12T11:49:13.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.767+0000 7f8ef8ccf700 1 -- 172.21.15.63:0/1116221724 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef410f030 con 0x7f8ef40fde00 2023-12-12T11:49:13.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.768+0000 7f8ef8ccf700 1 -- 172.21.15.63:0/1116221724 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef404bb80 con 0x7f8ef40fde00 2023-12-12T11:49:13.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.769+0000 7f8ee2ffd700 1 -- 172.21.15.63:0/1116221724 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f8ee801c570 con 0x7f8ef40fde00 2023-12-12T11:49:13.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.770+0000 7f8ee2ffd700 1 --2- 172.21.15.63:0/1116221724 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f8edc068f70 0x7f8edc06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:13.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.770+0000 7f8ee2ffd700 1 -- 172.21.15.63:0/1116221724 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8ee8087f80 con 0x7f8ef40fde00 2023-12-12T11:49:13.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.770+0000 7f8ef259c700 1 --2- 172.21.15.63:0/1116221724 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f8edc068f70 0x7f8edc06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:13.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.771+0000 7f8ef259c700 1 --2- 172.21.15.63:0/1116221724 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f8edc068f70 0x7f8edc06b420 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4007fd0 tx=0x7f8ee400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:13.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:13.775+0000 7f8ee2ffd700 1 -- 172.21.15.63:0/1116221724 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8ee8057f30 con 0x7f8ef40fde00 2023-12-12T11:49:14.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:14.039+0000 7f8ef8ccf700 1 -- 172.21.15.63:0/1116221724 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8ef4105590 con 0x7f8ef40fde00 2023-12-12T11:49:14.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:14.040+0000 7f8ee2ffd700 1 -- 172.21.15.63:0/1116221724 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1794 (secure 0 0 0) 0x7f8ee8057ac0 con 0x7f8ef40fde00 2023-12-12T11:49:14.042 INFO:teuthology.orchestra.run.smithi063.stdout:e12 2023-12-12T11:49:14.042 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-12T11:49:14.042 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:49:14.042 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-12T11:49:14.042 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:49:14.042 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-12T11:49:14.043 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-12T11:49:14.043 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 12 2023-12-12T11:49:14.043 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-12T11:49:14.043 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-12T11:48:58.523481+0000 2023-12-12T11:49:14.043 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-12T11:49:13.111796+0000 2023-12-12T11:49:14.043 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-12T11:49:14.043 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-12T11:49:14.043 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-12T11:49:14.043 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-12T11:49:14.043 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-12T11:49:14.043 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-12T11:49:14.043 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-12T11:49:14.043 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 46 2023-12-12T11:49:14.043 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:49:14.043 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 1 2023-12-12T11:49:14.043 INFO:teuthology.orchestra.run.smithi063.stdout:in 0 2023-12-12T11:49:14.043 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=14492} 2023-12-12T11:49:14.044 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-12T11:49:14.044 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-12T11:49:14.044 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-12T11:49:14.044 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-12T11:49:14.044 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-12T11:49:14.044 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data enabled 2023-12-12T11:49:14.044 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-12T11:49:14.044 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 1 2023-12-12T11:49:14.044 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.aevpzg{0:14492} state up:rejoin seq 4 join_fscid=1 addr [v2:172.21.15.63:6828/3709000039,v1:172.21.15.63:6829/3709000039] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:49:14.044 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:49:14.044 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:49:14.044 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2023-12-12T11:49:14.044 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:49:14.044 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.swdqms{-1:14500} state up:standby seq 1 addr [v2:172.21.15.93:6826/3307558569,v1:172.21.15.93:6827/3307558569] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:49:14.044 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.bdqbnp{-1:14508} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/2191270944,v1:172.21.15.63:6827/2191270944] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:49:14.045 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.rhaqsh{-1:24317} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.93:6824/3161864019,v1:172.21.15.93:6825/3161864019] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:49:14.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:14.042+0000 7f8ef8ccf700 1 -- 172.21.15.63:0/1116221724 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f8edc068f70 msgr2=0x7f8edc06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:14.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:14.042+0000 7f8ef8ccf700 1 --2- 172.21.15.63:0/1116221724 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f8edc068f70 0x7f8edc06b420 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4007fd0 tx=0x7f8ee400b040 comp rx=0 tx=0).stop 2023-12-12T11:49:14.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:14.042+0000 7f8ef8ccf700 1 -- 172.21.15.63:0/1116221724 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ef40fde00 msgr2=0x7f8ef410da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:14.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:14.042+0000 7f8ef8ccf700 1 --2- 172.21.15.63:0/1116221724 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ef40fde00 0x7f8ef410da30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8009fd0 tx=0x7f8ee8009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:14.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:14.042+0000 7f8ef8ccf700 1 -- 172.21.15.63:0/1116221724 shutdown_connections 2023-12-12T11:49:14.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:14.042+0000 7f8ef8ccf700 1 --2- 172.21.15.63:0/1116221724 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ef40fcbf0 0x7f8ef410d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:14.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:14.042+0000 7f8ef8ccf700 1 --2- 172.21.15.63:0/1116221724 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f8edc068f70 0x7f8edc06b420 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:14.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:14.042+0000 7f8ef8ccf700 1 --2- 172.21.15.63:0/1116221724 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ef40fde00 0x7f8ef410da30 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:14.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:14.042+0000 7f8ef8ccf700 1 -- 172.21.15.63:0/1116221724 >> 172.21.15.63:0/1116221724 conn(0x7f8ef40f82d0 msgr2=0x7f8ef4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:14.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:14.042+0000 7f8ef8ccf700 1 -- 172.21.15.63:0/1116221724 shutdown_connections 2023-12-12T11:49:14.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:14.042+0000 7f8ef8ccf700 1 -- 172.21.15.63:0/1116221724 wait complete. 2023-12-12T11:49:14.046 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 12 2023-12-12T11:49:14.426 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:14 smithi063 ceph-mon[107117]: mds.? [v2:172.21.15.63:6828/3709000039,v1:172.21.15.63:6829/3709000039] up:rejoin 2023-12-12T11:49:14.426 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:14 smithi063 ceph-mon[107117]: fsmap cephfs:1/1 {0=cephfs.smithi063.aevpzg=up:rejoin} 3 up:standby 2023-12-12T11:49:14.426 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:14 smithi063 ceph-mon[107117]: daemon mds.cephfs.smithi063.aevpzg is now active in filesystem cephfs as rank 0 2023-12-12T11:49:14.426 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:14 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/1116221724' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:49:14.450 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2023-12-12T11:49:14.473 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:14 smithi093 ceph-mon[115914]: mds.? [v2:172.21.15.63:6828/3709000039,v1:172.21.15.63:6829/3709000039] up:rejoin 2023-12-12T11:49:14.474 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:14 smithi093 ceph-mon[115914]: fsmap cephfs:1/1 {0=cephfs.smithi063.aevpzg=up:rejoin} 3 up:standby 2023-12-12T11:49:14.474 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:14 smithi093 ceph-mon[115914]: daemon mds.cephfs.smithi063.aevpzg is now active in filesystem cephfs as rank 0 2023-12-12T11:49:14.474 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:14 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/1116221724' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:49:14.921 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:49:15.440 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:15 smithi063 ceph-mon[107117]: pgmap v158: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 716 B/s wr, 2 op/s 2023-12-12T11:49:15.440 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:15 smithi063 ceph-mon[107117]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-12-12T11:49:15.441 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:15 smithi063 ceph-mon[107117]: mds.? [v2:172.21.15.63:6828/3709000039,v1:172.21.15.63:6829/3709000039] up:active 2023-12-12T11:49:15.441 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:15 smithi063 ceph-mon[107117]: mds.? [v2:172.21.15.93:6826/3307558569,v1:172.21.15.93:6827/3307558569] up:standby 2023-12-12T11:49:15.441 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:15 smithi063 ceph-mon[107117]: fsmap cephfs:1 {0=cephfs.smithi063.aevpzg=up:active} 3 up:standby 2023-12-12T11:49:15.441 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:15 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:15.441 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:15 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:15.441 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:15 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:49:15.441 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:15 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:49:15.441 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:15 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:15.441 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:15 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:49:15.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:15 smithi093 ceph-mon[115914]: pgmap v158: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 716 B/s wr, 2 op/s 2023-12-12T11:49:15.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:15 smithi093 ceph-mon[115914]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-12-12T11:49:15.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:15 smithi093 ceph-mon[115914]: mds.? [v2:172.21.15.63:6828/3709000039,v1:172.21.15.63:6829/3709000039] up:active 2023-12-12T11:49:15.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:15 smithi093 ceph-mon[115914]: mds.? [v2:172.21.15.93:6826/3307558569,v1:172.21.15.93:6827/3307558569] up:standby 2023-12-12T11:49:15.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:15 smithi093 ceph-mon[115914]: fsmap cephfs:1 {0=cephfs.smithi063.aevpzg=up:active} 3 up:standby 2023-12-12T11:49:15.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:15 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:15.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:15 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:15.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:15 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:49:15.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:15 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:49:15.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:15 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:15.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:15 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:49:16.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.393+0000 7facc2f68700 1 -- 172.21.15.63:0/158015716 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facbc070570 msgr2=0x7facbc0709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:16.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.393+0000 7facc2f68700 1 --2- 172.21.15.63:0/158015716 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facbc070570 0x7facbc0709c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7faca8004940 tx=0x7faca8009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:16.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.393+0000 7facc2f68700 1 -- 172.21.15.63:0/158015716 shutdown_connections 2023-12-12T11:49:16.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.393+0000 7facc2f68700 1 --2- 172.21.15.63:0/158015716 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facbc070570 0x7facbc0709c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:16.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.393+0000 7facc2f68700 1 --2- 172.21.15.63:0/158015716 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7facbc071bc0 0x7facbc070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:16.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.393+0000 7facc2f68700 1 -- 172.21.15.63:0/158015716 >> 172.21.15.63:0/158015716 conn(0x7facbc0f82d0 msgr2=0x7facbc0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:16.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.393+0000 7facc2f68700 1 -- 172.21.15.63:0/158015716 shutdown_connections 2023-12-12T11:49:16.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.393+0000 7facc2f68700 1 -- 172.21.15.63:0/158015716 wait complete. 2023-12-12T11:49:16.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.394+0000 7facc2f68700 1 Processor -- start 2023-12-12T11:49:16.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.394+0000 7facc2f68700 1 -- start start 2023-12-12T11:49:16.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.394+0000 7facc2f68700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facbc070570 0x7facbc113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:16.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.394+0000 7facc2f68700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7facbc071bc0 0x7facbc114050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:16.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.394+0000 7facc2f68700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facbc114650 con 0x7facbc070570 2023-12-12T11:49:16.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.394+0000 7facc2f68700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facbc114ef0 con 0x7facbc071bc0 2023-12-12T11:49:16.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.395+0000 7facc0d04700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facbc070570 0x7facbc113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:16.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.395+0000 7facc0d04700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facbc070570 0x7facbc113b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35986/0 (socket says 172.21.15.63:35986) 2023-12-12T11:49:16.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.395+0000 7facc0d04700 1 -- 172.21.15.63:0/3761651008 learned_addr learned my addr 172.21.15.63:0/3761651008 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:49:16.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.395+0000 7facbbfff700 1 --2- 172.21.15.63:0/3761651008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7facbc071bc0 0x7facbc114050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:16.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.395+0000 7facc0d04700 1 -- 172.21.15.63:0/3761651008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7facbc071bc0 msgr2=0x7facbc114050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:16.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.395+0000 7facc0d04700 1 --2- 172.21.15.63:0/3761651008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7facbc071bc0 0x7facbc114050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:16.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.395+0000 7facc0d04700 1 -- 172.21.15.63:0/3761651008 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca8005040 con 0x7facbc070570 2023-12-12T11:49:16.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.395+0000 7facc0d04700 1 --2- 172.21.15.63:0/3761651008 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facbc070570 0x7facbc113b10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7facb000eb70 tx=0x7facb000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:16.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.396+0000 7facb97fa700 1 -- 172.21.15.63:0/3761651008 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facb0007cc0 con 0x7facbc070570 2023-12-12T11:49:16.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.396+0000 7facb97fa700 1 -- 172.21.15.63:0/3761651008 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7facb000f040 con 0x7facbc070570 2023-12-12T11:49:16.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.396+0000 7facc2f68700 1 -- 172.21.15.63:0/3761651008 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facbc115170 con 0x7facbc070570 2023-12-12T11:49:16.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.396+0000 7facc2f68700 1 -- 172.21.15.63:0/3761651008 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facbc1156b0 con 0x7facbc070570 2023-12-12T11:49:16.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.396+0000 7facb97fa700 1 -- 172.21.15.63:0/3761651008 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facb000c9f0 con 0x7facbc070570 2023-12-12T11:49:16.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.397+0000 7facc2f68700 1 -- 172.21.15.63:0/3761651008 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facbc04bb80 con 0x7facbc070570 2023-12-12T11:49:16.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.398+0000 7facb97fa700 1 -- 172.21.15.63:0/3761651008 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7facb000cb50 con 0x7facbc070570 2023-12-12T11:49:16.401 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.399+0000 7facb97fa700 1 --2- 172.21.15.63:0/3761651008 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7facac068f60 0x7facac06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:16.401 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.399+0000 7facb97fa700 1 -- 172.21.15.63:0/3761651008 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7facb0086a20 con 0x7facbc070570 2023-12-12T11:49:16.401 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.399+0000 7facbbfff700 1 --2- 172.21.15.63:0/3761651008 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7facac068f60 0x7facac06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:16.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.400+0000 7facbbfff700 1 --2- 172.21.15.63:0/3761651008 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7facac068f60 0x7facac06b410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faca8009fd0 tx=0x7faca8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:16.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.404+0000 7facb97fa700 1 -- 172.21.15.63:0/3761651008 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7facb0056810 con 0x7facbc070570 2023-12-12T11:49:16.677 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.675+0000 7facc2f68700 1 -- 172.21.15.63:0/3761651008 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7facbc115ba0 con 0x7facbc070570 2023-12-12T11:49:16.678 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.675+0000 7facb97fa700 1 -- 172.21.15.63:0/3761651008 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4688 (secure 0 0 0) 0x7facb00563a0 con 0x7facbc070570 2023-12-12T11:49:16.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.678+0000 7facc2f68700 1 -- 172.21.15.63:0/3761651008 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7facac068f60 msgr2=0x7facac06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:16.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.678+0000 7facc2f68700 1 --2- 172.21.15.63:0/3761651008 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7facac068f60 0x7facac06b410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faca8009fd0 tx=0x7faca8009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:16.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.678+0000 7facc2f68700 1 -- 172.21.15.63:0/3761651008 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facbc070570 msgr2=0x7facbc113b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:16.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.678+0000 7facc2f68700 1 --2- 172.21.15.63:0/3761651008 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facbc070570 0x7facbc113b10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7facb000eb70 tx=0x7facb000b040 comp rx=0 tx=0).stop 2023-12-12T11:49:16.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.678+0000 7facc2f68700 1 -- 172.21.15.63:0/3761651008 shutdown_connections 2023-12-12T11:49:16.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.678+0000 7facc2f68700 1 --2- 172.21.15.63:0/3761651008 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7facac068f60 0x7facac06b410 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:16.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.678+0000 7facc2f68700 1 --2- 172.21.15.63:0/3761651008 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facbc070570 0x7facbc113b10 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:16.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.678+0000 7facc2f68700 1 --2- 172.21.15.63:0/3761651008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7facbc071bc0 0x7facbc114050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:16.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.678+0000 7facc2f68700 1 -- 172.21.15.63:0/3761651008 >> 172.21.15.63:0/3761651008 conn(0x7facbc0f82d0 msgr2=0x7facbc0fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:16.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.678+0000 7facc2f68700 1 -- 172.21.15.63:0/3761651008 shutdown_connections 2023-12-12T11:49:16.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:16.678+0000 7facc2f68700 1 -- 172.21.15.63:0/3761651008 wait complete. 2023-12-12T11:49:16.683 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 13 2023-12-12T11:49:16.695 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-12T11:49:17.160 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2023-12-12T11:49:17.226 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:17 smithi063 ceph-mon[107117]: pgmap v159: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 716 B/s wr, 2 op/s 2023-12-12T11:49:17.226 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:17 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/3761651008' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-12T11:49:17.226 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:17 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:17.226 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:17 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:17.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:17 smithi093 ceph-mon[115914]: pgmap v159: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 716 B/s wr, 2 op/s 2023-12-12T11:49:17.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:17 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/3761651008' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-12T11:49:17.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:17 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:17.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:17 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:17.882 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:49:19.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.172+0000 7f8b81f59700 1 -- 172.21.15.63:0/589867286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b7c0fde00 msgr2=0x7f8b7c0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:19.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.172+0000 7f8b81f59700 1 --2- 172.21.15.63:0/589867286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b7c0fde00 0x7f8b7c0fe250 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8b70004940 tx=0x7f8b70009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:19.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.172+0000 7f8b81f59700 1 -- 172.21.15.63:0/589867286 shutdown_connections 2023-12-12T11:49:19.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.172+0000 7f8b81f59700 1 --2- 172.21.15.63:0/589867286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b7c0fde00 0x7f8b7c0fe250 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:19.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.172+0000 7f8b81f59700 1 --2- 172.21.15.63:0/589867286 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b7c0fcbf0 0x7f8b7c0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:19.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.172+0000 7f8b81f59700 1 -- 172.21.15.63:0/589867286 >> 172.21.15.63:0/589867286 conn(0x7f8b7c0f82d0 msgr2=0x7f8b7c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:19.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.172+0000 7f8b81f59700 1 -- 172.21.15.63:0/589867286 shutdown_connections 2023-12-12T11:49:19.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.172+0000 7f8b81f59700 1 -- 172.21.15.63:0/589867286 wait complete. 2023-12-12T11:49:19.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.173+0000 7f8b81f59700 1 Processor -- start 2023-12-12T11:49:19.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.174+0000 7f8b81f59700 1 -- start start 2023-12-12T11:49:19.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.174+0000 7f8b81f59700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b7c0fcbf0 0x7f8b7c10f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:19.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.174+0000 7f8b81f59700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b7c0fde00 0x7f8b7c10fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:19.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.174+0000 7f8b81f59700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c110330 con 0x7f8b7c0fcbf0 2023-12-12T11:49:19.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.174+0000 7f8b81f59700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c110bd0 con 0x7f8b7c0fde00 2023-12-12T11:49:19.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.174+0000 7f8b7b7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b7c0fcbf0 0x7f8b7c10f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:19.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.174+0000 7f8b7b7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b7c0fcbf0 0x7f8b7c10f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47026/0 (socket says 172.21.15.63:47026) 2023-12-12T11:49:19.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.174+0000 7f8b7b7fe700 1 -- 172.21.15.63:0/384676972 learned_addr learned my addr 172.21.15.63:0/384676972 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:49:19.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.174+0000 7f8b7affd700 1 --2- 172.21.15.63:0/384676972 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b7c0fde00 0x7f8b7c10fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:19.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.175+0000 7f8b7b7fe700 1 -- 172.21.15.63:0/384676972 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b7c0fde00 msgr2=0x7f8b7c10fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:19.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.175+0000 7f8b7b7fe700 1 --2- 172.21.15.63:0/384676972 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b7c0fde00 0x7f8b7c10fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:19.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.175+0000 7f8b7b7fe700 1 -- 172.21.15.63:0/384676972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b70005040 con 0x7f8b7c0fcbf0 2023-12-12T11:49:19.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.175+0000 7f8b7b7fe700 1 --2- 172.21.15.63:0/384676972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b7c0fcbf0 0x7f8b7c10f7f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c00c8e0 tx=0x7f8b6c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:19.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.175+0000 7f8b63fff700 1 -- 172.21.15.63:0/384676972 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b6c00a760 con 0x7f8b7c0fcbf0 2023-12-12T11:49:19.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.175+0000 7f8b63fff700 1 -- 172.21.15.63:0/384676972 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8b6c00ad70 con 0x7f8b7c0fcbf0 2023-12-12T11:49:19.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.175+0000 7f8b81f59700 1 -- 172.21.15.63:0/384676972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b7c110eb0 con 0x7f8b7c0fcbf0 2023-12-12T11:49:19.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.175+0000 7f8b63fff700 1 -- 172.21.15.63:0/384676972 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b6c0113a0 con 0x7f8b7c0fcbf0 2023-12-12T11:49:19.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.175+0000 7f8b81f59700 1 -- 172.21.15.63:0/384676972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b7c1113f0 con 0x7f8b7c0fcbf0 2023-12-12T11:49:19.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.176+0000 7f8b81f59700 1 -- 172.21.15.63:0/384676972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b7c101ea0 con 0x7f8b7c0fcbf0 2023-12-12T11:49:19.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.177+0000 7f8b63fff700 1 -- 172.21.15.63:0/384676972 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f8b6c012400 con 0x7f8b7c0fcbf0 2023-12-12T11:49:19.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.179+0000 7f8b63fff700 1 --2- 172.21.15.63:0/384676972 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f8b64068f70 0x7f8b6406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:19.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.179+0000 7f8b63fff700 1 -- 172.21.15.63:0/384676972 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8b6c086dc0 con 0x7f8b7c0fcbf0 2023-12-12T11:49:19.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.179+0000 7f8b7affd700 1 --2- 172.21.15.63:0/384676972 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f8b64068f70 0x7f8b6406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:19.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.180+0000 7f8b7affd700 1 --2- 172.21.15.63:0/384676972 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f8b64068f70 0x7f8b6406b420 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8b700043d0 tx=0x7f8b70009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:19.185 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.183+0000 7f8b63fff700 1 -- 172.21.15.63:0/384676972 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8b6c08a030 con 0x7f8b7c0fcbf0 2023-12-12T11:49:19.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:19 smithi063 ceph-mon[107117]: pgmap v160: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.9 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-12T11:49:19.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:19 smithi093 ceph-mon[115914]: pgmap v160: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.9 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-12T11:49:19.483 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.481+0000 7f8b81f59700 1 -- 172.21.15.63:0/384676972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f8b7c111750 con 0x7f8b7c0fcbf0 2023-12-12T11:49:19.483 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.481+0000 7f8b63fff700 1 -- 172.21.15.63:0/384676972 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v13) v1 ==== 78+0+99 (secure 0 0 0) 0x7f8b6c056cb0 con 0x7f8b7c0fcbf0 2023-12-12T11:49:19.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.484+0000 7f8b81f59700 1 -- 172.21.15.63:0/384676972 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f8b64068f70 msgr2=0x7f8b6406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:19.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.484+0000 7f8b81f59700 1 --2- 172.21.15.63:0/384676972 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f8b64068f70 0x7f8b6406b420 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8b700043d0 tx=0x7f8b70009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:19.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.484+0000 7f8b81f59700 1 -- 172.21.15.63:0/384676972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b7c0fcbf0 msgr2=0x7f8b7c10f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:19.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.484+0000 7f8b81f59700 1 --2- 172.21.15.63:0/384676972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b7c0fcbf0 0x7f8b7c10f7f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c00c8e0 tx=0x7f8b6c0044c0 comp rx=0 tx=0).stop 2023-12-12T11:49:19.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.484+0000 7f8b81f59700 1 -- 172.21.15.63:0/384676972 shutdown_connections 2023-12-12T11:49:19.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.484+0000 7f8b81f59700 1 --2- 172.21.15.63:0/384676972 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f8b64068f70 0x7f8b6406b420 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:19.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.484+0000 7f8b81f59700 1 --2- 172.21.15.63:0/384676972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b7c0fcbf0 0x7f8b7c10f7f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:19.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.484+0000 7f8b81f59700 1 --2- 172.21.15.63:0/384676972 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b7c0fde00 0x7f8b7c10fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:19.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.484+0000 7f8b81f59700 1 -- 172.21.15.63:0/384676972 >> 172.21.15.63:0/384676972 conn(0x7f8b7c0f82d0 msgr2=0x7f8b7c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:19.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.484+0000 7f8b81f59700 1 -- 172.21.15.63:0/384676972 shutdown_connections 2023-12-12T11:49:19.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:19.484+0000 7f8b81f59700 1 -- 172.21.15.63:0/384676972 wait complete. 2023-12-12T11:49:19.500 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-12T11:49:19.872 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2023-12-12T11:49:19.885 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T11:49:20.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.103+0000 7f055ebff700 1 -- 172.21.15.63:0/2178061683 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05580fdcb0 msgr2=0x7f05580fe100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:20.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.103+0000 7f055ebff700 1 --2- 172.21.15.63:0/2178061683 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05580fdcb0 0x7f05580fe100 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0544004940 tx=0x7f0544009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:20.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.103+0000 7f055ebff700 1 -- 172.21.15.63:0/2178061683 shutdown_connections 2023-12-12T11:49:20.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.103+0000 7f055ebff700 1 --2- 172.21.15.63:0/2178061683 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05580fdcb0 0x7f05580fe100 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:20.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.103+0000 7f055ebff700 1 --2- 172.21.15.63:0/2178061683 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f05580fcaa0 0x7f05580fceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:20.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.103+0000 7f055ebff700 1 -- 172.21.15.63:0/2178061683 >> 172.21.15.63:0/2178061683 conn(0x7f05580f8160 msgr2=0x7f05580fa590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:20.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.103+0000 7f055ebff700 1 -- 172.21.15.63:0/2178061683 shutdown_connections 2023-12-12T11:49:20.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.103+0000 7f055ebff700 1 -- 172.21.15.63:0/2178061683 wait complete. 2023-12-12T11:49:20.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.104+0000 7f055ebff700 1 Processor -- start 2023-12-12T11:49:20.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.104+0000 7f055ebff700 1 -- start start 2023-12-12T11:49:20.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.104+0000 7f055ebff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f05580fcaa0 0x7f055810f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:20.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.104+0000 7f055ebff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05580fdcb0 0x7f055810fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:20.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.104+0000 7f055ebff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0558110000 con 0x7f05580fdcb0 2023-12-12T11:49:20.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.104+0000 7f055ebff700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0558110170 con 0x7f05580fcaa0 2023-12-12T11:49:20.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.105+0000 7f0557fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05580fdcb0 0x7f055810fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:20.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.105+0000 7f0557fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05580fdcb0 0x7f055810fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47048/0 (socket says 172.21.15.63:47048) 2023-12-12T11:49:20.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.105+0000 7f0557fff700 1 -- 172.21.15.63:0/1024468584 learned_addr learned my addr 172.21.15.63:0/1024468584 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:49:20.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.105+0000 7f055c99b700 1 --2- 172.21.15.63:0/1024468584 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f05580fcaa0 0x7f055810f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:20.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.105+0000 7f0557fff700 1 -- 172.21.15.63:0/1024468584 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f05580fcaa0 msgr2=0x7f055810f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:20.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.105+0000 7f0557fff700 1 --2- 172.21.15.63:0/1024468584 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f05580fcaa0 0x7f055810f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:20.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.105+0000 7f0557fff700 1 -- 172.21.15.63:0/1024468584 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0544005040 con 0x7f05580fdcb0 2023-12-12T11:49:20.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.105+0000 7f0557fff700 1 --2- 172.21.15.63:0/1024468584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05580fdcb0 0x7f055810fa00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0544009fd0 tx=0x7f0544009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:20.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.105+0000 7f05557fa700 1 -- 172.21.15.63:0/1024468584 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f054400e040 con 0x7f05580fdcb0 2023-12-12T11:49:20.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.106+0000 7f05557fa700 1 -- 172.21.15.63:0/1024468584 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0544004290 con 0x7f05580fdcb0 2023-12-12T11:49:20.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.106+0000 7f05557fa700 1 -- 172.21.15.63:0/1024468584 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f054401c3f0 con 0x7f05580fdcb0 2023-12-12T11:49:20.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.106+0000 7f055ebff700 1 -- 172.21.15.63:0/1024468584 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0558114bc0 con 0x7f05580fdcb0 2023-12-12T11:49:20.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.106+0000 7f055ebff700 1 -- 172.21.15.63:0/1024468584 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0558115180 con 0x7f05580fdcb0 2023-12-12T11:49:20.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.107+0000 7f055ebff700 1 -- 172.21.15.63:0/1024468584 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0558101d50 con 0x7f05580fdcb0 2023-12-12T11:49:20.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.108+0000 7f05557fa700 1 -- 172.21.15.63:0/1024468584 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f054400bc50 con 0x7f05580fdcb0 2023-12-12T11:49:20.111 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.108+0000 7f05557fa700 1 --2- 172.21.15.63:0/1024468584 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f0548068f70 0x7f054806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:20.111 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.109+0000 7f05557fa700 1 -- 172.21.15.63:0/1024468584 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f0544088270 con 0x7f05580fdcb0 2023-12-12T11:49:20.111 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.109+0000 7f055c99b700 1 --2- 172.21.15.63:0/1024468584 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f0548068f70 0x7f054806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:20.111 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.109+0000 7f055c99b700 1 --2- 172.21.15.63:0/1024468584 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f0548068f70 0x7f054806b420 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f05580fdb10 tx=0x7f054c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:20.115 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.113+0000 7f05557fa700 1 -- 172.21.15.63:0/1024468584 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f05440580e0 con 0x7f05580fdcb0 2023-12-12T11:49:20.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.319+0000 7f055ebff700 1 -- 172.21.15.63:0/1024468584 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0558105440 con 0x7f05580fdcb0 2023-12-12T11:49:20.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.320+0000 7f05557fa700 1 -- 172.21.15.63:0/1024468584 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+14359 (secure 0 0 0) 0x7f0544057c70 con 0x7f05580fdcb0 2023-12-12T11:49:20.323 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:49:20.323 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":46,"fsid":"85e33c70-98e3-11ee-95a3-87774f69a715","created":"2023-12-12T11:43:06.421058+0000","modified":"2023-12-12T11:49:11.105141+0000","last_up_change":"2023-12-12T11:48:03.326525+0000","last_in_change":"2023-12-12T11:47:44.737839+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T11:46:58.373192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-12T11:48:57.216360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-12T11:48:58.039176+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6b09da78-38a4-46a4-bf22-b1d21103b497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2424092816},{"type":"v1","addr":"172.21.15.63:6803","nonce":2424092816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2424092816},{"type":"v1","addr":"172.21.15.63:6805","nonce":2424092816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2424092816},{"type":"v1","addr":"172.21.15.63:6809","nonce":2424092816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2424092816},{"type":"v1","addr":"172.21.15.63:6807","nonce":2424092816}]},"public_addr":"172.21.15.63:6803/2424092816","cluster_addr":"172.21.15.63:6805/2424092816","heartbeat_back_addr":"172.21.15.63:6809/2424092816","heartbeat_front_addr":"172.21.15.63:6807/2424092816","state":["exists","up"]},{"osd":1,"uuid":"b45154ac-c018-4aa6-89d4-f22bd94b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":1292346728},{"type":"v1","addr":"172.21.15.63:6811","nonce":1292346728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":1292346728},{"type":"v1","addr":"172.21.15.63:6813","nonce":1292346728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":1292346728},{"type":"v1","addr":"172.21.15.63:6817","nonce":1292346728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":1292346728},{"type":"v1","addr":"172.21.15.63:6815","nonce":1292346728}]},"public_addr":"172.21.15.63:6811/1292346728","cluster_addr":"172.21.15.63:6813/1292346728","heartbeat_back_addr":"172.21.15.63:6817/1292346728","heartbeat_front_addr":"172.21.15.63:6815/1292346728","state":["exists","up"]},{"osd":2,"uuid":"2fcdfc7f-334e-427a-8e1e-b95578c88db5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3760392553},{"type":"v1","addr":"172.21.15.63:6819","nonce":3760392553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":3760392553},{"type":"v1","addr":"172.21.15.63:6821","nonce":3760392553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":3760392553},{"type":"v1","addr":"172.21.15.63:6825","nonce":3760392553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":3760392553},{"type":"v1","addr":"172.21.15.63:6823","nonce":3760392553}]},"public_addr":"172.21.15.63:6819/3760392553","cluster_addr":"172.21.15.63:6821/3760392553","heartbeat_back_addr":"172.21.15.63:6825/3760392553","heartbeat_front_addr":"172.21.15.63:6823/3760392553","state":["exists","up"]},{"osd":3,"uuid":"79666eff-9c6a-4170-b1b6-9fee68b62865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":3547672003},{"type":"v1","addr":"172.21.15.93:6801","nonce":3547672003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":3547672003},{"type":"v1","addr":"172.21.15.93:6803","nonce":3547672003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":3547672003},{"type":"v1","addr":"172.21.15.93:6807","nonce":3547672003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":3547672003},{"type":"v1","addr":"172.21.15.93:6805","nonce":3547672003}]},"public_addr":"172.21.15.93:6801/3547672003","cluster_addr":"172.21.15.93:6803/3547672003","heartbeat_back_addr":"172.21.15.93:6807/3547672003","heartbeat_front_addr":"172.21.15.93:6805/3547672003","state":["exists","up"]},{"osd":4,"uuid":"af069a18-59ca-4e55-a09c-9d4be6e10cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":612058290},{"type":"v1","addr":"172.21.15.93:6809","nonce":612058290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":612058290},{"type":"v1","addr":"172.21.15.93:6811","nonce":612058290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":612058290},{"type":"v1","addr":"172.21.15.93:6815","nonce":612058290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":612058290},{"type":"v1","addr":"172.21.15.93:6813","nonce":612058290}]},"public_addr":"172.21.15.93:6809/612058290","cluster_addr":"172.21.15.93:6811/612058290","heartbeat_back_addr":"172.21.15.93:6815/612058290","heartbeat_front_addr":"172.21.15.93:6813/612058290","state":["exists","up"]},{"osd":5,"uuid":"66901eb6-442c-4808-a5d3-958fd4b8f18d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2174153230},{"type":"v1","addr":"172.21.15.93:6817","nonce":2174153230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2174153230},{"type":"v1","addr":"172.21.15.93:6819","nonce":2174153230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2174153230},{"type":"v1","addr":"172.21.15.93:6823","nonce":2174153230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2174153230},{"type":"v1","addr":"172.21.15.93:6821","nonce":2174153230}]},"public_addr":"172.21.15.93:6817/2174153230","cluster_addr":"172.21.15.93:6819/2174153230","heartbeat_back_addr":"172.21.15.93:6823/2174153230","heartbeat_front_addr":"172.21.15.93:6821/2174153230","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:46:08.420691+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:46:31.277938+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:46:54.903181+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:47:16.535347+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:47:38.988069+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:48:01.641629+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:0/1089809755":"2023-12-13T11:43:38.661897+0000","172.21.15.63:0/3524404486":"2023-12-13T11:43:38.661897+0000","172.21.15.63:0/2270429505":"2023-12-13T11:44:08.715291+0000","172.21.15.63:6801/4048286824":"2023-12-13T11:44:08.715291+0000","172.21.15.63:0/90805296":"2023-12-13T11:43:38.661897+0000","172.21.15.63:6801/1972453923":"2023-12-13T11:43:38.661897+0000","172.21.15.63:6800/4048286824":"2023-12-13T11:44:08.715291+0000","172.21.15.63:6800/1972453923":"2023-12-13T11:43:38.661897+0000","172.21.15.63:0/545666177":"2023-12-13T11:44:08.715291+0000","172.21.15.63:0/1601381023":"2023-12-13T11:44:08.715291+0000","172.21.15.63:0/2015988516":"2023-12-13T11:45:05.780140+0000","172.21.15.63:0/1443572827":"2023-12-13T11:45:05.780140+0000","172.21.15.63:0/1972560506":"2023-12-13T11:45:05.780140+0000","172.21.15.63:6800/293571324":"2023-12-13T11:45:05.780140+0000","172.21.15.63:6801/293571324":"2023-12-13T11:45:05.780140+0000","172.21.15.63:6827/2809808942":"2023-12-13T11:49:11.105112+0000","172.21.15.63:6826/2809808942":"2023-12-13T11:49:11.105112+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T11:49:20.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.323+0000 7f055ebff700 1 -- 172.21.15.63:0/1024468584 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f0548068f70 msgr2=0x7f054806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:20.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.323+0000 7f055ebff700 1 --2- 172.21.15.63:0/1024468584 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f0548068f70 0x7f054806b420 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f05580fdb10 tx=0x7f054c00b040 comp rx=0 tx=0).stop 2023-12-12T11:49:20.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.323+0000 7f055ebff700 1 -- 172.21.15.63:0/1024468584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05580fdcb0 msgr2=0x7f055810fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:20.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.323+0000 7f055ebff700 1 --2- 172.21.15.63:0/1024468584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05580fdcb0 0x7f055810fa00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0544009fd0 tx=0x7f0544009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:20.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.323+0000 7f055ebff700 1 -- 172.21.15.63:0/1024468584 shutdown_connections 2023-12-12T11:49:20.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.323+0000 7f055ebff700 1 --2- 172.21.15.63:0/1024468584 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f05580fcaa0 0x7f055810f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:20.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.323+0000 7f055ebff700 1 --2- 172.21.15.63:0/1024468584 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f0548068f70 0x7f054806b420 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:20.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.323+0000 7f055ebff700 1 --2- 172.21.15.63:0/1024468584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05580fdcb0 0x7f055810fa00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:20.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.323+0000 7f055ebff700 1 -- 172.21.15.63:0/1024468584 >> 172.21.15.63:0/1024468584 conn(0x7f05580f8160 msgr2=0x7f05580feed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:20.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.323+0000 7f055ebff700 1 -- 172.21.15.63:0/1024468584 shutdown_connections 2023-12-12T11:49:20.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.323+0000 7f055ebff700 1 -- 172.21.15.63:0/1024468584 wait complete. 2023-12-12T11:49:20.344 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T11:46:58.373192+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-12T11:48:57.216360+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-12T11:48:58.039176+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T11:49:20.345 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T11:49:20.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:20 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:20.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:20 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:20.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:20 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:49:20.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:20 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:49:20.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:20 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:20.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:20 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/384676972' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2023-12-12T11:49:20.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:20 smithi063 ceph-mon[107117]: pgmap v161: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-12T11:49:20.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:20 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/1024468584' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-12T11:49:20.547 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.545+0000 7fc082bff700 1 -- 172.21.15.63:0/929753818 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc07c0fca40 msgr2=0x7fc07c0fce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:20.547 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.545+0000 7fc082bff700 1 --2- 172.21.15.63:0/929753818 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc07c0fca40 0x7fc07c0fce50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc070004940 tx=0x7fc070009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:20.547 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.545+0000 7fc082bff700 1 -- 172.21.15.63:0/929753818 shutdown_connections 2023-12-12T11:49:20.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.545+0000 7fc082bff700 1 --2- 172.21.15.63:0/929753818 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc07c0fd390 0x7fc07c0fdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:20.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.545+0000 7fc082bff700 1 --2- 172.21.15.63:0/929753818 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc07c0fca40 0x7fc07c0fce50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:20.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.545+0000 7fc082bff700 1 -- 172.21.15.63:0/929753818 >> 172.21.15.63:0/929753818 conn(0x7fc07c0f81c0 msgr2=0x7fc07c0fa610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:20.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.545+0000 7fc082bff700 1 -- 172.21.15.63:0/929753818 shutdown_connections 2023-12-12T11:49:20.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.545+0000 7fc082bff700 1 -- 172.21.15.63:0/929753818 wait complete. 2023-12-12T11:49:20.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.546+0000 7fc082bff700 1 Processor -- start 2023-12-12T11:49:20.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.547+0000 7fc082bff700 1 -- start start 2023-12-12T11:49:20.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.547+0000 7fc082bff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc07c0fca40 0x7fc07c10d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:20.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.547+0000 7fc082bff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc07c0fd390 0x7fc07c10d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:20.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.547+0000 7fc082bff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c10dda0 con 0x7fc07c0fca40 2023-12-12T11:49:20.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.547+0000 7fc082bff700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c10df10 con 0x7fc07c0fd390 2023-12-12T11:49:20.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.547+0000 7fc08099b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc07c0fca40 0x7fc07c10d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:20.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.547+0000 7fc08099b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc07c0fca40 0x7fc07c10d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47072/0 (socket says 172.21.15.63:47072) 2023-12-12T11:49:20.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.547+0000 7fc08099b700 1 -- 172.21.15.63:0/2029664791 learned_addr learned my addr 172.21.15.63:0/2029664791 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:49:20.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.548+0000 7fc07bfff700 1 --2- 172.21.15.63:0/2029664791 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc07c0fd390 0x7fc07c10d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:20.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.548+0000 7fc08099b700 1 -- 172.21.15.63:0/2029664791 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc07c0fd390 msgr2=0x7fc07c10d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:20.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.548+0000 7fc08099b700 1 --2- 172.21.15.63:0/2029664791 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc07c0fd390 0x7fc07c10d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:20.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.548+0000 7fc08099b700 1 -- 172.21.15.63:0/2029664791 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc070005040 con 0x7fc07c0fca40 2023-12-12T11:49:20.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.548+0000 7fc08099b700 1 --2- 172.21.15.63:0/2029664791 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc07c0fca40 0x7fc07c10d260 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc070009fd0 tx=0x7fc070009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:20.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.548+0000 7fc0797fa700 1 -- 172.21.15.63:0/2029664791 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc070021070 con 0x7fc07c0fca40 2023-12-12T11:49:20.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.548+0000 7fc0797fa700 1 -- 172.21.15.63:0/2029664791 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc07001c400 con 0x7fc07c0fca40 2023-12-12T11:49:20.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.548+0000 7fc082bff700 1 -- 172.21.15.63:0/2029664791 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc07c112960 con 0x7fc07c0fca40 2023-12-12T11:49:20.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.548+0000 7fc0797fa700 1 -- 172.21.15.63:0/2029664791 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc07000e070 con 0x7fc07c0fca40 2023-12-12T11:49:20.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.548+0000 7fc082bff700 1 -- 172.21.15.63:0/2029664791 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc07c112ec0 con 0x7fc07c0fca40 2023-12-12T11:49:20.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.549+0000 7fc082bff700 1 -- 172.21.15.63:0/2029664791 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc07c105440 con 0x7fc07c0fca40 2023-12-12T11:49:20.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.550+0000 7fc0797fa700 1 -- 172.21.15.63:0/2029664791 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fc07001c9c0 con 0x7fc07c0fca40 2023-12-12T11:49:20.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.551+0000 7fc0797fa700 1 --2- 172.21.15.63:0/2029664791 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fc06c068f70 0x7fc06c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:20.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.551+0000 7fc0797fa700 1 -- 172.21.15.63:0/2029664791 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc070087ff0 con 0x7fc07c0fca40 2023-12-12T11:49:20.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.551+0000 7fc07bfff700 1 --2- 172.21.15.63:0/2029664791 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fc06c068f70 0x7fc06c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:20.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.552+0000 7fc07bfff700 1 --2- 172.21.15.63:0/2029664791 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fc06c068f70 0x7fc06c06b420 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc068004600 tx=0x7fc06800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:20.557 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.555+0000 7fc0797fa700 1 -- 172.21.15.63:0/2029664791 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc070057f20 con 0x7fc07c0fca40 2023-12-12T11:49:20.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:20 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:20.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:20 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:20.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:20 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:49:20.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:20 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:49:20.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:20 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:20.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:20 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/384676972' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2023-12-12T11:49:20.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:20 smithi093 ceph-mon[115914]: pgmap v161: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-12T11:49:20.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:20 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/1024468584' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-12T11:49:20.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.761+0000 7fc082bff700 1 -- 172.21.15.63:0/2029664791 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc07c113170 con 0x7fc07c0fca40 2023-12-12T11:49:20.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.761+0000 7fc0797fa700 1 -- 172.21.15.63:0/2029664791 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc070057ab0 con 0x7fc07c0fca40 2023-12-12T11:49:20.763 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-12T11:49:20.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.763+0000 7fc082bff700 1 -- 172.21.15.63:0/2029664791 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fc06c068f70 msgr2=0x7fc06c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:20.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.763+0000 7fc082bff700 1 --2- 172.21.15.63:0/2029664791 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fc06c068f70 0x7fc06c06b420 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc068004600 tx=0x7fc06800b040 comp rx=0 tx=0).stop 2023-12-12T11:49:20.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.763+0000 7fc082bff700 1 -- 172.21.15.63:0/2029664791 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc07c0fca40 msgr2=0x7fc07c10d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:20.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.763+0000 7fc082bff700 1 --2- 172.21.15.63:0/2029664791 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc07c0fca40 0x7fc07c10d260 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc070009fd0 tx=0x7fc070009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:20.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.764+0000 7fc082bff700 1 -- 172.21.15.63:0/2029664791 shutdown_connections 2023-12-12T11:49:20.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.764+0000 7fc082bff700 1 --2- 172.21.15.63:0/2029664791 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fc06c068f70 0x7fc06c06b420 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:20.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.764+0000 7fc082bff700 1 --2- 172.21.15.63:0/2029664791 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc07c0fca40 0x7fc07c10d260 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:20.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.764+0000 7fc082bff700 1 --2- 172.21.15.63:0/2029664791 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc07c0fd390 0x7fc07c10d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:20.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.764+0000 7fc082bff700 1 -- 172.21.15.63:0/2029664791 >> 172.21.15.63:0/2029664791 conn(0x7fc07c0f81c0 msgr2=0x7fc07c100f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:20.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.764+0000 7fc082bff700 1 -- 172.21.15.63:0/2029664791 shutdown_connections 2023-12-12T11:49:20.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.764+0000 7fc082bff700 1 -- 172.21.15.63:0/2029664791 wait complete. 2023-12-12T11:49:20.784 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-12T11:49:20.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.985+0000 7f4f179ff700 1 -- 172.21.15.63:0/2443942273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f100fca40 msgr2=0x7f4f100fce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:20.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.985+0000 7f4f179ff700 1 --2- 172.21.15.63:0/2443942273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f100fca40 0x7f4f100fce50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c004940 tx=0x7f4f0c009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:20.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.985+0000 7f4f179ff700 1 -- 172.21.15.63:0/2443942273 shutdown_connections 2023-12-12T11:49:20.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.985+0000 7f4f179ff700 1 --2- 172.21.15.63:0/2443942273 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4f100fd390 0x7f4f100fdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:20.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.985+0000 7f4f179ff700 1 --2- 172.21.15.63:0/2443942273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f100fca40 0x7f4f100fce50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:20.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.985+0000 7f4f179ff700 1 -- 172.21.15.63:0/2443942273 >> 172.21.15.63:0/2443942273 conn(0x7f4f100f81c0 msgr2=0x7f4f100fa610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:20.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.985+0000 7f4f179ff700 1 -- 172.21.15.63:0/2443942273 shutdown_connections 2023-12-12T11:49:20.989 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.985+0000 7f4f179ff700 1 -- 172.21.15.63:0/2443942273 wait complete. 2023-12-12T11:49:20.989 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.986+0000 7f4f179ff700 1 Processor -- start 2023-12-12T11:49:20.989 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.986+0000 7f4f179ff700 1 -- start start 2023-12-12T11:49:20.990 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.986+0000 7f4f179ff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f100fca40 0x7f4f1010d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:20.990 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.986+0000 7f4f179ff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4f100fd390 0x7f4f1010d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:20.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.986+0000 7f4f179ff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1010dda0 con 0x7f4f100fca40 2023-12-12T11:49:20.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.986+0000 7f4f179ff700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1010df10 con 0x7f4f100fd390 2023-12-12T11:49:20.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.986+0000 7f4f1579b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f100fca40 0x7f4f1010d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:20.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.986+0000 7f4f1579b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f100fca40 0x7f4f1010d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47092/0 (socket says 172.21.15.63:47092) 2023-12-12T11:49:20.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.986+0000 7f4f1579b700 1 -- 172.21.15.63:0/605906116 learned_addr learned my addr 172.21.15.63:0/605906116 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:49:20.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.987+0000 7f4f14f9a700 1 --2- 172.21.15.63:0/605906116 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4f100fd390 0x7f4f1010d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:20.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.987+0000 7f4f1579b700 1 -- 172.21.15.63:0/605906116 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4f100fd390 msgr2=0x7f4f1010d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:20.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.987+0000 7f4f1579b700 1 --2- 172.21.15.63:0/605906116 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4f100fd390 0x7f4f1010d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:20.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.987+0000 7f4f1579b700 1 -- 172.21.15.63:0/605906116 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c005040 con 0x7f4f100fca40 2023-12-12T11:49:20.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.987+0000 7f4f14f9a700 1 --2- 172.21.15.63:0/605906116 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4f100fd390 0x7f4f1010d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T11:49:20.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.987+0000 7f4f1579b700 1 --2- 172.21.15.63:0/605906116 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f100fca40 0x7f4f1010d260 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c008f80 tx=0x7f4f0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:20.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.987+0000 7f4f05ffb700 1 -- 172.21.15.63:0/605906116 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f0c021070 con 0x7f4f100fca40 2023-12-12T11:49:20.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.987+0000 7f4f05ffb700 1 -- 172.21.15.63:0/605906116 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4f0c01c400 con 0x7f4f100fca40 2023-12-12T11:49:20.992 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.987+0000 7f4f179ff700 1 -- 172.21.15.63:0/605906116 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f10112960 con 0x7f4f100fca40 2023-12-12T11:49:20.992 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.987+0000 7f4f05ffb700 1 -- 172.21.15.63:0/605906116 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f0c00e070 con 0x7f4f100fca40 2023-12-12T11:49:20.992 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.987+0000 7f4f179ff700 1 -- 172.21.15.63:0/605906116 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f10112ec0 con 0x7f4f100fca40 2023-12-12T11:49:20.992 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.988+0000 7f4f179ff700 1 -- 172.21.15.63:0/605906116 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f10105440 con 0x7f4f100fca40 2023-12-12T11:49:20.992 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.989+0000 7f4f05ffb700 1 -- 172.21.15.63:0/605906116 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f4f0c01c9c0 con 0x7f4f100fca40 2023-12-12T11:49:20.992 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.990+0000 7f4f05ffb700 1 --2- 172.21.15.63:0/605906116 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4efc068f70 0x7f4efc06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:20.993 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.990+0000 7f4f05ffb700 1 -- 172.21.15.63:0/605906116 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4f0c088090 con 0x7f4f100fca40 2023-12-12T11:49:20.993 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.990+0000 7f4f14f9a700 1 --2- 172.21.15.63:0/605906116 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4efc068f70 0x7f4efc06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:20.993 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.991+0000 7f4f14f9a700 1 --2- 172.21.15.63:0/605906116 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4efc068f70 0x7f4efc06b420 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4f00004600 tx=0x7f4f0000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:20.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:20.994+0000 7f4f05ffb700 1 -- 172.21.15.63:0/605906116 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4f0c057fa0 con 0x7f4f100fca40 2023-12-12T11:49:21.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.197+0000 7f4f179ff700 1 -- 172.21.15.63:0/605906116 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f4f101131a0 con 0x7f4f100fca40 2023-12-12T11:49:21.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.198+0000 7f4f05ffb700 1 -- 172.21.15.63:0/605906116 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7f4f0c057b30 con 0x7f4f100fca40 2023-12-12T11:49:21.200 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-12T11:49:21.202 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.200+0000 7f4f179ff700 1 -- 172.21.15.63:0/605906116 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4efc068f70 msgr2=0x7f4efc06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:21.202 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.200+0000 7f4f179ff700 1 --2- 172.21.15.63:0/605906116 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4efc068f70 0x7f4efc06b420 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4f00004600 tx=0x7f4f0000b040 comp rx=0 tx=0).stop 2023-12-12T11:49:21.202 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.200+0000 7f4f179ff700 1 -- 172.21.15.63:0/605906116 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f100fca40 msgr2=0x7f4f1010d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:21.202 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.200+0000 7f4f179ff700 1 --2- 172.21.15.63:0/605906116 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f100fca40 0x7f4f1010d260 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c008f80 tx=0x7f4f0c009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:21.203 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.200+0000 7f4f179ff700 1 -- 172.21.15.63:0/605906116 shutdown_connections 2023-12-12T11:49:21.203 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.200+0000 7f4f179ff700 1 --2- 172.21.15.63:0/605906116 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4efc068f70 0x7f4efc06b420 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:21.203 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.200+0000 7f4f179ff700 1 --2- 172.21.15.63:0/605906116 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f100fca40 0x7f4f1010d260 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:21.203 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.200+0000 7f4f179ff700 1 --2- 172.21.15.63:0/605906116 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4f100fd390 0x7f4f1010d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:21.203 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.200+0000 7f4f179ff700 1 -- 172.21.15.63:0/605906116 >> 172.21.15.63:0/605906116 conn(0x7f4f100f81c0 msgr2=0x7f4f10100f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:21.203 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.200+0000 7f4f179ff700 1 -- 172.21.15.63:0/605906116 shutdown_connections 2023-12-12T11:49:21.203 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.200+0000 7f4f179ff700 1 -- 172.21.15.63:0/605906116 wait complete. 2023-12-12T11:49:21.221 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-12T11:49:21.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.422+0000 7ffbc43ff700 1 -- 172.21.15.63:0/1023634642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffbbc070570 msgr2=0x7ffbbc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:21.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.422+0000 7ffbc43ff700 1 --2- 172.21.15.63:0/1023634642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffbbc070570 0x7ffbbc0709e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ffbac004940 tx=0x7ffbac009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:21.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.423+0000 7ffbc43ff700 1 -- 172.21.15.63:0/1023634642 shutdown_connections 2023-12-12T11:49:21.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.423+0000 7ffbc43ff700 1 --2- 172.21.15.63:0/1023634642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffbbc070570 0x7ffbbc0709e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:21.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.423+0000 7ffbc43ff700 1 --2- 172.21.15.63:0/1023634642 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbbc071b30 0x7ffbbc070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:21.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.423+0000 7ffbc43ff700 1 -- 172.21.15.63:0/1023634642 >> 172.21.15.63:0/1023634642 conn(0x7ffbbc0f81c0 msgr2=0x7ffbbc0fa610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:21.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.423+0000 7ffbc43ff700 1 -- 172.21.15.63:0/1023634642 shutdown_connections 2023-12-12T11:49:21.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.423+0000 7ffbc43ff700 1 -- 172.21.15.63:0/1023634642 wait complete. 2023-12-12T11:49:21.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.423+0000 7ffbc43ff700 1 Processor -- start 2023-12-12T11:49:21.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.424+0000 7ffbc43ff700 1 -- start start 2023-12-12T11:49:21.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.424+0000 7ffbc43ff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffbbc070570 0x7ffbbc10f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:21.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.424+0000 7ffbc43ff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbbc071b30 0x7ffbbc10fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:21.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.424+0000 7ffbc43ff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc110090 con 0x7ffbbc070570 2023-12-12T11:49:21.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.424+0000 7ffbc43ff700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc114a80 con 0x7ffbbc071b30 2023-12-12T11:49:21.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.424+0000 7ffbc219b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffbbc070570 0x7ffbbc10f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:21.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.424+0000 7ffbc219b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffbbc070570 0x7ffbbc10f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47108/0 (socket says 172.21.15.63:47108) 2023-12-12T11:49:21.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.424+0000 7ffbc219b700 1 -- 172.21.15.63:0/2028890068 learned_addr learned my addr 172.21.15.63:0/2028890068 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:49:21.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.425+0000 7ffbc199a700 1 --2- 172.21.15.63:0/2028890068 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbbc071b30 0x7ffbbc10fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:21.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.425+0000 7ffbc219b700 1 -- 172.21.15.63:0/2028890068 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbbc071b30 msgr2=0x7ffbbc10fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:21.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.425+0000 7ffbc219b700 1 --2- 172.21.15.63:0/2028890068 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbbc071b30 0x7ffbbc10fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:21.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.425+0000 7ffbc219b700 1 -- 172.21.15.63:0/2028890068 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbac005040 con 0x7ffbbc070570 2023-12-12T11:49:21.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.425+0000 7ffbc219b700 1 --2- 172.21.15.63:0/2028890068 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffbbc070570 0x7ffbbc10f4c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800b790 tx=0x7ffbb8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:21.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.425+0000 7ffbb2ffd700 1 -- 172.21.15.63:0/2028890068 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbb800f6f0 con 0x7ffbbc070570 2023-12-12T11:49:21.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.425+0000 7ffbb2ffd700 1 -- 172.21.15.63:0/2028890068 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffbb800fd00 con 0x7ffbbc070570 2023-12-12T11:49:21.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.425+0000 7ffbc43ff700 1 -- 172.21.15.63:0/2028890068 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbbc114ce0 con 0x7ffbbc070570 2023-12-12T11:49:21.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.425+0000 7ffbb2ffd700 1 -- 172.21.15.63:0/2028890068 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbb80103a0 con 0x7ffbbc070570 2023-12-12T11:49:21.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.425+0000 7ffbc43ff700 1 -- 172.21.15.63:0/2028890068 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbbc115200 con 0x7ffbbc070570 2023-12-12T11:49:21.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.426+0000 7ffbc43ff700 1 -- 172.21.15.63:0/2028890068 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbbc1076c0 con 0x7ffbbc070570 2023-12-12T11:49:21.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.427+0000 7ffbb2ffd700 1 -- 172.21.15.63:0/2028890068 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ffbb800f850 con 0x7ffbbc070570 2023-12-12T11:49:21.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.428+0000 7ffbb2ffd700 1 --2- 172.21.15.63:0/2028890068 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ffba8068f70 0x7ffba806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:21.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.428+0000 7ffbb2ffd700 1 -- 172.21.15.63:0/2028890068 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ffbb8086c10 con 0x7ffbbc070570 2023-12-12T11:49:21.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.428+0000 7ffbc199a700 1 --2- 172.21.15.63:0/2028890068 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ffba8068f70 0x7ffba806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:21.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.429+0000 7ffbc199a700 1 --2- 172.21.15.63:0/2028890068 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ffba8068f70 0x7ffba806b420 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffbac004f90 tx=0x7ffbac009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:21.434 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.432+0000 7ffbb2ffd700 1 -- 172.21.15.63:0/2028890068 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ffbb8056a80 con 0x7ffbbc070570 2023-12-12T11:49:21.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:21 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/2029664791' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-12T11:49:21.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:21 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:21.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:21 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:49:21.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:21 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/605906116' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-12T11:49:21.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.635+0000 7ffbc43ff700 1 -- 172.21.15.63:0/2028890068 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7ffbbc115450 con 0x7ffbbc070570 2023-12-12T11:49:21.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.635+0000 7ffbb2ffd700 1 -- 172.21.15.63:0/2028890068 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7ffbb8056610 con 0x7ffbbc070570 2023-12-12T11:49:21.638 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-12T11:49:21.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.638+0000 7ffbc43ff700 1 -- 172.21.15.63:0/2028890068 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ffba8068f70 msgr2=0x7ffba806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:21.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.638+0000 7ffbc43ff700 1 --2- 172.21.15.63:0/2028890068 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ffba8068f70 0x7ffba806b420 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffbac004f90 tx=0x7ffbac009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:21.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.638+0000 7ffbc43ff700 1 -- 172.21.15.63:0/2028890068 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffbbc070570 msgr2=0x7ffbbc10f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:21.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.638+0000 7ffbc43ff700 1 --2- 172.21.15.63:0/2028890068 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffbbc070570 0x7ffbbc10f4c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800b790 tx=0x7ffbb8009220 comp rx=0 tx=0).stop 2023-12-12T11:49:21.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.638+0000 7ffbc43ff700 1 -- 172.21.15.63:0/2028890068 shutdown_connections 2023-12-12T11:49:21.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.638+0000 7ffbc43ff700 1 --2- 172.21.15.63:0/2028890068 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ffba8068f70 0x7ffba806b420 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:21.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.638+0000 7ffbc43ff700 1 --2- 172.21.15.63:0/2028890068 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffbbc070570 0x7ffbbc10f4c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:21.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.638+0000 7ffbc43ff700 1 --2- 172.21.15.63:0/2028890068 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbbc071b30 0x7ffbbc10fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:21.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.638+0000 7ffbc43ff700 1 -- 172.21.15.63:0/2028890068 >> 172.21.15.63:0/2028890068 conn(0x7ffbbc0f81c0 msgr2=0x7ffbbc1029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:21.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.638+0000 7ffbc43ff700 1 -- 172.21.15.63:0/2028890068 shutdown_connections 2023-12-12T11:49:21.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.638+0000 7ffbc43ff700 1 -- 172.21.15.63:0/2028890068 wait complete. 2023-12-12T11:49:21.658 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T11:49:21.720 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:21 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/2029664791' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-12T11:49:21.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:21 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:21.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:21 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:49:21.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:21 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/605906116' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-12T11:49:21.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.855+0000 7f1b5f3ff700 1 -- 172.21.15.63:0/2310705572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b580fdc90 msgr2=0x7f1b580fe0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:21.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.855+0000 7f1b5f3ff700 1 --2- 172.21.15.63:0/2310705572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b580fdc90 0x7f1b580fe0e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1b48004940 tx=0x7f1b48009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:21.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.855+0000 7f1b5f3ff700 1 -- 172.21.15.63:0/2310705572 shutdown_connections 2023-12-12T11:49:21.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.855+0000 7f1b5f3ff700 1 --2- 172.21.15.63:0/2310705572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b580fdc90 0x7f1b580fe0e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:21.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.855+0000 7f1b5f3ff700 1 --2- 172.21.15.63:0/2310705572 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1b580fca80 0x7f1b580fce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:21.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.855+0000 7f1b5f3ff700 1 -- 172.21.15.63:0/2310705572 >> 172.21.15.63:0/2310705572 conn(0x7f1b580f8100 msgr2=0x7f1b580fa570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:21.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.855+0000 7f1b5f3ff700 1 -- 172.21.15.63:0/2310705572 shutdown_connections 2023-12-12T11:49:21.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.855+0000 7f1b5f3ff700 1 -- 172.21.15.63:0/2310705572 wait complete. 2023-12-12T11:49:21.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.856+0000 7f1b5f3ff700 1 Processor -- start 2023-12-12T11:49:21.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.856+0000 7f1b5f3ff700 1 -- start start 2023-12-12T11:49:21.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.857+0000 7f1b5f3ff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1b580fca80 0x7f1b5810f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:21.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.857+0000 7f1b5f3ff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b580fdc90 0x7f1b5810f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:21.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.857+0000 7f1b5f3ff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5810ffc0 con 0x7f1b580fdc90 2023-12-12T11:49:21.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.857+0000 7f1b5f3ff700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b58110130 con 0x7f1b580fca80 2023-12-12T11:49:21.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.857+0000 7f1b5c99a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b580fdc90 0x7f1b5810f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:21.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.857+0000 7f1b5c99a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b580fdc90 0x7f1b5810f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47134/0 (socket says 172.21.15.63:47134) 2023-12-12T11:49:21.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.857+0000 7f1b5c99a700 1 -- 172.21.15.63:0/3592450937 learned_addr learned my addr 172.21.15.63:0/3592450937 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:49:21.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.857+0000 7f1b5d19b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1b580fca80 0x7f1b5810f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:21.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.857+0000 7f1b5c99a700 1 -- 172.21.15.63:0/3592450937 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1b580fca80 msgr2=0x7f1b5810f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:21.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.857+0000 7f1b5c99a700 1 --2- 172.21.15.63:0/3592450937 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1b580fca80 0x7f1b5810f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:21.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.857+0000 7f1b5c99a700 1 -- 172.21.15.63:0/3592450937 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b48005040 con 0x7f1b580fdc90 2023-12-12T11:49:21.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.858+0000 7f1b5c99a700 1 --2- 172.21.15.63:0/3592450937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b580fdc90 0x7f1b5810f9c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1b48009fd0 tx=0x7f1b48009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:21.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.858+0000 7f1b4dffb700 1 -- 172.21.15.63:0/3592450937 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b48021070 con 0x7f1b580fdc90 2023-12-12T11:49:21.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.858+0000 7f1b4dffb700 1 -- 172.21.15.63:0/3592450937 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1b4801c400 con 0x7f1b580fdc90 2023-12-12T11:49:21.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.858+0000 7f1b5f3ff700 1 -- 172.21.15.63:0/3592450937 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b58114b80 con 0x7f1b580fdc90 2023-12-12T11:49:21.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.858+0000 7f1b4dffb700 1 -- 172.21.15.63:0/3592450937 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b4800e070 con 0x7f1b580fdc90 2023-12-12T11:49:21.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.858+0000 7f1b5f3ff700 1 -- 172.21.15.63:0/3592450937 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b58115140 con 0x7f1b580fdc90 2023-12-12T11:49:21.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.859+0000 7f1b5f3ff700 1 -- 172.21.15.63:0/3592450937 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b58101d30 con 0x7f1b580fdc90 2023-12-12T11:49:21.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.860+0000 7f1b4dffb700 1 -- 172.21.15.63:0/3592450937 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f1b4801c570 con 0x7f1b580fdc90 2023-12-12T11:49:21.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.861+0000 7f1b4dffb700 1 --2- 172.21.15.63:0/3592450937 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f1b44068f70 0x7f1b4406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:21.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.861+0000 7f1b4dffb700 1 -- 172.21.15.63:0/3592450937 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1b48088090 con 0x7f1b580fdc90 2023-12-12T11:49:21.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.861+0000 7f1b5d19b700 1 --2- 172.21.15.63:0/3592450937 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f1b44068f70 0x7f1b4406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:21.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.862+0000 7f1b5d19b700 1 --2- 172.21.15.63:0/3592450937 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f1b44068f70 0x7f1b4406b420 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1b54009b80 tx=0x7f1b5400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:21.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:21.866+0000 7f1b4dffb700 1 -- 172.21.15.63:0/3592450937 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1b48057fa0 con 0x7f1b580fdc90 2023-12-12T11:49:22.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:22.116+0000 7f1b5f3ff700 1 -- 172.21.15.63:0/3592450937 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b5802b0e0 con 0x7f1b580fdc90 2023-12-12T11:49:22.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:22.117+0000 7f1b4dffb700 1 -- 172.21.15.63:0/3592450937 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4688 (secure 0 0 0) 0x7f1b48057b30 con 0x7f1b580fdc90 2023-12-12T11:49:22.119 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:49:22.119 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14500,"name":"cephfs.smithi093.swdqms","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.93:6827/3307558569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":3307558569},{"type":"v1","addr":"172.21.15.93:6827","nonce":3307558569}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":14508,"name":"cephfs.smithi063.bdqbnp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6827/2191270944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2191270944},{"type":"v1","addr":"172.21.15.63:6827","nonce":2191270944}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24317,"name":"cephfs.smithi093.rhaqsh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.93:6825/3161864019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":3161864019},{"type":"v1","addr":"172.21.15.93:6825","nonce":3161864019}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T11:48:58.523481+0000","modified":"2023-12-12T11:49:14.113993+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14492":{"gid":14492,"name":"cephfs.smithi063.aevpzg","rank":0,"incarnation":10,"state":"up:active","state_seq":5,"addr":"172.21.15.63:6829/3709000039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":3709000039},{"type":"v1","addr":"172.21.15.63:6829","nonce":3709000039}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-12-12T11:49:22.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:22.119+0000 7f1b5f3ff700 1 -- 172.21.15.63:0/3592450937 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f1b44068f70 msgr2=0x7f1b4406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:22.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:22.119+0000 7f1b5f3ff700 1 --2- 172.21.15.63:0/3592450937 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f1b44068f70 0x7f1b4406b420 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1b54009b80 tx=0x7f1b5400b040 comp rx=0 tx=0).stop 2023-12-12T11:49:22.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:22.119+0000 7f1b5f3ff700 1 -- 172.21.15.63:0/3592450937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b580fdc90 msgr2=0x7f1b5810f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:22.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:22.119+0000 7f1b5f3ff700 1 --2- 172.21.15.63:0/3592450937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b580fdc90 0x7f1b5810f9c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1b48009fd0 tx=0x7f1b48009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:22.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:22.119+0000 7f1b5f3ff700 1 -- 172.21.15.63:0/3592450937 shutdown_connections 2023-12-12T11:49:22.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:22.119+0000 7f1b5f3ff700 1 --2- 172.21.15.63:0/3592450937 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1b580fca80 0x7f1b5810f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:22.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:22.119+0000 7f1b5f3ff700 1 --2- 172.21.15.63:0/3592450937 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f1b44068f70 0x7f1b4406b420 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:22.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:22.119+0000 7f1b5f3ff700 1 --2- 172.21.15.63:0/3592450937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b580fdc90 0x7f1b5810f9c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:22.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:22.119+0000 7f1b5f3ff700 1 -- 172.21.15.63:0/3592450937 >> 172.21.15.63:0/3592450937 conn(0x7f1b580f8100 msgr2=0x7f1b580feeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:22.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:22.119+0000 7f1b5f3ff700 1 -- 172.21.15.63:0/3592450937 shutdown_connections 2023-12-12T11:49:22.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:22.119+0000 7f1b5f3ff700 1 -- 172.21.15.63:0/3592450937 wait complete. 2023-12-12T11:49:22.122 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 13 2023-12-12T11:49:22.140 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 13, 'max_mds': 1, 'flags': 18} 2023-12-12T11:49:22.140 INFO:teuthology.run_tasks:Running task kclient... 2023-12-12T11:49:22.166 INFO:tasks.kclient:Mounting kernel clients... 2023-12-12T11:49:22.166 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-12-12T11:49:22.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:22.166 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2023-12-12T11:49:22.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:22.215 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link delete ceph-brx 2023-12-12T11:49:22.289 INFO:teuthology.orchestra.run.smithi063.stderr:Cannot find device "ceph-brx" 2023-12-12T11:49:22.292 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T11:49:22.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:22.293 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list 2023-12-12T11:49:22.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:22.348 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link delete ceph-brx 2023-12-12T11:49:22.437 INFO:teuthology.orchestra.run.smithi093.stderr:Cannot find device "ceph-brx" 2023-12-12T11:49:22.440 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T11:49:22.440 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-12-12T11:49:22.441 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-12T11:49:22.441 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-12T11:49:22.441 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph fs ls 2023-12-12T11:49:22.720 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:22 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/2028890068' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-12T11:49:22.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:22 smithi093 ceph-mon[115914]: pgmap v162: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.8 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-12T11:49:22.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:22 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/3592450937' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-12T11:49:22.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:22 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/2028890068' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-12T11:49:22.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:22 smithi063 ceph-mon[107117]: pgmap v162: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.8 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-12T11:49:22.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:22 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/3592450937' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-12T11:49:22.880 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:49:24.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.054+0000 7fb7a4f78700 1 -- 172.21.15.63:0/1319924696 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7a0102c00 msgr2=0x7fb7a0102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:24.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.054+0000 7fb7a4f78700 1 --2- 172.21.15.63:0/1319924696 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7a0102c00 0x7fb7a0102fd0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb790004940 tx=0x7fb790009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:24.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.055+0000 7fb7a4f78700 1 -- 172.21.15.63:0/1319924696 shutdown_connections 2023-12-12T11:49:24.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.055+0000 7fb7a4f78700 1 --2- 172.21.15.63:0/1319924696 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7a01035a0 0x7fb7a00fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:24.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.055+0000 7fb7a4f78700 1 --2- 172.21.15.63:0/1319924696 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7a0102c00 0x7fb7a0102fd0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:24.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.055+0000 7fb7a4f78700 1 -- 172.21.15.63:0/1319924696 >> 172.21.15.63:0/1319924696 conn(0x7fb7a00f8790 msgr2=0x7fb7a00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:24.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.055+0000 7fb7a4f78700 1 -- 172.21.15.63:0/1319924696 shutdown_connections 2023-12-12T11:49:24.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.055+0000 7fb7a4f78700 1 -- 172.21.15.63:0/1319924696 wait complete. 2023-12-12T11:49:24.059 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.056+0000 7fb7a4f78700 1 Processor -- start 2023-12-12T11:49:24.059 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.056+0000 7fb7a4f78700 1 -- start start 2023-12-12T11:49:24.059 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.056+0000 7fb7a4f78700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7a0102c00 0x7fb7a01157d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:24.059 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.056+0000 7fb7a4f78700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7a01035a0 0x7fb7a0115d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:24.059 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.056+0000 7fb7a4f78700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a0116360 con 0x7fb7a01035a0 2023-12-12T11:49:24.059 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.056+0000 7fb7a4f78700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a010f690 con 0x7fb7a0102c00 2023-12-12T11:49:24.059 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.057+0000 7fb79dd9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7a01035a0 0x7fb7a0115d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:24.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.057+0000 7fb79dd9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7a01035a0 0x7fb7a0115d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47152/0 (socket says 172.21.15.63:47152) 2023-12-12T11:49:24.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.057+0000 7fb79dd9b700 1 -- 172.21.15.63:0/942006516 learned_addr learned my addr 172.21.15.63:0/942006516 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:49:24.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.057+0000 7fb79e59c700 1 --2- 172.21.15.63:0/942006516 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7a0102c00 0x7fb7a01157d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:24.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.057+0000 7fb79dd9b700 1 -- 172.21.15.63:0/942006516 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7a0102c00 msgr2=0x7fb7a01157d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:24.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.057+0000 7fb79dd9b700 1 --2- 172.21.15.63:0/942006516 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7a0102c00 0x7fb7a01157d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:24.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.057+0000 7fb79dd9b700 1 -- 172.21.15.63:0/942006516 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb790005040 con 0x7fb7a01035a0 2023-12-12T11:49:24.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.057+0000 7fb79e59c700 1 --2- 172.21.15.63:0/942006516 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7a0102c00 0x7fb7a01157d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T11:49:24.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.057+0000 7fb79dd9b700 1 --2- 172.21.15.63:0/942006516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7a01035a0 0x7fb7a0115d10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb79400eb40 tx=0x7fb79400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:24.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.057+0000 7fb78effd700 1 -- 172.21.15.63:0/942006516 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb794007cc0 con 0x7fb7a01035a0 2023-12-12T11:49:24.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.058+0000 7fb78effd700 1 -- 172.21.15.63:0/942006516 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb79400f040 con 0x7fb7a01035a0 2023-12-12T11:49:24.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.058+0000 7fb7a4f78700 1 -- 172.21.15.63:0/942006516 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7a010f910 con 0x7fb7a01035a0 2023-12-12T11:49:24.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.058+0000 7fb78effd700 1 -- 172.21.15.63:0/942006516 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb794009510 con 0x7fb7a01035a0 2023-12-12T11:49:24.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.058+0000 7fb7a4f78700 1 -- 172.21.15.63:0/942006516 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a010fe50 con 0x7fb7a01035a0 2023-12-12T11:49:24.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.059+0000 7fb7a4f78700 1 -- 172.21.15.63:0/942006516 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7a00fc390 con 0x7fb7a01035a0 2023-12-12T11:49:24.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.060+0000 7fb78effd700 1 -- 172.21.15.63:0/942006516 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fb794009670 con 0x7fb7a01035a0 2023-12-12T11:49:24.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.060+0000 7fb78effd700 1 --2- 172.21.15.63:0/942006516 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb788068f70 0x7fb78806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:24.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.061+0000 7fb78effd700 1 -- 172.21.15.63:0/942006516 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb794086ad0 con 0x7fb7a01035a0 2023-12-12T11:49:24.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.061+0000 7fb79e59c700 1 --2- 172.21.15.63:0/942006516 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb788068f70 0x7fb78806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:24.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.061+0000 7fb79e59c700 1 --2- 172.21.15.63:0/942006516 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb788068f70 0x7fb78806b420 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb790004560 tx=0x7fb790009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:24.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.064+0000 7fb78effd700 1 -- 172.21.15.63:0/942006516 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb7940568c0 con 0x7fb7a01035a0 2023-12-12T11:49:24.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.309+0000 7fb7a4f78700 1 -- 172.21.15.63:0/942006516 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb7a004bb80 con 0x7fb7a01035a0 2023-12-12T11:49:24.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.310+0000 7fb78effd700 1 -- 172.21.15.63:0/942006516 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+83 (secure 0 0 0) 0x7fb794056450 con 0x7fb7a01035a0 2023-12-12T11:49:24.312 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2023-12-12T11:49:24.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.312+0000 7fb7a4f78700 1 -- 172.21.15.63:0/942006516 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb788068f70 msgr2=0x7fb78806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:24.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.312+0000 7fb7a4f78700 1 --2- 172.21.15.63:0/942006516 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb788068f70 0x7fb78806b420 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb790004560 tx=0x7fb790009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:24.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.312+0000 7fb7a4f78700 1 -- 172.21.15.63:0/942006516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7a01035a0 msgr2=0x7fb7a0115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:24.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.312+0000 7fb7a4f78700 1 --2- 172.21.15.63:0/942006516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7a01035a0 0x7fb7a0115d10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb79400eb40 tx=0x7fb79400b040 comp rx=0 tx=0).stop 2023-12-12T11:49:24.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.312+0000 7fb7a4f78700 1 -- 172.21.15.63:0/942006516 shutdown_connections 2023-12-12T11:49:24.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.312+0000 7fb7a4f78700 1 --2- 172.21.15.63:0/942006516 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7a0102c00 0x7fb7a01157d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:24.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.312+0000 7fb7a4f78700 1 --2- 172.21.15.63:0/942006516 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb788068f70 0x7fb78806b420 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:24.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.312+0000 7fb7a4f78700 1 --2- 172.21.15.63:0/942006516 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7a01035a0 0x7fb7a0115d10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:24.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.312+0000 7fb7a4f78700 1 -- 172.21.15.63:0/942006516 >> 172.21.15.63:0/942006516 conn(0x7fb7a00f8790 msgr2=0x7fb7a00fa000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:24.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.312+0000 7fb7a4f78700 1 -- 172.21.15.63:0/942006516 shutdown_connections 2023-12-12T11:49:24.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:24.313+0000 7fb7a4f78700 1 -- 172.21.15.63:0/942006516 wait complete. 2023-12-12T11:49:24.688 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-12T11:49:24.688 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T11:49:24.688 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi063.front.sepia.ceph.com 2023-12-12T11:49:24.688 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-12T11:49:24.688 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-12T11:49:24.689 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-12T11:49:24.689 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-12T11:49:24.689 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-12T11:49:24.689 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-12T11:49:24.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:24.689 DEBUG:teuthology.orchestra.run.smithi063:> ip addr 2023-12-12T11:49:24.737 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T11:49:24.737 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T11:49:24.737 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T11:49:24.737 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-12T11:49:24.737 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2023-12-12T11:49:24.737 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-12T11:49:24.737 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T11:49:24.737 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2023-12-12T11:49:24.737 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f0 2023-12-12T11:49:24.737 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T11:49:24.738 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2023-12-12T11:49:24.738 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f1 2023-12-12T11:49:24.738 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T11:49:24.738 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2023-12-12T11:49:24.738 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T11:49:24.738 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2023-12-12T11:49:24.738 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-12T11:49:24.738 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 41881sec preferred_lft 41881sec 2023-12-12T11:49:24.738 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2023-12-12T11:49:24.738 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-12T11:49:24.739 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-12T11:49:24.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:24.740 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2023-12-12T11:49:24.740 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2023-12-12T11:49:24.740 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add name ceph-brx type bridge 2023-12-12T11:49:24.740 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip addr flush dev ceph-brx 2023-12-12T11:49:24.740 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set ceph-brx up 2023-12-12T11:49:24.740 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-12T11:49:24.740 DEBUG:teuthology.orchestra.run.smithi063:> ') 2023-12-12T11:49:25.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:24 smithi063 ceph-mon[107117]: pgmap v163: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-12T11:49:25.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:24 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/942006516' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-12T11:49:25.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:25.169 DEBUG:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T11:49:25.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:24 smithi093 ceph-mon[115914]: pgmap v163: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-12T11:49:25.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:24 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/942006516' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-12T11:49:25.243 INFO:teuthology.orchestra.run.smithi063.stdout:1 2023-12-12T11:49:25.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:25.247 DEBUG:teuthology.orchestra.run.smithi063:> route 2023-12-12T11:49:25.309 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2023-12-12T11:49:25.309 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T11:49:25.309 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T11:49:25.309 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T11:49:25.309 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T11:49:25.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:25.311 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2023-12-12T11:49:25.311 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2023-12-12T11:49:25.311 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T11:49:25.311 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T11:49:25.311 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T11:49:25.311 DEBUG:teuthology.orchestra.run.smithi063:> ') 2023-12-12T11:49:26.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:26.071 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2023-12-12T11:49:26.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:26.120 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list-id 2023-12-12T11:49:26.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:26.168 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2023-12-12T11:49:26.168 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2023-12-12T11:49:26.168 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T11:49:26.168 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-12T11:49:26.168 DEBUG:teuthology.orchestra.run.smithi063:> ') 2023-12-12T11:49:26.316 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-12T11:49:26.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:26.317 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2023-12-12T11:49:26.317 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2023-12-12T11:49:26.317 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-12T11:49:26.317 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-12T11:49:26.317 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-12T11:49:26.317 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-12T11:49:26.317 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-12T11:49:26.317 DEBUG:teuthology.orchestra.run.smithi063:> ') 2023-12-12T11:49:26.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:26.603 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2023-12-12T11:49:26.603 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2023-12-12T11:49:26.603 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set brx.0 up 2023-12-12T11:49:26.603 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set dev brx.0 master ceph-brx 2023-12-12T11:49:26.604 DEBUG:teuthology.orchestra.run.smithi063:> ') 2023-12-12T11:49:26.782 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T11:49:26.782 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-12T11:49:26.829 INFO:teuthology.orchestra.run.smithi063.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-12T11:49:26.830 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T11:49:26.830 DEBUG:teuthology.orchestra.run.smithi063:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-12T11:49:26.875 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-12T11:49:26.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:26.875 DEBUG:teuthology.orchestra.run.smithi063:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-12T11:49:26.979 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:26 smithi063 ceph-mon[107117]: pgmap v164: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-12T11:49:27.027 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-12T11:49:27.027 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-12T11:49:27.027 INFO:teuthology.orchestra.run.smithi063.stdout:invalid new device string format 2023-12-12T11:49:27.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:26 smithi093 ceph-mon[115914]: pgmap v164: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-12T11:49:27.453 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-12T11:49:27.453 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-12T11:49:27.453 INFO:teuthology.orchestra.run.smithi063.stdout:invalid new device string format 2023-12-12T11:49:27.453 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.93:3300" 2023-12-12T11:49:27.454 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-12T11:49:27.479 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-12T11:49:27.479 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-12T11:49:27.479 INFO:teuthology.orchestra.run.smithi063.stdout:invalid new device string format 2023-12-12T11:49:27.479 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.93:3300" 2023-12-12T11:49:27.479 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-12T11:49:27.479 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: resolved to: "172.21.15.63:6789,172.21.15.93:6789" 2023-12-12T11:49:27.479 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.63:6789,172.21.15.93:6789:/ 2023-12-12T11:49:27.480 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=85e33c70-98e3-11ee-95a3-87774f69a715" will pass to kernel 2023-12-12T11:49:27.484 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-12T11:49:27.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:27.485 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-12T11:49:27.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:27.558 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-12T11:49:27.718 INFO:teuthology.orchestra.run.smithi063.stdout:client24361 2023-12-12T11:49:27.719 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-12T11:49:27.719 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T11:49:27.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:27.767 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-12T11:49:27.911 INFO:teuthology.orchestra.run.smithi063.stdout:client24361 2023-12-12T11:49:27.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:27.912 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-12T11:49:28.013 INFO:teuthology.orchestra.run.smithi063.stdout:client24361 2023-12-12T11:49:28.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:28.014 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/85e33c70-98e3-11ee-95a3-87774f69a715.client24361/status') 2023-12-12T11:49:28.137 INFO:teuthology.orchestra.run.smithi063.stdout:instance: client.24361 (3)172.21.15.63:0/1163474257 2023-12-12T11:49:28.137 INFO:teuthology.orchestra.run.smithi063.stdout:blocklisted: false 2023-12-12T11:49:28.138 INFO:teuthology.orchestra.run.smithi063.stderr:0+1 records in 2023-12-12T11:49:28.138 INFO:teuthology.orchestra.run.smithi063.stderr:0+1 records out 2023-12-12T11:49:28.138 INFO:teuthology.orchestra.run.smithi063.stderr:71 bytes copied, 5.7281e-05 s, 1.2 MB/s 2023-12-12T11:49:28.140 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-12-12T11:49:28.140 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-12T11:49:28.141 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-12T11:49:28.141 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -- ceph fs ls 2023-12-12T11:49:28.580 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:49:29.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:28 smithi063 ceph-mon[107117]: pgmap v165: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-12T11:49:29.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:28 smithi093 ceph-mon[115914]: pgmap v165: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-12T11:49:29.831 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.829+0000 7fcc9ca4f700 1 -- 172.21.15.63:0/1474641396 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc98102c00 msgr2=0x7fcc98102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:29.831 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.829+0000 7fcc9ca4f700 1 --2- 172.21.15.63:0/1474641396 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc98102c00 0x7fcc98102fd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcc88004940 tx=0x7fcc88009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:29.831 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.829+0000 7fcc9ca4f700 1 -- 172.21.15.63:0/1474641396 shutdown_connections 2023-12-12T11:49:29.831 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.829+0000 7fcc9ca4f700 1 --2- 172.21.15.63:0/1474641396 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcc981035a0 0x7fcc980fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:29.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.829+0000 7fcc9ca4f700 1 --2- 172.21.15.63:0/1474641396 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc98102c00 0x7fcc98102fd0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:29.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.829+0000 7fcc9ca4f700 1 -- 172.21.15.63:0/1474641396 >> 172.21.15.63:0/1474641396 conn(0x7fcc980f8790 msgr2=0x7fcc980faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:29.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.829+0000 7fcc9ca4f700 1 -- 172.21.15.63:0/1474641396 shutdown_connections 2023-12-12T11:49:29.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.829+0000 7fcc9ca4f700 1 -- 172.21.15.63:0/1474641396 wait complete. 2023-12-12T11:49:29.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.830+0000 7fcc9ca4f700 1 Processor -- start 2023-12-12T11:49:29.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.830+0000 7fcc9ca4f700 1 -- start start 2023-12-12T11:49:29.833 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.831+0000 7fcc9ca4f700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcc98102c00 0x7fcc98113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:29.833 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.831+0000 7fcc9ca4f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc981035a0 0x7fcc98113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:29.833 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.831+0000 7fcc9ca4f700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc981141e0 con 0x7fcc981035a0 2023-12-12T11:49:29.833 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.831+0000 7fcc9ca4f700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9810d4d0 con 0x7fcc98102c00 2023-12-12T11:49:29.833 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.831+0000 7fcc8ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc981035a0 0x7fcc98113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:29.834 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.831+0000 7fcc8ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc981035a0 0x7fcc98113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56998/0 (socket says 172.21.15.63:56998) 2023-12-12T11:49:29.834 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.831+0000 7fcc8ffff700 1 -- 172.21.15.63:0/1220284120 learned_addr learned my addr 172.21.15.63:0/1220284120 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:49:29.834 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.831+0000 7fcc9659c700 1 --2- 172.21.15.63:0/1220284120 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcc98102c00 0x7fcc98113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:29.834 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.832+0000 7fcc8ffff700 1 -- 172.21.15.63:0/1220284120 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcc98102c00 msgr2=0x7fcc98113610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:29.835 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.832+0000 7fcc8ffff700 1 --2- 172.21.15.63:0/1220284120 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcc98102c00 0x7fcc98113610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:29.835 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.832+0000 7fcc8ffff700 1 -- 172.21.15.63:0/1220284120 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc88005040 con 0x7fcc981035a0 2023-12-12T11:49:29.835 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.832+0000 7fcc8ffff700 1 --2- 172.21.15.63:0/1220284120 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc981035a0 0x7fcc98113b90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcc80002a50 tx=0x7fcc80004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:29.835 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.832+0000 7fcc8effd700 1 -- 172.21.15.63:0/1220284120 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc80007cc0 con 0x7fcc981035a0 2023-12-12T11:49:29.835 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.832+0000 7fcc8effd700 1 -- 172.21.15.63:0/1220284120 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcc8000f040 con 0x7fcc981035a0 2023-12-12T11:49:29.835 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.832+0000 7fcc8effd700 1 -- 172.21.15.63:0/1220284120 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc8000d920 con 0x7fcc981035a0 2023-12-12T11:49:29.835 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.832+0000 7fcc9ca4f700 1 -- 172.21.15.63:0/1220284120 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc9810d760 con 0x7fcc981035a0 2023-12-12T11:49:29.835 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.832+0000 7fcc9ca4f700 1 -- 172.21.15.63:0/1220284120 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc9810dca0 con 0x7fcc981035a0 2023-12-12T11:49:29.835 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.833+0000 7fcc9ca4f700 1 -- 172.21.15.63:0/1220284120 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc980fff10 con 0x7fcc981035a0 2023-12-12T11:49:29.836 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.834+0000 7fcc8effd700 1 -- 172.21.15.63:0/1220284120 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fcc80009680 con 0x7fcc981035a0 2023-12-12T11:49:29.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.835+0000 7fcc8effd700 1 --2- 172.21.15.63:0/1220284120 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fcc84068f60 0x7fcc8406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:29.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.835+0000 7fcc8effd700 1 -- 172.21.15.63:0/1220284120 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fcc80086ae0 con 0x7fcc981035a0 2023-12-12T11:49:29.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.835+0000 7fcc9659c700 1 --2- 172.21.15.63:0/1220284120 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fcc84068f60 0x7fcc8406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:29.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.836+0000 7fcc9659c700 1 --2- 172.21.15.63:0/1220284120 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fcc84068f60 0x7fcc8406b410 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcc88004f90 tx=0x7fcc88009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:29.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:29.840+0000 7fcc8effd700 1 -- 172.21.15.63:0/1220284120 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fcc80056950 con 0x7fcc981035a0 2023-12-12T11:49:30.094 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:30.092+0000 7fcc9ca4f700 1 -- 172.21.15.63:0/1220284120 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcc980fc390 con 0x7fcc981035a0 2023-12-12T11:49:30.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:30.093+0000 7fcc8effd700 1 -- 172.21.15.63:0/1220284120 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+83 (secure 0 0 0) 0x7fcc800564e0 con 0x7fcc981035a0 2023-12-12T11:49:30.095 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2023-12-12T11:49:30.097 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:30.095+0000 7fcc9ca4f700 1 -- 172.21.15.63:0/1220284120 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fcc84068f60 msgr2=0x7fcc8406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:30.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:30.095+0000 7fcc9ca4f700 1 --2- 172.21.15.63:0/1220284120 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fcc84068f60 0x7fcc8406b410 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcc88004f90 tx=0x7fcc88009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:30.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:30.095+0000 7fcc9ca4f700 1 -- 172.21.15.63:0/1220284120 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc981035a0 msgr2=0x7fcc98113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:30.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:30.095+0000 7fcc9ca4f700 1 --2- 172.21.15.63:0/1220284120 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc981035a0 0x7fcc98113b90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcc80002a50 tx=0x7fcc80004600 comp rx=0 tx=0).stop 2023-12-12T11:49:30.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:30.095+0000 7fcc9ca4f700 1 -- 172.21.15.63:0/1220284120 shutdown_connections 2023-12-12T11:49:30.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:30.095+0000 7fcc9ca4f700 1 --2- 172.21.15.63:0/1220284120 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcc98102c00 0x7fcc98113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:30.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:30.095+0000 7fcc9ca4f700 1 --2- 172.21.15.63:0/1220284120 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fcc84068f60 0x7fcc8406b410 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:30.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:30.095+0000 7fcc9ca4f700 1 --2- 172.21.15.63:0/1220284120 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc981035a0 0x7fcc98113b90 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:30.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:30.095+0000 7fcc9ca4f700 1 -- 172.21.15.63:0/1220284120 >> 172.21.15.63:0/1220284120 conn(0x7fcc980f8790 msgr2=0x7fcc980fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:30.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:30.096+0000 7fcc9ca4f700 1 -- 172.21.15.63:0/1220284120 shutdown_connections 2023-12-12T11:49:30.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:30.096+0000 7fcc9ca4f700 1 -- 172.21.15.63:0/1220284120 wait complete. 2023-12-12T11:49:30.459 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-12T11:49:30.459 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T11:49:30.459 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi093.front.sepia.ceph.com 2023-12-12T11:49:30.459 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-12T11:49:30.459 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-12T11:49:30.459 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-12T11:49:30.459 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-12T11:49:30.459 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-12T11:49:30.459 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-12T11:49:30.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:30.459 DEBUG:teuthology.orchestra.run.smithi093:> ip addr 2023-12-12T11:49:30.515 INFO:teuthology.orchestra.run.smithi093.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T11:49:30.515 INFO:teuthology.orchestra.run.smithi093.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T11:49:30.515 INFO:teuthology.orchestra.run.smithi093.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T11:49:30.515 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-12-12T11:49:30.515 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 ::1/128 scope host 2023-12-12T11:49:30.515 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-12-12T11:49:30.515 INFO:teuthology.orchestra.run.smithi093.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T11:49:30.515 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1c brd ff:ff:ff:ff:ff:ff 2023-12-12T11:49:30.515 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f0 2023-12-12T11:49:30.515 INFO:teuthology.orchestra.run.smithi093.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T11:49:30.516 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1d brd ff:ff:ff:ff:ff:ff 2023-12-12T11:49:30.516 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f1 2023-12-12T11:49:30.516 INFO:teuthology.orchestra.run.smithi093.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T11:49:30.516 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:34 brd ff:ff:ff:ff:ff:ff 2023-12-12T11:49:30.516 INFO:teuthology.orchestra.run.smithi093.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T11:49:30.516 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:35 brd ff:ff:ff:ff:ff:ff 2023-12-12T11:49:30.516 INFO:teuthology.orchestra.run.smithi093.stdout: inet 172.21.15.93/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-12T11:49:30.516 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft 41743sec preferred_lft 41743sec 2023-12-12T11:49:30.516 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::ec4:7aff:fe8f:d635/64 scope link 2023-12-12T11:49:30.516 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-12-12T11:49:30.517 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-12T11:49:30.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:30.517 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-12-12T11:49:30.517 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-12-12T11:49:30.517 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link add name ceph-brx type bridge 2023-12-12T11:49:30.517 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip addr flush dev ceph-brx 2023-12-12T11:49:30.518 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set ceph-brx up 2023-12-12T11:49:30.518 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-12T11:49:30.518 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-12-12T11:49:30.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:30.943 DEBUG:teuthology.orchestra.run.smithi093:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T11:49:31.014 INFO:teuthology.orchestra.run.smithi093.stdout:1 2023-12-12T11:49:31.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:31.018 DEBUG:teuthology.orchestra.run.smithi093:> route 2023-12-12T11:49:31.082 INFO:teuthology.orchestra.run.smithi093.stdout:Kernel IP routing table 2023-12-12T11:49:31.082 INFO:teuthology.orchestra.run.smithi093.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T11:49:31.082 INFO:teuthology.orchestra.run.smithi093.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T11:49:31.082 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T11:49:31.082 INFO:teuthology.orchestra.run.smithi093.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T11:49:31.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:31.082 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-12-12T11:49:31.083 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-12-12T11:49:31.083 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T11:49:31.083 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T11:49:31.083 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T11:49:31.083 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-12-12T11:49:31.187 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:30 smithi093 ceph-mon[115914]: pgmap v166: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2023-12-12T11:49:31.187 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:30 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/1220284120' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-12T11:49:31.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:30 smithi063 ceph-mon[107117]: pgmap v166: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2023-12-12T11:49:31.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:30 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/1220284120' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-12T11:49:31.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:31.832 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list 2023-12-12T11:49:31.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:31.881 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list-id 2023-12-12T11:49:31.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:31.928 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-12-12T11:49:31.929 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-12-12T11:49:31.929 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T11:49:31.929 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-12T11:49:31.929 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-12-12T11:49:32.074 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-12T11:49:32.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:32.074 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-12-12T11:49:32.074 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-12-12T11:49:32.074 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-12T11:49:32.074 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-12T11:49:32.074 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-12T11:49:32.074 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-12T11:49:32.074 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-12T11:49:32.075 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-12-12T11:49:32.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:32.348 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-12-12T11:49:32.348 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-12-12T11:49:32.348 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set brx.0 up 2023-12-12T11:49:32.348 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set dev brx.0 master ceph-brx 2023-12-12T11:49:32.348 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-12-12T11:49:32.523 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T11:49:32.523 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-12T11:49:32.569 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-12T11:49:32.570 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T11:49:32.570 DEBUG:teuthology.orchestra.run.smithi093:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-12T11:49:32.615 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-12T11:49:32.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:32.615 DEBUG:teuthology.orchestra.run.smithi093:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-12T11:49:32.717 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:32 smithi093 ceph-mon[115914]: pgmap v167: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-12T11:49:32.773 INFO:teuthology.orchestra.run.smithi093.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-12T11:49:32.773 INFO:teuthology.orchestra.run.smithi093.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-12T11:49:32.773 INFO:teuthology.orchestra.run.smithi093.stdout:invalid new device string format 2023-12-12T11:49:32.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:32 smithi063 ceph-mon[107117]: pgmap v167: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-12T11:49:33.203 INFO:teuthology.orchestra.run.smithi093.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-12T11:49:33.203 INFO:teuthology.orchestra.run.smithi093.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-12T11:49:33.203 INFO:teuthology.orchestra.run.smithi093.stdout:invalid new device string format 2023-12-12T11:49:33.203 INFO:teuthology.orchestra.run.smithi093.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.93:3300" 2023-12-12T11:49:33.203 INFO:teuthology.orchestra.run.smithi093.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-12T11:49:33.227 INFO:teuthology.orchestra.run.smithi093.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-12T11:49:33.227 INFO:teuthology.orchestra.run.smithi093.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-12T11:49:33.227 INFO:teuthology.orchestra.run.smithi093.stdout:invalid new device string format 2023-12-12T11:49:33.227 INFO:teuthology.orchestra.run.smithi093.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.93:3300" 2023-12-12T11:49:33.228 INFO:teuthology.orchestra.run.smithi093.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-12T11:49:33.228 INFO:teuthology.orchestra.run.smithi093.stdout:mount.ceph: resolved to: "172.21.15.63:6789,172.21.15.93:6789" 2023-12-12T11:49:33.228 INFO:teuthology.orchestra.run.smithi093.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.63:6789,172.21.15.93:6789:/ 2023-12-12T11:49:33.228 INFO:teuthology.orchestra.run.smithi093.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=85e33c70-98e3-11ee-95a3-87774f69a715" will pass to kernel 2023-12-12T11:49:33.233 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-12T11:49:33.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:33.233 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-12T11:49:33.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:33.305 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-12T11:49:33.408 INFO:teuthology.orchestra.run.smithi093.stdout:client24367 2023-12-12T11:49:33.408 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-12T11:49:33.408 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T11:49:33.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:33.456 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-12T11:49:33.585 INFO:teuthology.orchestra.run.smithi093.stdout:client24367 2023-12-12T11:49:33.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:33.585 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-12T11:49:33.674 INFO:teuthology.orchestra.run.smithi093.stdout:client24367 2023-12-12T11:49:33.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:49:33.674 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/85e33c70-98e3-11ee-95a3-87774f69a715.client24367/status') 2023-12-12T11:49:33.783 INFO:teuthology.orchestra.run.smithi093.stdout:instance: client.24367 (3)192.168.0.1:0/1020904555 2023-12-12T11:49:33.783 INFO:teuthology.orchestra.run.smithi093.stdout:blocklisted: false 2023-12-12T11:49:33.783 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records in 2023-12-12T11:49:33.783 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records out 2023-12-12T11:49:33.783 INFO:teuthology.orchestra.run.smithi093.stderr:70 bytes copied, 5.5742e-05 s, 1.3 MB/s 2023-12-12T11:49:33.786 INFO:teuthology.run_tasks:Running task print... 2023-12-12T11:49:33.796 INFO:teuthology.task.print:**** done client 2023-12-12T11:49:33.796 INFO:teuthology.run_tasks:Running task parallel... 2023-12-12T11:49:33.812 INFO:teuthology.task.parallel:starting parallel... 2023-12-12T11:49:33.812 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-12-12T11:49:33.813 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-12T11:49:33.813 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi063.front.sepia.ceph.com 2023-12-12T11:49:33.813 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -e sha1=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2023-12-12T11:49:33.814 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-12-12T11:49:33.814 INFO:teuthology.task.sequential:In sequential, running task workunit... 2023-12-12T11:49:33.817 INFO:tasks.workunit:Pulling workunits from ref f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 2023-12-12T11:49:33.818 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-12T11:49:33.818 INFO:tasks.workunit:timeout=3h 2023-12-12T11:49:33.818 INFO:tasks.workunit:cleanup=True 2023-12-12T11:49:33.818 DEBUG:teuthology.orchestra.run.smithi063:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-12T11:49:33.877 INFO:teuthology.orchestra.run.smithi063.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-12-12T11:49:33.877 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-12-12T11:49:33.877 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 96h/150d Inode: 1 Links: 2 2023-12-12T11:49:33.877 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T11:49:33.877 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:cephfs_t:s0 2023-12-12T11:49:33.877 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-12T11:49:33.877 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2023-12-12 11:49:01.509826161 +0000 2023-12-12T11:49:33.877 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2023-12-12 11:49:27.552191706 +0000 2023-12-12T11:49:33.877 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2023-12-12 11:49:01.509826161 +0000 2023-12-12T11:49:33.878 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-12-12T11:49:33.878 DEBUG:teuthology.orchestra.run.smithi063:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-12-12T11:49:33.999 DEBUG:teuthology.orchestra.run.smithi093:> stat -- /home/ubuntu/cephtest/mnt.1 2023-12-12T11:49:34.048 INFO:teuthology.orchestra.run.smithi093.stdout: File: /home/ubuntu/cephtest/mnt.1 2023-12-12T11:49:34.048 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2023-12-12T11:49:34.048 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 75h/117d Inode: 1 Links: 3 2023-12-12T11:49:34.048 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T11:49:34.048 INFO:teuthology.orchestra.run.smithi093.stdout:Context: system_u:object_r:cephfs_t:s0 2023-12-12T11:49:34.048 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-12T11:49:34.048 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2023-12-12 11:49:33.989064335 +0000 2023-12-12T11:49:34.048 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2023-12-12 11:49:33.989064335 +0000 2023-12-12T11:49:34.048 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: 2023-12-12 11:49:01.509826161 +0000 2023-12-12T11:49:34.048 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2023-12-12T11:49:34.049 DEBUG:teuthology.orchestra.run.smithi093:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2023-12-12T11:49:34.125 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 2023-12-12T11:49:34.125 DEBUG:teuthology.orchestra.run.smithi093:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 2023-12-12T11:49:34.175 INFO:tasks.workunit.client.1.smithi093.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2023-12-12T11:49:34.179 INFO:tasks.workunit.client.0.smithi063.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-12T11:49:34.280 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:49:35.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:34 smithi093 ceph-mon[115914]: pgmap v168: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-12T11:49:35.253 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:34 smithi063 ceph-mon[107117]: pgmap v168: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-12T11:49:35.510 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.508+0000 7f69ccfbb700 1 -- 172.21.15.63:0/1966000828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69c80fde00 msgr2=0x7f69c80fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:35.510 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.508+0000 7f69ccfbb700 1 --2- 172.21.15.63:0/1966000828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69c80fde00 0x7f69c80fe250 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f69bc004940 tx=0x7f69bc009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:35.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.508+0000 7f69ccfbb700 1 -- 172.21.15.63:0/1966000828 shutdown_connections 2023-12-12T11:49:35.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.508+0000 7f69ccfbb700 1 --2- 172.21.15.63:0/1966000828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69c80fde00 0x7f69c80fe250 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:35.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.508+0000 7f69ccfbb700 1 --2- 172.21.15.63:0/1966000828 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69c80fcbf0 0x7f69c80fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:35.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.508+0000 7f69ccfbb700 1 -- 172.21.15.63:0/1966000828 >> 172.21.15.63:0/1966000828 conn(0x7f69c80f82d0 msgr2=0x7f69c80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:35.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.508+0000 7f69ccfbb700 1 -- 172.21.15.63:0/1966000828 shutdown_connections 2023-12-12T11:49:35.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.508+0000 7f69ccfbb700 1 -- 172.21.15.63:0/1966000828 wait complete. 2023-12-12T11:49:35.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.509+0000 7f69ccfbb700 1 Processor -- start 2023-12-12T11:49:35.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.509+0000 7f69ccfbb700 1 -- start start 2023-12-12T11:49:35.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.509+0000 7f69ccfbb700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69c80fcbf0 0x7f69c810f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:35.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.509+0000 7f69ccfbb700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69c80fde00 0x7f69c810fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:35.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.509+0000 7f69ccfbb700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c8110310 con 0x7f69c80fde00 2023-12-12T11:49:35.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.509+0000 7f69ccfbb700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c8110b60 con 0x7f69c80fcbf0 2023-12-12T11:49:35.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.510+0000 7f69c5d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69c80fde00 0x7f69c810fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:35.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.510+0000 7f69c5d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69c80fde00 0x7f69c810fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57006/0 (socket says 172.21.15.63:57006) 2023-12-12T11:49:35.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.510+0000 7f69c5d9b700 1 -- 172.21.15.63:0/1594640336 learned_addr learned my addr 172.21.15.63:0/1594640336 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:49:35.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.510+0000 7f69c659c700 1 --2- 172.21.15.63:0/1594640336 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69c80fcbf0 0x7f69c810f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:35.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.510+0000 7f69c5d9b700 1 -- 172.21.15.63:0/1594640336 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69c80fcbf0 msgr2=0x7f69c810f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:35.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.510+0000 7f69c5d9b700 1 --2- 172.21.15.63:0/1594640336 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69c80fcbf0 0x7f69c810f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:35.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.510+0000 7f69c5d9b700 1 -- 172.21.15.63:0/1594640336 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69bc005040 con 0x7f69c80fde00 2023-12-12T11:49:35.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.510+0000 7f69c5d9b700 1 --2- 172.21.15.63:0/1594640336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69c80fde00 0x7f69c810fd10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f69bc00b3b0 tx=0x7f69bc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:35.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.511+0000 7f69b6ffd700 1 -- 172.21.15.63:0/1594640336 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69bc00e040 con 0x7f69c80fde00 2023-12-12T11:49:35.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.511+0000 7f69b6ffd700 1 -- 172.21.15.63:0/1594640336 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f69bc00bcd0 con 0x7f69c80fde00 2023-12-12T11:49:35.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.511+0000 7f69b6ffd700 1 -- 172.21.15.63:0/1594640336 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69bc01c630 con 0x7f69c80fde00 2023-12-12T11:49:35.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.511+0000 7f69ccfbb700 1 -- 172.21.15.63:0/1594640336 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69c8110de0 con 0x7f69c80fde00 2023-12-12T11:49:35.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.511+0000 7f69ccfbb700 1 -- 172.21.15.63:0/1594640336 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69c81112d0 con 0x7f69c80fde00 2023-12-12T11:49:35.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.512+0000 7f69ccfbb700 1 -- 172.21.15.63:0/1594640336 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69c8101ea0 con 0x7f69c80fde00 2023-12-12T11:49:35.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.513+0000 7f69b6ffd700 1 -- 172.21.15.63:0/1594640336 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f69bc013420 con 0x7f69c80fde00 2023-12-12T11:49:35.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.514+0000 7f69b6ffd700 1 --2- 172.21.15.63:0/1594640336 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f69b0068f70 0x7f69b006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:35.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.514+0000 7f69b6ffd700 1 -- 172.21.15.63:0/1594640336 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f69bc088310 con 0x7f69c80fde00 2023-12-12T11:49:35.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.514+0000 7f69c659c700 1 --2- 172.21.15.63:0/1594640336 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f69b0068f70 0x7f69b006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:35.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.515+0000 7f69c659c700 1 --2- 172.21.15.63:0/1594640336 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f69b0068f70 0x7f69b006b420 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f69b8009fd0 tx=0x7f69b8009f00 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:35.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.519+0000 7f69b6ffd700 1 -- 172.21.15.63:0/1594640336 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f69bc058100 con 0x7f69c80fde00 2023-12-12T11:49:35.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.725+0000 7f69ccfbb700 1 -- 172.21.15.63:0/1594640336 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f69c804bb80 con 0x7f69c80fde00 2023-12-12T11:49:35.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:35.725+0000 7f69b6ffd700 1 -- 172.21.15.63:0/1594640336 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21)=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21) v1 ==== 179+0+0 (secure 0 0 0) 0x7f69bc057c90 con 0x7f69c80fde00 2023-12-12T11:49:35.729 INFO:teuthology.orchestra.run.smithi063.stderr:Error EINVAL: unrecognized config option 'mgr/orchestrator/fail_fs' 2023-12-12T11:49:36.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:35 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:49:36.106 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-12T11:49:36.106 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi063.front.sepia.ceph.com 2023-12-12T11:49:36.107 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -e sha1=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2023-12-12T11:49:36.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:35 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:49:36.546 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:49:37.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:36 smithi063 ceph-mon[107117]: pgmap v169: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-12T11:49:37.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:36 smithi093 ceph-mon[115914]: pgmap v169: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-12T11:49:37.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.767+0000 7f4fc6f41700 1 -- 172.21.15.63:0/4132853592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fc00fcbf0 msgr2=0x7f4fc00fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:37.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.767+0000 7f4fc6f41700 1 --2- 172.21.15.63:0/4132853592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fc00fcbf0 0x7f4fc00fd000 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4004940 tx=0x7f4fb4009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:37.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.767+0000 7f4fc6f41700 1 -- 172.21.15.63:0/4132853592 shutdown_connections 2023-12-12T11:49:37.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.767+0000 7f4fc6f41700 1 --2- 172.21.15.63:0/4132853592 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4fc00fde00 0x7f4fc00fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:37.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.767+0000 7f4fc6f41700 1 --2- 172.21.15.63:0/4132853592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fc00fcbf0 0x7f4fc00fd000 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:37.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.767+0000 7f4fc6f41700 1 -- 172.21.15.63:0/4132853592 >> 172.21.15.63:0/4132853592 conn(0x7f4fc00f82d0 msgr2=0x7f4fc00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:37.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.767+0000 7f4fc6f41700 1 -- 172.21.15.63:0/4132853592 shutdown_connections 2023-12-12T11:49:37.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.767+0000 7f4fc6f41700 1 -- 172.21.15.63:0/4132853592 wait complete. 2023-12-12T11:49:37.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.768+0000 7f4fc6f41700 1 Processor -- start 2023-12-12T11:49:37.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.768+0000 7f4fc6f41700 1 -- start start 2023-12-12T11:49:37.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.769+0000 7f4fc6f41700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4fc00fcbf0 0x7f4fc010f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:37.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.769+0000 7f4fc6f41700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fc00fde00 0x7f4fc010fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:37.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.769+0000 7f4fc6f41700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc01102a0 con 0x7f4fc00fde00 2023-12-12T11:49:37.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.769+0000 7f4fc6f41700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc0110b40 con 0x7f4fc00fcbf0 2023-12-12T11:49:37.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.769+0000 7f4fbffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fc00fde00 0x7f4fc010fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:37.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.769+0000 7f4fbffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fc00fde00 0x7f4fc010fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57024/0 (socket says 172.21.15.63:57024) 2023-12-12T11:49:37.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.769+0000 7f4fc4cdd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4fc00fcbf0 0x7f4fc010f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:37.773 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.769+0000 7f4fbffff700 1 -- 172.21.15.63:0/1361462902 learned_addr learned my addr 172.21.15.63:0/1361462902 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:49:37.773 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.769+0000 7f4fbffff700 1 -- 172.21.15.63:0/1361462902 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4fc00fcbf0 msgr2=0x7f4fc010f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:37.773 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.769+0000 7f4fbffff700 1 --2- 172.21.15.63:0/1361462902 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4fc00fcbf0 0x7f4fc010f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:37.773 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.769+0000 7f4fbffff700 1 -- 172.21.15.63:0/1361462902 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb4005040 con 0x7f4fc00fde00 2023-12-12T11:49:37.773 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.770+0000 7f4fbffff700 1 --2- 172.21.15.63:0/1361462902 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fc00fde00 0x7f4fc010fca0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4fac00c8c0 tx=0x7f4fac0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:37.773 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.770+0000 7f4fbd7fa700 1 -- 172.21.15.63:0/1361462902 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fac00a760 con 0x7f4fc00fde00 2023-12-12T11:49:37.773 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.770+0000 7f4fbd7fa700 1 -- 172.21.15.63:0/1361462902 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4fac00ad70 con 0x7f4fc00fde00 2023-12-12T11:49:37.773 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.770+0000 7f4fc6f41700 1 -- 172.21.15.63:0/1361462902 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc0110e20 con 0x7f4fc00fde00 2023-12-12T11:49:37.773 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.770+0000 7f4fbd7fa700 1 -- 172.21.15.63:0/1361462902 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fac0113a0 con 0x7f4fc00fde00 2023-12-12T11:49:37.773 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.770+0000 7f4fc6f41700 1 -- 172.21.15.63:0/1361462902 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc0111360 con 0x7f4fc00fde00 2023-12-12T11:49:37.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.771+0000 7f4fc6f41700 1 -- 172.21.15.63:0/1361462902 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc0101ea0 con 0x7f4fc00fde00 2023-12-12T11:49:37.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.772+0000 7f4fbd7fa700 1 -- 172.21.15.63:0/1361462902 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f4fac012400 con 0x7f4fc00fde00 2023-12-12T11:49:37.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.773+0000 7f4fbd7fa700 1 --2- 172.21.15.63:0/1361462902 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4fb0068f70 0x7f4fb006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:37.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.773+0000 7f4fbd7fa700 1 -- 172.21.15.63:0/1361462902 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4fac086f20 con 0x7f4fc00fde00 2023-12-12T11:49:37.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.773+0000 7f4fc4cdd700 1 --2- 172.21.15.63:0/1361462902 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4fb0068f70 0x7f4fb006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:37.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.774+0000 7f4fc4cdd700 1 --2- 172.21.15.63:0/1361462902 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4fb0068f70 0x7f4fb006b420 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400b3b0 tx=0x7f4fb4009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:37.779 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.777+0000 7f4fbd7fa700 1 -- 172.21.15.63:0/1361462902 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4fac056d90 con 0x7f4fc00fde00 2023-12-12T11:49:37.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.982+0000 7f4fc6f41700 1 -- 172.21.15.63:0/1361462902 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f4fc004bb80 con 0x7f4fc00fde00 2023-12-12T11:49:37.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.982+0000 7f4fbd7fa700 1 -- 172.21.15.63:0/1361462902 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f4fac056920 con 0x7f4fc00fde00 2023-12-12T11:49:37.987 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.985+0000 7f4fc6f41700 1 -- 172.21.15.63:0/1361462902 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4fb0068f70 msgr2=0x7f4fb006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:37.987 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.985+0000 7f4fc6f41700 1 --2- 172.21.15.63:0/1361462902 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4fb0068f70 0x7f4fb006b420 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400b3b0 tx=0x7f4fb4009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:37.987 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.985+0000 7f4fc6f41700 1 -- 172.21.15.63:0/1361462902 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fc00fde00 msgr2=0x7f4fc010fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:37.987 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.985+0000 7f4fc6f41700 1 --2- 172.21.15.63:0/1361462902 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fc00fde00 0x7f4fc010fca0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4fac00c8c0 tx=0x7f4fac0044c0 comp rx=0 tx=0).stop 2023-12-12T11:49:37.987 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.985+0000 7f4fc6f41700 1 -- 172.21.15.63:0/1361462902 shutdown_connections 2023-12-12T11:49:37.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.985+0000 7f4fc6f41700 1 --2- 172.21.15.63:0/1361462902 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4fc00fcbf0 0x7f4fc010f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:37.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.985+0000 7f4fc6f41700 1 --2- 172.21.15.63:0/1361462902 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4fb0068f70 0x7f4fb006b420 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:37.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.985+0000 7f4fc6f41700 1 --2- 172.21.15.63:0/1361462902 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fc00fde00 0x7f4fc010fca0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:37.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.985+0000 7f4fc6f41700 1 -- 172.21.15.63:0/1361462902 >> 172.21.15.63:0/1361462902 conn(0x7f4fc00f82d0 msgr2=0x7f4fc00ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:37.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.985+0000 7f4fc6f41700 1 -- 172.21.15.63:0/1361462902 shutdown_connections 2023-12-12T11:49:37.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:37.985+0000 7f4fc6f41700 1 -- 172.21.15.63:0/1361462902 wait complete. 2023-12-12T11:49:38.357 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -e sha1=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2023-12-12T11:49:38.797 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:49:39.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:38 smithi093 ceph-mon[115914]: pgmap v170: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-12T11:49:39.289 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:38 smithi063 ceph-mon[107117]: pgmap v170: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-12T11:49:39.994 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.992+0000 7fb78138c700 1 -- 172.21.15.63:0/2617513685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb77c0fde00 msgr2=0x7fb77c0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:39.994 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.992+0000 7fb78138c700 1 --2- 172.21.15.63:0/2617513685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb77c0fde00 0x7fb77c0fe250 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb770004940 tx=0x7fb770009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:39.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.992+0000 7fb78138c700 1 -- 172.21.15.63:0/2617513685 shutdown_connections 2023-12-12T11:49:39.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.992+0000 7fb78138c700 1 --2- 172.21.15.63:0/2617513685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb77c0fde00 0x7fb77c0fe250 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:39.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.992+0000 7fb78138c700 1 --2- 172.21.15.63:0/2617513685 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb77c0fcbf0 0x7fb77c0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:39.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.992+0000 7fb78138c700 1 -- 172.21.15.63:0/2617513685 >> 172.21.15.63:0/2617513685 conn(0x7fb77c0f82d0 msgr2=0x7fb77c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:39.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.992+0000 7fb78138c700 1 -- 172.21.15.63:0/2617513685 shutdown_connections 2023-12-12T11:49:39.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.992+0000 7fb78138c700 1 -- 172.21.15.63:0/2617513685 wait complete. 2023-12-12T11:49:39.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.993+0000 7fb78138c700 1 Processor -- start 2023-12-12T11:49:39.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.993+0000 7fb78138c700 1 -- start start 2023-12-12T11:49:39.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.993+0000 7fb78138c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb77c0fcbf0 0x7fb77c10f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:39.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.994+0000 7fb78138c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb77c0fde00 0x7fb77c10fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:39.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.994+0000 7fb78138c700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c110310 con 0x7fb77c0fde00 2023-12-12T11:49:39.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.994+0000 7fb78138c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c110b60 con 0x7fb77c0fcbf0 2023-12-12T11:49:39.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.994+0000 7fb77a7fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb77c0fde00 0x7fb77c10fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:39.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.994+0000 7fb77a7fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb77c0fde00 0x7fb77c10fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57490/0 (socket says 172.21.15.63:57490) 2023-12-12T11:49:39.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.994+0000 7fb77a7fc700 1 -- 172.21.15.63:0/3802553119 learned_addr learned my addr 172.21.15.63:0/3802553119 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:49:39.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.994+0000 7fb77affd700 1 --2- 172.21.15.63:0/3802553119 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb77c0fcbf0 0x7fb77c10f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:39.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.994+0000 7fb77a7fc700 1 -- 172.21.15.63:0/3802553119 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb77c0fcbf0 msgr2=0x7fb77c10f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:39.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.994+0000 7fb77a7fc700 1 --2- 172.21.15.63:0/3802553119 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb77c0fcbf0 0x7fb77c10f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:39.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.994+0000 7fb77a7fc700 1 -- 172.21.15.63:0/3802553119 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb770005040 con 0x7fb77c0fde00 2023-12-12T11:49:39.998 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.994+0000 7fb77a7fc700 1 --2- 172.21.15.63:0/3802553119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb77c0fde00 0x7fb77c10fd10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb770009380 tx=0x7fb770009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:39.998 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.995+0000 7fb7637fe700 1 -- 172.21.15.63:0/3802553119 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb77000e040 con 0x7fb77c0fde00 2023-12-12T11:49:39.998 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.995+0000 7fb7637fe700 1 -- 172.21.15.63:0/3802553119 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb77000bd20 con 0x7fb77c0fde00 2023-12-12T11:49:39.998 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.995+0000 7fb78138c700 1 -- 172.21.15.63:0/3802553119 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb77c110de0 con 0x7fb77c0fde00 2023-12-12T11:49:39.998 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.995+0000 7fb7637fe700 1 -- 172.21.15.63:0/3802553119 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb77001c630 con 0x7fb77c0fde00 2023-12-12T11:49:39.998 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.995+0000 7fb78138c700 1 -- 172.21.15.63:0/3802553119 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb77c111320 con 0x7fb77c0fde00 2023-12-12T11:49:39.998 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.996+0000 7fb78138c700 1 -- 172.21.15.63:0/3802553119 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb77c101ea0 con 0x7fb77c0fde00 2023-12-12T11:49:39.999 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.997+0000 7fb7637fe700 1 -- 172.21.15.63:0/3802553119 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fb770013420 con 0x7fb77c0fde00 2023-12-12T11:49:40.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.998+0000 7fb7637fe700 1 --2- 172.21.15.63:0/3802553119 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb764068f60 0x7fb76406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:40.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.998+0000 7fb7637fe700 1 -- 172.21.15.63:0/3802553119 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb7700880b0 con 0x7fb77c0fde00 2023-12-12T11:49:40.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.998+0000 7fb77affd700 1 --2- 172.21.15.63:0/3802553119 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb764068f60 0x7fb76406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:40.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:39.999+0000 7fb77affd700 1 --2- 172.21.15.63:0/3802553119 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb764068f60 0x7fb76406b410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb77c0fdc60 tx=0x7fb76c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:40.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:40.002+0000 7fb7637fe700 1 -- 172.21.15.63:0/3802553119 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb770058060 con 0x7fb77c0fde00 2023-12-12T11:49:40.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:40.205+0000 7fb78138c700 1 -- 172.21.15.63:0/3802553119 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fb77c111650 con 0x7fb77c0fde00 2023-12-12T11:49:40.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:40.205+0000 7fb7637fe700 1 -- 172.21.15.63:0/3802553119 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7fb770057bf0 con 0x7fb77c0fde00 2023-12-12T11:49:40.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:40.208+0000 7fb78138c700 1 -- 172.21.15.63:0/3802553119 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb764068f60 msgr2=0x7fb76406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:40.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:40.208+0000 7fb78138c700 1 --2- 172.21.15.63:0/3802553119 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb764068f60 0x7fb76406b410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb77c0fdc60 tx=0x7fb76c00b040 comp rx=0 tx=0).stop 2023-12-12T11:49:40.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:40.208+0000 7fb78138c700 1 -- 172.21.15.63:0/3802553119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb77c0fde00 msgr2=0x7fb77c10fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:40.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:40.208+0000 7fb78138c700 1 --2- 172.21.15.63:0/3802553119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb77c0fde00 0x7fb77c10fd10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb770009380 tx=0x7fb770009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:40.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:40.208+0000 7fb78138c700 1 -- 172.21.15.63:0/3802553119 shutdown_connections 2023-12-12T11:49:40.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:40.208+0000 7fb78138c700 1 --2- 172.21.15.63:0/3802553119 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb77c0fcbf0 0x7fb77c10f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:40.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:40.208+0000 7fb78138c700 1 --2- 172.21.15.63:0/3802553119 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb764068f60 0x7fb76406b410 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:40.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:40.208+0000 7fb78138c700 1 --2- 172.21.15.63:0/3802553119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb77c0fde00 0x7fb77c10fd10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:40.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:40.208+0000 7fb78138c700 1 -- 172.21.15.63:0/3802553119 >> 172.21.15.63:0/3802553119 conn(0x7fb77c0f82d0 msgr2=0x7fb77c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:40.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:40.208+0000 7fb78138c700 1 -- 172.21.15.63:0/3802553119 shutdown_connections 2023-12-12T11:49:40.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:40.208+0000 7fb78138c700 1 -- 172.21.15.63:0/3802553119 wait complete. 2023-12-12T11:49:40.606 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -e sha1=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 -- bash -c 'ceph config set global log_to_journald false --force' 2023-12-12T11:49:41.042 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:49:41.200 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:40 smithi063 ceph-mon[107117]: pgmap v171: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2023-12-12T11:49:41.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:40 smithi093 ceph-mon[115914]: pgmap v171: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2023-12-12T11:49:42.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.241+0000 7f9963457700 1 -- 172.21.15.63:0/2261360456 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f995c071bc0 msgr2=0x7f995c070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:42.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.241+0000 7f9963457700 1 --2- 172.21.15.63:0/2261360456 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f995c071bc0 0x7f995c070030 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9958004940 tx=0x7f9958009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:42.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.241+0000 7f9963457700 1 -- 172.21.15.63:0/2261360456 shutdown_connections 2023-12-12T11:49:42.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.241+0000 7f9963457700 1 --2- 172.21.15.63:0/2261360456 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f995c070570 0x7f995c0709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:42.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.241+0000 7f9963457700 1 --2- 172.21.15.63:0/2261360456 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f995c071bc0 0x7f995c070030 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:42.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.241+0000 7f9963457700 1 -- 172.21.15.63:0/2261360456 >> 172.21.15.63:0/2261360456 conn(0x7f995c0f82d0 msgr2=0x7f995c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:42.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.241+0000 7f9963457700 1 -- 172.21.15.63:0/2261360456 shutdown_connections 2023-12-12T11:49:42.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.242+0000 7f9963457700 1 -- 172.21.15.63:0/2261360456 wait complete. 2023-12-12T11:49:42.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.242+0000 7f9963457700 1 Processor -- start 2023-12-12T11:49:42.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.242+0000 7f9963457700 1 -- start start 2023-12-12T11:49:42.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.243+0000 7f9963457700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f995c070570 0x7f995c10f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:42.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.243+0000 7f9963457700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f995c071bc0 0x7f995c10fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:42.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.243+0000 7f9963457700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995c110420 con 0x7f995c070570 2023-12-12T11:49:42.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.243+0000 7f9963457700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995c110cc0 con 0x7f995c071bc0 2023-12-12T11:49:42.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.243+0000 7f99611f3700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f995c070570 0x7f995c10f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:42.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.243+0000 7f99611f3700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f995c070570 0x7f995c10f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57508/0 (socket says 172.21.15.63:57508) 2023-12-12T11:49:42.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.243+0000 7f99611f3700 1 -- 172.21.15.63:0/2956038629 learned_addr learned my addr 172.21.15.63:0/2956038629 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:49:42.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.243+0000 7f99609f2700 1 --2- 172.21.15.63:0/2956038629 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f995c071bc0 0x7f995c10fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:42.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.243+0000 7f99611f3700 1 -- 172.21.15.63:0/2956038629 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f995c071bc0 msgr2=0x7f995c10fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:42.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.243+0000 7f99611f3700 1 --2- 172.21.15.63:0/2956038629 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f995c071bc0 0x7f995c10fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:42.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.243+0000 7f99611f3700 1 -- 172.21.15.63:0/2956038629 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9958005040 con 0x7f995c070570 2023-12-12T11:49:42.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.244+0000 7f99611f3700 1 --2- 172.21.15.63:0/2956038629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f995c070570 0x7f995c10f8e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f995800b3b0 tx=0x7f9958009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:42.247 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.244+0000 7f9951ffb700 1 -- 172.21.15.63:0/2956038629 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f995800e040 con 0x7f995c070570 2023-12-12T11:49:42.247 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.244+0000 7f9951ffb700 1 -- 172.21.15.63:0/2956038629 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f995800bc70 con 0x7f995c070570 2023-12-12T11:49:42.247 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.244+0000 7f9963457700 1 -- 172.21.15.63:0/2956038629 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f995c110f40 con 0x7f995c070570 2023-12-12T11:49:42.247 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.244+0000 7f9951ffb700 1 -- 172.21.15.63:0/2956038629 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f995801c630 con 0x7f995c070570 2023-12-12T11:49:42.247 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.244+0000 7f9963457700 1 -- 172.21.15.63:0/2956038629 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f995c111480 con 0x7f995c070570 2023-12-12T11:49:42.247 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.245+0000 7f9963457700 1 -- 172.21.15.63:0/2956038629 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f995c1096f0 con 0x7f995c070570 2023-12-12T11:49:42.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.246+0000 7f9951ffb700 1 -- 172.21.15.63:0/2956038629 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f9958013960 con 0x7f995c070570 2023-12-12T11:49:42.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.247+0000 7f9951ffb700 1 --2- 172.21.15.63:0/2956038629 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f9948068f70 0x7f994806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:42.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.247+0000 7f9951ffb700 1 -- 172.21.15.63:0/2956038629 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f99580882b0 con 0x7f995c070570 2023-12-12T11:49:42.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.247+0000 7f99609f2700 1 --2- 172.21.15.63:0/2956038629 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f9948068f70 0x7f994806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:42.250 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.248+0000 7f99609f2700 1 --2- 172.21.15.63:0/2956038629 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f9948068f70 0x7f994806b420 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f994c004990 tx=0x7f994c009ee0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:42.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.252+0000 7f9951ffb700 1 -- 172.21.15.63:0/2956038629 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9958058120 con 0x7f995c070570 2023-12-12T11:49:42.455 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.453+0000 7f9963457700 1 -- 172.21.15.63:0/2956038629 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f995c04bb80 con 0x7f995c070570 2023-12-12T11:49:42.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.453+0000 7f9951ffb700 1 -- 172.21.15.63:0/2956038629 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f9958057cb0 con 0x7f995c070570 2023-12-12T11:49:42.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.456+0000 7f9963457700 1 -- 172.21.15.63:0/2956038629 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f9948068f70 msgr2=0x7f994806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:42.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.456+0000 7f9963457700 1 --2- 172.21.15.63:0/2956038629 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f9948068f70 0x7f994806b420 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f994c004990 tx=0x7f994c009ee0 comp rx=0 tx=0).stop 2023-12-12T11:49:42.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.456+0000 7f9963457700 1 -- 172.21.15.63:0/2956038629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f995c070570 msgr2=0x7f995c10f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:42.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.456+0000 7f9963457700 1 --2- 172.21.15.63:0/2956038629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f995c070570 0x7f995c10f8e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f995800b3b0 tx=0x7f9958009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:42.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.456+0000 7f9963457700 1 -- 172.21.15.63:0/2956038629 shutdown_connections 2023-12-12T11:49:42.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.456+0000 7f9963457700 1 --2- 172.21.15.63:0/2956038629 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f9948068f70 0x7f994806b420 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:42.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.456+0000 7f9963457700 1 --2- 172.21.15.63:0/2956038629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f995c070570 0x7f995c10f8e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:42.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.456+0000 7f9963457700 1 --2- 172.21.15.63:0/2956038629 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f995c071bc0 0x7f995c10fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:42.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.456+0000 7f9963457700 1 -- 172.21.15.63:0/2956038629 >> 172.21.15.63:0/2956038629 conn(0x7f995c0f82d0 msgr2=0x7f995c103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:42.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.456+0000 7f9963457700 1 -- 172.21.15.63:0/2956038629 shutdown_connections 2023-12-12T11:49:42.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:42.456+0000 7f9963457700 1 -- 172.21.15.63:0/2956038629 wait complete. 2023-12-12T11:49:42.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:42 smithi063 ceph-mon[107117]: pgmap v172: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-12T11:49:42.823 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -e sha1=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2023-12-12T11:49:42.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:42 smithi093 ceph-mon[115914]: pgmap v172: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-12T11:49:43.260 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:49:44.435 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.432+0000 7f8bd6700700 1 -- 172.21.15.63:0/2515005780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bd00fde00 msgr2=0x7f8bd00fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:44.435 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.432+0000 7f8bd6700700 1 --2- 172.21.15.63:0/2515005780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bd00fde00 0x7f8bd00fe250 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4004940 tx=0x7f8bc4009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:44.435 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.432+0000 7f8bd6700700 1 -- 172.21.15.63:0/2515005780 shutdown_connections 2023-12-12T11:49:44.435 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.432+0000 7f8bd6700700 1 --2- 172.21.15.63:0/2515005780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bd00fde00 0x7f8bd00fe250 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:44.435 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.432+0000 7f8bd6700700 1 --2- 172.21.15.63:0/2515005780 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8bd00fcbf0 0x7f8bd00fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:44.435 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.432+0000 7f8bd6700700 1 -- 172.21.15.63:0/2515005780 >> 172.21.15.63:0/2515005780 conn(0x7f8bd00f82d0 msgr2=0x7f8bd00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:44.435 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.432+0000 7f8bd6700700 1 -- 172.21.15.63:0/2515005780 shutdown_connections 2023-12-12T11:49:44.435 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.432+0000 7f8bd6700700 1 -- 172.21.15.63:0/2515005780 wait complete. 2023-12-12T11:49:44.436 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.433+0000 7f8bd6700700 1 Processor -- start 2023-12-12T11:49:44.436 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.434+0000 7f8bd6700700 1 -- start start 2023-12-12T11:49:44.436 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.434+0000 7f8bd6700700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bd00fcbf0 0x7f8bd0071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:44.436 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.434+0000 7f8bd6700700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8bd00fde00 0x7f8bd006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:44.437 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.434+0000 7f8bd6700700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd0070590 con 0x7f8bd00fcbf0 2023-12-12T11:49:44.437 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.434+0000 7f8bd6700700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd0070700 con 0x7f8bd00fde00 2023-12-12T11:49:44.437 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.435+0000 7f8bcffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bd00fcbf0 0x7f8bd0071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:44.437 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.435+0000 7f8bcffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bd00fcbf0 0x7f8bd0071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57520/0 (socket says 172.21.15.63:57520) 2023-12-12T11:49:44.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.435+0000 7f8bcffff700 1 -- 172.21.15.63:0/971639480 learned_addr learned my addr 172.21.15.63:0/971639480 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:49:44.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.435+0000 7f8bcf7fe700 1 --2- 172.21.15.63:0/971639480 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8bd00fde00 0x7f8bd006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:44.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.435+0000 7f8bcffff700 1 -- 172.21.15.63:0/971639480 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8bd00fde00 msgr2=0x7f8bd006ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:44.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.435+0000 7f8bcffff700 1 --2- 172.21.15.63:0/971639480 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8bd00fde00 0x7f8bd006ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:44.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.435+0000 7f8bcffff700 1 -- 172.21.15.63:0/971639480 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc4005040 con 0x7f8bd00fcbf0 2023-12-12T11:49:44.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.435+0000 7f8bcf7fe700 1 --2- 172.21.15.63:0/971639480 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8bd00fde00 0x7f8bd006ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T11:49:44.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.435+0000 7f8bcffff700 1 --2- 172.21.15.63:0/971639480 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bd00fcbf0 0x7f8bd0071b10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8bc000eb70 tx=0x7f8bc000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:44.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.435+0000 7f8bccff9700 1 -- 172.21.15.63:0/971639480 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bc0007cc0 con 0x7f8bd00fcbf0 2023-12-12T11:49:44.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.435+0000 7f8bccff9700 1 -- 172.21.15.63:0/971639480 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8bc000f040 con 0x7f8bd00fcbf0 2023-12-12T11:49:44.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.435+0000 7f8bd6700700 1 -- 172.21.15.63:0/971639480 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd0070980 con 0x7f8bd00fcbf0 2023-12-12T11:49:44.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.436+0000 7f8bccff9700 1 -- 172.21.15.63:0/971639480 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bc000cad0 con 0x7f8bd00fcbf0 2023-12-12T11:49:44.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.436+0000 7f8bd6700700 1 -- 172.21.15.63:0/971639480 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd0115520 con 0x7f8bd00fcbf0 2023-12-12T11:49:44.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.437+0000 7f8bd6700700 1 -- 172.21.15.63:0/971639480 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd004bb80 con 0x7f8bd00fcbf0 2023-12-12T11:49:44.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.438+0000 7f8bccff9700 1 -- 172.21.15.63:0/971639480 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f8bc000cc30 con 0x7f8bd00fcbf0 2023-12-12T11:49:44.441 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.439+0000 7f8bccff9700 1 --2- 172.21.15.63:0/971639480 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f8bb8068f70 0x7f8bb806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:44.441 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.439+0000 7f8bccff9700 1 -- 172.21.15.63:0/971639480 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8bc00868e0 con 0x7f8bd00fcbf0 2023-12-12T11:49:44.441 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.439+0000 7f8bcf7fe700 1 --2- 172.21.15.63:0/971639480 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f8bb8068f70 0x7f8bb806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:44.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.440+0000 7f8bcf7fe700 1 --2- 172.21.15.63:0/971639480 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f8bb8068f70 0x7f8bb806b420 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8bc40135e0 tx=0x7f8bc4009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:44.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.442+0000 7f8bccff9700 1 -- 172.21.15.63:0/971639480 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8bc004da00 con 0x7f8bd00fcbf0 2023-12-12T11:49:44.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.667+0000 7f8bd6700700 1 -- 172.21.15.63:0/971639480 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f1fbf3c583d03e19f5e58eb618e78d8e10d075f9", "target": ["mon-mgr", ""]}) v1 -- 0x7f8bd01027f0 con 0x7f8bb8068f70 2023-12-12T11:49:44.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.673+0000 7f8bccff9700 1 -- 172.21.15.63:0/971639480 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f8bd01027f0 con 0x7f8bb8068f70 2023-12-12T11:49:44.675 INFO:teuthology.orchestra.run.smithi063.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 2023-12-12T11:49:44.678 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.676+0000 7f8bd6700700 1 -- 172.21.15.63:0/971639480 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f8bb8068f70 msgr2=0x7f8bb806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:44.678 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.676+0000 7f8bd6700700 1 --2- 172.21.15.63:0/971639480 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f8bb8068f70 0x7f8bb806b420 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8bc40135e0 tx=0x7f8bc4009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:44.678 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.676+0000 7f8bd6700700 1 -- 172.21.15.63:0/971639480 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bd00fcbf0 msgr2=0x7f8bd0071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:44.678 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.676+0000 7f8bd6700700 1 --2- 172.21.15.63:0/971639480 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bd00fcbf0 0x7f8bd0071b10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8bc000eb70 tx=0x7f8bc000b040 comp rx=0 tx=0).stop 2023-12-12T11:49:44.678 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.676+0000 7f8bd6700700 1 -- 172.21.15.63:0/971639480 shutdown_connections 2023-12-12T11:49:44.678 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.676+0000 7f8bd6700700 1 --2- 172.21.15.63:0/971639480 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f8bb8068f70 0x7f8bb806b420 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:44.678 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.676+0000 7f8bd6700700 1 --2- 172.21.15.63:0/971639480 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bd00fcbf0 0x7f8bd0071b10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:44.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.676+0000 7f8bd6700700 1 --2- 172.21.15.63:0/971639480 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8bd00fde00 0x7f8bd006ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:44.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.676+0000 7f8bd6700700 1 -- 172.21.15.63:0/971639480 >> 172.21.15.63:0/971639480 conn(0x7f8bd00f82d0 msgr2=0x7f8bd0101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:44.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.676+0000 7f8bd6700700 1 -- 172.21.15.63:0/971639480 shutdown_connections 2023-12-12T11:49:44.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:44.676+0000 7f8bd6700700 1 -- 172.21.15.63:0/971639480 wait complete. 2023-12-12T11:49:45.030 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:44 smithi063 ceph-mon[107117]: pgmap v173: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-12T11:49:45.030 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:44 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:45.030 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:44 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:49:45.054 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-12T11:49:45.054 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi063.front.sepia.ceph.com 2023-12-12T11:49:45.054 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -e sha1=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2023-12-12T11:49:45.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:44 smithi093 ceph-mon[115914]: pgmap v173: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-12T11:49:45.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:44 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:45.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:44 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:49:45.516 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:49:46.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:45 smithi063 ceph-mon[107117]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f1fbf3c583d03e19f5e58eb618e78d8e10d075f9", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:49:46.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:45 smithi063 ceph-mon[107117]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 2023-12-12T11:49:46.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:45 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:49:46.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:45 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:49:46.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:45 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:46.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:45 smithi093 ceph-mon[115914]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f1fbf3c583d03e19f5e58eb618e78d8e10d075f9", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:49:46.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:45 smithi093 ceph-mon[115914]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 2023-12-12T11:49:46.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:45 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:49:46.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:45 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:49:46.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:45 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:49:46.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.793+0000 7fb1180bf700 1 -- 172.21.15.63:0/3664493276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb110100050 msgr2=0x7fb110102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:46.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.793+0000 7fb1180bf700 1 --2- 172.21.15.63:0/3664493276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb110100050 0x7fb110102430 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb100004940 tx=0x7fb100009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:46.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.793+0000 7fb1180bf700 1 -- 172.21.15.63:0/3664493276 shutdown_connections 2023-12-12T11:49:46.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.793+0000 7fb1180bf700 1 --2- 172.21.15.63:0/3664493276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb110100050 0x7fb110102430 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:46.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.793+0000 7fb1180bf700 1 --2- 172.21.15.63:0/3664493276 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1100fd730 0x7fb1100ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:46.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.793+0000 7fb1180bf700 1 -- 172.21.15.63:0/3664493276 >> 172.21.15.63:0/3664493276 conn(0x7fb1100f71d0 msgr2=0x7fb1100f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:46.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.793+0000 7fb1180bf700 1 -- 172.21.15.63:0/3664493276 shutdown_connections 2023-12-12T11:49:46.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.793+0000 7fb1180bf700 1 -- 172.21.15.63:0/3664493276 wait complete. 2023-12-12T11:49:46.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.794+0000 7fb1180bf700 1 Processor -- start 2023-12-12T11:49:46.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.794+0000 7fb1180bf700 1 -- start start 2023-12-12T11:49:46.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.794+0000 7fb1180bf700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1100fd730 0x7fb1100fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:46.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.794+0000 7fb1180bf700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb110100050 0x7fb1100fb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:46.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.794+0000 7fb1180bf700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb110111200 con 0x7fb1100fd730 2023-12-12T11:49:46.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.794+0000 7fb1180bf700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb110111370 con 0x7fb110100050 2023-12-12T11:49:46.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.795+0000 7fb115e5b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1100fd730 0x7fb1100fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:46.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.795+0000 7fb115e5b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1100fd730 0x7fb1100fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57536/0 (socket says 172.21.15.63:57536) 2023-12-12T11:49:46.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.795+0000 7fb115e5b700 1 -- 172.21.15.63:0/2538012740 learned_addr learned my addr 172.21.15.63:0/2538012740 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:49:46.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.795+0000 7fb11565a700 1 --2- 172.21.15.63:0/2538012740 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb110100050 0x7fb1100fb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:46.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.795+0000 7fb115e5b700 1 -- 172.21.15.63:0/2538012740 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb110100050 msgr2=0x7fb1100fb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:46.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.795+0000 7fb115e5b700 1 --2- 172.21.15.63:0/2538012740 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb110100050 0x7fb1100fb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:46.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.795+0000 7fb115e5b700 1 -- 172.21.15.63:0/2538012740 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb100005040 con 0x7fb1100fd730 2023-12-12T11:49:46.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.796+0000 7fb115e5b700 1 --2- 172.21.15.63:0/2538012740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1100fd730 0x7fb1100fd1c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb10c002a50 tx=0x7fb10c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:46.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.796+0000 7fb1067fc700 1 -- 172.21.15.63:0/2538012740 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb10c007cc0 con 0x7fb1100fd730 2023-12-12T11:49:46.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.796+0000 7fb1067fc700 1 -- 172.21.15.63:0/2538012740 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb10c00f040 con 0x7fb1100fd730 2023-12-12T11:49:46.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.796+0000 7fb1067fc700 1 -- 172.21.15.63:0/2538012740 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb10c00d9c0 con 0x7fb1100fd730 2023-12-12T11:49:46.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.796+0000 7fb1180bf700 1 -- 172.21.15.63:0/2538012740 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1100fbca0 con 0x7fb1100fd730 2023-12-12T11:49:46.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.796+0000 7fb1180bf700 1 -- 172.21.15.63:0/2538012740 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1100fc1e0 con 0x7fb1100fd730 2023-12-12T11:49:46.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.797+0000 7fb1180bf700 1 -- 172.21.15.63:0/2538012740 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1101075c0 con 0x7fb1100fd730 2023-12-12T11:49:46.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.798+0000 7fb1067fc700 1 -- 172.21.15.63:0/2538012740 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fb10c00db20 con 0x7fb1100fd730 2023-12-12T11:49:46.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.799+0000 7fb1067fc700 1 --2- 172.21.15.63:0/2538012740 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb0fc068f70 0x7fb0fc06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:46.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.799+0000 7fb1067fc700 1 -- 172.21.15.63:0/2538012740 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb10c086ad0 con 0x7fb1100fd730 2023-12-12T11:49:46.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.799+0000 7fb11565a700 1 --2- 172.21.15.63:0/2538012740 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb0fc068f70 0x7fb0fc06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:46.802 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.800+0000 7fb11565a700 1 --2- 172.21.15.63:0/2538012740 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb0fc068f70 0x7fb0fc06b420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb10000b3b0 tx=0x7fb100009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:46.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:46.805+0000 7fb1067fc700 1 -- 172.21.15.63:0/2538012740 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb10c056940 con 0x7fb1100fd730 2023-12-12T11:49:47.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.075+0000 7fb1180bf700 1 -- 172.21.15.63:0/2538012740 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb11005e080 con 0x7fb0fc068f70 2023-12-12T11:49:47.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.076+0000 7fb1067fc700 1 -- 172.21.15.63:0/2538012740 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fb11005e080 con 0x7fb0fc068f70 2023-12-12T11:49:47.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.079+0000 7fb1180bf700 1 -- 172.21.15.63:0/2538012740 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb0fc068f70 msgr2=0x7fb0fc06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:47.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.079+0000 7fb1180bf700 1 --2- 172.21.15.63:0/2538012740 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb0fc068f70 0x7fb0fc06b420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb10000b3b0 tx=0x7fb100009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:47.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.079+0000 7fb1180bf700 1 -- 172.21.15.63:0/2538012740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1100fd730 msgr2=0x7fb1100fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:47.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.079+0000 7fb1180bf700 1 --2- 172.21.15.63:0/2538012740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1100fd730 0x7fb1100fd1c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb10c002a50 tx=0x7fb10c0046b0 comp rx=0 tx=0).stop 2023-12-12T11:49:47.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.079+0000 7fb1180bf700 1 -- 172.21.15.63:0/2538012740 shutdown_connections 2023-12-12T11:49:47.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.079+0000 7fb1180bf700 1 --2- 172.21.15.63:0/2538012740 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb0fc068f70 0x7fb0fc06b420 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:47.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.079+0000 7fb1180bf700 1 --2- 172.21.15.63:0/2538012740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1100fd730 0x7fb1100fd1c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:47.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.079+0000 7fb1180bf700 1 --2- 172.21.15.63:0/2538012740 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb110100050 0x7fb1100fb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:47.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.079+0000 7fb1180bf700 1 -- 172.21.15.63:0/2538012740 >> 172.21.15.63:0/2538012740 conn(0x7fb1100f71d0 msgr2=0x7fb1100f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:47.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.079+0000 7fb1180bf700 1 -- 172.21.15.63:0/2538012740 shutdown_connections 2023-12-12T11:49:47.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.079+0000 7fb1180bf700 1 -- 172.21.15.63:0/2538012740 wait complete. 2023-12-12T11:49:47.102 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-12T11:49:47.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:46 smithi093 ceph-mon[115914]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 2023-12-12T11:49:47.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:46 smithi093 ceph-mon[115914]: pgmap v174: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-12T11:49:47.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.249+0000 7f53ece55700 1 -- 172.21.15.63:0/1095399775 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53e80fcbf0 msgr2=0x7f53e80fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:47.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.249+0000 7f53ece55700 1 --2- 172.21.15.63:0/1095399775 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53e80fcbf0 0x7f53e80fd000 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f53d8004940 tx=0x7f53d8009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:47.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.249+0000 7f53ece55700 1 -- 172.21.15.63:0/1095399775 shutdown_connections 2023-12-12T11:49:47.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.249+0000 7f53ece55700 1 --2- 172.21.15.63:0/1095399775 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53e80fde00 0x7f53e80fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:47.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.249+0000 7f53ece55700 1 --2- 172.21.15.63:0/1095399775 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53e80fcbf0 0x7f53e80fd000 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:47.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.249+0000 7f53ece55700 1 -- 172.21.15.63:0/1095399775 >> 172.21.15.63:0/1095399775 conn(0x7f53e80f82d0 msgr2=0x7f53e80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:47.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.249+0000 7f53ece55700 1 -- 172.21.15.63:0/1095399775 shutdown_connections 2023-12-12T11:49:47.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.250+0000 7f53ece55700 1 -- 172.21.15.63:0/1095399775 wait complete. 2023-12-12T11:49:47.253 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.251+0000 7f53ece55700 1 Processor -- start 2023-12-12T11:49:47.253 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.251+0000 7f53ece55700 1 -- start start 2023-12-12T11:49:47.253 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.251+0000 7f53ece55700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53e80fcbf0 0x7f53e8071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:47.253 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.251+0000 7f53ece55700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53e80fde00 0x7f53e806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:47.253 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.251+0000 7f53ece55700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e8070590 con 0x7f53e80fcbf0 2023-12-12T11:49:47.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.251+0000 7f53ece55700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e8070700 con 0x7f53e80fde00 2023-12-12T11:49:47.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.251+0000 7f53e659c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53e80fcbf0 0x7f53e8071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:47.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.252+0000 7f53e659c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53e80fcbf0 0x7f53e8071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57542/0 (socket says 172.21.15.63:57542) 2023-12-12T11:49:47.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.252+0000 7f53e659c700 1 -- 172.21.15.63:0/3848415948 learned_addr learned my addr 172.21.15.63:0/3848415948 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:49:47.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.252+0000 7f53e5d9b700 1 --2- 172.21.15.63:0/3848415948 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53e80fde00 0x7f53e806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:47.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.252+0000 7f53e659c700 1 -- 172.21.15.63:0/3848415948 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53e80fde00 msgr2=0x7f53e806ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:47.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.252+0000 7f53e659c700 1 --2- 172.21.15.63:0/3848415948 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53e80fde00 0x7f53e806ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:47.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.252+0000 7f53e659c700 1 -- 172.21.15.63:0/3848415948 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d8005040 con 0x7f53e80fcbf0 2023-12-12T11:49:47.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.252+0000 7f53e5d9b700 1 --2- 172.21.15.63:0/3848415948 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53e80fde00 0x7f53e806ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T11:49:47.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.252+0000 7f53e659c700 1 --2- 172.21.15.63:0/3848415948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53e80fcbf0 0x7f53e8071b10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f53d8000c00 tx=0x7f53d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:47.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.252+0000 7f53d6ffd700 1 -- 172.21.15.63:0/3848415948 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53d800e040 con 0x7f53e80fcbf0 2023-12-12T11:49:47.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.252+0000 7f53d6ffd700 1 -- 172.21.15.63:0/3848415948 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f53d8009af0 con 0x7f53e80fcbf0 2023-12-12T11:49:47.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.252+0000 7f53ece55700 1 -- 172.21.15.63:0/3848415948 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e8070980 con 0x7f53e80fcbf0 2023-12-12T11:49:47.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.253+0000 7f53d6ffd700 1 -- 172.21.15.63:0/3848415948 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53d801c630 con 0x7f53e80fcbf0 2023-12-12T11:49:47.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.253+0000 7f53ece55700 1 -- 172.21.15.63:0/3848415948 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e8115590 con 0x7f53e80fcbf0 2023-12-12T11:49:47.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.254+0000 7f53ece55700 1 -- 172.21.15.63:0/3848415948 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e804bb80 con 0x7f53e80fcbf0 2023-12-12T11:49:47.258 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.256+0000 7f53d6ffd700 1 -- 172.21.15.63:0/3848415948 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f53d800bcd0 con 0x7f53e80fcbf0 2023-12-12T11:49:47.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.257+0000 7f53d6ffd700 1 --2- 172.21.15.63:0/3848415948 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f53d0068f60 0x7f53d006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:47.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.258+0000 7f53d6ffd700 1 -- 172.21.15.63:0/3848415948 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f53d8088210 con 0x7f53e80fcbf0 2023-12-12T11:49:47.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.258+0000 7f53e5d9b700 1 --2- 172.21.15.63:0/3848415948 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f53d0068f60 0x7f53d006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:47.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.258+0000 7f53e5d9b700 1 --2- 172.21.15.63:0/3848415948 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f53d0068f60 0x7f53d006b410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f53dc009fd0 tx=0x7f53dc009ee0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:47.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.263+0000 7f53d6ffd700 1 -- 172.21.15.63:0/3848415948 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f53d80581b0 con 0x7f53e80fcbf0 2023-12-12T11:49:47.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:46 smithi063 ceph-mon[107117]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 2023-12-12T11:49:47.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:46 smithi063 ceph-mon[107117]: pgmap v174: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-12T11:49:47.536 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.533+0000 7f53ece55700 1 -- 172.21.15.63:0/3848415948 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f53e8102750 con 0x7f53d0068f60 2023-12-12T11:49:47.537 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.535+0000 7f53d6ffd700 1 -- 172.21.15.63:0/3848415948 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f53e8102750 con 0x7f53d0068f60 2023-12-12T11:49:47.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.537+0000 7f53ece55700 1 -- 172.21.15.63:0/3848415948 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f53d0068f60 msgr2=0x7f53d006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:47.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.537+0000 7f53ece55700 1 --2- 172.21.15.63:0/3848415948 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f53d0068f60 0x7f53d006b410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f53dc009fd0 tx=0x7f53dc009ee0 comp rx=0 tx=0).stop 2023-12-12T11:49:47.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.537+0000 7f53ece55700 1 -- 172.21.15.63:0/3848415948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53e80fcbf0 msgr2=0x7f53e8071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:47.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.537+0000 7f53ece55700 1 --2- 172.21.15.63:0/3848415948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53e80fcbf0 0x7f53e8071b10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f53d8000c00 tx=0x7f53d8009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:47.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.537+0000 7f53ece55700 1 -- 172.21.15.63:0/3848415948 shutdown_connections 2023-12-12T11:49:47.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.537+0000 7f53ece55700 1 --2- 172.21.15.63:0/3848415948 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f53d0068f60 0x7f53d006b410 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:47.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.537+0000 7f53ece55700 1 --2- 172.21.15.63:0/3848415948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53e80fcbf0 0x7f53e8071b10 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:47.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.537+0000 7f53ece55700 1 --2- 172.21.15.63:0/3848415948 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53e80fde00 0x7f53e806ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:47.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.537+0000 7f53ece55700 1 -- 172.21.15.63:0/3848415948 >> 172.21.15.63:0/3848415948 conn(0x7f53e80f82d0 msgr2=0x7f53e8101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:47.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.538+0000 7f53ece55700 1 -- 172.21.15.63:0/3848415948 shutdown_connections 2023-12-12T11:49:47.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.538+0000 7f53ece55700 1 -- 172.21.15.63:0/3848415948 wait complete. 2023-12-12T11:49:47.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.702+0000 7feeb6a56700 1 -- 172.21.15.63:0/2650744195 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feeb00fde00 msgr2=0x7feeb00fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:47.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.702+0000 7feeb6a56700 1 --2- 172.21.15.63:0/2650744195 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feeb00fde00 0x7feeb00fe250 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7feea4004940 tx=0x7feea4009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:47.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.702+0000 7feeb6a56700 1 -- 172.21.15.63:0/2650744195 shutdown_connections 2023-12-12T11:49:47.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.702+0000 7feeb6a56700 1 --2- 172.21.15.63:0/2650744195 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feeb00fde00 0x7feeb00fe250 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:47.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.702+0000 7feeb6a56700 1 --2- 172.21.15.63:0/2650744195 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feeb00fcbf0 0x7feeb00fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:47.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.702+0000 7feeb6a56700 1 -- 172.21.15.63:0/2650744195 >> 172.21.15.63:0/2650744195 conn(0x7feeb00f82d0 msgr2=0x7feeb00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:47.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.702+0000 7feeb6a56700 1 -- 172.21.15.63:0/2650744195 shutdown_connections 2023-12-12T11:49:47.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.702+0000 7feeb6a56700 1 -- 172.21.15.63:0/2650744195 wait complete. 2023-12-12T11:49:47.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.703+0000 7feeb6a56700 1 Processor -- start 2023-12-12T11:49:47.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.703+0000 7feeb6a56700 1 -- start start 2023-12-12T11:49:47.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.703+0000 7feeb6a56700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feeb00fcbf0 0x7feeb010f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:47.706 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.703+0000 7feeb6a56700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feeb00fde00 0x7feeb010fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:47.706 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.703+0000 7feeb6a56700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb0110290 con 0x7feeb00fde00 2023-12-12T11:49:47.706 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.703+0000 7feeb6a56700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb0110b30 con 0x7feeb00fcbf0 2023-12-12T11:49:47.706 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.704+0000 7feeaf7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feeb00fde00 0x7feeb010fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:47.706 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.704+0000 7feeaf7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feeb00fde00 0x7feeb010fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57556/0 (socket says 172.21.15.63:57556) 2023-12-12T11:49:47.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.704+0000 7feeaf7fe700 1 -- 172.21.15.63:0/542825929 learned_addr learned my addr 172.21.15.63:0/542825929 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:49:47.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.704+0000 7feeaffff700 1 --2- 172.21.15.63:0/542825929 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feeb00fcbf0 0x7feeb010f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:47.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.704+0000 7feeaf7fe700 1 -- 172.21.15.63:0/542825929 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feeb00fcbf0 msgr2=0x7feeb010f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:47.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.704+0000 7feeaf7fe700 1 --2- 172.21.15.63:0/542825929 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feeb00fcbf0 0x7feeb010f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:47.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.704+0000 7feeaf7fe700 1 -- 172.21.15.63:0/542825929 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea4005040 con 0x7feeb00fde00 2023-12-12T11:49:47.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.704+0000 7feeaf7fe700 1 --2- 172.21.15.63:0/542825929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feeb00fde00 0x7feeb010fc90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7feea400b3b0 tx=0x7feea4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:47.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.705+0000 7feeacff9700 1 -- 172.21.15.63:0/542825929 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feea400e040 con 0x7feeb00fde00 2023-12-12T11:49:47.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.705+0000 7feeacff9700 1 -- 172.21.15.63:0/542825929 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7feea400bc50 con 0x7feeb00fde00 2023-12-12T11:49:47.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.705+0000 7feeacff9700 1 -- 172.21.15.63:0/542825929 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feea401c630 con 0x7feeb00fde00 2023-12-12T11:49:47.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.705+0000 7feeb6a56700 1 -- 172.21.15.63:0/542825929 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb0110db0 con 0x7feeb00fde00 2023-12-12T11:49:47.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.705+0000 7feeb6a56700 1 -- 172.21.15.63:0/542825929 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb01112f0 con 0x7feeb00fde00 2023-12-12T11:49:47.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.706+0000 7feeb6a56700 1 -- 172.21.15.63:0/542825929 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb0101ea0 con 0x7feeb00fde00 2023-12-12T11:49:47.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.707+0000 7feeacff9700 1 -- 172.21.15.63:0/542825929 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7feea4013420 con 0x7feeb00fde00 2023-12-12T11:49:47.712 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.710+0000 7feeacff9700 1 --2- 172.21.15.63:0/542825929 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fee98068f70 0x7fee9806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:47.712 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.710+0000 7feeacff9700 1 -- 172.21.15.63:0/542825929 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7feea4088140 con 0x7feeb00fde00 2023-12-12T11:49:47.712 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.710+0000 7feeaffff700 1 --2- 172.21.15.63:0/542825929 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fee98068f70 0x7fee9806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:47.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.711+0000 7feeaffff700 1 --2- 172.21.15.63:0/542825929 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fee98068f70 0x7fee9806b420 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feeb00fdc60 tx=0x7feea000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:47.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.714+0000 7feeacff9700 1 -- 172.21.15.63:0/542825929 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7feea40580f0 con 0x7feeb00fde00 2023-12-12T11:49:47.992 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:47.990+0000 7feeb6a56700 1 -- 172.21.15.63:0/542825929 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7feeb0111620 con 0x7fee98068f70 2023-12-12T11:49:48.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.000+0000 7feeacff9700 1 -- 172.21.15.63:0/542825929 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7feeb0111620 con 0x7fee98068f70 2023-12-12T11:49:48.002 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-12T11:49:48.002 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (4m) 28s ago 5m - - 0.25.0 c8568f914cd2 cd61d03c786f 2023-12-12T11:49:48.002 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (5m) 28s ago 5m - - 17.2.7-123-gbef78a51 ae6196193935 ee4415610fae 2023-12-12T11:49:48.002 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi093 smithi093 running (4m) 31s ago 4m 7810k - 17.2.7-123-gbef78a51 ae6196193935 f64e68742cfe 2023-12-12T11:49:48.003 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (4m) 28s ago 5m - - 9.4.7 954c08fa6188 2eeaef85f231 2023-12-12T11:49:48.003 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.aevpzg smithi063 running (41s) 28s ago 41s - - 17.2.7-123-gbef78a51 ae6196193935 df9a6781f836 2023-12-12T11:49:48.003 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.bdqbnp smithi063 running (46s) 28s ago 46s - - 17.2.7-123-gbef78a51 ae6196193935 0c7e1d21eee9 2023-12-12T11:49:48.003 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.rhaqsh smithi093 running (44s) 31s ago 44s 12.0M - 17.2.7-123-gbef78a51 ae6196193935 257aee771d87 2023-12-12T11:49:48.003 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.swdqms smithi093 running (38s) 31s ago 38s 12.0M - 17.2.7-123-gbef78a51 ae6196193935 f46d7173d3b1 2023-12-12T11:49:48.003 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.zjnfdi smithi063 *:9283 running (6m) 28s ago 6m - - 17.2.7-123-gbef78a51 ae6196193935 1b9efe5a68d3 2023-12-12T11:49:48.003 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi093.nbtltu smithi093 *:8443,9283 running (4m) 31s ago 4m 442M - 17.2.7-123-gbef78a51 ae6196193935 ecfd38b909a0 2023-12-12T11:49:48.003 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (6m) 28s ago 6m - 2048M 17.2.7-123-gbef78a51 ae6196193935 ee8e9d7455f9 2023-12-12T11:49:48.003 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi093 smithi093 running (4m) 31s ago 4m 45.4M 2048M 17.2.7-123-gbef78a51 ae6196193935 fac71666a805 2023-12-12T11:49:48.003 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (5m) 28s ago 5m - - 1.5.0 0da6a335fe13 9c94f98d1396 2023-12-12T11:49:48.003 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi093 smithi093 *:9100 running (4m) 31s ago 4m 8942k - 1.5.0 0da6a335fe13 55fa35accdef 2023-12-12T11:49:48.003 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (3m) 28s ago 3m - 4349M 17.2.7-123-gbef78a51 ae6196193935 636790d2b28c 2023-12-12T11:49:48.003 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (3m) 28s ago 3m - 4349M 17.2.7-123-gbef78a51 ae6196193935 5388a4bc6b12 2023-12-12T11:49:48.003 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (2m) 28s ago 2m - 4349M 17.2.7-123-gbef78a51 ae6196193935 9eb2483337c8 2023-12-12T11:49:48.004 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi093 running (2m) 31s ago 2m 54.0M 5373M 17.2.7-123-gbef78a51 ae6196193935 5b2bb36b5843 2023-12-12T11:49:48.004 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi093 running (2m) 31s ago 2m 48.9M 5373M 17.2.7-123-gbef78a51 ae6196193935 7dc3f04b04cb 2023-12-12T11:49:48.004 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi093 running (111s) 31s ago 111s 48.2M 5373M 17.2.7-123-gbef78a51 ae6196193935 16fe8e4668f1 2023-12-12T11:49:48.004 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (3m) 28s ago 4m - - 2.43.0 a07b618ecd1d 14c481676fd7 2023-12-12T11:49:48.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.003+0000 7feeb6a56700 1 -- 172.21.15.63:0/542825929 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fee98068f70 msgr2=0x7fee9806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:48.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.003+0000 7feeb6a56700 1 --2- 172.21.15.63:0/542825929 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fee98068f70 0x7fee9806b420 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feeb00fdc60 tx=0x7feea000b040 comp rx=0 tx=0).stop 2023-12-12T11:49:48.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.003+0000 7feeb6a56700 1 -- 172.21.15.63:0/542825929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feeb00fde00 msgr2=0x7feeb010fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:48.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.003+0000 7feeb6a56700 1 --2- 172.21.15.63:0/542825929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feeb00fde00 0x7feeb010fc90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7feea400b3b0 tx=0x7feea4009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:48.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.003+0000 7feeb6a56700 1 -- 172.21.15.63:0/542825929 shutdown_connections 2023-12-12T11:49:48.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.003+0000 7feeb6a56700 1 --2- 172.21.15.63:0/542825929 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feeb00fcbf0 0x7feeb010f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:48.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.003+0000 7feeb6a56700 1 --2- 172.21.15.63:0/542825929 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fee98068f70 0x7fee9806b420 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:48.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.003+0000 7feeb6a56700 1 --2- 172.21.15.63:0/542825929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feeb00fde00 0x7feeb010fc90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:48.006 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.003+0000 7feeb6a56700 1 -- 172.21.15.63:0/542825929 >> 172.21.15.63:0/542825929 conn(0x7feeb00f82d0 msgr2=0x7feeb00ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:48.006 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.003+0000 7feeb6a56700 1 -- 172.21.15.63:0/542825929 shutdown_connections 2023-12-12T11:49:48.006 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.003+0000 7feeb6a56700 1 -- 172.21.15.63:0/542825929 wait complete. 2023-12-12T11:49:48.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.170+0000 7fe16b944700 1 -- 172.21.15.63:0/2674752058 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1640fcbf0 msgr2=0x7fe1640fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:48.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.170+0000 7fe16b944700 1 --2- 172.21.15.63:0/2674752058 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1640fcbf0 0x7fe1640fd000 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe160004940 tx=0x7fe160009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:48.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.170+0000 7fe16b944700 1 -- 172.21.15.63:0/2674752058 shutdown_connections 2023-12-12T11:49:48.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.170+0000 7fe16b944700 1 --2- 172.21.15.63:0/2674752058 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe1640fde00 0x7fe1640fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:48.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.170+0000 7fe16b944700 1 --2- 172.21.15.63:0/2674752058 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1640fcbf0 0x7fe1640fd000 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:48.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.170+0000 7fe16b944700 1 -- 172.21.15.63:0/2674752058 >> 172.21.15.63:0/2674752058 conn(0x7fe1640f82d0 msgr2=0x7fe1640fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:48.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.170+0000 7fe16b944700 1 -- 172.21.15.63:0/2674752058 shutdown_connections 2023-12-12T11:49:48.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.170+0000 7fe16b944700 1 -- 172.21.15.63:0/2674752058 wait complete. 2023-12-12T11:49:48.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.171+0000 7fe16b944700 1 Processor -- start 2023-12-12T11:49:48.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.171+0000 7fe16b944700 1 -- start start 2023-12-12T11:49:48.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.171+0000 7fe16b944700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe1640fcbf0 0x7fe164071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:48.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.171+0000 7fe16b944700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1640fde00 0x7fe16406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:48.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.171+0000 7fe16b944700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1641111b0 con 0x7fe1640fde00 2023-12-12T11:49:48.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.171+0000 7fe16b944700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe164111320 con 0x7fe1640fcbf0 2023-12-12T11:49:48.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.172+0000 7fe168edf700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1640fde00 0x7fe16406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:48.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.172+0000 7fe168edf700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1640fde00 0x7fe16406ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54946/0 (socket says 172.21.15.63:54946) 2023-12-12T11:49:48.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.172+0000 7fe168edf700 1 -- 172.21.15.63:0/2668975084 learned_addr learned my addr 172.21.15.63:0/2668975084 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:49:48.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.172+0000 7fe1696e0700 1 --2- 172.21.15.63:0/2668975084 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe1640fcbf0 0x7fe164071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:48.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.172+0000 7fe168edf700 1 -- 172.21.15.63:0/2668975084 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe1640fcbf0 msgr2=0x7fe164071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:48.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.172+0000 7fe168edf700 1 --2- 172.21.15.63:0/2668975084 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe1640fcbf0 0x7fe164071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:48.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.172+0000 7fe168edf700 1 -- 172.21.15.63:0/2668975084 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe160005040 con 0x7fe1640fde00 2023-12-12T11:49:48.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.172+0000 7fe168edf700 1 --2- 172.21.15.63:0/2668975084 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1640fde00 0x7fe16406ff90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe15400eb40 tx=0x7fe15400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:48.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.173+0000 7fe159ffb700 1 -- 172.21.15.63:0/2668975084 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe154007cc0 con 0x7fe1640fde00 2023-12-12T11:49:48.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.173+0000 7fe159ffb700 1 -- 172.21.15.63:0/2668975084 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe15400f040 con 0x7fe1640fde00 2023-12-12T11:49:48.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.173+0000 7fe159ffb700 1 -- 172.21.15.63:0/2668975084 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe15400c990 con 0x7fe1640fde00 2023-12-12T11:49:48.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.173+0000 7fe16b944700 1 -- 172.21.15.63:0/2668975084 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe164070590 con 0x7fe1640fde00 2023-12-12T11:49:48.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.173+0000 7fe16b944700 1 -- 172.21.15.63:0/2668975084 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe164070ad0 con 0x7fe1640fde00 2023-12-12T11:49:48.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.174+0000 7fe16b944700 1 -- 172.21.15.63:0/2668975084 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe16404bb80 con 0x7fe1640fde00 2023-12-12T11:49:48.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.175+0000 7fe159ffb700 1 -- 172.21.15.63:0/2668975084 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fe15400cc00 con 0x7fe1640fde00 2023-12-12T11:49:48.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.176+0000 7fe159ffb700 1 --2- 172.21.15.63:0/2668975084 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fe150068f70 0x7fe15006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:48.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.176+0000 7fe159ffb700 1 -- 172.21.15.63:0/2668975084 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe154086a80 con 0x7fe1640fde00 2023-12-12T11:49:48.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.176+0000 7fe1696e0700 1 --2- 172.21.15.63:0/2668975084 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fe150068f70 0x7fe15006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:48.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.177+0000 7fe1696e0700 1 --2- 172.21.15.63:0/2668975084 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fe150068f70 0x7fe15006b420 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe1600136a0 tx=0x7fe160009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:48.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.180+0000 7fe159ffb700 1 -- 172.21.15.63:0/2668975084 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe15404da00 con 0x7fe1640fde00 2023-12-12T11:49:48.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:47 smithi093 ceph-mon[115914]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:49:48.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:47 smithi063 ceph-mon[107117]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:49:48.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.564+0000 7fe16b944700 1 -- 172.21.15.63:0/2668975084 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe164070cf0 con 0x7fe1640fde00 2023-12-12T11:49:48.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.565+0000 7fe159ffb700 1 -- 172.21.15.63:0/2668975084 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7fe154056920 con 0x7fe1640fde00 2023-12-12T11:49:48.567 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:49:48.567 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-12T11:49:48.567 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 2 2023-12-12T11:49:48.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:49:48.567 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-12T11:49:48.567 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 2 2023-12-12T11:49:48.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:49:48.567 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-12T11:49:48.567 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 6 2023-12-12T11:49:48.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:49:48.568 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-12T11:49:48.568 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 4 2023-12-12T11:49:48.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:49:48.568 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-12T11:49:48.568 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 14 2023-12-12T11:49:48.568 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-12T11:49:48.568 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:49:48.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.567+0000 7fe16b944700 1 -- 172.21.15.63:0/2668975084 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fe150068f70 msgr2=0x7fe15006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:48.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.567+0000 7fe16b944700 1 --2- 172.21.15.63:0/2668975084 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fe150068f70 0x7fe15006b420 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe1600136a0 tx=0x7fe160009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:48.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.567+0000 7fe16b944700 1 -- 172.21.15.63:0/2668975084 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1640fde00 msgr2=0x7fe16406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:48.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.567+0000 7fe16b944700 1 --2- 172.21.15.63:0/2668975084 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1640fde00 0x7fe16406ff90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe15400eb40 tx=0x7fe15400b040 comp rx=0 tx=0).stop 2023-12-12T11:49:48.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.567+0000 7fe16b944700 1 -- 172.21.15.63:0/2668975084 shutdown_connections 2023-12-12T11:49:48.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.567+0000 7fe16b944700 1 --2- 172.21.15.63:0/2668975084 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe1640fcbf0 0x7fe164071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:48.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.567+0000 7fe16b944700 1 --2- 172.21.15.63:0/2668975084 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fe150068f70 0x7fe15006b420 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:48.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.567+0000 7fe16b944700 1 --2- 172.21.15.63:0/2668975084 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1640fde00 0x7fe16406ff90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:48.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.567+0000 7fe16b944700 1 -- 172.21.15.63:0/2668975084 >> 172.21.15.63:0/2668975084 conn(0x7fe1640f82d0 msgr2=0x7fe164101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:48.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.567+0000 7fe16b944700 1 -- 172.21.15.63:0/2668975084 shutdown_connections 2023-12-12T11:49:48.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.567+0000 7fe16b944700 1 -- 172.21.15.63:0/2668975084 wait complete. 2023-12-12T11:49:48.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.744+0000 7fc291b02700 1 -- 172.21.15.63:0/67431792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc28c0fde00 msgr2=0x7fc28c0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:48.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.744+0000 7fc291b02700 1 --2- 172.21.15.63:0/67431792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc28c0fde00 0x7fc28c0fe250 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc280004940 tx=0x7fc280009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:48.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.744+0000 7fc291b02700 1 -- 172.21.15.63:0/67431792 shutdown_connections 2023-12-12T11:49:48.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.744+0000 7fc291b02700 1 --2- 172.21.15.63:0/67431792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc28c0fde00 0x7fc28c0fe250 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:48.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.744+0000 7fc291b02700 1 --2- 172.21.15.63:0/67431792 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc28c0fcbf0 0x7fc28c0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:48.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.744+0000 7fc291b02700 1 -- 172.21.15.63:0/67431792 >> 172.21.15.63:0/67431792 conn(0x7fc28c0f82d0 msgr2=0x7fc28c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:48.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.744+0000 7fc291b02700 1 -- 172.21.15.63:0/67431792 shutdown_connections 2023-12-12T11:49:48.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.744+0000 7fc291b02700 1 -- 172.21.15.63:0/67431792 wait complete. 2023-12-12T11:49:48.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.745+0000 7fc291b02700 1 Processor -- start 2023-12-12T11:49:48.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.745+0000 7fc291b02700 1 -- start start 2023-12-12T11:49:48.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.746+0000 7fc291b02700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc28c0fcbf0 0x7fc28c071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:48.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.746+0000 7fc291b02700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc28c0fde00 0x7fc28c06ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:48.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.746+0000 7fc291b02700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c070590 con 0x7fc28c0fcbf0 2023-12-12T11:49:48.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.746+0000 7fc291b02700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c070700 con 0x7fc28c0fde00 2023-12-12T11:49:48.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.746+0000 7fc28b7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc28c0fcbf0 0x7fc28c071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:48.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.746+0000 7fc28b7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc28c0fcbf0 0x7fc28c071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54978/0 (socket says 172.21.15.63:54978) 2023-12-12T11:49:48.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.746+0000 7fc28b7fe700 1 -- 172.21.15.63:0/878616779 learned_addr learned my addr 172.21.15.63:0/878616779 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:49:48.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.746+0000 7fc28affd700 1 --2- 172.21.15.63:0/878616779 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc28c0fde00 0x7fc28c06ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:48.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.747+0000 7fc28b7fe700 1 -- 172.21.15.63:0/878616779 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc28c0fde00 msgr2=0x7fc28c06ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:48.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.747+0000 7fc28b7fe700 1 --2- 172.21.15.63:0/878616779 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc28c0fde00 0x7fc28c06ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:48.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.747+0000 7fc28b7fe700 1 -- 172.21.15.63:0/878616779 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc280005040 con 0x7fc28c0fcbf0 2023-12-12T11:49:48.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.747+0000 7fc28affd700 1 --2- 172.21.15.63:0/878616779 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc28c0fde00 0x7fc28c06ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T11:49:48.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.747+0000 7fc28b7fe700 1 --2- 172.21.15.63:0/878616779 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc28c0fcbf0 0x7fc28c071b10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc27c002a80 tx=0x7fc27c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:48.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.747+0000 7fc273fff700 1 -- 172.21.15.63:0/878616779 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc27c007cc0 con 0x7fc28c0fcbf0 2023-12-12T11:49:48.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.747+0000 7fc273fff700 1 -- 172.21.15.63:0/878616779 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc27c00f040 con 0x7fc28c0fcbf0 2023-12-12T11:49:48.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.747+0000 7fc291b02700 1 -- 172.21.15.63:0/878616779 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc28c0709e0 con 0x7fc28c0fcbf0 2023-12-12T11:49:48.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.747+0000 7fc273fff700 1 -- 172.21.15.63:0/878616779 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc27c0095d0 con 0x7fc28c0fcbf0 2023-12-12T11:49:48.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.748+0000 7fc291b02700 1 -- 172.21.15.63:0/878616779 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc28c115520 con 0x7fc28c0fcbf0 2023-12-12T11:49:48.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.749+0000 7fc291b02700 1 -- 172.21.15.63:0/878616779 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc28c04bb80 con 0x7fc28c0fcbf0 2023-12-12T11:49:48.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.751+0000 7fc273fff700 1 -- 172.21.15.63:0/878616779 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fc27c009730 con 0x7fc28c0fcbf0 2023-12-12T11:49:48.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.752+0000 7fc273fff700 1 --2- 172.21.15.63:0/878616779 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fc274068f70 0x7fc27406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:48.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.752+0000 7fc273fff700 1 -- 172.21.15.63:0/878616779 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc27c086700 con 0x7fc28c0fcbf0 2023-12-12T11:49:48.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.753+0000 7fc28affd700 1 --2- 172.21.15.63:0/878616779 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fc274068f70 0x7fc27406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:48.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.753+0000 7fc28affd700 1 --2- 172.21.15.63:0/878616779 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fc274068f70 0x7fc27406b420 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc280004f90 tx=0x7fc280009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:48.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:48.757+0000 7fc273fff700 1 -- 172.21.15.63:0/878616779 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc27c04ca00 con 0x7fc28c0fcbf0 2023-12-12T11:49:49.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.086+0000 7fc291b02700 1 -- 172.21.15.63:0/878616779 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc28c115710 con 0x7fc28c0fcbf0 2023-12-12T11:49:49.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.086+0000 7fc273fff700 1 -- 172.21.15.63:0/878616779 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1807 (secure 0 0 0) 0x7fc28c115710 con 0x7fc28c0fcbf0 2023-12-12T11:49:49.089 INFO:teuthology.orchestra.run.smithi063.stdout:e13 2023-12-12T11:49:49.090 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-12T11:49:49.090 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:49:49.090 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-12T11:49:49.090 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:49:49.090 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-12T11:49:49.090 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-12T11:49:49.090 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 13 2023-12-12T11:49:49.090 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-12T11:49:49.091 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-12T11:48:58.523481+0000 2023-12-12T11:49:49.091 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-12T11:49:14.113993+0000 2023-12-12T11:49:49.091 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-12T11:49:49.091 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-12T11:49:49.091 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-12T11:49:49.091 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-12T11:49:49.091 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-12T11:49:49.091 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-12T11:49:49.092 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-12T11:49:49.092 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 46 2023-12-12T11:49:49.092 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:49:49.092 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 1 2023-12-12T11:49:49.092 INFO:teuthology.orchestra.run.smithi063.stdout:in 0 2023-12-12T11:49:49.092 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=14492} 2023-12-12T11:49:49.093 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-12T11:49:49.093 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-12T11:49:49.093 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-12T11:49:49.093 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-12T11:49:49.093 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-12T11:49:49.093 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data enabled 2023-12-12T11:49:49.093 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-12T11:49:49.093 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 1 2023-12-12T11:49:49.094 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.aevpzg{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.63:6828/3709000039,v1:172.21.15.63:6829/3709000039] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:49:49.094 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:49:49.094 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:49:49.094 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2023-12-12T11:49:49.094 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:49:49.094 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.swdqms{-1:14500} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.93:6826/3307558569,v1:172.21.15.93:6827/3307558569] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:49:49.095 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.bdqbnp{-1:14508} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/2191270944,v1:172.21.15.63:6827/2191270944] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:49:49.095 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.rhaqsh{-1:24317} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.93:6824/3161864019,v1:172.21.15.93:6825/3161864019] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:49:49.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.089+0000 7fc291b02700 1 -- 172.21.15.63:0/878616779 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fc274068f70 msgr2=0x7fc27406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:49.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.089+0000 7fc291b02700 1 --2- 172.21.15.63:0/878616779 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fc274068f70 0x7fc27406b420 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc280004f90 tx=0x7fc280009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:49.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.089+0000 7fc291b02700 1 -- 172.21.15.63:0/878616779 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc28c0fcbf0 msgr2=0x7fc28c071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:49.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.089+0000 7fc291b02700 1 --2- 172.21.15.63:0/878616779 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc28c0fcbf0 0x7fc28c071b10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc27c002a80 tx=0x7fc27c0046b0 comp rx=0 tx=0).stop 2023-12-12T11:49:49.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.089+0000 7fc291b02700 1 -- 172.21.15.63:0/878616779 shutdown_connections 2023-12-12T11:49:49.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.089+0000 7fc291b02700 1 --2- 172.21.15.63:0/878616779 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fc274068f70 0x7fc27406b420 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:49.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.089+0000 7fc291b02700 1 --2- 172.21.15.63:0/878616779 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc28c0fcbf0 0x7fc28c071b10 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:49.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.089+0000 7fc291b02700 1 --2- 172.21.15.63:0/878616779 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc28c0fde00 0x7fc28c06ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:49.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.089+0000 7fc291b02700 1 -- 172.21.15.63:0/878616779 >> 172.21.15.63:0/878616779 conn(0x7fc28c0f82d0 msgr2=0x7fc28c101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:49.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.089+0000 7fc291b02700 1 -- 172.21.15.63:0/878616779 shutdown_connections 2023-12-12T11:49:49.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.089+0000 7fc291b02700 1 -- 172.21.15.63:0/878616779 wait complete. 2023-12-12T11:49:49.096 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 13 2023-12-12T11:49:49.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:48 smithi093 ceph-mon[115914]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:49:49.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:48 smithi093 ceph-mon[115914]: pgmap v175: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-12T11:49:49.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:48 smithi093 ceph-mon[115914]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:49:49.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:48 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/2668975084' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:49:49.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.284+0000 7fb1bd748700 1 -- 172.21.15.63:0/2020731455 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1b8071b60 msgr2=0x7fb1b806ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:49.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.284+0000 7fb1bd748700 1 --2- 172.21.15.63:0/2020731455 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1b8071b60 0x7fb1b806ffd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8004940 tx=0x7fb1a8009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:49.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.284+0000 7fb1bd748700 1 -- 172.21.15.63:0/2020731455 shutdown_connections 2023-12-12T11:49:49.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.284+0000 7fb1bd748700 1 --2- 172.21.15.63:0/2020731455 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1b8070510 0x7fb1b8070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:49.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.284+0000 7fb1bd748700 1 --2- 172.21.15.63:0/2020731455 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1b8071b60 0x7fb1b806ffd0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:49.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.285+0000 7fb1bd748700 1 -- 172.21.15.63:0/2020731455 >> 172.21.15.63:0/2020731455 conn(0x7fb1b80f82d0 msgr2=0x7fb1b80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:49.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.285+0000 7fb1bd748700 1 -- 172.21.15.63:0/2020731455 shutdown_connections 2023-12-12T11:49:49.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.285+0000 7fb1bd748700 1 -- 172.21.15.63:0/2020731455 wait complete. 2023-12-12T11:49:49.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.286+0000 7fb1bd748700 1 Processor -- start 2023-12-12T11:49:49.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.286+0000 7fb1bd748700 1 -- start start 2023-12-12T11:49:49.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.286+0000 7fb1bd748700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1b8070510 0x7fb1b810f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:49.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.286+0000 7fb1bd748700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1b8071b60 0x7fb1b810fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:49.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.286+0000 7fb1bd748700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b8110370 con 0x7fb1b8070510 2023-12-12T11:49:49.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.286+0000 7fb1bd748700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b8110c10 con 0x7fb1b8071b60 2023-12-12T11:49:49.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.287+0000 7fb1b6ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1b8070510 0x7fb1b810f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:49.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.287+0000 7fb1b6ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1b8070510 0x7fb1b810f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55010/0 (socket says 172.21.15.63:55010) 2023-12-12T11:49:49.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.287+0000 7fb1b6ffd700 1 -- 172.21.15.63:0/3465400047 learned_addr learned my addr 172.21.15.63:0/3465400047 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:49:49.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.287+0000 7fb1b67fc700 1 --2- 172.21.15.63:0/3465400047 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1b8071b60 0x7fb1b810fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:49.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.287+0000 7fb1b6ffd700 1 -- 172.21.15.63:0/3465400047 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1b8071b60 msgr2=0x7fb1b810fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:49.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.287+0000 7fb1b6ffd700 1 --2- 172.21.15.63:0/3465400047 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1b8071b60 0x7fb1b810fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:49.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.287+0000 7fb1b6ffd700 1 -- 172.21.15.63:0/3465400047 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a8005040 con 0x7fb1b8070510 2023-12-12T11:49:49.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.287+0000 7fb1b6ffd700 1 --2- 172.21.15.63:0/3465400047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1b8070510 0x7fb1b810f830 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8008f90 tx=0x7fb1a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:49.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.288+0000 7fb19f7fe700 1 -- 172.21.15.63:0/3465400047 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1a8021070 con 0x7fb1b8070510 2023-12-12T11:49:49.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.288+0000 7fb19f7fe700 1 -- 172.21.15.63:0/3465400047 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb1a801c400 con 0x7fb1b8070510 2023-12-12T11:49:49.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.288+0000 7fb19f7fe700 1 -- 172.21.15.63:0/3465400047 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1a800e030 con 0x7fb1b8070510 2023-12-12T11:49:49.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.288+0000 7fb1bd748700 1 -- 172.21.15.63:0/3465400047 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b8110e90 con 0x7fb1b8070510 2023-12-12T11:49:49.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.288+0000 7fb1bd748700 1 -- 172.21.15.63:0/3465400047 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b81113d0 con 0x7fb1b8070510 2023-12-12T11:49:49.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.289+0000 7fb1bd748700 1 -- 172.21.15.63:0/3465400047 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b8109700 con 0x7fb1b8070510 2023-12-12T11:49:49.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.290+0000 7fb19f7fe700 1 -- 172.21.15.63:0/3465400047 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fb1a801ca00 con 0x7fb1b8070510 2023-12-12T11:49:49.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.291+0000 7fb19f7fe700 1 --2- 172.21.15.63:0/3465400047 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb1a0068f70 0x7fb1a006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:49.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.291+0000 7fb19f7fe700 1 -- 172.21.15.63:0/3465400047 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb1a8088090 con 0x7fb1b8070510 2023-12-12T11:49:49.294 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.291+0000 7fb1b67fc700 1 --2- 172.21.15.63:0/3465400047 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb1a0068f70 0x7fb1a006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:49.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:48 smithi063 ceph-mon[107117]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:49:49.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:48 smithi063 ceph-mon[107117]: pgmap v175: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-12T11:49:49.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:48 smithi063 ceph-mon[107117]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:49:49.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:48 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/2668975084' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:49:49.294 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.292+0000 7fb1b67fc700 1 --2- 172.21.15.63:0/3465400047 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb1a0068f70 0x7fb1a006b420 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac009b80 tx=0x7fb1ac00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:49.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.298+0000 7fb19f7fe700 1 -- 172.21.15.63:0/3465400047 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb1a8057f80 con 0x7fb1b8070510 2023-12-12T11:49:49.646 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.644+0000 7fb1bd748700 1 -- 172.21.15.63:0/3465400047 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1b8111640 con 0x7fb1a0068f70 2023-12-12T11:49:49.647 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.645+0000 7fb19f7fe700 1 -- 172.21.15.63:0/3465400047 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fb1b8111640 con 0x7fb1a0068f70 2023-12-12T11:49:49.648 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:49:49.648 INFO:teuthology.orchestra.run.smithi063.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:f1fbf3c583d03e19f5e58eb618e78d8e10d075f9", 2023-12-12T11:49:49.648 INFO:teuthology.orchestra.run.smithi063.stdout: "in_progress": true, 2023-12-12T11:49:49.648 INFO:teuthology.orchestra.run.smithi063.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-12T11:49:49.648 INFO:teuthology.orchestra.run.smithi063.stdout: "services_complete": [], 2023-12-12T11:49:49.648 INFO:teuthology.orchestra.run.smithi063.stdout: "progress": "", 2023-12-12T11:49:49.648 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 image", 2023-12-12T11:49:49.649 INFO:teuthology.orchestra.run.smithi063.stdout: "is_paused": false 2023-12-12T11:49:49.649 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:49:49.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.648+0000 7fb1bd748700 1 -- 172.21.15.63:0/3465400047 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb1a0068f70 msgr2=0x7fb1a006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:49.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.648+0000 7fb1bd748700 1 --2- 172.21.15.63:0/3465400047 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb1a0068f70 0x7fb1a006b420 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac009b80 tx=0x7fb1ac00b040 comp rx=0 tx=0).stop 2023-12-12T11:49:49.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.648+0000 7fb1bd748700 1 -- 172.21.15.63:0/3465400047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1b8070510 msgr2=0x7fb1b810f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:49.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.648+0000 7fb1bd748700 1 --2- 172.21.15.63:0/3465400047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1b8070510 0x7fb1b810f830 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8008f90 tx=0x7fb1a8009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:49.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.648+0000 7fb1bd748700 1 -- 172.21.15.63:0/3465400047 shutdown_connections 2023-12-12T11:49:49.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.648+0000 7fb1bd748700 1 --2- 172.21.15.63:0/3465400047 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb1a0068f70 0x7fb1a006b420 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:49.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.648+0000 7fb1bd748700 1 --2- 172.21.15.63:0/3465400047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1b8070510 0x7fb1b810f830 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:49.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.648+0000 7fb1bd748700 1 --2- 172.21.15.63:0/3465400047 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1b8071b60 0x7fb1b810fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:49.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.648+0000 7fb1bd748700 1 -- 172.21.15.63:0/3465400047 >> 172.21.15.63:0/3465400047 conn(0x7fb1b80f82d0 msgr2=0x7fb1b8103370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:49.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.648+0000 7fb1bd748700 1 -- 172.21.15.63:0/3465400047 shutdown_connections 2023-12-12T11:49:49.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.648+0000 7fb1bd748700 1 -- 172.21.15.63:0/3465400047 wait complete. 2023-12-12T11:49:49.825 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.822+0000 7fe141218700 1 -- 172.21.15.63:0/745044187 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe13c0ffe50 msgr2=0x7fe13c102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:49.825 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.822+0000 7fe141218700 1 --2- 172.21.15.63:0/745044187 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe13c0ffe50 0x7fe13c102230 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe124004940 tx=0x7fe124009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:49.825 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.822+0000 7fe141218700 1 -- 172.21.15.63:0/745044187 shutdown_connections 2023-12-12T11:49:49.825 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.822+0000 7fe141218700 1 --2- 172.21.15.63:0/745044187 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe13c0ffe50 0x7fe13c102230 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:49.825 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.822+0000 7fe141218700 1 --2- 172.21.15.63:0/745044187 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe13c0fd530 0x7fe13c0ff910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:49.825 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.822+0000 7fe141218700 1 -- 172.21.15.63:0/745044187 >> 172.21.15.63:0/745044187 conn(0x7fe13c0f6f70 msgr2=0x7fe13c0f93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:49.825 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.822+0000 7fe141218700 1 -- 172.21.15.63:0/745044187 shutdown_connections 2023-12-12T11:49:49.825 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.823+0000 7fe141218700 1 -- 172.21.15.63:0/745044187 wait complete. 2023-12-12T11:49:49.826 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.824+0000 7fe141218700 1 Processor -- start 2023-12-12T11:49:49.826 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.824+0000 7fe141218700 1 -- start start 2023-12-12T11:49:49.827 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.824+0000 7fe141218700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe13c0fd530 0x7fe13c0fcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:49.827 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.824+0000 7fe141218700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe13c0ffe50 0x7fe13c0fb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:49.827 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.824+0000 7fe141218700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13c0fba40 con 0x7fe13c0ffe50 2023-12-12T11:49:49.827 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.824+0000 7fe141218700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13c0fbbb0 con 0x7fe13c0fd530 2023-12-12T11:49:49.827 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.825+0000 7fe13bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe13c0ffe50 0x7fe13c0fb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:49.827 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.825+0000 7fe133fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe13c0fd530 0x7fe13c0fcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:49.827 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.825+0000 7fe13bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe13c0ffe50 0x7fe13c0fb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55034/0 (socket says 172.21.15.63:55034) 2023-12-12T11:49:49.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.825+0000 7fe13bfff700 1 -- 172.21.15.63:0/310960786 learned_addr learned my addr 172.21.15.63:0/310960786 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:49:49.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.825+0000 7fe13bfff700 1 -- 172.21.15.63:0/310960786 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe13c0fd530 msgr2=0x7fe13c0fcfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:49.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.825+0000 7fe13bfff700 1 --2- 172.21.15.63:0/310960786 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe13c0fd530 0x7fe13c0fcfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:49.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.825+0000 7fe13bfff700 1 -- 172.21.15.63:0/310960786 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe124005040 con 0x7fe13c0ffe50 2023-12-12T11:49:49.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.825+0000 7fe133fff700 1 --2- 172.21.15.63:0/310960786 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe13c0fd530 0x7fe13c0fcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T11:49:49.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.826+0000 7fe13bfff700 1 --2- 172.21.15.63:0/310960786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe13c0ffe50 0x7fe13c0fb440 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe124009fd0 tx=0x7fe124009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:49.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.826+0000 7fe1397fa700 1 -- 172.21.15.63:0/310960786 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe124021070 con 0x7fe13c0ffe50 2023-12-12T11:49:49.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.826+0000 7fe1397fa700 1 -- 172.21.15.63:0/310960786 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe12401c400 con 0x7fe13c0ffe50 2023-12-12T11:49:49.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.826+0000 7fe141218700 1 -- 172.21.15.63:0/310960786 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe13c0fbe30 con 0x7fe13c0ffe50 2023-12-12T11:49:49.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.826+0000 7fe1397fa700 1 -- 172.21.15.63:0/310960786 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe12400e070 con 0x7fe13c0ffe50 2023-12-12T11:49:49.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.826+0000 7fe141218700 1 -- 172.21.15.63:0/310960786 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe13c115280 con 0x7fe13c0ffe50 2023-12-12T11:49:49.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.828+0000 7fe141218700 1 -- 172.21.15.63:0/310960786 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe13c1073c0 con 0x7fe13c0ffe50 2023-12-12T11:49:49.831 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.829+0000 7fe1397fa700 1 -- 172.21.15.63:0/310960786 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fe12401c570 con 0x7fe13c0ffe50 2023-12-12T11:49:49.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.829+0000 7fe1397fa700 1 --2- 172.21.15.63:0/310960786 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fe128068f70 0x7fe12806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:49:49.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.830+0000 7fe1397fa700 1 -- 172.21.15.63:0/310960786 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe124087fe0 con 0x7fe13c0ffe50 2023-12-12T11:49:49.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.830+0000 7fe133fff700 1 --2- 172.21.15.63:0/310960786 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fe128068f70 0x7fe12806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:49:49.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.830+0000 7fe133fff700 1 --2- 172.21.15.63:0/310960786 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fe128068f70 0x7fe12806b420 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0fcd50 tx=0x7fe12c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:49:49.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:49.835+0000 7fe1397fa700 1 -- 172.21.15.63:0/310960786 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe124057f10 con 0x7fe13c0ffe50 2023-12-12T11:49:50.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:50.150+0000 7fe141218700 1 -- 172.21.15.63:0/310960786 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe13c04bb80 con 0x7fe13c0ffe50 2023-12-12T11:49:50.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:50.151+0000 7fe1397fa700 1 -- 172.21.15.63:0/310960786 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fe124057aa0 con 0x7fe13c0ffe50 2023-12-12T11:49:50.153 INFO:teuthology.orchestra.run.smithi063.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-12T11:49:50.153 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-12T11:49:50.154 INFO:teuthology.orchestra.run.smithi063.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-12T11:49:50.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:50.153+0000 7fe141218700 1 -- 172.21.15.63:0/310960786 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fe128068f70 msgr2=0x7fe12806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:50.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:50.153+0000 7fe141218700 1 --2- 172.21.15.63:0/310960786 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fe128068f70 0x7fe12806b420 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0fcd50 tx=0x7fe12c00b040 comp rx=0 tx=0).stop 2023-12-12T11:49:50.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:50.153+0000 7fe141218700 1 -- 172.21.15.63:0/310960786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe13c0ffe50 msgr2=0x7fe13c0fb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:49:50.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:50.153+0000 7fe141218700 1 --2- 172.21.15.63:0/310960786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe13c0ffe50 0x7fe13c0fb440 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe124009fd0 tx=0x7fe124009e30 comp rx=0 tx=0).stop 2023-12-12T11:49:50.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:50.154+0000 7fe141218700 1 -- 172.21.15.63:0/310960786 shutdown_connections 2023-12-12T11:49:50.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:50.154+0000 7fe141218700 1 --2- 172.21.15.63:0/310960786 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe13c0fd530 0x7fe13c0fcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:50.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:50.154+0000 7fe141218700 1 --2- 172.21.15.63:0/310960786 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fe128068f70 0x7fe12806b420 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:50.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:50.154+0000 7fe141218700 1 --2- 172.21.15.63:0/310960786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe13c0ffe50 0x7fe13c0fb440 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:49:50.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:50.154+0000 7fe141218700 1 -- 172.21.15.63:0/310960786 >> 172.21.15.63:0/310960786 conn(0x7fe13c0f6f70 msgr2=0x7fe13c0f93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:49:50.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:50.154+0000 7fe141218700 1 -- 172.21.15.63:0/310960786 shutdown_connections 2023-12-12T11:49:50.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:49:50.154+0000 7fe141218700 1 -- 172.21.15.63:0/310960786 wait complete. 2023-12-12T11:49:50.214 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:49 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/878616779' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:49:50.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:49 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/878616779' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:49:51.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:50 smithi093 ceph-mon[115914]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:49:51.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:50 smithi093 ceph-mon[115914]: pgmap v176: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-12T11:49:51.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:50 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/310960786' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:49:51.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:50 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:49:51.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:50 smithi063 ceph-mon[107117]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:49:51.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:50 smithi063 ceph-mon[107117]: pgmap v176: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-12T11:49:51.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:50 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/310960786' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:49:51.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:50 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:49:52.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:52 smithi063 ceph-mon[107117]: pgmap v177: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:49:52.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:52 smithi093 ceph-mon[115914]: pgmap v177: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:49:55.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:54 smithi093 ceph-mon[115914]: pgmap v178: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:49:55.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:54 smithi063 ceph-mon[107117]: pgmap v178: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:49:57.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:56 smithi093 ceph-mon[115914]: pgmap v179: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:49:57.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:56 smithi063 ceph-mon[107117]: pgmap v179: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:49:59.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:49:58 smithi093 ceph-mon[115914]: pgmap v180: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:49:59.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:49:58 smithi063 ceph-mon[107117]: pgmap v180: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:50:01.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:00 smithi093 ceph-mon[115914]: pgmap v181: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:50:01.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:00 smithi093 ceph-mon[115914]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-12T11:50:01.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:00 smithi093 ceph-mon[115914]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-12T11:50:01.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:00 smithi093 ceph-mon[115914]: fs cephfs has deprecated feature inline_data enabled. 2023-12-12T11:50:01.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:00 smithi063 ceph-mon[107117]: pgmap v181: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:50:01.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:00 smithi063 ceph-mon[107117]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-12T11:50:01.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:00 smithi063 ceph-mon[107117]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-12T11:50:01.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:00 smithi063 ceph-mon[107117]: fs cephfs has deprecated feature inline_data enabled. 2023-12-12T11:50:02.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:02 smithi063 ceph-mon[107117]: pgmap v182: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:50:02.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:02 smithi093 ceph-mon[115914]: pgmap v182: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:50:05.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:04 smithi093 ceph-mon[115914]: pgmap v183: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:50:05.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:04 smithi063 ceph-mon[107117]: pgmap v183: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:50:06.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:05 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:50:06.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:05 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:50:07.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:06 smithi093 ceph-mon[115914]: pgmap v184: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:50:07.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:06 smithi063 ceph-mon[107117]: pgmap v184: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:50:09.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:08 smithi093 ceph-mon[115914]: pgmap v185: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:50:09.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:08 smithi063 ceph-mon[107117]: pgmap v185: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:50:11.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:10 smithi093 ceph-mon[115914]: pgmap v186: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-12T11:50:11.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:10 smithi063 ceph-mon[107117]: pgmap v186: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-12T11:50:12.783 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:12 smithi093 ceph-mon[115914]: pgmap v187: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-12T11:50:12.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:12 smithi063 ceph-mon[107117]: pgmap v187: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-12T11:50:15.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:14 smithi093 ceph-mon[115914]: pgmap v188: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-12T11:50:15.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:14 smithi063 ceph-mon[107117]: pgmap v188: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-12T11:50:17.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:16 smithi093 ceph-mon[115914]: pgmap v189: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-12T11:50:17.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:16 smithi063 ceph-mon[107117]: pgmap v189: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-12T11:50:19.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:18 smithi093 ceph-mon[115914]: pgmap v190: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-12T11:50:19.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:18 smithi063 ceph-mon[107117]: pgmap v190: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-12T11:50:20.363 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.361+0000 7fb949ac0700 1 -- 172.21.15.63:0/2273170218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb944071b60 msgr2=0x7fb94406ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:20.363 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.361+0000 7fb949ac0700 1 --2- 172.21.15.63:0/2273170218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb944071b60 0x7fb94406ffd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb938004940 tx=0x7fb938009e30 comp rx=0 tx=0).stop 2023-12-12T11:50:20.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.361+0000 7fb949ac0700 1 -- 172.21.15.63:0/2273170218 shutdown_connections 2023-12-12T11:50:20.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.361+0000 7fb949ac0700 1 --2- 172.21.15.63:0/2273170218 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb944070510 0x7fb944070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:20.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.361+0000 7fb949ac0700 1 --2- 172.21.15.63:0/2273170218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb944071b60 0x7fb94406ffd0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:20.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.361+0000 7fb949ac0700 1 -- 172.21.15.63:0/2273170218 >> 172.21.15.63:0/2273170218 conn(0x7fb9440f80f0 msgr2=0x7fb9440fa540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:50:20.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.361+0000 7fb949ac0700 1 -- 172.21.15.63:0/2273170218 shutdown_connections 2023-12-12T11:50:20.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.361+0000 7fb949ac0700 1 -- 172.21.15.63:0/2273170218 wait complete. 2023-12-12T11:50:20.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.362+0000 7fb949ac0700 1 Processor -- start 2023-12-12T11:50:20.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.363+0000 7fb949ac0700 1 -- start start 2023-12-12T11:50:20.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.363+0000 7fb949ac0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb944070510 0x7fb94410f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:20.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.363+0000 7fb949ac0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb944071b60 0x7fb94410fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:20.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.363+0000 7fb949ac0700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb944110010 con 0x7fb944071b60 2023-12-12T11:50:20.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.363+0000 7fb949ac0700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9441108b0 con 0x7fb944070510 2023-12-12T11:50:20.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.363+0000 7fb948abe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb944070510 0x7fb94410f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:20.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.363+0000 7fb948abe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb944070510 0x7fb94410f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:47434/0 (socket says 172.21.15.63:47434) 2023-12-12T11:50:20.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.363+0000 7fb948abe700 1 -- 172.21.15.63:0/998221859 learned_addr learned my addr 172.21.15.63:0/998221859 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:50:20.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.364+0000 7fb943fff700 1 --2- 172.21.15.63:0/998221859 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb944071b60 0x7fb94410fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:20.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.364+0000 7fb948abe700 1 -- 172.21.15.63:0/998221859 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb944071b60 msgr2=0x7fb94410fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:20.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.364+0000 7fb948abe700 1 --2- 172.21.15.63:0/998221859 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb944071b60 0x7fb94410fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:20.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.364+0000 7fb948abe700 1 -- 172.21.15.63:0/998221859 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb938005040 con 0x7fb944070510 2023-12-12T11:50:20.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.364+0000 7fb948abe700 1 --2- 172.21.15.63:0/998221859 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb944070510 0x7fb94410f4d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb938009fd0 tx=0x7fb938009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:50:20.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.365+0000 7fb9417fa700 1 -- 172.21.15.63:0/998221859 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb938021070 con 0x7fb944070510 2023-12-12T11:50:20.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.365+0000 7fb9417fa700 1 -- 172.21.15.63:0/998221859 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb938013c60 con 0x7fb944070510 2023-12-12T11:50:20.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.365+0000 7fb9417fa700 1 -- 172.21.15.63:0/998221859 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb93800e070 con 0x7fb944070510 2023-12-12T11:50:20.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.365+0000 7fb949ac0700 1 -- 172.21.15.63:0/998221859 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb944110b30 con 0x7fb944070510 2023-12-12T11:50:20.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.365+0000 7fb949ac0700 1 -- 172.21.15.63:0/998221859 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb944110fc0 con 0x7fb944070510 2023-12-12T11:50:20.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.367+0000 7fb949ac0700 1 -- 172.21.15.63:0/998221859 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94404bb80 con 0x7fb944070510 2023-12-12T11:50:20.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.368+0000 7fb9417fa700 1 -- 172.21.15.63:0/998221859 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fb93801c400 con 0x7fb944070510 2023-12-12T11:50:20.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.369+0000 7fb9417fa700 1 --2- 172.21.15.63:0/998221859 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb934068f60 0x7fb93406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:20.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.369+0000 7fb9417fa700 1 -- 172.21.15.63:0/998221859 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb9380880e0 con 0x7fb944070510 2023-12-12T11:50:20.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.370+0000 7fb943fff700 1 --2- 172.21.15.63:0/998221859 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb934068f60 0x7fb93406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:20.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.371+0000 7fb943fff700 1 --2- 172.21.15.63:0/998221859 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb934068f60 0x7fb93406b410 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb930009fd0 tx=0x7fb93000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:50:20.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.374+0000 7fb9417fa700 1 -- 172.21.15.63:0/998221859 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb938057fd0 con 0x7fb944070510 2023-12-12T11:50:20.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.744+0000 7fb949ac0700 1 -- 172.21.15.63:0/998221859 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb944111740 con 0x7fb934068f60 2023-12-12T11:50:20.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.746+0000 7fb9417fa700 1 -- 172.21.15.63:0/998221859 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fb930004e10 con 0x7fb934068f60 2023-12-12T11:50:20.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.749+0000 7fb949ac0700 1 -- 172.21.15.63:0/998221859 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb934068f60 msgr2=0x7fb93406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:20.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.749+0000 7fb949ac0700 1 --2- 172.21.15.63:0/998221859 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb934068f60 0x7fb93406b410 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb930009fd0 tx=0x7fb93000b040 comp rx=0 tx=0).stop 2023-12-12T11:50:20.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.749+0000 7fb949ac0700 1 -- 172.21.15.63:0/998221859 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb944070510 msgr2=0x7fb94410f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:20.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.749+0000 7fb949ac0700 1 --2- 172.21.15.63:0/998221859 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb944070510 0x7fb94410f4d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb938009fd0 tx=0x7fb938009e30 comp rx=0 tx=0).stop 2023-12-12T11:50:20.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.749+0000 7fb949ac0700 1 -- 172.21.15.63:0/998221859 shutdown_connections 2023-12-12T11:50:20.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.749+0000 7fb949ac0700 1 --2- 172.21.15.63:0/998221859 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb944070510 0x7fb94410f4d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:20.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.749+0000 7fb949ac0700 1 --2- 172.21.15.63:0/998221859 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb934068f60 0x7fb93406b410 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:20.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.749+0000 7fb949ac0700 1 --2- 172.21.15.63:0/998221859 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb944071b60 0x7fb94410fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:20.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.749+0000 7fb949ac0700 1 -- 172.21.15.63:0/998221859 >> 172.21.15.63:0/998221859 conn(0x7fb9440f80f0 msgr2=0x7fb944102940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:50:20.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.750+0000 7fb949ac0700 1 -- 172.21.15.63:0/998221859 shutdown_connections 2023-12-12T11:50:20.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.750+0000 7fb949ac0700 1 -- 172.21.15.63:0/998221859 wait complete. 2023-12-12T11:50:20.766 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-12T11:50:20.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.942+0000 7f612e130700 1 -- 172.21.15.63:0/2921306671 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61280fcbf0 msgr2=0x7f61280fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:20.945 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.942+0000 7f612e130700 1 --2- 172.21.15.63:0/2921306671 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61280fcbf0 0x7f61280fd000 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6118004940 tx=0x7f6118009e30 comp rx=0 tx=0).stop 2023-12-12T11:50:20.945 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.942+0000 7f612e130700 1 -- 172.21.15.63:0/2921306671 shutdown_connections 2023-12-12T11:50:20.945 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.942+0000 7f612e130700 1 --2- 172.21.15.63:0/2921306671 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f61280fde00 0x7f61280fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:20.945 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.942+0000 7f612e130700 1 --2- 172.21.15.63:0/2921306671 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61280fcbf0 0x7f61280fd000 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:20.945 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.942+0000 7f612e130700 1 -- 172.21.15.63:0/2921306671 >> 172.21.15.63:0/2921306671 conn(0x7f61280f82d0 msgr2=0x7f61280fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:50:20.945 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.942+0000 7f612e130700 1 -- 172.21.15.63:0/2921306671 shutdown_connections 2023-12-12T11:50:20.945 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.942+0000 7f612e130700 1 -- 172.21.15.63:0/2921306671 wait complete. 2023-12-12T11:50:20.945 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.943+0000 7f612e130700 1 Processor -- start 2023-12-12T11:50:20.946 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.944+0000 7f612e130700 1 -- start start 2023-12-12T11:50:20.946 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.944+0000 7f612e130700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61280fcbf0 0x7f612810f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:20.946 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.944+0000 7f612e130700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f61280fde00 0x7f612810fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:20.946 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.944+0000 7f612e130700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6128110200 con 0x7f61280fcbf0 2023-12-12T11:50:20.946 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.944+0000 7f612e130700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6128110aa0 con 0x7f61280fde00 2023-12-12T11:50:20.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.944+0000 7f61277fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61280fcbf0 0x7f612810f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:20.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.944+0000 7f61277fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61280fcbf0 0x7f612810f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49740/0 (socket says 172.21.15.63:49740) 2023-12-12T11:50:20.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.944+0000 7f61277fe700 1 -- 172.21.15.63:0/3898545482 learned_addr learned my addr 172.21.15.63:0/3898545482 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:50:20.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.945+0000 7f6126ffd700 1 --2- 172.21.15.63:0/3898545482 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f61280fde00 0x7f612810fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:20.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.945+0000 7f61277fe700 1 -- 172.21.15.63:0/3898545482 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f61280fde00 msgr2=0x7f612810fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:20.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.945+0000 7f61277fe700 1 --2- 172.21.15.63:0/3898545482 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f61280fde00 0x7f612810fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:20.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.945+0000 7f61277fe700 1 -- 172.21.15.63:0/3898545482 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6118005040 con 0x7f61280fcbf0 2023-12-12T11:50:20.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.945+0000 7f6126ffd700 1 --2- 172.21.15.63:0/3898545482 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f61280fde00 0x7f612810fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T11:50:20.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.945+0000 7f61277fe700 1 --2- 172.21.15.63:0/3898545482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61280fcbf0 0x7f612810f6c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6118009fd0 tx=0x7f6118009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:50:20.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.946+0000 7f610ffff700 1 -- 172.21.15.63:0/3898545482 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6118021070 con 0x7f61280fcbf0 2023-12-12T11:50:20.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.946+0000 7f610ffff700 1 -- 172.21.15.63:0/3898545482 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f611801c400 con 0x7f61280fcbf0 2023-12-12T11:50:20.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.946+0000 7f612e130700 1 -- 172.21.15.63:0/3898545482 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6128110d20 con 0x7f61280fcbf0 2023-12-12T11:50:20.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.946+0000 7f610ffff700 1 -- 172.21.15.63:0/3898545482 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f611800e070 con 0x7f61280fcbf0 2023-12-12T11:50:20.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.946+0000 7f612e130700 1 -- 172.21.15.63:0/3898545482 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6128111200 con 0x7f61280fcbf0 2023-12-12T11:50:20.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.948+0000 7f612e130700 1 -- 172.21.15.63:0/3898545482 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61140052e0 con 0x7f61280fcbf0 2023-12-12T11:50:20.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.949+0000 7f610ffff700 1 -- 172.21.15.63:0/3898545482 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f611801ca00 con 0x7f61280fcbf0 2023-12-12T11:50:20.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.951+0000 7f610ffff700 1 --2- 172.21.15.63:0/3898545482 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f6110068f60 0x7f611006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:20.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.951+0000 7f610ffff700 1 -- 172.21.15.63:0/3898545482 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f6118087ea0 con 0x7f61280fcbf0 2023-12-12T11:50:20.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.951+0000 7f6126ffd700 1 --2- 172.21.15.63:0/3898545482 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f6110068f60 0x7f611006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:20.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.952+0000 7f6126ffd700 1 --2- 172.21.15.63:0/3898545482 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f6110068f60 0x7f611006b410 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f611c009b80 tx=0x7f611c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:50:20.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:20.956+0000 7f610ffff700 1 -- 172.21.15.63:0/3898545482 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6118057e50 con 0x7f61280fcbf0 2023-12-12T11:50:21.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:20 smithi093 ceph-mon[115914]: pgmap v191: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2023-12-12T11:50:21.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:20 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:50:21.253 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.251+0000 7f612e130700 1 -- 172.21.15.63:0/3898545482 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6114000bf0 con 0x7f6110068f60 2023-12-12T11:50:21.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.252+0000 7f610ffff700 1 -- 172.21.15.63:0/3898545482 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f6114000bf0 con 0x7f6110068f60 2023-12-12T11:50:21.258 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.256+0000 7f612e130700 1 -- 172.21.15.63:0/3898545482 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f6110068f60 msgr2=0x7f611006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:21.258 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.256+0000 7f612e130700 1 --2- 172.21.15.63:0/3898545482 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f6110068f60 0x7f611006b410 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f611c009b80 tx=0x7f611c00b040 comp rx=0 tx=0).stop 2023-12-12T11:50:21.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.256+0000 7f612e130700 1 -- 172.21.15.63:0/3898545482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61280fcbf0 msgr2=0x7f612810f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:21.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.256+0000 7f612e130700 1 --2- 172.21.15.63:0/3898545482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61280fcbf0 0x7f612810f6c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6118009fd0 tx=0x7f6118009e30 comp rx=0 tx=0).stop 2023-12-12T11:50:21.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.256+0000 7f612e130700 1 -- 172.21.15.63:0/3898545482 shutdown_connections 2023-12-12T11:50:21.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.256+0000 7f612e130700 1 --2- 172.21.15.63:0/3898545482 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f6110068f60 0x7f611006b410 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:21.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.256+0000 7f612e130700 1 --2- 172.21.15.63:0/3898545482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f61280fcbf0 0x7f612810f6c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:21.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.256+0000 7f612e130700 1 --2- 172.21.15.63:0/3898545482 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f61280fde00 0x7f612810fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:21.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.256+0000 7f612e130700 1 -- 172.21.15.63:0/3898545482 >> 172.21.15.63:0/3898545482 conn(0x7f61280f82d0 msgr2=0x7f61280ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:50:21.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.257+0000 7f612e130700 1 -- 172.21.15.63:0/3898545482 shutdown_connections 2023-12-12T11:50:21.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.257+0000 7f612e130700 1 -- 172.21.15.63:0/3898545482 wait complete. 2023-12-12T11:50:21.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:20 smithi063 ceph-mon[107117]: pgmap v191: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2023-12-12T11:50:21.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:20 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:50:21.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.453+0000 7f797672a700 1 -- 172.21.15.63:0/152954888 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79700fcbf0 msgr2=0x7f79700fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:21.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.453+0000 7f797672a700 1 --2- 172.21.15.63:0/152954888 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79700fcbf0 0x7f79700fd000 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7960004940 tx=0x7f7960009e30 comp rx=0 tx=0).stop 2023-12-12T11:50:21.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.453+0000 7f797672a700 1 -- 172.21.15.63:0/152954888 shutdown_connections 2023-12-12T11:50:21.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.453+0000 7f797672a700 1 --2- 172.21.15.63:0/152954888 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79700fde00 0x7f79700fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:21.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.453+0000 7f797672a700 1 --2- 172.21.15.63:0/152954888 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79700fcbf0 0x7f79700fd000 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:21.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.453+0000 7f797672a700 1 -- 172.21.15.63:0/152954888 >> 172.21.15.63:0/152954888 conn(0x7f79700f82d0 msgr2=0x7f79700fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:50:21.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.454+0000 7f797672a700 1 -- 172.21.15.63:0/152954888 shutdown_connections 2023-12-12T11:50:21.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.454+0000 7f797672a700 1 -- 172.21.15.63:0/152954888 wait complete. 2023-12-12T11:50:21.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.455+0000 7f797672a700 1 Processor -- start 2023-12-12T11:50:21.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.455+0000 7f797672a700 1 -- start start 2023-12-12T11:50:21.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.456+0000 7f797672a700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79700fcbf0 0x7f797010f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:21.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.456+0000 7f797672a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79700fde00 0x7f797010fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:21.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.456+0000 7f797672a700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7970110330 con 0x7f79700fde00 2023-12-12T11:50:21.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.456+0000 7f797672a700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7970110bd0 con 0x7f79700fcbf0 2023-12-12T11:50:21.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.456+0000 7f796ffff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79700fcbf0 0x7f797010f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:21.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.456+0000 7f796ffff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79700fcbf0 0x7f797010f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:47470/0 (socket says 172.21.15.63:47470) 2023-12-12T11:50:21.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.456+0000 7f796ffff700 1 -- 172.21.15.63:0/1969961006 learned_addr learned my addr 172.21.15.63:0/1969961006 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:50:21.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.456+0000 7f796f7fe700 1 --2- 172.21.15.63:0/1969961006 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79700fde00 0x7f797010fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:21.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.457+0000 7f796ffff700 1 -- 172.21.15.63:0/1969961006 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79700fde00 msgr2=0x7f797010fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:21.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.457+0000 7f796ffff700 1 --2- 172.21.15.63:0/1969961006 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79700fde00 0x7f797010fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:21.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.457+0000 7f796ffff700 1 -- 172.21.15.63:0/1969961006 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7960005040 con 0x7f79700fcbf0 2023-12-12T11:50:21.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.457+0000 7f796ffff700 1 --2- 172.21.15.63:0/1969961006 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79700fcbf0 0x7f797010f7f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7960008f80 tx=0x7f7960009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:50:21.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.457+0000 7f796cff9700 1 -- 172.21.15.63:0/1969961006 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7960021070 con 0x7f79700fcbf0 2023-12-12T11:50:21.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.458+0000 7f796cff9700 1 -- 172.21.15.63:0/1969961006 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f796001c400 con 0x7f79700fcbf0 2023-12-12T11:50:21.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.458+0000 7f797672a700 1 -- 172.21.15.63:0/1969961006 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7970110e50 con 0x7f79700fcbf0 2023-12-12T11:50:21.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.458+0000 7f797672a700 1 -- 172.21.15.63:0/1969961006 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7970111330 con 0x7f79700fcbf0 2023-12-12T11:50:21.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.458+0000 7f796cff9700 1 -- 172.21.15.63:0/1969961006 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f796000e070 con 0x7f79700fcbf0 2023-12-12T11:50:21.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.459+0000 7f797672a700 1 -- 172.21.15.63:0/1969961006 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f795c0052e0 con 0x7f79700fcbf0 2023-12-12T11:50:21.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.461+0000 7f796cff9700 1 -- 172.21.15.63:0/1969961006 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f7960013a30 con 0x7f79700fcbf0 2023-12-12T11:50:21.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.464+0000 7f796cff9700 1 --2- 172.21.15.63:0/1969961006 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f7958069040 0x7f795806b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:21.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.464+0000 7f796cff9700 1 -- 172.21.15.63:0/1969961006 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f7960087f70 con 0x7f79700fcbf0 2023-12-12T11:50:21.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.464+0000 7f796f7fe700 1 --2- 172.21.15.63:0/1969961006 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f7958069040 0x7f795806b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:21.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.465+0000 7f796f7fe700 1 --2- 172.21.15.63:0/1969961006 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f7958069040 0x7f795806b4f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7964009b80 tx=0x7f796400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:50:21.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.466+0000 7f796cff9700 1 -- 172.21.15.63:0/1969961006 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7960057e60 con 0x7f79700fcbf0 2023-12-12T11:50:21.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.722+0000 7f797672a700 1 -- 172.21.15.63:0/1969961006 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f795c000bf0 con 0x7f7958069040 2023-12-12T11:50:21.737 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.734+0000 7f796cff9700 1 -- 172.21.15.63:0/1969961006 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f795c000bf0 con 0x7f7958069040 2023-12-12T11:50:21.737 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-12T11:50:21.737 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (4m) 62s ago 5m - - 0.25.0 c8568f914cd2 cd61d03c786f 2023-12-12T11:50:21.737 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (5m) 62s ago 5m - - 17.2.7-123-gbef78a51 ae6196193935 ee4415610fae 2023-12-12T11:50:21.737 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi093 smithi093 running (5m) 65s ago 5m 7810k - 17.2.7-123-gbef78a51 ae6196193935 f64e68742cfe 2023-12-12T11:50:21.737 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (4m) 62s ago 5m - - 9.4.7 954c08fa6188 2eeaef85f231 2023-12-12T11:50:21.737 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.aevpzg smithi063 running (75s) 62s ago 74s - - 17.2.7-123-gbef78a51 ae6196193935 df9a6781f836 2023-12-12T11:50:21.737 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.bdqbnp smithi063 running (80s) 62s ago 80s - - 17.2.7-123-gbef78a51 ae6196193935 0c7e1d21eee9 2023-12-12T11:50:21.737 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.rhaqsh smithi093 running (78s) 65s ago 77s 12.0M - 17.2.7-123-gbef78a51 ae6196193935 257aee771d87 2023-12-12T11:50:21.737 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.swdqms smithi093 running (72s) 65s ago 72s 12.0M - 17.2.7-123-gbef78a51 ae6196193935 f46d7173d3b1 2023-12-12T11:50:21.737 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.zjnfdi smithi063 *:9283 running (7m) 62s ago 7m - - 17.2.7-123-gbef78a51 ae6196193935 1b9efe5a68d3 2023-12-12T11:50:21.738 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi093.nbtltu smithi093 *:8443,9283 running (4m) 65s ago 4m 442M - 17.2.7-123-gbef78a51 ae6196193935 ecfd38b909a0 2023-12-12T11:50:21.738 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (7m) 62s ago 7m - 2048M 17.2.7-123-gbef78a51 ae6196193935 ee8e9d7455f9 2023-12-12T11:50:21.738 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi093 smithi093 running (4m) 65s ago 4m 45.4M 2048M 17.2.7-123-gbef78a51 ae6196193935 fac71666a805 2023-12-12T11:50:21.738 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (5m) 62s ago 5m - - 1.5.0 0da6a335fe13 9c94f98d1396 2023-12-12T11:50:21.738 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi093 smithi093 *:9100 running (5m) 65s ago 5m 8942k - 1.5.0 0da6a335fe13 55fa35accdef 2023-12-12T11:50:21.738 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (4m) 62s ago 4m - 4349M 17.2.7-123-gbef78a51 ae6196193935 636790d2b28c 2023-12-12T11:50:21.738 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (3m) 62s ago 3m - 4349M 17.2.7-123-gbef78a51 ae6196193935 5388a4bc6b12 2023-12-12T11:50:21.738 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (3m) 62s ago 3m - 4349M 17.2.7-123-gbef78a51 ae6196193935 9eb2483337c8 2023-12-12T11:50:21.738 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi093 running (3m) 65s ago 3m 54.0M 5373M 17.2.7-123-gbef78a51 ae6196193935 5b2bb36b5843 2023-12-12T11:50:21.738 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi093 running (2m) 65s ago 2m 48.9M 5373M 17.2.7-123-gbef78a51 ae6196193935 7dc3f04b04cb 2023-12-12T11:50:21.738 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi093 running (2m) 65s ago 2m 48.2M 5373M 17.2.7-123-gbef78a51 ae6196193935 16fe8e4668f1 2023-12-12T11:50:21.738 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (4m) 62s ago 5m - - 2.43.0 a07b618ecd1d 14c481676fd7 2023-12-12T11:50:21.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.736+0000 7f797672a700 1 -- 172.21.15.63:0/1969961006 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f7958069040 msgr2=0x7f795806b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:21.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.736+0000 7f797672a700 1 --2- 172.21.15.63:0/1969961006 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f7958069040 0x7f795806b4f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7964009b80 tx=0x7f796400b040 comp rx=0 tx=0).stop 2023-12-12T11:50:21.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.737+0000 7f797672a700 1 -- 172.21.15.63:0/1969961006 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79700fcbf0 msgr2=0x7f797010f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:21.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.737+0000 7f797672a700 1 --2- 172.21.15.63:0/1969961006 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79700fcbf0 0x7f797010f7f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7960008f80 tx=0x7f7960009e30 comp rx=0 tx=0).stop 2023-12-12T11:50:21.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.737+0000 7f797672a700 1 -- 172.21.15.63:0/1969961006 shutdown_connections 2023-12-12T11:50:21.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.737+0000 7f797672a700 1 --2- 172.21.15.63:0/1969961006 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79700fcbf0 0x7f797010f7f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:21.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.737+0000 7f797672a700 1 --2- 172.21.15.63:0/1969961006 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f7958069040 0x7f795806b4f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:21.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.737+0000 7f797672a700 1 --2- 172.21.15.63:0/1969961006 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79700fde00 0x7f797010fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:21.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.737+0000 7f797672a700 1 -- 172.21.15.63:0/1969961006 >> 172.21.15.63:0/1969961006 conn(0x7f79700f82d0 msgr2=0x7f79701018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:50:21.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.737+0000 7f797672a700 1 -- 172.21.15.63:0/1969961006 shutdown_connections 2023-12-12T11:50:21.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.737+0000 7f797672a700 1 -- 172.21.15.63:0/1969961006 wait complete. 2023-12-12T11:50:21.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.913+0000 7f62ca6f4700 1 -- 172.21.15.63:0/1765933332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c40fcd00 msgr2=0x7f62c40fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:21.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.913+0000 7f62ca6f4700 1 --2- 172.21.15.63:0/1765933332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c40fcd00 0x7f62c40fd150 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f62b8004940 tx=0x7f62b8009e30 comp rx=0 tx=0).stop 2023-12-12T11:50:21.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.913+0000 7f62ca6f4700 1 -- 172.21.15.63:0/1765933332 shutdown_connections 2023-12-12T11:50:21.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.913+0000 7f62ca6f4700 1 --2- 172.21.15.63:0/1765933332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c40fcd00 0x7f62c40fd150 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:21.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.913+0000 7f62ca6f4700 1 --2- 172.21.15.63:0/1765933332 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62c40fbaf0 0x7f62c40fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:21.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.913+0000 7f62ca6f4700 1 -- 172.21.15.63:0/1765933332 >> 172.21.15.63:0/1765933332 conn(0x7f62c40f7190 msgr2=0x7f62c40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:50:21.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.913+0000 7f62ca6f4700 1 -- 172.21.15.63:0/1765933332 shutdown_connections 2023-12-12T11:50:21.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.913+0000 7f62ca6f4700 1 -- 172.21.15.63:0/1765933332 wait complete. 2023-12-12T11:50:21.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.914+0000 7f62ca6f4700 1 Processor -- start 2023-12-12T11:50:21.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.914+0000 7f62ca6f4700 1 -- start start 2023-12-12T11:50:21.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.915+0000 7f62ca6f4700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c40fbaf0 0x7f62c410f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:21.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.915+0000 7f62ca6f4700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62c40fcd00 0x7f62c410fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:21.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.915+0000 7f62ca6f4700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c4110210 con 0x7f62c40fbaf0 2023-12-12T11:50:21.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.915+0000 7f62ca6f4700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c4110ab0 con 0x7f62c40fcd00 2023-12-12T11:50:21.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.915+0000 7f62c3fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c40fbaf0 0x7f62c410f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:21.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.915+0000 7f62c37fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62c40fcd00 0x7f62c410fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:21.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.915+0000 7f62c3fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c40fbaf0 0x7f62c410f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49786/0 (socket says 172.21.15.63:49786) 2023-12-12T11:50:21.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.915+0000 7f62c3fff700 1 -- 172.21.15.63:0/1647499311 learned_addr learned my addr 172.21.15.63:0/1647499311 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:50:21.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.916+0000 7f62c37fe700 1 -- 172.21.15.63:0/1647499311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c40fbaf0 msgr2=0x7f62c410f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:21.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.916+0000 7f62c37fe700 1 --2- 172.21.15.63:0/1647499311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c40fbaf0 0x7f62c410f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:21.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.916+0000 7f62c37fe700 1 -- 172.21.15.63:0/1647499311 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b8005040 con 0x7f62c40fcd00 2023-12-12T11:50:21.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.916+0000 7f62c37fe700 1 --2- 172.21.15.63:0/1647499311 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62c40fcd00 0x7f62c410fc10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f62b8009fd0 tx=0x7f62b8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:50:21.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.916+0000 7f62c0ff9700 1 -- 172.21.15.63:0/1647499311 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62b800e070 con 0x7f62c40fcd00 2023-12-12T11:50:21.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.917+0000 7f62c0ff9700 1 -- 172.21.15.63:0/1647499311 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f62b80093f0 con 0x7f62c40fcd00 2023-12-12T11:50:21.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.917+0000 7f62c0ff9700 1 -- 172.21.15.63:0/1647499311 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62b800b410 con 0x7f62c40fcd00 2023-12-12T11:50:21.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.917+0000 7f62ca6f4700 1 -- 172.21.15.63:0/1647499311 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c4110cb0 con 0x7f62c40fcd00 2023-12-12T11:50:21.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.917+0000 7f62ca6f4700 1 -- 172.21.15.63:0/1647499311 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c4111190 con 0x7f62c40fcd00 2023-12-12T11:50:21.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.919+0000 7f62ca6f4700 1 -- 172.21.15.63:0/1647499311 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c404bb80 con 0x7f62c40fcd00 2023-12-12T11:50:21.922 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.920+0000 7f62c0ff9700 1 -- 172.21.15.63:0/1647499311 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f62b8013c60 con 0x7f62c40fcd00 2023-12-12T11:50:21.924 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.922+0000 7f62c0ff9700 1 --2- 172.21.15.63:0/1647499311 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f62ac068f70 0x7f62ac06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:21.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.922+0000 7f62c0ff9700 1 -- 172.21.15.63:0/1647499311 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f62b8088380 con 0x7f62c40fcd00 2023-12-12T11:50:21.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.922+0000 7f62c3fff700 1 --2- 172.21.15.63:0/1647499311 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f62ac068f70 0x7f62ac06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:21.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.923+0000 7f62c3fff700 1 --2- 172.21.15.63:0/1647499311 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f62ac068f70 0x7f62ac06b420 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f62b4004ba0 tx=0x7f62b400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:50:21.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:21.925+0000 7f62c0ff9700 1 -- 172.21.15.63:0/1647499311 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f62b80583e0 con 0x7f62c40fcd00 2023-12-12T11:50:22.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:21 smithi093 ceph-mon[115914]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:50:22.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:21 smithi093 ceph-mon[115914]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:50:22.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:21 smithi063 ceph-mon[107117]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:50:22.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:21 smithi063 ceph-mon[107117]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:50:22.342 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.339+0000 7f62ca6f4700 1 -- 172.21.15.63:0/1647499311 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f62c4104490 con 0x7f62c40fcd00 2023-12-12T11:50:22.342 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.340+0000 7f62c0ff9700 1 -- 172.21.15.63:0/1647499311 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f62b8057f70 con 0x7f62c40fcd00 2023-12-12T11:50:22.343 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:50:22.343 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-12T11:50:22.343 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 2 2023-12-12T11:50:22.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:50:22.343 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-12T11:50:22.343 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 2 2023-12-12T11:50:22.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:50:22.343 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-12T11:50:22.343 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 6 2023-12-12T11:50:22.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:50:22.343 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-12T11:50:22.343 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 4 2023-12-12T11:50:22.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:50:22.344 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-12T11:50:22.344 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 14 2023-12-12T11:50:22.344 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-12T11:50:22.344 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:50:22.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.344+0000 7f62ca6f4700 1 -- 172.21.15.63:0/1647499311 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f62ac068f70 msgr2=0x7f62ac06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:22.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.344+0000 7f62ca6f4700 1 --2- 172.21.15.63:0/1647499311 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f62ac068f70 0x7f62ac06b420 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f62b4004ba0 tx=0x7f62b400b040 comp rx=0 tx=0).stop 2023-12-12T11:50:22.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.344+0000 7f62ca6f4700 1 -- 172.21.15.63:0/1647499311 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62c40fcd00 msgr2=0x7f62c410fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:22.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.344+0000 7f62ca6f4700 1 --2- 172.21.15.63:0/1647499311 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62c40fcd00 0x7f62c410fc10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f62b8009fd0 tx=0x7f62b8009e30 comp rx=0 tx=0).stop 2023-12-12T11:50:22.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.344+0000 7f62ca6f4700 1 -- 172.21.15.63:0/1647499311 shutdown_connections 2023-12-12T11:50:22.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.344+0000 7f62ca6f4700 1 --2- 172.21.15.63:0/1647499311 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f62ac068f70 0x7f62ac06b420 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:22.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.344+0000 7f62ca6f4700 1 --2- 172.21.15.63:0/1647499311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c40fbaf0 0x7f62c410f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:22.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.344+0000 7f62ca6f4700 1 --2- 172.21.15.63:0/1647499311 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62c40fcd00 0x7f62c410fc10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:22.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.344+0000 7f62ca6f4700 1 -- 172.21.15.63:0/1647499311 >> 172.21.15.63:0/1647499311 conn(0x7f62c40f7190 msgr2=0x7f62c4065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:50:22.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.344+0000 7f62ca6f4700 1 -- 172.21.15.63:0/1647499311 shutdown_connections 2023-12-12T11:50:22.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.344+0000 7f62ca6f4700 1 -- 172.21.15.63:0/1647499311 wait complete. 2023-12-12T11:50:22.547 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.544+0000 7fb24ad95700 1 -- 172.21.15.63:0/3630808258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb244071bc0 msgr2=0x7fb244070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:22.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.544+0000 7fb24ad95700 1 --2- 172.21.15.63:0/3630808258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb244071bc0 0x7fb244070030 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb238004940 tx=0x7fb238009e30 comp rx=0 tx=0).stop 2023-12-12T11:50:22.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.545+0000 7fb24ad95700 1 -- 172.21.15.63:0/3630808258 shutdown_connections 2023-12-12T11:50:22.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.545+0000 7fb24ad95700 1 --2- 172.21.15.63:0/3630808258 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb244070570 0x7fb2440709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:22.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.545+0000 7fb24ad95700 1 --2- 172.21.15.63:0/3630808258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb244071bc0 0x7fb244070030 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:22.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.545+0000 7fb24ad95700 1 -- 172.21.15.63:0/3630808258 >> 172.21.15.63:0/3630808258 conn(0x7fb2440f82d0 msgr2=0x7fb2440fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:50:22.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.545+0000 7fb24ad95700 1 -- 172.21.15.63:0/3630808258 shutdown_connections 2023-12-12T11:50:22.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.545+0000 7fb24ad95700 1 -- 172.21.15.63:0/3630808258 wait complete. 2023-12-12T11:50:22.549 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.546+0000 7fb24ad95700 1 Processor -- start 2023-12-12T11:50:22.549 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.546+0000 7fb24ad95700 1 -- start start 2023-12-12T11:50:22.549 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.547+0000 7fb24ad95700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb244070570 0x7fb244113aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:22.549 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.547+0000 7fb24ad95700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb244071bc0 0x7fb244113fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:22.549 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.547+0000 7fb24ad95700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2441145e0 con 0x7fb244071bc0 2023-12-12T11:50:22.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.547+0000 7fb24ad95700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb244114e80 con 0x7fb244070570 2023-12-12T11:50:22.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.547+0000 7fb248b31700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb244070570 0x7fb244113aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:22.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.547+0000 7fb248b31700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb244070570 0x7fb244113aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:47504/0 (socket says 172.21.15.63:47504) 2023-12-12T11:50:22.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.547+0000 7fb248b31700 1 -- 172.21.15.63:0/984792830 learned_addr learned my addr 172.21.15.63:0/984792830 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:50:22.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.547+0000 7fb243fff700 1 --2- 172.21.15.63:0/984792830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb244071bc0 0x7fb244113fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:22.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.548+0000 7fb248b31700 1 -- 172.21.15.63:0/984792830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb244071bc0 msgr2=0x7fb244113fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:22.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.548+0000 7fb248b31700 1 --2- 172.21.15.63:0/984792830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb244071bc0 0x7fb244113fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:22.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.548+0000 7fb248b31700 1 -- 172.21.15.63:0/984792830 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb238005040 con 0x7fb244070570 2023-12-12T11:50:22.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.548+0000 7fb248b31700 1 --2- 172.21.15.63:0/984792830 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb244070570 0x7fb244113aa0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb238008f90 tx=0x7fb238009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:50:22.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.548+0000 7fb2417fa700 1 -- 172.21.15.63:0/984792830 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb238021070 con 0x7fb244070570 2023-12-12T11:50:22.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.548+0000 7fb2417fa700 1 -- 172.21.15.63:0/984792830 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb23801c400 con 0x7fb244070570 2023-12-12T11:50:22.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.548+0000 7fb2417fa700 1 -- 172.21.15.63:0/984792830 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb23800e030 con 0x7fb244070570 2023-12-12T11:50:22.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.548+0000 7fb24ad95700 1 -- 172.21.15.63:0/984792830 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb244115100 con 0x7fb244070570 2023-12-12T11:50:22.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.549+0000 7fb24ad95700 1 -- 172.21.15.63:0/984792830 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2441155f0 con 0x7fb244070570 2023-12-12T11:50:22.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.550+0000 7fb24ad95700 1 -- 172.21.15.63:0/984792830 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb24404bb80 con 0x7fb244070570 2023-12-12T11:50:22.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.552+0000 7fb2417fa700 1 -- 172.21.15.63:0/984792830 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fb23801ca00 con 0x7fb244070570 2023-12-12T11:50:22.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.553+0000 7fb2417fa700 1 --2- 172.21.15.63:0/984792830 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb234068f70 0x7fb23406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:22.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.553+0000 7fb2417fa700 1 -- 172.21.15.63:0/984792830 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb238088170 con 0x7fb244070570 2023-12-12T11:50:22.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.554+0000 7fb243fff700 1 --2- 172.21.15.63:0/984792830 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb234068f70 0x7fb23406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:22.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.554+0000 7fb243fff700 1 --2- 172.21.15.63:0/984792830 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb234068f70 0x7fb23406b420 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb230009b80 tx=0x7fb23000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:50:22.563 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.561+0000 7fb2417fa700 1 -- 172.21.15.63:0/984792830 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb238057fe0 con 0x7fb244070570 2023-12-12T11:50:22.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.985+0000 7fb24ad95700 1 -- 172.21.15.63:0/984792830 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb244115c40 con 0x7fb244070570 2023-12-12T11:50:22.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.986+0000 7fb2417fa700 1 -- 172.21.15.63:0/984792830 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1807 (secure 0 0 0) 0x7fb238057b70 con 0x7fb244070570 2023-12-12T11:50:22.988 INFO:teuthology.orchestra.run.smithi063.stdout:e13 2023-12-12T11:50:22.988 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-12T11:50:22.989 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:50:22.989 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-12T11:50:22.989 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:50:22.989 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-12T11:50:22.989 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-12T11:50:22.989 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 13 2023-12-12T11:50:22.989 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-12T11:50:22.989 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-12T11:48:58.523481+0000 2023-12-12T11:50:22.989 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-12T11:49:14.113993+0000 2023-12-12T11:50:22.989 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-12T11:50:22.989 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-12T11:50:22.989 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-12T11:50:22.989 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-12T11:50:22.989 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-12T11:50:22.989 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-12T11:50:22.989 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-12T11:50:22.990 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 46 2023-12-12T11:50:22.990 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:50:22.990 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 1 2023-12-12T11:50:22.990 INFO:teuthology.orchestra.run.smithi063.stdout:in 0 2023-12-12T11:50:22.990 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=14492} 2023-12-12T11:50:22.990 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-12T11:50:22.990 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-12T11:50:22.990 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-12T11:50:22.990 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-12T11:50:22.990 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-12T11:50:22.990 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data enabled 2023-12-12T11:50:22.990 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-12T11:50:22.990 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 1 2023-12-12T11:50:22.990 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.aevpzg{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.63:6828/3709000039,v1:172.21.15.63:6829/3709000039] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:50:22.991 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:50:22.991 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:50:22.991 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2023-12-12T11:50:22.991 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:50:22.991 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.swdqms{-1:14500} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.93:6826/3307558569,v1:172.21.15.93:6827/3307558569] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:50:22.991 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.bdqbnp{-1:14508} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/2191270944,v1:172.21.15.63:6827/2191270944] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:50:22.991 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.rhaqsh{-1:24317} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.93:6824/3161864019,v1:172.21.15.93:6825/3161864019] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:50:22.992 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.989+0000 7fb24ad95700 1 -- 172.21.15.63:0/984792830 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb234068f70 msgr2=0x7fb23406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:22.992 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.989+0000 7fb24ad95700 1 --2- 172.21.15.63:0/984792830 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb234068f70 0x7fb23406b420 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb230009b80 tx=0x7fb23000b040 comp rx=0 tx=0).stop 2023-12-12T11:50:22.992 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.989+0000 7fb24ad95700 1 -- 172.21.15.63:0/984792830 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb244070570 msgr2=0x7fb244113aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:22.992 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.989+0000 7fb24ad95700 1 --2- 172.21.15.63:0/984792830 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb244070570 0x7fb244113aa0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb238008f90 tx=0x7fb238009e30 comp rx=0 tx=0).stop 2023-12-12T11:50:22.992 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.990+0000 7fb24ad95700 1 -- 172.21.15.63:0/984792830 shutdown_connections 2023-12-12T11:50:22.992 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.990+0000 7fb24ad95700 1 --2- 172.21.15.63:0/984792830 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb244070570 0x7fb244113aa0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:22.992 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.990+0000 7fb24ad95700 1 --2- 172.21.15.63:0/984792830 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fb234068f70 0x7fb23406b420 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:22.992 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.990+0000 7fb24ad95700 1 --2- 172.21.15.63:0/984792830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb244071bc0 0x7fb244113fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:22.993 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.990+0000 7fb24ad95700 1 -- 172.21.15.63:0/984792830 >> 172.21.15.63:0/984792830 conn(0x7fb2440f82d0 msgr2=0x7fb2440fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:50:22.993 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.990+0000 7fb24ad95700 1 -- 172.21.15.63:0/984792830 shutdown_connections 2023-12-12T11:50:22.993 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:22.990+0000 7fb24ad95700 1 -- 172.21.15.63:0/984792830 wait complete. 2023-12-12T11:50:22.993 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 13 2023-12-12T11:50:23.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.191+0000 7fa9a0da0700 1 -- 172.21.15.63:0/3661756918 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa99c0fc9f0 msgr2=0x7fa99c0fce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:23.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.191+0000 7fa9a0da0700 1 --2- 172.21.15.63:0/3661756918 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa99c0fc9f0 0x7fa99c0fce00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa98c004940 tx=0x7fa98c009e30 comp rx=0 tx=0).stop 2023-12-12T11:50:23.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.191+0000 7fa9a0da0700 1 -- 172.21.15.63:0/3661756918 shutdown_connections 2023-12-12T11:50:23.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.191+0000 7fa9a0da0700 1 --2- 172.21.15.63:0/3661756918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa99c0fdc00 0x7fa99c0fe050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:23.195 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.191+0000 7fa9a0da0700 1 --2- 172.21.15.63:0/3661756918 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa99c0fc9f0 0x7fa99c0fce00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:23.195 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.191+0000 7fa9a0da0700 1 -- 172.21.15.63:0/3661756918 >> 172.21.15.63:0/3661756918 conn(0x7fa99c0f8090 msgr2=0x7fa99c0fa4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:50:23.195 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.192+0000 7fa9a0da0700 1 -- 172.21.15.63:0/3661756918 shutdown_connections 2023-12-12T11:50:23.195 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.193+0000 7fa9a0da0700 1 -- 172.21.15.63:0/3661756918 wait complete. 2023-12-12T11:50:23.196 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.194+0000 7fa9a0da0700 1 Processor -- start 2023-12-12T11:50:23.196 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.194+0000 7fa9a0da0700 1 -- start start 2023-12-12T11:50:23.197 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.194+0000 7fa9a0da0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa99c0fc9f0 0x7fa99c10d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:23.197 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.194+0000 7fa9a0da0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa99c0fdc00 0x7fa99c10d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:23.197 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.194+0000 7fa9a0da0700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c10de60 con 0x7fa99c0fc9f0 2023-12-12T11:50:23.197 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.194+0000 7fa9a0da0700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c10e700 con 0x7fa99c0fdc00 2023-12-12T11:50:23.197 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.195+0000 7fa99b7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa99c0fc9f0 0x7fa99c10d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:23.198 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.195+0000 7fa99affd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa99c0fdc00 0x7fa99c10d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:23.198 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.195+0000 7fa99affd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa99c0fdc00 0x7fa99c10d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:47516/0 (socket says 172.21.15.63:47516) 2023-12-12T11:50:23.198 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.195+0000 7fa99affd700 1 -- 172.21.15.63:0/3298630692 learned_addr learned my addr 172.21.15.63:0/3298630692 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:50:23.198 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.195+0000 7fa99b7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa99c0fc9f0 0x7fa99c10d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49824/0 (socket says 172.21.15.63:49824) 2023-12-12T11:50:23.198 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.196+0000 7fa99affd700 1 -- 172.21.15.63:0/3298630692 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa99c0fc9f0 msgr2=0x7fa99c10d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.196+0000 7fa99affd700 1 --2- 172.21.15.63:0/3298630692 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa99c0fc9f0 0x7fa99c10d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.196+0000 7fa99affd700 1 -- 172.21.15.63:0/3298630692 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98c005040 con 0x7fa99c0fdc00 2023-12-12T11:50:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.196+0000 7fa99b7fe700 1 --2- 172.21.15.63:0/3298630692 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa99c0fc9f0 0x7fa99c10d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T11:50:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.196+0000 7fa99affd700 1 --2- 172.21.15.63:0/3298630692 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa99c0fdc00 0x7fa99c10d860 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa990002a50 tx=0x7fa9900046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:50:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.197+0000 7fa983fff700 1 -- 172.21.15.63:0/3298630692 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa990007cc0 con 0x7fa99c0fdc00 2023-12-12T11:50:23.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.197+0000 7fa983fff700 1 -- 172.21.15.63:0/3298630692 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa99000f040 con 0x7fa99c0fdc00 2023-12-12T11:50:23.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.197+0000 7fa983fff700 1 -- 172.21.15.63:0/3298630692 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa99000d9c0 con 0x7fa99c0fdc00 2023-12-12T11:50:23.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.197+0000 7fa9a0da0700 1 -- 172.21.15.63:0/3298630692 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa99c10e9e0 con 0x7fa99c0fdc00 2023-12-12T11:50:23.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.197+0000 7fa9a0da0700 1 -- 172.21.15.63:0/3298630692 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa99c10ef20 con 0x7fa99c0fdc00 2023-12-12T11:50:23.201 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.198+0000 7fa9a0da0700 1 -- 172.21.15.63:0/3298630692 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa99c04bb80 con 0x7fa99c0fdc00 2023-12-12T11:50:23.203 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.201+0000 7fa983fff700 1 -- 172.21.15.63:0/3298630692 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa99000db20 con 0x7fa99c0fdc00 2023-12-12T11:50:23.204 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.202+0000 7fa983fff700 1 --2- 172.21.15.63:0/3298630692 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fa984068f70 0x7fa98406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:23.204 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.202+0000 7fa983fff700 1 -- 172.21.15.63:0/3298630692 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa990086ac0 con 0x7fa99c0fdc00 2023-12-12T11:50:23.204 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.202+0000 7fa99b7fe700 1 --2- 172.21.15.63:0/3298630692 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fa984068f70 0x7fa98406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:23.205 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.203+0000 7fa99b7fe700 1 --2- 172.21.15.63:0/3298630692 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fa984068f70 0x7fa98406b420 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa98c00b7d0 tx=0x7fa98c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:50:23.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.205+0000 7fa983fff700 1 -- 172.21.15.63:0/3298630692 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa9900569b0 con 0x7fa99c0fdc00 2023-12-12T11:50:23.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:22 smithi093 ceph-mon[115914]: from='client.24423 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:50:23.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:22 smithi093 ceph-mon[115914]: pgmap v192: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-12T11:50:23.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:22 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/1647499311' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:50:23.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:22 smithi063 ceph-mon[107117]: from='client.24423 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:50:23.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:22 smithi063 ceph-mon[107117]: pgmap v192: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-12T11:50:23.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:22 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/1647499311' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:50:23.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.456+0000 7fa9a0da0700 1 -- 172.21.15.63:0/3298630692 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa99c10f540 con 0x7fa984068f70 2023-12-12T11:50:23.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.457+0000 7fa983fff700 1 -- 172.21.15.63:0/3298630692 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fa99c10f540 con 0x7fa984068f70 2023-12-12T11:50:23.460 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:50:23.460 INFO:teuthology.orchestra.run.smithi063.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:f1fbf3c583d03e19f5e58eb618e78d8e10d075f9", 2023-12-12T11:50:23.460 INFO:teuthology.orchestra.run.smithi063.stdout: "in_progress": true, 2023-12-12T11:50:23.460 INFO:teuthology.orchestra.run.smithi063.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-12T11:50:23.460 INFO:teuthology.orchestra.run.smithi063.stdout: "services_complete": [], 2023-12-12T11:50:23.460 INFO:teuthology.orchestra.run.smithi063.stdout: "progress": "", 2023-12-12T11:50:23.460 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 image", 2023-12-12T11:50:23.460 INFO:teuthology.orchestra.run.smithi063.stdout: "is_paused": false 2023-12-12T11:50:23.460 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:50:23.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.460+0000 7fa9a0da0700 1 -- 172.21.15.63:0/3298630692 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fa984068f70 msgr2=0x7fa98406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:23.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.460+0000 7fa9a0da0700 1 --2- 172.21.15.63:0/3298630692 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fa984068f70 0x7fa98406b420 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa98c00b7d0 tx=0x7fa98c009e30 comp rx=0 tx=0).stop 2023-12-12T11:50:23.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.460+0000 7fa9a0da0700 1 -- 172.21.15.63:0/3298630692 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa99c0fdc00 msgr2=0x7fa99c10d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:23.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.460+0000 7fa9a0da0700 1 --2- 172.21.15.63:0/3298630692 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa99c0fdc00 0x7fa99c10d860 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa990002a50 tx=0x7fa9900046b0 comp rx=0 tx=0).stop 2023-12-12T11:50:23.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.460+0000 7fa9a0da0700 1 -- 172.21.15.63:0/3298630692 shutdown_connections 2023-12-12T11:50:23.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.460+0000 7fa9a0da0700 1 --2- 172.21.15.63:0/3298630692 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fa984068f70 0x7fa98406b420 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:23.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.460+0000 7fa9a0da0700 1 --2- 172.21.15.63:0/3298630692 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa99c0fc9f0 0x7fa99c10d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:23.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.460+0000 7fa9a0da0700 1 --2- 172.21.15.63:0/3298630692 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa99c0fdc00 0x7fa99c10d860 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:23.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.460+0000 7fa9a0da0700 1 -- 172.21.15.63:0/3298630692 >> 172.21.15.63:0/3298630692 conn(0x7fa99c0f8090 msgr2=0x7fa99c100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:50:23.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.460+0000 7fa9a0da0700 1 -- 172.21.15.63:0/3298630692 shutdown_connections 2023-12-12T11:50:23.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.460+0000 7fa9a0da0700 1 -- 172.21.15.63:0/3298630692 wait complete. 2023-12-12T11:50:23.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.618+0000 7f74880a3700 1 -- 172.21.15.63:0/3364957936 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7480070570 msgr2=0x7f74800709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:23.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.618+0000 7f74880a3700 1 --2- 172.21.15.63:0/3364957936 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7480070570 0x7f74800709c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7470004940 tx=0x7f7470009e30 comp rx=0 tx=0).stop 2023-12-12T11:50:23.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.618+0000 7f74880a3700 1 -- 172.21.15.63:0/3364957936 shutdown_connections 2023-12-12T11:50:23.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.618+0000 7f74880a3700 1 --2- 172.21.15.63:0/3364957936 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7480070570 0x7f74800709c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:23.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.618+0000 7f74880a3700 1 --2- 172.21.15.63:0/3364957936 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7480071bc0 0x7f7480070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:23.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.618+0000 7f74880a3700 1 -- 172.21.15.63:0/3364957936 >> 172.21.15.63:0/3364957936 conn(0x7f74800f82d0 msgr2=0x7f74800fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:50:23.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.619+0000 7f74880a3700 1 -- 172.21.15.63:0/3364957936 shutdown_connections 2023-12-12T11:50:23.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.619+0000 7f74880a3700 1 -- 172.21.15.63:0/3364957936 wait complete. 2023-12-12T11:50:23.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.619+0000 7f74880a3700 1 Processor -- start 2023-12-12T11:50:23.623 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.621+0000 7f74880a3700 1 -- start start 2023-12-12T11:50:23.623 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.621+0000 7f74880a3700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7480070570 0x7f74800fca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:23.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.621+0000 7f74880a3700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7480071bc0 0x7f74800fcf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:23.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.621+0000 7f74880a3700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74800fd5a0 con 0x7f7480070570 2023-12-12T11:50:23.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.621+0000 7f74880a3700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74800fde40 con 0x7f7480071bc0 2023-12-12T11:50:23.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.622+0000 7f7485e3f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7480070570 0x7f74800fca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:23.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.622+0000 7f7485e3f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7480070570 0x7f74800fca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49846/0 (socket says 172.21.15.63:49846) 2023-12-12T11:50:23.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.622+0000 7f7485e3f700 1 -- 172.21.15.63:0/246481183 learned_addr learned my addr 172.21.15.63:0/246481183 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:50:23.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.622+0000 7f748563e700 1 --2- 172.21.15.63:0/246481183 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7480071bc0 0x7f74800fcf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:23.625 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.622+0000 7f7485e3f700 1 -- 172.21.15.63:0/246481183 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7480071bc0 msgr2=0x7f74800fcf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:23.625 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.622+0000 7f7485e3f700 1 --2- 172.21.15.63:0/246481183 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7480071bc0 0x7f74800fcf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:23.625 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.622+0000 7f7485e3f700 1 -- 172.21.15.63:0/246481183 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7470005040 con 0x7f7480070570 2023-12-12T11:50:23.625 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.622+0000 7f7485e3f700 1 --2- 172.21.15.63:0/246481183 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7480070570 0x7f74800fca10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f747c00eb40 tx=0x7f747c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:50:23.625 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.623+0000 7f74767fc700 1 -- 172.21.15.63:0/246481183 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f747c007cc0 con 0x7f7480070570 2023-12-12T11:50:23.625 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.623+0000 7f74880a3700 1 -- 172.21.15.63:0/246481183 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74800fe0c0 con 0x7f7480070570 2023-12-12T11:50:23.625 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.623+0000 7f74767fc700 1 -- 172.21.15.63:0/246481183 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f747c00f040 con 0x7f7480070570 2023-12-12T11:50:23.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.623+0000 7f74767fc700 1 -- 172.21.15.63:0/246481183 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f747c00c990 con 0x7f7480070570 2023-12-12T11:50:23.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.623+0000 7f74880a3700 1 -- 172.21.15.63:0/246481183 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74800fe600 con 0x7f7480070570 2023-12-12T11:50:23.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.625+0000 7f74880a3700 1 -- 172.21.15.63:0/246481183 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74801096f0 con 0x7f7480070570 2023-12-12T11:50:23.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.627+0000 7f74767fc700 1 -- 172.21.15.63:0/246481183 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f747c00caf0 con 0x7f7480070570 2023-12-12T11:50:23.631 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.628+0000 7f74767fc700 1 --2- 172.21.15.63:0/246481183 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f746c068f70 0x7f746c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:23.631 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.629+0000 7f74767fc700 1 -- 172.21.15.63:0/246481183 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f747c086990 con 0x7f7480070570 2023-12-12T11:50:23.631 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.629+0000 7f748563e700 1 --2- 172.21.15.63:0/246481183 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f746c068f70 0x7f746c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:23.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.630+0000 7f748563e700 1 --2- 172.21.15.63:0/246481183 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f746c068f70 0x7f746c06b420 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7470013600 tx=0x7f7470009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:50:23.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.633+0000 7f74767fc700 1 -- 172.21.15.63:0/246481183 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f747c04da00 con 0x7f7480070570 2023-12-12T11:50:23.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.933+0000 7f74880a3700 1 -- 172.21.15.63:0/246481183 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f748004bb80 con 0x7f7480070570 2023-12-12T11:50:23.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.934+0000 7f74767fc700 1 -- 172.21.15.63:0/246481183 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f747c052e20 con 0x7f7480070570 2023-12-12T11:50:23.938 INFO:teuthology.orchestra.run.smithi063.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-12T11:50:23.938 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-12T11:50:23.938 INFO:teuthology.orchestra.run.smithi063.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-12T11:50:23.939 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.937+0000 7f74880a3700 1 -- 172.21.15.63:0/246481183 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f746c068f70 msgr2=0x7f746c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:23.939 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.937+0000 7f74880a3700 1 --2- 172.21.15.63:0/246481183 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f746c068f70 0x7f746c06b420 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7470013600 tx=0x7f7470009e30 comp rx=0 tx=0).stop 2023-12-12T11:50:23.939 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.937+0000 7f74880a3700 1 -- 172.21.15.63:0/246481183 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7480070570 msgr2=0x7f74800fca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:23.939 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.937+0000 7f74880a3700 1 --2- 172.21.15.63:0/246481183 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7480070570 0x7f74800fca10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f747c00eb40 tx=0x7f747c00b040 comp rx=0 tx=0).stop 2023-12-12T11:50:23.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.937+0000 7f74880a3700 1 -- 172.21.15.63:0/246481183 shutdown_connections 2023-12-12T11:50:23.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.937+0000 7f74880a3700 1 --2- 172.21.15.63:0/246481183 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f746c068f70 0x7f746c06b420 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:23.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.937+0000 7f74880a3700 1 --2- 172.21.15.63:0/246481183 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7480070570 0x7f74800fca10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:23.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.937+0000 7f74880a3700 1 --2- 172.21.15.63:0/246481183 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7480071bc0 0x7f74800fcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:23.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.937+0000 7f74880a3700 1 -- 172.21.15.63:0/246481183 >> 172.21.15.63:0/246481183 conn(0x7f74800f82d0 msgr2=0x7f7480103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:50:23.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.938+0000 7f74880a3700 1 -- 172.21.15.63:0/246481183 shutdown_connections 2023-12-12T11:50:23.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:23.938+0000 7f74880a3700 1 -- 172.21.15.63:0/246481183 wait complete. 2023-12-12T11:50:24.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:23 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/984792830' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:50:24.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:23 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/984792830' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:50:25.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:24 smithi093 ceph-mon[115914]: from='client.24435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:50:25.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:24 smithi093 ceph-mon[115914]: pgmap v193: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-12T11:50:25.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:24 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/246481183' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:50:25.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:24 smithi063 ceph-mon[107117]: from='client.24435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:50:25.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:24 smithi063 ceph-mon[107117]: pgmap v193: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-12T11:50:25.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:24 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/246481183' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:50:27.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:26 smithi093 ceph-mon[115914]: pgmap v194: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-12T11:50:27.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:26 smithi063 ceph-mon[107117]: pgmap v194: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-12T11:50:29.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:28 smithi093 ceph-mon[115914]: pgmap v195: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-12T11:50:29.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:28 smithi063 ceph-mon[107117]: pgmap v195: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-12T11:50:31.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:30 smithi093 ceph-mon[115914]: pgmap v196: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-12T11:50:31.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:30 smithi063 ceph-mon[107117]: pgmap v196: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-12T11:50:32.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:32 smithi063 ceph-mon[107117]: pgmap v197: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:50:32.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:32 smithi093 ceph-mon[115914]: pgmap v197: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:50:35.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:34 smithi093 ceph-mon[115914]: pgmap v198: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:50:35.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:34 smithi063 ceph-mon[107117]: pgmap v198: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:50:36.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:35 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:50:36.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:35 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:50:37.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:36 smithi093 ceph-mon[115914]: pgmap v199: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:50:37.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:36 smithi063 ceph-mon[107117]: pgmap v199: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:50:39.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:38 smithi093 ceph-mon[115914]: pgmap v200: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:50:39.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:38 smithi063 ceph-mon[107117]: pgmap v200: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:50:41.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:40 smithi093 ceph-mon[115914]: pgmap v201: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:50:41.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:40 smithi063 ceph-mon[107117]: pgmap v201: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:50:42.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:42 smithi063 ceph-mon[107117]: pgmap v202: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:50:42.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:42 smithi093 ceph-mon[115914]: pgmap v202: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:50:43.803 INFO:tasks.workunit.client.1.smithi093.stderr:Updating files: 65% (7958/12157) Updating files: 66% (8024/12157) Updating files: 67% (8146/12157) Updating files: 68% (8267/12157) Updating files: 69% (8389/12157) Updating files: 70% (8510/12157) Updating files: 71% (8632/12157) Updating files: 72% (8754/12157) Updating files: 73% (8875/12157) Updating files: 74% (8997/12157) Updating files: 75% (9118/12157) Updating files: 76% (9240/12157) Updating files: 77% (9361/12157) Updating files: 78% (9483/12157) Updating files: 79% (9605/12157) Updating files: 80% (9726/12157) Updating files: 81% (9848/12157) Updating files: 82% (9969/12157) Updating files: 83% (10091/12157) Updating files: 84% (10212/12157) Updating files: 85% (10334/12157) Updating files: 86% (10456/12157) Updating files: 87% (10577/12157) Updating files: 88% (10699/12157) Updating files: 89% (10820/12157) Updating files: 90% (10942/12157) Updating files: 91% (11063/12157) Updating files: 92% (11185/12157) Updating files: 93% (11307/12157) Updating files: 94% (11428/12157) Updating files: 95% (11550/12157) Updating files: 96% (11671/12157) Updating files: 97% (11793/12157) Updating files: 98% (11914/12157) Updating files: 99% (12036/12157) Updating files: 100% (12157/12157) Updating files: 100% (12157/12157), done. 2023-12-12T11:50:44.358 INFO:tasks.workunit.client.1.smithi093.stderr:Note: switching to 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9'. 2023-12-12T11:50:44.358 INFO:tasks.workunit.client.1.smithi093.stderr: 2023-12-12T11:50:44.359 INFO:tasks.workunit.client.1.smithi093.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-12T11:50:44.359 INFO:tasks.workunit.client.1.smithi093.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-12T11:50:44.359 INFO:tasks.workunit.client.1.smithi093.stderr:state without impacting any branches by switching back to a branch. 2023-12-12T11:50:44.359 INFO:tasks.workunit.client.1.smithi093.stderr: 2023-12-12T11:50:44.359 INFO:tasks.workunit.client.1.smithi093.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-12T11:50:44.359 INFO:tasks.workunit.client.1.smithi093.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-12T11:50:44.359 INFO:tasks.workunit.client.1.smithi093.stderr: 2023-12-12T11:50:44.359 INFO:tasks.workunit.client.1.smithi093.stderr: git switch -c 2023-12-12T11:50:44.359 INFO:tasks.workunit.client.1.smithi093.stderr: 2023-12-12T11:50:44.359 INFO:tasks.workunit.client.1.smithi093.stderr:Or undo this operation with: 2023-12-12T11:50:44.359 INFO:tasks.workunit.client.1.smithi093.stderr: 2023-12-12T11:50:44.359 INFO:tasks.workunit.client.1.smithi093.stderr: git switch - 2023-12-12T11:50:44.360 INFO:tasks.workunit.client.1.smithi093.stderr: 2023-12-12T11:50:44.360 INFO:tasks.workunit.client.1.smithi093.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-12T11:50:44.360 INFO:tasks.workunit.client.1.smithi093.stderr: 2023-12-12T11:50:44.360 INFO:tasks.workunit.client.1.smithi093.stderr:HEAD is now at f1fbf3c583d qa: add split/merge dirfrag tests for scrub 2023-12-12T11:50:44.365 DEBUG:teuthology.orchestra.run.smithi093:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2023-12-12T11:50:44.419 INFO:tasks.workunit.client.1.smithi093.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-12T11:50:44.424 INFO:tasks.workunit.client.1.smithi093.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-12-12T11:50:44.424 INFO:tasks.workunit.client.1.smithi093.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-12T11:50:45.105 INFO:tasks.workunit.client.1.smithi093.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-12T11:50:45.197 INFO:tasks.workunit.client.1.smithi093.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-12T11:50:45.264 INFO:tasks.workunit.client.1.smithi093.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-12-12T11:50:45.268 INFO:tasks.workunit.client.1.smithi093.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-12-12T11:50:45.268 INFO:tasks.workunit.client.1.smithi093.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-12T11:50:45.351 INFO:tasks.workunit.client.1.smithi093.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-12-12T11:50:45.359 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-12T11:50:45.359 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2023-12-12T11:50:45.405 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2023-12-12T11:50:45.406 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-12-12T11:50:45.407 DEBUG:teuthology.orchestra.run.smithi093:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2023-12-12T11:50:45.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:45 smithi093 ceph-mon[115914]: pgmap v203: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:50:45.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:45 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:50:45.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:45 smithi093 ceph-mon[115914]: Upgrade: Target is version 19.0.0-96-gf1fbf3c5 (unknown) 2023-12-12T11:50:45.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:45 smithi093 ceph-mon[115914]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:dbb46fd2dbbe029cfba763f2b7c769e980f86b63e74be0c72e188909e20b81f3, digests ['quay.ceph.io/ceph-ci/ceph@sha256:dbb46fd2dbbe029cfba763f2b7c769e980f86b63e74be0c72e188909e20b81f3'] 2023-12-12T11:50:45.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:45 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:50:45.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:45 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:50:45.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:45 smithi093 ceph-mon[115914]: Upgrade: Need to upgrade myself (mgr.smithi063.zjnfdi) 2023-12-12T11:50:45.507 INFO:tasks.workunit.client.1.smithi093.stderr:+ mkdir -p fsstress 2023-12-12T11:50:45.511 INFO:tasks.workunit.client.1.smithi093.stderr:+ pushd fsstress 2023-12-12T11:50:45.511 INFO:tasks.workunit.client.1.smithi093.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-12T11:50:45.511 INFO:tasks.workunit.client.1.smithi093.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-12-12T11:50:45.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:45 smithi063 ceph-mon[107117]: pgmap v203: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:50:45.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:45 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:50:45.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:45 smithi063 ceph-mon[107117]: Upgrade: Target is version 19.0.0-96-gf1fbf3c5 (unknown) 2023-12-12T11:50:45.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:45 smithi063 ceph-mon[107117]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:dbb46fd2dbbe029cfba763f2b7c769e980f86b63e74be0c72e188909e20b81f3, digests ['quay.ceph.io/ceph-ci/ceph@sha256:dbb46fd2dbbe029cfba763f2b7c769e980f86b63e74be0c72e188909e20b81f3'] 2023-12-12T11:50:45.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:45 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:50:45.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:45 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:50:45.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:45 smithi063 ceph-mon[107117]: Upgrade: Need to upgrade myself (mgr.smithi063.zjnfdi) 2023-12-12T11:50:46.172 INFO:tasks.workunit.client.1.smithi093.stderr:+ tar xzf ltp-full.tgz 2023-12-12T11:50:46.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:46 smithi093 ceph-mon[115914]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:dbb46fd2dbbe029cfba763f2b7c769e980f86b63e74be0c72e188909e20b81f3 on smithi093 2023-12-12T11:50:46.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:46 smithi063 ceph-mon[107117]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:dbb46fd2dbbe029cfba763f2b7c769e980f86b63e74be0c72e188909e20b81f3 on smithi093 2023-12-12T11:50:47.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:47 smithi093 ceph-mon[115914]: pgmap v204: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:50:47.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:47 smithi063 ceph-mon[107117]: pgmap v204: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:50:49.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:49 smithi093 ceph-mon[115914]: pgmap v205: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:50:49.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:49 smithi063 ceph-mon[107117]: pgmap v205: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:50:51.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:51 smithi093 ceph-mon[115914]: pgmap v206: 65 pgs: 65 active+clean; 5.7 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 438 KiB/s wr, 0 op/s 2023-12-12T11:50:51.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:51 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:50:51.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:51 smithi063 ceph-mon[107117]: pgmap v206: 65 pgs: 65 active+clean; 5.7 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 438 KiB/s wr, 0 op/s 2023-12-12T11:50:51.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:51 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:50:52.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:52 smithi063 ceph-mon[107117]: pgmap v207: 65 pgs: 65 active+clean; 7.1 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 582 KiB/s wr, 30 op/s 2023-12-12T11:50:52.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:52 smithi093 ceph-mon[115914]: pgmap v207: 65 pgs: 65 active+clean; 7.1 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 582 KiB/s wr, 30 op/s 2023-12-12T11:50:54.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.096+0000 7f4d923c7700 1 -- 172.21.15.63:0/318262902 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d8c0fca00 msgr2=0x7f4d8c0fce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:54.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.096+0000 7f4d923c7700 1 --2- 172.21.15.63:0/318262902 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d8c0fca00 0x7f4d8c0fce10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4d88004940 tx=0x7f4d88009e30 comp rx=0 tx=0).stop 2023-12-12T11:50:54.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.096+0000 7f4d923c7700 1 -- 172.21.15.63:0/318262902 shutdown_connections 2023-12-12T11:50:54.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.096+0000 7f4d923c7700 1 --2- 172.21.15.63:0/318262902 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d8c0fdc10 0x7f4d8c0fe060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:54.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.096+0000 7f4d923c7700 1 --2- 172.21.15.63:0/318262902 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d8c0fca00 0x7f4d8c0fce10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:54.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.096+0000 7f4d923c7700 1 -- 172.21.15.63:0/318262902 >> 172.21.15.63:0/318262902 conn(0x7f4d8c0f80e0 msgr2=0x7f4d8c0fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:50:54.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.096+0000 7f4d923c7700 1 -- 172.21.15.63:0/318262902 shutdown_connections 2023-12-12T11:50:54.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.096+0000 7f4d923c7700 1 -- 172.21.15.63:0/318262902 wait complete. 2023-12-12T11:50:54.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.098+0000 7f4d923c7700 1 Processor -- start 2023-12-12T11:50:54.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.098+0000 7f4d923c7700 1 -- start start 2023-12-12T11:50:54.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.098+0000 7f4d923c7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d8c0fca00 0x7f4d8c113900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:54.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.098+0000 7f4d923c7700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d8c0fdc10 0x7f4d8c113e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:54.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.098+0000 7f4d923c7700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c114440 con 0x7f4d8c0fca00 2023-12-12T11:50:54.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.098+0000 7f4d923c7700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c114ce0 con 0x7f4d8c0fdc10 2023-12-12T11:50:54.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.099+0000 7f4d913c5700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d8c0fca00 0x7f4d8c113900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:54.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.099+0000 7f4d90bc4700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d8c0fdc10 0x7f4d8c113e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:54.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.099+0000 7f4d913c5700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d8c0fca00 0x7f4d8c113900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48266/0 (socket says 172.21.15.63:48266) 2023-12-12T11:50:54.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.099+0000 7f4d913c5700 1 -- 172.21.15.63:0/2308124775 learned_addr learned my addr 172.21.15.63:0/2308124775 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:50:54.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.099+0000 7f4d913c5700 1 -- 172.21.15.63:0/2308124775 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d8c0fdc10 msgr2=0x7f4d8c113e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:54.105 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.099+0000 7f4d913c5700 1 --2- 172.21.15.63:0/2308124775 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d8c0fdc10 0x7f4d8c113e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:54.105 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.099+0000 7f4d913c5700 1 -- 172.21.15.63:0/2308124775 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d88005040 con 0x7f4d8c0fca00 2023-12-12T11:50:54.105 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.099+0000 7f4d90bc4700 1 --2- 172.21.15.63:0/2308124775 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d8c0fdc10 0x7f4d8c113e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T11:50:54.105 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.099+0000 7f4d913c5700 1 --2- 172.21.15.63:0/2308124775 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d8c0fca00 0x7f4d8c113900 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4d88009360 tx=0x7f4d88009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:50:54.105 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.100+0000 7f4d81ffb700 1 -- 172.21.15.63:0/2308124775 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d8800e040 con 0x7f4d8c0fca00 2023-12-12T11:50:54.105 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.100+0000 7f4d81ffb700 1 -- 172.21.15.63:0/2308124775 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4d88004290 con 0x7f4d8c0fca00 2023-12-12T11:50:54.105 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.100+0000 7f4d81ffb700 1 -- 172.21.15.63:0/2308124775 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d8801c630 con 0x7f4d8c0fca00 2023-12-12T11:50:54.106 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.100+0000 7f4d923c7700 1 -- 172.21.15.63:0/2308124775 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d8c114f60 con 0x7f4d8c0fca00 2023-12-12T11:50:54.106 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.100+0000 7f4d923c7700 1 -- 172.21.15.63:0/2308124775 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d8c1154a0 con 0x7f4d8c0fca00 2023-12-12T11:50:54.106 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.102+0000 7f4d923c7700 1 -- 172.21.15.63:0/2308124775 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d8c101cb0 con 0x7f4d8c0fca00 2023-12-12T11:50:54.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.103+0000 7f4d81ffb700 1 -- 172.21.15.63:0/2308124775 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f4d88013960 con 0x7f4d8c0fca00 2023-12-12T11:50:54.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.104+0000 7f4d81ffb700 1 --2- 172.21.15.63:0/2308124775 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4d78068f70 0x7f4d7806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:54.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.104+0000 7f4d81ffb700 1 -- 172.21.15.63:0/2308124775 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4d88087eb0 con 0x7f4d8c0fca00 2023-12-12T11:50:54.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.104+0000 7f4d90bc4700 1 --2- 172.21.15.63:0/2308124775 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4d78068f70 0x7f4d7806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:54.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.105+0000 7f4d90bc4700 1 --2- 172.21.15.63:0/2308124775 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4d78068f70 0x7f4d7806b420 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c009fd0 tx=0x7f4d7c009ee0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:50:54.111 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.109+0000 7f4d81ffb700 1 -- 172.21.15.63:0/2308124775 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4d88057e60 con 0x7f4d8c0fca00 2023-12-12T11:50:54.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.347+0000 7f4d923c7700 1 -- 172.21.15.63:0/2308124775 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d8c02b250 con 0x7f4d78068f70 2023-12-12T11:50:54.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.348+0000 7f4d81ffb700 1 -- 172.21.15.63:0/2308124775 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f4d8c02b250 con 0x7f4d78068f70 2023-12-12T11:50:54.353 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.351+0000 7f4d923c7700 1 -- 172.21.15.63:0/2308124775 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4d78068f70 msgr2=0x7f4d7806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:54.353 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.351+0000 7f4d923c7700 1 --2- 172.21.15.63:0/2308124775 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4d78068f70 0x7f4d7806b420 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c009fd0 tx=0x7f4d7c009ee0 comp rx=0 tx=0).stop 2023-12-12T11:50:54.353 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.351+0000 7f4d923c7700 1 -- 172.21.15.63:0/2308124775 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d8c0fca00 msgr2=0x7f4d8c113900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:54.353 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.351+0000 7f4d923c7700 1 --2- 172.21.15.63:0/2308124775 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d8c0fca00 0x7f4d8c113900 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4d88009360 tx=0x7f4d88009e30 comp rx=0 tx=0).stop 2023-12-12T11:50:54.353 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.351+0000 7f4d923c7700 1 -- 172.21.15.63:0/2308124775 shutdown_connections 2023-12-12T11:50:54.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.351+0000 7f4d923c7700 1 --2- 172.21.15.63:0/2308124775 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f4d78068f70 0x7f4d7806b420 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:54.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.351+0000 7f4d923c7700 1 --2- 172.21.15.63:0/2308124775 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d8c0fca00 0x7f4d8c113900 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:54.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.351+0000 7f4d923c7700 1 --2- 172.21.15.63:0/2308124775 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d8c0fdc10 0x7f4d8c113e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:54.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.351+0000 7f4d923c7700 1 -- 172.21.15.63:0/2308124775 >> 172.21.15.63:0/2308124775 conn(0x7f4d8c0f80e0 msgr2=0x7f4d8c0fee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:50:54.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.351+0000 7f4d923c7700 1 -- 172.21.15.63:0/2308124775 shutdown_connections 2023-12-12T11:50:54.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.351+0000 7f4d923c7700 1 -- 172.21.15.63:0/2308124775 wait complete. 2023-12-12T11:50:54.376 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-12T11:50:54.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.564+0000 7f13917d6700 1 -- 172.21.15.63:0/1930722061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f138c0fde00 msgr2=0x7f138c0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:54.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.564+0000 7f13917d6700 1 --2- 172.21.15.63:0/1930722061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f138c0fde00 0x7f138c0fe250 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1380004940 tx=0x7f1380009e30 comp rx=0 tx=0).stop 2023-12-12T11:50:54.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.565+0000 7f13917d6700 1 -- 172.21.15.63:0/1930722061 shutdown_connections 2023-12-12T11:50:54.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.565+0000 7f13917d6700 1 --2- 172.21.15.63:0/1930722061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f138c0fde00 0x7f138c0fe250 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:54.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.565+0000 7f13917d6700 1 --2- 172.21.15.63:0/1930722061 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f138c0fcbf0 0x7f138c0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:54.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.565+0000 7f13917d6700 1 -- 172.21.15.63:0/1930722061 >> 172.21.15.63:0/1930722061 conn(0x7f138c0f82d0 msgr2=0x7f138c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:50:54.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.565+0000 7f13917d6700 1 -- 172.21.15.63:0/1930722061 shutdown_connections 2023-12-12T11:50:54.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.565+0000 7f13917d6700 1 -- 172.21.15.63:0/1930722061 wait complete. 2023-12-12T11:50:54.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.566+0000 7f13917d6700 1 Processor -- start 2023-12-12T11:50:54.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.566+0000 7f13917d6700 1 -- start start 2023-12-12T11:50:54.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.566+0000 7f13917d6700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f138c0fcbf0 0x7f138c10f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:54.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.566+0000 7f13917d6700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f138c0fde00 0x7f138c10fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:54.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.566+0000 7f13917d6700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138c110230 con 0x7f138c0fde00 2023-12-12T11:50:54.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.566+0000 7f13917d6700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138c110ad0 con 0x7f138c0fcbf0 2023-12-12T11:50:54.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.567+0000 7f138affd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f138c0fcbf0 0x7f138c10f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:54.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.567+0000 7f138affd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f138c0fcbf0 0x7f138c10f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:44582/0 (socket says 172.21.15.63:44582) 2023-12-12T11:50:54.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.567+0000 7f138affd700 1 -- 172.21.15.63:0/891013258 learned_addr learned my addr 172.21.15.63:0/891013258 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:50:54.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.567+0000 7f138a7fc700 1 --2- 172.21.15.63:0/891013258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f138c0fde00 0x7f138c10fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:54.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.567+0000 7f138affd700 1 -- 172.21.15.63:0/891013258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f138c0fde00 msgr2=0x7f138c10fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:54.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.567+0000 7f138affd700 1 --2- 172.21.15.63:0/891013258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f138c0fde00 0x7f138c10fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:54.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.567+0000 7f138affd700 1 -- 172.21.15.63:0/891013258 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1380005040 con 0x7f138c0fcbf0 2023-12-12T11:50:54.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.568+0000 7f138affd700 1 --2- 172.21.15.63:0/891013258 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f138c0fcbf0 0x7f138c10f6f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f137c00eb70 tx=0x7f137c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:50:54.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.568+0000 7f13737fe700 1 -- 172.21.15.63:0/891013258 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f137c007cc0 con 0x7f138c0fcbf0 2023-12-12T11:50:54.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.568+0000 7f13737fe700 1 -- 172.21.15.63:0/891013258 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f137c00f040 con 0x7f138c0fcbf0 2023-12-12T11:50:54.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.568+0000 7f13737fe700 1 -- 172.21.15.63:0/891013258 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f137c00ca50 con 0x7f138c0fcbf0 2023-12-12T11:50:54.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.568+0000 7f13917d6700 1 -- 172.21.15.63:0/891013258 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f138c110d50 con 0x7f138c0fcbf0 2023-12-12T11:50:54.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.568+0000 7f13917d6700 1 -- 172.21.15.63:0/891013258 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f138c1111d0 con 0x7f138c0fcbf0 2023-12-12T11:50:54.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.569+0000 7f13917d6700 1 -- 172.21.15.63:0/891013258 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138c101ea0 con 0x7f138c0fcbf0 2023-12-12T11:50:54.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.570+0000 7f13737fe700 1 -- 172.21.15.63:0/891013258 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f137c00cbb0 con 0x7f138c0fcbf0 2023-12-12T11:50:54.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.572+0000 7f13737fe700 1 --2- 172.21.15.63:0/891013258 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f1374068f60 0x7f137406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:54.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.572+0000 7f13737fe700 1 -- 172.21.15.63:0/891013258 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f137c0867e0 con 0x7f138c0fcbf0 2023-12-12T11:50:54.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.572+0000 7f138a7fc700 1 --2- 172.21.15.63:0/891013258 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f1374068f60 0x7f137406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:54.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.573+0000 7f138a7fc700 1 --2- 172.21.15.63:0/891013258 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f1374068f60 0x7f137406b410 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1380013600 tx=0x7f1380009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:50:54.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.576+0000 7f13737fe700 1 -- 172.21.15.63:0/891013258 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f137c04da00 con 0x7f138c0fcbf0 2023-12-12T11:50:54.901 INFO:tasks.workunit.client.0.smithi063.stderr:Updating files: 59% (7224/12157) Updating files: 60% (7295/12157) Updating files: 61% (7416/12157) Updating files: 62% (7538/12157) Updating files: 63% (7659/12157) Updating files: 64% (7781/12157) Updating files: 65% (7903/12157) Updating files: 66% (8024/12157) Updating files: 67% (8146/12157) Updating files: 68% (8267/12157) Updating files: 69% (8389/12157) Updating files: 70% (8510/12157) Updating files: 71% (8632/12157) Updating files: 72% (8754/12157) Updating files: 73% (8875/12157) Updating files: 74% (8997/12157) Updating files: 75% (9118/12157) Updating files: 76% (9240/12157) Updating files: 77% (9361/12157) Updating files: 78% (9483/12157) Updating files: 79% (9605/12157) Updating files: 80% (9726/12157) Updating files: 81% (9848/12157) Updating files: 82% (9969/12157) Updating files: 83% (10091/12157) Updating files: 84% (10212/12157) Updating files: 85% (10334/12157) Updating files: 86% (10456/12157) Updating files: 87% (10577/12157) Updating files: 88% (10699/12157) Updating files: 89% (10820/12157) Updating files: 90% (10942/12157) Updating files: 91% (11063/12157) Updating files: 92% (11185/12157) Updating files: 93% (11307/12157) Updating files: 94% (11428/12157) Updating files: 94% (11429/12157) Updating files: 95% (11550/12157) Updating files: 96% (11671/12157) Updating files: 97% (11793/12157) Updating files: 98% (11914/12157) Updating files: 99% (12036/12157) Updating files: 100% (12157/12157) Updating files: 100% (12157/12157), done. 2023-12-12T11:50:54.915 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.913+0000 7f13917d6700 1 -- 172.21.15.63:0/891013258 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f138c02b150 con 0x7f1374068f60 2023-12-12T11:50:54.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.914+0000 7f13737fe700 1 -- 172.21.15.63:0/891013258 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f138c02b150 con 0x7f1374068f60 2023-12-12T11:50:54.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.917+0000 7f13917d6700 1 -- 172.21.15.63:0/891013258 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f1374068f60 msgr2=0x7f137406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:54.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.917+0000 7f13917d6700 1 --2- 172.21.15.63:0/891013258 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f1374068f60 0x7f137406b410 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1380013600 tx=0x7f1380009e30 comp rx=0 tx=0).stop 2023-12-12T11:50:54.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.917+0000 7f13917d6700 1 -- 172.21.15.63:0/891013258 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f138c0fcbf0 msgr2=0x7f138c10f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:54.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.917+0000 7f13917d6700 1 --2- 172.21.15.63:0/891013258 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f138c0fcbf0 0x7f138c10f6f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f137c00eb70 tx=0x7f137c00b040 comp rx=0 tx=0).stop 2023-12-12T11:50:54.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.917+0000 7f13917d6700 1 -- 172.21.15.63:0/891013258 shutdown_connections 2023-12-12T11:50:54.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.917+0000 7f13917d6700 1 --2- 172.21.15.63:0/891013258 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f138c0fcbf0 0x7f138c10f6f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:54.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.917+0000 7f13917d6700 1 --2- 172.21.15.63:0/891013258 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f1374068f60 0x7f137406b410 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:54.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.917+0000 7f13917d6700 1 --2- 172.21.15.63:0/891013258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f138c0fde00 0x7f138c10fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:54.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.917+0000 7f13917d6700 1 -- 172.21.15.63:0/891013258 >> 172.21.15.63:0/891013258 conn(0x7f138c0f82d0 msgr2=0x7f138c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:50:54.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.917+0000 7f13917d6700 1 -- 172.21.15.63:0/891013258 shutdown_connections 2023-12-12T11:50:54.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:54.917+0000 7f13917d6700 1 -- 172.21.15.63:0/891013258 wait complete. 2023-12-12T11:50:55.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.124+0000 7ff7a2553700 1 -- 172.21.15.63:0/652292320 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff79c0fcbf0 msgr2=0x7ff79c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:55.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.124+0000 7ff7a2553700 1 --2- 172.21.15.63:0/652292320 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff79c0fcbf0 0x7ff79c0fd000 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff78c004940 tx=0x7ff78c009e30 comp rx=0 tx=0).stop 2023-12-12T11:50:55.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.124+0000 7ff7a2553700 1 -- 172.21.15.63:0/652292320 shutdown_connections 2023-12-12T11:50:55.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.124+0000 7ff7a2553700 1 --2- 172.21.15.63:0/652292320 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff79c0fde00 0x7ff79c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:55.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.124+0000 7ff7a2553700 1 --2- 172.21.15.63:0/652292320 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff79c0fcbf0 0x7ff79c0fd000 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:55.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.124+0000 7ff7a2553700 1 -- 172.21.15.63:0/652292320 >> 172.21.15.63:0/652292320 conn(0x7ff79c0f82d0 msgr2=0x7ff79c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:50:55.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.125+0000 7ff7a2553700 1 -- 172.21.15.63:0/652292320 shutdown_connections 2023-12-12T11:50:55.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.125+0000 7ff7a2553700 1 -- 172.21.15.63:0/652292320 wait complete. 2023-12-12T11:50:55.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.126+0000 7ff7a2553700 1 Processor -- start 2023-12-12T11:50:55.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.126+0000 7ff7a2553700 1 -- start start 2023-12-12T11:50:55.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.126+0000 7ff7a2553700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff79c0fcbf0 0x7ff79c10f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:55.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.126+0000 7ff7a2553700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff79c0fde00 0x7ff79c10fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:55.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.126+0000 7ff7a2553700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c110200 con 0x7ff79c0fde00 2023-12-12T11:50:55.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.126+0000 7ff7a2553700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c110aa0 con 0x7ff79c0fcbf0 2023-12-12T11:50:55.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.127+0000 7ff79bfff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff79c0fcbf0 0x7ff79c10f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:55.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.127+0000 7ff79bfff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff79c0fcbf0 0x7ff79c10f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:44600/0 (socket says 172.21.15.63:44600) 2023-12-12T11:50:55.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.127+0000 7ff79bfff700 1 -- 172.21.15.63:0/2282544253 learned_addr learned my addr 172.21.15.63:0/2282544253 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:50:55.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.127+0000 7ff79b7fe700 1 --2- 172.21.15.63:0/2282544253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff79c0fde00 0x7ff79c10fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:55.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.127+0000 7ff79bfff700 1 -- 172.21.15.63:0/2282544253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff79c0fde00 msgr2=0x7ff79c10fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:55.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.127+0000 7ff79bfff700 1 --2- 172.21.15.63:0/2282544253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff79c0fde00 0x7ff79c10fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:55.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.127+0000 7ff79bfff700 1 -- 172.21.15.63:0/2282544253 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff790005040 con 0x7ff79c0fcbf0 2023-12-12T11:50:55.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.127+0000 7ff79bfff700 1 --2- 172.21.15.63:0/2282544253 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff79c0fcbf0 0x7ff79c10f6c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff78c009fd0 tx=0x7ff78c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:50:55.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.128+0000 7ff798ff9700 1 -- 172.21.15.63:0/2282544253 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff78c021070 con 0x7ff79c0fcbf0 2023-12-12T11:50:55.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.128+0000 7ff7a2553700 1 -- 172.21.15.63:0/2282544253 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff78c005040 con 0x7ff79c0fcbf0 2023-12-12T11:50:55.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.128+0000 7ff798ff9700 1 -- 172.21.15.63:0/2282544253 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff78c01c400 con 0x7ff79c0fcbf0 2023-12-12T11:50:55.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.128+0000 7ff798ff9700 1 -- 172.21.15.63:0/2282544253 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff78c00e070 con 0x7ff79c0fcbf0 2023-12-12T11:50:55.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.128+0000 7ff7a2553700 1 -- 172.21.15.63:0/2282544253 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff79c1110d0 con 0x7ff79c0fcbf0 2023-12-12T11:50:55.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.129+0000 7ff7a2553700 1 -- 172.21.15.63:0/2282544253 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff79c101ea0 con 0x7ff79c0fcbf0 2023-12-12T11:50:55.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.130+0000 7ff798ff9700 1 -- 172.21.15.63:0/2282544253 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff78c01c9c0 con 0x7ff79c0fcbf0 2023-12-12T11:50:55.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.131+0000 7ff798ff9700 1 --2- 172.21.15.63:0/2282544253 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff784068f70 0x7ff78406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:55.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.132+0000 7ff798ff9700 1 -- 172.21.15.63:0/2282544253 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff78c087ff0 con 0x7ff79c0fcbf0 2023-12-12T11:50:55.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.132+0000 7ff79b7fe700 1 --2- 172.21.15.63:0/2282544253 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff784068f70 0x7ff78406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:55.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.133+0000 7ff79b7fe700 1 --2- 172.21.15.63:0/2282544253 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff784068f70 0x7ff78406b420 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff790009fd0 tx=0x7ff79000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:50:55.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.136+0000 7ff798ff9700 1 -- 172.21.15.63:0/2282544253 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff78c057f20 con 0x7ff79c0fcbf0 2023-12-12T11:50:55.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:54 smithi093 ceph-mon[115914]: pgmap v208: 65 pgs: 65 active+clean; 27 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s wr, 167 op/s 2023-12-12T11:50:55.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:54 smithi093 ceph-mon[115914]: from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:50:55.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:54 smithi063 ceph-mon[107117]: pgmap v208: 65 pgs: 65 active+clean; 27 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s wr, 167 op/s 2023-12-12T11:50:55.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:54 smithi063 ceph-mon[107117]: from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:50:55.419 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.416+0000 7ff7a2553700 1 -- 172.21.15.63:0/2282544253 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff79c111400 con 0x7ff784068f70 2023-12-12T11:50:55.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.436+0000 7ff798ff9700 1 -- 172.21.15.63:0/2282544253 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7ff79c111400 con 0x7ff784068f70 2023-12-12T11:50:55.438 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-12T11:50:55.439 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (5m) 96s ago 6m - - 0.25.0 c8568f914cd2 cd61d03c786f 2023-12-12T11:50:55.439 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (6m) 96s ago 6m - - 17.2.7-123-gbef78a51 ae6196193935 ee4415610fae 2023-12-12T11:50:55.439 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi093 smithi093 running (5m) 98s ago 5m 7810k - 17.2.7-123-gbef78a51 ae6196193935 f64e68742cfe 2023-12-12T11:50:55.439 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (5m) 96s ago 6m - - 9.4.7 954c08fa6188 2eeaef85f231 2023-12-12T11:50:55.439 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.aevpzg smithi063 running (108s) 96s ago 108s - - 17.2.7-123-gbef78a51 ae6196193935 df9a6781f836 2023-12-12T11:50:55.439 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.bdqbnp smithi063 running (114s) 96s ago 114s - - 17.2.7-123-gbef78a51 ae6196193935 0c7e1d21eee9 2023-12-12T11:50:55.439 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.rhaqsh smithi093 running (111s) 98s ago 111s 12.0M - 17.2.7-123-gbef78a51 ae6196193935 257aee771d87 2023-12-12T11:50:55.439 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.swdqms smithi093 running (106s) 98s ago 105s 12.0M - 17.2.7-123-gbef78a51 ae6196193935 f46d7173d3b1 2023-12-12T11:50:55.439 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.zjnfdi smithi063 *:9283 running (7m) 96s ago 7m - - 17.2.7-123-gbef78a51 ae6196193935 1b9efe5a68d3 2023-12-12T11:50:55.439 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi093.nbtltu smithi093 *:8443,9283 running (5m) 98s ago 5m 442M - 17.2.7-123-gbef78a51 ae6196193935 ecfd38b909a0 2023-12-12T11:50:55.439 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (7m) 96s ago 7m - 2048M 17.2.7-123-gbef78a51 ae6196193935 ee8e9d7455f9 2023-12-12T11:50:55.439 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi093 smithi093 running (5m) 98s ago 5m 45.4M 2048M 17.2.7-123-gbef78a51 ae6196193935 fac71666a805 2023-12-12T11:50:55.439 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (6m) 96s ago 6m - - 1.5.0 0da6a335fe13 9c94f98d1396 2023-12-12T11:50:55.439 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi093 smithi093 *:9100 running (5m) 98s ago 5m 8942k - 1.5.0 0da6a335fe13 55fa35accdef 2023-12-12T11:50:55.440 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (4m) 96s ago 4m - 4349M 17.2.7-123-gbef78a51 ae6196193935 636790d2b28c 2023-12-12T11:50:55.440 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (4m) 96s ago 4m - 4349M 17.2.7-123-gbef78a51 ae6196193935 5388a4bc6b12 2023-12-12T11:50:55.440 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (4m) 96s ago 4m - 4349M 17.2.7-123-gbef78a51 ae6196193935 9eb2483337c8 2023-12-12T11:50:55.440 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi093 running (3m) 98s ago 3m 54.0M 5373M 17.2.7-123-gbef78a51 ae6196193935 5b2bb36b5843 2023-12-12T11:50:55.440 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi093 running (3m) 98s ago 3m 48.9M 5373M 17.2.7-123-gbef78a51 ae6196193935 7dc3f04b04cb 2023-12-12T11:50:55.440 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi093 running (2m) 98s ago 2m 48.2M 5373M 17.2.7-123-gbef78a51 ae6196193935 16fe8e4668f1 2023-12-12T11:50:55.440 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (4m) 96s ago 5m - - 2.43.0 a07b618ecd1d 14c481676fd7 2023-12-12T11:50:55.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.439+0000 7ff7a2553700 1 -- 172.21.15.63:0/2282544253 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff784068f70 msgr2=0x7ff78406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:55.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.439+0000 7ff7a2553700 1 --2- 172.21.15.63:0/2282544253 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff784068f70 0x7ff78406b420 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff790009fd0 tx=0x7ff79000b040 comp rx=0 tx=0).stop 2023-12-12T11:50:55.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.439+0000 7ff7a2553700 1 -- 172.21.15.63:0/2282544253 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff79c0fcbf0 msgr2=0x7ff79c10f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:55.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.439+0000 7ff7a2553700 1 --2- 172.21.15.63:0/2282544253 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff79c0fcbf0 0x7ff79c10f6c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff78c009fd0 tx=0x7ff78c009e30 comp rx=0 tx=0).stop 2023-12-12T11:50:55.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.440+0000 7ff7a2553700 1 -- 172.21.15.63:0/2282544253 shutdown_connections 2023-12-12T11:50:55.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.440+0000 7ff7a2553700 1 --2- 172.21.15.63:0/2282544253 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff79c0fcbf0 0x7ff79c10f6c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:55.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.440+0000 7ff7a2553700 1 --2- 172.21.15.63:0/2282544253 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff784068f70 0x7ff78406b420 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:55.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.440+0000 7ff7a2553700 1 --2- 172.21.15.63:0/2282544253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff79c0fde00 0x7ff79c10fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:55.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.440+0000 7ff7a2553700 1 -- 172.21.15.63:0/2282544253 >> 172.21.15.63:0/2282544253 conn(0x7ff79c0f82d0 msgr2=0x7ff79c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:50:55.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.440+0000 7ff7a2553700 1 -- 172.21.15.63:0/2282544253 shutdown_connections 2023-12-12T11:50:55.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.440+0000 7ff7a2553700 1 -- 172.21.15.63:0/2282544253 wait complete. 2023-12-12T11:50:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.594+0000 7f7464f42700 1 -- 172.21.15.63:0/4163499601 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74600fb0f0 msgr2=0x7f74600fb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.594+0000 7f7464f42700 1 --2- 172.21.15.63:0/4163499601 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74600fb0f0 0x7f74600fb9e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7454004940 tx=0x7f7454009e30 comp rx=0 tx=0).stop 2023-12-12T11:50:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.594+0000 7f7464f42700 1 -- 172.21.15.63:0/4163499601 shutdown_connections 2023-12-12T11:50:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.594+0000 7f7464f42700 1 --2- 172.21.15.63:0/4163499601 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74600fb0f0 0x7f74600fb9e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.595+0000 7f7464f42700 1 --2- 172.21.15.63:0/4163499601 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74600fa7a0 0x7f74600fabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.595+0000 7f7464f42700 1 -- 172.21.15.63:0/4163499601 >> 172.21.15.63:0/4163499601 conn(0x7f74600f62e0 msgr2=0x7f74600f8710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:50:55.598 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.595+0000 7f7464f42700 1 -- 172.21.15.63:0/4163499601 shutdown_connections 2023-12-12T11:50:55.598 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.595+0000 7f7464f42700 1 -- 172.21.15.63:0/4163499601 wait complete. 2023-12-12T11:50:55.598 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.596+0000 7f7464f42700 1 Processor -- start 2023-12-12T11:50:55.598 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.596+0000 7f7464f42700 1 -- start start 2023-12-12T11:50:55.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.597+0000 7f7464f42700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74600fa7a0 0x7f746010f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:55.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.597+0000 7f7464f42700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74600fb0f0 0x7f746010f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:55.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.597+0000 7f7464f42700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746010fff0 con 0x7f74600fa7a0 2023-12-12T11:50:55.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.597+0000 7f7464f42700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7460110890 con 0x7f74600fb0f0 2023-12-12T11:50:55.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.597+0000 7f745f7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74600fa7a0 0x7f746010f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:55.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.597+0000 7f745effd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74600fb0f0 0x7f746010f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:55.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.597+0000 7f745effd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74600fb0f0 0x7f746010f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:44618/0 (socket says 172.21.15.63:44618) 2023-12-12T11:50:55.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.597+0000 7f745effd700 1 -- 172.21.15.63:0/277671631 learned_addr learned my addr 172.21.15.63:0/277671631 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:50:55.600 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.598+0000 7f745effd700 1 -- 172.21.15.63:0/277671631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74600fa7a0 msgr2=0x7f746010f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:55.600 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.598+0000 7f745effd700 1 --2- 172.21.15.63:0/277671631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74600fa7a0 0x7f746010f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:55.600 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.598+0000 7f745effd700 1 -- 172.21.15.63:0/277671631 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7454005040 con 0x7f74600fb0f0 2023-12-12T11:50:55.600 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.598+0000 7f745effd700 1 --2- 172.21.15.63:0/277671631 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74600fb0f0 0x7f746010f9f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f745400b3b0 tx=0x7f7454009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:50:55.600 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.598+0000 7f7447fff700 1 -- 172.21.15.63:0/277671631 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f745400e040 con 0x7f74600fb0f0 2023-12-12T11:50:55.601 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.598+0000 7f7447fff700 1 -- 172.21.15.63:0/277671631 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f745400bc50 con 0x7f74600fb0f0 2023-12-12T11:50:55.601 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.598+0000 7f7447fff700 1 -- 172.21.15.63:0/277671631 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f745401c630 con 0x7f74600fb0f0 2023-12-12T11:50:55.601 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.598+0000 7f7464f42700 1 -- 172.21.15.63:0/277671631 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7460110b10 con 0x7f74600fb0f0 2023-12-12T11:50:55.601 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.598+0000 7f7464f42700 1 -- 172.21.15.63:0/277671631 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7460111000 con 0x7f74600fb0f0 2023-12-12T11:50:55.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.600+0000 7f7464f42700 1 -- 172.21.15.63:0/277671631 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f746004bb80 con 0x7f74600fb0f0 2023-12-12T11:50:55.604 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.602+0000 7f7447fff700 1 -- 172.21.15.63:0/277671631 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f7454013420 con 0x7f74600fb0f0 2023-12-12T11:50:55.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.603+0000 7f7447fff700 1 --2- 172.21.15.63:0/277671631 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f7448068f70 0x7f744806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:55.606 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.603+0000 7f7447fff700 1 -- 172.21.15.63:0/277671631 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f74540882a0 con 0x7f74600fb0f0 2023-12-12T11:50:55.606 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.603+0000 7f745f7fe700 1 --2- 172.21.15.63:0/277671631 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f7448068f70 0x7f744806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:55.606 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.604+0000 7f745f7fe700 1 --2- 172.21.15.63:0/277671631 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f7448068f70 0x7f744806b420 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7450004f40 tx=0x7f745000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:50:55.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.607+0000 7f7447fff700 1 -- 172.21.15.63:0/277671631 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7454058110 con 0x7f74600fb0f0 2023-12-12T11:50:55.664 INFO:tasks.workunit.client.0.smithi063.stderr:Note: switching to 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9'. 2023-12-12T11:50:55.664 INFO:tasks.workunit.client.0.smithi063.stderr: 2023-12-12T11:50:55.665 INFO:tasks.workunit.client.0.smithi063.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-12T11:50:55.665 INFO:tasks.workunit.client.0.smithi063.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-12T11:50:55.665 INFO:tasks.workunit.client.0.smithi063.stderr:state without impacting any branches by switching back to a branch. 2023-12-12T11:50:55.665 INFO:tasks.workunit.client.0.smithi063.stderr: 2023-12-12T11:50:55.665 INFO:tasks.workunit.client.0.smithi063.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-12T11:50:55.665 INFO:tasks.workunit.client.0.smithi063.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-12T11:50:55.665 INFO:tasks.workunit.client.0.smithi063.stderr: 2023-12-12T11:50:55.665 INFO:tasks.workunit.client.0.smithi063.stderr: git switch -c 2023-12-12T11:50:55.665 INFO:tasks.workunit.client.0.smithi063.stderr: 2023-12-12T11:50:55.665 INFO:tasks.workunit.client.0.smithi063.stderr:Or undo this operation with: 2023-12-12T11:50:55.665 INFO:tasks.workunit.client.0.smithi063.stderr: 2023-12-12T11:50:55.665 INFO:tasks.workunit.client.0.smithi063.stderr: git switch - 2023-12-12T11:50:55.665 INFO:tasks.workunit.client.0.smithi063.stderr: 2023-12-12T11:50:55.665 INFO:tasks.workunit.client.0.smithi063.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-12T11:50:55.666 INFO:tasks.workunit.client.0.smithi063.stderr: 2023-12-12T11:50:55.666 INFO:tasks.workunit.client.0.smithi063.stderr:HEAD is now at f1fbf3c583d qa: add split/merge dirfrag tests for scrub 2023-12-12T11:50:55.670 DEBUG:teuthology.orchestra.run.smithi063:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-12T11:50:55.737 INFO:tasks.workunit.client.0.smithi063.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-12T11:50:55.743 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-12T11:50:55.743 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-12T11:50:55.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.906+0000 7f7464f42700 1 -- 172.21.15.63:0/277671631 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7460111510 con 0x7f74600fb0f0 2023-12-12T11:50:55.911 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.908+0000 7f7447fff700 1 -- 172.21.15.63:0/277671631 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f7454057ca0 con 0x7f74600fb0f0 2023-12-12T11:50:55.911 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:50:55.911 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-12T11:50:55.911 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 2 2023-12-12T11:50:55.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:50:55.911 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-12T11:50:55.911 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 2 2023-12-12T11:50:55.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:50:55.911 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-12T11:50:55.911 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 6 2023-12-12T11:50:55.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:50:55.911 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-12T11:50:55.912 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 4 2023-12-12T11:50:55.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:50:55.912 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-12T11:50:55.912 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 14 2023-12-12T11:50:55.912 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-12T11:50:55.912 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:50:55.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.911+0000 7f7464f42700 1 -- 172.21.15.63:0/277671631 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f7448068f70 msgr2=0x7f744806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:55.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.911+0000 7f7464f42700 1 --2- 172.21.15.63:0/277671631 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f7448068f70 0x7f744806b420 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7450004f40 tx=0x7f745000b040 comp rx=0 tx=0).stop 2023-12-12T11:50:55.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.911+0000 7f7464f42700 1 -- 172.21.15.63:0/277671631 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74600fb0f0 msgr2=0x7f746010f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:55.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.911+0000 7f7464f42700 1 --2- 172.21.15.63:0/277671631 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74600fb0f0 0x7f746010f9f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f745400b3b0 tx=0x7f7454009e30 comp rx=0 tx=0).stop 2023-12-12T11:50:55.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.911+0000 7f7464f42700 1 -- 172.21.15.63:0/277671631 shutdown_connections 2023-12-12T11:50:55.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.911+0000 7f7464f42700 1 --2- 172.21.15.63:0/277671631 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f7448068f70 0x7f744806b420 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:55.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.911+0000 7f7464f42700 1 --2- 172.21.15.63:0/277671631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74600fa7a0 0x7f746010f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:55.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.911+0000 7f7464f42700 1 --2- 172.21.15.63:0/277671631 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74600fb0f0 0x7f746010f9f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:55.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.911+0000 7f7464f42700 1 -- 172.21.15.63:0/277671631 >> 172.21.15.63:0/277671631 conn(0x7f74600f62e0 msgr2=0x7f7460104640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:50:55.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.912+0000 7f7464f42700 1 -- 172.21.15.63:0/277671631 shutdown_connections 2023-12-12T11:50:55.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:55.912+0000 7f7464f42700 1 -- 172.21.15.63:0/277671631 wait complete. 2023-12-12T11:50:56.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.078+0000 7f3b49029700 1 -- 172.21.15.63:0/1376653785 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b44071aa0 msgr2=0x7f3b4406ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:56.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.078+0000 7f3b49029700 1 --2- 172.21.15.63:0/1376653785 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b44071aa0 0x7f3b4406ffb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3b34004940 tx=0x7f3b34009e30 comp rx=0 tx=0).stop 2023-12-12T11:50:56.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.079+0000 7f3b49029700 1 -- 172.21.15.63:0/1376653785 shutdown_connections 2023-12-12T11:50:56.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.079+0000 7f3b49029700 1 --2- 172.21.15.63:0/1376653785 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3b440704f0 0x7f3b44070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:56.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.079+0000 7f3b49029700 1 --2- 172.21.15.63:0/1376653785 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b44071aa0 0x7f3b4406ffb0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:56.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.079+0000 7f3b49029700 1 -- 172.21.15.63:0/1376653785 >> 172.21.15.63:0/1376653785 conn(0x7f3b440f8330 msgr2=0x7f3b440fa780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:50:56.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.079+0000 7f3b49029700 1 -- 172.21.15.63:0/1376653785 shutdown_connections 2023-12-12T11:50:56.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.079+0000 7f3b49029700 1 -- 172.21.15.63:0/1376653785 wait complete. 2023-12-12T11:50:56.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.080+0000 7f3b49029700 1 Processor -- start 2023-12-12T11:50:56.083 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.080+0000 7f3b49029700 1 -- start start 2023-12-12T11:50:56.083 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.080+0000 7f3b49029700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b440704f0 0x7f3b4410f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:56.083 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.080+0000 7f3b49029700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3b44071aa0 0x7f3b4410fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:56.083 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.080+0000 7f3b49029700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b44110300 con 0x7f3b440704f0 2023-12-12T11:50:56.083 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.080+0000 7f3b49029700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b44110ba0 con 0x7f3b44071aa0 2023-12-12T11:50:56.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.081+0000 7f3b42d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b440704f0 0x7f3b4410f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:56.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.081+0000 7f3b42d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b440704f0 0x7f3b4410f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48330/0 (socket says 172.21.15.63:48330) 2023-12-12T11:50:56.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.081+0000 7f3b42d9d700 1 -- 172.21.15.63:0/3232174502 learned_addr learned my addr 172.21.15.63:0/3232174502 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:50:56.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.081+0000 7f3b4259c700 1 --2- 172.21.15.63:0/3232174502 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3b44071aa0 0x7f3b4410fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:56.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.081+0000 7f3b42d9d700 1 -- 172.21.15.63:0/3232174502 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3b44071aa0 msgr2=0x7f3b4410fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:56.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.081+0000 7f3b42d9d700 1 --2- 172.21.15.63:0/3232174502 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3b44071aa0 0x7f3b4410fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:56.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.081+0000 7f3b42d9d700 1 -- 172.21.15.63:0/3232174502 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b34005040 con 0x7f3b440704f0 2023-12-12T11:50:56.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.081+0000 7f3b42d9d700 1 --2- 172.21.15.63:0/3232174502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b440704f0 0x7f3b4410f7c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3b34000c00 tx=0x7f3b34009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:50:56.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.082+0000 7f3b2b7fe700 1 -- 172.21.15.63:0/3232174502 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b34021070 con 0x7f3b440704f0 2023-12-12T11:50:56.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.082+0000 7f3b2b7fe700 1 -- 172.21.15.63:0/3232174502 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3b340093b0 con 0x7f3b440704f0 2023-12-12T11:50:56.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.082+0000 7f3b2b7fe700 1 -- 172.21.15.63:0/3232174502 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b3400e070 con 0x7f3b440704f0 2023-12-12T11:50:56.085 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.082+0000 7f3b49029700 1 -- 172.21.15.63:0/3232174502 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b44110e20 con 0x7f3b440704f0 2023-12-12T11:50:56.085 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.082+0000 7f3b49029700 1 -- 172.21.15.63:0/3232174502 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b44111300 con 0x7f3b440704f0 2023-12-12T11:50:56.086 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.084+0000 7f3b49029700 1 -- 172.21.15.63:0/3232174502 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b441097f0 con 0x7f3b440704f0 2023-12-12T11:50:56.088 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.086+0000 7f3b2b7fe700 1 -- 172.21.15.63:0/3232174502 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f3b3401c670 con 0x7f3b440704f0 2023-12-12T11:50:56.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.087+0000 7f3b2b7fe700 1 --2- 172.21.15.63:0/3232174502 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f3b2c068f70 0x7f3b2c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:56.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.087+0000 7f3b2b7fe700 1 -- 172.21.15.63:0/3232174502 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f3b34087ed0 con 0x7f3b440704f0 2023-12-12T11:50:56.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.087+0000 7f3b4259c700 1 --2- 172.21.15.63:0/3232174502 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f3b2c068f70 0x7f3b2c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:56.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.088+0000 7f3b4259c700 1 --2- 172.21.15.63:0/3232174502 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f3b2c068f70 0x7f3b2c06b420 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3b38009b80 tx=0x7f3b3800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:50:56.094 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.092+0000 7f3b2b7fe700 1 -- 172.21.15.63:0/3232174502 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3b34057e00 con 0x7f3b440704f0 2023-12-12T11:50:56.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:55 smithi093 ceph-mon[115914]: from='client.24447 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:50:56.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:55 smithi063 ceph-mon[107117]: from='client.24447 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:50:56.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.362+0000 7f3b49029700 1 -- 172.21.15.63:0/3232174502 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3b44111630 con 0x7f3b440704f0 2023-12-12T11:50:56.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.362+0000 7f3b2b7fe700 1 -- 172.21.15.63:0/3232174502 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1807 (secure 0 0 0) 0x7f3b34057990 con 0x7f3b440704f0 2023-12-12T11:50:56.365 INFO:teuthology.orchestra.run.smithi063.stdout:e13 2023-12-12T11:50:56.365 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-12T11:50:56.365 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:50:56.365 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-12T11:50:56.365 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:50:56.365 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-12T11:50:56.365 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-12T11:50:56.365 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 13 2023-12-12T11:50:56.365 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-12T11:50:56.365 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-12T11:48:58.523481+0000 2023-12-12T11:50:56.366 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-12T11:49:14.113993+0000 2023-12-12T11:50:56.366 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-12T11:50:56.366 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-12T11:50:56.366 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-12T11:50:56.366 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-12T11:50:56.366 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-12T11:50:56.366 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-12T11:50:56.366 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-12T11:50:56.366 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 46 2023-12-12T11:50:56.366 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:50:56.366 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 1 2023-12-12T11:50:56.366 INFO:teuthology.orchestra.run.smithi063.stdout:in 0 2023-12-12T11:50:56.366 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=14492} 2023-12-12T11:50:56.366 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-12T11:50:56.366 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-12T11:50:56.367 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-12T11:50:56.367 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-12T11:50:56.367 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-12T11:50:56.367 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data enabled 2023-12-12T11:50:56.367 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-12T11:50:56.367 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 1 2023-12-12T11:50:56.367 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.aevpzg{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.63:6828/3709000039,v1:172.21.15.63:6829/3709000039] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:50:56.367 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:50:56.367 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:50:56.367 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2023-12-12T11:50:56.367 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:50:56.367 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.swdqms{-1:14500} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.93:6826/3307558569,v1:172.21.15.93:6827/3307558569] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:50:56.367 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.bdqbnp{-1:14508} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/2191270944,v1:172.21.15.63:6827/2191270944] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:50:56.367 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.rhaqsh{-1:24317} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.93:6824/3161864019,v1:172.21.15.93:6825/3161864019] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:50:56.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.365+0000 7f3b49029700 1 -- 172.21.15.63:0/3232174502 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f3b2c068f70 msgr2=0x7f3b2c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:56.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.365+0000 7f3b49029700 1 --2- 172.21.15.63:0/3232174502 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f3b2c068f70 0x7f3b2c06b420 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3b38009b80 tx=0x7f3b3800b040 comp rx=0 tx=0).stop 2023-12-12T11:50:56.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.365+0000 7f3b49029700 1 -- 172.21.15.63:0/3232174502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b440704f0 msgr2=0x7f3b4410f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:56.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.365+0000 7f3b49029700 1 --2- 172.21.15.63:0/3232174502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b440704f0 0x7f3b4410f7c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3b34000c00 tx=0x7f3b34009e30 comp rx=0 tx=0).stop 2023-12-12T11:50:56.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.365+0000 7f3b49029700 1 -- 172.21.15.63:0/3232174502 shutdown_connections 2023-12-12T11:50:56.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.365+0000 7f3b49029700 1 --2- 172.21.15.63:0/3232174502 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f3b2c068f70 0x7f3b2c06b420 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:56.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.365+0000 7f3b49029700 1 --2- 172.21.15.63:0/3232174502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b440704f0 0x7f3b4410f7c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:56.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.365+0000 7f3b49029700 1 --2- 172.21.15.63:0/3232174502 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3b44071aa0 0x7f3b4410fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:56.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.365+0000 7f3b49029700 1 -- 172.21.15.63:0/3232174502 >> 172.21.15.63:0/3232174502 conn(0x7f3b440f8330 msgr2=0x7f3b440fa610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:50:56.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.365+0000 7f3b49029700 1 -- 172.21.15.63:0/3232174502 shutdown_connections 2023-12-12T11:50:56.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.365+0000 7f3b49029700 1 -- 172.21.15.63:0/3232174502 wait complete. 2023-12-12T11:50:56.369 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 13 2023-12-12T11:50:56.398 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-12T11:50:56.505 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-12T11:50:56.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.518+0000 7f01e8b1f700 1 -- 172.21.15.63:0/3730068200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01e4071bc0 msgr2=0x7f01e4070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:56.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.518+0000 7f01e8b1f700 1 --2- 172.21.15.63:0/3730068200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01e4071bc0 0x7f01e4070030 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f01d4004940 tx=0x7f01d4009e30 comp rx=0 tx=0).stop 2023-12-12T11:50:56.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.518+0000 7f01e8b1f700 1 -- 172.21.15.63:0/3730068200 shutdown_connections 2023-12-12T11:50:56.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.518+0000 7f01e8b1f700 1 --2- 172.21.15.63:0/3730068200 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e4070570 0x7f01e40709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:56.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.518+0000 7f01e8b1f700 1 --2- 172.21.15.63:0/3730068200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01e4071bc0 0x7f01e4070030 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:56.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.518+0000 7f01e8b1f700 1 -- 172.21.15.63:0/3730068200 >> 172.21.15.63:0/3730068200 conn(0x7f01e40f82d0 msgr2=0x7f01e40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:50:56.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.519+0000 7f01e8b1f700 1 -- 172.21.15.63:0/3730068200 shutdown_connections 2023-12-12T11:50:56.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.519+0000 7f01e8b1f700 1 -- 172.21.15.63:0/3730068200 wait complete. 2023-12-12T11:50:56.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.520+0000 7f01e8b1f700 1 Processor -- start 2023-12-12T11:50:56.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.520+0000 7f01e8b1f700 1 -- start start 2023-12-12T11:50:56.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.521+0000 7f01e8b1f700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e4070570 0x7f01e410f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:56.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.521+0000 7f01e8b1f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01e4071bc0 0x7f01e410fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:56.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.521+0000 7f01e8b1f700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e4110420 con 0x7f01e4071bc0 2023-12-12T11:50:56.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.521+0000 7f01e8b1f700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e4110cc0 con 0x7f01e4070570 2023-12-12T11:50:56.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.521+0000 7f01e259c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e4070570 0x7f01e410f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:56.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.521+0000 7f01e259c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e4070570 0x7f01e410f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:44646/0 (socket says 172.21.15.63:44646) 2023-12-12T11:50:56.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.521+0000 7f01e259c700 1 -- 172.21.15.63:0/54986464 learned_addr learned my addr 172.21.15.63:0/54986464 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:50:56.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.521+0000 7f01e1d9b700 1 --2- 172.21.15.63:0/54986464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01e4071bc0 0x7f01e410fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:56.526 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.522+0000 7f01e259c700 1 -- 172.21.15.63:0/54986464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01e4071bc0 msgr2=0x7f01e410fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:56.526 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.522+0000 7f01e259c700 1 --2- 172.21.15.63:0/54986464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01e4071bc0 0x7f01e410fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:56.526 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.522+0000 7f01e259c700 1 -- 172.21.15.63:0/54986464 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d4005040 con 0x7f01e4070570 2023-12-12T11:50:56.526 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.522+0000 7f01e1d9b700 1 --2- 172.21.15.63:0/54986464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01e4071bc0 0x7f01e410fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T11:50:56.526 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.522+0000 7f01e259c700 1 --2- 172.21.15.63:0/54986464 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e4070570 0x7f01e410f8e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f01d4009fd0 tx=0x7f01d4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:50:56.526 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.522+0000 7f01d2ffd700 1 -- 172.21.15.63:0/54986464 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01d400e040 con 0x7f01e4070570 2023-12-12T11:50:56.526 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.522+0000 7f01d2ffd700 1 -- 172.21.15.63:0/54986464 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f01d4004290 con 0x7f01e4070570 2023-12-12T11:50:56.526 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.522+0000 7f01d2ffd700 1 -- 172.21.15.63:0/54986464 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01d401c3f0 con 0x7f01e4070570 2023-12-12T11:50:56.526 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.522+0000 7f01e8b1f700 1 -- 172.21.15.63:0/54986464 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01e4110f40 con 0x7f01e4070570 2023-12-12T11:50:56.526 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.523+0000 7f01e8b1f700 1 -- 172.21.15.63:0/54986464 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e4111480 con 0x7f01e4070570 2023-12-12T11:50:56.527 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.524+0000 7f01e8b1f700 1 -- 172.21.15.63:0/54986464 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01e41096f0 con 0x7f01e4070570 2023-12-12T11:50:56.527 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.525+0000 7f01d2ffd700 1 -- 172.21.15.63:0/54986464 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f01d400bbf0 con 0x7f01e4070570 2023-12-12T11:50:56.529 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.526+0000 7f01d2ffd700 1 --2- 172.21.15.63:0/54986464 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f01cc068f70 0x7f01cc06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:56.529 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.527+0000 7f01d2ffd700 1 -- 172.21.15.63:0/54986464 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f01d4088120 con 0x7f01e4070570 2023-12-12T11:50:56.529 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.527+0000 7f01e1d9b700 1 --2- 172.21.15.63:0/54986464 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f01cc068f70 0x7f01cc06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:56.529 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.527+0000 7f01e1d9b700 1 --2- 172.21.15.63:0/54986464 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f01cc068f70 0x7f01cc06b420 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f01d8010520 tx=0x7f01d800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:50:56.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.530+0000 7f01d2ffd700 1 -- 172.21.15.63:0/54986464 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f01d4058010 con 0x7f01e4070570 2023-12-12T11:50:56.591 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-12T11:50:56.596 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-12T11:50:56.596 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-12T11:50:56.666 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-12T11:50:56.674 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-12T11:50:56.675 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-12T11:50:56.769 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2023-12-12T11:50:56.770 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-12-12T11:50:56.770 DEBUG:teuthology.orchestra.run.smithi063:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2023-12-12T11:50:56.834 INFO:tasks.workunit.client.0.smithi063.stderr:+ mkdir -p fsstress 2023-12-12T11:50:56.834 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.832+0000 7f01e8b1f700 1 -- 172.21.15.63:0/54986464 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f01e41117b0 con 0x7f01cc068f70 2023-12-12T11:50:56.836 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.834+0000 7f01d2ffd700 1 -- 172.21.15.63:0/54986464 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f01e41117b0 con 0x7f01cc068f70 2023-12-12T11:50:56.836 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:50:56.836 INFO:teuthology.orchestra.run.smithi063.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dbb46fd2dbbe029cfba763f2b7c769e980f86b63e74be0c72e188909e20b81f3", 2023-12-12T11:50:56.836 INFO:teuthology.orchestra.run.smithi063.stdout: "in_progress": true, 2023-12-12T11:50:56.836 INFO:teuthology.orchestra.run.smithi063.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-12T11:50:56.836 INFO:teuthology.orchestra.run.smithi063.stdout: "services_complete": [], 2023-12-12T11:50:56.836 INFO:teuthology.orchestra.run.smithi063.stdout: "progress": "0/21 daemons upgraded", 2023-12-12T11:50:56.837 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:dbb46fd2dbbe029cfba763f2b7c769e980f86b63e74be0c72e188909e20b81f3 image on host smithi093", 2023-12-12T11:50:56.837 INFO:teuthology.orchestra.run.smithi063.stdout: "is_paused": false 2023-12-12T11:50:56.837 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:50:56.839 INFO:tasks.workunit.client.0.smithi063.stderr:+ pushd fsstress 2023-12-12T11:50:56.839 INFO:tasks.workunit.client.0.smithi063.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-12T11:50:56.839 INFO:tasks.workunit.client.0.smithi063.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-12-12T11:50:56.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.837+0000 7f01e8b1f700 1 -- 172.21.15.63:0/54986464 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f01cc068f70 msgr2=0x7f01cc06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:56.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.837+0000 7f01e8b1f700 1 --2- 172.21.15.63:0/54986464 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f01cc068f70 0x7f01cc06b420 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f01d8010520 tx=0x7f01d800b040 comp rx=0 tx=0).stop 2023-12-12T11:50:56.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.837+0000 7f01e8b1f700 1 -- 172.21.15.63:0/54986464 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e4070570 msgr2=0x7f01e410f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:56.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.837+0000 7f01e8b1f700 1 --2- 172.21.15.63:0/54986464 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e4070570 0x7f01e410f8e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f01d4009fd0 tx=0x7f01d4009e30 comp rx=0 tx=0).stop 2023-12-12T11:50:56.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.837+0000 7f01e8b1f700 1 -- 172.21.15.63:0/54986464 shutdown_connections 2023-12-12T11:50:56.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.837+0000 7f01e8b1f700 1 --2- 172.21.15.63:0/54986464 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e4070570 0x7f01e410f8e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:56.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.837+0000 7f01e8b1f700 1 --2- 172.21.15.63:0/54986464 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f01cc068f70 0x7f01cc06b420 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:56.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.837+0000 7f01e8b1f700 1 --2- 172.21.15.63:0/54986464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01e4071bc0 0x7f01e410fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:56.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.837+0000 7f01e8b1f700 1 -- 172.21.15.63:0/54986464 >> 172.21.15.63:0/54986464 conn(0x7f01e40f82d0 msgr2=0x7f01e4103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:50:56.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.837+0000 7f01e8b1f700 1 -- 172.21.15.63:0/54986464 shutdown_connections 2023-12-12T11:50:56.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.837+0000 7f01e8b1f700 1 -- 172.21.15.63:0/54986464 wait complete. 2023-12-12T11:50:56.990 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.988+0000 7ff83d921700 1 -- 172.21.15.63:0/287172286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8380fd730 msgr2=0x7ff8380ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:56.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.988+0000 7ff83d921700 1 --2- 172.21.15.63:0/287172286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8380fd730 0x7ff8380ffb10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff828004940 tx=0x7ff828009e30 comp rx=0 tx=0).stop 2023-12-12T11:50:56.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.988+0000 7ff83d921700 1 -- 172.21.15.63:0/287172286 shutdown_connections 2023-12-12T11:50:56.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.988+0000 7ff83d921700 1 --2- 172.21.15.63:0/287172286 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff838100050 0x7ff838102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:56.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.988+0000 7ff83d921700 1 --2- 172.21.15.63:0/287172286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8380fd730 0x7ff8380ffb10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:56.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.988+0000 7ff83d921700 1 -- 172.21.15.63:0/287172286 >> 172.21.15.63:0/287172286 conn(0x7ff8380f7190 msgr2=0x7ff8380f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:50:56.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.988+0000 7ff83d921700 1 -- 172.21.15.63:0/287172286 shutdown_connections 2023-12-12T11:50:56.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.988+0000 7ff83d921700 1 -- 172.21.15.63:0/287172286 wait complete. 2023-12-12T11:50:56.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.989+0000 7ff83d921700 1 Processor -- start 2023-12-12T11:50:56.992 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.990+0000 7ff83d921700 1 -- start start 2023-12-12T11:50:56.992 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.990+0000 7ff83d921700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8380fd730 0x7ff83810d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:56.992 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.990+0000 7ff83d921700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff838100050 0x7ff83810d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:56.992 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.990+0000 7ff83d921700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83810dfd0 con 0x7ff8380fd730 2023-12-12T11:50:56.993 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.990+0000 7ff83d921700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83810e870 con 0x7ff838100050 2023-12-12T11:50:56.993 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.991+0000 7ff836ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8380fd730 0x7ff83810d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:56.993 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.991+0000 7ff836ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8380fd730 0x7ff83810d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48376/0 (socket says 172.21.15.63:48376) 2023-12-12T11:50:56.993 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.991+0000 7ff836ffd700 1 -- 172.21.15.63:0/2003406625 learned_addr learned my addr 172.21.15.63:0/2003406625 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:50:56.993 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.991+0000 7ff8367fc700 1 --2- 172.21.15.63:0/2003406625 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff838100050 0x7ff83810d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:56.994 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.991+0000 7ff836ffd700 1 -- 172.21.15.63:0/2003406625 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff838100050 msgr2=0x7ff83810d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:56.994 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.991+0000 7ff836ffd700 1 --2- 172.21.15.63:0/2003406625 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff838100050 0x7ff83810d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:56.994 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.991+0000 7ff836ffd700 1 -- 172.21.15.63:0/2003406625 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff828005040 con 0x7ff8380fd730 2023-12-12T11:50:56.994 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.992+0000 7ff836ffd700 1 --2- 172.21.15.63:0/2003406625 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8380fd730 0x7ff83810d490 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff828009fd0 tx=0x7ff828009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:50:56.994 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.992+0000 7ff81f7fe700 1 -- 172.21.15.63:0/2003406625 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff828021070 con 0x7ff8380fd730 2023-12-12T11:50:56.994 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.992+0000 7ff81f7fe700 1 -- 172.21.15.63:0/2003406625 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff82801c400 con 0x7ff8380fd730 2023-12-12T11:50:56.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.992+0000 7ff81f7fe700 1 -- 172.21.15.63:0/2003406625 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff82800e070 con 0x7ff8380fd730 2023-12-12T11:50:56.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.992+0000 7ff83d921700 1 -- 172.21.15.63:0/2003406625 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83810eaf0 con 0x7ff8380fd730 2023-12-12T11:50:56.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.992+0000 7ff83d921700 1 -- 172.21.15.63:0/2003406625 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83810f030 con 0x7ff8380fd730 2023-12-12T11:50:56.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.994+0000 7ff83d921700 1 -- 172.21.15.63:0/2003406625 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff83804bb80 con 0x7ff8380fd730 2023-12-12T11:50:56.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.995+0000 7ff81f7fe700 1 -- 172.21.15.63:0/2003406625 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff82801c570 con 0x7ff8380fd730 2023-12-12T11:50:57.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.996+0000 7ff81f7fe700 1 --2- 172.21.15.63:0/2003406625 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff820068f70 0x7ff82006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:50:57.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.996+0000 7ff81f7fe700 1 -- 172.21.15.63:0/2003406625 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff828087f50 con 0x7ff8380fd730 2023-12-12T11:50:57.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.997+0000 7ff8367fc700 1 --2- 172.21.15.63:0/2003406625 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff820068f70 0x7ff82006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:50:57.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:56.998+0000 7ff8367fc700 1 --2- 172.21.15.63:0/2003406625 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff820068f70 0x7ff82006b420 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff82c009b80 tx=0x7ff82c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:50:57.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:57.002+0000 7ff81f7fe700 1 -- 172.21.15.63:0/2003406625 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff8280b9a00 con 0x7ff8380fd730 2023-12-12T11:50:57.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:56 smithi093 ceph-mon[115914]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:50:57.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:56 smithi093 ceph-mon[115914]: pgmap v209: 65 pgs: 65 active+clean; 33 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.8 MiB/s wr, 227 op/s 2023-12-12T11:50:57.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:56 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/277671631' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:50:57.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:56 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/3232174502' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:50:57.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:56 smithi063 ceph-mon[107117]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:50:57.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:56 smithi063 ceph-mon[107117]: pgmap v209: 65 pgs: 65 active+clean; 33 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.8 MiB/s wr, 227 op/s 2023-12-12T11:50:57.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:56 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/277671631' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:50:57.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:56 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/3232174502' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:50:57.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:57.331+0000 7ff83d921700 1 -- 172.21.15.63:0/2003406625 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff838105580 con 0x7ff8380fd730 2023-12-12T11:50:57.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:57.331+0000 7ff81f7fe700 1 -- 172.21.15.63:0/2003406625 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7ff828057f00 con 0x7ff8380fd730 2023-12-12T11:50:57.334 INFO:teuthology.orchestra.run.smithi063.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-12T11:50:57.334 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-12T11:50:57.334 INFO:teuthology.orchestra.run.smithi063.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-12T11:50:57.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:57.334+0000 7ff83d921700 1 -- 172.21.15.63:0/2003406625 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff820068f70 msgr2=0x7ff82006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:57.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:57.334+0000 7ff83d921700 1 --2- 172.21.15.63:0/2003406625 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff820068f70 0x7ff82006b420 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff82c009b80 tx=0x7ff82c00b040 comp rx=0 tx=0).stop 2023-12-12T11:50:57.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:57.334+0000 7ff83d921700 1 -- 172.21.15.63:0/2003406625 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8380fd730 msgr2=0x7ff83810d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:50:57.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:57.334+0000 7ff83d921700 1 --2- 172.21.15.63:0/2003406625 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8380fd730 0x7ff83810d490 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff828009fd0 tx=0x7ff828009e30 comp rx=0 tx=0).stop 2023-12-12T11:50:57.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:57.334+0000 7ff83d921700 1 -- 172.21.15.63:0/2003406625 shutdown_connections 2023-12-12T11:50:57.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:57.334+0000 7ff83d921700 1 --2- 172.21.15.63:0/2003406625 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff820068f70 0x7ff82006b420 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:57.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:57.334+0000 7ff83d921700 1 --2- 172.21.15.63:0/2003406625 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8380fd730 0x7ff83810d490 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:57.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:57.334+0000 7ff83d921700 1 --2- 172.21.15.63:0/2003406625 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff838100050 0x7ff83810d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:50:57.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:57.334+0000 7ff83d921700 1 -- 172.21.15.63:0/2003406625 >> 172.21.15.63:0/2003406625 conn(0x7ff8380f7190 msgr2=0x7ff8380f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:50:57.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:57.334+0000 7ff83d921700 1 -- 172.21.15.63:0/2003406625 shutdown_connections 2023-12-12T11:50:57.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:50:57.334+0000 7ff83d921700 1 -- 172.21.15.63:0/2003406625 wait complete. 2023-12-12T11:50:57.879 INFO:tasks.workunit.client.0.smithi063.stderr:+ tar xzf ltp-full.tgz 2023-12-12T11:50:58.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:57 smithi093 ceph-mon[115914]: from='client.24463 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:50:58.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:57 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/2003406625' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:50:58.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:57 smithi063 ceph-mon[107117]: from='client.24463 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:50:58.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:57 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/2003406625' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:50:59.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:50:58 smithi093 ceph-mon[115914]: pgmap v210: 65 pgs: 65 active+clean; 42 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.6 MiB/s wr, 246 op/s 2023-12-12T11:50:59.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:50:58 smithi063 ceph-mon[107117]: pgmap v210: 65 pgs: 65 active+clean; 42 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.6 MiB/s wr, 246 op/s 2023-12-12T11:51:01.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:00 smithi093 ceph-mon[115914]: pgmap v211: 65 pgs: 65 active+clean; 48 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 4.1 MiB/s wr, 252 op/s 2023-12-12T11:51:01.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:00 smithi063 ceph-mon[107117]: pgmap v211: 65 pgs: 65 active+clean; 48 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 4.1 MiB/s wr, 252 op/s 2023-12-12T11:51:02.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:02 smithi093 ceph-mon[115914]: pgmap v212: 65 pgs: 65 active+clean; 48 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.7 MiB/s wr, 251 op/s 2023-12-12T11:51:03.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:02 smithi063 ceph-mon[107117]: pgmap v212: 65 pgs: 65 active+clean; 48 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.7 MiB/s wr, 251 op/s 2023-12-12T11:51:05.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:04 smithi093 ceph-mon[115914]: pgmap v213: 65 pgs: 65 active+clean; 61 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 4.7 MiB/s wr, 261 op/s 2023-12-12T11:51:05.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:04 smithi063 ceph-mon[107117]: pgmap v213: 65 pgs: 65 active+clean; 61 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 4.7 MiB/s wr, 261 op/s 2023-12-12T11:51:06.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:05 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:51:06.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:05 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:51:07.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:06 smithi093 ceph-mon[115914]: pgmap v214: 65 pgs: 65 active+clean; 71 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s wr, 156 op/s 2023-12-12T11:51:07.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:06 smithi063 ceph-mon[107117]: pgmap v214: 65 pgs: 65 active+clean; 71 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s wr, 156 op/s 2023-12-12T11:51:09.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:08 smithi093 ceph-mon[115914]: pgmap v215: 65 pgs: 65 active+clean; 80 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.1 MiB/s wr, 146 op/s 2023-12-12T11:51:09.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:08 smithi063 ceph-mon[107117]: pgmap v215: 65 pgs: 65 active+clean; 80 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.1 MiB/s wr, 146 op/s 2023-12-12T11:51:11.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:10 smithi093 ceph-mon[115914]: pgmap v216: 65 pgs: 65 active+clean; 89 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.1 MiB/s wr, 135 op/s 2023-12-12T11:51:11.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:10 smithi063 ceph-mon[107117]: pgmap v216: 65 pgs: 65 active+clean; 89 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.1 MiB/s wr, 135 op/s 2023-12-12T11:51:12.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:12 smithi093 ceph-mon[115914]: pgmap v217: 65 pgs: 65 active+clean; 93 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s wr, 137 op/s 2023-12-12T11:51:13.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:12 smithi063 ceph-mon[107117]: pgmap v217: 65 pgs: 65 active+clean; 93 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s wr, 137 op/s 2023-12-12T11:51:15.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:14 smithi093 ceph-mon[115914]: pgmap v218: 65 pgs: 65 active+clean; 111 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 5.5 MiB/s wr, 311 op/s 2023-12-12T11:51:15.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:14 smithi063 ceph-mon[107117]: pgmap v218: 65 pgs: 65 active+clean; 111 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 5.5 MiB/s wr, 311 op/s 2023-12-12T11:51:16.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:16 smithi093 ceph-mon[115914]: Upgrade: Updating mgr.smithi093.nbtltu 2023-12-12T11:51:16.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:16 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:51:16.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:16 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi093.nbtltu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-12T11:51:16.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:16 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-12T11:51:16.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:16 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:51:16.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:16 smithi093 ceph-mon[115914]: Deploying daemon mgr.smithi093.nbtltu on smithi093 2023-12-12T11:51:16.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:16 smithi093 ceph-mon[115914]: pgmap v219: 65 pgs: 65 active+clean; 122 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 5.3 MiB/s wr, 397 op/s 2023-12-12T11:51:17.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:16 smithi063 ceph-mon[107117]: Upgrade: Updating mgr.smithi093.nbtltu 2023-12-12T11:51:17.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:16 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:51:17.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:16 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi093.nbtltu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-12T11:51:17.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:16 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-12T11:51:17.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:16 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:51:17.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:16 smithi063 ceph-mon[107117]: Deploying daemon mgr.smithi093.nbtltu on smithi093 2023-12-12T11:51:17.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:16 smithi063 ceph-mon[107117]: pgmap v219: 65 pgs: 65 active+clean; 122 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 5.3 MiB/s wr, 397 op/s 2023-12-12T11:51:19.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:18 smithi093 ceph-mon[115914]: pgmap v220: 65 pgs: 65 active+clean; 135 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 5.7 MiB/s wr, 539 op/s 2023-12-12T11:51:19.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:18 smithi063 ceph-mon[107117]: pgmap v220: 65 pgs: 65 active+clean; 135 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 5.7 MiB/s wr, 539 op/s 2023-12-12T11:51:20.483 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:20 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:51:20.483 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:20 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:51:20.483 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:20 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:51:20.483 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:20 smithi093 ceph-mon[115914]: pgmap v221: 65 pgs: 65 active+clean; 157 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 6.8 MiB/s wr, 728 op/s 2023-12-12T11:51:20.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:20 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:51:20.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:20 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:51:20.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:20 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:51:20.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:20 smithi063 ceph-mon[107117]: pgmap v221: 65 pgs: 65 active+clean; 157 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 6.8 MiB/s wr, 728 op/s 2023-12-12T11:51:21.657 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:21 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:51:21.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:21 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:51:22.966 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:22 smithi093 ceph-mon[115914]: pgmap v222: 65 pgs: 65 active+clean; 161 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 6.4 MiB/s wr, 795 op/s 2023-12-12T11:51:22.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:22 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:51:22.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:22 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:51:23.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:22 smithi063 ceph-mon[107117]: pgmap v222: 65 pgs: 65 active+clean; 161 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 6.4 MiB/s wr, 795 op/s 2023-12-12T11:51:23.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:22 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:51:23.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:22 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:51:24.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:24 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:51:24.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:24 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:51:24.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:24 smithi093 ceph-mon[115914]: pgmap v223: 65 pgs: 65 active+clean; 190 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 8.6 MiB/s wr, 936 op/s 2023-12-12T11:51:25.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:24 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:51:25.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:24 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:51:25.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:24 smithi063 ceph-mon[107117]: pgmap v223: 65 pgs: 65 active+clean; 190 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 8.6 MiB/s wr, 936 op/s 2023-12-12T11:51:25.098 INFO:tasks.workunit.client.1.smithi093.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-12-12T11:51:25.112 INFO:tasks.workunit.client.1.smithi093.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-12T11:51:25.112 INFO:tasks.workunit.client.1.smithi093.stderr:+ make 2023-12-12T11:51:25.429 INFO:tasks.workunit.client.1.smithi093.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-12-12T11:51:25.803 INFO:tasks.workunit.client.1.smithi093.stderr:++ readlink -f fsstress 2023-12-12T11:51:25.805 INFO:tasks.workunit.client.1.smithi093.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-12-12T11:51:25.805 INFO:tasks.workunit.client.1.smithi093.stderr:+ popd 2023-12-12T11:51:25.805 INFO:tasks.workunit.client.1.smithi093.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-12T11:51:25.806 INFO:tasks.workunit.client.1.smithi093.stderr:+ popd 2023-12-12T11:51:25.806 INFO:tasks.workunit.client.1.smithi093.stdout:~/cephtest/mnt.1/client.1/tmp 2023-12-12T11:51:25.806 INFO:tasks.workunit.client.1.smithi093.stderr:++ mktemp -d -p . 2023-12-12T11:51:25.809 INFO:tasks.workunit.client.1.smithi093.stderr:+ T=./tmp.F0BQwUqlR3 2023-12-12T11:51:25.809 INFO:tasks.workunit.client.1.smithi093.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.F0BQwUqlR3 -l 1 -n 1000 -p 10 -v 2023-12-12T11:51:25.812 INFO:tasks.workunit.client.1.smithi093.stdout:seed = 1702111336 2023-12-12T11:51:25.816 INFO:tasks.workunit.client.1.smithi093.stdout:0/0: rmdir - no directory 2023-12-12T11:51:25.816 INFO:tasks.workunit.client.1.smithi093.stdout:0/1: stat - no entries 2023-12-12T11:51:25.816 INFO:tasks.workunit.client.1.smithi093.stdout:0/2: write - no filename 2023-12-12T11:51:25.816 INFO:tasks.workunit.client.1.smithi093.stdout:0/3: unlink - no file 2023-12-12T11:51:25.817 INFO:tasks.workunit.client.1.smithi093.stdout:5/0: write - no filename 2023-12-12T11:51:25.818 INFO:tasks.workunit.client.1.smithi093.stdout:0/4: mknod c0 0 2023-12-12T11:51:25.819 INFO:tasks.workunit.client.1.smithi093.stdout:1/0: chown . 7320486 1 2023-12-12T11:51:25.819 INFO:tasks.workunit.client.1.smithi093.stdout:1/1: rmdir - no directory 2023-12-12T11:51:25.819 INFO:tasks.workunit.client.1.smithi093.stdout:1/2: truncate - no filename 2023-12-12T11:51:25.819 INFO:tasks.workunit.client.1.smithi093.stdout:1/3: write - no filename 2023-12-12T11:51:25.819 INFO:tasks.workunit.client.1.smithi093.stdout:1/4: truncate - no filename 2023-12-12T11:51:25.819 INFO:tasks.workunit.client.1.smithi093.stdout:1/5: dwrite - no filename 2023-12-12T11:51:25.820 INFO:tasks.workunit.client.1.smithi093.stdout:1/6: read - no filename 2023-12-12T11:51:25.820 INFO:tasks.workunit.client.1.smithi093.stdout:1/7: link - no file 2023-12-12T11:51:25.820 INFO:tasks.workunit.client.1.smithi093.stdout:1/8: stat - no entries 2023-12-12T11:51:25.820 INFO:tasks.workunit.client.1.smithi093.stdout:1/9: rmdir - no directory 2023-12-12T11:51:25.820 INFO:tasks.workunit.client.1.smithi093.stdout:1/10: dread - no filename 2023-12-12T11:51:25.820 INFO:tasks.workunit.client.1.smithi093.stdout:1/11: fdatasync - no filename 2023-12-12T11:51:25.820 INFO:tasks.workunit.client.1.smithi093.stdout:1/12: dwrite - no filename 2023-12-12T11:51:25.820 INFO:tasks.workunit.client.1.smithi093.stdout:1/13: write - no filename 2023-12-12T11:51:25.820 INFO:tasks.workunit.client.1.smithi093.stdout:1/14: fdatasync - no filename 2023-12-12T11:51:25.820 INFO:tasks.workunit.client.1.smithi093.stdout:1/15: fsync - no filename 2023-12-12T11:51:25.820 INFO:tasks.workunit.client.1.smithi093.stdout:1/16: stat - no entries 2023-12-12T11:51:25.820 INFO:tasks.workunit.client.1.smithi093.stdout:1/17: link - no file 2023-12-12T11:51:25.820 INFO:tasks.workunit.client.1.smithi093.stdout:1/18: chown . 1251 1 2023-12-12T11:51:25.820 INFO:tasks.workunit.client.1.smithi093.stdout:1/19: truncate - no filename 2023-12-12T11:51:25.820 INFO:tasks.workunit.client.1.smithi093.stdout:1/20: dwrite - no filename 2023-12-12T11:51:25.820 INFO:tasks.workunit.client.1.smithi093.stdout:1/21: truncate - no filename 2023-12-12T11:51:25.821 INFO:tasks.workunit.client.1.smithi093.stdout:1/22: dwrite - no filename 2023-12-12T11:51:25.821 INFO:tasks.workunit.client.1.smithi093.stdout:5/1: mkdir d0 0 2023-12-12T11:51:25.821 INFO:tasks.workunit.client.1.smithi093.stdout:5/2: fsync - no filename 2023-12-12T11:51:25.821 INFO:tasks.workunit.client.1.smithi093.stdout:5/3: dread - no filename 2023-12-12T11:51:25.821 INFO:tasks.workunit.client.1.smithi093.stdout:0/5: symlink l1 0 2023-12-12T11:51:25.821 INFO:tasks.workunit.client.1.smithi093.stdout:0/6: stat l1 0 2023-12-12T11:51:25.822 INFO:tasks.workunit.client.1.smithi093.stdout:0/7: chown c0 5 1 2023-12-12T11:51:25.822 INFO:tasks.workunit.client.1.smithi093.stdout:0/8: fdatasync - no filename 2023-12-12T11:51:25.823 INFO:tasks.workunit.client.1.smithi093.stdout:1/23: symlink l0 0 2023-12-12T11:51:25.823 INFO:tasks.workunit.client.1.smithi093.stdout:1/24: stat l0 0 2023-12-12T11:51:25.824 INFO:tasks.workunit.client.1.smithi093.stdout:5/4: creat d0/f1 x:0 0 0 2023-12-12T11:51:25.824 INFO:tasks.workunit.client.1.smithi093.stdout:5/5: dread - d0/f1 zero size 2023-12-12T11:51:25.824 INFO:tasks.workunit.client.1.smithi093.stdout:5/6: read - d0/f1 zero size 2023-12-12T11:51:25.842 INFO:tasks.workunit.client.1.smithi093.stdout:2/0: creat f0 x:0 0 0 2023-12-12T11:51:25.842 INFO:tasks.workunit.client.1.smithi093.stdout:0/9: unlink l1 0 2023-12-12T11:51:25.843 INFO:tasks.workunit.client.1.smithi093.stdout:1/25: creat f1 x:0 0 0 2023-12-12T11:51:25.847 INFO:tasks.workunit.client.1.smithi093.stdout:0/10: rename c0 to c2 0 2023-12-12T11:51:25.851 INFO:tasks.workunit.client.1.smithi093.stdout:1/26: symlink l2 0 2023-12-12T11:51:25.853 INFO:tasks.workunit.client.1.smithi093.stdout:0/11: symlink l3 0 2023-12-12T11:51:25.854 INFO:tasks.workunit.client.1.smithi093.stdout:1/27: mknod c3 0 2023-12-12T11:51:25.859 INFO:tasks.workunit.client.1.smithi093.stdout:0/12: unlink l3 0 2023-12-12T11:51:25.865 INFO:tasks.workunit.client.1.smithi093.stdout:0/13: mknod c4 0 2023-12-12T11:51:25.876 INFO:tasks.workunit.client.1.smithi093.stdout:0/14: mkdir d5 0 2023-12-12T11:51:25.882 INFO:tasks.workunit.client.1.smithi093.stdout:0/15: creat d5/f6 x:0 0 0 2023-12-12T11:51:25.888 INFO:tasks.workunit.client.1.smithi093.stdout:0/16: rename d5/f6 to d5/f7 0 2023-12-12T11:51:25.893 INFO:tasks.workunit.client.1.smithi093.stdout:0/17: link c4 d5/c8 0 2023-12-12T11:51:25.893 INFO:tasks.workunit.client.1.smithi093.stdout:0/18: dread - d5/f7 zero size 2023-12-12T11:51:25.893 INFO:tasks.workunit.client.1.smithi093.stdout:0/19: dread - d5/f7 zero size 2023-12-12T11:51:25.912 INFO:tasks.workunit.client.1.smithi093.stdout:3/0: write - no filename 2023-12-12T11:51:25.913 INFO:tasks.workunit.client.1.smithi093.stdout:4/0: dwrite - no filename 2023-12-12T11:51:25.913 INFO:tasks.workunit.client.1.smithi093.stdout:8/0: dread - no filename 2023-12-12T11:51:25.913 INFO:tasks.workunit.client.1.smithi093.stdout:8/1: link - no file 2023-12-12T11:51:25.913 INFO:tasks.workunit.client.1.smithi093.stdout:4/1: write - no filename 2023-12-12T11:51:25.913 INFO:tasks.workunit.client.1.smithi093.stdout:4/2: write - no filename 2023-12-12T11:51:25.913 INFO:tasks.workunit.client.1.smithi093.stdout:4/3: dwrite - no filename 2023-12-12T11:51:25.913 INFO:tasks.workunit.client.1.smithi093.stdout:8/2: rmdir - no directory 2023-12-12T11:51:25.913 INFO:tasks.workunit.client.1.smithi093.stdout:8/3: fdatasync - no filename 2023-12-12T11:51:25.913 INFO:tasks.workunit.client.1.smithi093.stdout:8/4: rename - no filename 2023-12-12T11:51:25.913 INFO:tasks.workunit.client.1.smithi093.stdout:8/5: write - no filename 2023-12-12T11:51:25.913 INFO:tasks.workunit.client.1.smithi093.stdout:4/4: chown . 1397 1 2023-12-12T11:51:25.914 INFO:tasks.workunit.client.1.smithi093.stdout:4/5: stat - no entries 2023-12-12T11:51:25.914 INFO:tasks.workunit.client.1.smithi093.stdout:4/6: fsync - no filename 2023-12-12T11:51:25.914 INFO:tasks.workunit.client.1.smithi093.stdout:4/7: rename - no filename 2023-12-12T11:51:25.914 INFO:tasks.workunit.client.1.smithi093.stdout:4/8: chown . 413 1 2023-12-12T11:51:25.914 INFO:tasks.workunit.client.1.smithi093.stdout:4/9: chown . 22 1 2023-12-12T11:51:25.914 INFO:tasks.workunit.client.1.smithi093.stdout:7/0: dwrite - no filename 2023-12-12T11:51:25.914 INFO:tasks.workunit.client.1.smithi093.stdout:4/10: chown . 666644 1 2023-12-12T11:51:25.914 INFO:tasks.workunit.client.1.smithi093.stdout:4/11: dwrite - no filename 2023-12-12T11:51:25.914 INFO:tasks.workunit.client.1.smithi093.stdout:4/12: stat - no entries 2023-12-12T11:51:25.914 INFO:tasks.workunit.client.1.smithi093.stdout:4/13: truncate - no filename 2023-12-12T11:51:25.914 INFO:tasks.workunit.client.1.smithi093.stdout:4/14: dwrite - no filename 2023-12-12T11:51:25.914 INFO:tasks.workunit.client.1.smithi093.stdout:7/1: unlink - no file 2023-12-12T11:51:25.914 INFO:tasks.workunit.client.1.smithi093.stdout:4/15: truncate - no filename 2023-12-12T11:51:25.914 INFO:tasks.workunit.client.1.smithi093.stdout:7/2: dwrite - no filename 2023-12-12T11:51:25.914 INFO:tasks.workunit.client.1.smithi093.stdout:9/0: dwrite - no filename 2023-12-12T11:51:25.915 INFO:tasks.workunit.client.1.smithi093.stdout:9/1: chown . 612102633 1 2023-12-12T11:51:25.915 INFO:tasks.workunit.client.1.smithi093.stdout:9/2: dwrite - no filename 2023-12-12T11:51:25.915 INFO:tasks.workunit.client.1.smithi093.stdout:9/3: chown . 1407 1 2023-12-12T11:51:25.915 INFO:tasks.workunit.client.1.smithi093.stdout:9/4: stat - no entries 2023-12-12T11:51:25.915 INFO:tasks.workunit.client.1.smithi093.stdout:6/0: dread - no filename 2023-12-12T11:51:25.917 INFO:tasks.workunit.client.1.smithi093.stdout:2/1: symlink l1 0 2023-12-12T11:51:25.919 INFO:tasks.workunit.client.1.smithi093.stdout:2/2: write f0 [961004,73116] 0 2023-12-12T11:51:25.921 INFO:tasks.workunit.client.1.smithi093.stdout:3/1: mkdir d0 0 2023-12-12T11:51:25.921 INFO:tasks.workunit.client.1.smithi093.stdout:3/2: fdatasync - no filename 2023-12-12T11:51:25.922 INFO:tasks.workunit.client.1.smithi093.stdout:8/6: creat f0 x:0 0 0 2023-12-12T11:51:25.922 INFO:tasks.workunit.client.1.smithi093.stdout:8/7: creat f1 x:0 0 0 2023-12-12T11:51:25.922 INFO:tasks.workunit.client.1.smithi093.stdout:8/8: chown f0 3269 1 2023-12-12T11:51:25.924 INFO:tasks.workunit.client.1.smithi093.stdout:4/16: mkdir d0 0 2023-12-12T11:51:25.924 INFO:tasks.workunit.client.1.smithi093.stdout:4/17: readlink - no filename 2023-12-12T11:51:25.928 INFO:tasks.workunit.client.1.smithi093.stdout:9/5: mknod c0 0 2023-12-12T11:51:25.928 INFO:tasks.workunit.client.1.smithi093.stdout:7/3: creat f0 x:0 0 0 2023-12-12T11:51:25.928 INFO:tasks.workunit.client.1.smithi093.stdout:7/4: creat f1 x:0 0 0 2023-12-12T11:51:25.928 INFO:tasks.workunit.client.1.smithi093.stdout:7/5: chown f0 1 1 2023-12-12T11:51:25.928 INFO:tasks.workunit.client.1.smithi093.stdout:7/6: fdatasync f0 0 2023-12-12T11:51:25.930 INFO:tasks.workunit.client.1.smithi093.stdout:6/1: mkdir d0 0 2023-12-12T11:51:25.931 INFO:tasks.workunit.client.1.smithi093.stdout:6/2: fsync - no filename 2023-12-12T11:51:25.931 INFO:tasks.workunit.client.1.smithi093.stdout:6/3: chown d0 201 1 2023-12-12T11:51:25.933 INFO:tasks.workunit.client.1.smithi093.stdout:3/3: rmdir d0 0 2023-12-12T11:51:25.933 INFO:tasks.workunit.client.1.smithi093.stdout:3/4: dwrite - no filename 2023-12-12T11:51:25.934 INFO:tasks.workunit.client.1.smithi093.stdout:2/3: dread f0 [0,4194304] 0 2023-12-12T11:51:25.937 INFO:tasks.workunit.client.1.smithi093.stdout:8/9: symlink l2 0 2023-12-12T11:51:25.939 INFO:tasks.workunit.client.1.smithi093.stdout:4/18: creat d0/f1 x:0 0 0 2023-12-12T11:51:25.939 INFO:tasks.workunit.client.1.smithi093.stdout:4/19: creat d0/f2 x:0 0 0 2023-12-12T11:51:25.942 INFO:tasks.workunit.client.1.smithi093.stdout:0/20: dwrite d5/f7 [0,4194304] 0 2023-12-12T11:51:25.942 INFO:tasks.workunit.client.1.smithi093.stdout:9/6: mkdir d1 0 2023-12-12T11:51:25.944 INFO:tasks.workunit.client.1.smithi093.stdout:7/7: symlink l2 0 2023-12-12T11:51:25.944 INFO:tasks.workunit.client.1.smithi093.stdout:7/8: read - f0 zero size 2023-12-12T11:51:25.944 INFO:tasks.workunit.client.1.smithi093.stdout:7/9: chown f1 17902145 1 2023-12-12T11:51:25.945 INFO:tasks.workunit.client.1.smithi093.stdout:6/4: symlink d0/l1 0 2023-12-12T11:51:25.947 INFO:tasks.workunit.client.1.smithi093.stdout:3/5: mknod c1 0 2023-12-12T11:51:25.947 INFO:tasks.workunit.client.1.smithi093.stdout:3/6: rmdir - no directory 2023-12-12T11:51:25.947 INFO:tasks.workunit.client.1.smithi093.stdout:3/7: dwrite - no filename 2023-12-12T11:51:25.947 INFO:tasks.workunit.client.1.smithi093.stdout:3/8: truncate - no filename 2023-12-12T11:51:25.949 INFO:tasks.workunit.client.1.smithi093.stdout:2/4: unlink f0 0 2023-12-12T11:51:25.952 INFO:tasks.workunit.client.1.smithi093.stdout:8/10: mkdir d3 0 2023-12-12T11:51:25.952 INFO:tasks.workunit.client.1.smithi093.stdout:8/11: fdatasync f0 0 2023-12-12T11:51:25.961 INFO:tasks.workunit.client.1.smithi093.stdout:0/21: mknod d5/c9 0 2023-12-12T11:51:25.963 INFO:tasks.workunit.client.1.smithi093.stdout:9/7: mknod d1/c2 0 2023-12-12T11:51:25.965 INFO:tasks.workunit.client.1.smithi093.stdout:7/10: mknod c3 0 2023-12-12T11:51:25.965 INFO:tasks.workunit.client.1.smithi093.stdout:7/11: write f1 [819466,62818] 0 2023-12-12T11:51:25.966 INFO:tasks.workunit.client.1.smithi093.stdout:7/12: truncate f1 1715612 0 2023-12-12T11:51:25.967 INFO:tasks.workunit.client.1.smithi093.stdout:6/5: mknod d0/c2 0 2023-12-12T11:51:25.967 INFO:tasks.workunit.client.1.smithi093.stdout:6/6: fdatasync - no filename 2023-12-12T11:51:25.967 INFO:tasks.workunit.client.1.smithi093.stdout:6/7: write - no filename 2023-12-12T11:51:25.967 INFO:tasks.workunit.client.1.smithi093.stdout:6/8: write - no filename 2023-12-12T11:51:25.969 INFO:tasks.workunit.client.1.smithi093.stdout:3/9: link c1 c2 0 2023-12-12T11:51:25.969 INFO:tasks.workunit.client.1.smithi093.stdout:3/10: dread - no filename 2023-12-12T11:51:25.971 INFO:tasks.workunit.client.1.smithi093.stdout:2/5: rename l1 to l2 0 2023-12-12T11:51:25.971 INFO:tasks.workunit.client.1.smithi093.stdout:2/6: chown l2 2564512 1 2023-12-12T11:51:25.971 INFO:tasks.workunit.client.1.smithi093.stdout:2/7: chown l2 894 1 2023-12-12T11:51:25.971 INFO:tasks.workunit.client.1.smithi093.stdout:2/8: truncate - no filename 2023-12-12T11:51:25.971 INFO:tasks.workunit.client.1.smithi093.stdout:2/9: write - no filename 2023-12-12T11:51:25.974 INFO:tasks.workunit.client.1.smithi093.stdout:8/12: rename l2 to d3/l4 0 2023-12-12T11:51:25.977 INFO:tasks.workunit.client.1.smithi093.stdout:9/8: creat d1/f3 x:0 0 0 2023-12-12T11:51:25.977 INFO:tasks.workunit.client.1.smithi093.stdout:9/9: dread - d1/f3 zero size 2023-12-12T11:51:25.978 INFO:tasks.workunit.client.1.smithi093.stdout:7/13: symlink l4 0 2023-12-12T11:51:25.978 INFO:tasks.workunit.client.1.smithi093.stdout:7/14: write f0 [228195,39682] 0 2023-12-12T11:51:25.981 INFO:tasks.workunit.client.1.smithi093.stdout:6/9: mknod d0/c3 0 2023-12-12T11:51:25.982 INFO:tasks.workunit.client.1.smithi093.stdout:2/10: stat l2 0 2023-12-12T11:51:25.983 INFO:tasks.workunit.client.1.smithi093.stdout:0/22: dread d5/f7 [0,4194304] 0 2023-12-12T11:51:25.983 INFO:tasks.workunit.client.1.smithi093.stdout:0/23: creat d5/fa x:0 0 0 2023-12-12T11:51:25.986 INFO:tasks.workunit.client.1.smithi093.stdout:8/13: mknod d3/c5 0 2023-12-12T11:51:25.986 INFO:tasks.workunit.client.1.smithi093.stdout:8/14: truncate f1 62005 0 2023-12-12T11:51:25.990 INFO:tasks.workunit.client.1.smithi093.stdout:9/10: mknod d1/c4 0 2023-12-12T11:51:25.991 INFO:tasks.workunit.client.1.smithi093.stdout:6/10: symlink d0/l4 0 2023-12-12T11:51:25.992 INFO:tasks.workunit.client.1.smithi093.stdout:0/24: mknod d5/cb 0 2023-12-12T11:51:25.993 INFO:tasks.workunit.client.1.smithi093.stdout:8/15: rmdir d3 39 2023-12-12T11:51:25.994 INFO:tasks.workunit.client.1.smithi093.stdout:6/11: link d0/c2 d0/c5 0 2023-12-12T11:51:25.998 INFO:tasks.workunit.client.1.smithi093.stdout:6/12: rename d0/l4 to d0/l6 0 2023-12-12T11:51:26.001 INFO:tasks.workunit.client.1.smithi093.stdout:6/13: unlink d0/c5 0 2023-12-12T11:51:26.001 INFO:tasks.workunit.client.1.smithi093.stdout:6/14: dread - no filename 2023-12-12T11:51:26.003 INFO:tasks.workunit.client.1.smithi093.stdout:6/15: link d0/l1 d0/l7 0 2023-12-12T11:51:26.004 INFO:tasks.workunit.client.1.smithi093.stdout:6/16: mkdir d0/d8 0 2023-12-12T11:51:26.005 INFO:tasks.workunit.client.1.smithi093.stdout:6/17: fdatasync - no filename 2023-12-12T11:51:26.007 INFO:tasks.workunit.client.1.smithi093.stdout:6/18: symlink d0/d8/l9 0 2023-12-12T11:51:26.010 INFO:tasks.workunit.client.1.smithi093.stdout:6/19: unlink d0/l1 0 2023-12-12T11:51:26.024 INFO:tasks.workunit.client.1.smithi093.stdout:7/15: dwrite f0 [0,4194304] 0 2023-12-12T11:51:26.027 INFO:tasks.workunit.client.1.smithi093.stdout:7/16: symlink l5 0 2023-12-12T11:51:26.030 INFO:tasks.workunit.client.1.smithi093.stdout:7/17: mknod c6 0 2023-12-12T11:51:26.070 INFO:tasks.workunit.client.1.smithi093.stdout:7/18: dwrite f0 [0,4194304] 0 2023-12-12T11:51:26.072 INFO:tasks.workunit.client.1.smithi093.stdout:7/19: rename l4 to l7 0 2023-12-12T11:51:26.074 INFO:tasks.workunit.client.1.smithi093.stdout:7/20: mknod c8 0 2023-12-12T11:51:26.118 INFO:tasks.workunit.client.1.smithi093.stdout:7/21: dwrite f1 [0,4194304] 0 2023-12-12T11:51:26.533 INFO:tasks.workunit.client.1.smithi093.stdout:1/28: getdents . 0 2023-12-12T11:51:26.535 INFO:tasks.workunit.client.1.smithi093.stdout:1/29: mkdir d4 0 2023-12-12T11:51:26.537 INFO:tasks.workunit.client.1.smithi093.stdout:1/30: symlink d4/l5 0 2023-12-12T11:51:26.540 INFO:tasks.workunit.client.1.smithi093.stdout:1/31: symlink d4/l6 0 2023-12-12T11:51:26.577 INFO:tasks.workunit.client.1.smithi093.stdout:1/32: dwrite f1 [0,4194304] 0 2023-12-12T11:51:26.577 INFO:tasks.workunit.client.1.smithi093.stdout:1/33: chown d4/l5 1233298 1 2023-12-12T11:51:26.577 INFO:tasks.workunit.client.1.smithi093.stdout:1/34: stat d4 0 2023-12-12T11:51:26.594 INFO:tasks.workunit.client.1.smithi093.stdout:8/16: fsync f0 0 2023-12-12T11:51:26.594 INFO:tasks.workunit.client.1.smithi093.stdout:8/17: chown d3/l4 6279 1 2023-12-12T11:51:26.596 INFO:tasks.workunit.client.1.smithi093.stdout:8/18: creat d3/f6 x:0 0 0 2023-12-12T11:51:26.628 INFO:tasks.workunit.client.1.smithi093.stdout:4/20: rmdir d0 39 2023-12-12T11:51:26.628 INFO:tasks.workunit.client.1.smithi093.stdout:4/21: fsync d0/f2 0 2023-12-12T11:51:26.628 INFO:tasks.workunit.client.1.smithi093.stdout:4/22: read - d0/f2 zero size 2023-12-12T11:51:26.630 INFO:tasks.workunit.client.1.smithi093.stdout:4/23: mknod d0/c3 0 2023-12-12T11:51:26.633 INFO:tasks.workunit.client.1.smithi093.stdout:4/24: symlink d0/l4 0 2023-12-12T11:51:26.646 INFO:tasks.workunit.client.1.smithi093.stdout:2/11: link l2 l3 0 2023-12-12T11:51:26.648 INFO:tasks.workunit.client.1.smithi093.stdout:2/12: symlink l4 0 2023-12-12T11:51:26.651 INFO:tasks.workunit.client.1.smithi093.stdout:2/13: mkdir d5 0 2023-12-12T11:51:26.652 INFO:tasks.workunit.client.1.smithi093.stdout:2/14: dread - no filename 2023-12-12T11:51:26.652 INFO:tasks.workunit.client.1.smithi093.stdout:2/15: chown l4 138 1 2023-12-12T11:51:26.652 INFO:tasks.workunit.client.1.smithi093.stdout:2/16: truncate - no filename 2023-12-12T11:51:26.652 INFO:tasks.workunit.client.1.smithi093.stdout:2/17: dwrite - no filename 2023-12-12T11:51:26.653 INFO:tasks.workunit.client.1.smithi093.stdout:8/19: dwrite f0 [0,4194304] 0 2023-12-12T11:51:26.657 INFO:tasks.workunit.client.1.smithi093.stdout:2/18: symlink d5/l6 0 2023-12-12T11:51:26.662 INFO:tasks.workunit.client.1.smithi093.stdout:2/19: mkdir d5/d7 0 2023-12-12T11:51:26.662 INFO:tasks.workunit.client.1.smithi093.stdout:2/20: dread - no filename 2023-12-12T11:51:26.662 INFO:tasks.workunit.client.1.smithi093.stdout:2/21: dread - no filename 2023-12-12T11:51:26.662 INFO:tasks.workunit.client.1.smithi093.stdout:2/22: dread - no filename 2023-12-12T11:51:26.662 INFO:tasks.workunit.client.1.smithi093.stdout:2/23: fsync - no filename 2023-12-12T11:51:26.663 INFO:tasks.workunit.client.1.smithi093.stdout:2/24: dwrite - no filename 2023-12-12T11:51:26.667 INFO:tasks.workunit.client.1.smithi093.stdout:2/25: creat d5/f8 x:0 0 0 2023-12-12T11:51:26.667 INFO:tasks.workunit.client.1.smithi093.stdout:2/26: write d5/f8 [384322,113813] 0 2023-12-12T11:51:26.668 INFO:tasks.workunit.client.1.smithi093.stdout:2/27: readlink l2 0 2023-12-12T11:51:26.671 INFO:tasks.workunit.client.1.smithi093.stdout:0/25: rmdir d5 39 2023-12-12T11:51:26.672 INFO:tasks.workunit.client.1.smithi093.stdout:2/28: symlink d5/d7/l9 0 2023-12-12T11:51:26.676 INFO:tasks.workunit.client.1.smithi093.stdout:0/26: link d5/c8 d5/cc 0 2023-12-12T11:51:26.676 INFO:tasks.workunit.client.1.smithi093.stdout:2/29: mknod d5/ca 0 2023-12-12T11:51:26.676 INFO:tasks.workunit.client.1.smithi093.stdout:2/30: write d5/f8 [665000,66376] 0 2023-12-12T11:51:26.679 INFO:tasks.workunit.client.1.smithi093.stdout:0/27: truncate d5/f7 2521167 0 2023-12-12T11:51:26.680 INFO:tasks.workunit.client.1.smithi093.stdout:0/28: write d5/fa [223947,51442] 0 2023-12-12T11:51:26.681 INFO:tasks.workunit.client.1.smithi093.stdout:2/31: mknod d5/d7/cb 0 2023-12-12T11:51:26.682 INFO:tasks.workunit.client.1.smithi093.stdout:0/29: mkdir d5/dd 0 2023-12-12T11:51:26.688 INFO:tasks.workunit.client.1.smithi093.stdout:0/30: symlink d5/le 0 2023-12-12T11:51:26.689 INFO:tasks.workunit.client.1.smithi093.stdout:4/25: dwrite d0/f2 [0,4194304] 0 2023-12-12T11:51:26.689 INFO:tasks.workunit.client.1.smithi093.stdout:4/26: chown d0 6385146 1 2023-12-12T11:51:26.692 INFO:tasks.workunit.client.1.smithi093.stdout:6/20: rename d0/d8 to d0/da 0 2023-12-12T11:51:26.693 INFO:tasks.workunit.client.1.smithi093.stdout:8/20: dwrite f1 [0,4194304] 0 2023-12-12T11:51:26.693 INFO:tasks.workunit.client.1.smithi093.stdout:8/21: creat d3/f7 x:0 0 0 2023-12-12T11:51:26.696 INFO:tasks.workunit.client.1.smithi093.stdout:4/27: symlink d0/l5 0 2023-12-12T11:51:26.696 INFO:tasks.workunit.client.1.smithi093.stdout:4/28: dread - d0/f1 zero size 2023-12-12T11:51:26.697 INFO:tasks.workunit.client.1.smithi093.stdout:6/21: mkdir d0/da/db 0 2023-12-12T11:51:26.698 INFO:tasks.workunit.client.1.smithi093.stdout:6/22: dwrite - no filename 2023-12-12T11:51:26.699 INFO:tasks.workunit.client.1.smithi093.stdout:0/31: dread d5/fa [0,4194304] 0 2023-12-12T11:51:26.700 INFO:tasks.workunit.client.1.smithi093.stdout:0/32: fdatasync d5/fa 0 2023-12-12T11:51:26.704 INFO:tasks.workunit.client.1.smithi093.stdout:8/22: mkdir d3/d8 0 2023-12-12T11:51:26.704 INFO:tasks.workunit.client.1.smithi093.stdout:8/23: stat f0 0 2023-12-12T11:51:26.704 INFO:tasks.workunit.client.1.smithi093.stdout:8/24: readlink d3/l4 0 2023-12-12T11:51:26.708 INFO:tasks.workunit.client.1.smithi093.stdout:4/29: mknod d0/c6 0 2023-12-12T11:51:26.708 INFO:tasks.workunit.client.1.smithi093.stdout:4/30: dread - d0/f1 zero size 2023-12-12T11:51:26.712 INFO:tasks.workunit.client.1.smithi093.stdout:4/31: creat d0/f7 x:0 0 0 2023-12-12T11:51:26.712 INFO:tasks.workunit.client.1.smithi093.stdout:4/32: stat d0/f2 0 2023-12-12T11:51:26.712 INFO:tasks.workunit.client.1.smithi093.stdout:4/33: truncate d0/f1 262093 0 2023-12-12T11:51:26.777 INFO:tasks.workunit.client.1.smithi093.stdout:4/34: dwrite d0/f2 [0,4194304] 0 2023-12-12T11:51:26.781 INFO:tasks.workunit.client.1.smithi093.stdout:4/35: symlink d0/l8 0 2023-12-12T11:51:26.781 INFO:tasks.workunit.client.1.smithi093.stdout:4/36: chown d0/f1 60551756 1 2023-12-12T11:51:26.781 INFO:tasks.workunit.client.1.smithi093.stdout:4/37: chown d0/f7 23081675 1 2023-12-12T11:51:26.782 INFO:tasks.workunit.client.1.smithi093.stdout:4/38: chown d0/l4 14248979 1 2023-12-12T11:51:26.782 INFO:tasks.workunit.client.1.smithi093.stdout:4/39: dread - d0/f7 zero size 2023-12-12T11:51:26.822 INFO:tasks.workunit.client.1.smithi093.stdout:4/40: dwrite d0/f1 [0,4194304] 0 2023-12-12T11:51:26.822 INFO:tasks.workunit.client.1.smithi093.stdout:4/41: truncate d0/f7 391484 0 2023-12-12T11:51:26.836 INFO:tasks.workunit.client.1.smithi093.stdout:4/42: write d0/f2 [2121042,113445] 0 2023-12-12T11:51:26.913 INFO:tasks.workunit.client.1.smithi093.stdout:4/43: dwrite d0/f2 [0,4194304] 0 2023-12-12T11:51:26.927 INFO:tasks.workunit.client.1.smithi093.stdout:4/44: dread d0/f2 [0,4194304] 0 2023-12-12T11:51:26.927 INFO:tasks.workunit.client.1.smithi093.stdout:4/45: chown d0/c3 128283 1 2023-12-12T11:51:26.929 INFO:tasks.workunit.client.1.smithi093.stdout:4/46: symlink d0/l9 0 2023-12-12T11:51:26.929 INFO:tasks.workunit.client.1.smithi093.stdout:4/47: creat d0/fa x:0 0 0 2023-12-12T11:51:26.931 INFO:tasks.workunit.client.1.smithi093.stdout:4/48: symlink d0/lb 0 2023-12-12T11:51:26.943 INFO:tasks.workunit.client.1.smithi093.stdout:4/49: read d0/f1 [2020652,88202] 0 2023-12-12T11:51:27.007 INFO:tasks.workunit.client.1.smithi093.stdout:1/35: dwrite f1 [4194304,4194304] 0 2023-12-12T11:51:27.025 INFO:tasks.workunit.client.1.smithi093.stdout:1/36: write f1 [6714707,104653] 0 2023-12-12T11:51:27.045 INFO:tasks.workunit.client.1.smithi093.stdout:1/37: read f1 [3012208,75775] 0 2023-12-12T11:51:27.070 INFO:tasks.workunit.client.1.smithi093.stdout:0/33: truncate d5/f7 2675416 0 2023-12-12T11:51:27.071 INFO:tasks.workunit.client.1.smithi093.stdout:0/34: rename c2 to d5/cf 0 2023-12-12T11:51:27.072 INFO:tasks.workunit.client.1.smithi093.stdout:2/32: rmdir d5 39 2023-12-12T11:51:27.074 INFO:tasks.workunit.client.1.smithi093.stdout:2/33: creat d5/d7/fc x:0 0 0 2023-12-12T11:51:27.074 INFO:tasks.workunit.client.1.smithi093.stdout:2/34: rename d5/d7/cb to d5/d7/cd 0 2023-12-12T11:51:27.084 INFO:tasks.workunit.client.1.smithi093.stdout:6/23: readlink d0/da/l9 0 2023-12-12T11:51:27.085 INFO:tasks.workunit.client.1.smithi093.stdout:6/24: getdents d0/da 0 2023-12-12T11:51:27.085 INFO:tasks.workunit.client.1.smithi093.stdout:6/25: write - no filename 2023-12-12T11:51:27.085 INFO:tasks.workunit.client.1.smithi093.stdout:6/26: write - no filename 2023-12-12T11:51:27.086 INFO:tasks.workunit.client.1.smithi093.stdout:6/27: rmdir d0/da/db 0 2023-12-12T11:51:27.088 INFO:tasks.workunit.client.1.smithi093.stdout:6/28: symlink d0/da/lc 0 2023-12-12T11:51:27.088 INFO:tasks.workunit.client.1.smithi093.stdout:6/29: stat d0/da 0 2023-12-12T11:51:27.088 INFO:tasks.workunit.client.1.smithi093.stdout:6/30: truncate - no filename 2023-12-12T11:51:27.102 INFO:tasks.workunit.client.1.smithi093.stdout:1/38: dwrite f1 [4194304,4194304] 0 2023-12-12T11:51:27.104 INFO:tasks.workunit.client.1.smithi093.stdout:1/39: symlink d4/l7 0 2023-12-12T11:51:27.119 INFO:tasks.workunit.client.1.smithi093.stdout:1/40: dread f1 [4194304,4194304] 0 2023-12-12T11:51:27.131 INFO:tasks.workunit.client.1.smithi093.stdout:1/41: dread f1 [4194304,4194304] 0 2023-12-12T11:51:27.145 INFO:tasks.workunit.client.1.smithi093.stdout:2/35: dwrite d5/d7/fc [0,4194304] 0 2023-12-12T11:51:27.145 INFO:tasks.workunit.client.1.smithi093.stdout:2/36: fdatasync d5/d7/fc 0 2023-12-12T11:51:27.145 INFO:tasks.workunit.client.1.smithi093.stdout:2/37: chown d5/d7/fc 18668497 1 2023-12-12T11:51:27.145 INFO:tasks.workunit.client.1.smithi093.stdout:2/38: readlink l3 0 2023-12-12T11:51:27.145 INFO:tasks.workunit.client.1.smithi093.stdout:2/39: fdatasync d5/f8 0 2023-12-12T11:51:27.152 INFO:tasks.workunit.client.1.smithi093.stdout:4/50: truncate d0/f1 4017408 0 2023-12-12T11:51:27.152 INFO:tasks.workunit.client.1.smithi093.stdout:4/51: fdatasync d0/fa 0 2023-12-12T11:51:27.186 INFO:tasks.workunit.client.1.smithi093.stdout:2/40: dwrite d5/f8 [0,4194304] 0 2023-12-12T11:51:27.218 INFO:tasks.workunit.client.1.smithi093.stdout:4/52: dwrite d0/f7 [0,4194304] 0 2023-12-12T11:51:27.219 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:26 smithi093 ceph-mon[115914]: pgmap v224: 65 pgs: 65 active+clean; 190 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 7.0 MiB/s wr, 763 op/s 2023-12-12T11:51:27.230 INFO:tasks.workunit.client.1.smithi093.stdout:0/35: truncate d5/f7 1580164 0 2023-12-12T11:51:27.232 INFO:tasks.workunit.client.1.smithi093.stdout:0/36: symlink d5/l10 0 2023-12-12T11:51:27.233 INFO:tasks.workunit.client.1.smithi093.stdout:2/41: fsync d5/d7/fc 0 2023-12-12T11:51:27.233 INFO:tasks.workunit.client.1.smithi093.stdout:2/42: rename d5 to d5/d7/de 22 2023-12-12T11:51:27.234 INFO:tasks.workunit.client.1.smithi093.stdout:2/43: creat d5/d7/ff x:0 0 0 2023-12-12T11:51:27.234 INFO:tasks.workunit.client.1.smithi093.stdout:0/37: symlink d5/dd/l11 0 2023-12-12T11:51:27.236 INFO:tasks.workunit.client.1.smithi093.stdout:6/31: creat d0/fd x:0 0 0 2023-12-12T11:51:27.239 INFO:tasks.workunit.client.1.smithi093.stdout:2/44: creat d5/f10 x:0 0 0 2023-12-12T11:51:27.239 INFO:tasks.workunit.client.1.smithi093.stdout:2/45: truncate d5/f8 5139428 0 2023-12-12T11:51:27.241 INFO:tasks.workunit.client.1.smithi093.stdout:6/32: mknod d0/da/ce 0 2023-12-12T11:51:27.263 INFO:tasks.workunit.client.1.smithi093.stdout:4/53: dwrite d0/f7 [0,4194304] 0 2023-12-12T11:51:27.263 INFO:tasks.workunit.client.1.smithi093.stdout:4/54: creat d0/fc x:0 0 0 2023-12-12T11:51:27.271 INFO:tasks.workunit.client.1.smithi093.stdout:4/55: unlink d0/l5 0 2023-12-12T11:51:27.271 INFO:tasks.workunit.client.1.smithi093.stdout:4/56: truncate d0/f1 4644212 0 2023-12-12T11:51:27.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:26 smithi063 ceph-mon[107117]: pgmap v224: 65 pgs: 65 active+clean; 190 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 7.0 MiB/s wr, 763 op/s 2023-12-12T11:51:27.304 INFO:tasks.workunit.client.1.smithi093.stdout:4/57: dwrite d0/fa [0,4194304] 0 2023-12-12T11:51:27.304 INFO:tasks.workunit.client.1.smithi093.stdout:4/58: fdatasync d0/f7 0 2023-12-12T11:51:27.308 INFO:tasks.workunit.client.1.smithi093.stdout:4/59: symlink d0/ld 0 2023-12-12T11:51:27.308 INFO:tasks.workunit.client.1.smithi093.stdout:4/60: creat d0/fe x:0 0 0 2023-12-12T11:51:27.311 INFO:tasks.workunit.client.1.smithi093.stdout:4/61: rename d0/fc to d0/ff 0 2023-12-12T11:51:27.338 INFO:tasks.workunit.client.1.smithi093.stdout:2/46: getdents d5 0 2023-12-12T11:51:27.339 INFO:tasks.workunit.client.1.smithi093.stdout:2/47: read - d5/d7/ff zero size 2023-12-12T11:51:27.339 INFO:tasks.workunit.client.1.smithi093.stdout:2/48: chown d5/d7 498 1 2023-12-12T11:51:27.339 INFO:tasks.workunit.client.1.smithi093.stdout:2/49: chown d5/d7/l9 11822 1 2023-12-12T11:51:27.343 INFO:tasks.workunit.client.1.smithi093.stdout:6/33: rename d0/fd to d0/da/ff 0 2023-12-12T11:51:27.362 INFO:tasks.workunit.client.1.smithi093.stdout:2/50: dread d5/d7/fc [0,4194304] 0 2023-12-12T11:51:27.373 INFO:tasks.workunit.client.1.smithi093.stdout:2/51: dread d5/d7/fc [0,4194304] 0 2023-12-12T11:51:27.377 INFO:tasks.workunit.client.1.smithi093.stdout:2/52: rmdir d5/d7 39 2023-12-12T11:51:27.380 INFO:tasks.workunit.client.1.smithi093.stdout:2/53: creat d5/f11 x:0 0 0 2023-12-12T11:51:27.381 INFO:tasks.workunit.client.1.smithi093.stdout:2/54: mkdir d5/d7/d12 0 2023-12-12T11:51:27.383 INFO:tasks.workunit.client.1.smithi093.stdout:2/55: symlink d5/d7/d12/l13 0 2023-12-12T11:51:27.384 INFO:tasks.workunit.client.1.smithi093.stdout:2/56: write d5/f11 [43410,44834] 0 2023-12-12T11:51:27.384 INFO:tasks.workunit.client.1.smithi093.stdout:2/57: dread - d5/d7/ff zero size 2023-12-12T11:51:27.385 INFO:tasks.workunit.client.1.smithi093.stdout:2/58: rmdir d5/d7 39 2023-12-12T11:51:27.433 INFO:tasks.workunit.client.1.smithi093.stdout:4/62: dwrite d0/f1 [0,4194304] 0 2023-12-12T11:51:27.435 INFO:tasks.workunit.client.1.smithi093.stdout:4/63: mknod d0/c10 0 2023-12-12T11:51:27.437 INFO:tasks.workunit.client.1.smithi093.stdout:6/34: dwrite d0/da/ff [0,4194304] 0 2023-12-12T11:51:27.448 INFO:tasks.workunit.client.1.smithi093.stdout:4/64: write d0/f7 [546659,7119] 0 2023-12-12T11:51:27.455 INFO:tasks.workunit.client.1.smithi093.stdout:6/35: dread d0/da/ff [0,4194304] 0 2023-12-12T11:51:27.494 INFO:tasks.workunit.client.1.smithi093.stdout:2/59: rmdir d5 39 2023-12-12T11:51:27.510 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.507+0000 7fc20eeda700 1 -- 172.21.15.63:0/2657344762 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc208100060 msgr2=0x7fc208102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:51:27.510 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.507+0000 7fc20eeda700 1 --2- 172.21.15.63:0/2657344762 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc208100060 0x7fc208102440 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4004940 tx=0x7fc1f4009e30 comp rx=0 tx=0).stop 2023-12-12T11:51:27.510 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.507+0000 7fc20eeda700 1 -- 172.21.15.63:0/2657344762 shutdown_connections 2023-12-12T11:51:27.510 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.507+0000 7fc20eeda700 1 --2- 172.21.15.63:0/2657344762 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc208100060 0x7fc208102440 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:27.510 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.507+0000 7fc20eeda700 1 --2- 172.21.15.63:0/2657344762 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc2080fd740 0x7fc2080ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:27.510 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.507+0000 7fc20eeda700 1 -- 172.21.15.63:0/2657344762 >> 172.21.15.63:0/2657344762 conn(0x7fc2080f71c0 msgr2=0x7fc2080f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:51:27.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.508+0000 7fc20eeda700 1 -- 172.21.15.63:0/2657344762 shutdown_connections 2023-12-12T11:51:27.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.508+0000 7fc20eeda700 1 -- 172.21.15.63:0/2657344762 wait complete. 2023-12-12T11:51:27.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.509+0000 7fc20eeda700 1 Processor -- start 2023-12-12T11:51:27.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.509+0000 7fc20eeda700 1 -- start start 2023-12-12T11:51:27.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.509+0000 7fc20eeda700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2080fd740 0x7fc20810f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:51:27.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.509+0000 7fc20eeda700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc208100060 0x7fc20810fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:51:27.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.509+0000 7fc20eeda700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc208110200 con 0x7fc2080fd740 2023-12-12T11:51:27.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.509+0000 7fc20eeda700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc208110aa0 con 0x7fc208100060 2023-12-12T11:51:27.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.509+0000 7fc20cc76700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2080fd740 0x7fc20810f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:51:27.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.510+0000 7fc20cc76700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2080fd740 0x7fc20810f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55464/0 (socket says 172.21.15.63:55464) 2023-12-12T11:51:27.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.510+0000 7fc20cc76700 1 -- 172.21.15.63:0/1064764008 learned_addr learned my addr 172.21.15.63:0/1064764008 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:51:27.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.510+0000 7fc207fff700 1 --2- 172.21.15.63:0/1064764008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc208100060 0x7fc20810fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:51:27.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.510+0000 7fc20cc76700 1 -- 172.21.15.63:0/1064764008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc208100060 msgr2=0x7fc20810fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:51:27.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.510+0000 7fc20cc76700 1 --2- 172.21.15.63:0/1064764008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc208100060 0x7fc20810fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:27.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.510+0000 7fc20cc76700 1 -- 172.21.15.63:0/1064764008 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f4005040 con 0x7fc2080fd740 2023-12-12T11:51:27.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.510+0000 7fc20cc76700 1 --2- 172.21.15.63:0/1064764008 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2080fd740 0x7fc20810f6c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc00eb40 tx=0x7fc1fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:51:27.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.511+0000 7fc2057fa700 1 -- 172.21.15.63:0/1064764008 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1fc007cc0 con 0x7fc2080fd740 2023-12-12T11:51:27.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.511+0000 7fc2057fa700 1 -- 172.21.15.63:0/1064764008 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc1fc00f040 con 0x7fc2080fd740 2023-12-12T11:51:27.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.511+0000 7fc2057fa700 1 -- 172.21.15.63:0/1064764008 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1fc00c990 con 0x7fc2080fd740 2023-12-12T11:51:27.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.511+0000 7fc20eeda700 1 -- 172.21.15.63:0/1064764008 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc208110d20 con 0x7fc2080fd740 2023-12-12T11:51:27.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.511+0000 7fc20eeda700 1 -- 172.21.15.63:0/1064764008 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc208111210 con 0x7fc2080fd740 2023-12-12T11:51:27.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.512+0000 7fc20eeda700 1 -- 172.21.15.63:0/1064764008 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2080f8d40 con 0x7fc2080fd740 2023-12-12T11:51:27.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.514+0000 7fc2057fa700 1 -- 172.21.15.63:0/1064764008 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fc1fc00cc00 con 0x7fc2080fd740 2023-12-12T11:51:27.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.515+0000 7fc2057fa700 1 --2- 172.21.15.63:0/1064764008 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fc1f8068f70 0x7fc1f806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:51:27.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.515+0000 7fc2057fa700 1 -- 172.21.15.63:0/1064764008 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc1fc086ac0 con 0x7fc2080fd740 2023-12-12T11:51:27.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.516+0000 7fc207fff700 1 --2- 172.21.15.63:0/1064764008 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fc1f8068f70 0x7fc1f806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:51:27.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.518+0000 7fc207fff700 1 --2- 172.21.15.63:0/1064764008 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fc1f8068f70 0x7fc1f806b420 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4013600 tx=0x7fc1f4009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:51:27.526 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.523+0000 7fc2057fa700 1 -- 172.21.15.63:0/1064764008 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc1fc04da00 con 0x7fc2080fd740 2023-12-12T11:51:27.530 INFO:tasks.workunit.client.1.smithi093.stdout:2/60: dwrite d5/d7/ff [0,4194304] 0 2023-12-12T11:51:27.543 INFO:tasks.workunit.client.1.smithi093.stdout:2/61: dread d5/f8 [0,4194304] 0 2023-12-12T11:51:27.544 INFO:tasks.workunit.client.1.smithi093.stdout:2/62: stat d5/d7/d12/l13 0 2023-12-12T11:51:27.544 INFO:tasks.workunit.client.1.smithi093.stdout:2/63: fdatasync d5/f10 0 2023-12-12T11:51:27.545 INFO:tasks.workunit.client.1.smithi093.stdout:2/64: mkdir d5/d14 0 2023-12-12T11:51:27.547 INFO:tasks.workunit.client.1.smithi093.stdout:2/65: getdents d5/d7 0 2023-12-12T11:51:27.549 INFO:tasks.workunit.client.1.smithi093.stdout:4/65: getdents d0 0 2023-12-12T11:51:27.551 INFO:tasks.workunit.client.1.smithi093.stdout:4/66: rename d0/f7 to d0/f11 0 2023-12-12T11:51:27.552 INFO:tasks.workunit.client.1.smithi093.stdout:4/67: truncate d0/fe 418457 0 2023-12-12T11:51:27.552 INFO:tasks.workunit.client.1.smithi093.stdout:4/68: truncate d0/ff 140976 0 2023-12-12T11:51:27.553 INFO:tasks.workunit.client.1.smithi093.stdout:4/69: creat d0/f12 x:0 0 0 2023-12-12T11:51:27.556 INFO:tasks.workunit.client.1.smithi093.stdout:6/36: write d0/da/ff [4645011,91282] 0 2023-12-12T11:51:27.564 INFO:tasks.workunit.client.1.smithi093.stdout:6/37: write d0/da/ff [1658711,102142] 0 2023-12-12T11:51:27.575 INFO:tasks.workunit.client.1.smithi093.stdout:4/70: dread d0/f1 [0,4194304] 0 2023-12-12T11:51:27.579 INFO:tasks.workunit.client.1.smithi093.stdout:2/66: dwrite d5/d7/ff [0,4194304] 0 2023-12-12T11:51:27.582 INFO:tasks.workunit.client.1.smithi093.stdout:2/67: rename d5/ca to d5/d14/c15 0 2023-12-12T11:51:27.582 INFO:tasks.workunit.client.1.smithi093.stdout:2/68: fsync d5/d7/fc 0 2023-12-12T11:51:27.585 INFO:tasks.workunit.client.1.smithi093.stdout:2/69: fsync d5/f11 0 2023-12-12T11:51:27.613 INFO:tasks.workunit.client.1.smithi093.stdout:6/38: dwrite d0/da/ff [0,4194304] 0 2023-12-12T11:51:27.616 INFO:tasks.workunit.client.1.smithi093.stdout:6/39: mknod d0/da/c10 0 2023-12-12T11:51:27.627 INFO:tasks.workunit.client.1.smithi093.stdout:6/40: dread d0/da/ff [0,4194304] 0 2023-12-12T11:51:27.634 INFO:tasks.workunit.client.1.smithi093.stdout:6/41: write d0/da/ff [2942895,109850] 0 2023-12-12T11:51:27.646 INFO:tasks.workunit.client.1.smithi093.stdout:6/42: dread d0/da/ff [0,4194304] 0 2023-12-12T11:51:27.646 INFO:tasks.workunit.client.1.smithi093.stdout:6/43: fsync d0/da/ff 0 2023-12-12T11:51:27.649 INFO:tasks.workunit.client.1.smithi093.stdout:4/71: unlink d0/f11 0 2023-12-12T11:51:27.653 INFO:tasks.workunit.client.1.smithi093.stdout:6/44: creat d0/f11 x:0 0 0 2023-12-12T11:51:27.653 INFO:tasks.workunit.client.1.smithi093.stdout:6/45: chown d0/da/ff 225183 1 2023-12-12T11:51:27.653 INFO:tasks.workunit.client.1.smithi093.stdout:6/46: chown d0/da/lc 2464 1 2023-12-12T11:51:27.670 INFO:tasks.workunit.client.1.smithi093.stdout:6/47: mknod d0/c12 0 2023-12-12T11:51:27.683 INFO:tasks.workunit.client.1.smithi093.stdout:2/70: truncate d5/d7/ff 2264853 0 2023-12-12T11:51:27.683 INFO:tasks.workunit.client.1.smithi093.stdout:2/71: fdatasync d5/d7/fc 0 2023-12-12T11:51:27.685 INFO:tasks.workunit.client.1.smithi093.stdout:2/72: symlink d5/d7/l16 0 2023-12-12T11:51:27.685 INFO:tasks.workunit.client.1.smithi093.stdout:2/73: chown d5/d14 2086671 1 2023-12-12T11:51:27.685 INFO:tasks.workunit.client.1.smithi093.stdout:2/74: stat d5/d7/d12 0 2023-12-12T11:51:27.692 INFO:tasks.workunit.client.1.smithi093.stdout:4/72: dwrite d0/f12 [0,4194304] 0 2023-12-12T11:51:27.703 INFO:tasks.workunit.client.1.smithi093.stdout:4/73: write d0/f1 [1954670,98187] 0 2023-12-12T11:51:27.707 INFO:tasks.workunit.client.1.smithi093.stdout:6/48: dwrite d0/da/ff [0,4194304] 0 2023-12-12T11:51:27.707 INFO:tasks.workunit.client.1.smithi093.stdout:6/49: truncate d0/da/ff 5477633 0 2023-12-12T11:51:27.723 INFO:tasks.workunit.client.1.smithi093.stdout:6/50: dread d0/da/ff [0,4194304] 0 2023-12-12T11:51:27.728 INFO:tasks.workunit.client.1.smithi093.stdout:6/51: link d0/da/c10 d0/c13 0 2023-12-12T11:51:27.731 INFO:tasks.workunit.client.1.smithi093.stdout:6/52: unlink d0/c12 0 2023-12-12T11:51:27.735 INFO:tasks.workunit.client.1.smithi093.stdout:6/53: mkdir d0/da/d14 0 2023-12-12T11:51:27.737 INFO:tasks.workunit.client.1.smithi093.stdout:6/54: symlink d0/da/d14/l15 0 2023-12-12T11:51:27.741 INFO:tasks.workunit.client.1.smithi093.stdout:6/55: mknod d0/da/c16 0 2023-12-12T11:51:27.741 INFO:tasks.workunit.client.1.smithi093.stdout:6/56: write d0/f11 [264493,55786] 0 2023-12-12T11:51:27.751 INFO:tasks.workunit.client.1.smithi093.stdout:6/57: dread d0/da/ff [0,4194304] 0 2023-12-12T11:51:27.755 INFO:tasks.workunit.client.1.smithi093.stdout:4/74: dwrite d0/fe [0,4194304] 0 2023-12-12T11:51:27.760 INFO:tasks.workunit.client.1.smithi093.stdout:6/58: fsync d0/f11 0 2023-12-12T11:51:27.766 INFO:tasks.workunit.client.1.smithi093.stdout:6/59: mknod d0/c17 0 2023-12-12T11:51:27.766 INFO:tasks.workunit.client.1.smithi093.stdout:6/60: truncate d0/f11 1099452 0 2023-12-12T11:51:27.770 INFO:tasks.workunit.client.1.smithi093.stdout:6/61: rename d0/da/ff to d0/da/d14/f18 0 2023-12-12T11:51:27.771 INFO:tasks.workunit.client.1.smithi093.stdout:4/75: dread d0/fe [0,4194304] 0 2023-12-12T11:51:27.771 INFO:tasks.workunit.client.1.smithi093.stdout:4/76: creat d0/f13 x:0 0 0 2023-12-12T11:51:27.771 INFO:tasks.workunit.client.1.smithi093.stdout:4/77: truncate d0/ff 790869 0 2023-12-12T11:51:27.771 INFO:tasks.workunit.client.1.smithi093.stdout:4/78: read - d0/f13 zero size 2023-12-12T11:51:27.771 INFO:tasks.workunit.client.1.smithi093.stdout:4/79: creat d0/f14 x:0 0 0 2023-12-12T11:51:27.777 INFO:tasks.workunit.client.1.smithi093.stdout:4/80: mknod d0/c15 0 2023-12-12T11:51:27.777 INFO:tasks.workunit.client.1.smithi093.stdout:4/81: creat d0/f16 x:0 0 0 2023-12-12T11:51:27.781 INFO:tasks.workunit.client.1.smithi093.stdout:4/82: rename d0/f13 to d0/f17 0 2023-12-12T11:51:27.784 INFO:tasks.workunit.client.1.smithi093.stdout:4/83: link d0/f14 d0/f18 0 2023-12-12T11:51:27.795 INFO:tasks.workunit.client.1.smithi093.stdout:2/75: write d5/d7/ff [1918203,122986] 0 2023-12-12T11:51:27.795 INFO:tasks.workunit.client.1.smithi093.stdout:2/76: read - d5/f10 zero size 2023-12-12T11:51:27.810 INFO:tasks.workunit.client.1.smithi093.stdout:6/62: dwrite d0/da/d14/f18 [0,4194304] 0 2023-12-12T11:51:27.815 INFO:tasks.workunit.client.1.smithi093.stdout:6/63: mkdir d0/d19 0 2023-12-12T11:51:27.821 INFO:tasks.workunit.client.1.smithi093.stdout:6/64: write d0/f11 [886861,85632] 0 2023-12-12T11:51:27.831 INFO:tasks.workunit.client.1.smithi093.stdout:2/77: dwrite d5/f11 [0,4194304] 0 2023-12-12T11:51:27.834 INFO:tasks.workunit.client.1.smithi093.stdout:6/65: dread d0/da/d14/f18 [0,4194304] 0 2023-12-12T11:51:27.844 INFO:tasks.workunit.client.1.smithi093.stdout:6/66: read d0/da/d14/f18 [3864306,60073] 0 2023-12-12T11:51:27.869 INFO:tasks.workunit.client.1.smithi093.stdout:2/78: dwrite d5/f11 [0,4194304] 0 2023-12-12T11:51:27.872 INFO:tasks.workunit.client.1.smithi093.stdout:2/79: rename d5/d7/l9 to d5/l17 0 2023-12-12T11:51:27.875 INFO:tasks.workunit.client.1.smithi093.stdout:2/80: symlink d5/d7/d12/l18 0 2023-12-12T11:51:27.877 INFO:tasks.workunit.client.1.smithi093.stdout:6/67: dwrite d0/da/d14/f18 [0,4194304] 0 2023-12-12T11:51:27.877 INFO:tasks.workunit.client.1.smithi093.stdout:2/81: rmdir d5/d7/d12 39 2023-12-12T11:51:27.879 INFO:tasks.workunit.client.1.smithi093.stdout:4/84: fsync d0/f16 0 2023-12-12T11:51:27.880 INFO:tasks.workunit.client.1.smithi093.stdout:2/82: unlink d5/d7/l16 0 2023-12-12T11:51:27.884 INFO:tasks.workunit.client.1.smithi093.stdout:4/85: symlink d0/l19 0 2023-12-12T11:51:27.887 INFO:tasks.workunit.client.1.smithi093.stdout:4/86: rename d0/lb to d0/l1a 0 2023-12-12T11:51:27.889 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.887+0000 7fc20eeda700 1 -- 172.21.15.63:0/1064764008 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc208111540 con 0x7fc1f8068f70 2023-12-12T11:51:27.891 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.889+0000 7fc2057fa700 1 -- 172.21.15.63:0/1064764008 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fc208111540 con 0x7fc1f8068f70 2023-12-12T11:51:27.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.892+0000 7fc20eeda700 1 -- 172.21.15.63:0/1064764008 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fc1f8068f70 msgr2=0x7fc1f806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:51:27.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.892+0000 7fc20eeda700 1 --2- 172.21.15.63:0/1064764008 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fc1f8068f70 0x7fc1f806b420 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4013600 tx=0x7fc1f4009e30 comp rx=0 tx=0).stop 2023-12-12T11:51:27.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.892+0000 7fc20eeda700 1 -- 172.21.15.63:0/1064764008 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2080fd740 msgr2=0x7fc20810f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:51:27.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.892+0000 7fc20eeda700 1 --2- 172.21.15.63:0/1064764008 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2080fd740 0x7fc20810f6c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc00eb40 tx=0x7fc1fc00b040 comp rx=0 tx=0).stop 2023-12-12T11:51:27.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.892+0000 7fc20eeda700 1 -- 172.21.15.63:0/1064764008 shutdown_connections 2023-12-12T11:51:27.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.892+0000 7fc20eeda700 1 --2- 172.21.15.63:0/1064764008 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fc1f8068f70 0x7fc1f806b420 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:27.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.892+0000 7fc20eeda700 1 --2- 172.21.15.63:0/1064764008 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2080fd740 0x7fc20810f6c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:27.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.892+0000 7fc20eeda700 1 --2- 172.21.15.63:0/1064764008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc208100060 0x7fc20810fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:27.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.892+0000 7fc20eeda700 1 -- 172.21.15.63:0/1064764008 >> 172.21.15.63:0/1064764008 conn(0x7fc2080f71c0 msgr2=0x7fc208100cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:51:27.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.893+0000 7fc20eeda700 1 -- 172.21.15.63:0/1064764008 shutdown_connections 2023-12-12T11:51:27.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:27.893+0000 7fc20eeda700 1 -- 172.21.15.63:0/1064764008 wait complete. 2023-12-12T11:51:27.915 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-12T11:51:27.929 INFO:tasks.workunit.client.1.smithi093.stdout:2/83: dwrite d5/d7/fc [4194304,4194304] 0 2023-12-12T11:51:27.950 INFO:tasks.workunit.client.1.smithi093.stdout:4/87: dwrite d0/f16 [0,4194304] 0 2023-12-12T11:51:27.971 INFO:tasks.workunit.client.1.smithi093.stdout:6/68: truncate d0/da/d14/f18 980770 0 2023-12-12T11:51:27.976 INFO:tasks.workunit.client.1.smithi093.stdout:6/69: creat d0/da/f1a x:0 0 0 2023-12-12T11:51:27.976 INFO:tasks.workunit.client.1.smithi093.stdout:6/70: write d0/da/f1a [539011,92208] 0 2023-12-12T11:51:27.979 INFO:tasks.workunit.client.1.smithi093.stdout:4/88: getdents d0 0 2023-12-12T11:51:27.979 INFO:tasks.workunit.client.1.smithi093.stdout:4/89: getdents d0 0 2023-12-12T11:51:27.984 INFO:tasks.workunit.client.1.smithi093.stdout:4/90: mknod d0/c1b 0 2023-12-12T11:51:28.024 INFO:tasks.workunit.client.1.smithi093.stdout:4/91: read d0/fe [658150,66514] 0 2023-12-12T11:51:28.030 INFO:tasks.workunit.client.1.smithi093.stdout:4/92: creat d0/f1c x:0 0 0 2023-12-12T11:51:28.033 INFO:tasks.workunit.client.1.smithi093.stdout:4/93: read - d0/f14 zero size 2023-12-12T11:51:28.253 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.111+0000 7f0ec6ac7700 1 -- 172.21.15.63:0/2098100574 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ec00fc640 msgr2=0x7f0ec00fca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:51:28.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.111+0000 7f0ec6ac7700 1 --2- 172.21.15.63:0/2098100574 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ec00fc640 0x7f0ec00fca90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0004940 tx=0x7f0eb0009e30 comp rx=0 tx=0).stop 2023-12-12T11:51:28.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.111+0000 7f0ec6ac7700 1 -- 172.21.15.63:0/2098100574 shutdown_connections 2023-12-12T11:51:28.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.111+0000 7f0ec6ac7700 1 --2- 172.21.15.63:0/2098100574 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ec00fc640 0x7f0ec00fca90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:28.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.111+0000 7f0ec6ac7700 1 --2- 172.21.15.63:0/2098100574 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ec00fe0f0 0x7f0ec00fe500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:28.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.111+0000 7f0ec6ac7700 1 -- 172.21.15.63:0/2098100574 >> 172.21.15.63:0/2098100574 conn(0x7f0ec00f80b0 msgr2=0x7f0ec00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:51:28.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.111+0000 7f0ec6ac7700 1 -- 172.21.15.63:0/2098100574 shutdown_connections 2023-12-12T11:51:28.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.111+0000 7f0ec6ac7700 1 -- 172.21.15.63:0/2098100574 wait complete. 2023-12-12T11:51:28.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.112+0000 7f0ec6ac7700 1 Processor -- start 2023-12-12T11:51:28.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.112+0000 7f0ec6ac7700 1 -- start start 2023-12-12T11:51:28.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.112+0000 7f0ec6ac7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ec00fc640 0x7f0ec010f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:51:28.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.112+0000 7f0ec6ac7700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ec00fe0f0 0x7f0ec010fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:51:28.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.112+0000 7f0ec6ac7700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec0110040 con 0x7f0ec00fc640 2023-12-12T11:51:28.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.112+0000 7f0ec6ac7700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec01108e0 con 0x7f0ec00fe0f0 2023-12-12T11:51:28.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.112+0000 7f0ec5ac5700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ec00fc640 0x7f0ec010f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:51:28.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.112+0000 7f0ec5ac5700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ec00fc640 0x7f0ec010f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36394/0 (socket says 172.21.15.63:36394) 2023-12-12T11:51:28.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.112+0000 7f0ec5ac5700 1 -- 172.21.15.63:0/3562247891 learned_addr learned my addr 172.21.15.63:0/3562247891 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:51:28.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.113+0000 7f0ec52c4700 1 --2- 172.21.15.63:0/3562247891 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ec00fe0f0 0x7f0ec010fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:51:28.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.113+0000 7f0ec5ac5700 1 -- 172.21.15.63:0/3562247891 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ec00fe0f0 msgr2=0x7f0ec010fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:51:28.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.113+0000 7f0ec5ac5700 1 --2- 172.21.15.63:0/3562247891 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ec00fe0f0 0x7f0ec010fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:28.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.113+0000 7f0ec5ac5700 1 -- 172.21.15.63:0/3562247891 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb0005040 con 0x7f0ec00fc640 2023-12-12T11:51:28.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.113+0000 7f0ec5ac5700 1 --2- 172.21.15.63:0/3562247891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ec00fc640 0x7f0ec010f500 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc002a80 tx=0x7f0ebc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:51:28.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.113+0000 7f0eb67fc700 1 -- 172.21.15.63:0/3562247891 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ebc007cc0 con 0x7f0ec00fc640 2023-12-12T11:51:28.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.113+0000 7f0eb67fc700 1 -- 172.21.15.63:0/3562247891 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0ebc00f040 con 0x7f0ec00fc640 2023-12-12T11:51:28.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.113+0000 7f0ec6ac7700 1 -- 172.21.15.63:0/3562247891 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec0110bc0 con 0x7f0ec00fc640 2023-12-12T11:51:28.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.113+0000 7f0eb67fc700 1 -- 172.21.15.63:0/3562247891 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ebc00da20 con 0x7f0ec00fc640 2023-12-12T11:51:28.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.113+0000 7f0ec6ac7700 1 -- 172.21.15.63:0/3562247891 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec0111100 con 0x7f0ec00fc640 2023-12-12T11:51:28.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.114+0000 7f0ec6ac7700 1 -- 172.21.15.63:0/3562247891 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec0101cc0 con 0x7f0ec00fc640 2023-12-12T11:51:28.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.116+0000 7f0eb67fc700 1 -- 172.21.15.63:0/3562247891 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f0ebc00db80 con 0x7f0ec00fc640 2023-12-12T11:51:28.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.118+0000 7f0eb67fc700 1 --2- 172.21.15.63:0/3562247891 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f0eac068f70 0x7f0eac06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:51:28.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.118+0000 7f0eb67fc700 1 -- 172.21.15.63:0/3562247891 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f0ebc087260 con 0x7f0ec00fc640 2023-12-12T11:51:28.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.118+0000 7f0ec52c4700 1 --2- 172.21.15.63:0/3562247891 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f0eac068f70 0x7f0eac06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:51:28.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.119+0000 7f0ec52c4700 1 --2- 172.21.15.63:0/3562247891 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f0eac068f70 0x7f0eac06b420 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0004f90 tx=0x7f0eb0009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:51:28.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.122+0000 7f0eb67fc700 1 -- 172.21.15.63:0/3562247891 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0ebc057180 con 0x7f0ec00fc640 2023-12-12T11:51:28.430 INFO:tasks.workunit.client.1.smithi093.stdout:4/94: dwrite d0/f1c [0,4194304] 0 2023-12-12T11:51:28.434 INFO:tasks.workunit.client.1.smithi093.stdout:4/95: stat d0/l19 0 2023-12-12T11:51:28.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.483+0000 7f0ec6ac7700 1 -- 172.21.15.63:0/3562247891 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ec0111510 con 0x7f0eac068f70 2023-12-12T11:51:28.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.489+0000 7f0eb67fc700 1 -- 172.21.15.63:0/3562247891 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f0ec0111510 con 0x7f0eac068f70 2023-12-12T11:51:28.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.497+0000 7f0ec6ac7700 1 -- 172.21.15.63:0/3562247891 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f0eac068f70 msgr2=0x7f0eac06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:51:28.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.497+0000 7f0ec6ac7700 1 --2- 172.21.15.63:0/3562247891 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f0eac068f70 0x7f0eac06b420 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0004f90 tx=0x7f0eb0009e30 comp rx=0 tx=0).stop 2023-12-12T11:51:28.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.497+0000 7f0ec6ac7700 1 -- 172.21.15.63:0/3562247891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ec00fc640 msgr2=0x7f0ec010f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:51:28.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.497+0000 7f0ec6ac7700 1 --2- 172.21.15.63:0/3562247891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ec00fc640 0x7f0ec010f500 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc002a80 tx=0x7f0ebc004600 comp rx=0 tx=0).stop 2023-12-12T11:51:28.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.497+0000 7f0ec6ac7700 1 -- 172.21.15.63:0/3562247891 shutdown_connections 2023-12-12T11:51:28.500 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.497+0000 7f0ec6ac7700 1 --2- 172.21.15.63:0/3562247891 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f0eac068f70 0x7f0eac06b420 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:28.500 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.497+0000 7f0ec6ac7700 1 --2- 172.21.15.63:0/3562247891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ec00fc640 0x7f0ec010f500 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:28.500 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.497+0000 7f0ec6ac7700 1 --2- 172.21.15.63:0/3562247891 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ec00fe0f0 0x7f0ec010fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:28.500 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.497+0000 7f0ec6ac7700 1 -- 172.21.15.63:0/3562247891 >> 172.21.15.63:0/3562247891 conn(0x7f0ec00f80b0 msgr2=0x7f0ec00fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:51:28.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.498+0000 7f0ec6ac7700 1 -- 172.21.15.63:0/3562247891 shutdown_connections 2023-12-12T11:51:28.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.498+0000 7f0ec6ac7700 1 -- 172.21.15.63:0/3562247891 wait complete. 2023-12-12T11:51:28.621 INFO:tasks.workunit.client.1.smithi093.stdout:6/71: dwrite d0/da/d14/f18 [0,4194304] 0 2023-12-12T11:51:28.658 INFO:tasks.workunit.client.1.smithi093.stdout:6/72: write d0/da/d14/f18 [3863424,120878] 0 2023-12-12T11:51:28.661 INFO:tasks.workunit.client.1.smithi093.stdout:6/73: truncate d0/f11 726150 0 2023-12-12T11:51:28.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.756+0000 7f9e13c49700 1 -- 172.21.15.63:0/569016309 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e0c0fde00 msgr2=0x7f9e0c0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:51:28.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.756+0000 7f9e13c49700 1 --2- 172.21.15.63:0/569016309 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e0c0fde00 0x7f9e0c0fe250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9df8004880 tx=0x7f9df8009e30 comp rx=0 tx=0).stop 2023-12-12T11:51:28.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.757+0000 7f9e13c49700 1 -- 172.21.15.63:0/569016309 shutdown_connections 2023-12-12T11:51:28.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.757+0000 7f9e13c49700 1 --2- 172.21.15.63:0/569016309 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e0c0fde00 0x7f9e0c0fe250 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:28.760 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.757+0000 7f9e13c49700 1 --2- 172.21.15.63:0/569016309 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e0c0fcbf0 0x7f9e0c0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:28.760 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.757+0000 7f9e13c49700 1 -- 172.21.15.63:0/569016309 >> 172.21.15.63:0/569016309 conn(0x7f9e0c0f82d0 msgr2=0x7f9e0c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:51:28.760 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.758+0000 7f9e13c49700 1 -- 172.21.15.63:0/569016309 shutdown_connections 2023-12-12T11:51:28.760 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.758+0000 7f9e13c49700 1 -- 172.21.15.63:0/569016309 wait complete. 2023-12-12T11:51:28.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.759+0000 7f9e13c49700 1 Processor -- start 2023-12-12T11:51:28.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.760+0000 7f9e13c49700 1 -- start start 2023-12-12T11:51:28.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.761+0000 7f9e13c49700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e0c0fcbf0 0x7f9e0c113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:51:28.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.761+0000 7f9e13c49700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e0c0fde00 0x7f9e0c114030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:51:28.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.761+0000 7f9e13c49700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c114630 con 0x7f9e0c0fcbf0 2023-12-12T11:51:28.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.762+0000 7f9e13c49700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c114ed0 con 0x7f9e0c0fde00 2023-12-12T11:51:28.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.762+0000 7f9e111e4700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e0c0fde00 0x7f9e0c114030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:51:28.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.762+0000 7f9e111e4700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e0c0fde00 0x7f9e0c114030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:35298/0 (socket says 172.21.15.63:35298) 2023-12-12T11:51:28.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.762+0000 7f9e119e5700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e0c0fcbf0 0x7f9e0c113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:51:28.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.762+0000 7f9e111e4700 1 -- 172.21.15.63:0/2067042471 learned_addr learned my addr 172.21.15.63:0/2067042471 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:51:28.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.763+0000 7f9e119e5700 1 -- 172.21.15.63:0/2067042471 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e0c0fde00 msgr2=0x7f9e0c114030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:51:28.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.763+0000 7f9e119e5700 1 --2- 172.21.15.63:0/2067042471 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e0c0fde00 0x7f9e0c114030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:28.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.763+0000 7f9e119e5700 1 -- 172.21.15.63:0/2067042471 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df8005040 con 0x7f9e0c0fcbf0 2023-12-12T11:51:28.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.765+0000 7f9e119e5700 1 --2- 172.21.15.63:0/2067042471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e0c0fcbf0 0x7f9e0c113af0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9e0000dad0 tx=0x7f9e00004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:51:28.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.766+0000 7f9e0a7fc700 1 -- 172.21.15.63:0/2067042471 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e0000b820 con 0x7f9e0c0fcbf0 2023-12-12T11:51:28.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.766+0000 7f9e0a7fc700 1 -- 172.21.15.63:0/2067042471 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9e0000f040 con 0x7f9e0c0fcbf0 2023-12-12T11:51:28.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.766+0000 7f9e0a7fc700 1 -- 172.21.15.63:0/2067042471 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e00013ca0 con 0x7f9e0c0fcbf0 2023-12-12T11:51:28.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.766+0000 7f9e13c49700 1 -- 172.21.15.63:0/2067042471 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e0c1151b0 con 0x7f9e0c0fcbf0 2023-12-12T11:51:28.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.766+0000 7f9e13c49700 1 -- 172.21.15.63:0/2067042471 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e0c1156f0 con 0x7f9e0c0fcbf0 2023-12-12T11:51:28.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.768+0000 7f9e13c49700 1 -- 172.21.15.63:0/2067042471 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e0c101ea0 con 0x7f9e0c0fcbf0 2023-12-12T11:51:28.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.772+0000 7f9e0a7fc700 1 -- 172.21.15.63:0/2067042471 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f9e00013530 con 0x7f9e0c0fcbf0 2023-12-12T11:51:28.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.773+0000 7f9e0a7fc700 1 --2- 172.21.15.63:0/2067042471 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f9dfc069020 0x7f9dfc06b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:51:28.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.774+0000 7f9e0a7fc700 1 -- 172.21.15.63:0/2067042471 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9e00087350 con 0x7f9e0c0fcbf0 2023-12-12T11:51:28.779 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.774+0000 7f9e111e4700 1 --2- 172.21.15.63:0/2067042471 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f9dfc069020 0x7f9dfc06b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:51:28.779 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.776+0000 7f9e111e4700 1 --2- 172.21.15.63:0/2067042471 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f9dfc069020 0x7f9dfc06b4d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9df8009fd0 tx=0x7f9df8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:51:28.783 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:28.781+0000 7f9e0a7fc700 1 -- 172.21.15.63:0/2067042471 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9e00057300 con 0x7f9e0c0fcbf0 2023-12-12T11:51:28.785 INFO:tasks.workunit.client.1.smithi093.stdout:4/96: read d0/f12 [491964,74047] 0 2023-12-12T11:51:28.787 INFO:tasks.workunit.client.1.smithi093.stdout:4/97: dread - d0/f18 zero size 2023-12-12T11:51:28.810 INFO:tasks.workunit.client.1.smithi093.stdout:4/98: read d0/f2 [1294552,54729] 0 2023-12-12T11:51:28.813 INFO:tasks.workunit.client.1.smithi093.stdout:4/99: rmdir d0 39 2023-12-12T11:51:28.829 INFO:tasks.workunit.client.1.smithi093.stdout:6/74: dread d0/f11 [0,4194304] 0 2023-12-12T11:51:28.832 INFO:tasks.workunit.client.1.smithi093.stdout:6/75: creat d0/da/d14/f1b x:0 0 0 2023-12-12T11:51:28.833 INFO:tasks.workunit.client.1.smithi093.stdout:6/76: creat d0/da/f1c x:0 0 0 2023-12-12T11:51:28.833 INFO:tasks.workunit.client.1.smithi093.stdout:6/77: stat d0/da/c16 0 2023-12-12T11:51:28.833 INFO:tasks.workunit.client.1.smithi093.stdout:6/78: chown d0/d19 4626 1 2023-12-12T11:51:28.839 INFO:tasks.workunit.client.1.smithi093.stdout:6/79: unlink d0/da/d14/l15 0 2023-12-12T11:51:28.839 INFO:tasks.workunit.client.1.smithi093.stdout:6/80: stat d0/f11 0 2023-12-12T11:51:28.928 INFO:tasks.workunit.client.1.smithi093.stdout:4/100: write d0/fa [2239976,11687] 0 2023-12-12T11:51:28.932 INFO:tasks.workunit.client.1.smithi093.stdout:4/101: link d0/ff d0/f1d 0 2023-12-12T11:51:28.935 INFO:tasks.workunit.client.1.smithi093.stdout:4/102: symlink d0/l1e 0 2023-12-12T11:51:28.937 INFO:tasks.workunit.client.1.smithi093.stdout:4/103: readlink d0/l4 0 2023-12-12T11:51:28.937 INFO:tasks.workunit.client.1.smithi093.stdout:4/104: write d0/fe [1772231,96520] 0 2023-12-12T11:51:28.940 INFO:tasks.workunit.client.1.smithi093.stdout:4/105: rename d0/f12 to d0/f1f 0 2023-12-12T11:51:28.940 INFO:tasks.workunit.client.1.smithi093.stdout:4/106: chown d0/l4 95 1 2023-12-12T11:51:28.975 INFO:tasks.workunit.client.1.smithi093.stdout:6/81: dwrite d0/f11 [0,4194304] 0 2023-12-12T11:51:28.978 INFO:tasks.workunit.client.1.smithi093.stdout:6/82: unlink d0/c13 0 2023-12-12T11:51:28.985 INFO:tasks.workunit.client.1.smithi093.stdout:6/83: mknod d0/c1d 0 2023-12-12T11:51:28.985 INFO:tasks.workunit.client.1.smithi093.stdout:6/84: chown d0/da/f1a 41742922 1 2023-12-12T11:51:28.988 INFO:tasks.workunit.client.1.smithi093.stdout:6/85: link d0/da/l9 d0/da/d14/l1e 0 2023-12-12T11:51:29.003 INFO:tasks.workunit.client.1.smithi093.stdout:4/107: dwrite d0/ff [0,4194304] 0 2023-12-12T11:51:29.018 INFO:tasks.workunit.client.1.smithi093.stdout:4/108: dread d0/f1c [0,4194304] 0 2023-12-12T11:51:29.019 INFO:tasks.workunit.client.1.smithi093.stdout:4/109: chown d0/ff 331 1 2023-12-12T11:51:29.019 INFO:tasks.workunit.client.1.smithi093.stdout:4/110: dread - d0/f18 zero size 2023-12-12T11:51:29.026 INFO:tasks.workunit.client.1.smithi093.stdout:4/111: creat d0/f20 x:0 0 0 2023-12-12T11:51:29.034 INFO:tasks.workunit.client.1.smithi093.stdout:6/86: dread d0/da/f1a [0,4194304] 0 2023-12-12T11:51:29.035 INFO:tasks.workunit.client.1.smithi093.stdout:6/87: dread - d0/da/f1c zero size 2023-12-12T11:51:29.035 INFO:tasks.workunit.client.1.smithi093.stdout:6/88: readlink d0/da/d14/l1e 0 2023-12-12T11:51:29.036 INFO:tasks.workunit.client.1.smithi093.stdout:6/89: symlink d0/da/l1f 0 2023-12-12T11:51:29.039 INFO:tasks.workunit.client.1.smithi093.stdout:6/90: rmdir d0/da/d14 39 2023-12-12T11:51:29.039 INFO:tasks.workunit.client.1.smithi093.stdout:6/91: creat d0/da/f20 x:0 0 0 2023-12-12T11:51:29.042 INFO:tasks.workunit.client.1.smithi093.stdout:6/92: chown d0/c3 4888310 1 2023-12-12T11:51:29.042 INFO:tasks.workunit.client.1.smithi093.stdout:6/93: chown d0/da/l9 101400 1 2023-12-12T11:51:29.052 INFO:tasks.workunit.client.1.smithi093.stdout:6/94: mkdir d0/da/d14/d21 0 2023-12-12T11:51:29.060 INFO:tasks.workunit.client.1.smithi093.stdout:6/95: mknod d0/da/d14/c22 0 2023-12-12T11:51:29.101 INFO:tasks.workunit.client.1.smithi093.stdout:6/96: dwrite d0/da/d14/f1b [0,4194304] 0 2023-12-12T11:51:29.143 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:28 smithi093 ceph-mon[115914]: pgmap v225: 65 pgs: 65 active+clean; 203 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1024 KiB/s rd, 7.7 MiB/s wr, 644 op/s 2023-12-12T11:51:29.143 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:28 smithi093 ceph-mon[115914]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:51:29.144 INFO:tasks.workunit.client.1.smithi093.stdout:6/97: dwrite d0/da/f20 [0,4194304] 0 2023-12-12T11:51:29.161 INFO:tasks.workunit.client.1.smithi093.stdout:6/98: unlink d0/c2 0 2023-12-12T11:51:29.164 INFO:tasks.workunit.client.1.smithi093.stdout:6/99: mknod d0/da/c23 0 2023-12-12T11:51:29.165 INFO:tasks.workunit.client.1.smithi093.stdout:6/100: write d0/da/f1c [950376,119596] 0 2023-12-12T11:51:29.165 INFO:tasks.workunit.client.1.smithi093.stdout:6/101: fsync d0/f11 0 2023-12-12T11:51:29.165 INFO:tasks.workunit.client.1.smithi093.stdout:4/112: dwrite d0/fe [0,4194304] 0 2023-12-12T11:51:29.165 INFO:tasks.workunit.client.1.smithi093.stdout:4/113: dread - d0/f20 zero size 2023-12-12T11:51:29.172 INFO:tasks.workunit.client.1.smithi093.stdout:4/114: symlink d0/l21 0 2023-12-12T11:51:29.200 INFO:tasks.workunit.client.1.smithi093.stdout:6/102: getdents d0 0 2023-12-12T11:51:29.208 INFO:tasks.workunit.client.1.smithi093.stdout:6/103: mknod d0/da/d14/c24 0 2023-12-12T11:51:29.208 INFO:tasks.workunit.client.1.smithi093.stdout:4/115: dwrite d0/f1d [0,4194304] 0 2023-12-12T11:51:29.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.209+0000 7f9e13c49700 1 -- 172.21.15.63:0/2067042471 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e0c115a40 con 0x7f9dfc069020 2023-12-12T11:51:29.211 INFO:tasks.workunit.client.1.smithi093.stdout:4/116: mkdir d0/d22 0 2023-12-12T11:51:29.213 INFO:tasks.workunit.client.1.smithi093.stdout:4/117: symlink d0/d22/l23 0 2023-12-12T11:51:29.215 INFO:tasks.workunit.client.1.smithi093.stdout:6/104: dread d0/da/f1a [0,4194304] 0 2023-12-12T11:51:29.216 INFO:tasks.workunit.client.1.smithi093.stdout:4/118: symlink d0/l24 0 2023-12-12T11:51:29.217 INFO:tasks.workunit.client.1.smithi093.stdout:6/105: mknod d0/c25 0 2023-12-12T11:51:29.219 INFO:tasks.workunit.client.1.smithi093.stdout:4/119: symlink d0/l25 0 2023-12-12T11:51:29.220 INFO:tasks.workunit.client.1.smithi093.stdout:6/106: fdatasync d0/da/d14/f18 0 2023-12-12T11:51:29.223 INFO:tasks.workunit.client.1.smithi093.stdout:6/107: symlink d0/d19/l26 0 2023-12-12T11:51:29.223 INFO:tasks.workunit.client.1.smithi093.stdout:6/108: chown d0/da 78725 1 2023-12-12T11:51:29.223 INFO:tasks.workunit.client.1.smithi093.stdout:6/109: write d0/da/d14/f18 [888968,90167] 0 2023-12-12T11:51:29.224 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.221+0000 7f9e0a7fc700 1 -- 172.21.15.63:0/2067042471 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f9e0c115a40 con 0x7f9dfc069020 2023-12-12T11:51:29.224 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-12T11:51:29.224 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (5m) 2m ago 6m - - 0.25.0 c8568f914cd2 cd61d03c786f 2023-12-12T11:51:29.224 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (7m) 2m ago 7m - - 17.2.7-123-gbef78a51 ae6196193935 ee4415610fae 2023-12-12T11:51:29.224 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi093 smithi093 running (6m) 6s ago 6m 7810k - 17.2.7-123-gbef78a51 ae6196193935 f64e68742cfe 2023-12-12T11:51:29.224 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (5m) 2m ago 6m - - 9.4.7 954c08fa6188 2eeaef85f231 2023-12-12T11:51:29.224 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.aevpzg smithi063 running (2m) 2m ago 2m - - 17.2.7-123-gbef78a51 ae6196193935 df9a6781f836 2023-12-12T11:51:29.224 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.bdqbnp smithi063 running (2m) 2m ago 2m - - 17.2.7-123-gbef78a51 ae6196193935 0c7e1d21eee9 2023-12-12T11:51:29.224 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.rhaqsh smithi093 running (2m) 6s ago 2m 12.7M - 17.2.7-123-gbef78a51 ae6196193935 257aee771d87 2023-12-12T11:51:29.224 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.swdqms smithi093 running (2m) 6s ago 2m 12.7M - 17.2.7-123-gbef78a51 ae6196193935 f46d7173d3b1 2023-12-12T11:51:29.225 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.zjnfdi smithi063 *:9283 running (8m) 2m ago 8m - - 17.2.7-123-gbef78a51 ae6196193935 1b9efe5a68d3 2023-12-12T11:51:29.225 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi093.nbtltu smithi093 *:8443,9283 running (10s) 6s ago 6m 53.7M - 19.0.0-96-gf1fbf3c5 8cf689f388db 58a1ec037be4 2023-12-12T11:51:29.225 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (8m) 2m ago 8m - 2048M 17.2.7-123-gbef78a51 ae6196193935 ee8e9d7455f9 2023-12-12T11:51:29.225 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi093 smithi093 running (6m) 6s ago 6m 51.8M 2048M 17.2.7-123-gbef78a51 ae6196193935 fac71666a805 2023-12-12T11:51:29.225 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (7m) 2m ago 7m - - 1.5.0 0da6a335fe13 9c94f98d1396 2023-12-12T11:51:29.225 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi093 smithi093 *:9100 running (6m) 6s ago 6m 8984k - 1.5.0 0da6a335fe13 55fa35accdef 2023-12-12T11:51:29.225 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (5m) 2m ago 5m - 4349M 17.2.7-123-gbef78a51 ae6196193935 636790d2b28c 2023-12-12T11:51:29.225 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (5m) 2m ago 5m - 4349M 17.2.7-123-gbef78a51 ae6196193935 5388a4bc6b12 2023-12-12T11:51:29.225 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (4m) 2m ago 4m - 4349M 17.2.7-123-gbef78a51 ae6196193935 9eb2483337c8 2023-12-12T11:51:29.225 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi093 running (4m) 6s ago 4m 271M 5373M 17.2.7-123-gbef78a51 ae6196193935 5b2bb36b5843 2023-12-12T11:51:29.225 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi093 running (3m) 6s ago 3m 233M 5373M 17.2.7-123-gbef78a51 ae6196193935 7dc3f04b04cb 2023-12-12T11:51:29.225 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi093 running (3m) 6s ago 3m 258M 5373M 17.2.7-123-gbef78a51 ae6196193935 16fe8e4668f1 2023-12-12T11:51:29.225 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (5m) 2m ago 6m - - 2.43.0 a07b618ecd1d 14c481676fd7 2023-12-12T11:51:29.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.223+0000 7f9e13c49700 1 -- 172.21.15.63:0/2067042471 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f9dfc069020 msgr2=0x7f9dfc06b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:51:29.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.223+0000 7f9e13c49700 1 --2- 172.21.15.63:0/2067042471 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f9dfc069020 0x7f9dfc06b4d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9df8009fd0 tx=0x7f9df8009e30 comp rx=0 tx=0).stop 2023-12-12T11:51:29.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.223+0000 7f9e13c49700 1 -- 172.21.15.63:0/2067042471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e0c0fcbf0 msgr2=0x7f9e0c113af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:51:29.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.223+0000 7f9e13c49700 1 --2- 172.21.15.63:0/2067042471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e0c0fcbf0 0x7f9e0c113af0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9e0000dad0 tx=0x7f9e00004db0 comp rx=0 tx=0).stop 2023-12-12T11:51:29.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.223+0000 7f9e13c49700 1 -- 172.21.15.63:0/2067042471 shutdown_connections 2023-12-12T11:51:29.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.223+0000 7f9e13c49700 1 --2- 172.21.15.63:0/2067042471 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f9dfc069020 0x7f9dfc06b4d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:29.227 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.223+0000 7f9e13c49700 1 --2- 172.21.15.63:0/2067042471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e0c0fcbf0 0x7f9e0c113af0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:29.227 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.223+0000 7f9e13c49700 1 --2- 172.21.15.63:0/2067042471 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e0c0fde00 0x7f9e0c114030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:29.227 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.223+0000 7f9e13c49700 1 -- 172.21.15.63:0/2067042471 >> 172.21.15.63:0/2067042471 conn(0x7f9e0c0f82d0 msgr2=0x7f9e0c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:51:29.227 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.224+0000 7f9e13c49700 1 -- 172.21.15.63:0/2067042471 shutdown_connections 2023-12-12T11:51:29.227 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.224+0000 7f9e13c49700 1 -- 172.21.15.63:0/2067042471 wait complete. 2023-12-12T11:51:29.227 INFO:tasks.workunit.client.1.smithi093.stdout:6/110: symlink d0/da/l27 0 2023-12-12T11:51:29.237 INFO:tasks.workunit.client.1.smithi093.stdout:6/111: dread d0/da/f1c [0,4194304] 0 2023-12-12T11:51:29.251 INFO:tasks.workunit.client.1.smithi093.stdout:4/120: dwrite d0/f1d [0,4194304] 0 2023-12-12T11:51:29.251 INFO:tasks.workunit.client.1.smithi093.stdout:4/121: write d0/f20 [581553,41796] 0 2023-12-12T11:51:29.263 INFO:tasks.workunit.client.1.smithi093.stdout:4/122: dread d0/f1f [0,4194304] 0 2023-12-12T11:51:29.265 INFO:tasks.workunit.client.1.smithi093.stdout:4/123: mknod d0/d22/c26 0 2023-12-12T11:51:29.272 INFO:tasks.workunit.client.1.smithi093.stdout:6/112: write d0/da/d14/f1b [84546,117931] 0 2023-12-12T11:51:29.278 INFO:tasks.workunit.client.1.smithi093.stdout:4/124: dread d0/f1c [0,4194304] 0 2023-12-12T11:51:29.278 INFO:tasks.workunit.client.1.smithi093.stdout:4/125: stat d0/c1b 0 2023-12-12T11:51:29.278 INFO:tasks.workunit.client.1.smithi093.stdout:4/126: dread - d0/f14 zero size 2023-12-12T11:51:29.278 INFO:tasks.workunit.client.1.smithi093.stdout:4/127: fsync d0/f18 0 2023-12-12T11:51:29.278 INFO:tasks.workunit.client.1.smithi093.stdout:4/128: write d0/fa [4491916,124738] 0 2023-12-12T11:51:29.279 INFO:tasks.workunit.client.1.smithi093.stdout:4/129: read d0/f1c [553400,34395] 0 2023-12-12T11:51:29.285 INFO:tasks.workunit.client.1.smithi093.stdout:4/130: read d0/f1c [2049385,80319] 0 2023-12-12T11:51:29.285 INFO:tasks.workunit.client.1.smithi093.stdout:4/131: creat d0/f27 x:0 0 0 2023-12-12T11:51:29.286 INFO:tasks.workunit.client.1.smithi093.stdout:4/132: write d0/f1 [5471046,82449] 0 2023-12-12T11:51:29.286 INFO:tasks.workunit.client.1.smithi093.stdout:4/133: write d0/f1c [634050,72137] 0 2023-12-12T11:51:29.290 INFO:tasks.workunit.client.1.smithi093.stdout:6/113: dread d0/da/d14/f1b [0,4194304] 0 2023-12-12T11:51:29.293 INFO:tasks.workunit.client.1.smithi093.stdout:4/134: creat d0/d22/f28 x:0 0 0 2023-12-12T11:51:29.293 INFO:tasks.workunit.client.1.smithi093.stdout:4/135: creat d0/d22/f29 x:0 0 0 2023-12-12T11:51:29.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:28 smithi063 ceph-mon[107117]: pgmap v225: 65 pgs: 65 active+clean; 203 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1024 KiB/s rd, 7.7 MiB/s wr, 644 op/s 2023-12-12T11:51:29.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:28 smithi063 ceph-mon[107117]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:51:29.312 INFO:tasks.workunit.client.1.smithi093.stdout:6/114: dread d0/da/f1a [0,4194304] 0 2023-12-12T11:51:29.333 INFO:tasks.workunit.client.1.smithi093.stdout:6/115: write d0/da/f20 [2658227,1307] 0 2023-12-12T11:51:29.334 INFO:tasks.workunit.client.1.smithi093.stdout:6/116: mknod d0/da/d14/d21/c28 0 2023-12-12T11:51:29.337 INFO:tasks.workunit.client.1.smithi093.stdout:6/117: rename d0/da/f1c to d0/f29 0 2023-12-12T11:51:29.338 INFO:tasks.workunit.client.1.smithi093.stdout:6/118: mknod d0/da/d14/c2a 0 2023-12-12T11:51:29.341 INFO:tasks.workunit.client.1.smithi093.stdout:4/136: dwrite d0/fa [0,4194304] 0 2023-12-12T11:51:29.345 INFO:tasks.workunit.client.1.smithi093.stdout:4/137: fdatasync d0/f20 0 2023-12-12T11:51:29.357 INFO:tasks.workunit.client.1.smithi093.stdout:4/138: dread d0/fe [0,4194304] 0 2023-12-12T11:51:29.407 INFO:tasks.workunit.client.1.smithi093.stdout:4/139: dwrite d0/fa [0,4194304] 0 2023-12-12T11:51:29.409 INFO:tasks.workunit.client.1.smithi093.stdout:4/140: symlink d0/d22/l2a 0 2023-12-12T11:51:29.412 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.409+0000 7ffb7c879700 1 -- 172.21.15.63:0/4090142195 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffb780fee00 msgr2=0x7ffb780ff210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:51:29.412 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.409+0000 7ffb7c879700 1 --2- 172.21.15.63:0/4090142195 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffb780fee00 0x7ffb780ff210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffb68004940 tx=0x7ffb68009e30 comp rx=0 tx=0).stop 2023-12-12T11:51:29.412 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.409+0000 7ffb7c879700 1 -- 172.21.15.63:0/4090142195 shutdown_connections 2023-12-12T11:51:29.412 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.409+0000 7ffb7c879700 1 --2- 172.21.15.63:0/4090142195 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb780fff70 0x7ffb781003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:29.412 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.409+0000 7ffb7c879700 1 --2- 172.21.15.63:0/4090142195 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffb780fee00 0x7ffb780ff210 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:29.412 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.409+0000 7ffb7c879700 1 -- 172.21.15.63:0/4090142195 >> 172.21.15.63:0/4090142195 conn(0x7ffb780fa5d0 msgr2=0x7ffb780fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:51:29.412 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.409+0000 7ffb7c879700 1 -- 172.21.15.63:0/4090142195 shutdown_connections 2023-12-12T11:51:29.412 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.410+0000 7ffb7c879700 1 -- 172.21.15.63:0/4090142195 wait complete. 2023-12-12T11:51:29.412 INFO:tasks.workunit.client.1.smithi093.stdout:4/141: mknod d0/c2b 0 2023-12-12T11:51:29.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.411+0000 7ffb7c879700 1 Processor -- start 2023-12-12T11:51:29.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.411+0000 7ffb7c879700 1 -- start start 2023-12-12T11:51:29.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.411+0000 7ffb7c879700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb780fee00 0x7ffb7810f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:51:29.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.411+0000 7ffb7c879700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffb780fff70 0x7ffb7810fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:51:29.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.411+0000 7ffb7c879700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb78110230 con 0x7ffb780fee00 2023-12-12T11:51:29.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.411+0000 7ffb7c879700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb78110ad0 con 0x7ffb780fff70 2023-12-12T11:51:29.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.412+0000 7ffb7659c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb780fee00 0x7ffb7810f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:51:29.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.412+0000 7ffb7659c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb780fee00 0x7ffb7810f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36428/0 (socket says 172.21.15.63:36428) 2023-12-12T11:51:29.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.412+0000 7ffb7659c700 1 -- 172.21.15.63:0/1690581104 learned_addr learned my addr 172.21.15.63:0/1690581104 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:51:29.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.412+0000 7ffb75d9b700 1 --2- 172.21.15.63:0/1690581104 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffb780fff70 0x7ffb7810fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:51:29.415 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.412+0000 7ffb7659c700 1 -- 172.21.15.63:0/1690581104 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffb780fff70 msgr2=0x7ffb7810fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:51:29.415 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.412+0000 7ffb7659c700 1 --2- 172.21.15.63:0/1690581104 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffb780fff70 0x7ffb7810fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:29.415 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.412+0000 7ffb7659c700 1 -- 172.21.15.63:0/1690581104 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb68005040 con 0x7ffb780fee00 2023-12-12T11:51:29.415 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.412+0000 7ffb75d9b700 1 --2- 172.21.15.63:0/1690581104 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffb780fff70 0x7ffb7810fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T11:51:29.416 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.413+0000 7ffb7659c700 1 --2- 172.21.15.63:0/1690581104 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb780fee00 0x7ffb7810f6f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009fd0 tx=0x7ffb68009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:51:29.416 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.413+0000 7ffb66ffd700 1 -- 172.21.15.63:0/1690581104 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb68021070 con 0x7ffb780fee00 2023-12-12T11:51:29.416 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.413+0000 7ffb66ffd700 1 -- 172.21.15.63:0/1690581104 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffb6801c400 con 0x7ffb780fee00 2023-12-12T11:51:29.416 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.413+0000 7ffb66ffd700 1 -- 172.21.15.63:0/1690581104 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb6800e070 con 0x7ffb780fee00 2023-12-12T11:51:29.416 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.413+0000 7ffb7c879700 1 -- 172.21.15.63:0/1690581104 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb78110d50 con 0x7ffb780fee00 2023-12-12T11:51:29.416 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.413+0000 7ffb7c879700 1 -- 172.21.15.63:0/1690581104 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb78111240 con 0x7ffb780fee00 2023-12-12T11:51:29.416 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.414+0000 7ffb7c879700 1 -- 172.21.15.63:0/1690581104 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb7804bb80 con 0x7ffb780fee00 2023-12-12T11:51:29.419 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.417+0000 7ffb66ffd700 1 -- 172.21.15.63:0/1690581104 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ffb6801c570 con 0x7ffb780fee00 2023-12-12T11:51:29.420 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.418+0000 7ffb66ffd700 1 --2- 172.21.15.63:0/1690581104 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ffb60068f70 0x7ffb6006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:51:29.420 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.418+0000 7ffb66ffd700 1 -- 172.21.15.63:0/1690581104 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ffb680880e0 con 0x7ffb780fee00 2023-12-12T11:51:29.420 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.418+0000 7ffb75d9b700 1 --2- 172.21.15.63:0/1690581104 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ffb60068f70 0x7ffb6006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:51:29.421 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.419+0000 7ffb75d9b700 1 --2- 172.21.15.63:0/1690581104 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ffb60068f70 0x7ffb6006b420 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009b80 tx=0x7ffb6c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:51:29.428 INFO:tasks.workunit.client.1.smithi093.stdout:4/142: dread d0/f16 [0,4194304] 0 2023-12-12T11:51:29.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.426+0000 7ffb66ffd700 1 -- 172.21.15.63:0/1690581104 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ffb68057f50 con 0x7ffb780fee00 2023-12-12T11:51:29.446 INFO:tasks.workunit.client.1.smithi093.stdout:4/143: write d0/f1d [2712680,62763] 0 2023-12-12T11:51:29.455 INFO:tasks.workunit.client.1.smithi093.stdout:4/144: dread d0/f1c [0,4194304] 0 2023-12-12T11:51:29.455 INFO:tasks.workunit.client.1.smithi093.stdout:4/145: chown d0/d22/l2a 3738 1 2023-12-12T11:51:29.455 INFO:tasks.workunit.client.1.smithi093.stdout:4/146: creat d0/d22/f2c x:0 0 0 2023-12-12T11:51:29.460 INFO:tasks.workunit.client.1.smithi093.stdout:4/147: rename d0/c3 to d0/c2d 0 2023-12-12T11:51:29.462 INFO:tasks.workunit.client.1.smithi093.stdout:4/148: truncate d0/f1f 3810786 0 2023-12-12T11:51:29.462 INFO:tasks.workunit.client.1.smithi093.stdout:4/149: fsync d0/f1c 0 2023-12-12T11:51:29.462 INFO:tasks.workunit.client.1.smithi093.stdout:4/150: readlink d0/l19 0 2023-12-12T11:51:29.463 INFO:tasks.workunit.client.1.smithi093.stdout:4/151: dread - d0/f17 zero size 2023-12-12T11:51:29.470 INFO:tasks.workunit.client.1.smithi093.stdout:4/152: rename d0/c15 to d0/c2e 0 2023-12-12T11:51:29.470 INFO:tasks.workunit.client.1.smithi093.stdout:4/153: chown d0/f14 77636 1 2023-12-12T11:51:29.483 INFO:tasks.workunit.client.1.smithi093.stdout:4/154: dread d0/f1d [0,4194304] 0 2023-12-12T11:51:29.483 INFO:tasks.workunit.client.1.smithi093.stdout:4/155: dread - d0/f17 zero size 2023-12-12T11:51:29.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.749+0000 7ffb7c879700 1 -- 172.21.15.63:0/1690581104 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffb78115d10 con 0x7ffb780fee00 2023-12-12T11:51:29.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.749+0000 7ffb66ffd700 1 -- 172.21.15.63:0/1690581104 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7ffb68057ae0 con 0x7ffb780fee00 2023-12-12T11:51:29.752 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:51:29.752 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-12T11:51:29.752 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 2 2023-12-12T11:51:29.752 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:51:29.752 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-12T11:51:29.752 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 2 2023-12-12T11:51:29.752 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:51:29.752 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-12T11:51:29.753 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 6 2023-12-12T11:51:29.753 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:51:29.753 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-12T11:51:29.753 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 4 2023-12-12T11:51:29.753 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:51:29.753 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-12T11:51:29.753 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 14 2023-12-12T11:51:29.753 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-12T11:51:29.753 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:51:29.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.752+0000 7ffb7c879700 1 -- 172.21.15.63:0/1690581104 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ffb60068f70 msgr2=0x7ffb6006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:51:29.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.752+0000 7ffb7c879700 1 --2- 172.21.15.63:0/1690581104 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ffb60068f70 0x7ffb6006b420 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009b80 tx=0x7ffb6c00b040 comp rx=0 tx=0).stop 2023-12-12T11:51:29.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.752+0000 7ffb7c879700 1 -- 172.21.15.63:0/1690581104 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb780fee00 msgr2=0x7ffb7810f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:51:29.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.752+0000 7ffb7c879700 1 --2- 172.21.15.63:0/1690581104 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb780fee00 0x7ffb7810f6f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009fd0 tx=0x7ffb68009e30 comp rx=0 tx=0).stop 2023-12-12T11:51:29.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.752+0000 7ffb7c879700 1 -- 172.21.15.63:0/1690581104 shutdown_connections 2023-12-12T11:51:29.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.752+0000 7ffb7c879700 1 --2- 172.21.15.63:0/1690581104 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ffb60068f70 0x7ffb6006b420 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:29.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.752+0000 7ffb7c879700 1 --2- 172.21.15.63:0/1690581104 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb780fee00 0x7ffb7810f6f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:29.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.752+0000 7ffb7c879700 1 --2- 172.21.15.63:0/1690581104 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffb780fff70 0x7ffb7810fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:29.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.752+0000 7ffb7c879700 1 -- 172.21.15.63:0/1690581104 >> 172.21.15.63:0/1690581104 conn(0x7ffb780fa5d0 msgr2=0x7ffb78103230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:51:29.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.752+0000 7ffb7c879700 1 -- 172.21.15.63:0/1690581104 shutdown_connections 2023-12-12T11:51:29.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.752+0000 7ffb7c879700 1 -- 172.21.15.63:0/1690581104 wait complete. 2023-12-12T11:51:29.865 INFO:tasks.workunit.client.1.smithi093.stdout:4/156: getdents d0 0 2023-12-12T11:51:29.907 INFO:tasks.workunit.client.1.smithi093.stdout:4/157: dwrite d0/ff [4194304,4194304] 0 2023-12-12T11:51:29.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.946+0000 7f18f0be0700 1 -- 172.21.15.63:0/2407988275 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18ec0ffdb0 msgr2=0x7f18ec1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:51:29.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.946+0000 7f18f0be0700 1 --2- 172.21.15.63:0/2407988275 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18ec0ffdb0 0x7f18ec1021d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f18e0004940 tx=0x7f18e0009e30 comp rx=0 tx=0).stop 2023-12-12T11:51:29.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.946+0000 7f18f0be0700 1 -- 172.21.15.63:0/2407988275 shutdown_connections 2023-12-12T11:51:29.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.946+0000 7f18f0be0700 1 --2- 172.21.15.63:0/2407988275 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18ec0ffdb0 0x7f18ec1021d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:29.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.946+0000 7f18f0be0700 1 --2- 172.21.15.63:0/2407988275 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18ec0668e0 0x7f18ec0ff7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:29.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.946+0000 7f18f0be0700 1 -- 172.21.15.63:0/2407988275 >> 172.21.15.63:0/2407988275 conn(0x7f18ec0f71d0 msgr2=0x7f18ec0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:51:29.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.946+0000 7f18f0be0700 1 -- 172.21.15.63:0/2407988275 shutdown_connections 2023-12-12T11:51:29.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.946+0000 7f18f0be0700 1 -- 172.21.15.63:0/2407988275 wait complete. 2023-12-12T11:51:29.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.947+0000 7f18f0be0700 1 Processor -- start 2023-12-12T11:51:29.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.947+0000 7f18f0be0700 1 -- start start 2023-12-12T11:51:29.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.948+0000 7f18f0be0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18ec0668e0 0x7f18ec0fd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:51:29.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.948+0000 7f18f0be0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18ec0ffdb0 0x7f18ec0fb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:51:29.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.948+0000 7f18f0be0700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec0fbce0 con 0x7f18ec0ffdb0 2023-12-12T11:51:29.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.948+0000 7f18f0be0700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec0fbe50 con 0x7f18ec0668e0 2023-12-12T11:51:29.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.948+0000 7f18ea59c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18ec0668e0 0x7f18ec0fd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:51:29.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.948+0000 7f18ea59c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18ec0668e0 0x7f18ec0fd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:35320/0 (socket says 172.21.15.63:35320) 2023-12-12T11:51:29.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.948+0000 7f18ea59c700 1 -- 172.21.15.63:0/3575501115 learned_addr learned my addr 172.21.15.63:0/3575501115 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:51:29.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.949+0000 7f18e9d9b700 1 --2- 172.21.15.63:0/3575501115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18ec0ffdb0 0x7f18ec0fb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:51:29.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.949+0000 7f18ea59c700 1 -- 172.21.15.63:0/3575501115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18ec0ffdb0 msgr2=0x7f18ec0fb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:51:29.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.949+0000 7f18ea59c700 1 --2- 172.21.15.63:0/3575501115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18ec0ffdb0 0x7f18ec0fb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:29.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.949+0000 7f18ea59c700 1 -- 172.21.15.63:0/3575501115 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e0005040 con 0x7f18ec0668e0 2023-12-12T11:51:29.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.950+0000 7f18ea59c700 1 --2- 172.21.15.63:0/3575501115 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18ec0668e0 0x7f18ec0fd260 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f18dc002a80 tx=0x7f18dc0046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:51:29.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.950+0000 7f18daffd700 1 -- 172.21.15.63:0/3575501115 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18dc007cc0 con 0x7f18ec0668e0 2023-12-12T11:51:29.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.950+0000 7f18daffd700 1 -- 172.21.15.63:0/3575501115 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f18dc00f040 con 0x7f18ec0668e0 2023-12-12T11:51:29.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.950+0000 7f18daffd700 1 -- 172.21.15.63:0/3575501115 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18dc00da60 con 0x7f18ec0668e0 2023-12-12T11:51:29.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.950+0000 7f18f0be0700 1 -- 172.21.15.63:0/3575501115 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18ec0fc130 con 0x7f18ec0668e0 2023-12-12T11:51:29.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.950+0000 7f18f0be0700 1 -- 172.21.15.63:0/3575501115 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18ec1154c0 con 0x7f18ec0668e0 2023-12-12T11:51:29.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.951+0000 7f18f0be0700 1 -- 172.21.15.63:0/3575501115 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18ec04bb80 con 0x7f18ec0668e0 2023-12-12T11:51:29.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.953+0000 7f18daffd700 1 -- 172.21.15.63:0/3575501115 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 20) v1 ==== 88622+0+0 (secure 0 0 0) 0x7f18dc00dbc0 con 0x7f18ec0668e0 2023-12-12T11:51:29.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.954+0000 7f18daffd700 1 --2- 172.21.15.63:0/3575501115 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f18d406ad30 0x7f18d406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:51:29.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.954+0000 7f18daffd700 1 -- 172.21.15.63:0/3575501115 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f18dc089030 con 0x7f18ec0668e0 2023-12-12T11:51:29.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.954+0000 7f18e9d9b700 1 --2- 172.21.15.63:0/3575501115 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f18d406ad30 0x7f18d406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:51:29.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.955+0000 7f18e9d9b700 1 --2- 172.21.15.63:0/3575501115 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f18d406ad30 0x7f18d406d1e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f18e000b7d0 tx=0x7f18e0009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:51:29.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:29.958+0000 7f18daffd700 1 -- 172.21.15.63:0/3575501115 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f18dc058f40 con 0x7f18ec0668e0 2023-12-12T11:51:29.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:29 smithi093 ceph-mon[115914]: from='client.14662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:51:29.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:29 smithi093 ceph-mon[115914]: from='client.14666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:51:29.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:29 smithi093 ceph-mon[115914]: Standby manager daemon smithi093.nbtltu restarted 2023-12-12T11:51:29.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:29 smithi093 ceph-mon[115914]: Standby manager daemon smithi093.nbtltu started 2023-12-12T11:51:29.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:29 smithi093 ceph-mon[115914]: from='mgr.? 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi093.nbtltu/crt"}]: dispatch 2023-12-12T11:51:29.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:29 smithi093 ceph-mon[115914]: from='mgr.? 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-12T11:51:29.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:29 smithi093 ceph-mon[115914]: from='mgr.? 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi093.nbtltu/key"}]: dispatch 2023-12-12T11:51:29.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:29 smithi093 ceph-mon[115914]: from='mgr.? 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-12T11:51:29.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:29 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/1690581104' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:51:30.213 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:29 smithi063 ceph-mon[107117]: from='client.14662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:51:30.213 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:29 smithi063 ceph-mon[107117]: from='client.14666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:51:30.213 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:29 smithi063 ceph-mon[107117]: Standby manager daemon smithi093.nbtltu restarted 2023-12-12T11:51:30.213 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:29 smithi063 ceph-mon[107117]: Standby manager daemon smithi093.nbtltu started 2023-12-12T11:51:30.214 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:29 smithi063 ceph-mon[107117]: from='mgr.? 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi093.nbtltu/crt"}]: dispatch 2023-12-12T11:51:30.214 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:29 smithi063 ceph-mon[107117]: from='mgr.? 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-12T11:51:30.214 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:29 smithi063 ceph-mon[107117]: from='mgr.? 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi093.nbtltu/key"}]: dispatch 2023-12-12T11:51:30.214 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:29 smithi063 ceph-mon[107117]: from='mgr.? 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-12T11:51:30.214 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:29 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/1690581104' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:51:30.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.244+0000 7f18f0be0700 1 -- 172.21.15.63:0/3575501115 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f18ec1156b0 con 0x7f18ec0668e0 2023-12-12T11:51:30.247 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.245+0000 7f18daffd700 1 -- 172.21.15.63:0/3575501115 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1807 (secure 0 0 0) 0x7f18dc058ad0 con 0x7f18ec0668e0 2023-12-12T11:51:30.247 INFO:teuthology.orchestra.run.smithi063.stdout:e13 2023-12-12T11:51:30.247 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-12T11:51:30.247 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:51:30.247 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-12T11:51:30.247 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:51:30.248 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-12T11:51:30.248 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-12T11:51:30.248 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 13 2023-12-12T11:51:30.248 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-12T11:51:30.248 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-12T11:48:58.523481+0000 2023-12-12T11:51:30.248 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-12T11:49:14.113993+0000 2023-12-12T11:51:30.248 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-12T11:51:30.248 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-12T11:51:30.248 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-12T11:51:30.248 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-12T11:51:30.248 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-12T11:51:30.248 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-12T11:51:30.248 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-12T11:51:30.248 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 46 2023-12-12T11:51:30.249 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:51:30.249 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 1 2023-12-12T11:51:30.249 INFO:teuthology.orchestra.run.smithi063.stdout:in 0 2023-12-12T11:51:30.249 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=14492} 2023-12-12T11:51:30.249 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-12T11:51:30.249 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-12T11:51:30.249 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-12T11:51:30.249 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-12T11:51:30.249 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-12T11:51:30.249 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data enabled 2023-12-12T11:51:30.249 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-12T11:51:30.249 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 1 2023-12-12T11:51:30.249 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.aevpzg{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.63:6828/3709000039,v1:172.21.15.63:6829/3709000039] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:51:30.249 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:51:30.249 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:51:30.249 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2023-12-12T11:51:30.250 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:51:30.250 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.swdqms{-1:14500} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.93:6826/3307558569,v1:172.21.15.93:6827/3307558569] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:51:30.250 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.bdqbnp{-1:14508} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/2191270944,v1:172.21.15.63:6827/2191270944] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:51:30.250 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.rhaqsh{-1:24317} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.93:6824/3161864019,v1:172.21.15.93:6825/3161864019] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:51:30.250 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.247+0000 7f18f0be0700 1 -- 172.21.15.63:0/3575501115 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f18d406ad30 msgr2=0x7f18d406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:51:30.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.247+0000 7f18f0be0700 1 --2- 172.21.15.63:0/3575501115 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f18d406ad30 0x7f18d406d1e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f18e000b7d0 tx=0x7f18e0009e30 comp rx=0 tx=0).stop 2023-12-12T11:51:30.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.247+0000 7f18f0be0700 1 -- 172.21.15.63:0/3575501115 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18ec0668e0 msgr2=0x7f18ec0fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:51:30.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.247+0000 7f18f0be0700 1 --2- 172.21.15.63:0/3575501115 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18ec0668e0 0x7f18ec0fd260 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f18dc002a80 tx=0x7f18dc0046b0 comp rx=0 tx=0).stop 2023-12-12T11:51:30.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.248+0000 7f18f0be0700 1 -- 172.21.15.63:0/3575501115 shutdown_connections 2023-12-12T11:51:30.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.248+0000 7f18f0be0700 1 --2- 172.21.15.63:0/3575501115 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18ec0668e0 0x7f18ec0fd260 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:30.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.248+0000 7f18f0be0700 1 --2- 172.21.15.63:0/3575501115 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7f18d406ad30 0x7f18d406d1e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:30.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.248+0000 7f18f0be0700 1 --2- 172.21.15.63:0/3575501115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18ec0ffdb0 0x7f18ec0fb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:30.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.248+0000 7f18f0be0700 1 -- 172.21.15.63:0/3575501115 >> 172.21.15.63:0/3575501115 conn(0x7f18ec0f71d0 msgr2=0x7f18ec0f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:51:30.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.248+0000 7f18f0be0700 1 -- 172.21.15.63:0/3575501115 shutdown_connections 2023-12-12T11:51:30.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.248+0000 7f18f0be0700 1 -- 172.21.15.63:0/3575501115 wait complete. 2023-12-12T11:51:30.252 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 13 2023-12-12T11:51:30.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.453+0000 7ff535279700 1 -- 172.21.15.63:0/2734325883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5300fcbf0 msgr2=0x7ff5300fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:51:30.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.453+0000 7ff535279700 1 --2- 172.21.15.63:0/2734325883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5300fcbf0 0x7ff5300fd000 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff520004940 tx=0x7ff520009e30 comp rx=0 tx=0).stop 2023-12-12T11:51:30.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.453+0000 7ff535279700 1 -- 172.21.15.63:0/2734325883 shutdown_connections 2023-12-12T11:51:30.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.453+0000 7ff535279700 1 --2- 172.21.15.63:0/2734325883 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5300fde00 0x7ff5300fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:30.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.453+0000 7ff535279700 1 --2- 172.21.15.63:0/2734325883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5300fcbf0 0x7ff5300fd000 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:30.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.453+0000 7ff535279700 1 -- 172.21.15.63:0/2734325883 >> 172.21.15.63:0/2734325883 conn(0x7ff5300f82d0 msgr2=0x7ff5300fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:51:30.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.453+0000 7ff535279700 1 -- 172.21.15.63:0/2734325883 shutdown_connections 2023-12-12T11:51:30.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.453+0000 7ff535279700 1 -- 172.21.15.63:0/2734325883 wait complete. 2023-12-12T11:51:30.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.455+0000 7ff535279700 1 Processor -- start 2023-12-12T11:51:30.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.455+0000 7ff535279700 1 -- start start 2023-12-12T11:51:30.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.455+0000 7ff535279700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5300fcbf0 0x7ff53010d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:51:30.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.456+0000 7ff535279700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5300fde00 0x7ff53010da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:51:30.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.456+0000 7ff535279700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53010e010 con 0x7ff5300fde00 2023-12-12T11:51:30.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.456+0000 7ff535279700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53010e8b0 con 0x7ff5300fcbf0 2023-12-12T11:51:30.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.456+0000 7ff52e7fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5300fde00 0x7ff53010da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:51:30.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.456+0000 7ff52effd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5300fcbf0 0x7ff53010d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:51:30.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.456+0000 7ff52e7fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5300fde00 0x7ff53010da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36456/0 (socket says 172.21.15.63:36456) 2023-12-12T11:51:30.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.456+0000 7ff52e7fc700 1 -- 172.21.15.63:0/2741910984 learned_addr learned my addr 172.21.15.63:0/2741910984 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:51:30.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.456+0000 7ff52e7fc700 1 -- 172.21.15.63:0/2741910984 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5300fcbf0 msgr2=0x7ff53010d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:51:30.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.456+0000 7ff52e7fc700 1 --2- 172.21.15.63:0/2741910984 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5300fcbf0 0x7ff53010d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:30.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.456+0000 7ff52e7fc700 1 -- 172.21.15.63:0/2741910984 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff520005040 con 0x7ff5300fde00 2023-12-12T11:51:30.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.457+0000 7ff52e7fc700 1 --2- 172.21.15.63:0/2741910984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5300fde00 0x7ff53010da10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff52400eb40 tx=0x7ff52400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:51:30.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.457+0000 7ff5177fe700 1 -- 172.21.15.63:0/2741910984 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff524007cc0 con 0x7ff5300fde00 2023-12-12T11:51:30.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.457+0000 7ff5177fe700 1 -- 172.21.15.63:0/2741910984 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff52400f040 con 0x7ff5300fde00 2023-12-12T11:51:30.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.457+0000 7ff535279700 1 -- 172.21.15.63:0/2741910984 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff53010eb30 con 0x7ff5300fde00 2023-12-12T11:51:30.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.457+0000 7ff5177fe700 1 -- 172.21.15.63:0/2741910984 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff52400c990 con 0x7ff5300fde00 2023-12-12T11:51:30.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.457+0000 7ff535279700 1 -- 172.21.15.63:0/2741910984 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff53010f070 con 0x7ff5300fde00 2023-12-12T11:51:30.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.459+0000 7ff535279700 1 -- 172.21.15.63:0/2741910984 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff53004bb80 con 0x7ff5300fde00 2023-12-12T11:51:30.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.460+0000 7ff5177fe700 1 -- 172.21.15.63:0/2741910984 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) v1 ==== 88622+0+0 (secure 0 0 0) 0x7ff52400cc00 con 0x7ff5300fde00 2023-12-12T11:51:30.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.461+0000 7ff5177fe700 1 --2- 172.21.15.63:0/2741910984 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff51806ad30 0x7ff51806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:51:30.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.462+0000 7ff5177fe700 1 -- 172.21.15.63:0/2741910984 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff524089130 con 0x7ff5300fde00 2023-12-12T11:51:30.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.462+0000 7ff52effd700 1 --2- 172.21.15.63:0/2741910984 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff51806ad30 0x7ff51806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:51:30.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.463+0000 7ff52effd700 1 --2- 172.21.15.63:0/2741910984 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff51806ad30 0x7ff51806d1e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff520013680 tx=0x7ff520009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:51:30.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.467+0000 7ff5177fe700 1 -- 172.21.15.63:0/2741910984 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff524058fd0 con 0x7ff5300fde00 2023-12-12T11:51:30.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.732+0000 7ff535279700 1 -- 172.21.15.63:0/2741910984 --> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff53010f4c0 con 0x7ff51806ad30 2023-12-12T11:51:30.735 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.733+0000 7ff5177fe700 1 -- 172.21.15.63:0/2741910984 <== mgr.14208 v2:172.21.15.63:6800/3841315087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7ff53010f4c0 con 0x7ff51806ad30 2023-12-12T11:51:30.735 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:51:30.735 INFO:teuthology.orchestra.run.smithi063.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dbb46fd2dbbe029cfba763f2b7c769e980f86b63e74be0c72e188909e20b81f3", 2023-12-12T11:51:30.735 INFO:teuthology.orchestra.run.smithi063.stdout: "in_progress": true, 2023-12-12T11:51:30.736 INFO:teuthology.orchestra.run.smithi063.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-12T11:51:30.736 INFO:teuthology.orchestra.run.smithi063.stdout: "services_complete": [], 2023-12-12T11:51:30.736 INFO:teuthology.orchestra.run.smithi063.stdout: "progress": "1/21 daemons upgraded", 2023-12-12T11:51:30.736 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "Currently upgrading mgr daemons", 2023-12-12T11:51:30.736 INFO:teuthology.orchestra.run.smithi063.stdout: "is_paused": false 2023-12-12T11:51:30.736 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:51:30.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.735+0000 7ff535279700 1 -- 172.21.15.63:0/2741910984 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff51806ad30 msgr2=0x7ff51806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:51:30.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.735+0000 7ff535279700 1 --2- 172.21.15.63:0/2741910984 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff51806ad30 0x7ff51806d1e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff520013680 tx=0x7ff520009e30 comp rx=0 tx=0).stop 2023-12-12T11:51:30.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.735+0000 7ff535279700 1 -- 172.21.15.63:0/2741910984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5300fde00 msgr2=0x7ff53010da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:51:30.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.735+0000 7ff535279700 1 --2- 172.21.15.63:0/2741910984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5300fde00 0x7ff53010da10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff52400eb40 tx=0x7ff52400b040 comp rx=0 tx=0).stop 2023-12-12T11:51:30.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.735+0000 7ff535279700 1 -- 172.21.15.63:0/2741910984 shutdown_connections 2023-12-12T11:51:30.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.735+0000 7ff535279700 1 --2- 172.21.15.63:0/2741910984 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5300fcbf0 0x7ff53010d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:30.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.735+0000 7ff535279700 1 --2- 172.21.15.63:0/2741910984 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7ff51806ad30 0x7ff51806d1e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:30.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.735+0000 7ff535279700 1 --2- 172.21.15.63:0/2741910984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5300fde00 0x7ff53010da10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:30.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.735+0000 7ff535279700 1 -- 172.21.15.63:0/2741910984 >> 172.21.15.63:0/2741910984 conn(0x7ff5300f82d0 msgr2=0x7ff530101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:51:30.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.736+0000 7ff535279700 1 -- 172.21.15.63:0/2741910984 shutdown_connections 2023-12-12T11:51:30.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.736+0000 7ff535279700 1 -- 172.21.15.63:0/2741910984 wait complete. 2023-12-12T11:51:30.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.895+0000 7fe33af65700 1 -- 172.21.15.63:0/327845678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3340fff70 msgr2=0x7fe3341003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:51:30.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.895+0000 7fe33af65700 1 --2- 172.21.15.63:0/327845678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3340fff70 0x7fe3341003e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe320004940 tx=0x7fe320009e30 comp rx=0 tx=0).stop 2023-12-12T11:51:30.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.895+0000 7fe33af65700 1 -- 172.21.15.63:0/327845678 shutdown_connections 2023-12-12T11:51:30.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.895+0000 7fe33af65700 1 --2- 172.21.15.63:0/327845678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3340fff70 0x7fe3341003e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:30.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.895+0000 7fe33af65700 1 --2- 172.21.15.63:0/327845678 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe3340fee00 0x7fe3340ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:30.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.895+0000 7fe33af65700 1 -- 172.21.15.63:0/327845678 >> 172.21.15.63:0/327845678 conn(0x7fe3340fa5d0 msgr2=0x7fe3340fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:51:30.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.895+0000 7fe33af65700 1 -- 172.21.15.63:0/327845678 shutdown_connections 2023-12-12T11:51:30.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.895+0000 7fe33af65700 1 -- 172.21.15.63:0/327845678 wait complete. 2023-12-12T11:51:30.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.896+0000 7fe33af65700 1 Processor -- start 2023-12-12T11:51:30.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.896+0000 7fe33af65700 1 -- start start 2023-12-12T11:51:30.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.897+0000 7fe33af65700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe3340fee00 0x7fe33410f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:51:30.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.897+0000 7fe33af65700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3340fff70 0x7fe33410fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:51:30.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.897+0000 7fe33af65700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe334110230 con 0x7fe3340fff70 2023-12-12T11:51:30.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.897+0000 7fe33af65700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe334110ad0 con 0x7fe3340fee00 2023-12-12T11:51:30.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.897+0000 7fe333fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3340fff70 0x7fe33410fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:51:30.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.897+0000 7fe333fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3340fff70 0x7fe33410fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36476/0 (socket says 172.21.15.63:36476) 2023-12-12T11:51:30.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.897+0000 7fe333fff700 1 -- 172.21.15.63:0/945887891 learned_addr learned my addr 172.21.15.63:0/945887891 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:51:30.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.898+0000 7fe333fff700 1 -- 172.21.15.63:0/945887891 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe3340fee00 msgr2=0x7fe33410f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:51:30.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.898+0000 7fe338d01700 1 --2- 172.21.15.63:0/945887891 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe3340fee00 0x7fe33410f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:51:30.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.898+0000 7fe333fff700 1 --2- 172.21.15.63:0/945887891 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe3340fee00 0x7fe33410f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:30.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.898+0000 7fe333fff700 1 -- 172.21.15.63:0/945887891 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe320005040 con 0x7fe3340fff70 2023-12-12T11:51:30.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.898+0000 7fe338d01700 1 --2- 172.21.15.63:0/945887891 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe3340fee00 0x7fe33410f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T11:51:30.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.898+0000 7fe333fff700 1 --2- 172.21.15.63:0/945887891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3340fff70 0x7fe33410fc30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe320009fd0 tx=0x7fe320009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:51:30.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.898+0000 7fe3317fa700 1 -- 172.21.15.63:0/945887891 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe320021070 con 0x7fe3340fff70 2023-12-12T11:51:30.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.899+0000 7fe3317fa700 1 -- 172.21.15.63:0/945887891 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe32001c400 con 0x7fe3340fff70 2023-12-12T11:51:30.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.899+0000 7fe33af65700 1 -- 172.21.15.63:0/945887891 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe334110d50 con 0x7fe3340fff70 2023-12-12T11:51:30.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.899+0000 7fe3317fa700 1 -- 172.21.15.63:0/945887891 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe32000e070 con 0x7fe3340fff70 2023-12-12T11:51:30.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.899+0000 7fe33af65700 1 -- 172.21.15.63:0/945887891 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe334111230 con 0x7fe3340fff70 2023-12-12T11:51:30.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.901+0000 7fe31effd700 1 -- 172.21.15.63:0/945887891 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe33404bb80 con 0x7fe3340fff70 2023-12-12T11:51:30.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.904+0000 7fe3317fa700 1 -- 172.21.15.63:0/945887891 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 20) v1 ==== 88622+0+0 (secure 0 0 0) 0x7fe320013a50 con 0x7fe3340fff70 2023-12-12T11:51:30.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.905+0000 7fe3317fa700 1 --2- 172.21.15.63:0/945887891 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fe32406ad30 0x7fe32406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:51:30.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.905+0000 7fe3317fa700 1 -- 172.21.15.63:0/945887891 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe32008aef0 con 0x7fe3340fff70 2023-12-12T11:51:30.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.905+0000 7fe338d01700 1 --2- 172.21.15.63:0/945887891 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fe32406ad30 0x7fe32406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:51:30.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.906+0000 7fe338d01700 1 --2- 172.21.15.63:0/945887891 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fe32406ad30 0x7fe32406d1e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe328004600 tx=0x7fe32800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:51:30.910 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:30.908+0000 7fe3317fa700 1 -- 172.21.15.63:0/945887891 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe32005aea0 con 0x7fe3340fff70 2023-12-12T11:51:31.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:30 smithi093 ceph-mon[115914]: pgmap v226: 65 pgs: 65 active+clean; 270 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 7.1 MiB/s rd, 15 MiB/s wr, 601 op/s 2023-12-12T11:51:31.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:30 smithi093 ceph-mon[115914]: mgrmap e20: smithi063.zjnfdi(active, since 6m), standbys: smithi093.nbtltu 2023-12-12T11:51:31.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:30 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/3575501115' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:51:31.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:30 smithi063 ceph-mon[107117]: pgmap v226: 65 pgs: 65 active+clean; 270 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 7.1 MiB/s rd, 15 MiB/s wr, 601 op/s 2023-12-12T11:51:31.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:30 smithi063 ceph-mon[107117]: mgrmap e20: smithi063.zjnfdi(active, since 6m), standbys: smithi093.nbtltu 2023-12-12T11:51:31.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:30 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/3575501115' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:51:31.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:31.295+0000 7fe31effd700 1 -- 172.21.15.63:0/945887891 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe3341077b0 con 0x7fe3340fff70 2023-12-12T11:51:31.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:31.295+0000 7fe3317fa700 1 -- 172.21.15.63:0/945887891 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fe32005aa30 con 0x7fe3340fff70 2023-12-12T11:51:31.298 INFO:teuthology.orchestra.run.smithi063.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-12T11:51:31.298 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-12T11:51:31.298 INFO:teuthology.orchestra.run.smithi063.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-12T11:51:31.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:31.298+0000 7fe31effd700 1 -- 172.21.15.63:0/945887891 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fe32406ad30 msgr2=0x7fe32406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:51:31.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:31.298+0000 7fe31effd700 1 --2- 172.21.15.63:0/945887891 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fe32406ad30 0x7fe32406d1e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe328004600 tx=0x7fe32800b040 comp rx=0 tx=0).stop 2023-12-12T11:51:31.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:31.298+0000 7fe31effd700 1 -- 172.21.15.63:0/945887891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3340fff70 msgr2=0x7fe33410fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:51:31.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:31.298+0000 7fe31effd700 1 --2- 172.21.15.63:0/945887891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3340fff70 0x7fe33410fc30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe320009fd0 tx=0x7fe320009e30 comp rx=0 tx=0).stop 2023-12-12T11:51:31.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:31.298+0000 7fe31effd700 1 -- 172.21.15.63:0/945887891 shutdown_connections 2023-12-12T11:51:31.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:31.298+0000 7fe31effd700 1 --2- 172.21.15.63:0/945887891 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe3340fee00 0x7fe33410f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:31.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:31.298+0000 7fe31effd700 1 --2- 172.21.15.63:0/945887891 >> [v2:172.21.15.63:6800/3841315087,v1:172.21.15.63:6801/3841315087] conn(0x7fe32406ad30 0x7fe32406d1e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:31.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:31.298+0000 7fe31effd700 1 --2- 172.21.15.63:0/945887891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3340fff70 0x7fe33410fc30 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:51:31.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:31.298+0000 7fe31effd700 1 -- 172.21.15.63:0/945887891 >> 172.21.15.63:0/945887891 conn(0x7fe3340fa5d0 msgr2=0x7fe334103230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:51:31.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:31.299+0000 7fe31effd700 1 -- 172.21.15.63:0/945887891 shutdown_connections 2023-12-12T11:51:31.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:51:31.299+0000 7fe31effd700 1 -- 172.21.15.63:0/945887891 wait complete. 2023-12-12T11:51:32.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:31 smithi093 ceph-mon[115914]: from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:51:32.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:31 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/945887891' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:51:32.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:31 smithi063 ceph-mon[107117]: from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:51:32.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:31 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/945887891' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:51:33.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:32 smithi093 ceph-mon[115914]: pgmap v227: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 8.8 MiB/s rd, 15 MiB/s wr, 421 op/s 2023-12-12T11:51:33.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:32 smithi063 ceph-mon[107117]: pgmap v227: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 8.8 MiB/s rd, 15 MiB/s wr, 421 op/s 2023-12-12T11:51:34.093 INFO:tasks.workunit.client.0.smithi063.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-12-12T11:51:34.094 INFO:tasks.workunit.client.0.smithi063.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-12T11:51:34.094 INFO:tasks.workunit.client.0.smithi063.stderr:+ make 2023-12-12T11:51:34.123 INFO:tasks.workunit.client.0.smithi063.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-12-12T11:51:34.411 INFO:tasks.workunit.client.0.smithi063.stderr:++ readlink -f fsstress 2023-12-12T11:51:34.413 INFO:tasks.workunit.client.0.smithi063.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-12-12T11:51:34.413 INFO:tasks.workunit.client.0.smithi063.stderr:+ popd 2023-12-12T11:51:34.413 INFO:tasks.workunit.client.0.smithi063.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-12T11:51:34.414 INFO:tasks.workunit.client.0.smithi063.stderr:+ popd 2023-12-12T11:51:34.414 INFO:tasks.workunit.client.0.smithi063.stdout:~/cephtest/mnt.0/client.0/tmp 2023-12-12T11:51:34.414 INFO:tasks.workunit.client.0.smithi063.stderr:++ mktemp -d -p . 2023-12-12T11:51:34.416 INFO:tasks.workunit.client.0.smithi063.stderr:+ T=./tmp.Dod4sLe1dI 2023-12-12T11:51:34.417 INFO:tasks.workunit.client.0.smithi063.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.Dod4sLe1dI -l 1 -n 1000 -p 10 -v 2023-12-12T11:51:34.419 INFO:tasks.workunit.client.0.smithi063.stdout:seed = 1702767398 2023-12-12T11:51:34.422 INFO:tasks.workunit.client.0.smithi063.stdout:0/0: truncate - no filename 2023-12-12T11:51:34.422 INFO:tasks.workunit.client.0.smithi063.stdout:0/1: dread - no filename 2023-12-12T11:51:34.422 INFO:tasks.workunit.client.0.smithi063.stdout:0/2: dwrite - no filename 2023-12-12T11:51:34.423 INFO:tasks.workunit.client.0.smithi063.stdout:1/0: chown . 10508799 1 2023-12-12T11:51:34.424 INFO:tasks.workunit.client.0.smithi063.stdout:1/1: chown . 4309 1 2023-12-12T11:51:34.424 INFO:tasks.workunit.client.0.smithi063.stdout:1/2: truncate - no filename 2023-12-12T11:51:34.424 INFO:tasks.workunit.client.0.smithi063.stdout:1/3: write - no filename 2023-12-12T11:51:34.424 INFO:tasks.workunit.client.0.smithi063.stdout:1/4: write - no filename 2023-12-12T11:51:34.424 INFO:tasks.workunit.client.0.smithi063.stdout:1/5: write - no filename 2023-12-12T11:51:34.424 INFO:tasks.workunit.client.0.smithi063.stdout:1/6: stat - no entries 2023-12-12T11:51:34.424 INFO:tasks.workunit.client.0.smithi063.stdout:1/7: dwrite - no filename 2023-12-12T11:51:34.424 INFO:tasks.workunit.client.0.smithi063.stdout:1/8: truncate - no filename 2023-12-12T11:51:34.425 INFO:tasks.workunit.client.0.smithi063.stdout:6/0: readlink - no filename 2023-12-12T11:51:34.425 INFO:tasks.workunit.client.0.smithi063.stdout:6/1: write - no filename 2023-12-12T11:51:34.425 INFO:tasks.workunit.client.0.smithi063.stdout:6/2: fsync - no filename 2023-12-12T11:51:34.425 INFO:tasks.workunit.client.0.smithi063.stdout:6/3: dwrite - no filename 2023-12-12T11:51:34.425 INFO:tasks.workunit.client.0.smithi063.stdout:6/4: unlink - no file 2023-12-12T11:51:34.425 INFO:tasks.workunit.client.0.smithi063.stdout:6/5: dread - no filename 2023-12-12T11:51:34.425 INFO:tasks.workunit.client.0.smithi063.stdout:6/6: readlink - no filename 2023-12-12T11:51:34.425 INFO:tasks.workunit.client.0.smithi063.stdout:1/9: mknod c0 0 2023-12-12T11:51:34.425 INFO:tasks.workunit.client.0.smithi063.stdout:1/10: dread - no filename 2023-12-12T11:51:34.425 INFO:tasks.workunit.client.0.smithi063.stdout:1/11: dwrite - no filename 2023-12-12T11:51:34.426 INFO:tasks.workunit.client.0.smithi063.stdout:1/12: dwrite - no filename 2023-12-12T11:51:34.427 INFO:tasks.workunit.client.0.smithi063.stdout:6/7: creat f0 x:0 0 0 2023-12-12T11:51:34.427 INFO:tasks.workunit.client.0.smithi063.stdout:6/8: truncate f0 882215 0 2023-12-12T11:51:34.427 INFO:tasks.workunit.client.0.smithi063.stdout:6/9: chown f0 19905067 1 2023-12-12T11:51:34.430 INFO:tasks.workunit.client.0.smithi063.stdout:2/0: mkdir d0 0 2023-12-12T11:51:34.431 INFO:tasks.workunit.client.0.smithi063.stdout:6/10: mknod c1 0 2023-12-12T11:51:34.432 INFO:tasks.workunit.client.0.smithi063.stdout:2/1: creat d0/f1 x:0 0 0 2023-12-12T11:51:34.433 INFO:tasks.workunit.client.0.smithi063.stdout:6/11: link c1 c2 0 2023-12-12T11:51:34.436 INFO:tasks.workunit.client.0.smithi063.stdout:6/12: symlink l3 0 2023-12-12T11:51:34.437 INFO:tasks.workunit.client.0.smithi063.stdout:3/0: creat f0 x:0 0 0 2023-12-12T11:51:34.437 INFO:tasks.workunit.client.0.smithi063.stdout:4/0: link - no file 2023-12-12T11:51:34.443 INFO:tasks.workunit.client.0.smithi063.stdout:5/0: dread - no filename 2023-12-12T11:51:34.443 INFO:tasks.workunit.client.0.smithi063.stdout:5/1: write - no filename 2023-12-12T11:51:34.443 INFO:tasks.workunit.client.0.smithi063.stdout:5/2: readlink - no filename 2023-12-12T11:51:34.443 INFO:tasks.workunit.client.0.smithi063.stdout:5/3: write - no filename 2023-12-12T11:51:34.443 INFO:tasks.workunit.client.0.smithi063.stdout:5/4: unlink - no file 2023-12-12T11:51:34.443 INFO:tasks.workunit.client.0.smithi063.stdout:5/5: dread - no filename 2023-12-12T11:51:34.444 INFO:tasks.workunit.client.0.smithi063.stdout:4/1: creat f0 x:0 0 0 2023-12-12T11:51:34.444 INFO:tasks.workunit.client.0.smithi063.stdout:4/2: readlink - no filename 2023-12-12T11:51:34.446 INFO:tasks.workunit.client.0.smithi063.stdout:5/6: symlink l0 0 2023-12-12T11:51:34.446 INFO:tasks.workunit.client.0.smithi063.stdout:5/7: write - no filename 2023-12-12T11:51:34.446 INFO:tasks.workunit.client.0.smithi063.stdout:5/8: readlink l0 0 2023-12-12T11:51:34.446 INFO:tasks.workunit.client.0.smithi063.stdout:5/9: dread - no filename 2023-12-12T11:51:34.447 INFO:tasks.workunit.client.0.smithi063.stdout:4/3: symlink l1 0 2023-12-12T11:51:34.449 INFO:tasks.workunit.client.0.smithi063.stdout:4/4: mkdir d2 0 2023-12-12T11:51:34.476 INFO:tasks.workunit.client.0.smithi063.stdout:4/5: rename f0 to d2/f3 0 2023-12-12T11:51:34.476 INFO:tasks.workunit.client.0.smithi063.stdout:7/0: symlink l0 0 2023-12-12T11:51:34.476 INFO:tasks.workunit.client.0.smithi063.stdout:7/1: dwrite - no filename 2023-12-12T11:51:34.486 INFO:tasks.workunit.client.0.smithi063.stdout:9/0: write - no filename 2023-12-12T11:51:34.486 INFO:tasks.workunit.client.0.smithi063.stdout:9/1: fdatasync - no filename 2023-12-12T11:51:34.486 INFO:tasks.workunit.client.0.smithi063.stdout:9/2: chown . 7 1 2023-12-12T11:51:34.486 INFO:tasks.workunit.client.0.smithi063.stdout:9/3: chown . 2960937 1 2023-12-12T11:51:34.486 INFO:tasks.workunit.client.0.smithi063.stdout:9/4: rename - no filename 2023-12-12T11:51:34.486 INFO:tasks.workunit.client.0.smithi063.stdout:7/2: symlink l1 0 2023-12-12T11:51:34.486 INFO:tasks.workunit.client.0.smithi063.stdout:7/3: dwrite - no filename 2023-12-12T11:51:34.486 INFO:tasks.workunit.client.0.smithi063.stdout:7/4: stat l0 0 2023-12-12T11:51:34.487 INFO:tasks.workunit.client.0.smithi063.stdout:7/5: rmdir - no directory 2023-12-12T11:51:34.487 INFO:tasks.workunit.client.0.smithi063.stdout:7/6: truncate - no filename 2023-12-12T11:51:34.487 INFO:tasks.workunit.client.0.smithi063.stdout:7/7: stat l1 0 2023-12-12T11:51:34.487 INFO:tasks.workunit.client.0.smithi063.stdout:7/8: write - no filename 2023-12-12T11:51:34.490 INFO:tasks.workunit.client.0.smithi063.stdout:8/0: creat f0 x:0 0 0 2023-12-12T11:51:34.490 INFO:tasks.workunit.client.0.smithi063.stdout:9/5: creat f0 x:0 0 0 2023-12-12T11:51:34.490 INFO:tasks.workunit.client.0.smithi063.stdout:9/6: rmdir - no directory 2023-12-12T11:51:34.490 INFO:tasks.workunit.client.0.smithi063.stdout:8/1: dread - f0 zero size 2023-12-12T11:51:34.492 INFO:tasks.workunit.client.0.smithi063.stdout:7/9: mknod c2 0 2023-12-12T11:51:34.492 INFO:tasks.workunit.client.0.smithi063.stdout:7/10: chown l1 1 1 2023-12-12T11:51:34.493 INFO:tasks.workunit.client.0.smithi063.stdout:7/11: dwrite - no filename 2023-12-12T11:51:34.493 INFO:tasks.workunit.client.0.smithi063.stdout:7/12: chown l0 1 1 2023-12-12T11:51:34.503 INFO:tasks.workunit.client.0.smithi063.stdout:9/7: symlink l1 0 2023-12-12T11:51:34.503 INFO:tasks.workunit.client.0.smithi063.stdout:9/8: read - f0 zero size 2023-12-12T11:51:34.511 INFO:tasks.workunit.client.0.smithi063.stdout:9/9: mknod c2 0 2023-12-12T11:51:34.511 INFO:tasks.workunit.client.0.smithi063.stdout:9/10: chown c2 18399 1 2023-12-12T11:51:34.524 INFO:tasks.workunit.client.0.smithi063.stdout:6/13: dread f0 [0,4194304] 0 2023-12-12T11:51:34.524 INFO:tasks.workunit.client.0.smithi063.stdout:6/14: creat f4 x:0 0 0 2023-12-12T11:51:34.524 INFO:tasks.workunit.client.0.smithi063.stdout:6/15: readlink l3 0 2023-12-12T11:51:34.524 INFO:tasks.workunit.client.0.smithi063.stdout:6/16: write f4 [522907,10970] 0 2023-12-12T11:51:34.525 INFO:tasks.workunit.client.0.smithi063.stdout:6/17: write f0 [1474010,80850] 0 2023-12-12T11:51:34.525 INFO:tasks.workunit.client.0.smithi063.stdout:6/18: rmdir - no directory 2023-12-12T11:51:34.739 INFO:tasks.workunit.client.0.smithi063.stdout:3/1: dwrite f0 [0,4194304] 0 2023-12-12T11:51:34.868 INFO:tasks.workunit.client.0.smithi063.stdout:6/19: dread f0 [0,4194304] 0 2023-12-12T11:51:34.869 INFO:tasks.workunit.client.0.smithi063.stdout:6/20: creat f5 x:0 0 0 2023-12-12T11:51:34.893 INFO:tasks.workunit.client.0.smithi063.stdout:2/2: dwrite d0/f1 [0,4194304] 0 2023-12-12T11:51:35.074 INFO:tasks.workunit.client.0.smithi063.stdout:1/13: getdents . 0 2023-12-12T11:51:35.074 INFO:tasks.workunit.client.0.smithi063.stdout:1/14: getdents . 0 2023-12-12T11:51:35.074 INFO:tasks.workunit.client.0.smithi063.stdout:1/15: chown c0 1 1 2023-12-12T11:51:35.074 INFO:tasks.workunit.client.0.smithi063.stdout:1/16: getdents . 0 2023-12-12T11:51:35.074 INFO:tasks.workunit.client.0.smithi063.stdout:1/17: dread - no filename 2023-12-12T11:51:35.074 INFO:tasks.workunit.client.0.smithi063.stdout:5/10: getdents . 0 2023-12-12T11:51:35.075 INFO:tasks.workunit.client.0.smithi063.stdout:4/6: getdents d2 0 2023-12-12T11:51:35.075 INFO:tasks.workunit.client.0.smithi063.stdout:8/2: getdents . 0 2023-12-12T11:51:35.075 INFO:tasks.workunit.client.0.smithi063.stdout:9/11: fsync f0 0 2023-12-12T11:51:35.075 INFO:tasks.workunit.client.0.smithi063.stdout:8/3: getdents . 0 2023-12-12T11:51:35.075 INFO:tasks.workunit.client.0.smithi063.stdout:8/4: fsync f0 0 2023-12-12T11:51:35.075 INFO:tasks.workunit.client.0.smithi063.stdout:9/12: truncate f0 810572 0 2023-12-12T11:51:35.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:34 smithi093 ceph-mon[115914]: pgmap v228: 65 pgs: 65 active+clean; 319 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 14 MiB/s rd, 20 MiB/s wr, 485 op/s 2023-12-12T11:51:35.286 INFO:tasks.workunit.client.0.smithi063.stdout:3/2: mknod c1 0 2023-12-12T11:51:35.286 INFO:tasks.workunit.client.0.smithi063.stdout:1/18: mknod c1 0 2023-12-12T11:51:35.286 INFO:tasks.workunit.client.0.smithi063.stdout:1/19: dwrite - no filename 2023-12-12T11:51:35.288 INFO:tasks.workunit.client.0.smithi063.stdout:5/11: creat f1 x:0 0 0 2023-12-12T11:51:35.288 INFO:tasks.workunit.client.0.smithi063.stdout:5/12: rmdir - no directory 2023-12-12T11:51:35.288 INFO:tasks.workunit.client.0.smithi063.stdout:5/13: read - f1 zero size 2023-12-12T11:51:35.288 INFO:tasks.workunit.client.0.smithi063.stdout:5/14: write f1 [175821,22844] 0 2023-12-12T11:51:35.288 INFO:tasks.workunit.client.0.smithi063.stdout:5/15: read f1 [194746,51413] 0 2023-12-12T11:51:35.288 INFO:tasks.workunit.client.0.smithi063.stdout:5/16: readlink l0 0 2023-12-12T11:51:35.289 INFO:tasks.workunit.client.0.smithi063.stdout:4/7: rename d2/f3 to d2/f4 0 2023-12-12T11:51:35.289 INFO:tasks.workunit.client.0.smithi063.stdout:9/13: mknod c3 0 2023-12-12T11:51:35.290 INFO:tasks.workunit.client.0.smithi063.stdout:8/5: creat f1 x:0 0 0 2023-12-12T11:51:35.290 INFO:tasks.workunit.client.0.smithi063.stdout:8/6: write f1 [102390,16724] 0 2023-12-12T11:51:35.291 INFO:tasks.workunit.client.0.smithi063.stdout:8/7: stat f1 0 2023-12-12T11:51:35.291 INFO:tasks.workunit.client.0.smithi063.stdout:8/8: chown f0 22665 1 2023-12-12T11:51:35.292 INFO:tasks.workunit.client.0.smithi063.stdout:6/21: link f4 f6 0 2023-12-12T11:51:35.293 INFO:tasks.workunit.client.0.smithi063.stdout:1/20: creat f2 x:0 0 0 2023-12-12T11:51:35.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:34 smithi063 ceph-mon[107117]: pgmap v228: 65 pgs: 65 active+clean; 319 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 14 MiB/s rd, 20 MiB/s wr, 485 op/s 2023-12-12T11:51:35.295 INFO:tasks.workunit.client.0.smithi063.stdout:5/17: unlink f1 0 2023-12-12T11:51:35.296 INFO:tasks.workunit.client.0.smithi063.stdout:4/8: symlink d2/l5 0 2023-12-12T11:51:35.297 INFO:tasks.workunit.client.0.smithi063.stdout:4/9: write d2/f4 [639505,12148] 0 2023-12-12T11:51:35.299 INFO:tasks.workunit.client.0.smithi063.stdout:6/22: rename c1 to c7 0 2023-12-12T11:51:35.300 INFO:tasks.workunit.client.0.smithi063.stdout:3/3: dread f0 [0,4194304] 0 2023-12-12T11:51:35.300 INFO:tasks.workunit.client.0.smithi063.stdout:3/4: readlink - no filename 2023-12-12T11:51:35.300 INFO:tasks.workunit.client.0.smithi063.stdout:1/21: mkdir d3 0 2023-12-12T11:51:35.300 INFO:tasks.workunit.client.0.smithi063.stdout:1/22: fdatasync f2 0 2023-12-12T11:51:35.300 INFO:tasks.workunit.client.0.smithi063.stdout:1/23: getdents d3 0 2023-12-12T11:51:35.301 INFO:tasks.workunit.client.0.smithi063.stdout:5/18: rename l0 to l2 0 2023-12-12T11:51:35.302 INFO:tasks.workunit.client.0.smithi063.stdout:8/9: dread f1 [0,4194304] 0 2023-12-12T11:51:35.304 INFO:tasks.workunit.client.0.smithi063.stdout:3/5: link c1 c2 0 2023-12-12T11:51:35.305 INFO:tasks.workunit.client.0.smithi063.stdout:1/24: mknod d3/c4 0 2023-12-12T11:51:35.306 INFO:tasks.workunit.client.0.smithi063.stdout:5/19: mknod c3 0 2023-12-12T11:51:35.307 INFO:tasks.workunit.client.0.smithi063.stdout:5/20: creat f4 x:0 0 0 2023-12-12T11:51:35.308 INFO:tasks.workunit.client.0.smithi063.stdout:3/6: rename c2 to c3 0 2023-12-12T11:51:35.310 INFO:tasks.workunit.client.0.smithi063.stdout:1/25: mkdir d3/d5 0 2023-12-12T11:51:35.310 INFO:tasks.workunit.client.0.smithi063.stdout:1/26: readlink - no filename 2023-12-12T11:51:35.311 INFO:tasks.workunit.client.0.smithi063.stdout:1/27: stat c0 0 2023-12-12T11:51:35.313 INFO:tasks.workunit.client.0.smithi063.stdout:4/10: dread d2/f4 [0,4194304] 0 2023-12-12T11:51:35.314 INFO:tasks.workunit.client.0.smithi063.stdout:5/21: symlink l5 0 2023-12-12T11:51:35.314 INFO:tasks.workunit.client.0.smithi063.stdout:5/22: read - f4 zero size 2023-12-12T11:51:35.314 INFO:tasks.workunit.client.0.smithi063.stdout:5/23: creat f6 x:0 0 0 2023-12-12T11:51:35.315 INFO:tasks.workunit.client.0.smithi063.stdout:5/24: chown f6 63146 1 2023-12-12T11:51:35.320 INFO:tasks.workunit.client.0.smithi063.stdout:1/28: mknod d3/c6 0 2023-12-12T11:51:35.320 INFO:tasks.workunit.client.0.smithi063.stdout:4/11: creat d2/f6 x:0 0 0 2023-12-12T11:51:35.320 INFO:tasks.workunit.client.0.smithi063.stdout:4/12: dread - d2/f6 zero size 2023-12-12T11:51:35.324 INFO:tasks.workunit.client.0.smithi063.stdout:4/13: mknod d2/c7 0 2023-12-12T11:51:35.324 INFO:tasks.workunit.client.0.smithi063.stdout:4/14: write d2/f6 [981715,102472] 0 2023-12-12T11:51:35.331 INFO:tasks.workunit.client.0.smithi063.stdout:3/7: dread f0 [0,4194304] 0 2023-12-12T11:51:35.354 INFO:tasks.workunit.client.0.smithi063.stdout:6/23: dwrite f5 [0,4194304] 0 2023-12-12T11:51:35.374 INFO:tasks.workunit.client.0.smithi063.stdout:6/24: truncate f4 324692 0 2023-12-12T11:51:35.375 INFO:tasks.workunit.client.0.smithi063.stdout:4/15: dread d2/f4 [0,4194304] 0 2023-12-12T11:51:35.380 INFO:tasks.workunit.client.0.smithi063.stdout:4/16: mkdir d2/d8 0 2023-12-12T11:51:35.387 INFO:tasks.workunit.client.0.smithi063.stdout:8/10: dwrite f0 [0,4194304] 0 2023-12-12T11:51:35.390 INFO:tasks.workunit.client.0.smithi063.stdout:6/25: dread f0 [0,4194304] 0 2023-12-12T11:51:35.395 INFO:tasks.workunit.client.0.smithi063.stdout:2/3: dwrite d0/f1 [4194304,4194304] 0 2023-12-12T11:51:35.396 INFO:tasks.workunit.client.0.smithi063.stdout:8/11: link f1 f2 0 2023-12-12T11:51:35.396 INFO:tasks.workunit.client.0.smithi063.stdout:8/12: creat f3 x:0 0 0 2023-12-12T11:51:35.402 INFO:tasks.workunit.client.0.smithi063.stdout:8/13: mkdir d4 0 2023-12-12T11:51:35.405 INFO:tasks.workunit.client.0.smithi063.stdout:2/4: rmdir d0 39 2023-12-12T11:51:35.406 INFO:tasks.workunit.client.0.smithi063.stdout:2/5: chown d0 7162 1 2023-12-12T11:51:35.406 INFO:tasks.workunit.client.0.smithi063.stdout:4/17: dread d2/f6 [0,4194304] 0 2023-12-12T11:51:35.407 INFO:tasks.workunit.client.0.smithi063.stdout:8/14: symlink d4/l5 0 2023-12-12T11:51:35.408 INFO:tasks.workunit.client.0.smithi063.stdout:4/18: link d2/f6 d2/f9 0 2023-12-12T11:51:35.409 INFO:tasks.workunit.client.0.smithi063.stdout:8/15: rmdir d4 39 2023-12-12T11:51:35.414 INFO:tasks.workunit.client.0.smithi063.stdout:1/29: dwrite f2 [0,4194304] 0 2023-12-12T11:51:35.415 INFO:tasks.workunit.client.0.smithi063.stdout:3/8: dwrite f0 [0,4194304] 0 2023-12-12T11:51:35.415 INFO:tasks.workunit.client.0.smithi063.stdout:3/9: chown c3 49080 1 2023-12-12T11:51:35.415 INFO:tasks.workunit.client.0.smithi063.stdout:3/10: chown c1 2691696 1 2023-12-12T11:51:35.416 INFO:tasks.workunit.client.0.smithi063.stdout:4/19: rename d2/f4 to d2/d8/fa 0 2023-12-12T11:51:35.416 INFO:tasks.workunit.client.0.smithi063.stdout:5/25: dwrite f6 [0,4194304] 0 2023-12-12T11:51:35.420 INFO:tasks.workunit.client.0.smithi063.stdout:9/14: getdents . 0 2023-12-12T11:51:35.421 INFO:tasks.workunit.client.0.smithi063.stdout:3/11: mkdir d4 0 2023-12-12T11:51:35.423 INFO:tasks.workunit.client.0.smithi063.stdout:4/20: rename d2/c7 to d2/d8/cb 0 2023-12-12T11:51:35.423 INFO:tasks.workunit.client.0.smithi063.stdout:3/12: rename d4 to d4/d5 22 2023-12-12T11:51:35.423 INFO:tasks.workunit.client.0.smithi063.stdout:3/13: write f0 [5202897,43196] 0 2023-12-12T11:51:35.425 INFO:tasks.workunit.client.0.smithi063.stdout:4/21: mknod d2/cc 0 2023-12-12T11:51:35.427 INFO:tasks.workunit.client.0.smithi063.stdout:4/22: rmdir d2/d8 39 2023-12-12T11:51:35.429 INFO:tasks.workunit.client.0.smithi063.stdout:4/23: symlink d2/d8/ld 0 2023-12-12T11:51:35.429 INFO:tasks.workunit.client.0.smithi063.stdout:4/24: readlink l1 0 2023-12-12T11:51:35.432 INFO:tasks.workunit.client.0.smithi063.stdout:4/25: creat d2/d8/fe x:0 0 0 2023-12-12T11:51:35.432 INFO:tasks.workunit.client.0.smithi063.stdout:4/26: rename d2/d8 to d2/d8/df 22 2023-12-12T11:51:35.437 INFO:tasks.workunit.client.0.smithi063.stdout:1/30: dread f2 [0,4194304] 0 2023-12-12T11:51:35.439 INFO:tasks.workunit.client.0.smithi063.stdout:1/31: rmdir d3/d5 0 2023-12-12T11:51:35.449 INFO:tasks.workunit.client.0.smithi063.stdout:4/27: fsync d2/f6 0 2023-12-12T11:51:35.449 INFO:tasks.workunit.client.0.smithi063.stdout:4/28: creat d2/f10 x:0 0 0 2023-12-12T11:51:35.454 INFO:tasks.workunit.client.0.smithi063.stdout:2/6: dwrite d0/f1 [4194304,4194304] 0 2023-12-12T11:51:35.456 INFO:tasks.workunit.client.0.smithi063.stdout:5/26: write f6 [4147853,6273] 0 2023-12-12T11:51:35.456 INFO:tasks.workunit.client.0.smithi063.stdout:6/26: write f6 [1830,37801] 0 2023-12-12T11:51:35.457 INFO:tasks.workunit.client.0.smithi063.stdout:2/7: rmdir d0 39 2023-12-12T11:51:35.457 INFO:tasks.workunit.client.0.smithi063.stdout:9/15: truncate f0 518766 0 2023-12-12T11:51:35.460 INFO:tasks.workunit.client.0.smithi063.stdout:5/27: mkdir d7 0 2023-12-12T11:51:35.460 INFO:tasks.workunit.client.0.smithi063.stdout:5/28: chown f6 5634124 1 2023-12-12T11:51:35.460 INFO:tasks.workunit.client.0.smithi063.stdout:6/27: mknod c8 0 2023-12-12T11:51:35.462 INFO:tasks.workunit.client.0.smithi063.stdout:4/29: truncate d2/f9 496006 0 2023-12-12T11:51:35.462 INFO:tasks.workunit.client.0.smithi063.stdout:4/30: stat d2/cc 0 2023-12-12T11:51:35.462 INFO:tasks.workunit.client.0.smithi063.stdout:6/28: mkdir d9 0 2023-12-12T11:51:35.466 INFO:tasks.workunit.client.0.smithi063.stdout:4/31: rename d2/cc to d2/d8/c11 0 2023-12-12T11:51:35.466 INFO:tasks.workunit.client.0.smithi063.stdout:4/32: creat d2/d8/f12 x:0 0 0 2023-12-12T11:51:35.467 INFO:tasks.workunit.client.0.smithi063.stdout:6/29: mknod d9/ca 0 2023-12-12T11:51:35.467 INFO:tasks.workunit.client.0.smithi063.stdout:6/30: chown d9/ca 11 1 2023-12-12T11:51:35.472 INFO:tasks.workunit.client.0.smithi063.stdout:4/33: mknod d2/c13 0 2023-12-12T11:51:35.475 INFO:tasks.workunit.client.0.smithi063.stdout:8/16: dwrite f1 [0,4194304] 0 2023-12-12T11:51:35.487 INFO:tasks.workunit.client.0.smithi063.stdout:5/29: dread f6 [0,4194304] 0 2023-12-12T11:51:35.498 INFO:tasks.workunit.client.0.smithi063.stdout:3/14: dwrite f0 [0,4194304] 0 2023-12-12T11:51:35.501 INFO:tasks.workunit.client.0.smithi063.stdout:3/15: creat d4/f6 x:0 0 0 2023-12-12T11:51:35.501 INFO:tasks.workunit.client.0.smithi063.stdout:3/16: chown d4 378777 1 2023-12-12T11:51:35.520 INFO:tasks.workunit.client.0.smithi063.stdout:2/8: dwrite d0/f1 [4194304,4194304] 0 2023-12-12T11:51:35.527 INFO:tasks.workunit.client.0.smithi063.stdout:9/16: dwrite f0 [0,4194304] 0 2023-12-12T11:51:35.527 INFO:tasks.workunit.client.0.smithi063.stdout:6/31: dread f5 [0,4194304] 0 2023-12-12T11:51:35.529 INFO:tasks.workunit.client.0.smithi063.stdout:2/9: rmdir d0 39 2023-12-12T11:51:35.530 INFO:tasks.workunit.client.0.smithi063.stdout:2/10: symlink d0/l2 0 2023-12-12T11:51:35.530 INFO:tasks.workunit.client.0.smithi063.stdout:6/32: creat d9/fb x:0 0 0 2023-12-12T11:51:35.531 INFO:tasks.workunit.client.0.smithi063.stdout:6/33: creat d9/fc x:0 0 0 2023-12-12T11:51:35.531 INFO:tasks.workunit.client.0.smithi063.stdout:6/34: creat d9/fd x:0 0 0 2023-12-12T11:51:35.546 INFO:tasks.workunit.client.0.smithi063.stdout:8/17: dwrite f3 [0,4194304] 0 2023-12-12T11:51:35.546 INFO:tasks.workunit.client.0.smithi063.stdout:8/18: chown f0 51177682 1 2023-12-12T11:51:35.547 INFO:tasks.workunit.client.0.smithi063.stdout:8/19: stat f1 0 2023-12-12T11:51:35.547 INFO:tasks.workunit.client.0.smithi063.stdout:8/20: chown f1 1122088 1 2023-12-12T11:51:35.549 INFO:tasks.workunit.client.0.smithi063.stdout:3/17: dwrite d4/f6 [0,4194304] 0 2023-12-12T11:51:35.549 INFO:tasks.workunit.client.0.smithi063.stdout:3/18: readlink - no filename 2023-12-12T11:51:35.553 INFO:tasks.workunit.client.0.smithi063.stdout:4/34: dwrite d2/f10 [0,4194304] 0 2023-12-12T11:51:35.555 INFO:tasks.workunit.client.0.smithi063.stdout:4/35: mkdir d2/d8/d14 0 2023-12-12T11:51:35.556 INFO:tasks.workunit.client.0.smithi063.stdout:4/36: link d2/d8/c11 d2/c15 0 2023-12-12T11:51:35.556 INFO:tasks.workunit.client.0.smithi063.stdout:4/37: chown d2/f9 35091 1 2023-12-12T11:51:35.557 INFO:tasks.workunit.client.0.smithi063.stdout:4/38: mkdir d2/d8/d14/d16 0 2023-12-12T11:51:35.557 INFO:tasks.workunit.client.0.smithi063.stdout:4/39: truncate d2/f9 1253656 0 2023-12-12T11:51:35.558 INFO:tasks.workunit.client.0.smithi063.stdout:4/40: mkdir d2/d17 0 2023-12-12T11:51:35.562 INFO:tasks.workunit.client.0.smithi063.stdout:5/30: dwrite f6 [4194304,4194304] 0 2023-12-12T11:51:35.569 INFO:tasks.workunit.client.0.smithi063.stdout:5/31: symlink d7/l8 0 2023-12-12T11:51:35.569 INFO:tasks.workunit.client.0.smithi063.stdout:5/32: unlink f6 0 2023-12-12T11:51:35.569 INFO:tasks.workunit.client.0.smithi063.stdout:5/33: truncate f4 606092 0 2023-12-12T11:51:35.574 INFO:tasks.workunit.client.0.smithi063.stdout:8/21: write f3 [656973,116304] 0 2023-12-12T11:51:35.574 INFO:tasks.workunit.client.0.smithi063.stdout:8/22: readlink d4/l5 0 2023-12-12T11:51:35.574 INFO:tasks.workunit.client.0.smithi063.stdout:8/23: mknod d4/c6 0 2023-12-12T11:51:35.576 INFO:tasks.workunit.client.0.smithi063.stdout:8/24: link f3 d4/f7 0 2023-12-12T11:51:35.611 INFO:tasks.workunit.client.0.smithi063.stdout:2/11: dwrite d0/f1 [0,4194304] 0 2023-12-12T11:51:35.612 INFO:tasks.workunit.client.0.smithi063.stdout:2/12: rename d0/l2 to d0/l3 0 2023-12-12T11:51:35.612 INFO:tasks.workunit.client.0.smithi063.stdout:2/13: chown d0/f1 4 1 2023-12-12T11:51:35.613 INFO:tasks.workunit.client.0.smithi063.stdout:2/14: creat d0/f4 x:0 0 0 2023-12-12T11:51:35.613 INFO:tasks.workunit.client.0.smithi063.stdout:2/15: chown d0/f4 1552 1 2023-12-12T11:51:35.613 INFO:tasks.workunit.client.0.smithi063.stdout:2/16: creat d0/f5 x:0 0 0 2023-12-12T11:51:35.624 INFO:tasks.workunit.client.0.smithi063.stdout:6/35: dwrite d9/fc [0,4194304] 0 2023-12-12T11:51:35.624 INFO:tasks.workunit.client.0.smithi063.stdout:6/36: readlink l3 0 2023-12-12T11:51:35.624 INFO:tasks.workunit.client.0.smithi063.stdout:2/17: fsync d0/f4 0 2023-12-12T11:51:35.624 INFO:tasks.workunit.client.0.smithi063.stdout:2/18: truncate d0/f5 671294 0 2023-12-12T11:51:35.625 INFO:tasks.workunit.client.0.smithi063.stdout:2/19: creat d0/f6 x:0 0 0 2023-12-12T11:51:35.626 INFO:tasks.workunit.client.0.smithi063.stdout:6/37: symlink d9/le 0 2023-12-12T11:51:35.628 INFO:tasks.workunit.client.0.smithi063.stdout:3/19: dwrite d4/f6 [0,4194304] 0 2023-12-12T11:51:35.630 INFO:tasks.workunit.client.0.smithi063.stdout:3/20: rmdir d4 39 2023-12-12T11:51:35.633 INFO:tasks.workunit.client.0.smithi063.stdout:2/20: dread d0/f5 [0,4194304] 0 2023-12-12T11:51:35.633 INFO:tasks.workunit.client.0.smithi063.stdout:5/34: dwrite f4 [0,4194304] 0 2023-12-12T11:51:35.636 INFO:tasks.workunit.client.0.smithi063.stdout:5/35: creat d7/f9 x:0 0 0 2023-12-12T11:51:35.636 INFO:tasks.workunit.client.0.smithi063.stdout:2/21: rmdir d0 39 2023-12-12T11:51:35.637 INFO:tasks.workunit.client.0.smithi063.stdout:5/36: write d7/f9 [762089,118430] 0 2023-12-12T11:51:35.638 INFO:tasks.workunit.client.0.smithi063.stdout:5/37: write d7/f9 [1374125,24673] 0 2023-12-12T11:51:35.638 INFO:tasks.workunit.client.0.smithi063.stdout:5/38: write d7/f9 [1340159,78800] 0 2023-12-12T11:51:35.638 INFO:tasks.workunit.client.0.smithi063.stdout:2/22: unlink d0/f1 0 2023-12-12T11:51:35.642 INFO:tasks.workunit.client.0.smithi063.stdout:5/39: unlink f4 0 2023-12-12T11:51:35.644 INFO:tasks.workunit.client.0.smithi063.stdout:5/40: unlink l5 0 2023-12-12T11:51:35.645 INFO:tasks.workunit.client.0.smithi063.stdout:5/41: rename c3 to d7/ca 0 2023-12-12T11:51:35.645 INFO:tasks.workunit.client.0.smithi063.stdout:5/42: write d7/f9 [1837072,48227] 0 2023-12-12T11:51:35.645 INFO:tasks.workunit.client.0.smithi063.stdout:5/43: readlink d7/l8 0 2023-12-12T11:51:35.646 INFO:tasks.workunit.client.0.smithi063.stdout:5/44: chown d7/l8 3069 1 2023-12-12T11:51:35.646 INFO:tasks.workunit.client.0.smithi063.stdout:5/45: write d7/f9 [1149425,51732] 0 2023-12-12T11:51:35.647 INFO:tasks.workunit.client.0.smithi063.stdout:5/46: symlink d7/lb 0 2023-12-12T11:51:35.647 INFO:tasks.workunit.client.0.smithi063.stdout:2/23: dread d0/f5 [0,4194304] 0 2023-12-12T11:51:35.648 INFO:tasks.workunit.client.0.smithi063.stdout:5/47: link d7/lb d7/lc 0 2023-12-12T11:51:35.649 INFO:tasks.workunit.client.0.smithi063.stdout:8/25: dwrite f3 [0,4194304] 0 2023-12-12T11:51:35.649 INFO:tasks.workunit.client.0.smithi063.stdout:3/21: dread f0 [0,4194304] 0 2023-12-12T11:51:35.650 INFO:tasks.workunit.client.0.smithi063.stdout:3/22: chown c1 2921 1 2023-12-12T11:51:35.651 INFO:tasks.workunit.client.0.smithi063.stdout:5/48: mknod d7/cd 0 2023-12-12T11:51:35.653 INFO:tasks.workunit.client.0.smithi063.stdout:8/26: creat d4/f8 x:0 0 0 2023-12-12T11:51:35.653 INFO:tasks.workunit.client.0.smithi063.stdout:5/49: mkdir d7/de 0 2023-12-12T11:51:35.654 INFO:tasks.workunit.client.0.smithi063.stdout:5/50: creat d7/ff x:0 0 0 2023-12-12T11:51:35.654 INFO:tasks.workunit.client.0.smithi063.stdout:5/51: truncate d7/ff 127739 0 2023-12-12T11:51:35.656 INFO:tasks.workunit.client.0.smithi063.stdout:5/52: write d7/f9 [1510375,8927] 0 2023-12-12T11:51:35.657 INFO:tasks.workunit.client.0.smithi063.stdout:5/53: mkdir d7/d10 0 2023-12-12T11:51:35.668 INFO:tasks.workunit.client.0.smithi063.stdout:5/54: truncate d7/f9 968989 0 2023-12-12T11:51:35.668 INFO:tasks.workunit.client.0.smithi063.stdout:5/55: mknod d7/d10/c11 0 2023-12-12T11:51:35.669 INFO:tasks.workunit.client.0.smithi063.stdout:5/56: chown d7/lc 1063 1 2023-12-12T11:51:35.669 INFO:tasks.workunit.client.0.smithi063.stdout:5/57: creat d7/f12 x:0 0 0 2023-12-12T11:51:35.701 INFO:tasks.workunit.client.0.smithi063.stdout:6/38: dwrite d9/fc [4194304,4194304] 0 2023-12-12T11:51:35.703 INFO:tasks.workunit.client.0.smithi063.stdout:6/39: mknod d9/cf 0 2023-12-12T11:51:35.711 INFO:tasks.workunit.client.0.smithi063.stdout:6/40: read f0 [699154,88909] 0 2023-12-12T11:51:35.721 INFO:tasks.workunit.client.0.smithi063.stdout:6/41: read f5 [1165813,107695] 0 2023-12-12T11:51:35.721 INFO:tasks.workunit.client.0.smithi063.stdout:6/42: dread - d9/fb zero size 2023-12-12T11:51:35.722 INFO:tasks.workunit.client.0.smithi063.stdout:6/43: mkdir d9/d10 0 2023-12-12T11:51:35.722 INFO:tasks.workunit.client.0.smithi063.stdout:8/27: dwrite f1 [0,4194304] 0 2023-12-12T11:51:35.722 INFO:tasks.workunit.client.0.smithi063.stdout:8/28: chown d4/f7 7 1 2023-12-12T11:51:35.723 INFO:tasks.workunit.client.0.smithi063.stdout:3/23: dwrite d4/f6 [0,4194304] 0 2023-12-12T11:51:35.734 INFO:tasks.workunit.client.0.smithi063.stdout:6/44: dread d9/fc [4194304,4194304] 0 2023-12-12T11:51:35.735 INFO:tasks.workunit.client.0.smithi063.stdout:6/45: symlink d9/d10/l11 0 2023-12-12T11:51:35.739 INFO:tasks.workunit.client.0.smithi063.stdout:5/58: dwrite d7/ff [0,4194304] 0 2023-12-12T11:51:35.746 INFO:tasks.workunit.client.0.smithi063.stdout:3/24: read d4/f6 [3126488,86525] 0 2023-12-12T11:51:35.748 INFO:tasks.workunit.client.0.smithi063.stdout:3/25: creat d4/f7 x:0 0 0 2023-12-12T11:51:35.755 INFO:tasks.workunit.client.0.smithi063.stdout:5/59: write d7/ff [2929326,49208] 0 2023-12-12T11:51:35.776 INFO:tasks.workunit.client.0.smithi063.stdout:8/29: dwrite f0 [0,4194304] 0 2023-12-12T11:51:35.778 INFO:tasks.workunit.client.0.smithi063.stdout:8/30: getdents d4 0 2023-12-12T11:51:35.779 INFO:tasks.workunit.client.0.smithi063.stdout:8/31: symlink d4/l9 0 2023-12-12T11:51:35.779 INFO:tasks.workunit.client.0.smithi063.stdout:8/32: chown f1 656600 1 2023-12-12T11:51:35.779 INFO:tasks.workunit.client.0.smithi063.stdout:8/33: dread - d4/f8 zero size 2023-12-12T11:51:35.779 INFO:tasks.workunit.client.0.smithi063.stdout:8/34: chown d4 14798 1 2023-12-12T11:51:35.779 INFO:tasks.workunit.client.0.smithi063.stdout:8/35: chown d4/l9 133190275 1 2023-12-12T11:51:35.781 INFO:tasks.workunit.client.0.smithi063.stdout:8/36: rename d4/l5 to d4/la 0 2023-12-12T11:51:35.781 INFO:tasks.workunit.client.0.smithi063.stdout:8/37: rmdir d4 39 2023-12-12T11:51:35.797 INFO:tasks.workunit.client.0.smithi063.stdout:6/46: dwrite f0 [0,4194304] 0 2023-12-12T11:51:35.797 INFO:tasks.workunit.client.0.smithi063.stdout:3/26: dread d4/f6 [0,4194304] 0 2023-12-12T11:51:35.800 INFO:tasks.workunit.client.0.smithi063.stdout:8/38: dread f2 [0,4194304] 0 2023-12-12T11:51:35.802 INFO:tasks.workunit.client.0.smithi063.stdout:8/39: symlink d4/lb 0 2023-12-12T11:51:35.802 INFO:tasks.workunit.client.0.smithi063.stdout:8/40: chown d4/lb 315 1 2023-12-12T11:51:35.802 INFO:tasks.workunit.client.0.smithi063.stdout:8/41: write d4/f8 [903638,98511] 0 2023-12-12T11:51:35.821 INFO:tasks.workunit.client.0.smithi063.stdout:5/60: dwrite d7/f12 [0,4194304] 0 2023-12-12T11:51:35.821 INFO:tasks.workunit.client.0.smithi063.stdout:8/42: dread f0 [0,4194304] 0 2023-12-12T11:51:35.821 INFO:tasks.workunit.client.0.smithi063.stdout:5/61: write d7/ff [1450392,118525] 0 2023-12-12T11:51:35.821 INFO:tasks.workunit.client.0.smithi063.stdout:5/62: write d7/ff [4374079,57339] 0 2023-12-12T11:51:35.824 INFO:tasks.workunit.client.0.smithi063.stdout:8/43: symlink d4/lc 0 2023-12-12T11:51:35.825 INFO:tasks.workunit.client.0.smithi063.stdout:8/44: chown f1 44 1 2023-12-12T11:51:35.827 INFO:tasks.workunit.client.0.smithi063.stdout:5/63: unlink d7/lb 0 2023-12-12T11:51:35.830 INFO:tasks.workunit.client.0.smithi063.stdout:8/45: truncate f2 3525966 0 2023-12-12T11:51:35.841 INFO:tasks.workunit.client.0.smithi063.stdout:3/27: dwrite d4/f6 [4194304,4194304] 0 2023-12-12T11:51:35.841 INFO:tasks.workunit.client.0.smithi063.stdout:3/28: write d4/f7 [740660,81774] 0 2023-12-12T11:51:35.842 INFO:tasks.workunit.client.0.smithi063.stdout:5/64: write d7/f12 [3894311,96080] 0 2023-12-12T11:51:35.843 INFO:tasks.workunit.client.0.smithi063.stdout:5/65: chown d7/f9 10346629 1 2023-12-12T11:51:35.844 INFO:tasks.workunit.client.0.smithi063.stdout:8/46: write f1 [2442150,91227] 0 2023-12-12T11:51:35.844 INFO:tasks.workunit.client.0.smithi063.stdout:5/66: write d7/ff [197248,104171] 0 2023-12-12T11:51:35.845 INFO:tasks.workunit.client.0.smithi063.stdout:8/47: creat d4/fd x:0 0 0 2023-12-12T11:51:35.846 INFO:tasks.workunit.client.0.smithi063.stdout:8/48: mkdir d4/de 0 2023-12-12T11:51:35.852 INFO:tasks.workunit.client.0.smithi063.stdout:3/29: write f0 [3800869,97492] 0 2023-12-12T11:51:35.852 INFO:tasks.workunit.client.0.smithi063.stdout:5/67: fsync d7/ff 0 2023-12-12T11:51:35.853 INFO:tasks.workunit.client.0.smithi063.stdout:5/68: stat d7/cd 0 2023-12-12T11:51:35.855 INFO:tasks.workunit.client.0.smithi063.stdout:5/69: creat d7/f13 x:0 0 0 2023-12-12T11:51:35.874 INFO:tasks.workunit.client.0.smithi063.stdout:3/30: dread d4/f6 [0,4194304] 0 2023-12-12T11:51:35.895 INFO:tasks.workunit.client.0.smithi063.stdout:3/31: dread f0 [0,4194304] 0 2023-12-12T11:51:35.902 INFO:tasks.workunit.client.0.smithi063.stdout:8/49: dwrite d4/f8 [0,4194304] 0 2023-12-12T11:51:35.915 INFO:tasks.workunit.client.0.smithi063.stdout:3/32: dread d4/f6 [4194304,4194304] 0 2023-12-12T11:51:35.915 INFO:tasks.workunit.client.0.smithi063.stdout:3/33: mknod d4/c8 0 2023-12-12T11:51:35.916 INFO:tasks.workunit.client.0.smithi063.stdout:5/70: dwrite d7/f9 [0,4194304] 0 2023-12-12T11:51:35.916 INFO:tasks.workunit.client.0.smithi063.stdout:3/34: mknod d4/c9 0 2023-12-12T11:51:35.919 INFO:tasks.workunit.client.0.smithi063.stdout:5/71: creat d7/d10/f14 x:0 0 0 2023-12-12T11:51:35.925 INFO:tasks.workunit.client.0.smithi063.stdout:8/50: read d4/f7 [1287946,47261] 0 2023-12-12T11:51:35.971 INFO:tasks.workunit.client.0.smithi063.stdout:8/51: dread f0 [0,4194304] 0 2023-12-12T11:51:35.971 INFO:tasks.workunit.client.0.smithi063.stdout:8/52: fdatasync f3 0 2023-12-12T11:51:35.971 INFO:tasks.workunit.client.0.smithi063.stdout:5/72: dwrite d7/f13 [0,4194304] 0 2023-12-12T11:51:35.971 INFO:tasks.workunit.client.0.smithi063.stdout:5/73: fdatasync d7/f13 0 2023-12-12T11:51:35.973 INFO:tasks.workunit.client.0.smithi063.stdout:5/74: readlink d7/lc 0 2023-12-12T11:51:35.974 INFO:tasks.workunit.client.0.smithi063.stdout:5/75: creat d7/f15 x:0 0 0 2023-12-12T11:51:35.977 INFO:tasks.workunit.client.0.smithi063.stdout:3/35: dwrite d4/f6 [0,4194304] 0 2023-12-12T11:51:35.977 INFO:tasks.workunit.client.0.smithi063.stdout:3/36: write d4/f7 [1566263,104947] 0 2023-12-12T11:51:35.978 INFO:tasks.workunit.client.0.smithi063.stdout:5/76: link d7/ca d7/de/c16 0 2023-12-12T11:51:35.978 INFO:tasks.workunit.client.0.smithi063.stdout:5/77: write d7/f9 [4477560,55445] 0 2023-12-12T11:51:35.979 INFO:tasks.workunit.client.0.smithi063.stdout:3/37: symlink d4/la 0 2023-12-12T11:51:36.014 INFO:tasks.workunit.client.0.smithi063.stdout:8/53: dwrite f3 [0,4194304] 0 2023-12-12T11:51:36.019 INFO:tasks.workunit.client.0.smithi063.stdout:8/54: truncate d4/f8 1877299 0 2023-12-12T11:51:36.032 INFO:tasks.workunit.client.0.smithi063.stdout:8/55: read f3 [1102529,101677] 0 2023-12-12T11:51:36.032 INFO:tasks.workunit.client.0.smithi063.stdout:8/56: chown d4/f8 8 1 2023-12-12T11:51:36.032 INFO:tasks.workunit.client.0.smithi063.stdout:8/57: mkdir d4/de/df 0 2023-12-12T11:51:36.033 INFO:tasks.workunit.client.0.smithi063.stdout:8/58: read f2 [558095,124717] 0 2023-12-12T11:51:36.033 INFO:tasks.workunit.client.0.smithi063.stdout:8/59: symlink d4/de/l10 0 2023-12-12T11:51:36.034 INFO:tasks.workunit.client.0.smithi063.stdout:8/60: unlink d4/l9 0 2023-12-12T11:51:36.034 INFO:tasks.workunit.client.0.smithi063.stdout:8/61: read - d4/fd zero size 2023-12-12T11:51:36.036 INFO:tasks.workunit.client.0.smithi063.stdout:8/62: mkdir d4/de/d11 0 2023-12-12T11:51:36.036 INFO:tasks.workunit.client.0.smithi063.stdout:8/63: write d4/fd [78454,59493] 0 2023-12-12T11:51:36.036 INFO:tasks.workunit.client.0.smithi063.stdout:8/64: fdatasync d4/f7 0 2023-12-12T11:51:36.037 INFO:tasks.workunit.client.0.smithi063.stdout:8/65: rmdir d4/de/df 0 2023-12-12T11:51:36.037 INFO:tasks.workunit.client.0.smithi063.stdout:8/66: fdatasync f1 0 2023-12-12T11:51:36.037 INFO:tasks.workunit.client.0.smithi063.stdout:8/67: stat d4/lc 0 2023-12-12T11:51:36.038 INFO:tasks.workunit.client.0.smithi063.stdout:8/68: link d4/f7 d4/de/f12 0 2023-12-12T11:51:36.038 INFO:tasks.workunit.client.0.smithi063.stdout:8/69: truncate f1 3590063 0 2023-12-12T11:51:36.038 INFO:tasks.workunit.client.0.smithi063.stdout:8/70: chown f1 55347120 1 2023-12-12T11:51:36.039 INFO:tasks.workunit.client.0.smithi063.stdout:8/71: creat d4/de/f13 x:0 0 0 2023-12-12T11:51:36.039 INFO:tasks.workunit.client.0.smithi063.stdout:8/72: chown f1 313 1 2023-12-12T11:51:36.039 INFO:tasks.workunit.client.0.smithi063.stdout:8/73: stat d4 0 2023-12-12T11:51:36.039 INFO:tasks.workunit.client.0.smithi063.stdout:8/74: read f1 [241198,62202] 0 2023-12-12T11:51:36.078 INFO:tasks.workunit.client.0.smithi063.stdout:8/75: dwrite d4/f8 [0,4194304] 0 2023-12-12T11:51:36.079 INFO:tasks.workunit.client.0.smithi063.stdout:8/76: creat d4/de/d11/f14 x:0 0 0 2023-12-12T11:51:36.079 INFO:tasks.workunit.client.0.smithi063.stdout:8/77: mknod d4/de/d11/c15 0 2023-12-12T11:51:36.080 INFO:tasks.workunit.client.0.smithi063.stdout:8/78: symlink d4/de/d11/l16 0 2023-12-12T11:51:36.083 INFO:tasks.workunit.client.0.smithi063.stdout:8/79: link d4/de/d11/f14 d4/f17 0 2023-12-12T11:51:36.083 INFO:tasks.workunit.client.0.smithi063.stdout:8/80: read f1 [2873063,53941] 0 2023-12-12T11:51:36.083 INFO:tasks.workunit.client.0.smithi063.stdout:8/81: chown f0 1201594349 1 2023-12-12T11:51:36.083 INFO:tasks.workunit.client.0.smithi063.stdout:8/82: write d4/f8 [4616474,115544] 0 2023-12-12T11:51:36.083 INFO:tasks.workunit.client.0.smithi063.stdout:8/83: write f2 [497242,87395] 0 2023-12-12T11:51:36.120 INFO:tasks.workunit.client.0.smithi063.stdout:8/84: dwrite f1 [0,4194304] 0 2023-12-12T11:51:36.121 INFO:tasks.workunit.client.0.smithi063.stdout:8/85: read d4/fd [3222,122949] 0 2023-12-12T11:51:36.128 INFO:tasks.workunit.client.0.smithi063.stdout:8/86: rmdir d4 39 2023-12-12T11:51:36.129 INFO:tasks.workunit.client.0.smithi063.stdout:8/87: fdatasync d4/de/f12 0 2023-12-12T11:51:36.129 INFO:tasks.workunit.client.0.smithi063.stdout:8/88: creat d4/de/d11/f18 x:0 0 0 2023-12-12T11:51:36.134 INFO:tasks.workunit.client.0.smithi063.stdout:8/89: truncate d4/f7 146191 0 2023-12-12T11:51:36.144 INFO:tasks.workunit.client.0.smithi063.stdout:8/90: dread d4/fd [0,4194304] 0 2023-12-12T11:51:36.144 INFO:tasks.workunit.client.0.smithi063.stdout:8/91: chown d4 97055259 1 2023-12-12T11:51:36.144 INFO:tasks.workunit.client.0.smithi063.stdout:8/92: write d4/f8 [5512790,45800] 0 2023-12-12T11:51:36.144 INFO:tasks.workunit.client.0.smithi063.stdout:8/93: stat d4/lb 0 2023-12-12T11:51:36.144 INFO:tasks.workunit.client.0.smithi063.stdout:8/94: write d4/f17 [820012,12207] 0 2023-12-12T11:51:36.145 INFO:tasks.workunit.client.0.smithi063.stdout:8/95: creat d4/de/f19 x:0 0 0 2023-12-12T11:51:36.145 INFO:tasks.workunit.client.0.smithi063.stdout:8/96: write d4/de/d11/f14 [1555606,12986] 0 2023-12-12T11:51:36.145 INFO:tasks.workunit.client.0.smithi063.stdout:8/97: write d4/de/f12 [1134299,30199] 0 2023-12-12T11:51:36.147 INFO:tasks.workunit.client.0.smithi063.stdout:8/98: rename d4/de/f12 to d4/f1a 0 2023-12-12T11:51:36.147 INFO:tasks.workunit.client.0.smithi063.stdout:8/99: rmdir d4 39 2023-12-12T11:51:36.150 INFO:tasks.workunit.client.0.smithi063.stdout:8/100: fdatasync d4/de/d11/f14 0 2023-12-12T11:51:36.151 INFO:tasks.workunit.client.0.smithi063.stdout:8/101: symlink d4/l1b 0 2023-12-12T11:51:36.152 INFO:tasks.workunit.client.0.smithi063.stdout:8/102: mknod d4/de/d11/c1c 0 2023-12-12T11:51:36.152 INFO:tasks.workunit.client.0.smithi063.stdout:8/103: write d4/de/f13 [288235,4640] 0 2023-12-12T11:51:36.155 INFO:tasks.workunit.client.0.smithi063.stdout:8/104: getdents d4/de 0 2023-12-12T11:51:36.192 INFO:tasks.workunit.client.0.smithi063.stdout:8/105: dwrite f0 [0,4194304] 0 2023-12-12T11:51:36.192 INFO:tasks.workunit.client.0.smithi063.stdout:8/106: chown d4/f17 60999 1 2023-12-12T11:51:36.193 INFO:tasks.workunit.client.0.smithi063.stdout:8/107: chown d4/de/f19 1 1 2023-12-12T11:51:36.193 INFO:tasks.workunit.client.0.smithi063.stdout:8/108: rename d4/f1a to d4/f1d 0 2023-12-12T11:51:36.194 INFO:tasks.workunit.client.0.smithi063.stdout:8/109: mkdir d4/de/d1e 0 2023-12-12T11:51:36.195 INFO:tasks.workunit.client.0.smithi063.stdout:8/110: rmdir d4/de/d11 39 2023-12-12T11:51:36.198 INFO:tasks.workunit.client.0.smithi063.stdout:8/111: rename d4/de/d11/l16 to d4/de/d1e/l1f 0 2023-12-12T11:51:36.198 INFO:tasks.workunit.client.0.smithi063.stdout:8/112: stat f0 0 2023-12-12T11:51:36.199 INFO:tasks.workunit.client.0.smithi063.stdout:8/113: creat d4/de/d1e/f20 x:0 0 0 2023-12-12T11:51:36.199 INFO:tasks.workunit.client.0.smithi063.stdout:8/114: stat d4/f7 0 2023-12-12T11:51:36.201 INFO:tasks.workunit.client.0.smithi063.stdout:8/115: write d4/f17 [1196245,17099] 0 2023-12-12T11:51:36.205 INFO:tasks.workunit.client.0.smithi063.stdout:8/116: truncate d4/de/f13 167540 0 2023-12-12T11:51:36.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:35 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:51:36.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:35 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:51:37.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:36 smithi093 ceph-mon[115914]: pgmap v229: 65 pgs: 65 active+clean; 327 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 14 MiB/s rd, 18 MiB/s wr, 344 op/s 2023-12-12T11:51:37.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:36 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:51:37.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:36 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:51:37.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:36 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:51:37.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:36 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:51:37.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:36 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:51:37.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:36 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:51:37.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:36 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr fail", "who": "smithi063.zjnfdi"}]: dispatch 2023-12-12T11:51:37.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:36 smithi093 ceph-mon[115914]: osdmap e47: 6 total, 6 up, 6 in 2023-12-12T11:51:37.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:36 smithi093 ceph-mon[115914]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "mgr fail", "who": "smithi063.zjnfdi"}]': finished 2023-12-12T11:51:37.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:36 smithi093 ceph-mon[115914]: mgrmap e21: smithi093.nbtltu(active, starting, since 0.00806811s) 2023-12-12T11:51:37.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:36 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-12T11:51:37.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:36 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "mon metadata", "id": "smithi093"}]: dispatch 2023-12-12T11:51:37.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:36 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.aevpzg"}]: dispatch 2023-12-12T11:51:37.223 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:36 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi093.swdqms"}]: dispatch 2023-12-12T11:51:37.223 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:36 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.bdqbnp"}]: dispatch 2023-12-12T11:51:37.223 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:36 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi093.rhaqsh"}]: dispatch 2023-12-12T11:51:37.223 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:36 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "mgr metadata", "who": "smithi093.nbtltu", "id": "smithi093.nbtltu"}]: dispatch 2023-12-12T11:51:37.223 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:36 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-12T11:51:37.223 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:36 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-12T11:51:37.223 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:36 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-12T11:51:37.223 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:36 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-12T11:51:37.223 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:36 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-12T11:51:37.223 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:36 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-12T11:51:37.223 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:36 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-12T11:51:37.223 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:36 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-12T11:51:37.223 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:36 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-12T11:51:37.223 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:36 smithi093 ceph-mon[115914]: Manager daemon smithi093.nbtltu is now available 2023-12-12T11:51:37.238 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:36 smithi063 ceph-mon[107117]: pgmap v229: 65 pgs: 65 active+clean; 327 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 14 MiB/s rd, 18 MiB/s wr, 344 op/s 2023-12-12T11:51:37.239 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:36 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:51:37.239 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:36 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:51:37.239 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:36 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:51:37.239 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:36 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:51:37.239 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:36 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:51:37.239 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:36 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:51:37.239 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:36 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr fail", "who": "smithi063.zjnfdi"}]: dispatch 2023-12-12T11:51:37.239 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:36 smithi063 ceph-mon[107117]: osdmap e47: 6 total, 6 up, 6 in 2023-12-12T11:51:37.239 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:36 smithi063 ceph-mon[107117]: from='mgr.14208 172.21.15.63:0/4138203286' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "mgr fail", "who": "smithi063.zjnfdi"}]': finished 2023-12-12T11:51:37.239 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:36 smithi063 ceph-mon[107117]: mgrmap e21: smithi093.nbtltu(active, starting, since 0.00806811s) 2023-12-12T11:51:37.239 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:36 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-12T11:51:37.239 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:36 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "mon metadata", "id": "smithi093"}]: dispatch 2023-12-12T11:51:37.239 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:36 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.aevpzg"}]: dispatch 2023-12-12T11:51:37.240 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:36 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi093.swdqms"}]: dispatch 2023-12-12T11:51:37.240 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:36 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.bdqbnp"}]: dispatch 2023-12-12T11:51:37.240 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:36 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi093.rhaqsh"}]: dispatch 2023-12-12T11:51:37.240 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:36 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "mgr metadata", "who": "smithi093.nbtltu", "id": "smithi093.nbtltu"}]: dispatch 2023-12-12T11:51:37.240 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:36 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-12T11:51:37.240 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:36 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-12T11:51:37.240 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:36 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-12T11:51:37.240 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:36 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-12T11:51:37.240 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:36 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-12T11:51:37.240 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:36 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-12T11:51:37.240 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:36 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-12T11:51:37.240 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:36 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-12T11:51:37.240 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:36 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-12T11:51:37.241 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:36 smithi063 ceph-mon[107117]: Manager daemon smithi093.nbtltu is now available 2023-12-12T11:51:37.374 INFO:tasks.workunit.client.1.smithi093.stdout:8/25: sync 2023-12-12T11:51:37.374 INFO:tasks.workunit.client.1.smithi093.stdout:5/7: sync 2023-12-12T11:51:37.374 INFO:tasks.workunit.client.1.smithi093.stdout:2/84: sync 2023-12-12T11:51:37.374 INFO:tasks.workunit.client.1.smithi093.stdout:6/119: sync 2023-12-12T11:51:37.374 INFO:tasks.workunit.client.1.smithi093.stdout:7/22: sync 2023-12-12T11:51:37.374 INFO:tasks.workunit.client.1.smithi093.stdout:3/11: sync 2023-12-12T11:51:37.374 INFO:tasks.workunit.client.1.smithi093.stdout:4/158: sync 2023-12-12T11:51:37.374 INFO:tasks.workunit.client.1.smithi093.stdout:4/159: chown d0/d22/f29 22616168 1 2023-12-12T11:51:37.374 INFO:tasks.workunit.client.1.smithi093.stdout:1/42: sync 2023-12-12T11:51:37.375 INFO:tasks.workunit.client.1.smithi093.stdout:9/11: sync 2023-12-12T11:51:37.375 INFO:tasks.workunit.client.1.smithi093.stdout:1/43: fsync f1 0 2023-12-12T11:51:37.375 INFO:tasks.workunit.client.1.smithi093.stdout:7/23: fdatasync f0 0 2023-12-12T11:51:37.375 INFO:tasks.workunit.client.1.smithi093.stdout:0/38: sync 2023-12-12T11:51:37.375 INFO:tasks.workunit.client.1.smithi093.stdout:9/12: creat d1/f5 x:0 0 0 2023-12-12T11:51:37.375 INFO:tasks.workunit.client.1.smithi093.stdout:8/26: mkdir d3/d9 0 2023-12-12T11:51:37.376 INFO:tasks.workunit.client.1.smithi093.stdout:2/85: creat d5/f19 x:0 0 0 2023-12-12T11:51:37.381 INFO:tasks.workunit.client.1.smithi093.stdout:6/120: mknod d0/d19/c2b 0 2023-12-12T11:51:37.381 INFO:tasks.workunit.client.1.smithi093.stdout:4/160: mknod d0/d22/c2f 0 2023-12-12T11:51:37.381 INFO:tasks.workunit.client.1.smithi093.stdout:3/12: creat f3 x:0 0 0 2023-12-12T11:51:37.381 INFO:tasks.workunit.client.1.smithi093.stdout:4/161: creat d0/d22/f30 x:0 0 0 2023-12-12T11:51:37.381 INFO:tasks.workunit.client.1.smithi093.stdout:4/162: write d0/f18 [46746,128564] 0 2023-12-12T11:51:37.382 INFO:tasks.workunit.client.1.smithi093.stdout:1/44: read f1 [3522573,112464] 0 2023-12-12T11:51:37.399 INFO:tasks.workunit.client.1.smithi093.stdout:7/24: link c8 c9 0 2023-12-12T11:51:37.403 INFO:tasks.workunit.client.1.smithi093.stdout:0/39: truncate d5/f7 793656 0 2023-12-12T11:51:37.405 INFO:tasks.workunit.client.1.smithi093.stdout:9/13: rename d1/f3 to d1/f6 0 2023-12-12T11:51:37.418 INFO:tasks.workunit.client.1.smithi093.stdout:8/27: rmdir d3/d9 0 2023-12-12T11:51:37.418 INFO:tasks.workunit.client.1.smithi093.stdout:9/14: rename c0 to d1/c7 0 2023-12-12T11:51:37.421 INFO:tasks.workunit.client.1.smithi093.stdout:1/45: truncate f1 4043108 0 2023-12-12T11:51:37.421 INFO:tasks.workunit.client.1.smithi093.stdout:9/15: mkdir d1/d8 0 2023-12-12T11:51:37.421 INFO:tasks.workunit.client.1.smithi093.stdout:1/46: fdatasync f1 0 2023-12-12T11:51:37.422 INFO:tasks.workunit.client.1.smithi093.stdout:9/16: write d1/f6 [776267,91131] 0 2023-12-12T11:51:37.423 INFO:tasks.workunit.client.1.smithi093.stdout:6/121: read d0/f11 [1373476,98203] 0 2023-12-12T11:51:37.428 INFO:tasks.workunit.client.1.smithi093.stdout:6/122: truncate d0/da/d14/f18 983123 0 2023-12-12T11:51:37.428 INFO:tasks.workunit.client.1.smithi093.stdout:6/123: truncate d0/da/f20 5051519 0 2023-12-12T11:51:37.439 INFO:tasks.workunit.client.1.smithi093.stdout:6/124: truncate d0/f11 3743717 0 2023-12-12T11:51:37.454 INFO:tasks.workunit.client.1.smithi093.stdout:4/163: getdents d0/d22 0 2023-12-12T11:51:37.454 INFO:tasks.workunit.client.1.smithi093.stdout:6/125: link d0/da/d14/c2a d0/da/d14/c2c 0 2023-12-12T11:51:37.454 INFO:tasks.workunit.client.1.smithi093.stdout:6/126: chown d0/c3 35408 1 2023-12-12T11:51:37.457 INFO:tasks.workunit.client.1.smithi093.stdout:9/17: unlink d1/f6 0 2023-12-12T11:51:37.459 INFO:tasks.workunit.client.1.smithi093.stdout:5/8: dwrite d0/f1 [0,4194304] 0 2023-12-12T11:51:37.471 INFO:tasks.workunit.client.1.smithi093.stdout:1/47: write f1 [4988680,29755] 0 2023-12-12T11:51:37.471 INFO:tasks.workunit.client.1.smithi093.stdout:6/127: creat d0/d19/f2d x:0 0 0 2023-12-12T11:51:37.473 INFO:tasks.workunit.client.1.smithi093.stdout:3/13: dwrite f3 [0,4194304] 0 2023-12-12T11:51:37.475 INFO:tasks.workunit.client.1.smithi093.stdout:5/9: unlink d0/f1 0 2023-12-12T11:51:37.475 INFO:tasks.workunit.client.1.smithi093.stdout:5/10: creat d0/f2 x:0 0 0 2023-12-12T11:51:37.484 INFO:tasks.workunit.client.1.smithi093.stdout:2/86: dwrite d5/f19 [0,4194304] 0 2023-12-12T11:51:37.484 INFO:tasks.workunit.client.1.smithi093.stdout:2/87: truncate d5/d7/ff 2527364 0 2023-12-12T11:51:37.484 INFO:tasks.workunit.client.1.smithi093.stdout:2/88: chown d5/d7/d12 50 1 2023-12-12T11:51:37.484 INFO:tasks.workunit.client.1.smithi093.stdout:2/89: truncate d5/f8 5727355 0 2023-12-12T11:51:37.484 INFO:tasks.workunit.client.1.smithi093.stdout:2/90: readlink d5/d7/d12/l18 0 2023-12-12T11:51:37.484 INFO:tasks.workunit.client.1.smithi093.stdout:5/11: unlink d0/f2 0 2023-12-12T11:51:37.485 INFO:tasks.workunit.client.1.smithi093.stdout:5/12: creat d0/f3 x:0 0 0 2023-12-12T11:51:37.490 INFO:tasks.workunit.client.1.smithi093.stdout:3/14: read f3 [721842,92877] 0 2023-12-12T11:51:37.493 INFO:tasks.workunit.client.1.smithi093.stdout:5/13: mknod d0/c4 0 2023-12-12T11:51:37.493 INFO:tasks.workunit.client.1.smithi093.stdout:5/14: read - d0/f3 zero size 2023-12-12T11:51:37.493 INFO:tasks.workunit.client.1.smithi093.stdout:5/15: stat d0 0 2023-12-12T11:51:37.493 INFO:tasks.workunit.client.1.smithi093.stdout:5/16: creat d0/f5 x:0 0 0 2023-12-12T11:51:37.494 INFO:tasks.workunit.client.1.smithi093.stdout:5/17: write d0/f3 [67794,67310] 0 2023-12-12T11:51:37.494 INFO:tasks.workunit.client.1.smithi093.stdout:2/91: creat d5/d7/f1a x:0 0 0 2023-12-12T11:51:37.494 INFO:tasks.workunit.client.1.smithi093.stdout:6/128: dread d0/da/f20 [0,4194304] 0 2023-12-12T11:51:37.495 INFO:tasks.workunit.client.1.smithi093.stdout:3/15: symlink l4 0 2023-12-12T11:51:37.495 INFO:tasks.workunit.client.1.smithi093.stdout:3/16: creat f5 x:0 0 0 2023-12-12T11:51:37.495 INFO:tasks.workunit.client.1.smithi093.stdout:3/17: chown l4 30714081 1 2023-12-12T11:51:37.496 INFO:tasks.workunit.client.1.smithi093.stdout:7/25: dwrite f1 [0,4194304] 0 2023-12-12T11:51:37.499 INFO:tasks.workunit.client.1.smithi093.stdout:0/40: dwrite d5/fa [0,4194304] 0 2023-12-12T11:51:37.500 INFO:tasks.workunit.client.1.smithi093.stdout:6/129: creat d0/da/f2e x:0 0 0 2023-12-12T11:51:37.501 INFO:tasks.workunit.client.1.smithi093.stdout:6/130: chown d0/f29 3174 1 2023-12-12T11:51:37.501 INFO:tasks.workunit.client.1.smithi093.stdout:6/131: readlink d0/l7 0 2023-12-12T11:51:37.501 INFO:tasks.workunit.client.1.smithi093.stdout:8/28: dwrite d3/f7 [0,4194304] 0 2023-12-12T11:51:37.503 INFO:tasks.workunit.client.1.smithi093.stdout:3/18: symlink l6 0 2023-12-12T11:51:37.503 INFO:tasks.workunit.client.1.smithi093.stdout:3/19: dread - f5 zero size 2023-12-12T11:51:37.507 INFO:tasks.workunit.client.1.smithi093.stdout:0/41: symlink d5/l12 0 2023-12-12T11:51:37.513 INFO:tasks.workunit.client.1.smithi093.stdout:7/26: dread f1 [0,4194304] 0 2023-12-12T11:51:37.513 INFO:tasks.workunit.client.1.smithi093.stdout:6/132: mknod d0/da/c2f 0 2023-12-12T11:51:37.513 INFO:tasks.workunit.client.1.smithi093.stdout:6/133: rename d0/da to d0/da/d14/d21/d30 22 2023-12-12T11:51:37.513 INFO:tasks.workunit.client.1.smithi093.stdout:5/18: fsync d0/f3 0 2023-12-12T11:51:37.514 INFO:tasks.workunit.client.1.smithi093.stdout:8/29: mknod d3/ca 0 2023-12-12T11:51:37.514 INFO:tasks.workunit.client.1.smithi093.stdout:8/30: creat d3/fb x:0 0 0 2023-12-12T11:51:37.516 INFO:tasks.workunit.client.1.smithi093.stdout:3/20: rename l4 to l7 0 2023-12-12T11:51:37.519 INFO:tasks.workunit.client.1.smithi093.stdout:7/27: mkdir da 0 2023-12-12T11:51:37.519 INFO:tasks.workunit.client.1.smithi093.stdout:0/42: read d5/f7 [435672,17011] 0 2023-12-12T11:51:37.521 INFO:tasks.workunit.client.1.smithi093.stdout:6/134: mknod d0/da/c31 0 2023-12-12T11:51:37.523 INFO:tasks.workunit.client.1.smithi093.stdout:5/19: link d0/c4 d0/c6 0 2023-12-12T11:51:37.523 INFO:tasks.workunit.client.1.smithi093.stdout:5/20: truncate d0/f3 867606 0 2023-12-12T11:51:37.523 INFO:tasks.workunit.client.1.smithi093.stdout:5/21: dread - d0/f5 zero size 2023-12-12T11:51:37.523 INFO:tasks.workunit.client.1.smithi093.stdout:5/22: stat d0 0 2023-12-12T11:51:37.524 INFO:tasks.workunit.client.1.smithi093.stdout:5/23: write d0/f3 [1048,46911] 0 2023-12-12T11:51:37.527 INFO:tasks.workunit.client.1.smithi093.stdout:7/28: unlink f1 0 2023-12-12T11:51:37.527 INFO:tasks.workunit.client.1.smithi093.stdout:7/29: getdents da 0 2023-12-12T11:51:37.527 INFO:tasks.workunit.client.1.smithi093.stdout:3/21: dread f3 [0,4194304] 0 2023-12-12T11:51:37.529 INFO:tasks.workunit.client.1.smithi093.stdout:6/135: getdents d0 0 2023-12-12T11:51:37.534 INFO:tasks.workunit.client.1.smithi093.stdout:5/24: dread d0/f3 [0,4194304] 0 2023-12-12T11:51:37.537 INFO:tasks.workunit.client.1.smithi093.stdout:7/30: creat da/fb x:0 0 0 2023-12-12T11:51:37.538 INFO:tasks.workunit.client.1.smithi093.stdout:8/31: write f0 [3779367,110518] 0 2023-12-12T11:51:37.541 INFO:tasks.workunit.client.1.smithi093.stdout:2/92: write d5/f11 [1651136,61629] 0 2023-12-12T11:51:37.541 INFO:tasks.workunit.client.1.smithi093.stdout:2/93: stat d5/d7/d12/l13 0 2023-12-12T11:51:37.546 INFO:tasks.workunit.client.1.smithi093.stdout:3/22: unlink c1 0 2023-12-12T11:51:37.546 INFO:tasks.workunit.client.1.smithi093.stdout:3/23: truncate f5 410874 0 2023-12-12T11:51:37.546 INFO:tasks.workunit.client.1.smithi093.stdout:6/136: mkdir d0/da/d32 0 2023-12-12T11:51:37.547 INFO:tasks.workunit.client.1.smithi093.stdout:8/32: unlink f1 0 2023-12-12T11:51:37.548 INFO:tasks.workunit.client.1.smithi093.stdout:7/31: write f0 [2699221,50820] 0 2023-12-12T11:51:37.550 INFO:tasks.workunit.client.1.smithi093.stdout:0/43: truncate d5/fa 2767624 0 2023-12-12T11:51:37.552 INFO:tasks.workunit.client.1.smithi093.stdout:6/137: mknod d0/da/c33 0 2023-12-12T11:51:37.554 INFO:tasks.workunit.client.1.smithi093.stdout:8/33: creat d3/d8/fc x:0 0 0 2023-12-12T11:51:37.554 INFO:tasks.workunit.client.1.smithi093.stdout:7/32: mknod da/cc 0 2023-12-12T11:51:37.555 INFO:tasks.workunit.client.1.smithi093.stdout:0/44: creat d5/f13 x:0 0 0 2023-12-12T11:51:37.555 INFO:tasks.workunit.client.1.smithi093.stdout:0/45: chown d5/l12 268 1 2023-12-12T11:51:37.557 INFO:tasks.workunit.client.1.smithi093.stdout:6/138: rename d0/da/c2f to d0/da/d32/c34 0 2023-12-12T11:51:37.559 INFO:tasks.workunit.client.1.smithi093.stdout:0/46: mkdir d5/dd/d14 0 2023-12-12T11:51:37.562 INFO:tasks.workunit.client.1.smithi093.stdout:6/139: truncate d0/f11 2779863 0 2023-12-12T11:51:37.562 INFO:tasks.workunit.client.1.smithi093.stdout:6/140: fsync d0/da/d14/f18 0 2023-12-12T11:51:37.566 INFO:tasks.workunit.client.1.smithi093.stdout:6/141: rename d0/da/d14/c22 to d0/d19/c35 0 2023-12-12T11:51:37.576 INFO:tasks.workunit.client.1.smithi093.stdout:5/25: dwrite d0/f5 [0,4194304] 0 2023-12-12T11:51:37.584 INFO:tasks.workunit.client.1.smithi093.stdout:8/34: rmdir d3 39 2023-12-12T11:51:37.586 INFO:tasks.workunit.client.1.smithi093.stdout:5/26: mkdir d0/d7 0 2023-12-12T11:51:37.589 INFO:tasks.workunit.client.1.smithi093.stdout:5/27: mkdir d0/d7/d8 0 2023-12-12T11:51:37.589 INFO:tasks.workunit.client.1.smithi093.stdout:5/28: creat d0/f9 x:0 0 0 2023-12-12T11:51:37.592 INFO:tasks.workunit.client.1.smithi093.stdout:6/142: rmdir d0/d19 39 2023-12-12T11:51:37.592 INFO:tasks.workunit.client.1.smithi093.stdout:6/143: fsync d0/f11 0 2023-12-12T11:51:37.593 INFO:tasks.workunit.client.1.smithi093.stdout:3/24: dwrite f3 [0,4194304] 0 2023-12-12T11:51:37.596 INFO:tasks.workunit.client.1.smithi093.stdout:5/29: creat d0/d7/fa x:0 0 0 2023-12-12T11:51:37.596 INFO:tasks.workunit.client.1.smithi093.stdout:6/144: creat d0/da/d32/f36 x:0 0 0 2023-12-12T11:51:37.603 INFO:tasks.workunit.client.1.smithi093.stdout:5/30: mkdir d0/d7/d8/db 0 2023-12-12T11:51:37.608 INFO:tasks.workunit.client.1.smithi093.stdout:6/145: mknod d0/da/d14/d21/c37 0 2023-12-12T11:51:37.610 INFO:tasks.workunit.client.1.smithi093.stdout:2/94: dwrite d5/f10 [0,4194304] 0 2023-12-12T11:51:37.610 INFO:tasks.workunit.client.1.smithi093.stdout:2/95: dread - d5/d7/f1a zero size 2023-12-12T11:51:37.612 INFO:tasks.workunit.client.1.smithi093.stdout:6/146: mkdir d0/da/d14/d38 0 2023-12-12T11:51:37.616 INFO:tasks.workunit.client.1.smithi093.stdout:0/47: dwrite d5/f13 [0,4194304] 0 2023-12-12T11:51:37.616 INFO:tasks.workunit.client.1.smithi093.stdout:0/48: creat d5/f15 x:0 0 0 2023-12-12T11:51:37.620 INFO:tasks.workunit.client.1.smithi093.stdout:5/31: dread d0/f5 [0,4194304] 0 2023-12-12T11:51:37.620 INFO:tasks.workunit.client.1.smithi093.stdout:5/32: dread - d0/f9 zero size 2023-12-12T11:51:37.627 INFO:tasks.workunit.client.1.smithi093.stdout:0/49: creat d5/dd/f16 x:0 0 0 2023-12-12T11:51:37.637 INFO:tasks.workunit.client.1.smithi093.stdout:0/50: rmdir d5/dd 39 2023-12-12T11:51:37.638 INFO:tasks.workunit.client.1.smithi093.stdout:0/51: mknod d5/dd/d14/c17 0 2023-12-12T11:51:37.641 INFO:tasks.workunit.client.1.smithi093.stdout:0/52: rename d5/f15 to d5/dd/d14/f18 0 2023-12-12T11:51:37.641 INFO:tasks.workunit.client.1.smithi093.stdout:0/53: fdatasync d5/f13 0 2023-12-12T11:51:37.642 INFO:tasks.workunit.client.1.smithi093.stdout:0/54: stat d5/c8 0 2023-12-12T11:51:37.643 INFO:tasks.workunit.client.1.smithi093.stdout:6/147: dread d0/da/f20 [0,4194304] 0 2023-12-12T11:51:37.644 INFO:tasks.workunit.client.1.smithi093.stdout:0/55: unlink d5/cc 0 2023-12-12T11:51:37.648 INFO:tasks.workunit.client.1.smithi093.stdout:8/35: dwrite d3/d8/fc [0,4194304] 0 2023-12-12T11:51:37.649 INFO:tasks.workunit.client.1.smithi093.stdout:8/36: write d3/fb [461072,30148] 0 2023-12-12T11:51:37.649 INFO:tasks.workunit.client.1.smithi093.stdout:8/37: readlink d3/l4 0 2023-12-12T11:51:37.651 INFO:tasks.workunit.client.1.smithi093.stdout:3/25: dwrite f5 [0,4194304] 0 2023-12-12T11:51:37.651 INFO:tasks.workunit.client.1.smithi093.stdout:8/38: unlink d3/f7 0 2023-12-12T11:51:37.655 INFO:tasks.workunit.client.1.smithi093.stdout:8/39: unlink d3/ca 0 2023-12-12T11:51:37.655 INFO:tasks.workunit.client.1.smithi093.stdout:8/40: rename d3/fb to d3/d8/fd 0 2023-12-12T11:51:37.656 INFO:tasks.workunit.client.1.smithi093.stdout:5/33: dwrite d0/f5 [0,4194304] 0 2023-12-12T11:51:37.656 INFO:tasks.workunit.client.1.smithi093.stdout:5/34: chown d0/d7/d8/db 1165735 1 2023-12-12T11:51:37.656 INFO:tasks.workunit.client.1.smithi093.stdout:5/35: readlink - no filename 2023-12-12T11:51:37.660 INFO:tasks.workunit.client.1.smithi093.stdout:6/148: dread d0/da/f20 [0,4194304] 0 2023-12-12T11:51:37.663 INFO:tasks.workunit.client.1.smithi093.stdout:0/56: dread d5/fa [0,4194304] 0 2023-12-12T11:51:37.664 INFO:tasks.workunit.client.1.smithi093.stdout:0/57: truncate d5/dd/f16 508976 0 2023-12-12T11:51:37.699 INFO:tasks.workunit.client.1.smithi093.stdout:3/26: rename l6 to l8 0 2023-12-12T11:51:37.699 INFO:tasks.workunit.client.1.smithi093.stdout:8/41: creat d3/fe x:0 0 0 2023-12-12T11:51:37.700 INFO:tasks.workunit.client.1.smithi093.stdout:6/149: dwrite d0/f11 [0,4194304] 0 2023-12-12T11:51:37.701 INFO:tasks.workunit.client.1.smithi093.stdout:0/58: mknod d5/dd/d14/c19 0 2023-12-12T11:51:37.702 INFO:tasks.workunit.client.1.smithi093.stdout:8/42: symlink d3/lf 0 2023-12-12T11:51:37.702 INFO:tasks.workunit.client.1.smithi093.stdout:8/43: stat f0 0 2023-12-12T11:51:37.706 INFO:tasks.workunit.client.1.smithi093.stdout:5/36: getdents d0 0 2023-12-12T11:51:37.706 INFO:tasks.workunit.client.1.smithi093.stdout:6/150: mkdir d0/da/d32/d39 0 2023-12-12T11:51:37.706 INFO:tasks.workunit.client.1.smithi093.stdout:0/59: creat d5/dd/f1a x:0 0 0 2023-12-12T11:51:37.706 INFO:tasks.workunit.client.1.smithi093.stdout:3/27: truncate f3 1316869 0 2023-12-12T11:51:37.707 INFO:tasks.workunit.client.1.smithi093.stdout:8/44: symlink d3/l10 0 2023-12-12T11:51:37.707 INFO:tasks.workunit.client.1.smithi093.stdout:8/45: creat d3/f11 x:0 0 0 2023-12-12T11:51:37.707 INFO:tasks.workunit.client.1.smithi093.stdout:8/46: dread - d3/f11 zero size 2023-12-12T11:51:37.707 INFO:tasks.workunit.client.1.smithi093.stdout:5/37: mknod d0/d7/d8/cc 0 2023-12-12T11:51:37.708 INFO:tasks.workunit.client.1.smithi093.stdout:6/151: mkdir d0/da/d14/d3a 0 2023-12-12T11:51:37.708 INFO:tasks.workunit.client.1.smithi093.stdout:0/60: mknod d5/c1b 0 2023-12-12T11:51:37.709 INFO:tasks.workunit.client.1.smithi093.stdout:3/28: readlink l7 0 2023-12-12T11:51:37.709 INFO:tasks.workunit.client.1.smithi093.stdout:3/29: fdatasync f5 0 2023-12-12T11:51:37.711 INFO:tasks.workunit.client.1.smithi093.stdout:6/152: mknod d0/da/d14/c3b 0 2023-12-12T11:51:37.711 INFO:tasks.workunit.client.1.smithi093.stdout:6/153: readlink d0/da/l1f 0 2023-12-12T11:51:37.729 INFO:tasks.workunit.client.1.smithi093.stdout:8/47: rmdir d3 39 2023-12-12T11:51:37.729 INFO:tasks.workunit.client.1.smithi093.stdout:8/48: stat d3/d8/fd 0 2023-12-12T11:51:37.729 INFO:tasks.workunit.client.1.smithi093.stdout:6/154: write d0/da/d14/f1b [2163556,107200] 0 2023-12-12T11:51:37.730 INFO:tasks.workunit.client.1.smithi093.stdout:0/61: write d5/f13 [2393459,116876] 0 2023-12-12T11:51:37.732 INFO:tasks.workunit.client.1.smithi093.stdout:3/30: write f5 [978305,49482] 0 2023-12-12T11:51:37.732 INFO:tasks.workunit.client.1.smithi093.stdout:8/49: link d3/d8/fc d3/d8/f12 0 2023-12-12T11:51:37.734 INFO:tasks.workunit.client.1.smithi093.stdout:8/50: truncate d3/d8/f12 4063015 0 2023-12-12T11:51:37.737 INFO:tasks.workunit.client.1.smithi093.stdout:8/51: creat d3/d8/f13 x:0 0 0 2023-12-12T11:51:37.739 INFO:tasks.workunit.client.1.smithi093.stdout:8/52: rename d3/l10 to d3/d8/l14 0 2023-12-12T11:51:37.739 INFO:tasks.workunit.client.1.smithi093.stdout:8/53: fsync d3/fe 0 2023-12-12T11:51:37.757 INFO:tasks.workunit.client.1.smithi093.stdout:5/38: dwrite d0/f9 [0,4194304] 0 2023-12-12T11:51:37.760 INFO:tasks.workunit.client.1.smithi093.stdout:5/39: symlink d0/d7/d8/db/ld 0 2023-12-12T11:51:37.763 INFO:tasks.workunit.client.1.smithi093.stdout:3/31: dread f3 [0,4194304] 0 2023-12-12T11:51:37.766 INFO:tasks.workunit.client.1.smithi093.stdout:5/40: rename d0/d7/d8/db to d0/d7/d8/de 0 2023-12-12T11:51:37.768 INFO:tasks.workunit.client.1.smithi093.stdout:5/41: symlink d0/d7/lf 0 2023-12-12T11:51:37.768 INFO:tasks.workunit.client.1.smithi093.stdout:5/42: write d0/d7/fa [101693,82596] 0 2023-12-12T11:51:37.771 INFO:tasks.workunit.client.1.smithi093.stdout:7/33: sync 2023-12-12T11:51:37.771 INFO:tasks.workunit.client.1.smithi093.stdout:1/48: sync 2023-12-12T11:51:37.771 INFO:tasks.workunit.client.1.smithi093.stdout:4/164: sync 2023-12-12T11:51:37.771 INFO:tasks.workunit.client.1.smithi093.stdout:9/18: sync 2023-12-12T11:51:37.771 INFO:tasks.workunit.client.1.smithi093.stdout:2/96: sync 2023-12-12T11:51:37.771 INFO:tasks.workunit.client.1.smithi093.stdout:9/19: dread - d1/f5 zero size 2023-12-12T11:51:37.771 INFO:tasks.workunit.client.1.smithi093.stdout:2/97: fsync d5/d7/f1a 0 2023-12-12T11:51:37.771 INFO:tasks.workunit.client.1.smithi093.stdout:2/98: readlink l2 0 2023-12-12T11:51:37.771 INFO:tasks.workunit.client.1.smithi093.stdout:9/20: readlink - no filename 2023-12-12T11:51:37.776 INFO:tasks.workunit.client.1.smithi093.stdout:3/32: dread f3 [0,4194304] 0 2023-12-12T11:51:37.776 INFO:tasks.workunit.client.1.smithi093.stdout:3/33: chown f3 23878 1 2023-12-12T11:51:37.780 INFO:tasks.workunit.client.1.smithi093.stdout:7/34: truncate f0 3552711 0 2023-12-12T11:51:37.780 INFO:tasks.workunit.client.1.smithi093.stdout:1/49: truncate f1 4955866 0 2023-12-12T11:51:37.781 INFO:tasks.workunit.client.1.smithi093.stdout:1/50: fdatasync f1 0 2023-12-12T11:51:37.781 INFO:tasks.workunit.client.1.smithi093.stdout:1/51: chown l2 1485620 1 2023-12-12T11:51:37.782 INFO:tasks.workunit.client.1.smithi093.stdout:8/54: dread d3/d8/fc [0,4194304] 0 2023-12-12T11:51:37.782 INFO:tasks.workunit.client.1.smithi093.stdout:8/55: stat f0 0 2023-12-12T11:51:37.782 INFO:tasks.workunit.client.1.smithi093.stdout:3/34: creat f9 x:0 0 0 2023-12-12T11:51:37.782 INFO:tasks.workunit.client.1.smithi093.stdout:0/62: dwrite d5/dd/f16 [0,4194304] 0 2023-12-12T11:51:37.782 INFO:tasks.workunit.client.1.smithi093.stdout:3/35: write f5 [1771107,75395] 0 2023-12-12T11:51:37.783 INFO:tasks.workunit.client.1.smithi093.stdout:9/21: rmdir d1 39 2023-12-12T11:51:37.792 INFO:tasks.workunit.client.1.smithi093.stdout:0/63: mknod d5/c1c 0 2023-12-12T11:51:37.793 INFO:tasks.workunit.client.1.smithi093.stdout:8/56: unlink d3/f11 0 2023-12-12T11:51:37.793 INFO:tasks.workunit.client.1.smithi093.stdout:9/22: link d1/f5 d1/f9 0 2023-12-12T11:51:37.793 INFO:tasks.workunit.client.1.smithi093.stdout:9/23: dread - d1/f5 zero size 2023-12-12T11:51:37.793 INFO:tasks.workunit.client.1.smithi093.stdout:3/36: rename l7 to la 0 2023-12-12T11:51:37.794 INFO:tasks.workunit.client.1.smithi093.stdout:3/37: chown f5 1953 1 2023-12-12T11:51:37.795 INFO:tasks.workunit.client.1.smithi093.stdout:8/57: truncate f0 2651350 0 2023-12-12T11:51:37.796 INFO:tasks.workunit.client.1.smithi093.stdout:7/35: write f0 [3148610,91449] 0 2023-12-12T11:51:37.796 INFO:tasks.workunit.client.1.smithi093.stdout:9/24: unlink d1/c7 0 2023-12-12T11:51:37.797 INFO:tasks.workunit.client.1.smithi093.stdout:7/36: mknod da/cd 0 2023-12-12T11:51:37.803 INFO:tasks.workunit.client.1.smithi093.stdout:1/52: dread f1 [0,4194304] 0 2023-12-12T11:51:37.804 INFO:tasks.workunit.client.1.smithi093.stdout:1/53: fsync f1 0 2023-12-12T11:51:37.805 INFO:tasks.workunit.client.1.smithi093.stdout:1/54: rmdir d4 39 2023-12-12T11:51:37.807 INFO:tasks.workunit.client.1.smithi093.stdout:1/55: creat d4/f8 x:0 0 0 2023-12-12T11:51:37.810 INFO:tasks.workunit.client.1.smithi093.stdout:1/56: link d4/l6 d4/l9 0 2023-12-12T11:51:37.810 INFO:tasks.workunit.client.1.smithi093.stdout:4/165: dread d0/f2 [0,4194304] 0 2023-12-12T11:51:37.812 INFO:tasks.workunit.client.1.smithi093.stdout:2/99: dread d5/d7/ff [0,4194304] 0 2023-12-12T11:51:37.814 INFO:tasks.workunit.client.1.smithi093.stdout:4/166: rename d0/d22 to d0/d31 0 2023-12-12T11:51:37.816 INFO:tasks.workunit.client.1.smithi093.stdout:8/58: dread d3/d8/fc [0,4194304] 0 2023-12-12T11:51:37.823 INFO:tasks.workunit.client.1.smithi093.stdout:2/100: creat d5/d7/d12/f1b x:0 0 0 2023-12-12T11:51:37.823 INFO:tasks.workunit.client.1.smithi093.stdout:2/101: creat d5/d7/f1c x:0 0 0 2023-12-12T11:51:37.825 INFO:tasks.workunit.client.1.smithi093.stdout:5/43: dwrite d0/f3 [0,4194304] 0 2023-12-12T11:51:37.826 INFO:tasks.workunit.client.1.smithi093.stdout:2/102: symlink d5/d7/d12/l1d 0 2023-12-12T11:51:37.826 INFO:tasks.workunit.client.1.smithi093.stdout:2/103: write d5/d7/f1c [659142,60475] 0 2023-12-12T11:51:37.841 INFO:tasks.workunit.client.1.smithi093.stdout:7/37: dread f0 [0,4194304] 0 2023-12-12T11:51:37.841 INFO:tasks.workunit.client.1.smithi093.stdout:7/38: fsync f0 0 2023-12-12T11:51:37.841 INFO:tasks.workunit.client.1.smithi093.stdout:7/39: stat c3 0 2023-12-12T11:51:37.841 INFO:tasks.workunit.client.1.smithi093.stdout:7/40: readlink l2 0 2023-12-12T11:51:37.842 INFO:tasks.workunit.client.1.smithi093.stdout:7/41: truncate da/fb 983561 0 2023-12-12T11:51:37.842 INFO:tasks.workunit.client.1.smithi093.stdout:7/42: read f0 [201101,121249] 0 2023-12-12T11:51:37.845 INFO:tasks.workunit.client.1.smithi093.stdout:7/43: mkdir da/de 0 2023-12-12T11:51:37.845 INFO:tasks.workunit.client.1.smithi093.stdout:7/44: stat da/cd 0 2023-12-12T11:51:37.848 INFO:tasks.workunit.client.1.smithi093.stdout:8/59: write d3/d8/fc [1771003,32063] 0 2023-12-12T11:51:37.849 INFO:tasks.workunit.client.1.smithi093.stdout:8/60: readlink d3/d8/l14 0 2023-12-12T11:51:37.850 INFO:tasks.workunit.client.1.smithi093.stdout:7/45: symlink da/de/lf 0 2023-12-12T11:51:37.852 INFO:tasks.workunit.client.1.smithi093.stdout:8/61: symlink d3/d8/l15 0 2023-12-12T11:51:37.852 INFO:tasks.workunit.client.1.smithi093.stdout:8/62: truncate d3/f6 1001388 0 2023-12-12T11:51:37.852 INFO:tasks.workunit.client.1.smithi093.stdout:0/64: dwrite d5/dd/f1a [0,4194304] 0 2023-12-12T11:51:37.852 INFO:tasks.workunit.client.1.smithi093.stdout:0/65: creat d5/dd/f1d x:0 0 0 2023-12-12T11:51:37.854 INFO:tasks.workunit.client.1.smithi093.stdout:7/46: creat da/de/f10 x:0 0 0 2023-12-12T11:51:37.864 INFO:tasks.workunit.client.1.smithi093.stdout:9/25: dwrite d1/f5 [0,4194304] 0 2023-12-12T11:51:37.866 INFO:tasks.workunit.client.1.smithi093.stdout:4/167: dwrite d0/f20 [0,4194304] 0 2023-12-12T11:51:37.866 INFO:tasks.workunit.client.1.smithi093.stdout:4/168: fsync d0/fa 0 2023-12-12T11:51:37.870 INFO:tasks.workunit.client.1.smithi093.stdout:1/57: fsync d4/f8 0 2023-12-12T11:51:37.870 INFO:tasks.workunit.client.1.smithi093.stdout:1/58: dread - d4/f8 zero size 2023-12-12T11:51:37.870 INFO:tasks.workunit.client.1.smithi093.stdout:1/59: creat d4/fa x:0 0 0 2023-12-12T11:51:37.871 INFO:tasks.workunit.client.1.smithi093.stdout:7/47: write da/fb [875616,76466] 0 2023-12-12T11:51:37.873 INFO:tasks.workunit.client.1.smithi093.stdout:9/26: rmdir d1/d8 0 2023-12-12T11:51:37.878 INFO:tasks.workunit.client.1.smithi093.stdout:4/169: creat d0/f32 x:0 0 0 2023-12-12T11:51:37.878 INFO:tasks.workunit.client.1.smithi093.stdout:4/170: creat d0/f33 x:0 0 0 2023-12-12T11:51:37.879 INFO:tasks.workunit.client.1.smithi093.stdout:1/60: symlink d4/lb 0 2023-12-12T11:51:37.882 INFO:tasks.workunit.client.1.smithi093.stdout:7/48: link da/de/f10 da/f11 0 2023-12-12T11:51:37.882 INFO:tasks.workunit.client.1.smithi093.stdout:7/49: write da/de/f10 [763650,17593] 0 2023-12-12T11:51:37.882 INFO:tasks.workunit.client.1.smithi093.stdout:7/50: chown da/cd 14422905 1 2023-12-12T11:51:37.883 INFO:tasks.workunit.client.1.smithi093.stdout:7/51: stat l5 0 2023-12-12T11:51:37.884 INFO:tasks.workunit.client.1.smithi093.stdout:9/27: creat d1/fa x:0 0 0 2023-12-12T11:51:37.884 INFO:tasks.workunit.client.1.smithi093.stdout:1/61: mkdir d4/dc 0 2023-12-12T11:51:37.885 INFO:tasks.workunit.client.1.smithi093.stdout:1/62: chown d4/l9 15550 1 2023-12-12T11:51:37.885 INFO:tasks.workunit.client.1.smithi093.stdout:1/63: fsync d4/f8 0 2023-12-12T11:51:37.885 INFO:tasks.workunit.client.1.smithi093.stdout:1/64: fdatasync d4/fa 0 2023-12-12T11:51:37.885 INFO:tasks.workunit.client.1.smithi093.stdout:1/65: creat d4/fd x:0 0 0 2023-12-12T11:51:37.894 INFO:tasks.workunit.client.1.smithi093.stdout:9/28: mknod d1/cb 0 2023-12-12T11:51:37.894 INFO:tasks.workunit.client.1.smithi093.stdout:4/171: dread d0/f1f [0,4194304] 0 2023-12-12T11:51:37.894 INFO:tasks.workunit.client.1.smithi093.stdout:4/172: stat d0/ld 0 2023-12-12T11:51:37.898 INFO:tasks.workunit.client.1.smithi093.stdout:2/104: dwrite d5/d7/fc [4194304,4194304] 0 2023-12-12T11:51:37.898 INFO:tasks.workunit.client.1.smithi093.stdout:0/66: fsync d5/dd/f1d 0 2023-12-12T11:51:37.909 INFO:tasks.workunit.client.1.smithi093.stdout:0/67: symlink d5/dd/l1e 0 2023-12-12T11:51:37.909 INFO:tasks.workunit.client.1.smithi093.stdout:0/68: truncate d5/dd/d14/f18 693547 0 2023-12-12T11:51:37.909 INFO:tasks.workunit.client.1.smithi093.stdout:0/69: write d5/f13 [1378715,8566] 0 2023-12-12T11:51:37.910 INFO:tasks.workunit.client.1.smithi093.stdout:0/70: chown d5/dd/l1e 10753 1 2023-12-12T11:51:37.910 INFO:tasks.workunit.client.1.smithi093.stdout:2/105: rename d5/d7/d12/f1b to d5/d7/f1e 0 2023-12-12T11:51:37.910 INFO:tasks.workunit.client.1.smithi093.stdout:2/106: creat d5/d7/f1f x:0 0 0 2023-12-12T11:51:37.910 INFO:tasks.workunit.client.1.smithi093.stdout:2/107: chown d5/d7/fc 1311 1 2023-12-12T11:51:37.911 INFO:tasks.workunit.client.1.smithi093.stdout:3/38: dwrite f3 [0,4194304] 0 2023-12-12T11:51:37.913 INFO:tasks.workunit.client.1.smithi093.stdout:2/108: mknod d5/c20 0 2023-12-12T11:51:37.914 INFO:tasks.workunit.client.1.smithi093.stdout:2/109: creat d5/f21 x:0 0 0 2023-12-12T11:51:37.914 INFO:tasks.workunit.client.1.smithi093.stdout:2/110: creat d5/d7/d12/f22 x:0 0 0 2023-12-12T11:51:37.921 INFO:tasks.workunit.client.1.smithi093.stdout:3/39: unlink f5 0 2023-12-12T11:51:37.924 INFO:tasks.workunit.client.1.smithi093.stdout:5/44: dwrite d0/f3 [0,4194304] 0 2023-12-12T11:51:37.925 INFO:tasks.workunit.client.1.smithi093.stdout:5/45: chown d0/d7/d8 3369 1 2023-12-12T11:51:37.925 INFO:tasks.workunit.client.1.smithi093.stdout:9/29: write d1/f9 [4081209,70836] 0 2023-12-12T11:51:37.927 INFO:tasks.workunit.client.1.smithi093.stdout:2/111: symlink d5/l23 0 2023-12-12T11:51:37.928 INFO:tasks.workunit.client.1.smithi093.stdout:2/112: dread - d5/f21 zero size 2023-12-12T11:51:37.928 INFO:tasks.workunit.client.1.smithi093.stdout:1/66: dread f1 [0,4194304] 0 2023-12-12T11:51:37.936 INFO:tasks.workunit.client.1.smithi093.stdout:4/173: fsync d0/f33 0 2023-12-12T11:51:37.936 INFO:tasks.workunit.client.1.smithi093.stdout:7/52: dread da/fb [0,4194304] 0 2023-12-12T11:51:37.956 INFO:tasks.workunit.client.1.smithi093.stdout:7/53: dread f0 [0,4194304] 0 2023-12-12T11:51:37.961 INFO:tasks.workunit.client.1.smithi093.stdout:6/155: sync 2023-12-12T11:51:37.961 INFO:tasks.workunit.client.1.smithi093.stdout:2/113: rmdir d5 39 2023-12-12T11:51:37.963 INFO:tasks.workunit.client.1.smithi093.stdout:5/46: write d0/f5 [33749,33862] 0 2023-12-12T11:51:37.963 INFO:tasks.workunit.client.1.smithi093.stdout:5/47: chown d0/f5 5600 1 2023-12-12T11:51:37.963 INFO:tasks.workunit.client.1.smithi093.stdout:5/48: write d0/f5 [2474224,45089] 0 2023-12-12T11:51:37.963 INFO:tasks.workunit.client.1.smithi093.stdout:2/114: rmdir d5/d7/d12 39 2023-12-12T11:51:37.964 INFO:tasks.workunit.client.1.smithi093.stdout:5/49: creat d0/d7/d8/f10 x:0 0 0 2023-12-12T11:51:37.964 INFO:tasks.workunit.client.1.smithi093.stdout:7/54: dread da/f11 [0,4194304] 0 2023-12-12T11:51:37.964 INFO:tasks.workunit.client.1.smithi093.stdout:5/50: stat d0/d7/d8 0 2023-12-12T11:51:37.965 INFO:tasks.workunit.client.1.smithi093.stdout:2/115: getdents d5 0 2023-12-12T11:51:37.966 INFO:tasks.workunit.client.1.smithi093.stdout:4/174: write d0/fa [993792,113439] 0 2023-12-12T11:51:37.966 INFO:tasks.workunit.client.1.smithi093.stdout:4/175: getdents d0/d31 0 2023-12-12T11:51:37.966 INFO:tasks.workunit.client.1.smithi093.stdout:9/30: dread d1/f9 [0,4194304] 0 2023-12-12T11:51:37.966 INFO:tasks.workunit.client.1.smithi093.stdout:9/31: write d1/f9 [109860,128441] 0 2023-12-12T11:51:37.967 INFO:tasks.workunit.client.1.smithi093.stdout:9/32: creat d1/fc x:0 0 0 2023-12-12T11:51:37.968 INFO:tasks.workunit.client.1.smithi093.stdout:8/63: dwrite d3/d8/fc [0,4194304] 0 2023-12-12T11:51:37.968 INFO:tasks.workunit.client.1.smithi093.stdout:7/55: rename l7 to da/l12 0 2023-12-12T11:51:37.969 INFO:tasks.workunit.client.1.smithi093.stdout:5/51: rename d0/d7/lf to d0/d7/l11 0 2023-12-12T11:51:37.974 INFO:tasks.workunit.client.1.smithi093.stdout:3/40: dwrite f9 [0,4194304] 0 2023-12-12T11:51:37.974 INFO:tasks.workunit.client.1.smithi093.stdout:0/71: dwrite d5/dd/f16 [0,4194304] 0 2023-12-12T11:51:37.974 INFO:tasks.workunit.client.1.smithi093.stdout:4/176: mknod d0/c34 0 2023-12-12T11:51:37.974 INFO:tasks.workunit.client.1.smithi093.stdout:4/177: stat d0/d31/f2c 0 2023-12-12T11:51:37.974 INFO:tasks.workunit.client.1.smithi093.stdout:4/178: creat d0/f35 x:0 0 0 2023-12-12T11:51:37.974 INFO:tasks.workunit.client.1.smithi093.stdout:4/179: stat d0/f18 0 2023-12-12T11:51:37.974 INFO:tasks.workunit.client.1.smithi093.stdout:4/180: chown d0/c1b 385 1 2023-12-12T11:51:37.977 INFO:tasks.workunit.client.1.smithi093.stdout:2/116: unlink d5/d7/d12/l1d 0 2023-12-12T11:51:37.978 INFO:tasks.workunit.client.1.smithi093.stdout:0/72: mknod d5/dd/d14/c1f 0 2023-12-12T11:51:37.978 INFO:tasks.workunit.client.1.smithi093.stdout:0/73: chown d5/cb 0 1 2023-12-12T11:51:37.980 INFO:tasks.workunit.client.1.smithi093.stdout:4/181: mkdir d0/d36 0 2023-12-12T11:51:37.981 INFO:tasks.workunit.client.1.smithi093.stdout:0/74: mknod d5/dd/d14/c20 0 2023-12-12T11:51:37.983 INFO:tasks.workunit.client.1.smithi093.stdout:4/182: rename d0/f2 to d0/d36/f37 0 2023-12-12T11:51:37.983 INFO:tasks.workunit.client.1.smithi093.stdout:4/183: chown d0/l9 872430 1 2023-12-12T11:51:37.983 INFO:tasks.workunit.client.1.smithi093.stdout:4/184: truncate d0/d31/f30 366619 0 2023-12-12T11:51:37.984 INFO:tasks.workunit.client.1.smithi093.stdout:4/185: link d0/c34 d0/d31/c38 0 2023-12-12T11:51:37.984 INFO:tasks.workunit.client.1.smithi093.stdout:4/186: write d0/fe [4795122,96934] 0 2023-12-12T11:51:37.988 INFO:tasks.workunit.client.1.smithi093.stdout:4/187: truncate d0/f16 3348506 0 2023-12-12T11:51:37.990 INFO:tasks.workunit.client.1.smithi093.stdout:4/188: creat d0/d36/f39 x:0 0 0 2023-12-12T11:51:37.991 INFO:tasks.workunit.client.1.smithi093.stdout:3/41: dread f9 [0,4194304] 0 2023-12-12T11:51:37.994 INFO:tasks.workunit.client.1.smithi093.stdout:4/189: symlink d0/d31/l3a 0 2023-12-12T11:51:37.994 INFO:tasks.workunit.client.1.smithi093.stdout:8/64: write d3/d8/f12 [20660,89780] 0 2023-12-12T11:51:37.994 INFO:tasks.workunit.client.1.smithi093.stdout:8/65: write d3/d8/f13 [37466,103979] 0 2023-12-12T11:51:37.995 INFO:tasks.workunit.client.1.smithi093.stdout:2/117: write d5/d7/fc [696229,32496] 0 2023-12-12T11:51:37.996 INFO:tasks.workunit.client.1.smithi093.stdout:0/75: read d5/f7 [442325,110946] 0 2023-12-12T11:51:37.997 INFO:tasks.workunit.client.1.smithi093.stdout:0/76: truncate d5/dd/f1d 700278 0 2023-12-12T11:51:37.997 INFO:tasks.workunit.client.1.smithi093.stdout:0/77: chown d5/f13 687959149 1 2023-12-12T11:51:37.997 INFO:tasks.workunit.client.1.smithi093.stdout:0/78: chown d5/dd/f1a 134198092 1 2023-12-12T11:51:37.997 INFO:tasks.workunit.client.1.smithi093.stdout:5/52: rename d0/d7/l11 to d0/d7/l12 0 2023-12-12T11:51:37.998 INFO:tasks.workunit.client.1.smithi093.stdout:5/53: creat d0/d7/d8/f13 x:0 0 0 2023-12-12T11:51:37.998 INFO:tasks.workunit.client.1.smithi093.stdout:5/54: write d0/d7/d8/f10 [561158,56763] 0 2023-12-12T11:51:37.998 INFO:tasks.workunit.client.1.smithi093.stdout:8/66: creat d3/f16 x:0 0 0 2023-12-12T11:51:38.001 INFO:tasks.workunit.client.1.smithi093.stdout:2/118: symlink d5/d7/l24 0 2023-12-12T11:51:38.003 INFO:tasks.workunit.client.1.smithi093.stdout:9/33: rmdir d1 39 2023-12-12T11:51:38.003 INFO:tasks.workunit.client.1.smithi093.stdout:9/34: dread - d1/fa zero size 2023-12-12T11:51:38.008 INFO:tasks.workunit.client.1.smithi093.stdout:7/56: dwrite da/de/f10 [0,4194304] 0 2023-12-12T11:51:38.009 INFO:tasks.workunit.client.1.smithi093.stdout:5/55: mkdir d0/d7/d8/de/d14 0 2023-12-12T11:51:38.009 INFO:tasks.workunit.client.1.smithi093.stdout:5/56: chown d0 874561364 1 2023-12-12T11:51:38.010 INFO:tasks.workunit.client.1.smithi093.stdout:8/67: truncate d3/f6 160437 0 2023-12-12T11:51:38.013 INFO:tasks.workunit.client.1.smithi093.stdout:2/119: mkdir d5/d7/d12/d25 0 2023-12-12T11:51:38.013 INFO:tasks.workunit.client.1.smithi093.stdout:2/120: truncate d5/d7/f1e 953663 0 2023-12-12T11:51:38.013 INFO:tasks.workunit.client.1.smithi093.stdout:2/121: readlink d5/d7/d12/l13 0 2023-12-12T11:51:38.016 INFO:tasks.workunit.client.1.smithi093.stdout:5/57: creat d0/f15 x:0 0 0 2023-12-12T11:51:38.022 INFO:tasks.workunit.client.1.smithi093.stdout:0/79: read d5/fa [2638894,55293] 0 2023-12-12T11:51:38.024 INFO:tasks.workunit.client.1.smithi093.stdout:4/190: rename d0/f16 to d0/d31/f3b 0 2023-12-12T11:51:38.025 INFO:tasks.workunit.client.1.smithi093.stdout:5/58: unlink d0/d7/d8/f10 0 2023-12-12T11:51:38.027 INFO:tasks.workunit.client.1.smithi093.stdout:0/80: mkdir d5/d21 0 2023-12-12T11:51:38.028 INFO:tasks.workunit.client.1.smithi093.stdout:2/122: dread d5/f8 [0,4194304] 0 2023-12-12T11:51:38.032 INFO:tasks.workunit.client.1.smithi093.stdout:9/35: dread d1/f9 [0,4194304] 0 2023-12-12T11:51:38.032 INFO:tasks.workunit.client.1.smithi093.stdout:7/57: rename c9 to da/c13 0 2023-12-12T11:51:38.032 INFO:tasks.workunit.client.1.smithi093.stdout:0/81: link d5/dd/d14/c17 d5/dd/c22 0 2023-12-12T11:51:38.034 INFO:tasks.workunit.client.1.smithi093.stdout:2/123: creat d5/d14/f26 x:0 0 0 2023-12-12T11:51:38.034 INFO:tasks.workunit.client.1.smithi093.stdout:2/124: chown d5/c20 0 1 2023-12-12T11:51:38.036 INFO:tasks.workunit.client.1.smithi093.stdout:7/58: mknod da/de/c14 0 2023-12-12T11:51:38.038 INFO:tasks.workunit.client.1.smithi093.stdout:2/125: mkdir d5/d14/d27 0 2023-12-12T11:51:38.056 INFO:tasks.workunit.client.1.smithi093.stdout:9/36: dread d1/f5 [0,4194304] 0 2023-12-12T11:51:38.061 INFO:tasks.workunit.client.1.smithi093.stdout:5/59: dread d0/f9 [0,4194304] 0 2023-12-12T11:51:38.061 INFO:tasks.workunit.client.1.smithi093.stdout:5/60: dread - d0/d7/d8/f13 zero size 2023-12-12T11:51:38.061 INFO:tasks.workunit.client.1.smithi093.stdout:5/61: chown d0/d7/fa 6629 1 2023-12-12T11:51:38.061 INFO:tasks.workunit.client.1.smithi093.stdout:5/62: dread - d0/d7/d8/f13 zero size 2023-12-12T11:51:38.064 INFO:tasks.workunit.client.1.smithi093.stdout:4/191: dwrite d0/f17 [0,4194304] 0 2023-12-12T11:51:38.069 INFO:tasks.workunit.client.1.smithi093.stdout:4/192: rename d0/l8 to d0/l3c 0 2023-12-12T11:51:38.073 INFO:tasks.workunit.client.1.smithi093.stdout:7/59: dread da/de/f10 [0,4194304] 0 2023-12-12T11:51:38.073 INFO:tasks.workunit.client.1.smithi093.stdout:3/42: dwrite f3 [4194304,4194304] 0 2023-12-12T11:51:38.086 INFO:tasks.workunit.client.1.smithi093.stdout:7/60: mkdir da/d15 0 2023-12-12T11:51:38.089 INFO:tasks.workunit.client.1.smithi093.stdout:2/126: dread d5/f19 [0,4194304] 0 2023-12-12T11:51:38.091 INFO:tasks.workunit.client.1.smithi093.stdout:7/61: creat da/d15/f16 x:0 0 0 2023-12-12T11:51:38.093 INFO:tasks.workunit.client.1.smithi093.stdout:2/127: stat d5/d14/c15 0 2023-12-12T11:51:38.093 INFO:tasks.workunit.client.1.smithi093.stdout:2/128: chown d5/d7/fc 118110606 1 2023-12-12T11:51:38.099 INFO:tasks.workunit.client.1.smithi093.stdout:7/62: truncate da/fb 407256 0 2023-12-12T11:51:38.099 INFO:tasks.workunit.client.1.smithi093.stdout:2/129: symlink d5/d7/l28 0 2023-12-12T11:51:38.099 INFO:tasks.workunit.client.1.smithi093.stdout:2/130: truncate d5/d7/ff 2218469 0 2023-12-12T11:51:38.100 INFO:tasks.workunit.client.1.smithi093.stdout:2/131: write d5/f21 [142385,66619] 0 2023-12-12T11:51:38.100 INFO:tasks.workunit.client.1.smithi093.stdout:2/132: fsync d5/d7/f1e 0 2023-12-12T11:51:38.100 INFO:tasks.workunit.client.1.smithi093.stdout:8/68: dwrite d3/d8/f12 [0,4194304] 0 2023-12-12T11:51:38.100 INFO:tasks.workunit.client.1.smithi093.stdout:8/69: creat d3/f17 x:0 0 0 2023-12-12T11:51:38.107 INFO:tasks.workunit.client.1.smithi093.stdout:4/193: dread d0/d31/f30 [0,4194304] 0 2023-12-12T11:51:38.111 INFO:tasks.workunit.client.1.smithi093.stdout:4/194: creat d0/d31/f3d x:0 0 0 2023-12-12T11:51:38.113 INFO:tasks.workunit.client.1.smithi093.stdout:4/195: link d0/d31/c38 d0/d31/c3e 0 2023-12-12T11:51:38.115 INFO:tasks.workunit.client.1.smithi093.stdout:7/63: write da/de/f10 [1197821,23627] 0 2023-12-12T11:51:38.118 INFO:tasks.workunit.client.1.smithi093.stdout:1/67: sync 2023-12-12T11:51:38.118 INFO:tasks.workunit.client.1.smithi093.stdout:1/68: stat l0 0 2023-12-12T11:51:38.118 INFO:tasks.workunit.client.1.smithi093.stdout:1/69: fsync d4/fd 0 2023-12-12T11:51:38.118 INFO:tasks.workunit.client.1.smithi093.stdout:5/63: dwrite d0/f15 [0,4194304] 0 2023-12-12T11:51:38.120 INFO:tasks.workunit.client.1.smithi093.stdout:7/64: write da/fb [471214,93432] 0 2023-12-12T11:51:38.122 INFO:tasks.workunit.client.1.smithi093.stdout:1/70: creat d4/dc/fe x:0 0 0 2023-12-12T11:51:38.122 INFO:tasks.workunit.client.1.smithi093.stdout:1/71: write f1 [5348849,46489] 0 2023-12-12T11:51:38.122 INFO:tasks.workunit.client.1.smithi093.stdout:1/72: chown f1 330 1 2023-12-12T11:51:38.122 INFO:tasks.workunit.client.1.smithi093.stdout:1/73: dread - d4/f8 zero size 2023-12-12T11:51:38.123 INFO:tasks.workunit.client.1.smithi093.stdout:1/74: creat d4/ff x:0 0 0 2023-12-12T11:51:38.123 INFO:tasks.workunit.client.1.smithi093.stdout:1/75: creat d4/dc/f10 x:0 0 0 2023-12-12T11:51:38.123 INFO:tasks.workunit.client.1.smithi093.stdout:5/64: mknod d0/d7/d8/c16 0 2023-12-12T11:51:38.123 INFO:tasks.workunit.client.1.smithi093.stdout:5/65: fsync d0/f9 0 2023-12-12T11:51:38.133 INFO:tasks.workunit.client.1.smithi093.stdout:5/66: unlink d0/d7/fa 0 2023-12-12T11:51:38.135 INFO:tasks.workunit.client.1.smithi093.stdout:8/70: dread d3/f6 [0,4194304] 0 2023-12-12T11:51:38.136 INFO:tasks.workunit.client.1.smithi093.stdout:5/67: symlink d0/d7/l17 0 2023-12-12T11:51:38.141 INFO:tasks.workunit.client.1.smithi093.stdout:5/68: truncate d0/f5 3240816 0 2023-12-12T11:51:38.142 INFO:tasks.workunit.client.1.smithi093.stdout:9/37: dwrite d1/f9 [0,4194304] 0 2023-12-12T11:51:38.142 INFO:tasks.workunit.client.1.smithi093.stdout:5/69: symlink d0/d7/d8/de/l18 0 2023-12-12T11:51:38.142 INFO:tasks.workunit.client.1.smithi093.stdout:5/70: dread - d0/d7/d8/f13 zero size 2023-12-12T11:51:38.144 INFO:tasks.workunit.client.1.smithi093.stdout:3/43: dwrite f9 [0,4194304] 0 2023-12-12T11:51:38.145 INFO:tasks.workunit.client.1.smithi093.stdout:9/38: rename d1/c4 to d1/cd 0 2023-12-12T11:51:38.145 INFO:tasks.workunit.client.1.smithi093.stdout:5/71: mkdir d0/d7/d19 0 2023-12-12T11:51:38.146 INFO:tasks.workunit.client.1.smithi093.stdout:5/72: fsync d0/f15 0 2023-12-12T11:51:38.146 INFO:tasks.workunit.client.1.smithi093.stdout:5/73: creat d0/d7/f1a x:0 0 0 2023-12-12T11:51:38.152 INFO:tasks.workunit.client.1.smithi093.stdout:9/39: creat d1/fe x:0 0 0 2023-12-12T11:51:38.152 INFO:tasks.workunit.client.1.smithi093.stdout:3/44: creat fb x:0 0 0 2023-12-12T11:51:38.152 INFO:tasks.workunit.client.1.smithi093.stdout:3/45: chown l8 103466784 1 2023-12-12T11:51:38.157 INFO:tasks.workunit.client.1.smithi093.stdout:3/46: unlink c2 0 2023-12-12T11:51:38.163 INFO:tasks.workunit.client.1.smithi093.stdout:0/82: sync 2023-12-12T11:51:38.163 INFO:tasks.workunit.client.1.smithi093.stdout:8/71: write d3/f6 [1014032,80432] 0 2023-12-12T11:51:38.163 INFO:tasks.workunit.client.1.smithi093.stdout:6/156: sync 2023-12-12T11:51:38.163 INFO:tasks.workunit.client.1.smithi093.stdout:6/157: chown d0/da/d14/f1b 28183 1 2023-12-12T11:51:38.163 INFO:tasks.workunit.client.1.smithi093.stdout:9/40: truncate d1/f5 1367256 0 2023-12-12T11:51:38.163 INFO:tasks.workunit.client.1.smithi093.stdout:9/41: read - d1/fa zero size 2023-12-12T11:51:38.164 INFO:tasks.workunit.client.1.smithi093.stdout:9/42: creat d1/ff x:0 0 0 2023-12-12T11:51:38.164 INFO:tasks.workunit.client.1.smithi093.stdout:0/83: unlink c4 0 2023-12-12T11:51:38.164 INFO:tasks.workunit.client.1.smithi093.stdout:6/158: rename d0/da/d32/c34 to d0/da/d14/d3a/c3c 0 2023-12-12T11:51:38.165 INFO:tasks.workunit.client.1.smithi093.stdout:6/159: truncate d0/f11 3534321 0 2023-12-12T11:51:38.165 INFO:tasks.workunit.client.1.smithi093.stdout:0/84: rmdir d5/dd 39 2023-12-12T11:51:38.165 INFO:tasks.workunit.client.1.smithi093.stdout:0/85: chown d5/c8 250450 1 2023-12-12T11:51:38.165 INFO:tasks.workunit.client.1.smithi093.stdout:0/86: chown d5/dd/d14/c20 24447464 1 2023-12-12T11:51:38.166 INFO:tasks.workunit.client.1.smithi093.stdout:2/133: dwrite d5/f19 [0,4194304] 0 2023-12-12T11:51:38.168 INFO:tasks.workunit.client.1.smithi093.stdout:6/160: link d0/da/d14/c2c d0/da/d14/c3d 0 2023-12-12T11:51:38.168 INFO:tasks.workunit.client.1.smithi093.stdout:6/161: stat d0/da/f20 0 2023-12-12T11:51:38.169 INFO:tasks.workunit.client.1.smithi093.stdout:0/87: write d5/dd/f1d [657223,14881] 0 2023-12-12T11:51:38.169 INFO:tasks.workunit.client.1.smithi093.stdout:2/134: creat d5/d7/d12/d25/f29 x:0 0 0 2023-12-12T11:51:38.169 INFO:tasks.workunit.client.1.smithi093.stdout:2/135: creat d5/d7/d12/d25/f2a x:0 0 0 2023-12-12T11:51:38.169 INFO:tasks.workunit.client.1.smithi093.stdout:6/162: mknod d0/c3e 0 2023-12-12T11:51:38.184 INFO:tasks.workunit.client.1.smithi093.stdout:2/136: truncate d5/f11 1791591 0 2023-12-12T11:51:38.184 INFO:tasks.workunit.client.1.smithi093.stdout:4/196: dwrite d0/d31/f28 [0,4194304] 0 2023-12-12T11:51:38.184 INFO:tasks.workunit.client.1.smithi093.stdout:4/197: fsync d0/f1c 0 2023-12-12T11:51:38.184 INFO:tasks.workunit.client.1.smithi093.stdout:8/72: dread d3/d8/f12 [0,4194304] 0 2023-12-12T11:51:38.184 INFO:tasks.workunit.client.1.smithi093.stdout:8/73: creat d3/d8/f18 x:0 0 0 2023-12-12T11:51:38.184 INFO:tasks.workunit.client.1.smithi093.stdout:8/74: dread - d3/f16 zero size 2023-12-12T11:51:38.186 INFO:tasks.workunit.client.1.smithi093.stdout:6/163: creat d0/d19/f3f x:0 0 0 2023-12-12T11:51:38.186 INFO:tasks.workunit.client.1.smithi093.stdout:0/88: getdents d5/dd 0 2023-12-12T11:51:38.186 INFO:tasks.workunit.client.1.smithi093.stdout:6/164: write d0/da/d14/f18 [1389305,102641] 0 2023-12-12T11:51:38.192 INFO:tasks.workunit.client.1.smithi093.stdout:2/137: link d5/d7/ff d5/d7/f2b 0 2023-12-12T11:51:38.192 INFO:tasks.workunit.client.1.smithi093.stdout:2/138: stat d5/d7/f1c 0 2023-12-12T11:51:38.201 INFO:tasks.workunit.client.1.smithi093.stdout:0/89: dread d5/dd/f1a [0,4194304] 0 2023-12-12T11:51:38.201 INFO:tasks.workunit.client.1.smithi093.stdout:0/90: chown d5/dd/l11 0 1 2023-12-12T11:51:38.201 INFO:tasks.workunit.client.1.smithi093.stdout:0/91: write d5/fa [1945117,33447] 0 2023-12-12T11:51:38.201 INFO:tasks.workunit.client.1.smithi093.stdout:0/92: chown d5/c9 49870 1 2023-12-12T11:51:38.210 INFO:tasks.workunit.client.1.smithi093.stdout:8/75: dread d3/d8/f12 [0,4194304] 0 2023-12-12T11:51:38.211 INFO:tasks.workunit.client.1.smithi093.stdout:8/76: write d3/d8/f18 [483857,47583] 0 2023-12-12T11:51:38.211 INFO:tasks.workunit.client.1.smithi093.stdout:8/77: truncate d3/d8/fc 5231406 0 2023-12-12T11:51:38.211 INFO:tasks.workunit.client.1.smithi093.stdout:8/78: readlink d3/d8/l15 0 2023-12-12T11:51:38.216 INFO:tasks.workunit.client.1.smithi093.stdout:3/47: dwrite fb [0,4194304] 0 2023-12-12T11:51:38.217 INFO:tasks.workunit.client.1.smithi093.stdout:2/139: dread d5/d7/f2b [0,4194304] 0 2023-12-12T11:51:38.218 INFO:tasks.workunit.client.1.smithi093.stdout:2/140: creat d5/d7/d12/f2c x:0 0 0 2023-12-12T11:51:38.218 INFO:tasks.workunit.client.1.smithi093.stdout:2/141: chown d5/d7/d12/f2c 174769331 1 2023-12-12T11:51:38.218 INFO:tasks.workunit.client.1.smithi093.stdout:2/142: chown d5/d7/f2b 6800 1 2023-12-12T11:51:38.219 INFO:tasks.workunit.client.1.smithi093.stdout:0/93: write d5/dd/f16 [1482734,10026] 0 2023-12-12T11:51:38.224 INFO:tasks.workunit.client.1.smithi093.stdout:6/165: getdents d0/da/d32 0 2023-12-12T11:51:38.232 INFO:tasks.workunit.client.1.smithi093.stdout:9/43: dwrite d1/fe [0,4194304] 0 2023-12-12T11:51:38.234 INFO:tasks.workunit.client.1.smithi093.stdout:6/166: unlink d0/d19/l26 0 2023-12-12T11:51:38.234 INFO:tasks.workunit.client.1.smithi093.stdout:6/167: chown d0/da/d14/c3d 0 1 2023-12-12T11:51:38.234 INFO:tasks.workunit.client.1.smithi093.stdout:3/48: write f9 [3026817,49965] 0 2023-12-12T11:51:38.234 INFO:tasks.workunit.client.1.smithi093.stdout:5/74: dwrite d0/f9 [0,4194304] 0 2023-12-12T11:51:38.246 INFO:tasks.workunit.client.1.smithi093.stdout:9/44: rename d1/f9 to d1/f10 0 2023-12-12T11:51:38.249 INFO:tasks.workunit.client.1.smithi093.stdout:6/168: mkdir d0/da/d32/d40 0 2023-12-12T11:51:38.249 INFO:tasks.workunit.client.1.smithi093.stdout:6/169: read d0/f29 [1047262,60750] 0 2023-12-12T11:51:38.249 INFO:tasks.workunit.client.1.smithi093.stdout:2/143: rename d5/d7 to d5/d14/d2d 0 2023-12-12T11:51:38.250 INFO:tasks.workunit.client.1.smithi093.stdout:0/94: write d5/f7 [1476076,61663] 0 2023-12-12T11:51:38.251 INFO:tasks.workunit.client.1.smithi093.stdout:3/49: creat fc x:0 0 0 2023-12-12T11:51:38.254 INFO:tasks.workunit.client.1.smithi093.stdout:9/45: unlink d1/cd 0 2023-12-12T11:51:38.255 INFO:tasks.workunit.client.1.smithi093.stdout:6/170: truncate d0/f29 368538 0 2023-12-12T11:51:38.256 INFO:tasks.workunit.client.1.smithi093.stdout:4/198: write d0/d31/f3b [2881626,72913] 0 2023-12-12T11:51:38.258 INFO:tasks.workunit.client.1.smithi093.stdout:2/144: symlink d5/d14/l2e 0 2023-12-12T11:51:38.260 INFO:tasks.workunit.client.1.smithi093.stdout:6/171: mknod d0/da/d14/d38/c41 0 2023-12-12T11:51:38.260 INFO:tasks.workunit.client.1.smithi093.stdout:6/172: fsync d0/da/d14/f18 0 2023-12-12T11:51:38.266 INFO:tasks.workunit.client.1.smithi093.stdout:3/50: dread f3 [4194304,4194304] 0 2023-12-12T11:51:38.274 INFO:tasks.workunit.client.1.smithi093.stdout:0/95: dread d5/dd/f1a [0,4194304] 0 2023-12-12T11:51:38.276 INFO:tasks.workunit.client.1.smithi093.stdout:2/145: dread d5/d14/d2d/fc [0,4194304] 0 2023-12-12T11:51:38.287 INFO:tasks.workunit.client.1.smithi093.stdout:3/51: write f3 [2478458,31931] 0 2023-12-12T11:51:38.288 INFO:tasks.workunit.client.1.smithi093.stdout:3/52: rmdir - no directory 2023-12-12T11:51:38.288 INFO:tasks.workunit.client.1.smithi093.stdout:3/53: write f9 [2238491,83266] 0 2023-12-12T11:51:38.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:37 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:51:38.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:37 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:51:38.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:37 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:51:38.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:37 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:51:38.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:37 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi093.nbtltu/mirror_snapshot_schedule"}]: dispatch 2023-12-12T11:51:38.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:37 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi093.nbtltu/trash_purge_schedule"}]: dispatch 2023-12-12T11:51:38.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:37 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:51:38.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:37 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:51:38.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:37 smithi063 ceph-mon[107117]: mgrmap e22: smithi093.nbtltu(active, since 1.01311s) 2023-12-12T11:51:38.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:37 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:51:38.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:37 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:51:38.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:37 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:51:38.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:37 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:51:38.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:37 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi093.nbtltu/mirror_snapshot_schedule"}]: dispatch 2023-12-12T11:51:38.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:37 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi093.nbtltu/trash_purge_schedule"}]: dispatch 2023-12-12T11:51:38.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:37 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:51:38.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:37 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:51:38.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:37 smithi093 ceph-mon[115914]: mgrmap e22: smithi093.nbtltu(active, since 1.01311s) 2023-12-12T11:51:38.493 INFO:tasks.workunit.client.1.smithi093.stdout:4/199: mknod d0/d36/c3f 0 2023-12-12T11:51:38.496 INFO:tasks.workunit.client.1.smithi093.stdout:6/173: mkdir d0/d19/d42 0 2023-12-12T11:51:38.496 INFO:tasks.workunit.client.1.smithi093.stdout:6/174: readlink d0/da/lc 0 2023-12-12T11:51:38.496 INFO:tasks.workunit.client.1.smithi093.stdout:6/175: truncate d0/da/d14/f18 1627938 0 2023-12-12T11:51:38.497 INFO:tasks.workunit.client.1.smithi093.stdout:0/96: write d5/fa [1645152,60196] 0 2023-12-12T11:51:38.498 INFO:tasks.workunit.client.1.smithi093.stdout:3/54: creat fd x:0 0 0 2023-12-12T11:51:38.499 INFO:tasks.workunit.client.1.smithi093.stdout:4/200: mkdir d0/d36/d40 0 2023-12-12T11:51:38.499 INFO:tasks.workunit.client.1.smithi093.stdout:6/176: mkdir d0/da/d14/d38/d43 0 2023-12-12T11:51:38.500 INFO:tasks.workunit.client.1.smithi093.stdout:9/46: rmdir d1 39 2023-12-12T11:51:38.502 INFO:tasks.workunit.client.1.smithi093.stdout:7/65: sync 2023-12-12T11:51:38.502 INFO:tasks.workunit.client.1.smithi093.stdout:1/76: sync 2023-12-12T11:51:38.502 INFO:tasks.workunit.client.1.smithi093.stdout:1/77: dread - d4/dc/f10 zero size 2023-12-12T11:51:38.502 INFO:tasks.workunit.client.1.smithi093.stdout:1/78: chown d4/fa 59 1 2023-12-12T11:51:38.502 INFO:tasks.workunit.client.1.smithi093.stdout:7/66: write da/f11 [3642022,7714] 0 2023-12-12T11:51:38.502 INFO:tasks.workunit.client.1.smithi093.stdout:7/67: stat f0 0 2023-12-12T11:51:38.502 INFO:tasks.workunit.client.1.smithi093.stdout:7/68: stat da/de/f10 0 2023-12-12T11:51:38.502 INFO:tasks.workunit.client.1.smithi093.stdout:7/69: chown da/de/lf 644684 1 2023-12-12T11:51:38.505 INFO:tasks.workunit.client.1.smithi093.stdout:5/75: dwrite d0/f3 [0,4194304] 0 2023-12-12T11:51:38.506 INFO:tasks.workunit.client.1.smithi093.stdout:2/146: dwrite d5/d14/d2d/d12/d25/f2a [0,4194304] 0 2023-12-12T11:51:38.506 INFO:tasks.workunit.client.1.smithi093.stdout:2/147: readlink d5/d14/d2d/l28 0 2023-12-12T11:51:38.506 INFO:tasks.workunit.client.1.smithi093.stdout:2/148: fdatasync d5/d14/d2d/ff 0 2023-12-12T11:51:38.511 INFO:tasks.workunit.client.1.smithi093.stdout:4/201: symlink d0/l41 0 2023-12-12T11:51:38.511 INFO:tasks.workunit.client.1.smithi093.stdout:0/97: mknod d5/c23 0 2023-12-12T11:51:38.511 INFO:tasks.workunit.client.1.smithi093.stdout:3/55: mknod ce 0 2023-12-12T11:51:38.512 INFO:tasks.workunit.client.1.smithi093.stdout:1/79: symlink d4/dc/l11 0 2023-12-12T11:51:38.514 INFO:tasks.workunit.client.1.smithi093.stdout:9/47: dread d1/f5 [0,4194304] 0 2023-12-12T11:51:38.514 INFO:tasks.workunit.client.1.smithi093.stdout:9/48: write d1/fc [726445,85230] 0 2023-12-12T11:51:38.514 INFO:tasks.workunit.client.1.smithi093.stdout:2/149: mknod d5/d14/d27/c2f 0 2023-12-12T11:51:38.519 INFO:tasks.workunit.client.1.smithi093.stdout:4/202: read d0/fe [2343754,126115] 0 2023-12-12T11:51:38.526 INFO:tasks.workunit.client.1.smithi093.stdout:1/80: symlink d4/l12 0 2023-12-12T11:51:38.530 INFO:tasks.workunit.client.1.smithi093.stdout:9/49: getdents d1 0 2023-12-12T11:51:38.530 INFO:tasks.workunit.client.1.smithi093.stdout:7/70: truncate da/f11 1175692 0 2023-12-12T11:51:38.530 INFO:tasks.workunit.client.1.smithi093.stdout:4/203: symlink d0/d36/d40/l42 0 2023-12-12T11:51:38.530 INFO:tasks.workunit.client.1.smithi093.stdout:4/204: truncate d0/f18 356159 0 2023-12-12T11:51:38.530 INFO:tasks.workunit.client.1.smithi093.stdout:4/205: stat d0/d31/f30 0 2023-12-12T11:51:38.530 INFO:tasks.workunit.client.1.smithi093.stdout:4/206: stat d0/d31/f29 0 2023-12-12T11:51:38.531 INFO:tasks.workunit.client.1.smithi093.stdout:2/150: unlink d5/d14/d2d/f1a 0 2023-12-12T11:51:38.531 INFO:tasks.workunit.client.1.smithi093.stdout:1/81: rename d4/l7 to d4/dc/l13 0 2023-12-12T11:51:38.531 INFO:tasks.workunit.client.1.smithi093.stdout:1/82: write d4/ff [456698,33992] 0 2023-12-12T11:51:38.532 INFO:tasks.workunit.client.1.smithi093.stdout:4/207: truncate d0/f1 1195233 0 2023-12-12T11:51:38.532 INFO:tasks.workunit.client.1.smithi093.stdout:4/208: write d0/f33 [137745,30326] 0 2023-12-12T11:51:38.533 INFO:tasks.workunit.client.1.smithi093.stdout:2/151: truncate d5/f11 546773 0 2023-12-12T11:51:38.535 INFO:tasks.workunit.client.1.smithi093.stdout:2/152: write d5/f10 [4517270,97849] 0 2023-12-12T11:51:38.536 INFO:tasks.workunit.client.1.smithi093.stdout:2/153: creat d5/d14/d2d/d12/d25/f30 x:0 0 0 2023-12-12T11:51:38.538 INFO:tasks.workunit.client.1.smithi093.stdout:2/154: mkdir d5/d31 0 2023-12-12T11:51:38.538 INFO:tasks.workunit.client.1.smithi093.stdout:2/155: chown l2 1574 1 2023-12-12T11:51:38.542 INFO:tasks.workunit.client.1.smithi093.stdout:2/156: rename d5/l17 to d5/d14/d2d/d12/l32 0 2023-12-12T11:51:38.542 INFO:tasks.workunit.client.1.smithi093.stdout:2/157: creat d5/d14/d2d/d12/d25/f33 x:0 0 0 2023-12-12T11:51:38.545 INFO:tasks.workunit.client.1.smithi093.stdout:0/98: dread d5/f13 [0,4194304] 0 2023-12-12T11:51:38.550 INFO:tasks.workunit.client.1.smithi093.stdout:8/79: sync 2023-12-12T11:51:38.550 INFO:tasks.workunit.client.1.smithi093.stdout:3/56: truncate f9 1888164 0 2023-12-12T11:51:38.551 INFO:tasks.workunit.client.1.smithi093.stdout:8/80: truncate d3/d8/fd 227575 0 2023-12-12T11:51:38.553 INFO:tasks.workunit.client.1.smithi093.stdout:3/57: getdents . 0 2023-12-12T11:51:38.553 INFO:tasks.workunit.client.1.smithi093.stdout:3/58: fsync f3 0 2023-12-12T11:51:38.553 INFO:tasks.workunit.client.1.smithi093.stdout:3/59: rmdir - no directory 2023-12-12T11:51:38.553 INFO:tasks.workunit.client.1.smithi093.stdout:3/60: write fd [579611,86935] 0 2023-12-12T11:51:38.567 INFO:tasks.workunit.client.1.smithi093.stdout:3/61: mkdir df 0 2023-12-12T11:51:38.591 INFO:tasks.workunit.client.1.smithi093.stdout:5/76: dwrite d0/f15 [4194304,4194304] 0 2023-12-12T11:51:38.596 INFO:tasks.workunit.client.1.smithi093.stdout:2/158: dread d5/f8 [0,4194304] 0 2023-12-12T11:51:38.596 INFO:tasks.workunit.client.1.smithi093.stdout:2/159: dread - d5/d14/d2d/d12/f22 zero size 2023-12-12T11:51:38.598 INFO:tasks.workunit.client.1.smithi093.stdout:2/160: read d5/d14/d2d/f1e [723978,52007] 0 2023-12-12T11:51:38.634 INFO:tasks.workunit.client.1.smithi093.stdout:1/83: dwrite d4/dc/f10 [0,4194304] 0 2023-12-12T11:51:38.637 INFO:tasks.workunit.client.1.smithi093.stdout:1/84: mknod d4/c14 0 2023-12-12T11:51:38.637 INFO:tasks.workunit.client.1.smithi093.stdout:9/50: dwrite d1/ff [0,4194304] 0 2023-12-12T11:51:38.646 INFO:tasks.workunit.client.1.smithi093.stdout:7/71: dwrite da/de/f10 [0,4194304] 0 2023-12-12T11:51:38.653 INFO:tasks.workunit.client.1.smithi093.stdout:5/77: dwrite d0/f3 [0,4194304] 0 2023-12-12T11:51:38.663 INFO:tasks.workunit.client.1.smithi093.stdout:9/51: dread d1/ff [0,4194304] 0 2023-12-12T11:51:38.663 INFO:tasks.workunit.client.1.smithi093.stdout:3/62: dwrite f3 [4194304,4194304] 0 2023-12-12T11:51:38.666 INFO:tasks.workunit.client.1.smithi093.stdout:2/161: dwrite d5/d14/d2d/d12/d25/f2a [0,4194304] 0 2023-12-12T11:51:38.666 INFO:tasks.workunit.client.1.smithi093.stdout:2/162: fsync d5/d14/d2d/d12/d25/f2a 0 2023-12-12T11:51:38.666 INFO:tasks.workunit.client.1.smithi093.stdout:2/163: chown d5/d14/d2d/f1f 32 1 2023-12-12T11:51:38.666 INFO:tasks.workunit.client.1.smithi093.stdout:2/164: dread - d5/d14/d2d/d12/d25/f30 zero size 2023-12-12T11:51:38.669 INFO:tasks.workunit.client.1.smithi093.stdout:5/78: symlink d0/d7/d8/de/l1b 0 2023-12-12T11:51:38.671 INFO:tasks.workunit.client.1.smithi093.stdout:9/52: mkdir d1/d11 0 2023-12-12T11:51:38.673 INFO:tasks.workunit.client.1.smithi093.stdout:3/63: creat df/f10 x:0 0 0 2023-12-12T11:51:38.673 INFO:tasks.workunit.client.1.smithi093.stdout:3/64: read - df/f10 zero size 2023-12-12T11:51:38.676 INFO:tasks.workunit.client.1.smithi093.stdout:9/53: truncate d1/f10 353900 0 2023-12-12T11:51:38.678 INFO:tasks.workunit.client.1.smithi093.stdout:3/65: symlink df/l11 0 2023-12-12T11:51:38.678 INFO:tasks.workunit.client.1.smithi093.stdout:3/66: chown df 360 1 2023-12-12T11:51:38.678 INFO:tasks.workunit.client.1.smithi093.stdout:3/67: creat df/f12 x:0 0 0 2023-12-12T11:51:38.678 INFO:tasks.workunit.client.1.smithi093.stdout:3/68: creat df/f13 x:0 0 0 2023-12-12T11:51:38.684 INFO:tasks.workunit.client.1.smithi093.stdout:9/54: mkdir d1/d12 0 2023-12-12T11:51:38.685 INFO:tasks.workunit.client.1.smithi093.stdout:1/85: dwrite f1 [0,4194304] 0 2023-12-12T11:51:38.693 INFO:tasks.workunit.client.1.smithi093.stdout:5/79: rmdir d0 39 2023-12-12T11:51:38.693 INFO:tasks.workunit.client.1.smithi093.stdout:5/80: write d0/f5 [3056135,51412] 0 2023-12-12T11:51:38.724 INFO:tasks.workunit.client.1.smithi093.stdout:2/165: dwrite d5/d14/d2d/f2b [0,4194304] 0 2023-12-12T11:51:38.724 INFO:tasks.workunit.client.1.smithi093.stdout:2/166: chown d5/d14/d2d/d12/f2c 22628 1 2023-12-12T11:51:38.727 INFO:tasks.workunit.client.1.smithi093.stdout:1/86: dread f1 [0,4194304] 0 2023-12-12T11:51:38.728 INFO:tasks.workunit.client.1.smithi093.stdout:7/72: dwrite da/fb [0,4194304] 0 2023-12-12T11:51:38.728 INFO:tasks.workunit.client.1.smithi093.stdout:3/69: dwrite df/f13 [0,4194304] 0 2023-12-12T11:51:38.728 INFO:tasks.workunit.client.1.smithi093.stdout:3/70: chown df 45 1 2023-12-12T11:51:38.728 INFO:tasks.workunit.client.1.smithi093.stdout:3/71: truncate df/f10 133524 0 2023-12-12T11:51:38.728 INFO:tasks.workunit.client.1.smithi093.stdout:3/72: fdatasync df/f12 0 2023-12-12T11:51:38.728 INFO:tasks.workunit.client.1.smithi093.stdout:3/73: chown df/f13 55552 1 2023-12-12T11:51:38.732 INFO:tasks.workunit.client.1.smithi093.stdout:1/87: link f1 d4/dc/f15 0 2023-12-12T11:51:38.734 INFO:tasks.workunit.client.1.smithi093.stdout:7/73: mknod da/d15/c17 0 2023-12-12T11:51:38.738 INFO:tasks.workunit.client.1.smithi093.stdout:3/74: symlink df/l14 0 2023-12-12T11:51:38.739 INFO:tasks.workunit.client.1.smithi093.stdout:3/75: mknod df/c15 0 2023-12-12T11:51:38.739 INFO:tasks.workunit.client.1.smithi093.stdout:3/76: chown df/l11 25 1 2023-12-12T11:51:38.740 INFO:tasks.workunit.client.1.smithi093.stdout:6/177: sync 2023-12-12T11:51:38.741 INFO:tasks.workunit.client.1.smithi093.stdout:3/77: symlink df/l16 0 2023-12-12T11:51:38.742 INFO:tasks.workunit.client.1.smithi093.stdout:6/178: rmdir d0/da/d14 39 2023-12-12T11:51:38.742 INFO:tasks.workunit.client.1.smithi093.stdout:6/179: chown d0/c17 6634 1 2023-12-12T11:51:38.744 INFO:tasks.workunit.client.1.smithi093.stdout:1/88: dread d4/ff [0,4194304] 0 2023-12-12T11:51:38.744 INFO:tasks.workunit.client.1.smithi093.stdout:2/167: dread d5/d14/d2d/d12/d25/f2a [0,4194304] 0 2023-12-12T11:51:38.744 INFO:tasks.workunit.client.1.smithi093.stdout:2/168: creat d5/d14/f34 x:0 0 0 2023-12-12T11:51:38.744 INFO:tasks.workunit.client.1.smithi093.stdout:3/78: symlink df/l17 0 2023-12-12T11:51:38.745 INFO:tasks.workunit.client.1.smithi093.stdout:1/89: mknod d4/dc/c16 0 2023-12-12T11:51:38.749 INFO:tasks.workunit.client.1.smithi093.stdout:6/180: dread d0/da/d14/f18 [0,4194304] 0 2023-12-12T11:51:38.758 INFO:tasks.workunit.client.1.smithi093.stdout:2/169: symlink d5/d14/d2d/l35 0 2023-12-12T11:51:38.758 INFO:tasks.workunit.client.1.smithi093.stdout:1/90: rename d4/dc/f15 to d4/dc/f17 0 2023-12-12T11:51:38.760 INFO:tasks.workunit.client.1.smithi093.stdout:6/181: creat d0/f44 x:0 0 0 2023-12-12T11:51:38.760 INFO:tasks.workunit.client.1.smithi093.stdout:6/182: chown d0/da/d14/f18 0 1 2023-12-12T11:51:38.760 INFO:tasks.workunit.client.1.smithi093.stdout:6/183: getdents d0/da/d32/d40 0 2023-12-12T11:51:38.763 INFO:tasks.workunit.client.1.smithi093.stdout:6/184: creat d0/d19/d42/f45 x:0 0 0 2023-12-12T11:51:38.764 INFO:tasks.workunit.client.1.smithi093.stdout:6/185: creat d0/da/d14/d21/f46 x:0 0 0 2023-12-12T11:51:38.766 INFO:tasks.workunit.client.1.smithi093.stdout:6/186: write d0/da/d32/f36 [835026,104039] 0 2023-12-12T11:51:38.766 INFO:tasks.workunit.client.1.smithi093.stdout:6/187: truncate d0/da/d14/d21/f46 718742 0 2023-12-12T11:51:38.769 INFO:tasks.workunit.client.1.smithi093.stdout:6/188: creat d0/da/d14/d3a/f47 x:0 0 0 2023-12-12T11:51:38.775 INFO:tasks.workunit.client.1.smithi093.stdout:6/189: unlink d0/d19/f2d 0 2023-12-12T11:51:38.810 INFO:tasks.workunit.client.1.smithi093.stdout:3/79: dwrite df/f12 [0,4194304] 0 2023-12-12T11:51:38.810 INFO:tasks.workunit.client.1.smithi093.stdout:3/80: chown df/c15 9 1 2023-12-12T11:51:38.812 INFO:tasks.workunit.client.1.smithi093.stdout:1/91: dwrite d4/f8 [0,4194304] 0 2023-12-12T11:51:38.812 INFO:tasks.workunit.client.1.smithi093.stdout:1/92: write d4/fa [639993,57672] 0 2023-12-12T11:51:38.815 INFO:tasks.workunit.client.1.smithi093.stdout:2/170: dwrite d5/d14/d2d/fc [4194304,4194304] 0 2023-12-12T11:51:38.815 INFO:tasks.workunit.client.1.smithi093.stdout:2/171: fdatasync d5/d14/d2d/f2b 0 2023-12-12T11:51:38.817 INFO:tasks.workunit.client.1.smithi093.stdout:1/93: truncate d4/dc/f10 1809171 0 2023-12-12T11:51:38.817 INFO:tasks.workunit.client.1.smithi093.stdout:1/94: creat d4/dc/f18 x:0 0 0 2023-12-12T11:51:38.817 INFO:tasks.workunit.client.1.smithi093.stdout:7/74: dwrite da/de/f10 [0,4194304] 0 2023-12-12T11:51:38.819 INFO:tasks.workunit.client.1.smithi093.stdout:7/75: symlink da/l18 0 2023-12-12T11:51:38.819 INFO:tasks.workunit.client.1.smithi093.stdout:2/172: creat d5/d14/d27/f36 x:0 0 0 2023-12-12T11:51:38.823 INFO:tasks.workunit.client.1.smithi093.stdout:2/173: getdents d5/d14/d2d/d12/d25 0 2023-12-12T11:51:38.824 INFO:tasks.workunit.client.1.smithi093.stdout:2/174: dread - d5/d14/d2d/d12/f2c zero size 2023-12-12T11:51:38.825 INFO:tasks.workunit.client.1.smithi093.stdout:2/175: rename d5/d14/d2d/d12/l13 to d5/d14/d2d/d12/l37 0 2023-12-12T11:51:38.826 INFO:tasks.workunit.client.1.smithi093.stdout:2/176: creat d5/d14/d2d/f38 x:0 0 0 2023-12-12T11:51:38.827 INFO:tasks.workunit.client.1.smithi093.stdout:6/190: dwrite d0/da/d14/f1b [0,4194304] 0 2023-12-12T11:51:38.827 INFO:tasks.workunit.client.1.smithi093.stdout:6/191: truncate d0/da/d14/f1b 4877413 0 2023-12-12T11:51:38.828 INFO:tasks.workunit.client.1.smithi093.stdout:1/95: fsync d4/fa 0 2023-12-12T11:51:38.838 INFO:tasks.workunit.client.1.smithi093.stdout:2/177: symlink d5/d14/d2d/d12/d25/l39 0 2023-12-12T11:51:38.838 INFO:tasks.workunit.client.1.smithi093.stdout:6/192: symlink d0/da/d14/d3a/l48 0 2023-12-12T11:51:38.840 INFO:tasks.workunit.client.1.smithi093.stdout:6/193: write d0/da/d14/d21/f46 [626115,9469] 0 2023-12-12T11:51:38.840 INFO:tasks.workunit.client.1.smithi093.stdout:6/194: creat d0/d19/f49 x:0 0 0 2023-12-12T11:51:38.841 INFO:tasks.workunit.client.1.smithi093.stdout:1/96: symlink d4/dc/l19 0 2023-12-12T11:51:38.841 INFO:tasks.workunit.client.1.smithi093.stdout:1/97: stat d4/dc/f18 0 2023-12-12T11:51:38.845 INFO:tasks.workunit.client.1.smithi093.stdout:6/195: creat d0/da/d32/f4a x:0 0 0 2023-12-12T11:51:38.847 INFO:tasks.workunit.client.1.smithi093.stdout:6/196: mknod d0/da/d14/d38/c4b 0 2023-12-12T11:51:38.849 INFO:tasks.workunit.client.1.smithi093.stdout:3/81: dwrite f3 [0,4194304] 0 2023-12-12T11:51:38.850 INFO:tasks.workunit.client.1.smithi093.stdout:6/197: symlink d0/da/d32/d40/l4c 0 2023-12-12T11:51:38.855 INFO:tasks.workunit.client.1.smithi093.stdout:1/98: rmdir d4 39 2023-12-12T11:51:38.857 INFO:tasks.workunit.client.1.smithi093.stdout:4/209: sync 2023-12-12T11:51:38.857 INFO:tasks.workunit.client.1.smithi093.stdout:0/99: sync 2023-12-12T11:51:38.857 INFO:tasks.workunit.client.1.smithi093.stdout:0/100: fsync d5/dd/f1d 0 2023-12-12T11:51:38.859 INFO:tasks.workunit.client.1.smithi093.stdout:2/178: write d5/d14/d2d/f2b [1534959,49372] 0 2023-12-12T11:51:38.859 INFO:tasks.workunit.client.1.smithi093.stdout:2/179: stat d5/d14/d2d/fc 0 2023-12-12T11:51:38.872 INFO:tasks.workunit.client.1.smithi093.stdout:0/101: dread d5/f7 [0,4194304] 0 2023-12-12T11:51:38.875 INFO:tasks.workunit.client.1.smithi093.stdout:2/180: rmdir d5/d14/d2d 39 2023-12-12T11:51:38.875 INFO:tasks.workunit.client.1.smithi093.stdout:2/181: readlink d5/d14/d2d/d12/l18 0 2023-12-12T11:51:38.876 INFO:tasks.workunit.client.1.smithi093.stdout:4/210: dread d0/fe [0,4194304] 0 2023-12-12T11:51:38.907 INFO:tasks.workunit.client.1.smithi093.stdout:5/81: sync 2023-12-12T11:51:38.907 INFO:tasks.workunit.client.1.smithi093.stdout:9/55: sync 2023-12-12T11:51:38.907 INFO:tasks.workunit.client.1.smithi093.stdout:8/81: sync 2023-12-12T11:51:38.907 INFO:tasks.workunit.client.1.smithi093.stdout:9/56: chown d1/cb 2045 1 2023-12-12T11:51:38.907 INFO:tasks.workunit.client.1.smithi093.stdout:9/57: chown d1 348505 1 2023-12-12T11:51:38.907 INFO:tasks.workunit.client.1.smithi093.stdout:8/82: truncate d3/d8/f18 600553 0 2023-12-12T11:51:38.910 INFO:tasks.workunit.client.1.smithi093.stdout:7/76: dwrite f0 [4194304,4194304] 0 2023-12-12T11:51:38.913 INFO:tasks.workunit.client.1.smithi093.stdout:9/58: unlink d1/f10 0 2023-12-12T11:51:38.913 INFO:tasks.workunit.client.1.smithi093.stdout:9/59: truncate d1/fa 417293 0 2023-12-12T11:51:38.914 INFO:tasks.workunit.client.1.smithi093.stdout:7/77: rmdir da/d15 39 2023-12-12T11:51:38.914 INFO:tasks.workunit.client.1.smithi093.stdout:1/99: dwrite d4/dc/fe [0,4194304] 0 2023-12-12T11:51:38.921 INFO:tasks.workunit.client.1.smithi093.stdout:7/78: mkdir da/d15/d19 0 2023-12-12T11:51:38.921 INFO:tasks.workunit.client.1.smithi093.stdout:1/100: mkdir d4/d1a 0 2023-12-12T11:51:38.927 INFO:tasks.workunit.client.1.smithi093.stdout:7/79: creat da/d15/f1a x:0 0 0 2023-12-12T11:51:38.927 INFO:tasks.workunit.client.1.smithi093.stdout:7/80: chown da/l18 2896 1 2023-12-12T11:51:38.929 INFO:tasks.workunit.client.1.smithi093.stdout:1/101: mkdir d4/d1a/d1b 0 2023-12-12T11:51:38.930 INFO:tasks.workunit.client.1.smithi093.stdout:1/102: fsync d4/dc/f17 0 2023-12-12T11:51:38.932 INFO:tasks.workunit.client.1.smithi093.stdout:7/81: link da/f11 da/d15/f1b 0 2023-12-12T11:51:38.932 INFO:tasks.workunit.client.1.smithi093.stdout:7/82: chown l5 331 1 2023-12-12T11:51:38.932 INFO:tasks.workunit.client.1.smithi093.stdout:7/83: chown da/c13 271530 1 2023-12-12T11:51:38.942 INFO:tasks.workunit.client.1.smithi093.stdout:6/198: dwrite d0/d19/f49 [0,4194304] 0 2023-12-12T11:51:38.943 INFO:tasks.workunit.client.1.smithi093.stdout:3/82: dwrite fc [0,4194304] 0 2023-12-12T11:51:38.943 INFO:tasks.workunit.client.1.smithi093.stdout:4/211: dwrite d0/d36/f37 [0,4194304] 0 2023-12-12T11:51:38.947 INFO:tasks.workunit.client.1.smithi093.stdout:3/83: symlink df/l18 0 2023-12-12T11:51:38.948 INFO:tasks.workunit.client.1.smithi093.stdout:3/84: fdatasync df/f13 0 2023-12-12T11:51:38.949 INFO:tasks.workunit.client.1.smithi093.stdout:1/103: write d4/f8 [1186582,116386] 0 2023-12-12T11:51:38.949 INFO:tasks.workunit.client.1.smithi093.stdout:1/104: chown d4/d1a 113602656 1 2023-12-12T11:51:38.949 INFO:tasks.workunit.client.1.smithi093.stdout:1/105: write d4/fd [588138,104623] 0 2023-12-12T11:51:38.949 INFO:tasks.workunit.client.1.smithi093.stdout:4/212: mknod d0/c43 0 2023-12-12T11:51:38.949 INFO:tasks.workunit.client.1.smithi093.stdout:4/213: creat d0/f44 x:0 0 0 2023-12-12T11:51:38.949 INFO:tasks.workunit.client.1.smithi093.stdout:4/214: truncate d0/f14 1017001 0 2023-12-12T11:51:38.949 INFO:tasks.workunit.client.1.smithi093.stdout:4/215: fdatasync d0/f17 0 2023-12-12T11:51:39.049 INFO:tasks.workunit.client.1.smithi093.stdout:3/85: rename fb to df/f19 0 2023-12-12T11:51:39.053 INFO:tasks.workunit.client.1.smithi093.stdout:1/106: rmdir d4/dc 39 2023-12-12T11:51:39.057 INFO:tasks.workunit.client.1.smithi093.stdout:3/86: rename f3 to df/f1a 0 2023-12-12T11:51:39.057 INFO:tasks.workunit.client.1.smithi093.stdout:3/87: stat fd 0 2023-12-12T11:51:39.057 INFO:tasks.workunit.client.1.smithi093.stdout:3/88: chown df/f1a 523 1 2023-12-12T11:51:39.058 INFO:tasks.workunit.client.1.smithi093.stdout:1/107: mkdir d4/d1c 0 2023-12-12T11:51:39.058 INFO:tasks.workunit.client.1.smithi093.stdout:1/108: write d4/dc/f18 [833081,96318] 0 2023-12-12T11:51:39.060 INFO:tasks.workunit.client.1.smithi093.stdout:6/199: write d0/d19/f49 [4475758,99935] 0 2023-12-12T11:51:39.062 INFO:tasks.workunit.client.1.smithi093.stdout:8/83: dwrite d3/d8/fd [0,4194304] 0 2023-12-12T11:51:39.062 INFO:tasks.workunit.client.1.smithi093.stdout:8/84: fdatasync d3/fe 0 2023-12-12T11:51:39.072 INFO:tasks.workunit.client.1.smithi093.stdout:4/216: dwrite d0/d31/f3b [0,4194304] 0 2023-12-12T11:51:39.077 INFO:tasks.workunit.client.1.smithi093.stdout:1/109: dread d4/fd [0,4194304] 0 2023-12-12T11:51:39.077 INFO:tasks.workunit.client.1.smithi093.stdout:4/217: symlink d0/d31/l45 0 2023-12-12T11:51:39.078 INFO:tasks.workunit.client.1.smithi093.stdout:4/218: creat d0/d31/f46 x:0 0 0 2023-12-12T11:51:39.078 INFO:tasks.workunit.client.1.smithi093.stdout:4/219: creat d0/f47 x:0 0 0 2023-12-12T11:51:39.078 INFO:tasks.workunit.client.1.smithi093.stdout:4/220: stat d0/l4 0 2023-12-12T11:51:39.079 INFO:tasks.workunit.client.1.smithi093.stdout:1/110: mknod d4/c1d 0 2023-12-12T11:51:39.080 INFO:tasks.workunit.client.1.smithi093.stdout:4/221: symlink d0/d36/l48 0 2023-12-12T11:51:39.080 INFO:tasks.workunit.client.1.smithi093.stdout:4/222: dread - d0/f44 zero size 2023-12-12T11:51:39.080 INFO:tasks.workunit.client.1.smithi093.stdout:4/223: readlink d0/l1a 0 2023-12-12T11:51:39.081 INFO:tasks.workunit.client.1.smithi093.stdout:4/224: mkdir d0/d36/d49 0 2023-12-12T11:51:39.084 INFO:tasks.workunit.client.1.smithi093.stdout:4/225: rename d0/f35 to d0/d36/d49/f4a 0 2023-12-12T11:51:39.084 INFO:tasks.workunit.client.1.smithi093.stdout:4/226: readlink d0/d36/l48 0 2023-12-12T11:51:39.088 INFO:tasks.workunit.client.1.smithi093.stdout:4/227: creat d0/d36/d49/f4b x:0 0 0 2023-12-12T11:51:39.094 INFO:tasks.workunit.client.1.smithi093.stdout:8/85: dread d3/d8/fc [0,4194304] 0 2023-12-12T11:51:39.096 INFO:tasks.workunit.client.1.smithi093.stdout:8/86: unlink d3/d8/f13 0 2023-12-12T11:51:39.096 INFO:tasks.workunit.client.1.smithi093.stdout:8/87: chown d3/d8/f18 3 1 2023-12-12T11:51:39.097 INFO:tasks.workunit.client.1.smithi093.stdout:8/88: write f0 [567083,54585] 0 2023-12-12T11:51:39.097 INFO:tasks.workunit.client.1.smithi093.stdout:8/89: fdatasync d3/fe 0 2023-12-12T11:51:39.099 INFO:tasks.workunit.client.1.smithi093.stdout:0/102: dwrite d5/dd/f1d [0,4194304] 0 2023-12-12T11:51:39.099 INFO:tasks.workunit.client.1.smithi093.stdout:0/103: fdatasync d5/f13 0 2023-12-12T11:51:39.100 INFO:tasks.workunit.client.1.smithi093.stdout:4/228: dread d0/fe [0,4194304] 0 2023-12-12T11:51:39.100 INFO:tasks.workunit.client.1.smithi093.stdout:4/229: creat d0/d36/f4c x:0 0 0 2023-12-12T11:51:39.101 INFO:tasks.workunit.client.1.smithi093.stdout:4/230: fdatasync d0/d36/d49/f4b 0 2023-12-12T11:51:39.101 INFO:tasks.workunit.client.1.smithi093.stdout:4/231: truncate d0/f47 510672 0 2023-12-12T11:51:39.104 INFO:tasks.workunit.client.1.smithi093.stdout:6/200: dwrite d0/da/d32/f4a [0,4194304] 0 2023-12-12T11:51:39.104 INFO:tasks.workunit.client.1.smithi093.stdout:6/201: read d0/da/f20 [3137239,91085] 0 2023-12-12T11:51:39.109 INFO:tasks.workunit.client.1.smithi093.stdout:6/202: unlink d0/da/d14/d3a/l48 0 2023-12-12T11:51:39.112 INFO:tasks.workunit.client.1.smithi093.stdout:8/90: getdents d3/d8 0 2023-12-12T11:51:39.113 INFO:tasks.workunit.client.1.smithi093.stdout:8/91: stat d3/l4 0 2023-12-12T11:51:39.113 INFO:tasks.workunit.client.1.smithi093.stdout:2/182: sync 2023-12-12T11:51:39.115 INFO:tasks.workunit.client.1.smithi093.stdout:8/92: rename d3/d8/fd to d3/d8/f19 0 2023-12-12T11:51:39.116 INFO:tasks.workunit.client.1.smithi093.stdout:2/183: creat d5/f3a x:0 0 0 2023-12-12T11:51:39.117 INFO:tasks.workunit.client.1.smithi093.stdout:2/184: symlink d5/d31/l3b 0 2023-12-12T11:51:39.118 INFO:tasks.workunit.client.1.smithi093.stdout:2/185: dread - d5/d14/d2d/d12/f2c zero size 2023-12-12T11:51:39.119 INFO:tasks.workunit.client.1.smithi093.stdout:0/104: dread d5/dd/f1a [0,4194304] 0 2023-12-12T11:51:39.120 INFO:tasks.workunit.client.1.smithi093.stdout:0/105: truncate d5/dd/d14/f18 1274704 0 2023-12-12T11:51:39.139 INFO:tasks.workunit.client.1.smithi093.stdout:4/232: dwrite d0/d31/f28 [0,4194304] 0 2023-12-12T11:51:39.139 INFO:tasks.workunit.client.1.smithi093.stdout:4/233: write d0/d31/f3d [856178,17383] 0 2023-12-12T11:51:39.148 INFO:tasks.workunit.client.1.smithi093.stdout:0/106: dread d5/dd/f16 [0,4194304] 0 2023-12-12T11:51:39.148 INFO:tasks.workunit.client.1.smithi093.stdout:3/89: dwrite df/f12 [0,4194304] 0 2023-12-12T11:51:39.149 INFO:tasks.workunit.client.1.smithi093.stdout:3/90: fdatasync df/f1a 0 2023-12-12T11:51:39.155 INFO:tasks.workunit.client.1.smithi093.stdout:8/93: dwrite d3/f16 [0,4194304] 0 2023-12-12T11:51:39.155 INFO:tasks.workunit.client.1.smithi093.stdout:3/91: mknod df/c1b 0 2023-12-12T11:51:39.155 INFO:tasks.workunit.client.1.smithi093.stdout:0/107: creat d5/f24 x:0 0 0 2023-12-12T11:51:39.155 INFO:tasks.workunit.client.1.smithi093.stdout:3/92: creat df/f1c x:0 0 0 2023-12-12T11:51:39.161 INFO:tasks.workunit.client.1.smithi093.stdout:4/234: dread d0/d31/f3b [0,4194304] 0 2023-12-12T11:51:39.162 INFO:tasks.workunit.client.1.smithi093.stdout:4/235: rename d0/d36/l48 to d0/d31/l4d 0 2023-12-12T11:51:39.162 INFO:tasks.workunit.client.1.smithi093.stdout:4/236: write d0/d31/f29 [641921,29436] 0 2023-12-12T11:51:39.165 INFO:tasks.workunit.client.1.smithi093.stdout:5/82: sync 2023-12-12T11:51:39.165 INFO:tasks.workunit.client.1.smithi093.stdout:5/83: write d0/f5 [323832,5238] 0 2023-12-12T11:51:39.166 INFO:tasks.workunit.client.1.smithi093.stdout:5/84: readlink d0/d7/d8/de/l18 0 2023-12-12T11:51:39.166 INFO:tasks.workunit.client.1.smithi093.stdout:9/60: sync 2023-12-12T11:51:39.166 INFO:tasks.workunit.client.1.smithi093.stdout:7/84: sync 2023-12-12T11:51:39.166 INFO:tasks.workunit.client.1.smithi093.stdout:7/85: dread - da/d15/f16 zero size 2023-12-12T11:51:39.166 INFO:tasks.workunit.client.1.smithi093.stdout:7/86: creat da/d15/f1c x:0 0 0 2023-12-12T11:51:39.166 INFO:tasks.workunit.client.1.smithi093.stdout:7/87: creat da/f1d x:0 0 0 2023-12-12T11:51:39.167 INFO:tasks.workunit.client.1.smithi093.stdout:5/85: creat d0/d7/f1c x:0 0 0 2023-12-12T11:51:39.168 INFO:tasks.workunit.client.1.smithi093.stdout:9/61: symlink d1/d12/l13 0 2023-12-12T11:51:39.178 INFO:tasks.workunit.client.1.smithi093.stdout:9/62: symlink d1/d12/l14 0 2023-12-12T11:51:39.178 INFO:tasks.workunit.client.1.smithi093.stdout:9/63: chown d1/c2 1 1 2023-12-12T11:51:39.178 INFO:tasks.workunit.client.1.smithi093.stdout:9/64: write d1/fe [4667953,66785] 0 2023-12-12T11:51:39.179 INFO:tasks.workunit.client.1.smithi093.stdout:9/65: rename d1/cb to d1/c15 0 2023-12-12T11:51:39.197 INFO:tasks.workunit.client.1.smithi093.stdout:6/203: dwrite d0/d19/f49 [0,4194304] 0 2023-12-12T11:51:39.200 INFO:tasks.workunit.client.1.smithi093.stdout:5/86: dread d0/f3 [0,4194304] 0 2023-12-12T11:51:39.201 INFO:tasks.workunit.client.1.smithi093.stdout:5/87: dread - d0/d7/f1c zero size 2023-12-12T11:51:39.203 INFO:tasks.workunit.client.1.smithi093.stdout:6/204: mkdir d0/da/d32/d40/d4d 0 2023-12-12T11:51:39.203 INFO:tasks.workunit.client.1.smithi093.stdout:6/205: fdatasync d0/f29 0 2023-12-12T11:51:39.203 INFO:tasks.workunit.client.1.smithi093.stdout:6/206: chown d0/da/d14/d3a/f47 542796995 1 2023-12-12T11:51:39.208 INFO:tasks.workunit.client.1.smithi093.stdout:5/88: getdents d0/d7/d8/de 0 2023-12-12T11:51:39.208 INFO:tasks.workunit.client.1.smithi093.stdout:5/89: rmdir d0 39 2023-12-12T11:51:39.210 INFO:tasks.workunit.client.1.smithi093.stdout:5/90: link d0/d7/d8/c16 d0/d7/d19/c1d 0 2023-12-12T11:51:39.212 INFO:tasks.workunit.client.1.smithi093.stdout:3/93: dwrite df/f1a [8388608,4194304] 0 2023-12-12T11:51:39.212 INFO:tasks.workunit.client.1.smithi093.stdout:3/94: chown df/f1c 55593415 1 2023-12-12T11:51:39.222 INFO:tasks.workunit.client.1.smithi093.stdout:5/91: write d0/f3 [499164,5724] 0 2023-12-12T11:51:39.222 INFO:tasks.workunit.client.1.smithi093.stdout:0/108: dwrite d5/f13 [0,4194304] 0 2023-12-12T11:51:39.223 INFO:tasks.workunit.client.1.smithi093.stdout:6/207: write d0/da/f1a [1470172,97160] 0 2023-12-12T11:51:39.223 INFO:tasks.workunit.client.1.smithi093.stdout:1/111: sync 2023-12-12T11:51:39.229 INFO:tasks.workunit.client.1.smithi093.stdout:5/92: mkdir d0/d7/d8/de/d14/d1e 0 2023-12-12T11:51:39.229 INFO:tasks.workunit.client.1.smithi093.stdout:5/93: fdatasync d0/f9 0 2023-12-12T11:51:39.229 INFO:tasks.workunit.client.1.smithi093.stdout:5/94: truncate d0/d7/f1c 893052 0 2023-12-12T11:51:39.229 INFO:tasks.workunit.client.1.smithi093.stdout:5/95: stat d0/d7/d8 0 2023-12-12T11:51:39.229 INFO:tasks.workunit.client.1.smithi093.stdout:5/96: stat d0/d7/l17 0 2023-12-12T11:51:39.230 INFO:tasks.workunit.client.1.smithi093.stdout:4/237: dread d0/d31/f3b [0,4194304] 0 2023-12-12T11:51:39.230 INFO:tasks.workunit.client.1.smithi093.stdout:4/238: creat d0/d36/d40/f4e x:0 0 0 2023-12-12T11:51:39.230 INFO:tasks.workunit.client.1.smithi093.stdout:0/109: symlink d5/d21/l25 0 2023-12-12T11:51:39.230 INFO:tasks.workunit.client.1.smithi093.stdout:0/110: truncate d5/f24 13530 0 2023-12-12T11:51:39.235 INFO:tasks.workunit.client.1.smithi093.stdout:0/111: mkdir d5/dd/d14/d26 0 2023-12-12T11:51:39.236 INFO:tasks.workunit.client.1.smithi093.stdout:5/97: dread d0/d7/f1c [0,4194304] 0 2023-12-12T11:51:39.236 INFO:tasks.workunit.client.1.smithi093.stdout:5/98: fsync d0/d7/f1a 0 2023-12-12T11:51:39.236 INFO:tasks.workunit.client.1.smithi093.stdout:9/66: dwrite d1/fc [0,4194304] 0 2023-12-12T11:51:39.237 INFO:tasks.workunit.client.1.smithi093.stdout:0/112: readlink d5/l12 0 2023-12-12T11:51:39.242 INFO:tasks.workunit.client.1.smithi093.stdout:9/67: creat d1/f16 x:0 0 0 2023-12-12T11:51:39.242 INFO:tasks.workunit.client.1.smithi093.stdout:0/113: mkdir d5/d21/d27 0 2023-12-12T11:51:39.244 INFO:tasks.workunit.client.1.smithi093.stdout:4/239: dread d0/d31/f3d [0,4194304] 0 2023-12-12T11:51:39.244 INFO:tasks.workunit.client.1.smithi093.stdout:6/208: dread d0/da/d32/f36 [0,4194304] 0 2023-12-12T11:51:39.244 INFO:tasks.workunit.client.1.smithi093.stdout:6/209: fdatasync d0/da/d32/f4a 0 2023-12-12T11:51:39.245 INFO:tasks.workunit.client.1.smithi093.stdout:7/88: dwrite da/d15/f16 [0,4194304] 0 2023-12-12T11:51:39.245 INFO:tasks.workunit.client.1.smithi093.stdout:7/89: truncate da/d15/f1c 787238 0 2023-12-12T11:51:39.245 INFO:tasks.workunit.client.1.smithi093.stdout:7/90: truncate da/d15/f1c 805654 0 2023-12-12T11:51:39.245 INFO:tasks.workunit.client.1.smithi093.stdout:7/91: fdatasync da/d15/f1b 0 2023-12-12T11:51:39.245 INFO:tasks.workunit.client.1.smithi093.stdout:7/92: chown da/d15/f1b 36 1 2023-12-12T11:51:39.247 INFO:tasks.workunit.client.1.smithi093.stdout:9/68: write d1/fa [264464,120365] 0 2023-12-12T11:51:39.248 INFO:tasks.workunit.client.1.smithi093.stdout:6/210: rename d0/da/d14/c24 to d0/da/d32/d40/d4d/c4e 0 2023-12-12T11:51:39.253 INFO:tasks.workunit.client.1.smithi093.stdout:0/114: mknod d5/c28 0 2023-12-12T11:51:39.253 INFO:tasks.workunit.client.1.smithi093.stdout:4/240: rmdir d0/d31 39 2023-12-12T11:51:39.253 INFO:tasks.workunit.client.1.smithi093.stdout:4/241: write d0/d31/f2c [421660,115716] 0 2023-12-12T11:51:39.253 INFO:tasks.workunit.client.1.smithi093.stdout:4/242: chown d0/f1d 365183 1 2023-12-12T11:51:39.254 INFO:tasks.workunit.client.1.smithi093.stdout:9/69: mknod d1/c17 0 2023-12-12T11:51:39.254 INFO:tasks.workunit.client.1.smithi093.stdout:6/211: unlink d0/da/f1a 0 2023-12-12T11:51:39.257 INFO:tasks.workunit.client.1.smithi093.stdout:5/99: read d0/f9 [2846510,8106] 0 2023-12-12T11:51:39.257 INFO:tasks.workunit.client.1.smithi093.stdout:9/70: mknod d1/d12/c18 0 2023-12-12T11:51:39.260 INFO:tasks.workunit.client.1.smithi093.stdout:6/212: truncate d0/f11 3273900 0 2023-12-12T11:51:39.261 INFO:tasks.workunit.client.1.smithi093.stdout:3/95: dwrite df/f19 [0,4194304] 0 2023-12-12T11:51:39.266 INFO:tasks.workunit.client.1.smithi093.stdout:4/243: rmdir d0 39 2023-12-12T11:51:39.268 INFO:tasks.workunit.client.1.smithi093.stdout:0/115: write d5/f13 [510639,63564] 0 2023-12-12T11:51:39.268 INFO:tasks.workunit.client.1.smithi093.stdout:0/116: getdents d5/dd/d14/d26 0 2023-12-12T11:51:39.268 INFO:tasks.workunit.client.1.smithi093.stdout:0/117: write d5/fa [1110873,62046] 0 2023-12-12T11:51:39.269 INFO:tasks.workunit.client.1.smithi093.stdout:6/213: creat d0/da/d14/d38/f4f x:0 0 0 2023-12-12T11:51:39.269 INFO:tasks.workunit.client.1.smithi093.stdout:6/214: chown d0/da/c23 14 1 2023-12-12T11:51:39.269 INFO:tasks.workunit.client.1.smithi093.stdout:6/215: write d0/d19/f3f [1047918,62559] 0 2023-12-12T11:51:39.270 INFO:tasks.workunit.client.1.smithi093.stdout:7/93: read da/d15/f16 [3569739,56049] 0 2023-12-12T11:51:39.274 INFO:tasks.workunit.client.1.smithi093.stdout:2/186: sync 2023-12-12T11:51:39.274 INFO:tasks.workunit.client.1.smithi093.stdout:2/187: creat d5/d14/f3c x:0 0 0 2023-12-12T11:51:39.275 INFO:tasks.workunit.client.1.smithi093.stdout:2/188: write d5/d14/d2d/d12/f22 [441693,65821] 0 2023-12-12T11:51:39.275 INFO:tasks.workunit.client.1.smithi093.stdout:2/189: dread - d5/d14/d2d/d12/f2c zero size 2023-12-12T11:51:39.275 INFO:tasks.workunit.client.1.smithi093.stdout:3/96: mknod df/c1d 0 2023-12-12T11:51:39.276 INFO:tasks.workunit.client.1.smithi093.stdout:3/97: write df/f1c [832692,4570] 0 2023-12-12T11:51:39.278 INFO:tasks.workunit.client.1.smithi093.stdout:5/100: rmdir d0/d7 39 2023-12-12T11:51:39.279 INFO:tasks.workunit.client.1.smithi093.stdout:4/244: getdents d0/d36/d49 0 2023-12-12T11:51:39.282 INFO:tasks.workunit.client.1.smithi093.stdout:0/118: symlink d5/dd/d14/l29 0 2023-12-12T11:51:39.282 INFO:tasks.workunit.client.1.smithi093.stdout:0/119: chown d5/d21/d27 1 1 2023-12-12T11:51:39.283 INFO:tasks.workunit.client.1.smithi093.stdout:6/216: symlink d0/l50 0 2023-12-12T11:51:39.290 INFO:tasks.workunit.client.1.smithi093.stdout:4/245: mknod d0/d31/c4f 0 2023-12-12T11:51:39.291 INFO:tasks.workunit.client.1.smithi093.stdout:0/120: symlink d5/dd/d14/d26/l2a 0 2023-12-12T11:51:39.292 INFO:tasks.workunit.client.1.smithi093.stdout:2/190: getdents d5/d14/d27 0 2023-12-12T11:51:39.293 INFO:tasks.workunit.client.1.smithi093.stdout:8/94: sync 2023-12-12T11:51:39.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:38 smithi063 ceph-mon[107117]: Deploying cephadm binary to smithi093 2023-12-12T11:51:39.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:38 smithi063 ceph-mon[107117]: Deploying cephadm binary to smithi063 2023-12-12T11:51:39.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:38 smithi063 ceph-mon[107117]: pgmap v3: 65 pgs: 65 active+clean; 504 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail 2023-12-12T11:51:39.295 INFO:tasks.workunit.client.1.smithi093.stdout:4/246: creat d0/d36/f50 x:0 0 0 2023-12-12T11:51:39.297 INFO:tasks.workunit.client.1.smithi093.stdout:2/191: symlink d5/l3d 0 2023-12-12T11:51:39.297 INFO:tasks.workunit.client.1.smithi093.stdout:2/192: dread - d5/d14/d2d/d12/d25/f29 zero size 2023-12-12T11:51:39.299 INFO:tasks.workunit.client.1.smithi093.stdout:0/121: mkdir d5/d2b 0 2023-12-12T11:51:39.299 INFO:tasks.workunit.client.1.smithi093.stdout:0/122: getdents d5/d21/d27 0 2023-12-12T11:51:39.299 INFO:tasks.workunit.client.1.smithi093.stdout:8/95: truncate d3/d8/f18 89087 0 2023-12-12T11:51:39.299 INFO:tasks.workunit.client.1.smithi093.stdout:8/96: fdatasync f0 0 2023-12-12T11:51:39.299 INFO:tasks.workunit.client.1.smithi093.stdout:8/97: readlink d3/l4 0 2023-12-12T11:51:39.317 INFO:tasks.workunit.client.1.smithi093.stdout:6/217: dread d0/da/d32/f36 [0,4194304] 0 2023-12-12T11:51:39.317 INFO:tasks.workunit.client.1.smithi093.stdout:6/218: readlink d0/da/d32/d40/l4c 0 2023-12-12T11:51:39.322 INFO:tasks.workunit.client.1.smithi093.stdout:6/219: symlink d0/l51 0 2023-12-12T11:51:39.324 INFO:tasks.workunit.client.1.smithi093.stdout:6/220: getdents d0/d19/d42 0 2023-12-12T11:51:39.324 INFO:tasks.workunit.client.1.smithi093.stdout:6/221: truncate d0/d19/d42/f45 743307 0 2023-12-12T11:51:39.325 INFO:tasks.workunit.client.1.smithi093.stdout:6/222: mkdir d0/d52 0 2023-12-12T11:51:39.339 INFO:tasks.workunit.client.1.smithi093.stdout:5/101: dread d0/f15 [4194304,4194304] 0 2023-12-12T11:51:39.339 INFO:tasks.workunit.client.1.smithi093.stdout:4/247: read d0/f14 [772377,121400] 0 2023-12-12T11:51:39.339 INFO:tasks.workunit.client.1.smithi093.stdout:5/102: creat d0/d7/d8/de/d14/d1e/f1f x:0 0 0 2023-12-12T11:51:39.358 INFO:tasks.workunit.client.1.smithi093.stdout:3/98: dwrite df/f1a [0,4194304] 0 2023-12-12T11:51:39.358 INFO:tasks.workunit.client.1.smithi093.stdout:3/99: write df/f1c [1645314,158] 0 2023-12-12T11:51:39.361 INFO:tasks.workunit.client.1.smithi093.stdout:8/98: dwrite d3/f17 [0,4194304] 0 2023-12-12T11:51:39.365 INFO:tasks.workunit.client.1.smithi093.stdout:3/100: symlink df/l1e 0 2023-12-12T11:51:39.365 INFO:tasks.workunit.client.1.smithi093.stdout:3/101: truncate df/f19 4860659 0 2023-12-12T11:51:39.365 INFO:tasks.workunit.client.1.smithi093.stdout:4/248: dread d0/f1c [0,4194304] 0 2023-12-12T11:51:39.368 INFO:tasks.workunit.client.1.smithi093.stdout:3/102: symlink df/l1f 0 2023-12-12T11:51:39.369 INFO:tasks.workunit.client.1.smithi093.stdout:4/249: creat d0/d31/f51 x:0 0 0 2023-12-12T11:51:39.369 INFO:tasks.workunit.client.1.smithi093.stdout:4/250: fdatasync d0/d36/d49/f4a 0 2023-12-12T11:51:39.369 INFO:tasks.workunit.client.1.smithi093.stdout:4/251: readlink d0/l41 0 2023-12-12T11:51:39.370 INFO:tasks.workunit.client.1.smithi093.stdout:3/103: symlink df/l20 0 2023-12-12T11:51:39.371 INFO:tasks.workunit.client.1.smithi093.stdout:4/252: mknod d0/c52 0 2023-12-12T11:51:39.373 INFO:tasks.workunit.client.1.smithi093.stdout:3/104: rename df/f13 to df/f21 0 2023-12-12T11:51:39.373 INFO:tasks.workunit.client.1.smithi093.stdout:2/193: dwrite d5/d14/d2d/ff [0,4194304] 0 2023-12-12T11:51:39.373 INFO:tasks.workunit.client.1.smithi093.stdout:2/194: stat d5/l23 0 2023-12-12T11:51:39.373 INFO:tasks.workunit.client.1.smithi093.stdout:2/195: dread - d5/d14/d2d/f1f zero size 2023-12-12T11:51:39.374 INFO:tasks.workunit.client.1.smithi093.stdout:2/196: chown d5/d14/f3c 721 1 2023-12-12T11:51:39.376 INFO:tasks.workunit.client.1.smithi093.stdout:2/197: symlink d5/d14/d2d/d12/d25/l3e 0 2023-12-12T11:51:39.384 INFO:tasks.workunit.client.1.smithi093.stdout:6/223: dwrite d0/da/d32/f36 [0,4194304] 0 2023-12-12T11:51:39.386 INFO:tasks.workunit.client.1.smithi093.stdout:6/224: truncate d0/f11 1565751 0 2023-12-12T11:51:39.403 INFO:tasks.workunit.client.1.smithi093.stdout:6/225: link d0/f11 d0/d19/d42/f53 0 2023-12-12T11:51:39.404 INFO:tasks.workunit.client.1.smithi093.stdout:6/226: rmdir d0/da/d32/d40 39 2023-12-12T11:51:39.405 INFO:tasks.workunit.client.1.smithi093.stdout:4/253: dread d0/f17 [0,4194304] 0 2023-12-12T11:51:39.405 INFO:tasks.workunit.client.1.smithi093.stdout:4/254: fdatasync d0/d31/f28 0 2023-12-12T11:51:39.405 INFO:tasks.workunit.client.1.smithi093.stdout:4/255: chown d0/l4 449381 1 2023-12-12T11:51:39.405 INFO:tasks.workunit.client.1.smithi093.stdout:0/123: dwrite d5/fa [0,4194304] 0 2023-12-12T11:51:39.411 INFO:tasks.workunit.client.1.smithi093.stdout:6/227: symlink d0/da/d14/d38/l54 0 2023-12-12T11:51:39.415 INFO:tasks.workunit.client.1.smithi093.stdout:4/256: mknod d0/c53 0 2023-12-12T11:51:39.416 INFO:tasks.workunit.client.1.smithi093.stdout:6/228: creat d0/da/d14/f55 x:0 0 0 2023-12-12T11:51:39.418 INFO:tasks.workunit.client.1.smithi093.stdout:4/257: rename d0/d31/f46 to d0/f54 0 2023-12-12T11:51:39.421 INFO:tasks.workunit.client.1.smithi093.stdout:6/229: rename d0/da/d14/d38/c41 to d0/da/d14/c56 0 2023-12-12T11:51:39.424 INFO:tasks.workunit.client.1.smithi093.stdout:6/230: link d0/da/d14/d21/c28 d0/d19/d42/c57 0 2023-12-12T11:51:39.436 INFO:tasks.workunit.client.1.smithi093.stdout:2/198: write d5/f19 [4026764,52840] 0 2023-12-12T11:51:39.436 INFO:tasks.workunit.client.1.smithi093.stdout:8/99: dwrite d3/d8/fc [0,4194304] 0 2023-12-12T11:51:39.438 INFO:tasks.workunit.client.1.smithi093.stdout:2/199: rename d5/d14/f34 to d5/d31/f3f 0 2023-12-12T11:51:39.438 INFO:tasks.workunit.client.1.smithi093.stdout:2/200: creat d5/d14/f40 x:0 0 0 2023-12-12T11:51:39.438 INFO:tasks.workunit.client.1.smithi093.stdout:2/201: write d5/d14/d2d/d12/d25/f33 [955714,75158] 0 2023-12-12T11:51:39.439 INFO:tasks.workunit.client.1.smithi093.stdout:8/100: unlink d3/c5 0 2023-12-12T11:51:39.441 INFO:tasks.workunit.client.1.smithi093.stdout:8/101: mkdir d3/d1a 0 2023-12-12T11:51:39.457 INFO:tasks.workunit.client.1.smithi093.stdout:8/102: read d3/d8/f19 [3412378,80573] 0 2023-12-12T11:51:39.460 INFO:tasks.workunit.client.1.smithi093.stdout:3/105: dwrite df/f19 [4194304,4194304] 0 2023-12-12T11:51:39.464 INFO:tasks.workunit.client.1.smithi093.stdout:3/106: mkdir df/d22 0 2023-12-12T11:51:39.464 INFO:tasks.workunit.client.1.smithi093.stdout:3/107: chown df/f19 64606 1 2023-12-12T11:51:39.464 INFO:tasks.workunit.client.1.smithi093.stdout:3/108: creat df/d22/f23 x:0 0 0 2023-12-12T11:51:39.465 INFO:tasks.workunit.client.1.smithi093.stdout:1/112: sync 2023-12-12T11:51:39.466 INFO:tasks.workunit.client.1.smithi093.stdout:3/109: mknod df/d22/c24 0 2023-12-12T11:51:39.466 INFO:tasks.workunit.client.1.smithi093.stdout:3/110: fsync fd 0 2023-12-12T11:51:39.467 INFO:tasks.workunit.client.1.smithi093.stdout:3/111: write df/f1c [2015833,122508] 0 2023-12-12T11:51:39.469 INFO:tasks.workunit.client.1.smithi093.stdout:3/112: mkdir df/d25 0 2023-12-12T11:51:39.469 INFO:tasks.workunit.client.1.smithi093.stdout:3/113: stat df/d22 0 2023-12-12T11:51:39.470 INFO:tasks.workunit.client.1.smithi093.stdout:3/114: link df/c1b df/c26 0 2023-12-12T11:51:39.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:38 smithi093 ceph-mon[115914]: Deploying cephadm binary to smithi093 2023-12-12T11:51:39.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:38 smithi093 ceph-mon[115914]: Deploying cephadm binary to smithi063 2023-12-12T11:51:39.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:38 smithi093 ceph-mon[115914]: pgmap v3: 65 pgs: 65 active+clean; 504 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail 2023-12-12T11:51:39.471 INFO:tasks.workunit.client.1.smithi093.stdout:3/115: fdatasync df/f19 0 2023-12-12T11:51:39.471 INFO:tasks.workunit.client.1.smithi093.stdout:3/116: chown df/l1e 3904 1 2023-12-12T11:51:39.472 INFO:tasks.workunit.client.1.smithi093.stdout:3/117: rename fd to df/d22/f27 0 2023-12-12T11:51:39.474 INFO:tasks.workunit.client.1.smithi093.stdout:1/113: dread d4/fd [0,4194304] 0 2023-12-12T11:51:39.474 INFO:tasks.workunit.client.1.smithi093.stdout:3/118: rename df/f12 to df/f28 0 2023-12-12T11:51:39.476 INFO:tasks.workunit.client.1.smithi093.stdout:1/114: link d4/dc/f17 d4/d1a/d1b/f1e 0 2023-12-12T11:51:39.476 INFO:tasks.workunit.client.1.smithi093.stdout:1/115: fsync d4/fd 0 2023-12-12T11:51:39.476 INFO:tasks.workunit.client.1.smithi093.stdout:1/116: truncate d4/fd 815489 0 2023-12-12T11:51:39.477 INFO:tasks.workunit.client.1.smithi093.stdout:9/71: sync 2023-12-12T11:51:39.477 INFO:tasks.workunit.client.1.smithi093.stdout:5/103: sync 2023-12-12T11:51:39.477 INFO:tasks.workunit.client.1.smithi093.stdout:5/104: chown d0/d7/d19 48792 1 2023-12-12T11:51:39.477 INFO:tasks.workunit.client.1.smithi093.stdout:9/72: fsync d1/f16 0 2023-12-12T11:51:39.480 INFO:tasks.workunit.client.1.smithi093.stdout:1/117: symlink d4/l1f 0 2023-12-12T11:51:39.480 INFO:tasks.workunit.client.1.smithi093.stdout:7/94: sync 2023-12-12T11:51:39.481 INFO:tasks.workunit.client.1.smithi093.stdout:7/95: write da/d15/f16 [3596730,4735] 0 2023-12-12T11:51:39.481 INFO:tasks.workunit.client.1.smithi093.stdout:1/118: symlink d4/d1a/l20 0 2023-12-12T11:51:39.481 INFO:tasks.workunit.client.1.smithi093.stdout:1/119: chown d4 19 1 2023-12-12T11:51:39.481 INFO:tasks.workunit.client.1.smithi093.stdout:7/96: fsync f0 0 2023-12-12T11:51:39.483 INFO:tasks.workunit.client.1.smithi093.stdout:1/120: truncate d4/f8 3045970 0 2023-12-12T11:51:39.492 INFO:tasks.workunit.client.1.smithi093.stdout:6/231: dwrite d0/d19/f49 [4194304,4194304] 0 2023-12-12T11:51:39.493 INFO:tasks.workunit.client.1.smithi093.stdout:6/232: creat d0/d19/f58 x:0 0 0 2023-12-12T11:51:39.496 INFO:tasks.workunit.client.1.smithi093.stdout:1/121: creat d4/d1c/f21 x:0 0 0 2023-12-12T11:51:39.501 INFO:tasks.workunit.client.1.smithi093.stdout:6/233: link d0/d19/d42/c57 d0/da/d14/d38/c59 0 2023-12-12T11:51:39.501 INFO:tasks.workunit.client.1.smithi093.stdout:7/97: getdents da/d15 0 2023-12-12T11:51:39.501 INFO:tasks.workunit.client.1.smithi093.stdout:7/98: chown da/de/c14 16 1 2023-12-12T11:51:39.501 INFO:tasks.workunit.client.1.smithi093.stdout:7/99: write da/d15/f1a [652516,42395] 0 2023-12-12T11:51:39.502 INFO:tasks.workunit.client.1.smithi093.stdout:6/234: creat d0/da/d14/d38/d43/f5a x:0 0 0 2023-12-12T11:51:39.503 INFO:tasks.workunit.client.1.smithi093.stdout:9/73: write d1/ff [3988242,68107] 0 2023-12-12T11:51:39.506 INFO:tasks.workunit.client.1.smithi093.stdout:9/74: creat d1/d12/f19 x:0 0 0 2023-12-12T11:51:39.506 INFO:tasks.workunit.client.1.smithi093.stdout:9/75: creat d1/d12/f1a x:0 0 0 2023-12-12T11:51:39.512 INFO:tasks.workunit.client.1.smithi093.stdout:9/76: symlink d1/l1b 0 2023-12-12T11:51:39.538 INFO:tasks.workunit.client.1.smithi093.stdout:3/119: dwrite df/f19 [0,4194304] 0 2023-12-12T11:51:39.548 INFO:tasks.workunit.client.1.smithi093.stdout:5/105: dwrite d0/d7/d8/f13 [0,4194304] 0 2023-12-12T11:51:39.550 INFO:tasks.workunit.client.1.smithi093.stdout:5/106: stat d0/c4 0 2023-12-12T11:51:39.556 INFO:tasks.workunit.client.1.smithi093.stdout:3/120: write fc [136806,117282] 0 2023-12-12T11:51:39.560 INFO:tasks.workunit.client.1.smithi093.stdout:5/107: creat d0/d7/f20 x:0 0 0 2023-12-12T11:51:39.565 INFO:tasks.workunit.client.1.smithi093.stdout:1/122: dwrite d4/dc/f10 [0,4194304] 0 2023-12-12T11:51:39.567 INFO:tasks.workunit.client.1.smithi093.stdout:5/108: symlink d0/d7/d8/de/d14/d1e/l21 0 2023-12-12T11:51:39.571 INFO:tasks.workunit.client.1.smithi093.stdout:1/123: symlink d4/dc/l22 0 2023-12-12T11:51:39.572 INFO:tasks.workunit.client.1.smithi093.stdout:1/124: truncate d4/d1c/f21 445064 0 2023-12-12T11:51:39.572 INFO:tasks.workunit.client.1.smithi093.stdout:1/125: fdatasync d4/fa 0 2023-12-12T11:51:39.575 INFO:tasks.workunit.client.1.smithi093.stdout:1/126: symlink d4/d1a/l23 0 2023-12-12T11:51:39.575 INFO:tasks.workunit.client.1.smithi093.stdout:1/127: fdatasync d4/dc/f10 0 2023-12-12T11:51:39.578 INFO:tasks.workunit.client.1.smithi093.stdout:5/109: rename d0/d7/d8/de/d14 to d0/d7/d8/d22 0 2023-12-12T11:51:39.578 INFO:tasks.workunit.client.1.smithi093.stdout:5/110: chown d0/d7/d8/c16 1876 1 2023-12-12T11:51:39.579 INFO:tasks.workunit.client.1.smithi093.stdout:3/121: dread df/f21 [0,4194304] 0 2023-12-12T11:51:39.579 INFO:tasks.workunit.client.1.smithi093.stdout:9/77: dwrite d1/f16 [0,4194304] 0 2023-12-12T11:51:39.579 INFO:tasks.workunit.client.1.smithi093.stdout:9/78: stat d1/d12/c18 0 2023-12-12T11:51:39.579 INFO:tasks.workunit.client.1.smithi093.stdout:1/128: rmdir d4/dc 39 2023-12-12T11:51:39.580 INFO:tasks.workunit.client.1.smithi093.stdout:1/129: fdatasync d4/fa 0 2023-12-12T11:51:39.580 INFO:tasks.workunit.client.1.smithi093.stdout:0/124: sync 2023-12-12T11:51:39.585 INFO:tasks.workunit.client.1.smithi093.stdout:5/111: rmdir d0/d7/d19 39 2023-12-12T11:51:39.585 INFO:tasks.workunit.client.1.smithi093.stdout:9/79: rmdir d1/d11 0 2023-12-12T11:51:39.585 INFO:tasks.workunit.client.1.smithi093.stdout:9/80: fdatasync d1/f16 0 2023-12-12T11:51:39.585 INFO:tasks.workunit.client.1.smithi093.stdout:1/130: rmdir d4/dc 39 2023-12-12T11:51:39.596 INFO:tasks.workunit.client.1.smithi093.stdout:7/100: dwrite da/f11 [0,4194304] 0 2023-12-12T11:51:39.596 INFO:tasks.workunit.client.1.smithi093.stdout:7/101: chown da/d15/f1c 4947 1 2023-12-12T11:51:39.597 INFO:tasks.workunit.client.1.smithi093.stdout:1/131: creat d4/d1a/f24 x:0 0 0 2023-12-12T11:51:39.599 INFO:tasks.workunit.client.1.smithi093.stdout:7/102: creat da/d15/d19/f1e x:0 0 0 2023-12-12T11:51:39.603 INFO:tasks.workunit.client.1.smithi093.stdout:7/103: symlink da/l1f 0 2023-12-12T11:51:39.603 INFO:tasks.workunit.client.1.smithi093.stdout:7/104: fdatasync da/d15/f1a 0 2023-12-12T11:51:39.603 INFO:tasks.workunit.client.1.smithi093.stdout:7/105: readlink da/l18 0 2023-12-12T11:51:39.603 INFO:tasks.workunit.client.1.smithi093.stdout:7/106: creat da/f20 x:0 0 0 2023-12-12T11:51:39.603 INFO:tasks.workunit.client.1.smithi093.stdout:7/107: creat da/d15/d19/f21 x:0 0 0 2023-12-12T11:51:39.609 INFO:tasks.workunit.client.1.smithi093.stdout:6/235: dwrite d0/da/d32/f4a [0,4194304] 0 2023-12-12T11:51:39.611 INFO:tasks.workunit.client.1.smithi093.stdout:3/122: write df/f28 [2657920,1310] 0 2023-12-12T11:51:39.615 INFO:tasks.workunit.client.1.smithi093.stdout:9/81: read d1/f5 [352275,18875] 0 2023-12-12T11:51:39.618 INFO:tasks.workunit.client.1.smithi093.stdout:9/82: write d1/d12/f1a [140392,91302] 0 2023-12-12T11:51:39.618 INFO:tasks.workunit.client.1.smithi093.stdout:1/132: getdents d4/d1a 0 2023-12-12T11:51:39.622 INFO:tasks.workunit.client.1.smithi093.stdout:3/123: write df/f21 [3237080,111485] 0 2023-12-12T11:51:39.622 INFO:tasks.workunit.client.1.smithi093.stdout:3/124: chown df/d25 637996 1 2023-12-12T11:51:39.622 INFO:tasks.workunit.client.1.smithi093.stdout:3/125: chown df/l1f 1746354355 1 2023-12-12T11:51:39.625 INFO:tasks.workunit.client.1.smithi093.stdout:6/236: mkdir d0/da/d32/d39/d5b 0 2023-12-12T11:51:39.628 INFO:tasks.workunit.client.1.smithi093.stdout:1/133: creat d4/f25 x:0 0 0 2023-12-12T11:51:39.630 INFO:tasks.workunit.client.1.smithi093.stdout:3/126: symlink df/d25/l29 0 2023-12-12T11:51:39.632 INFO:tasks.workunit.client.1.smithi093.stdout:6/237: getdents d0/d19/d42 0 2023-12-12T11:51:39.632 INFO:tasks.workunit.client.1.smithi093.stdout:6/238: fsync d0/d19/d42/f53 0 2023-12-12T11:51:39.632 INFO:tasks.workunit.client.1.smithi093.stdout:6/239: fsync d0/d19/d42/f53 0 2023-12-12T11:51:39.633 INFO:tasks.workunit.client.1.smithi093.stdout:9/83: dread d1/fc [0,4194304] 0 2023-12-12T11:51:39.633 INFO:tasks.workunit.client.1.smithi093.stdout:0/125: dwrite d5/f24 [0,4194304] 0 2023-12-12T11:51:39.633 INFO:tasks.workunit.client.1.smithi093.stdout:0/126: write d5/dd/f16 [5198655,32585] 0 2023-12-12T11:51:39.637 INFO:tasks.workunit.client.1.smithi093.stdout:1/134: mkdir d4/d1a/d1b/d26 0 2023-12-12T11:51:39.637 INFO:tasks.workunit.client.1.smithi093.stdout:3/127: symlink df/d22/l2a 0 2023-12-12T11:51:39.637 INFO:tasks.workunit.client.1.smithi093.stdout:3/128: fsync fc 0 2023-12-12T11:51:39.637 INFO:tasks.workunit.client.1.smithi093.stdout:7/108: rmdir da/d15/d19 39 2023-12-12T11:51:39.643 INFO:tasks.workunit.client.1.smithi093.stdout:1/135: rename d4/d1a/d1b/f1e to d4/d1a/d1b/d26/f27 0 2023-12-12T11:51:39.645 INFO:tasks.workunit.client.1.smithi093.stdout:3/129: rmdir df/d25 39 2023-12-12T11:51:39.645 INFO:tasks.workunit.client.1.smithi093.stdout:2/202: sync 2023-12-12T11:51:39.645 INFO:tasks.workunit.client.1.smithi093.stdout:8/103: sync 2023-12-12T11:51:39.645 INFO:tasks.workunit.client.1.smithi093.stdout:2/203: fsync d5/d14/d2d/f1e 0 2023-12-12T11:51:39.649 INFO:tasks.workunit.client.1.smithi093.stdout:0/127: write d5/f24 [1665696,25411] 0 2023-12-12T11:51:39.649 INFO:tasks.workunit.client.1.smithi093.stdout:4/258: sync 2023-12-12T11:51:39.653 INFO:tasks.workunit.client.1.smithi093.stdout:3/130: mkdir df/d22/d2b 0 2023-12-12T11:51:39.655 INFO:tasks.workunit.client.1.smithi093.stdout:2/204: link d5/d14/d2d/f2b d5/d14/d27/f41 0 2023-12-12T11:51:39.656 INFO:tasks.workunit.client.1.smithi093.stdout:8/104: symlink d3/d1a/l1b 0 2023-12-12T11:51:39.657 INFO:tasks.workunit.client.1.smithi093.stdout:3/131: mkdir df/d25/d2c 0 2023-12-12T11:51:39.660 INFO:tasks.workunit.client.1.smithi093.stdout:2/205: rename d5/d14/d2d/f38 to d5/d14/d2d/f42 0 2023-12-12T11:51:39.660 INFO:tasks.workunit.client.1.smithi093.stdout:6/240: dread d0/da/d14/f1b [0,4194304] 0 2023-12-12T11:51:39.660 INFO:tasks.workunit.client.1.smithi093.stdout:6/241: chown d0/da/d32 298 1 2023-12-12T11:51:39.662 INFO:tasks.workunit.client.1.smithi093.stdout:9/84: dread d1/fe [0,4194304] 0 2023-12-12T11:51:39.662 INFO:tasks.workunit.client.1.smithi093.stdout:9/85: truncate d1/d12/f1a 676177 0 2023-12-12T11:51:39.662 INFO:tasks.workunit.client.1.smithi093.stdout:9/86: creat d1/d12/f1c x:0 0 0 2023-12-12T11:51:39.674 INFO:tasks.workunit.client.1.smithi093.stdout:9/87: mknod d1/d12/c1d 0 2023-12-12T11:51:39.682 INFO:tasks.workunit.client.1.smithi093.stdout:1/136: getdents d4/d1a/d1b/d26 0 2023-12-12T11:51:39.682 INFO:tasks.workunit.client.1.smithi093.stdout:1/137: chown d4/dc/l19 1 1 2023-12-12T11:51:39.689 INFO:tasks.workunit.client.1.smithi093.stdout:7/109: dwrite da/f1d [0,4194304] 0 2023-12-12T11:51:39.692 INFO:tasks.workunit.client.1.smithi093.stdout:7/110: unlink da/d15/f1b 0 2023-12-12T11:51:39.699 INFO:tasks.workunit.client.1.smithi093.stdout:3/132: dread df/d22/f27 [0,4194304] 0 2023-12-12T11:51:39.699 INFO:tasks.workunit.client.1.smithi093.stdout:7/111: unlink da/d15/f1a 0 2023-12-12T11:51:39.704 INFO:tasks.workunit.client.1.smithi093.stdout:3/133: symlink df/d22/l2d 0 2023-12-12T11:51:39.707 INFO:tasks.workunit.client.1.smithi093.stdout:7/112: mkdir da/d15/d22 0 2023-12-12T11:51:39.712 INFO:tasks.workunit.client.1.smithi093.stdout:3/134: rename f9 to df/f2e 0 2023-12-12T11:51:39.716 INFO:tasks.workunit.client.1.smithi093.stdout:7/113: mknod da/de/c23 0 2023-12-12T11:51:39.716 INFO:tasks.workunit.client.1.smithi093.stdout:7/114: truncate da/f1d 4838964 0 2023-12-12T11:51:39.720 INFO:tasks.workunit.client.1.smithi093.stdout:8/105: dread d3/f17 [0,4194304] 0 2023-12-12T11:51:39.720 INFO:tasks.workunit.client.1.smithi093.stdout:8/106: chown d3 411783 1 2023-12-12T11:51:39.721 INFO:tasks.workunit.client.1.smithi093.stdout:3/135: link df/f1c df/f2f 0 2023-12-12T11:51:39.721 INFO:tasks.workunit.client.1.smithi093.stdout:3/136: fsync df/f10 0 2023-12-12T11:51:39.724 INFO:tasks.workunit.client.1.smithi093.stdout:2/206: dwrite d5/f10 [0,4194304] 0 2023-12-12T11:51:39.725 INFO:tasks.workunit.client.1.smithi093.stdout:7/115: link da/d15/f16 da/d15/f24 0 2023-12-12T11:51:39.726 INFO:tasks.workunit.client.1.smithi093.stdout:9/88: dwrite d1/d12/f1a [0,4194304] 0 2023-12-12T11:51:39.727 INFO:tasks.workunit.client.1.smithi093.stdout:3/137: truncate df/f2e 967392 0 2023-12-12T11:51:39.729 INFO:tasks.workunit.client.1.smithi093.stdout:2/207: mknod d5/c43 0 2023-12-12T11:51:39.734 INFO:tasks.workunit.client.1.smithi093.stdout:0/128: dwrite d5/f13 [4194304,4194304] 0 2023-12-12T11:51:39.734 INFO:tasks.workunit.client.1.smithi093.stdout:3/138: rename df/d22/d2b to df/d30 0 2023-12-12T11:51:39.734 INFO:tasks.workunit.client.1.smithi093.stdout:3/139: creat df/d22/f31 x:0 0 0 2023-12-12T11:51:39.738 INFO:tasks.workunit.client.1.smithi093.stdout:2/208: mkdir d5/d14/d2d/d12/d44 0 2023-12-12T11:51:39.740 INFO:tasks.workunit.client.1.smithi093.stdout:1/138: dwrite d4/fa [0,4194304] 0 2023-12-12T11:51:39.743 INFO:tasks.workunit.client.1.smithi093.stdout:0/129: symlink d5/dd/d14/d26/l2c 0 2023-12-12T11:51:39.743 INFO:tasks.workunit.client.1.smithi093.stdout:8/107: dread d3/d8/fc [0,4194304] 0 2023-12-12T11:51:39.743 INFO:tasks.workunit.client.1.smithi093.stdout:8/108: creat d3/f1c x:0 0 0 2023-12-12T11:51:39.744 INFO:tasks.workunit.client.1.smithi093.stdout:6/242: dwrite d0/d19/f3f [0,4194304] 0 2023-12-12T11:51:39.744 INFO:tasks.workunit.client.1.smithi093.stdout:6/243: readlink d0/l6 0 2023-12-12T11:51:39.745 INFO:tasks.workunit.client.1.smithi093.stdout:2/209: rename d5/f11 to d5/d31/f45 0 2023-12-12T11:51:39.751 INFO:tasks.workunit.client.1.smithi093.stdout:7/116: write da/f1d [5210198,88454] 0 2023-12-12T11:51:39.752 INFO:tasks.workunit.client.1.smithi093.stdout:7/117: write da/f20 [619673,55418] 0 2023-12-12T11:51:39.752 INFO:tasks.workunit.client.1.smithi093.stdout:7/118: creat da/de/f25 x:0 0 0 2023-12-12T11:51:39.752 INFO:tasks.workunit.client.1.smithi093.stdout:7/119: write da/d15/f16 [881211,43516] 0 2023-12-12T11:51:39.753 INFO:tasks.workunit.client.1.smithi093.stdout:3/140: dread df/f10 [0,4194304] 0 2023-12-12T11:51:39.753 INFO:tasks.workunit.client.1.smithi093.stdout:3/141: fdatasync df/d22/f27 0 2023-12-12T11:51:39.754 INFO:tasks.workunit.client.1.smithi093.stdout:7/120: write da/f20 [102269,27349] 0 2023-12-12T11:51:39.756 INFO:tasks.workunit.client.1.smithi093.stdout:1/139: rmdir d4/d1a 39 2023-12-12T11:51:39.756 INFO:tasks.workunit.client.1.smithi093.stdout:1/140: chown d4/d1a 106 1 2023-12-12T11:51:39.770 INFO:tasks.workunit.client.1.smithi093.stdout:0/130: read d5/fa [2567892,46926] 0 2023-12-12T11:51:39.771 INFO:tasks.workunit.client.1.smithi093.stdout:0/131: fdatasync d5/dd/d14/f18 0 2023-12-12T11:51:39.771 INFO:tasks.workunit.client.1.smithi093.stdout:6/244: link d0/c17 d0/c5c 0 2023-12-12T11:51:39.771 INFO:tasks.workunit.client.1.smithi093.stdout:2/210: truncate d5/d14/d2d/f1e 538897 0 2023-12-12T11:51:39.772 INFO:tasks.workunit.client.1.smithi093.stdout:3/142: truncate fc 1713659 0 2023-12-12T11:51:39.774 INFO:tasks.workunit.client.1.smithi093.stdout:9/89: dwrite d1/ff [0,4194304] 0 2023-12-12T11:51:39.774 INFO:tasks.workunit.client.1.smithi093.stdout:9/90: creat d1/f1e x:0 0 0 2023-12-12T11:51:39.775 INFO:tasks.workunit.client.1.smithi093.stdout:7/121: rmdir da/d15/d22 0 2023-12-12T11:51:39.778 INFO:tasks.workunit.client.1.smithi093.stdout:1/141: rename d4/dc/fe to d4/dc/f28 0 2023-12-12T11:51:39.790 INFO:tasks.workunit.client.1.smithi093.stdout:7/122: creat da/d15/f26 x:0 0 0 2023-12-12T11:51:39.802 INFO:tasks.workunit.client.1.smithi093.stdout:2/211: getdents d5 0 2023-12-12T11:51:39.804 INFO:tasks.workunit.client.1.smithi093.stdout:7/123: truncate da/de/f10 1096516 0 2023-12-12T11:51:39.808 INFO:tasks.workunit.client.1.smithi093.stdout:9/91: dwrite d1/d12/f19 [0,4194304] 0 2023-12-12T11:51:39.808 INFO:tasks.workunit.client.1.smithi093.stdout:2/212: mkdir d5/d46 0 2023-12-12T11:51:39.808 INFO:tasks.workunit.client.1.smithi093.stdout:2/213: readlink d5/d14/d2d/d12/l37 0 2023-12-12T11:51:39.809 INFO:tasks.workunit.client.1.smithi093.stdout:7/124: rename da/de/f25 to da/de/f27 0 2023-12-12T11:51:39.812 INFO:tasks.workunit.client.1.smithi093.stdout:4/259: sync 2023-12-12T11:51:39.812 INFO:tasks.workunit.client.1.smithi093.stdout:5/112: sync 2023-12-12T11:51:39.815 INFO:tasks.workunit.client.1.smithi093.stdout:9/92: mkdir d1/d12/d1f 0 2023-12-12T11:51:39.817 INFO:tasks.workunit.client.1.smithi093.stdout:4/260: mknod d0/d36/c55 0 2023-12-12T11:51:39.817 INFO:tasks.workunit.client.1.smithi093.stdout:4/261: stat d0/f20 0 2023-12-12T11:51:39.819 INFO:tasks.workunit.client.1.smithi093.stdout:8/109: getdents d3 0 2023-12-12T11:51:39.820 INFO:tasks.workunit.client.1.smithi093.stdout:5/113: creat d0/d7/d8/de/f23 x:0 0 0 2023-12-12T11:51:39.825 INFO:tasks.workunit.client.1.smithi093.stdout:4/262: mknod d0/d36/c56 0 2023-12-12T11:51:39.825 INFO:tasks.workunit.client.1.smithi093.stdout:4/263: fdatasync d0/f1d 0 2023-12-12T11:51:39.825 INFO:tasks.workunit.client.1.smithi093.stdout:4/264: chown d0/d36 3772 1 2023-12-12T11:51:39.827 INFO:tasks.workunit.client.1.smithi093.stdout:8/110: symlink d3/d1a/l1d 0 2023-12-12T11:51:39.831 INFO:tasks.workunit.client.1.smithi093.stdout:5/114: rename d0/d7/d8/c16 to d0/d7/c24 0 2023-12-12T11:51:39.835 INFO:tasks.workunit.client.1.smithi093.stdout:8/111: creat d3/d1a/f1e x:0 0 0 2023-12-12T11:51:39.838 INFO:tasks.workunit.client.1.smithi093.stdout:3/143: dwrite df/d22/f27 [0,4194304] 0 2023-12-12T11:51:39.839 INFO:tasks.workunit.client.1.smithi093.stdout:8/112: mkdir d3/d1a/d1f 0 2023-12-12T11:51:39.839 INFO:tasks.workunit.client.1.smithi093.stdout:8/113: creat d3/d1a/f20 x:0 0 0 2023-12-12T11:51:39.845 INFO:tasks.workunit.client.1.smithi093.stdout:3/144: creat df/d25/f32 x:0 0 0 2023-12-12T11:51:39.850 INFO:tasks.workunit.client.1.smithi093.stdout:8/114: symlink d3/d1a/d1f/l21 0 2023-12-12T11:51:39.852 INFO:tasks.workunit.client.1.smithi093.stdout:3/145: mkdir df/d30/d33 0 2023-12-12T11:51:39.852 INFO:tasks.workunit.client.1.smithi093.stdout:3/146: readlink l8 0 2023-12-12T11:51:39.857 INFO:tasks.workunit.client.1.smithi093.stdout:8/115: mknod d3/c22 0 2023-12-12T11:51:39.857 INFO:tasks.workunit.client.1.smithi093.stdout:8/116: chown d3/d1a/l1b 938357 1 2023-12-12T11:51:39.857 INFO:tasks.workunit.client.1.smithi093.stdout:8/117: chown d3/c22 283 1 2023-12-12T11:51:39.857 INFO:tasks.workunit.client.1.smithi093.stdout:3/147: symlink df/d25/l34 0 2023-12-12T11:51:39.859 INFO:tasks.workunit.client.1.smithi093.stdout:3/148: truncate df/f1a 688811 0 2023-12-12T11:51:39.860 INFO:tasks.workunit.client.1.smithi093.stdout:3/149: dread - df/d25/f32 zero size 2023-12-12T11:51:39.860 INFO:tasks.workunit.client.1.smithi093.stdout:3/150: fdatasync df/f10 0 2023-12-12T11:51:39.866 INFO:tasks.workunit.client.1.smithi093.stdout:7/125: dwrite da/d15/f1c [0,4194304] 0 2023-12-12T11:51:39.870 INFO:tasks.workunit.client.1.smithi093.stdout:9/93: getdents d1/d12 0 2023-12-12T11:51:39.891 INFO:tasks.workunit.client.1.smithi093.stdout:4/265: dwrite d0/d31/f3b [4194304,4194304] 0 2023-12-12T11:51:39.900 INFO:tasks.workunit.client.1.smithi093.stdout:9/94: write d1/f16 [3892980,41153] 0 2023-12-12T11:51:39.903 INFO:tasks.workunit.client.1.smithi093.stdout:7/126: write f0 [6326160,78022] 0 2023-12-12T11:51:39.903 INFO:tasks.workunit.client.1.smithi093.stdout:4/266: dread d0/f18 [0,4194304] 0 2023-12-12T11:51:39.905 INFO:tasks.workunit.client.1.smithi093.stdout:7/127: link da/l12 da/l28 0 2023-12-12T11:51:39.911 INFO:tasks.workunit.client.1.smithi093.stdout:4/267: rmdir d0/d31 39 2023-12-12T11:51:39.916 INFO:tasks.workunit.client.1.smithi093.stdout:2/214: dwrite d5/d14/d2d/ff [0,4194304] 0 2023-12-12T11:51:39.920 INFO:tasks.workunit.client.1.smithi093.stdout:4/268: creat d0/d36/d40/f57 x:0 0 0 2023-12-12T11:51:39.920 INFO:tasks.workunit.client.1.smithi093.stdout:4/269: write d0/d36/f4c [216436,127126] 0 2023-12-12T11:51:39.920 INFO:tasks.workunit.client.1.smithi093.stdout:4/270: read - d0/d31/f51 zero size 2023-12-12T11:51:39.920 INFO:tasks.workunit.client.1.smithi093.stdout:4/271: readlink d0/l25 0 2023-12-12T11:51:39.920 INFO:tasks.workunit.client.1.smithi093.stdout:4/272: readlink d0/l1e 0 2023-12-12T11:51:39.925 INFO:tasks.workunit.client.1.smithi093.stdout:3/151: dwrite df/d22/f23 [0,4194304] 0 2023-12-12T11:51:39.933 INFO:tasks.workunit.client.1.smithi093.stdout:4/273: getdents d0/d31 0 2023-12-12T11:51:39.934 INFO:tasks.workunit.client.1.smithi093.stdout:8/118: dwrite d3/f1c [0,4194304] 0 2023-12-12T11:51:39.943 INFO:tasks.workunit.client.1.smithi093.stdout:4/274: mkdir d0/d36/d49/d58 0 2023-12-12T11:51:39.943 INFO:tasks.workunit.client.1.smithi093.stdout:4/275: truncate d0/d31/f29 873386 0 2023-12-12T11:51:39.948 INFO:tasks.workunit.client.1.smithi093.stdout:5/115: dwrite d0/f15 [0,4194304] 0 2023-12-12T11:51:39.949 INFO:tasks.workunit.client.1.smithi093.stdout:3/152: getdents df/d25 0 2023-12-12T11:51:39.952 INFO:tasks.workunit.client.1.smithi093.stdout:5/116: mknod d0/d7/d8/d22/d1e/c25 0 2023-12-12T11:51:39.956 INFO:tasks.workunit.client.1.smithi093.stdout:5/117: mknod d0/d7/d8/d22/d1e/c26 0 2023-12-12T11:51:39.957 INFO:tasks.workunit.client.1.smithi093.stdout:5/118: write d0/f3 [4587691,100636] 0 2023-12-12T11:51:39.957 INFO:tasks.workunit.client.1.smithi093.stdout:2/215: dread d5/d14/d2d/fc [4194304,4194304] 0 2023-12-12T11:51:39.965 INFO:tasks.workunit.client.1.smithi093.stdout:5/119: mkdir d0/d7/d27 0 2023-12-12T11:51:39.968 INFO:tasks.workunit.client.1.smithi093.stdout:2/216: mkdir d5/d14/d47 0 2023-12-12T11:51:39.968 INFO:tasks.workunit.client.1.smithi093.stdout:2/217: dread - d5/d14/d2d/d12/d25/f29 zero size 2023-12-12T11:51:39.971 INFO:tasks.workunit.client.1.smithi093.stdout:2/218: read d5/d14/d2d/f1c [39285,107108] 0 2023-12-12T11:51:39.972 INFO:tasks.workunit.client.1.smithi093.stdout:7/128: dwrite da/d15/f24 [0,4194304] 0 2023-12-12T11:51:39.972 INFO:tasks.workunit.client.1.smithi093.stdout:5/120: rename d0/d7/d8/de/f23 to d0/d7/d8/de/f28 0 2023-12-12T11:51:39.972 INFO:tasks.workunit.client.1.smithi093.stdout:5/121: fdatasync d0/f15 0 2023-12-12T11:51:39.972 INFO:tasks.workunit.client.1.smithi093.stdout:7/129: creat da/f29 x:0 0 0 2023-12-12T11:51:39.977 INFO:tasks.workunit.client.1.smithi093.stdout:9/95: dwrite d1/f5 [0,4194304] 0 2023-12-12T11:51:39.977 INFO:tasks.workunit.client.1.smithi093.stdout:5/122: mkdir d0/d7/d8/d22/d29 0 2023-12-12T11:51:39.979 INFO:tasks.workunit.client.1.smithi093.stdout:8/119: dwrite d3/f16 [0,4194304] 0 2023-12-12T11:51:39.980 INFO:tasks.workunit.client.1.smithi093.stdout:7/130: symlink da/de/l2a 0 2023-12-12T11:51:39.981 INFO:tasks.workunit.client.1.smithi093.stdout:0/132: sync 2023-12-12T11:51:39.982 INFO:tasks.workunit.client.1.smithi093.stdout:9/96: rename d1/fc to d1/d12/d1f/f20 0 2023-12-12T11:51:39.987 INFO:tasks.workunit.client.1.smithi093.stdout:6/245: sync 2023-12-12T11:51:39.987 INFO:tasks.workunit.client.1.smithi093.stdout:1/142: sync 2023-12-12T11:51:39.987 INFO:tasks.workunit.client.1.smithi093.stdout:1/143: stat d4/dc/c16 0 2023-12-12T11:51:39.987 INFO:tasks.workunit.client.1.smithi093.stdout:1/144: truncate d4/fd 1465931 0 2023-12-12T11:51:39.987 INFO:tasks.workunit.client.1.smithi093.stdout:4/276: dwrite d0/d31/f29 [0,4194304] 0 2023-12-12T11:51:39.987 INFO:tasks.workunit.client.1.smithi093.stdout:4/277: creat d0/d36/f59 x:0 0 0 2023-12-12T11:51:39.989 INFO:tasks.workunit.client.1.smithi093.stdout:5/123: link d0/f5 d0/d7/d8/d22/f2a 0 2023-12-12T11:51:39.992 INFO:tasks.workunit.client.1.smithi093.stdout:8/120: creat d3/d8/f23 x:0 0 0 2023-12-12T11:51:39.996 INFO:tasks.workunit.client.1.smithi093.stdout:7/131: creat da/d15/d19/f2b x:0 0 0 2023-12-12T11:51:40.000 INFO:tasks.workunit.client.1.smithi093.stdout:0/133: truncate d5/dd/f1a 637942 0 2023-12-12T11:51:40.004 INFO:tasks.workunit.client.1.smithi093.stdout:9/97: dread d1/d12/f19 [0,4194304] 0 2023-12-12T11:51:40.004 INFO:tasks.workunit.client.1.smithi093.stdout:9/98: write d1/d12/f1c [208313,128030] 0 2023-12-12T11:51:40.004 INFO:tasks.workunit.client.1.smithi093.stdout:9/99: fsync d1/fa 0 2023-12-12T11:51:40.010 INFO:tasks.workunit.client.1.smithi093.stdout:6/246: creat d0/da/d32/d39/d5b/f5d x:0 0 0 2023-12-12T11:51:40.010 INFO:tasks.workunit.client.1.smithi093.stdout:6/247: chown d0/c1d 0 1 2023-12-12T11:51:40.014 INFO:tasks.workunit.client.1.smithi093.stdout:1/145: creat d4/d1a/f29 x:0 0 0 2023-12-12T11:51:40.014 INFO:tasks.workunit.client.1.smithi093.stdout:9/100: dread d1/d12/f19 [0,4194304] 0 2023-12-12T11:51:40.015 INFO:tasks.workunit.client.1.smithi093.stdout:4/278: creat d0/d31/f5a x:0 0 0 2023-12-12T11:51:40.016 INFO:tasks.workunit.client.1.smithi093.stdout:2/219: dwrite d5/d14/d2d/f1e [0,4194304] 0 2023-12-12T11:51:40.019 INFO:tasks.workunit.client.1.smithi093.stdout:5/124: mknod d0/d7/d8/d22/c2b 0 2023-12-12T11:51:40.019 INFO:tasks.workunit.client.1.smithi093.stdout:8/121: unlink d3/d1a/d1f/l21 0 2023-12-12T11:51:40.019 INFO:tasks.workunit.client.1.smithi093.stdout:5/125: read d0/f5 [3017570,12094] 0 2023-12-12T11:51:40.031 INFO:tasks.workunit.client.1.smithi093.stdout:0/134: getdents d5/dd/d14/d26 0 2023-12-12T11:51:40.031 INFO:tasks.workunit.client.1.smithi093.stdout:0/135: chown d5/d21/d27 0 1 2023-12-12T11:51:40.031 INFO:tasks.workunit.client.1.smithi093.stdout:0/136: chown d5/dd/c22 0 1 2023-12-12T11:51:40.031 INFO:tasks.workunit.client.1.smithi093.stdout:0/137: write d5/f13 [8774445,10940] 0 2023-12-12T11:51:40.032 INFO:tasks.workunit.client.1.smithi093.stdout:4/279: rename d0/l19 to d0/d36/d49/d58/l5b 0 2023-12-12T11:51:40.034 INFO:tasks.workunit.client.1.smithi093.stdout:6/248: link d0/da/d14/c2a d0/da/d14/d38/c5e 0 2023-12-12T11:51:40.035 INFO:tasks.workunit.client.1.smithi093.stdout:1/146: mkdir d4/d1c/d2a 0 2023-12-12T11:51:40.038 INFO:tasks.workunit.client.1.smithi093.stdout:5/126: mknod d0/d7/d8/c2c 0 2023-12-12T11:51:40.043 INFO:tasks.workunit.client.1.smithi093.stdout:0/138: write d5/dd/d14/f18 [1259934,67415] 0 2023-12-12T11:51:40.044 INFO:tasks.workunit.client.1.smithi093.stdout:0/139: chown d5/dd/l1e 3 1 2023-12-12T11:51:40.044 INFO:tasks.workunit.client.1.smithi093.stdout:0/140: write d5/f24 [516235,14926] 0 2023-12-12T11:51:40.044 INFO:tasks.workunit.client.1.smithi093.stdout:8/122: dread d3/f17 [0,4194304] 0 2023-12-12T11:51:40.044 INFO:tasks.workunit.client.1.smithi093.stdout:8/123: write d3/d8/f18 [505979,113027] 0 2023-12-12T11:51:40.047 INFO:tasks.workunit.client.1.smithi093.stdout:0/141: symlink d5/d21/l2d 0 2023-12-12T11:51:40.047 INFO:tasks.workunit.client.1.smithi093.stdout:0/142: fdatasync d5/dd/f16 0 2023-12-12T11:51:40.049 INFO:tasks.workunit.client.1.smithi093.stdout:8/124: unlink d3/d1a/f1e 0 2023-12-12T11:51:40.049 INFO:tasks.workunit.client.1.smithi093.stdout:8/125: chown d3/f1c 108158 1 2023-12-12T11:51:40.049 INFO:tasks.workunit.client.1.smithi093.stdout:8/126: chown d3/d8/f23 172463 1 2023-12-12T11:51:40.051 INFO:tasks.workunit.client.1.smithi093.stdout:0/143: creat d5/d21/f2e x:0 0 0 2023-12-12T11:51:40.056 INFO:tasks.workunit.client.1.smithi093.stdout:8/127: rename d3/f16 to d3/f24 0 2023-12-12T11:51:40.056 INFO:tasks.workunit.client.1.smithi093.stdout:8/128: stat d3/f1c 0 2023-12-12T11:51:40.056 INFO:tasks.workunit.client.1.smithi093.stdout:8/129: chown f0 401514484 1 2023-12-12T11:51:40.056 INFO:tasks.workunit.client.1.smithi093.stdout:8/130: creat d3/d1a/f25 x:0 0 0 2023-12-12T11:51:40.056 INFO:tasks.workunit.client.1.smithi093.stdout:8/131: write d3/d8/f23 [464757,119458] 0 2023-12-12T11:51:40.056 INFO:tasks.workunit.client.1.smithi093.stdout:8/132: write f0 [1148389,98652] 0 2023-12-12T11:51:40.057 INFO:tasks.workunit.client.1.smithi093.stdout:8/133: rename d3 to d3/d1a/d26 22 2023-12-12T11:51:40.061 INFO:tasks.workunit.client.1.smithi093.stdout:9/101: dwrite d1/fa [0,4194304] 0 2023-12-12T11:51:40.069 INFO:tasks.workunit.client.1.smithi093.stdout:8/134: dread d3/d8/f18 [0,4194304] 0 2023-12-12T11:51:40.073 INFO:tasks.workunit.client.1.smithi093.stdout:2/220: dwrite d5/f3a [0,4194304] 0 2023-12-12T11:51:40.074 INFO:tasks.workunit.client.1.smithi093.stdout:8/135: creat d3/d1a/d1f/f27 x:0 0 0 2023-12-12T11:51:40.082 INFO:tasks.workunit.client.1.smithi093.stdout:4/280: dwrite d0/d31/f51 [0,4194304] 0 2023-12-12T11:51:40.082 INFO:tasks.workunit.client.1.smithi093.stdout:4/281: truncate d0/d36/d49/f4a 244912 0 2023-12-12T11:51:40.090 INFO:tasks.workunit.client.1.smithi093.stdout:5/127: dwrite d0/f15 [0,4194304] 0 2023-12-12T11:51:40.090 INFO:tasks.workunit.client.1.smithi093.stdout:2/221: symlink d5/d14/d2d/l48 0 2023-12-12T11:51:40.092 INFO:tasks.workunit.client.1.smithi093.stdout:4/282: dread d0/f47 [0,4194304] 0 2023-12-12T11:51:40.093 INFO:tasks.workunit.client.1.smithi093.stdout:8/136: rename d3/l4 to d3/d1a/d1f/l28 0 2023-12-12T11:51:40.093 INFO:tasks.workunit.client.1.smithi093.stdout:8/137: fdatasync d3/f1c 0 2023-12-12T11:51:40.093 INFO:tasks.workunit.client.1.smithi093.stdout:8/138: stat d3/f6 0 2023-12-12T11:51:40.093 INFO:tasks.workunit.client.1.smithi093.stdout:8/139: fdatasync d3/f1c 0 2023-12-12T11:51:40.099 INFO:tasks.workunit.client.1.smithi093.stdout:9/102: dwrite d1/d12/f1a [0,4194304] 0 2023-12-12T11:51:40.099 INFO:tasks.workunit.client.1.smithi093.stdout:5/128: creat d0/d7/d27/f2d x:0 0 0 2023-12-12T11:51:40.099 INFO:tasks.workunit.client.1.smithi093.stdout:5/129: creat d0/d7/d8/de/f2e x:0 0 0 2023-12-12T11:51:40.105 INFO:tasks.workunit.client.1.smithi093.stdout:4/283: unlink d0/d31/f3d 0 2023-12-12T11:51:40.105 INFO:tasks.workunit.client.1.smithi093.stdout:8/140: mkdir d3/d1a/d1f/d29 0 2023-12-12T11:51:40.105 INFO:tasks.workunit.client.1.smithi093.stdout:2/222: dread d5/d14/d2d/f1c [0,4194304] 0 2023-12-12T11:51:40.112 INFO:tasks.workunit.client.1.smithi093.stdout:2/223: creat d5/f49 x:0 0 0 2023-12-12T11:51:40.112 INFO:tasks.workunit.client.1.smithi093.stdout:2/224: chown d5/d14/d2d/d12/f2c 0 1 2023-12-12T11:51:40.112 INFO:tasks.workunit.client.1.smithi093.stdout:2/225: fsync d5/f8 0 2023-12-12T11:51:40.115 INFO:tasks.workunit.client.1.smithi093.stdout:4/284: dread d0/f14 [0,4194304] 0 2023-12-12T11:51:40.115 INFO:tasks.workunit.client.1.smithi093.stdout:4/285: write d0/ff [4038266,62223] 0 2023-12-12T11:51:40.119 INFO:tasks.workunit.client.1.smithi093.stdout:2/226: rmdir d5/d31 39 2023-12-12T11:51:40.122 INFO:tasks.workunit.client.1.smithi093.stdout:4/286: rmdir d0/d36/d40 39 2023-12-12T11:51:40.122 INFO:tasks.workunit.client.1.smithi093.stdout:4/287: dread - d0/d36/f39 zero size 2023-12-12T11:51:40.122 INFO:tasks.workunit.client.1.smithi093.stdout:4/288: readlink d0/l1a 0 2023-12-12T11:51:40.122 INFO:tasks.workunit.client.1.smithi093.stdout:4/289: fsync d0/f1 0 2023-12-12T11:51:40.124 INFO:tasks.workunit.client.1.smithi093.stdout:2/227: creat d5/d31/f4a x:0 0 0 2023-12-12T11:51:40.125 INFO:tasks.workunit.client.1.smithi093.stdout:2/228: truncate d5/d14/f40 537340 0 2023-12-12T11:51:40.125 INFO:tasks.workunit.client.1.smithi093.stdout:2/229: getdents d5/d14/d2d/d12/d44 0 2023-12-12T11:51:40.130 INFO:tasks.workunit.client.1.smithi093.stdout:4/290: truncate d0/d36/f37 2919579 0 2023-12-12T11:51:40.130 INFO:tasks.workunit.client.1.smithi093.stdout:4/291: read d0/d36/f4c [326042,117002] 0 2023-12-12T11:51:40.131 INFO:tasks.workunit.client.1.smithi093.stdout:2/230: symlink d5/d14/d2d/d12/d44/l4b 0 2023-12-12T11:51:40.132 INFO:tasks.workunit.client.1.smithi093.stdout:2/231: write d5/d14/f40 [86879,90346] 0 2023-12-12T11:51:40.133 INFO:tasks.workunit.client.1.smithi093.stdout:2/232: truncate d5/d14/d2d/f42 355510 0 2023-12-12T11:51:40.133 INFO:tasks.workunit.client.1.smithi093.stdout:2/233: readlink l2 0 2023-12-12T11:51:40.133 INFO:tasks.workunit.client.1.smithi093.stdout:2/234: chown d5/d31/f4a 76 1 2023-12-12T11:51:40.133 INFO:tasks.workunit.client.1.smithi093.stdout:4/292: mkdir d0/d31/d5c 0 2023-12-12T11:51:40.135 INFO:tasks.workunit.client.1.smithi093.stdout:9/103: dread d1/f16 [0,4194304] 0 2023-12-12T11:51:40.137 INFO:tasks.workunit.client.1.smithi093.stdout:0/144: dwrite d5/dd/d14/f18 [0,4194304] 0 2023-12-12T11:51:40.141 INFO:tasks.workunit.client.1.smithi093.stdout:3/153: sync 2023-12-12T11:51:40.142 INFO:tasks.workunit.client.1.smithi093.stdout:2/235: dread d5/d14/d2d/d12/d25/f33 [0,4194304] 0 2023-12-12T11:51:40.156 INFO:tasks.workunit.client.1.smithi093.stdout:0/145: dread d5/fa [0,4194304] 0 2023-12-12T11:51:40.159 INFO:tasks.workunit.client.1.smithi093.stdout:9/104: dread d1/d12/f19 [0,4194304] 0 2023-12-12T11:51:40.162 INFO:tasks.workunit.client.1.smithi093.stdout:2/236: dread d5/d14/d2d/d12/d25/f33 [0,4194304] 0 2023-12-12T11:51:40.163 INFO:tasks.workunit.client.1.smithi093.stdout:7/132: sync 2023-12-12T11:51:40.163 INFO:tasks.workunit.client.1.smithi093.stdout:7/133: creat da/d15/f2c x:0 0 0 2023-12-12T11:51:40.163 INFO:tasks.workunit.client.1.smithi093.stdout:7/134: truncate da/d15/d19/f1e 876961 0 2023-12-12T11:51:40.166 INFO:tasks.workunit.client.1.smithi093.stdout:0/146: mkdir d5/d21/d2f 0 2023-12-12T11:51:40.166 INFO:tasks.workunit.client.1.smithi093.stdout:0/147: write d5/dd/f16 [303805,49269] 0 2023-12-12T11:51:40.169 INFO:tasks.workunit.client.1.smithi093.stdout:9/105: creat d1/d12/d1f/f21 x:0 0 0 2023-12-12T11:51:40.173 INFO:tasks.workunit.client.1.smithi093.stdout:9/106: rename d1/c15 to d1/c22 0 2023-12-12T11:51:40.173 INFO:tasks.workunit.client.1.smithi093.stdout:9/107: stat d1/fa 0 2023-12-12T11:51:40.174 INFO:tasks.workunit.client.1.smithi093.stdout:9/108: mkdir d1/d23 0 2023-12-12T11:51:40.177 INFO:tasks.workunit.client.1.smithi093.stdout:5/130: dwrite d0/d7/d27/f2d [0,4194304] 0 2023-12-12T11:51:40.177 INFO:tasks.workunit.client.1.smithi093.stdout:4/293: dwrite d0/f44 [0,4194304] 0 2023-12-12T11:51:40.179 INFO:tasks.workunit.client.1.smithi093.stdout:4/294: read - d0/d36/f39 zero size 2023-12-12T11:51:40.179 INFO:tasks.workunit.client.1.smithi093.stdout:9/109: mkdir d1/d23/d24 0 2023-12-12T11:51:40.181 INFO:tasks.workunit.client.1.smithi093.stdout:8/141: dwrite d3/d8/f19 [0,4194304] 0 2023-12-12T11:51:40.182 INFO:tasks.workunit.client.1.smithi093.stdout:2/237: dread d5/d14/d27/f41 [0,4194304] 0 2023-12-12T11:51:40.184 INFO:tasks.workunit.client.1.smithi093.stdout:4/295: read d0/f33 [92359,68367] 0 2023-12-12T11:51:40.188 INFO:tasks.workunit.client.1.smithi093.stdout:5/131: truncate d0/f15 7092291 0 2023-12-12T11:51:40.192 INFO:tasks.workunit.client.1.smithi093.stdout:2/238: unlink d5/f21 0 2023-12-12T11:51:40.195 INFO:tasks.workunit.client.1.smithi093.stdout:8/142: getdents d3 0 2023-12-12T11:51:40.195 INFO:tasks.workunit.client.1.smithi093.stdout:8/143: creat d3/d1a/d1f/f2a x:0 0 0 2023-12-12T11:51:40.206 INFO:tasks.workunit.client.1.smithi093.stdout:1/147: sync 2023-12-12T11:51:40.207 INFO:tasks.workunit.client.1.smithi093.stdout:0/148: dread d5/f13 [0,4194304] 0 2023-12-12T11:51:40.216 INFO:tasks.workunit.client.1.smithi093.stdout:8/144: truncate d3/f17 1670383 0 2023-12-12T11:51:40.216 INFO:tasks.workunit.client.1.smithi093.stdout:8/145: fsync d3/d8/f18 0 2023-12-12T11:51:40.218 INFO:tasks.workunit.client.1.smithi093.stdout:4/296: write d0/d31/f28 [4123503,3442] 0 2023-12-12T11:51:40.218 INFO:tasks.workunit.client.1.smithi093.stdout:4/297: fdatasync d0/f32 0 2023-12-12T11:51:40.218 INFO:tasks.workunit.client.1.smithi093.stdout:4/298: stat d0/d36/c55 0 2023-12-12T11:51:40.219 INFO:tasks.workunit.client.1.smithi093.stdout:4/299: write d0/d36/f59 [178004,80941] 0 2023-12-12T11:51:40.219 INFO:tasks.workunit.client.1.smithi093.stdout:4/300: getdents d0/d31/d5c 0 2023-12-12T11:51:40.219 INFO:tasks.workunit.client.1.smithi093.stdout:4/301: write d0/d31/f2c [1135695,109575] 0 2023-12-12T11:51:40.219 INFO:tasks.workunit.client.1.smithi093.stdout:0/149: creat d5/f30 x:0 0 0 2023-12-12T11:51:40.223 INFO:tasks.workunit.client.1.smithi093.stdout:0/150: creat d5/f31 x:0 0 0 2023-12-12T11:51:40.225 INFO:tasks.workunit.client.1.smithi093.stdout:5/132: dread d0/d7/d27/f2d [0,4194304] 0 2023-12-12T11:51:40.226 INFO:tasks.workunit.client.1.smithi093.stdout:3/154: dwrite fc [0,4194304] 0 2023-12-12T11:51:40.229 INFO:tasks.workunit.client.1.smithi093.stdout:8/146: dread d3/d8/f18 [0,4194304] 0 2023-12-12T11:51:40.230 INFO:tasks.workunit.client.1.smithi093.stdout:4/302: write d0/f44 [4385622,77332] 0 2023-12-12T11:51:40.232 INFO:tasks.workunit.client.1.smithi093.stdout:1/148: dread d4/dc/f10 [0,4194304] 0 2023-12-12T11:51:40.237 INFO:tasks.workunit.client.1.smithi093.stdout:9/110: dwrite d1/f1e [0,4194304] 0 2023-12-12T11:51:40.237 INFO:tasks.workunit.client.1.smithi093.stdout:3/155: symlink df/d22/l35 0 2023-12-12T11:51:40.237 INFO:tasks.workunit.client.1.smithi093.stdout:3/156: fdatasync df/f1c 0 2023-12-12T11:51:40.240 INFO:tasks.workunit.client.1.smithi093.stdout:4/303: link d0/c1b d0/d36/d49/c5d 0 2023-12-12T11:51:40.240 INFO:tasks.workunit.client.1.smithi093.stdout:4/304: write d0/f18 [825387,16166] 0 2023-12-12T11:51:40.240 INFO:tasks.workunit.client.1.smithi093.stdout:4/305: dread - d0/d36/f50 zero size 2023-12-12T11:51:40.242 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:39 smithi063 ceph-mon[107117]: pgmap v4: 65 pgs: 65 active+clean; 504 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail 2023-12-12T11:51:40.246 INFO:tasks.workunit.client.1.smithi093.stdout:9/111: truncate d1/fa 1735814 0 2023-12-12T11:51:40.246 INFO:tasks.workunit.client.1.smithi093.stdout:0/151: read d5/f13 [7584585,28488] 0 2023-12-12T11:51:40.246 INFO:tasks.workunit.client.1.smithi093.stdout:0/152: dread - d5/f31 zero size 2023-12-12T11:51:40.247 INFO:tasks.workunit.client.1.smithi093.stdout:6/249: sync 2023-12-12T11:51:40.248 INFO:tasks.workunit.client.1.smithi093.stdout:1/149: dread d4/f8 [0,4194304] 0 2023-12-12T11:51:40.248 INFO:tasks.workunit.client.1.smithi093.stdout:1/150: stat d4/ff 0 2023-12-12T11:51:40.251 INFO:tasks.workunit.client.1.smithi093.stdout:3/157: mkdir df/d36 0 2023-12-12T11:51:40.251 INFO:tasks.workunit.client.1.smithi093.stdout:3/158: read df/f21 [2071492,48279] 0 2023-12-12T11:51:40.251 INFO:tasks.workunit.client.1.smithi093.stdout:4/306: rename d0/d31/c3e to d0/d36/d40/c5e 0 2023-12-12T11:51:40.252 INFO:tasks.workunit.client.1.smithi093.stdout:2/239: dwrite d5/d14/d27/f41 [4194304,4194304] 0 2023-12-12T11:51:40.257 INFO:tasks.workunit.client.1.smithi093.stdout:1/151: creat d4/d1c/d2a/f2b x:0 0 0 2023-12-12T11:51:40.259 INFO:tasks.workunit.client.1.smithi093.stdout:3/159: truncate df/d22/f23 101741 0 2023-12-12T11:51:40.263 INFO:tasks.workunit.client.1.smithi093.stdout:6/250: dread d0/da/d14/f1b [0,4194304] 0 2023-12-12T11:51:40.267 INFO:tasks.workunit.client.1.smithi093.stdout:6/251: creat d0/da/d14/d21/f5f x:0 0 0 2023-12-12T11:51:40.267 INFO:tasks.workunit.client.1.smithi093.stdout:6/252: write d0/d19/f58 [632972,100005] 0 2023-12-12T11:51:40.267 INFO:tasks.workunit.client.1.smithi093.stdout:9/112: rename d1/f5 to d1/d12/d1f/f25 0 2023-12-12T11:51:40.267 INFO:tasks.workunit.client.1.smithi093.stdout:0/153: getdents d5/d21 0 2023-12-12T11:51:40.267 INFO:tasks.workunit.client.1.smithi093.stdout:0/154: chown d5/d21 2157113 1 2023-12-12T11:51:40.268 INFO:tasks.workunit.client.1.smithi093.stdout:8/147: getdents d3/d1a/d1f 0 2023-12-12T11:51:40.271 INFO:tasks.workunit.client.1.smithi093.stdout:5/133: dwrite d0/d7/d8/f13 [4194304,4194304] 0 2023-12-12T11:51:40.272 INFO:tasks.workunit.client.1.smithi093.stdout:2/240: getdents d5/d14 0 2023-12-12T11:51:40.273 INFO:tasks.workunit.client.1.smithi093.stdout:9/113: truncate d1/d12/d1f/f20 2929976 0 2023-12-12T11:51:40.276 INFO:tasks.workunit.client.1.smithi093.stdout:0/155: symlink d5/d21/l32 0 2023-12-12T11:51:40.277 INFO:tasks.workunit.client.1.smithi093.stdout:0/156: fdatasync d5/dd/f1a 0 2023-12-12T11:51:40.279 INFO:tasks.workunit.client.1.smithi093.stdout:8/148: unlink d3/d1a/f20 0 2023-12-12T11:51:40.285 INFO:tasks.workunit.client.1.smithi093.stdout:6/253: dread d0/f11 [0,4194304] 0 2023-12-12T11:51:40.285 INFO:tasks.workunit.client.1.smithi093.stdout:6/254: write d0/da/d14/d21/f5f [981868,32391] 0 2023-12-12T11:51:40.285 INFO:tasks.workunit.client.1.smithi093.stdout:6/255: write d0/d19/d42/f53 [2160215,16980] 0 2023-12-12T11:51:40.285 INFO:tasks.workunit.client.1.smithi093.stdout:6/256: chown d0/da/f2e 1 1 2023-12-12T11:51:40.294 INFO:tasks.workunit.client.1.smithi093.stdout:1/152: write d4/dc/f17 [825540,124938] 0 2023-12-12T11:51:40.298 INFO:tasks.workunit.client.1.smithi093.stdout:5/134: unlink d0/d7/d8/d22/d1e/l21 0 2023-12-12T11:51:40.305 INFO:tasks.workunit.client.1.smithi093.stdout:2/241: mkdir d5/d14/d2d/d4c 0 2023-12-12T11:51:40.305 INFO:tasks.workunit.client.1.smithi093.stdout:4/307: dwrite d0/d36/f59 [0,4194304] 0 2023-12-12T11:51:40.305 INFO:tasks.workunit.client.1.smithi093.stdout:9/114: mknod d1/c26 0 2023-12-12T11:51:40.310 INFO:tasks.workunit.client.1.smithi093.stdout:0/157: truncate d5/f24 2108910 0 2023-12-12T11:51:40.310 INFO:tasks.workunit.client.1.smithi093.stdout:8/149: dread d3/d8/fc [0,4194304] 0 2023-12-12T11:51:40.311 INFO:tasks.workunit.client.1.smithi093.stdout:8/150: fdatasync d3/d1a/d1f/f2a 0 2023-12-12T11:51:40.311 INFO:tasks.workunit.client.1.smithi093.stdout:6/257: creat d0/d19/d42/f60 x:0 0 0 2023-12-12T11:51:40.311 INFO:tasks.workunit.client.1.smithi093.stdout:8/151: creat d3/d1a/f2b x:0 0 0 2023-12-12T11:51:40.311 INFO:tasks.workunit.client.1.smithi093.stdout:8/152: readlink d3/d1a/l1b 0 2023-12-12T11:51:40.312 INFO:tasks.workunit.client.1.smithi093.stdout:1/153: unlink c3 0 2023-12-12T11:51:40.312 INFO:tasks.workunit.client.1.smithi093.stdout:1/154: creat d4/d1c/d2a/f2c x:0 0 0 2023-12-12T11:51:40.312 INFO:tasks.workunit.client.1.smithi093.stdout:1/155: getdents d4/d1a/d1b/d26 0 2023-12-12T11:51:40.314 INFO:tasks.workunit.client.1.smithi093.stdout:5/135: unlink d0/d7/c24 0 2023-12-12T11:51:40.316 INFO:tasks.workunit.client.1.smithi093.stdout:3/160: dwrite df/f10 [0,4194304] 0 2023-12-12T11:51:40.320 INFO:tasks.workunit.client.1.smithi093.stdout:2/242: creat d5/d14/d2d/d12/d44/f4d x:0 0 0 2023-12-12T11:51:40.321 INFO:tasks.workunit.client.1.smithi093.stdout:9/115: read d1/fa [1410990,10289] 0 2023-12-12T11:51:40.322 INFO:tasks.workunit.client.1.smithi093.stdout:9/116: chown d1/d12/d1f/f25 27 1 2023-12-12T11:51:40.333 INFO:tasks.workunit.client.1.smithi093.stdout:8/153: dread f0 [0,4194304] 0 2023-12-12T11:51:40.333 INFO:tasks.workunit.client.1.smithi093.stdout:8/154: fsync d3/d1a/d1f/f27 0 2023-12-12T11:51:40.333 INFO:tasks.workunit.client.1.smithi093.stdout:8/155: fsync d3/f6 0 2023-12-12T11:51:40.333 INFO:tasks.workunit.client.1.smithi093.stdout:8/156: readlink d3/d1a/l1d 0 2023-12-12T11:51:40.339 INFO:tasks.workunit.client.1.smithi093.stdout:5/136: mknod d0/d7/d8/de/c2f 0 2023-12-12T11:51:40.342 INFO:tasks.workunit.client.1.smithi093.stdout:3/161: truncate df/f19 1680604 0 2023-12-12T11:51:40.348 INFO:tasks.workunit.client.1.smithi093.stdout:2/243: unlink d5/c20 0 2023-12-12T11:51:40.348 INFO:tasks.workunit.client.1.smithi093.stdout:1/156: mkdir d4/d1c/d2a/d2d 0 2023-12-12T11:51:40.348 INFO:tasks.workunit.client.1.smithi093.stdout:4/308: rmdir d0/d36 39 2023-12-12T11:51:40.348 INFO:tasks.workunit.client.1.smithi093.stdout:4/309: dread - d0/d36/f39 zero size 2023-12-12T11:51:40.356 INFO:tasks.workunit.client.1.smithi093.stdout:6/258: getdents d0/da 0 2023-12-12T11:51:40.356 INFO:tasks.workunit.client.1.smithi093.stdout:6/259: dread - d0/da/d14/f55 zero size 2023-12-12T11:51:40.356 INFO:tasks.workunit.client.1.smithi093.stdout:6/260: dread - d0/da/d32/d39/d5b/f5d zero size 2023-12-12T11:51:40.358 INFO:tasks.workunit.client.1.smithi093.stdout:8/157: write d3/f1c [1930858,45259] 0 2023-12-12T11:51:40.358 INFO:tasks.workunit.client.1.smithi093.stdout:3/162: symlink df/d25/d2c/l37 0 2023-12-12T11:51:40.358 INFO:tasks.workunit.client.1.smithi093.stdout:7/135: sync 2023-12-12T11:51:40.358 INFO:tasks.workunit.client.1.smithi093.stdout:5/137: creat d0/d7/d8/d22/d29/f30 x:0 0 0 2023-12-12T11:51:40.358 INFO:tasks.workunit.client.1.smithi093.stdout:7/136: dread - da/d15/d19/f2b zero size 2023-12-12T11:51:40.359 INFO:tasks.workunit.client.1.smithi093.stdout:4/310: mknod d0/d31/d5c/c5f 0 2023-12-12T11:51:40.361 INFO:tasks.workunit.client.1.smithi093.stdout:3/163: fdatasync df/f1c 0 2023-12-12T11:51:40.362 INFO:tasks.workunit.client.1.smithi093.stdout:6/261: symlink d0/da/d14/d21/l61 0 2023-12-12T11:51:40.363 INFO:tasks.workunit.client.1.smithi093.stdout:6/262: read - d0/f44 zero size 2023-12-12T11:51:40.367 INFO:tasks.workunit.client.1.smithi093.stdout:7/137: mkdir da/d15/d2d 0 2023-12-12T11:51:40.370 INFO:tasks.workunit.client.1.smithi093.stdout:4/311: creat d0/d36/f60 x:0 0 0 2023-12-12T11:51:40.375 INFO:tasks.workunit.client.1.smithi093.stdout:6/263: mknod d0/da/c62 0 2023-12-12T11:51:40.382 INFO:tasks.workunit.client.1.smithi093.stdout:7/138: mkdir da/d2e 0 2023-12-12T11:51:40.383 INFO:tasks.workunit.client.1.smithi093.stdout:3/164: read df/d22/f27 [2464962,44599] 0 2023-12-12T11:51:40.383 INFO:tasks.workunit.client.1.smithi093.stdout:3/165: write df/d22/f31 [137829,107206] 0 2023-12-12T11:51:40.383 INFO:tasks.workunit.client.1.smithi093.stdout:0/158: dwrite d5/d21/f2e [0,4194304] 0 2023-12-12T11:51:40.384 INFO:tasks.workunit.client.1.smithi093.stdout:0/159: chown d5/dd/f1d 1280340 1 2023-12-12T11:51:40.384 INFO:tasks.workunit.client.1.smithi093.stdout:0/160: dread - d5/f30 zero size 2023-12-12T11:51:40.384 INFO:tasks.workunit.client.1.smithi093.stdout:9/117: dwrite d1/d12/f19 [0,4194304] 0 2023-12-12T11:51:40.385 INFO:tasks.workunit.client.1.smithi093.stdout:6/264: symlink d0/da/d32/d40/l63 0 2023-12-12T11:51:40.385 INFO:tasks.workunit.client.1.smithi093.stdout:2/244: dwrite d5/d14/d2d/d12/d25/f29 [0,4194304] 0 2023-12-12T11:51:40.386 INFO:tasks.workunit.client.1.smithi093.stdout:2/245: truncate d5/d31/f3f 889013 0 2023-12-12T11:51:40.386 INFO:tasks.workunit.client.1.smithi093.stdout:2/246: stat d5/f19 0 2023-12-12T11:51:40.390 INFO:tasks.workunit.client.1.smithi093.stdout:7/139: stat da/c13 0 2023-12-12T11:51:40.390 INFO:tasks.workunit.client.1.smithi093.stdout:7/140: write da/f11 [1296502,106852] 0 2023-12-12T11:51:40.391 INFO:tasks.workunit.client.1.smithi093.stdout:3/166: mknod df/d22/c38 0 2023-12-12T11:51:40.391 INFO:tasks.workunit.client.1.smithi093.stdout:3/167: readlink df/d22/l35 0 2023-12-12T11:51:40.392 INFO:tasks.workunit.client.1.smithi093.stdout:0/161: mkdir d5/dd/d33 0 2023-12-12T11:51:40.403 INFO:tasks.workunit.client.1.smithi093.stdout:3/168: mkdir df/d30/d39 0 2023-12-12T11:51:40.407 INFO:tasks.workunit.client.1.smithi093.stdout:4/312: dread d0/d31/f28 [0,4194304] 0 2023-12-12T11:51:40.407 INFO:tasks.workunit.client.1.smithi093.stdout:7/141: write da/fb [1706009,48347] 0 2023-12-12T11:51:40.408 INFO:tasks.workunit.client.1.smithi093.stdout:0/162: rmdir d5/d2b 0 2023-12-12T11:51:40.410 INFO:tasks.workunit.client.1.smithi093.stdout:9/118: write d1/fe [4024271,69692] 0 2023-12-12T11:51:40.412 INFO:tasks.workunit.client.1.smithi093.stdout:9/119: creat d1/d12/d1f/f27 x:0 0 0 2023-12-12T11:51:40.417 INFO:tasks.workunit.client.1.smithi093.stdout:6/265: rmdir d0/da/d14/d38 39 2023-12-12T11:51:40.417 INFO:tasks.workunit.client.1.smithi093.stdout:6/266: write d0/d19/d42/f45 [1724270,65207] 0 2023-12-12T11:51:40.420 INFO:tasks.workunit.client.1.smithi093.stdout:3/169: creat df/d30/d33/f3a x:0 0 0 2023-12-12T11:51:40.429 INFO:tasks.workunit.client.1.smithi093.stdout:9/120: rename d1/d12/d1f/f21 to d1/d12/d1f/f28 0 2023-12-12T11:51:40.429 INFO:tasks.workunit.client.1.smithi093.stdout:4/313: read d0/ff [4247496,126103] 0 2023-12-12T11:51:40.431 INFO:tasks.workunit.client.1.smithi093.stdout:4/314: mkdir d0/d36/d61 0 2023-12-12T11:51:40.434 INFO:tasks.workunit.client.1.smithi093.stdout:6/267: truncate d0/f11 1165628 0 2023-12-12T11:51:40.434 INFO:tasks.workunit.client.1.smithi093.stdout:6/268: creat d0/da/d32/d39/d5b/f64 x:0 0 0 2023-12-12T11:51:40.434 INFO:tasks.workunit.client.1.smithi093.stdout:0/163: write d5/dd/f1d [194436,40252] 0 2023-12-12T11:51:40.434 INFO:tasks.workunit.client.1.smithi093.stdout:6/269: creat d0/d19/d42/f65 x:0 0 0 2023-12-12T11:51:40.435 INFO:tasks.workunit.client.1.smithi093.stdout:6/270: creat d0/da/d14/f66 x:0 0 0 2023-12-12T11:51:40.435 INFO:tasks.workunit.client.1.smithi093.stdout:6/271: creat d0/d19/f67 x:0 0 0 2023-12-12T11:51:40.435 INFO:tasks.workunit.client.1.smithi093.stdout:6/272: chown d0/da/d14/d21/c37 582 1 2023-12-12T11:51:40.435 INFO:tasks.workunit.client.1.smithi093.stdout:6/273: creat d0/d19/f68 x:0 0 0 2023-12-12T11:51:40.436 INFO:tasks.workunit.client.1.smithi093.stdout:4/315: creat d0/d36/d61/f62 x:0 0 0 2023-12-12T11:51:40.441 INFO:tasks.workunit.client.1.smithi093.stdout:8/158: dwrite d3/f24 [0,4194304] 0 2023-12-12T11:51:40.442 INFO:tasks.workunit.client.1.smithi093.stdout:0/164: link d5/f24 d5/dd/d14/d26/f34 0 2023-12-12T11:51:40.453 INFO:tasks.workunit.client.1.smithi093.stdout:9/121: dread d1/ff [0,4194304] 0 2023-12-12T11:51:40.453 INFO:tasks.workunit.client.1.smithi093.stdout:9/122: readlink d1/d12/l14 0 2023-12-12T11:51:40.453 INFO:tasks.workunit.client.1.smithi093.stdout:9/123: chown d1/d12/c1d 2174 1 2023-12-12T11:51:40.455 INFO:tasks.workunit.client.1.smithi093.stdout:7/142: dwrite da/d15/f2c [0,4194304] 0 2023-12-12T11:51:40.460 INFO:tasks.workunit.client.1.smithi093.stdout:6/274: mkdir d0/da/d14/d38/d69 0 2023-12-12T11:51:40.460 INFO:tasks.workunit.client.1.smithi093.stdout:6/275: creat d0/da/d14/d3a/f6a x:0 0 0 2023-12-12T11:51:40.463 INFO:tasks.workunit.client.1.smithi093.stdout:4/316: creat d0/d36/d40/f63 x:0 0 0 2023-12-12T11:51:40.463 INFO:tasks.workunit.client.1.smithi093.stdout:4/317: fsync d0/f1c 0 2023-12-12T11:51:40.463 INFO:tasks.workunit.client.1.smithi093.stdout:4/318: write d0/d36/d40/f63 [179993,3364] 0 2023-12-12T11:51:40.463 INFO:tasks.workunit.client.1.smithi093.stdout:4/319: fsync d0/f44 0 2023-12-12T11:51:40.463 INFO:tasks.workunit.client.1.smithi093.stdout:4/320: truncate d0/f20 4926510 0 2023-12-12T11:51:40.469 INFO:tasks.workunit.client.1.smithi093.stdout:9/124: mkdir d1/d23/d24/d29 0 2023-12-12T11:51:40.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:39 smithi093 ceph-mon[115914]: pgmap v4: 65 pgs: 65 active+clean; 504 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail 2023-12-12T11:51:40.479 INFO:tasks.workunit.client.1.smithi093.stdout:7/143: truncate f0 7904623 0 2023-12-12T11:51:40.487 INFO:tasks.workunit.client.1.smithi093.stdout:8/159: getdents d3/d8 0 2023-12-12T11:51:40.487 INFO:tasks.workunit.client.1.smithi093.stdout:2/247: dwrite d5/d14/d2d/f1f [0,4194304] 0 2023-12-12T11:51:40.492 INFO:tasks.workunit.client.1.smithi093.stdout:9/125: creat d1/d23/f2a x:0 0 0 2023-12-12T11:51:40.494 INFO:tasks.workunit.client.1.smithi093.stdout:3/170: dwrite df/d25/f32 [0,4194304] 0 2023-12-12T11:51:40.494 INFO:tasks.workunit.client.1.smithi093.stdout:7/144: mkdir da/d15/d2d/d2f 0 2023-12-12T11:51:40.494 INFO:tasks.workunit.client.1.smithi093.stdout:7/145: creat da/de/f30 x:0 0 0 2023-12-12T11:51:40.506 INFO:tasks.workunit.client.1.smithi093.stdout:9/126: dread d1/f1e [0,4194304] 0 2023-12-12T11:51:40.522 INFO:tasks.workunit.client.1.smithi093.stdout:8/160: symlink d3/d8/l2c 0 2023-12-12T11:51:40.522 INFO:tasks.workunit.client.1.smithi093.stdout:8/161: write d3/f6 [2048817,61283] 0 2023-12-12T11:51:40.526 INFO:tasks.workunit.client.1.smithi093.stdout:2/248: mkdir d5/d14/d47/d4e 0 2023-12-12T11:51:40.527 INFO:tasks.workunit.client.1.smithi093.stdout:4/321: rmdir d0/d36/d40 39 2023-12-12T11:51:40.533 INFO:tasks.workunit.client.1.smithi093.stdout:9/127: write d1/d12/f1a [1902403,114035] 0 2023-12-12T11:51:40.536 INFO:tasks.workunit.client.1.smithi093.stdout:8/162: write d3/d8/f12 [1422107,123766] 0 2023-12-12T11:51:40.537 INFO:tasks.workunit.client.1.smithi093.stdout:7/146: link da/d15/f16 da/d15/d19/f31 0 2023-12-12T11:51:40.537 INFO:tasks.workunit.client.1.smithi093.stdout:7/147: chown f0 1180792 1 2023-12-12T11:51:40.543 INFO:tasks.workunit.client.1.smithi093.stdout:3/171: getdents df/d30/d33 0 2023-12-12T11:51:40.544 INFO:tasks.workunit.client.1.smithi093.stdout:3/172: fdatasync df/f2f 0 2023-12-12T11:51:40.544 INFO:tasks.workunit.client.1.smithi093.stdout:3/173: creat df/f3b x:0 0 0 2023-12-12T11:51:40.544 INFO:tasks.workunit.client.1.smithi093.stdout:3/174: readlink df/l18 0 2023-12-12T11:51:40.546 INFO:tasks.workunit.client.1.smithi093.stdout:8/163: write d3/f6 [110360,83982] 0 2023-12-12T11:51:40.558 INFO:tasks.workunit.client.1.smithi093.stdout:6/276: dwrite d0/f11 [0,4194304] 0 2023-12-12T11:51:40.558 INFO:tasks.workunit.client.1.smithi093.stdout:6/277: fdatasync d0/da/d14/d38/d43/f5a 0 2023-12-12T11:51:40.568 INFO:tasks.workunit.client.1.smithi093.stdout:8/164: symlink d3/d8/l2d 0 2023-12-12T11:51:40.569 INFO:tasks.workunit.client.1.smithi093.stdout:8/165: fdatasync d3/fe 0 2023-12-12T11:51:40.569 INFO:tasks.workunit.client.1.smithi093.stdout:8/166: write d3/f1c [3360646,85176] 0 2023-12-12T11:51:40.569 INFO:tasks.workunit.client.1.smithi093.stdout:4/322: dwrite d0/f54 [0,4194304] 0 2023-12-12T11:51:40.572 INFO:tasks.workunit.client.1.smithi093.stdout:6/278: truncate d0/da/d14/d21/f5f 759831 0 2023-12-12T11:51:40.572 INFO:tasks.workunit.client.1.smithi093.stdout:6/279: chown d0/da/d32/d40/d4d 8447181 1 2023-12-12T11:51:40.572 INFO:tasks.workunit.client.1.smithi093.stdout:6/280: dread - d0/da/d14/d38/f4f zero size 2023-12-12T11:51:40.575 INFO:tasks.workunit.client.1.smithi093.stdout:5/138: sync 2023-12-12T11:51:40.577 INFO:tasks.workunit.client.1.smithi093.stdout:2/249: write d5/d14/d2d/f1f [5055125,3468] 0 2023-12-12T11:51:40.577 INFO:tasks.workunit.client.1.smithi093.stdout:2/250: dread - d5/d14/d2d/d12/d44/f4d zero size 2023-12-12T11:51:40.577 INFO:tasks.workunit.client.1.smithi093.stdout:8/167: symlink d3/d1a/d1f/d29/l2e 0 2023-12-12T11:51:40.582 INFO:tasks.workunit.client.1.smithi093.stdout:1/157: sync 2023-12-12T11:51:40.582 INFO:tasks.workunit.client.1.smithi093.stdout:1/158: fsync d4/d1c/d2a/f2c 0 2023-12-12T11:51:40.582 INFO:tasks.workunit.client.1.smithi093.stdout:1/159: chown d4/l9 2465912 1 2023-12-12T11:51:40.584 INFO:tasks.workunit.client.1.smithi093.stdout:5/139: creat d0/d7/d8/d22/d1e/f31 x:0 0 0 2023-12-12T11:51:40.585 INFO:tasks.workunit.client.1.smithi093.stdout:8/168: dread d3/d8/f18 [0,4194304] 0 2023-12-12T11:51:40.585 INFO:tasks.workunit.client.1.smithi093.stdout:8/169: write d3/d8/fc [162157,57771] 0 2023-12-12T11:51:40.585 INFO:tasks.workunit.client.1.smithi093.stdout:8/170: chown d3/f1c 15 1 2023-12-12T11:51:40.585 INFO:tasks.workunit.client.1.smithi093.stdout:8/171: dread - d3/d1a/d1f/f2a zero size 2023-12-12T11:51:40.591 INFO:tasks.workunit.client.1.smithi093.stdout:4/323: rmdir d0/d31 39 2023-12-12T11:51:40.596 INFO:tasks.workunit.client.1.smithi093.stdout:1/160: truncate d4/dc/f17 757615 0 2023-12-12T11:51:40.598 INFO:tasks.workunit.client.1.smithi093.stdout:5/140: dread d0/d7/d27/f2d [0,4194304] 0 2023-12-12T11:51:40.598 INFO:tasks.workunit.client.1.smithi093.stdout:8/172: creat d3/d1a/d1f/f2f x:0 0 0 2023-12-12T11:51:40.598 INFO:tasks.workunit.client.1.smithi093.stdout:8/173: write f0 [213825,98355] 0 2023-12-12T11:51:40.600 INFO:tasks.workunit.client.1.smithi093.stdout:4/324: symlink d0/d36/d49/d58/l64 0 2023-12-12T11:51:40.606 INFO:tasks.workunit.client.1.smithi093.stdout:5/141: unlink d0/d7/f20 0 2023-12-12T11:51:40.616 INFO:tasks.workunit.client.1.smithi093.stdout:8/174: mkdir d3/d1a/d1f/d29/d30 0 2023-12-12T11:51:40.620 INFO:tasks.workunit.client.1.smithi093.stdout:7/148: rmdir da 39 2023-12-12T11:51:40.620 INFO:tasks.workunit.client.1.smithi093.stdout:3/175: getdents df 0 2023-12-12T11:51:40.624 INFO:tasks.workunit.client.1.smithi093.stdout:7/149: symlink da/d2e/l32 0 2023-12-12T11:51:40.626 INFO:tasks.workunit.client.1.smithi093.stdout:3/176: creat df/d25/d2c/f3c x:0 0 0 2023-12-12T11:51:40.626 INFO:tasks.workunit.client.1.smithi093.stdout:3/177: chown df/f2e 3883 1 2023-12-12T11:51:40.630 INFO:tasks.workunit.client.1.smithi093.stdout:7/150: link da/de/l2a da/d15/d19/l33 0 2023-12-12T11:51:40.633 INFO:tasks.workunit.client.1.smithi093.stdout:7/151: link da/d15/f26 da/d15/d2d/f34 0 2023-12-12T11:51:40.635 INFO:tasks.workunit.client.1.smithi093.stdout:2/251: dwrite d5/d14/d27/f36 [0,4194304] 0 2023-12-12T11:51:40.637 INFO:tasks.workunit.client.1.smithi093.stdout:1/161: dwrite d4/dc/f28 [0,4194304] 0 2023-12-12T11:51:40.637 INFO:tasks.workunit.client.1.smithi093.stdout:1/162: creat d4/f2e x:0 0 0 2023-12-12T11:51:40.639 INFO:tasks.workunit.client.1.smithi093.stdout:4/325: dread d0/f1d [0,4194304] 0 2023-12-12T11:51:40.639 INFO:tasks.workunit.client.1.smithi093.stdout:4/326: fdatasync d0/d31/f28 0 2023-12-12T11:51:40.646 INFO:tasks.workunit.client.1.smithi093.stdout:5/142: dwrite d0/d7/d8/d22/d29/f30 [0,4194304] 0 2023-12-12T11:51:40.646 INFO:tasks.workunit.client.1.smithi093.stdout:3/178: dread df/f19 [0,4194304] 0 2023-12-12T11:51:40.648 INFO:tasks.workunit.client.1.smithi093.stdout:6/281: truncate d0/d19/d42/f53 1343071 0 2023-12-12T11:51:40.648 INFO:tasks.workunit.client.1.smithi093.stdout:2/252: rmdir d5/d14/d2d/d12 39 2023-12-12T11:51:40.648 INFO:tasks.workunit.client.1.smithi093.stdout:0/165: sync 2023-12-12T11:51:40.648 INFO:tasks.workunit.client.1.smithi093.stdout:2/253: stat d5/d14/d2d/d12/f22 0 2023-12-12T11:51:40.648 INFO:tasks.workunit.client.1.smithi093.stdout:0/166: readlink d5/dd/d14/d26/l2c 0 2023-12-12T11:51:40.649 INFO:tasks.workunit.client.1.smithi093.stdout:6/282: write d0/da/d14/f66 [31152,75890] 0 2023-12-12T11:51:40.655 INFO:tasks.workunit.client.1.smithi093.stdout:1/163: mkdir d4/d1c/d2a/d2f 0 2023-12-12T11:51:40.657 INFO:tasks.workunit.client.1.smithi093.stdout:4/327: mknod d0/d36/d49/c65 0 2023-12-12T11:51:40.666 INFO:tasks.workunit.client.1.smithi093.stdout:5/143: creat d0/d7/d8/d22/f32 x:0 0 0 2023-12-12T11:51:40.667 INFO:tasks.workunit.client.1.smithi093.stdout:3/179: rename df/d30/d39 to df/d36/d3d 0 2023-12-12T11:51:40.670 INFO:tasks.workunit.client.1.smithi093.stdout:2/254: unlink d5/d14/l2e 0 2023-12-12T11:51:40.675 INFO:tasks.workunit.client.1.smithi093.stdout:6/283: mkdir d0/d52/d6b 0 2023-12-12T11:51:40.680 INFO:tasks.workunit.client.1.smithi093.stdout:5/144: rename d0/c4 to d0/c33 0 2023-12-12T11:51:40.684 INFO:tasks.workunit.client.1.smithi093.stdout:1/164: dwrite d4/f8 [0,4194304] 0 2023-12-12T11:51:40.684 INFO:tasks.workunit.client.1.smithi093.stdout:4/328: rename d0/d36/d49/d58 to d0/d31/d5c/d66 0 2023-12-12T11:51:40.686 INFO:tasks.workunit.client.1.smithi093.stdout:3/180: mkdir df/d25/d3e 0 2023-12-12T11:51:40.689 INFO:tasks.workunit.client.1.smithi093.stdout:0/167: unlink d5/cb 0 2023-12-12T11:51:40.698 INFO:tasks.workunit.client.1.smithi093.stdout:1/165: mknod d4/c30 0 2023-12-12T11:51:40.698 INFO:tasks.workunit.client.1.smithi093.stdout:0/168: write d5/f7 [829151,5862] 0 2023-12-12T11:51:40.698 INFO:tasks.workunit.client.1.smithi093.stdout:0/169: fdatasync d5/d21/f2e 0 2023-12-12T11:51:40.698 INFO:tasks.workunit.client.1.smithi093.stdout:6/284: rename d0/da/d14/d38/c5e to d0/c6c 0 2023-12-12T11:51:40.698 INFO:tasks.workunit.client.1.smithi093.stdout:6/285: write d0/da/d32/d39/d5b/f64 [95977,43252] 0 2023-12-12T11:51:40.698 INFO:tasks.workunit.client.1.smithi093.stdout:6/286: write d0/da/f20 [2579658,38623] 0 2023-12-12T11:51:40.699 INFO:tasks.workunit.client.1.smithi093.stdout:6/287: dread - d0/da/d14/f55 zero size 2023-12-12T11:51:40.699 INFO:tasks.workunit.client.1.smithi093.stdout:6/288: dread - d0/d19/d42/f65 zero size 2023-12-12T11:51:40.699 INFO:tasks.workunit.client.1.smithi093.stdout:6/289: chown d0/d19/c35 4497 1 2023-12-12T11:51:40.699 INFO:tasks.workunit.client.1.smithi093.stdout:6/290: fsync d0/d19/f68 0 2023-12-12T11:51:40.699 INFO:tasks.workunit.client.1.smithi093.stdout:8/175: dwrite d3/d8/fc [4194304,4194304] 0 2023-12-12T11:51:40.700 INFO:tasks.workunit.client.1.smithi093.stdout:3/181: truncate df/f19 1306468 0 2023-12-12T11:51:40.706 INFO:tasks.workunit.client.1.smithi093.stdout:6/291: mknod d0/d52/c6d 0 2023-12-12T11:51:40.706 INFO:tasks.workunit.client.1.smithi093.stdout:6/292: write d0/da/f2e [648231,80875] 0 2023-12-12T11:51:40.708 INFO:tasks.workunit.client.1.smithi093.stdout:4/329: dread d0/d31/f28 [0,4194304] 0 2023-12-12T11:51:40.709 INFO:tasks.workunit.client.1.smithi093.stdout:4/330: chown d0/c53 28824716 1 2023-12-12T11:51:40.710 INFO:tasks.workunit.client.1.smithi093.stdout:8/176: mknod d3/d1a/c31 0 2023-12-12T11:51:40.713 INFO:tasks.workunit.client.1.smithi093.stdout:6/293: creat d0/d52/f6e x:0 0 0 2023-12-12T11:51:40.713 INFO:tasks.workunit.client.1.smithi093.stdout:1/166: dread d4/dc/f28 [0,4194304] 0 2023-12-12T11:51:40.714 INFO:tasks.workunit.client.1.smithi093.stdout:1/167: chown d4/fa 2525 1 2023-12-12T11:51:40.724 INFO:tasks.workunit.client.1.smithi093.stdout:9/128: sync 2023-12-12T11:51:40.724 INFO:tasks.workunit.client.1.smithi093.stdout:9/129: fdatasync d1/f16 0 2023-12-12T11:51:40.728 INFO:tasks.workunit.client.1.smithi093.stdout:3/182: dread df/d25/f32 [0,4194304] 0 2023-12-12T11:51:40.731 INFO:tasks.workunit.client.1.smithi093.stdout:9/130: getdents d1 0 2023-12-12T11:51:40.732 INFO:tasks.workunit.client.1.smithi093.stdout:9/131: getdents d1 0 2023-12-12T11:51:40.734 INFO:tasks.workunit.client.1.smithi093.stdout:2/255: dwrite d5/d14/f26 [0,4194304] 0 2023-12-12T11:51:40.734 INFO:tasks.workunit.client.1.smithi093.stdout:3/183: symlink df/d25/d2c/l3f 0 2023-12-12T11:51:40.734 INFO:tasks.workunit.client.1.smithi093.stdout:3/184: chown df/c1b 494427 1 2023-12-12T11:51:40.734 INFO:tasks.workunit.client.1.smithi093.stdout:3/185: fsync df/f1c 0 2023-12-12T11:51:40.735 INFO:tasks.workunit.client.1.smithi093.stdout:5/145: truncate d0/d7/d8/d22/d29/f30 2515448 0 2023-12-12T11:51:40.746 INFO:tasks.workunit.client.1.smithi093.stdout:9/132: creat d1/d23/d24/d29/f2b x:0 0 0 2023-12-12T11:51:40.747 INFO:tasks.workunit.client.1.smithi093.stdout:2/256: rename d5/d14/d2d/f2b to d5/d14/f4f 0 2023-12-12T11:51:40.747 INFO:tasks.workunit.client.1.smithi093.stdout:0/170: dwrite d5/dd/f16 [0,4194304] 0 2023-12-12T11:51:40.748 INFO:tasks.workunit.client.1.smithi093.stdout:1/168: dwrite d4/f2e [0,4194304] 0 2023-12-12T11:51:40.753 INFO:tasks.workunit.client.1.smithi093.stdout:3/186: symlink df/d25/l40 0 2023-12-12T11:51:40.761 INFO:tasks.workunit.client.1.smithi093.stdout:9/133: symlink d1/d23/l2c 0 2023-12-12T11:51:40.767 INFO:tasks.workunit.client.1.smithi093.stdout:0/171: creat d5/dd/f35 x:0 0 0 2023-12-12T11:51:40.768 INFO:tasks.workunit.client.1.smithi093.stdout:4/331: dwrite d0/f54 [0,4194304] 0 2023-12-12T11:51:40.774 INFO:tasks.workunit.client.1.smithi093.stdout:1/169: rmdir d4/d1a/d1b 39 2023-12-12T11:51:40.776 INFO:tasks.workunit.client.1.smithi093.stdout:0/172: mknod d5/d21/d27/c36 0 2023-12-12T11:51:40.780 INFO:tasks.workunit.client.1.smithi093.stdout:8/177: dwrite d3/d8/fc [8388608,4194304] 0 2023-12-12T11:51:40.780 INFO:tasks.workunit.client.1.smithi093.stdout:8/178: chown d3/d1a/d1f/f27 44564 1 2023-12-12T11:51:40.781 INFO:tasks.workunit.client.1.smithi093.stdout:3/187: write df/f1a [165860,42484] 0 2023-12-12T11:51:40.782 INFO:tasks.workunit.client.1.smithi093.stdout:4/332: unlink d0/d36/f37 0 2023-12-12T11:51:40.783 INFO:tasks.workunit.client.1.smithi093.stdout:4/333: chown d0/d31/l23 254164072 1 2023-12-12T11:51:40.783 INFO:tasks.workunit.client.1.smithi093.stdout:4/334: write d0/f1c [1005957,109394] 0 2023-12-12T11:51:40.783 INFO:tasks.workunit.client.1.smithi093.stdout:0/173: truncate d5/dd/d14/f18 3536281 0 2023-12-12T11:51:40.783 INFO:tasks.workunit.client.1.smithi093.stdout:0/174: chown d5/dd/l11 0 1 2023-12-12T11:51:40.783 INFO:tasks.workunit.client.1.smithi093.stdout:0/175: chown d5/dd/f35 1750 1 2023-12-12T11:51:40.787 INFO:tasks.workunit.client.1.smithi093.stdout:8/179: creat d3/d1a/d1f/d29/f32 x:0 0 0 2023-12-12T11:51:40.787 INFO:tasks.workunit.client.1.smithi093.stdout:8/180: truncate d3/d1a/f25 536968 0 2023-12-12T11:51:40.791 INFO:tasks.workunit.client.1.smithi093.stdout:4/335: rename d0/d31/l45 to d0/d31/d5c/l67 0 2023-12-12T11:51:40.791 INFO:tasks.workunit.client.1.smithi093.stdout:3/188: creat df/d36/f41 x:0 0 0 2023-12-12T11:51:40.791 INFO:tasks.workunit.client.1.smithi093.stdout:6/294: dwrite d0/da/f20 [4194304,4194304] 0 2023-12-12T11:51:40.796 INFO:tasks.workunit.client.1.smithi093.stdout:2/257: dwrite d5/d14/d2d/d12/f22 [0,4194304] 0 2023-12-12T11:51:40.797 INFO:tasks.workunit.client.1.smithi093.stdout:3/189: mkdir df/d36/d3d/d42 0 2023-12-12T11:51:40.797 INFO:tasks.workunit.client.1.smithi093.stdout:8/181: rename d3/fe to d3/d1a/f33 0 2023-12-12T11:51:40.797 INFO:tasks.workunit.client.1.smithi093.stdout:3/190: write df/f1a [256241,6499] 0 2023-12-12T11:51:40.797 INFO:tasks.workunit.client.1.smithi093.stdout:8/182: write d3/d1a/f2b [409205,8361] 0 2023-12-12T11:51:40.797 INFO:tasks.workunit.client.1.smithi093.stdout:3/191: write df/d36/f41 [476516,101249] 0 2023-12-12T11:51:40.797 INFO:tasks.workunit.client.1.smithi093.stdout:3/192: readlink df/l1f 0 2023-12-12T11:51:40.798 INFO:tasks.workunit.client.1.smithi093.stdout:6/295: creat d0/da/d32/d40/d4d/f6f x:0 0 0 2023-12-12T11:51:40.810 INFO:tasks.workunit.client.1.smithi093.stdout:3/193: creat df/f43 x:0 0 0 2023-12-12T11:51:40.814 INFO:tasks.workunit.client.1.smithi093.stdout:6/296: rename d0/da/d14/d21/c28 to d0/da/d14/d3a/c70 0 2023-12-12T11:51:40.816 INFO:tasks.workunit.client.1.smithi093.stdout:3/194: getdents df/d25 0 2023-12-12T11:51:40.816 INFO:tasks.workunit.client.1.smithi093.stdout:3/195: fsync df/f2e 0 2023-12-12T11:51:40.821 INFO:tasks.workunit.client.1.smithi093.stdout:0/176: dwrite d5/f31 [0,4194304] 0 2023-12-12T11:51:40.821 INFO:tasks.workunit.client.1.smithi093.stdout:0/177: chown d5/dd/f1a 116934 1 2023-12-12T11:51:40.822 INFO:tasks.workunit.client.1.smithi093.stdout:1/170: dwrite f1 [0,4194304] 0 2023-12-12T11:51:40.825 INFO:tasks.workunit.client.1.smithi093.stdout:6/297: rename d0/da/d14/d21/c37 to d0/da/d32/d40/d4d/c71 0 2023-12-12T11:51:40.825 INFO:tasks.workunit.client.1.smithi093.stdout:6/298: stat d0/da/d32/d40/l4c 0 2023-12-12T11:51:40.825 INFO:tasks.workunit.client.1.smithi093.stdout:6/299: creat d0/da/d14/f72 x:0 0 0 2023-12-12T11:51:40.825 INFO:tasks.workunit.client.1.smithi093.stdout:7/152: sync 2023-12-12T11:51:40.829 INFO:tasks.workunit.client.1.smithi093.stdout:3/196: creat df/d25/f44 x:0 0 0 2023-12-12T11:51:40.830 INFO:tasks.workunit.client.1.smithi093.stdout:2/258: dread d5/d14/d2d/f1e [0,4194304] 0 2023-12-12T11:51:40.835 INFO:tasks.workunit.client.1.smithi093.stdout:1/171: mkdir d4/d1a/d1b/d26/d31 0 2023-12-12T11:51:40.840 INFO:tasks.workunit.client.1.smithi093.stdout:6/300: write d0/da/d14/f1b [1408713,75474] 0 2023-12-12T11:51:40.845 INFO:tasks.workunit.client.1.smithi093.stdout:8/183: dwrite d3/d8/f18 [0,4194304] 0 2023-12-12T11:51:40.848 INFO:tasks.workunit.client.1.smithi093.stdout:7/153: link da/l1f da/d2e/l35 0 2023-12-12T11:51:40.851 INFO:tasks.workunit.client.1.smithi093.stdout:4/336: dwrite d0/f33 [0,4194304] 0 2023-12-12T11:51:40.852 INFO:tasks.workunit.client.1.smithi093.stdout:3/197: creat df/d30/d33/f45 x:0 0 0 2023-12-12T11:51:40.852 INFO:tasks.workunit.client.1.smithi093.stdout:3/198: readlink l8 0 2023-12-12T11:51:40.852 INFO:tasks.workunit.client.1.smithi093.stdout:2/259: symlink d5/d14/d27/l50 0 2023-12-12T11:51:40.853 INFO:tasks.workunit.client.1.smithi093.stdout:1/172: creat d4/dc/f32 x:0 0 0 2023-12-12T11:51:40.860 INFO:tasks.workunit.client.1.smithi093.stdout:8/184: creat d3/d1a/d1f/d29/d30/f34 x:0 0 0 2023-12-12T11:51:40.873 INFO:tasks.workunit.client.1.smithi093.stdout:3/199: symlink df/d36/d3d/d42/l46 0 2023-12-12T11:51:40.873 INFO:tasks.workunit.client.1.smithi093.stdout:3/200: truncate df/d22/f27 4196002 0 2023-12-12T11:51:40.873 INFO:tasks.workunit.client.1.smithi093.stdout:3/201: dread - df/d30/d33/f45 zero size 2023-12-12T11:51:40.873 INFO:tasks.workunit.client.1.smithi093.stdout:3/202: truncate df/d22/f31 1154906 0 2023-12-12T11:51:40.874 INFO:tasks.workunit.client.1.smithi093.stdout:3/203: read - df/f3b zero size 2023-12-12T11:51:40.877 INFO:tasks.workunit.client.1.smithi093.stdout:2/260: mkdir d5/d14/d47/d4e/d51 0 2023-12-12T11:51:40.879 INFO:tasks.workunit.client.1.smithi093.stdout:8/185: mknod d3/d8/c35 0 2023-12-12T11:51:40.880 INFO:tasks.workunit.client.1.smithi093.stdout:8/186: readlink d3/d1a/l1b 0 2023-12-12T11:51:40.880 INFO:tasks.workunit.client.1.smithi093.stdout:8/187: fsync d3/d8/f18 0 2023-12-12T11:51:40.885 INFO:tasks.workunit.client.1.smithi093.stdout:3/204: rename df/d22/l2d to df/d36/d3d/d42/l47 0 2023-12-12T11:51:40.895 INFO:tasks.workunit.client.1.smithi093.stdout:3/205: dread df/f2e [0,4194304] 0 2023-12-12T11:51:40.895 INFO:tasks.workunit.client.1.smithi093.stdout:3/206: truncate df/f3b 760764 0 2023-12-12T11:51:40.903 INFO:tasks.workunit.client.1.smithi093.stdout:4/337: read d0/d36/f59 [2223905,93619] 0 2023-12-12T11:51:40.904 INFO:tasks.workunit.client.1.smithi093.stdout:3/207: link df/c15 df/d25/d3e/c48 0 2023-12-12T11:51:40.904 INFO:tasks.workunit.client.1.smithi093.stdout:3/208: write df/d22/f23 [420742,100061] 0 2023-12-12T11:51:40.909 INFO:tasks.workunit.client.1.smithi093.stdout:4/338: rmdir d0/d36/d40 39 2023-12-12T11:51:40.909 INFO:tasks.workunit.client.1.smithi093.stdout:4/339: write d0/f14 [2019767,61508] 0 2023-12-12T11:51:40.912 INFO:tasks.workunit.client.1.smithi093.stdout:1/173: dwrite d4/fa [0,4194304] 0 2023-12-12T11:51:40.920 INFO:tasks.workunit.client.1.smithi093.stdout:3/209: write df/d25/d2c/f3c [1029683,59216] 0 2023-12-12T11:51:40.922 INFO:tasks.workunit.client.1.smithi093.stdout:6/301: dwrite d0/d19/d42/f45 [0,4194304] 0 2023-12-12T11:51:40.924 INFO:tasks.workunit.client.1.smithi093.stdout:4/340: mkdir d0/d36/d68 0 2023-12-12T11:51:40.924 INFO:tasks.workunit.client.1.smithi093.stdout:4/341: fsync d0/d31/f29 0 2023-12-12T11:51:40.924 INFO:tasks.workunit.client.1.smithi093.stdout:7/154: dwrite da/d15/f16 [0,4194304] 0 2023-12-12T11:51:40.929 INFO:tasks.workunit.client.1.smithi093.stdout:1/174: truncate d4/f2e 676222 0 2023-12-12T11:51:40.929 INFO:tasks.workunit.client.1.smithi093.stdout:1/175: creat d4/dc/f33 x:0 0 0 2023-12-12T11:51:40.930 INFO:tasks.workunit.client.1.smithi093.stdout:1/176: creat d4/dc/f34 x:0 0 0 2023-12-12T11:51:40.937 INFO:tasks.workunit.client.1.smithi093.stdout:6/302: stat d0/l7 0 2023-12-12T11:51:40.938 INFO:tasks.workunit.client.1.smithi093.stdout:8/188: dwrite d3/d1a/f25 [0,4194304] 0 2023-12-12T11:51:40.938 INFO:tasks.workunit.client.1.smithi093.stdout:8/189: readlink d3/d1a/d1f/d29/l2e 0 2023-12-12T11:51:40.938 INFO:tasks.workunit.client.1.smithi093.stdout:8/190: write d3/d1a/d1f/f2a [688527,21806] 0 2023-12-12T11:51:40.954 INFO:tasks.workunit.client.1.smithi093.stdout:5/146: sync 2023-12-12T11:51:40.961 INFO:tasks.workunit.client.1.smithi093.stdout:6/303: mkdir d0/da/d73 0 2023-12-12T11:51:40.961 INFO:tasks.workunit.client.1.smithi093.stdout:7/155: rmdir da/d15/d2d 39 2023-12-12T11:51:40.961 INFO:tasks.workunit.client.1.smithi093.stdout:6/304: write d0/da/d14/f72 [17745,36245] 0 2023-12-12T11:51:40.961 INFO:tasks.workunit.client.1.smithi093.stdout:6/305: readlink d0/da/d14/l1e 0 2023-12-12T11:51:40.961 INFO:tasks.workunit.client.1.smithi093.stdout:2/261: dwrite d5/d14/d2d/f1e [0,4194304] 0 2023-12-12T11:51:40.962 INFO:tasks.workunit.client.1.smithi093.stdout:2/262: fdatasync d5/d14/f4f 0 2023-12-12T11:51:40.963 INFO:tasks.workunit.client.1.smithi093.stdout:4/342: dwrite d0/d31/f28 [0,4194304] 0 2023-12-12T11:51:40.963 INFO:tasks.workunit.client.1.smithi093.stdout:4/343: write d0/fe [237443,48863] 0 2023-12-12T11:51:40.965 INFO:tasks.workunit.client.1.smithi093.stdout:8/191: creat d3/f36 x:0 0 0 2023-12-12T11:51:40.973 INFO:tasks.workunit.client.1.smithi093.stdout:5/147: creat d0/d7/d19/f34 x:0 0 0 2023-12-12T11:51:40.973 INFO:tasks.workunit.client.1.smithi093.stdout:7/156: mknod da/c36 0 2023-12-12T11:51:40.974 INFO:tasks.workunit.client.1.smithi093.stdout:6/306: mknod d0/d52/d6b/c74 0 2023-12-12T11:51:40.984 INFO:tasks.workunit.client.1.smithi093.stdout:1/177: dwrite d4/d1a/f29 [0,4194304] 0 2023-12-12T11:51:40.987 INFO:tasks.workunit.client.1.smithi093.stdout:2/263: getdents d5/d14/d2d/d12/d25 0 2023-12-12T11:51:40.988 INFO:tasks.workunit.client.1.smithi093.stdout:4/344: mknod d0/d31/c69 0 2023-12-12T11:51:40.988 INFO:tasks.workunit.client.1.smithi093.stdout:4/345: fdatasync d0/f54 0 2023-12-12T11:51:40.988 INFO:tasks.workunit.client.1.smithi093.stdout:4/346: stat d0/c6 0 2023-12-12T11:51:40.989 INFO:tasks.workunit.client.1.smithi093.stdout:3/210: dwrite df/f2f [0,4194304] 0 2023-12-12T11:51:40.991 INFO:tasks.workunit.client.1.smithi093.stdout:6/307: symlink d0/da/d32/d39/l75 0 2023-12-12T11:51:41.008 INFO:tasks.workunit.client.1.smithi093.stdout:3/211: write df/f10 [1127724,1194] 0 2023-12-12T11:51:41.008 INFO:tasks.workunit.client.1.smithi093.stdout:2/264: mknod d5/d14/d2d/d12/d44/c52 0 2023-12-12T11:51:41.008 INFO:tasks.workunit.client.1.smithi093.stdout:4/347: creat d0/d31/d5c/d66/f6a x:0 0 0 2023-12-12T11:51:41.008 INFO:tasks.workunit.client.1.smithi093.stdout:6/308: rename d0/da/d32/f4a to d0/da/d14/d38/d43/f76 0 2023-12-12T11:51:41.017 INFO:tasks.workunit.client.1.smithi093.stdout:9/134: sync 2023-12-12T11:51:41.022 INFO:tasks.workunit.client.1.smithi093.stdout:4/348: creat d0/d31/d5c/f6b x:0 0 0 2023-12-12T11:51:41.024 INFO:tasks.workunit.client.1.smithi093.stdout:9/135: unlink d1/l1b 0 2023-12-12T11:51:41.027 INFO:tasks.workunit.client.1.smithi093.stdout:4/349: mkdir d0/d31/d5c/d6c 0 2023-12-12T11:51:41.029 INFO:tasks.workunit.client.1.smithi093.stdout:4/350: symlink d0/d31/l6d 0 2023-12-12T11:51:41.031 INFO:tasks.workunit.client.1.smithi093.stdout:5/148: dwrite d0/d7/d8/d22/d1e/f1f [0,4194304] 0 2023-12-12T11:51:41.032 INFO:tasks.workunit.client.1.smithi093.stdout:4/351: mknod d0/c6e 0 2023-12-12T11:51:41.032 INFO:tasks.workunit.client.1.smithi093.stdout:4/352: fdatasync d0/f20 0 2023-12-12T11:51:41.034 INFO:tasks.workunit.client.1.smithi093.stdout:7/157: dwrite da/d15/f1c [0,4194304] 0 2023-12-12T11:51:41.034 INFO:tasks.workunit.client.1.smithi093.stdout:7/158: readlink da/de/l2a 0 2023-12-12T11:51:41.035 INFO:tasks.workunit.client.1.smithi093.stdout:7/159: fsync da/d15/f24 0 2023-12-12T11:51:41.037 INFO:tasks.workunit.client.1.smithi093.stdout:2/265: dread d5/d14/d2d/ff [4194304,4194304] 0 2023-12-12T11:51:41.037 INFO:tasks.workunit.client.1.smithi093.stdout:2/266: dread - d5/f49 zero size 2023-12-12T11:51:41.038 INFO:tasks.workunit.client.1.smithi093.stdout:3/212: dread df/f2e [0,4194304] 0 2023-12-12T11:51:41.038 INFO:tasks.workunit.client.1.smithi093.stdout:1/178: dwrite d4/d1c/f21 [0,4194304] 0 2023-12-12T11:51:41.038 INFO:tasks.workunit.client.1.smithi093.stdout:1/179: chown d4/l9 15 1 2023-12-12T11:51:41.040 INFO:tasks.workunit.client.1.smithi093.stdout:0/178: sync 2023-12-12T11:51:41.040 INFO:tasks.workunit.client.1.smithi093.stdout:7/160: mknod da/d15/d2d/d2f/c37 0 2023-12-12T11:51:41.042 INFO:tasks.workunit.client.1.smithi093.stdout:4/353: symlink d0/d36/l6f 0 2023-12-12T11:51:41.048 INFO:tasks.workunit.client.1.smithi093.stdout:1/180: symlink d4/d1c/d2a/l35 0 2023-12-12T11:51:41.048 INFO:tasks.workunit.client.1.smithi093.stdout:1/181: readlink d4/l1f 0 2023-12-12T11:51:41.051 INFO:tasks.workunit.client.1.smithi093.stdout:2/267: dread d5/f19 [0,4194304] 0 2023-12-12T11:51:41.055 INFO:tasks.workunit.client.1.smithi093.stdout:0/179: creat d5/dd/d14/f37 x:0 0 0 2023-12-12T11:51:41.055 INFO:tasks.workunit.client.1.smithi093.stdout:0/180: dread - d5/dd/f35 zero size 2023-12-12T11:51:41.055 INFO:tasks.workunit.client.1.smithi093.stdout:3/213: getdents df/d30/d33 0 2023-12-12T11:51:41.056 INFO:tasks.workunit.client.1.smithi093.stdout:2/268: creat d5/d14/d2d/f53 x:0 0 0 2023-12-12T11:51:41.058 INFO:tasks.workunit.client.1.smithi093.stdout:5/149: rename d0/d7/d8/d22/d1e to d0/d7/d27/d35 0 2023-12-12T11:51:41.061 INFO:tasks.workunit.client.1.smithi093.stdout:3/214: mkdir df/d22/d49 0 2023-12-12T11:51:41.065 INFO:tasks.workunit.client.1.smithi093.stdout:2/269: mkdir d5/d14/d2d/d4c/d54 0 2023-12-12T11:51:41.065 INFO:tasks.workunit.client.1.smithi093.stdout:2/270: truncate d5/d14/d2d/d12/f22 4510756 0 2023-12-12T11:51:41.066 INFO:tasks.workunit.client.1.smithi093.stdout:1/182: read d4/fa [3800031,73731] 0 2023-12-12T11:51:41.067 INFO:tasks.workunit.client.1.smithi093.stdout:4/354: write d0/d31/f3b [1964093,37107] 0 2023-12-12T11:51:41.071 INFO:tasks.workunit.client.1.smithi093.stdout:1/183: rename d4/dc/l22 to d4/d1c/l36 0 2023-12-12T11:51:41.071 INFO:tasks.workunit.client.1.smithi093.stdout:3/215: unlink df/d36/d3d/d42/l46 0 2023-12-12T11:51:41.078 INFO:tasks.workunit.client.1.smithi093.stdout:1/184: symlink d4/dc/l37 0 2023-12-12T11:51:41.079 INFO:tasks.workunit.client.1.smithi093.stdout:3/216: mknod df/d25/d3e/c4a 0 2023-12-12T11:51:41.080 INFO:tasks.workunit.client.1.smithi093.stdout:3/217: write df/f2e [118674,112981] 0 2023-12-12T11:51:41.085 INFO:tasks.workunit.client.1.smithi093.stdout:1/185: rename d4/dc/f34 to d4/d1a/d1b/d26/d31/f38 0 2023-12-12T11:51:41.086 INFO:tasks.workunit.client.1.smithi093.stdout:0/181: dread d5/d21/f2e [0,4194304] 0 2023-12-12T11:51:41.089 INFO:tasks.workunit.client.1.smithi093.stdout:2/271: dread d5/d14/d2d/d12/d25/f29 [0,4194304] 0 2023-12-12T11:51:41.091 INFO:tasks.workunit.client.1.smithi093.stdout:7/161: dwrite da/d15/f2c [0,4194304] 0 2023-12-12T11:51:41.094 INFO:tasks.workunit.client.1.smithi093.stdout:3/218: rename df/f3b to df/d25/d3e/f4b 0 2023-12-12T11:51:41.095 INFO:tasks.workunit.client.1.smithi093.stdout:1/186: mknod d4/d1c/d2a/d2d/c39 0 2023-12-12T11:51:41.095 INFO:tasks.workunit.client.1.smithi093.stdout:1/187: chown d4/dc/f32 170830403 1 2023-12-12T11:51:41.095 INFO:tasks.workunit.client.1.smithi093.stdout:1/188: dread - d4/d1a/d1b/d26/d31/f38 zero size 2023-12-12T11:51:41.096 INFO:tasks.workunit.client.1.smithi093.stdout:0/182: symlink d5/d21/l38 0 2023-12-12T11:51:41.098 INFO:tasks.workunit.client.1.smithi093.stdout:2/272: mkdir d5/d46/d55 0 2023-12-12T11:51:41.098 INFO:tasks.workunit.client.1.smithi093.stdout:5/150: dwrite d0/d7/d8/de/f28 [0,4194304] 0 2023-12-12T11:51:41.099 INFO:tasks.workunit.client.1.smithi093.stdout:7/162: dread da/f20 [0,4194304] 0 2023-12-12T11:51:41.104 INFO:tasks.workunit.client.1.smithi093.stdout:1/189: creat d4/d1a/d1b/f3a x:0 0 0 2023-12-12T11:51:41.104 INFO:tasks.workunit.client.1.smithi093.stdout:1/190: chown d4/f8 1 1 2023-12-12T11:51:41.105 INFO:tasks.workunit.client.1.smithi093.stdout:0/183: mknod d5/d21/c39 0 2023-12-12T11:51:41.110 INFO:tasks.workunit.client.1.smithi093.stdout:7/163: creat da/de/f38 x:0 0 0 2023-12-12T11:51:41.112 INFO:tasks.workunit.client.1.smithi093.stdout:3/219: rmdir df/d25/d2c 39 2023-12-12T11:51:41.113 INFO:tasks.workunit.client.1.smithi093.stdout:0/184: dread d5/f7 [0,4194304] 0 2023-12-12T11:51:41.118 INFO:tasks.workunit.client.1.smithi093.stdout:1/191: mknod d4/d1c/c3b 0 2023-12-12T11:51:41.118 INFO:tasks.workunit.client.1.smithi093.stdout:3/220: rmdir df/d25/d3e 39 2023-12-12T11:51:41.118 INFO:tasks.workunit.client.1.smithi093.stdout:3/221: chown df/f21 27361200 1 2023-12-12T11:51:41.118 INFO:tasks.workunit.client.1.smithi093.stdout:0/185: mkdir d5/d21/d27/d3a 0 2023-12-12T11:51:41.122 INFO:tasks.workunit.client.1.smithi093.stdout:1/192: getdents d4/d1a/d1b/d26/d31 0 2023-12-12T11:51:41.122 INFO:tasks.workunit.client.1.smithi093.stdout:1/193: creat d4/f3c x:0 0 0 2023-12-12T11:51:41.125 INFO:tasks.workunit.client.1.smithi093.stdout:1/194: write d4/f2e [107604,18467] 0 2023-12-12T11:51:41.125 INFO:tasks.workunit.client.1.smithi093.stdout:1/195: dread - d4/f3c zero size 2023-12-12T11:51:41.128 INFO:tasks.workunit.client.1.smithi093.stdout:3/222: rename df/l16 to df/d30/d33/l4c 0 2023-12-12T11:51:41.137 INFO:tasks.workunit.client.1.smithi093.stdout:3/223: truncate df/d22/f31 148299 0 2023-12-12T11:51:41.137 INFO:tasks.workunit.client.1.smithi093.stdout:3/224: fdatasync df/d22/f31 0 2023-12-12T11:51:41.137 INFO:tasks.workunit.client.1.smithi093.stdout:0/186: mknod d5/c3b 0 2023-12-12T11:51:41.137 INFO:tasks.workunit.client.1.smithi093.stdout:0/187: fdatasync d5/f31 0 2023-12-12T11:51:41.137 INFO:tasks.workunit.client.1.smithi093.stdout:0/188: fsync d5/dd/f35 0 2023-12-12T11:51:41.140 INFO:tasks.workunit.client.1.smithi093.stdout:8/192: sync 2023-12-12T11:51:41.140 INFO:tasks.workunit.client.1.smithi093.stdout:8/193: chown d3/f24 14486524 1 2023-12-12T11:51:41.149 INFO:tasks.workunit.client.1.smithi093.stdout:2/273: dwrite d5/f49 [0,4194304] 0 2023-12-12T11:51:41.149 INFO:tasks.workunit.client.1.smithi093.stdout:2/274: dread - d5/d14/d2d/d12/d25/f30 zero size 2023-12-12T11:51:41.154 INFO:tasks.workunit.client.1.smithi093.stdout:8/194: creat d3/d8/f37 x:0 0 0 2023-12-12T11:51:41.154 INFO:tasks.workunit.client.1.smithi093.stdout:6/309: sync 2023-12-12T11:51:41.156 INFO:tasks.workunit.client.1.smithi093.stdout:0/189: dread d5/d21/f2e [0,4194304] 0 2023-12-12T11:51:41.160 INFO:tasks.workunit.client.1.smithi093.stdout:1/196: dwrite d4/f2e [0,4194304] 0 2023-12-12T11:51:41.160 INFO:tasks.workunit.client.1.smithi093.stdout:1/197: chown d4/dc/f32 789728 1 2023-12-12T11:51:41.161 INFO:tasks.workunit.client.1.smithi093.stdout:1/198: creat d4/d1c/d2a/f3d x:0 0 0 2023-12-12T11:51:41.162 INFO:tasks.workunit.client.1.smithi093.stdout:6/310: creat d0/da/d73/f77 x:0 0 0 2023-12-12T11:51:41.162 INFO:tasks.workunit.client.1.smithi093.stdout:6/311: truncate d0/d52/f6e 713236 0 2023-12-12T11:51:41.162 INFO:tasks.workunit.client.1.smithi093.stdout:6/312: write d0/da/d14/d3a/f6a [117271,111690] 0 2023-12-12T11:51:41.172 INFO:tasks.workunit.client.1.smithi093.stdout:1/199: rename d4/d1a/f29 to d4/f3e 0 2023-12-12T11:51:41.175 INFO:tasks.workunit.client.1.smithi093.stdout:0/190: unlink d5/c1b 0 2023-12-12T11:51:41.177 INFO:tasks.workunit.client.1.smithi093.stdout:1/200: rmdir d4/d1c/d2a/d2f 0 2023-12-12T11:51:41.178 INFO:tasks.workunit.client.1.smithi093.stdout:2/275: write d5/d14/d27/f36 [1881715,28751] 0 2023-12-12T11:51:41.179 INFO:tasks.workunit.client.1.smithi093.stdout:2/276: chown d5/d14/d2d/d12/l18 414366404 1 2023-12-12T11:51:41.179 INFO:tasks.workunit.client.1.smithi093.stdout:7/164: dwrite da/d15/f24 [0,4194304] 0 2023-12-12T11:51:41.179 INFO:tasks.workunit.client.1.smithi093.stdout:2/277: write d5/d31/f45 [955366,48310] 0 2023-12-12T11:51:41.182 INFO:tasks.workunit.client.1.smithi093.stdout:2/278: fsync d5/d14/d27/f36 0 2023-12-12T11:51:41.188 INFO:tasks.workunit.client.1.smithi093.stdout:2/279: mkdir d5/d14/d47/d56 0 2023-12-12T11:51:41.189 INFO:tasks.workunit.client.1.smithi093.stdout:2/280: write d5/d31/f4a [531913,54432] 0 2023-12-12T11:51:41.193 INFO:tasks.workunit.client.1.smithi093.stdout:0/191: dread d5/dd/d14/d26/f34 [0,4194304] 0 2023-12-12T11:51:41.199 INFO:tasks.workunit.client.1.smithi093.stdout:0/192: creat d5/dd/d33/f3c x:0 0 0 2023-12-12T11:51:41.201 INFO:tasks.workunit.client.1.smithi093.stdout:1/201: dread d4/f8 [0,4194304] 0 2023-12-12T11:51:41.205 INFO:tasks.workunit.client.1.smithi093.stdout:2/281: write d5/f10 [1137737,29755] 0 2023-12-12T11:51:41.209 INFO:tasks.workunit.client.1.smithi093.stdout:1/202: rmdir d4/d1a/d1b 39 2023-12-12T11:51:41.211 INFO:tasks.workunit.client.1.smithi093.stdout:2/282: dread d5/d31/f3f [0,4194304] 0 2023-12-12T11:51:41.211 INFO:tasks.workunit.client.1.smithi093.stdout:2/283: creat d5/d14/d2d/d12/d44/f57 x:0 0 0 2023-12-12T11:51:41.213 INFO:tasks.workunit.client.1.smithi093.stdout:3/225: dwrite df/d25/d2c/f3c [0,4194304] 0 2023-12-12T11:51:41.216 INFO:tasks.workunit.client.1.smithi093.stdout:1/203: symlink d4/d1c/d2a/d2d/l3f 0 2023-12-12T11:51:41.220 INFO:tasks.workunit.client.1.smithi093.stdout:7/165: truncate da/d15/f24 4124572 0 2023-12-12T11:51:41.222 INFO:tasks.workunit.client.1.smithi093.stdout:1/204: mkdir d4/d1a/d1b/d26/d40 0 2023-12-12T11:51:41.225 INFO:tasks.workunit.client.1.smithi093.stdout:2/284: dread d5/d14/d2d/fc [4194304,4194304] 0 2023-12-12T11:51:41.225 INFO:tasks.workunit.client.1.smithi093.stdout:7/166: rename da/d15/c17 to da/d15/c39 0 2023-12-12T11:51:41.226 INFO:tasks.workunit.client.1.smithi093.stdout:1/205: link d4/f25 d4/dc/f41 0 2023-12-12T11:51:41.228 INFO:tasks.workunit.client.1.smithi093.stdout:2/285: mknod d5/d14/d47/d4e/c58 0 2023-12-12T11:51:41.230 INFO:tasks.workunit.client.1.smithi093.stdout:1/206: symlink d4/d1a/d1b/d26/d40/l42 0 2023-12-12T11:51:41.230 INFO:tasks.workunit.client.1.smithi093.stdout:1/207: creat d4/d1c/f43 x:0 0 0 2023-12-12T11:51:41.232 INFO:tasks.workunit.client.1.smithi093.stdout:2/286: creat d5/d14/d2d/d12/f59 x:0 0 0 2023-12-12T11:51:41.235 INFO:tasks.workunit.client.1.smithi093.stdout:1/208: mknod d4/c44 0 2023-12-12T11:51:41.238 INFO:tasks.workunit.client.1.smithi093.stdout:2/287: creat d5/d14/d47/d4e/d51/f5a x:0 0 0 2023-12-12T11:51:41.238 INFO:tasks.workunit.client.1.smithi093.stdout:6/313: dwrite d0/da/d14/f72 [0,4194304] 0 2023-12-12T11:51:41.238 INFO:tasks.workunit.client.1.smithi093.stdout:6/314: stat d0/da/d14/d38/d69 0 2023-12-12T11:51:41.240 INFO:tasks.workunit.client.1.smithi093.stdout:6/315: write d0/da/d14/d21/f46 [666538,41761] 0 2023-12-12T11:51:41.240 INFO:tasks.workunit.client.1.smithi093.stdout:6/316: fsync d0/da/f2e 0 2023-12-12T11:51:41.256 INFO:tasks.workunit.client.1.smithi093.stdout:2/288: creat d5/d14/d47/f5b x:0 0 0 2023-12-12T11:51:41.256 INFO:tasks.workunit.client.1.smithi093.stdout:2/289: write d5/d14/d2d/d12/f2c [36572,56016] 0 2023-12-12T11:51:41.258 INFO:tasks.workunit.client.1.smithi093.stdout:6/317: getdents d0/da 0 2023-12-12T11:51:41.266 INFO:tasks.workunit.client.1.smithi093.stdout:7/167: dread da/d15/f24 [0,4194304] 0 2023-12-12T11:51:41.268 INFO:tasks.workunit.client.1.smithi093.stdout:6/318: unlink d0/da/d14/d21/f46 0 2023-12-12T11:51:41.283 INFO:tasks.workunit.client.1.smithi093.stdout:0/193: dwrite d5/dd/d14/f18 [0,4194304] 0 2023-12-12T11:51:41.284 INFO:tasks.workunit.client.1.smithi093.stdout:7/168: write da/d15/f1c [3653169,96334] 0 2023-12-12T11:51:41.284 INFO:tasks.workunit.client.1.smithi093.stdout:7/169: fsync da/d15/f16 0 2023-12-12T11:51:41.284 INFO:tasks.workunit.client.1.smithi093.stdout:7/170: fsync da/de/f38 0 2023-12-12T11:51:41.293 INFO:tasks.workunit.client.1.smithi093.stdout:2/290: rmdir d5/d14/d47/d4e/d51 39 2023-12-12T11:51:41.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:40 smithi063 ceph-mon[107117]: mgrmap e23: smithi093.nbtltu(active, since 3s) 2023-12-12T11:51:41.300 INFO:tasks.workunit.client.1.smithi093.stdout:9/136: sync 2023-12-12T11:51:41.300 INFO:tasks.workunit.client.1.smithi093.stdout:8/195: sync 2023-12-12T11:51:41.300 INFO:tasks.workunit.client.1.smithi093.stdout:9/137: readlink d1/d23/l2c 0 2023-12-12T11:51:41.300 INFO:tasks.workunit.client.1.smithi093.stdout:5/151: sync 2023-12-12T11:51:41.300 INFO:tasks.workunit.client.1.smithi093.stdout:9/138: write d1/d12/d1f/f28 [187911,13731] 0 2023-12-12T11:51:41.300 INFO:tasks.workunit.client.1.smithi093.stdout:9/139: read d1/fa [529641,79566] 0 2023-12-12T11:51:41.300 INFO:tasks.workunit.client.1.smithi093.stdout:4/355: sync 2023-12-12T11:51:41.300 INFO:tasks.workunit.client.1.smithi093.stdout:4/356: creat d0/d36/f70 x:0 0 0 2023-12-12T11:51:41.300 INFO:tasks.workunit.client.1.smithi093.stdout:3/226: dwrite df/f1a [0,4194304] 0 2023-12-12T11:51:41.300 INFO:tasks.workunit.client.1.smithi093.stdout:0/194: creat d5/d21/d2f/f3d x:0 0 0 2023-12-12T11:51:41.301 INFO:tasks.workunit.client.1.smithi093.stdout:2/291: link d5/d14/d2d/d12/l18 d5/l5c 0 2023-12-12T11:51:41.304 INFO:tasks.workunit.client.1.smithi093.stdout:1/209: dwrite d4/dc/f32 [0,4194304] 0 2023-12-12T11:51:41.306 INFO:tasks.workunit.client.1.smithi093.stdout:8/196: link d3/d8/l2c d3/d1a/d1f/d29/l38 0 2023-12-12T11:51:41.306 INFO:tasks.workunit.client.1.smithi093.stdout:8/197: creat d3/d8/f39 x:0 0 0 2023-12-12T11:51:41.310 INFO:tasks.workunit.client.1.smithi093.stdout:4/357: rename d0/l1a to d0/l71 0 2023-12-12T11:51:41.316 INFO:tasks.workunit.client.1.smithi093.stdout:0/195: readlink d5/le 0 2023-12-12T11:51:41.316 INFO:tasks.workunit.client.1.smithi093.stdout:2/292: symlink d5/d14/d47/d56/l5d 0 2023-12-12T11:51:41.318 INFO:tasks.workunit.client.1.smithi093.stdout:9/140: dread d1/f1e [0,4194304] 0 2023-12-12T11:51:41.319 INFO:tasks.workunit.client.1.smithi093.stdout:9/141: read d1/d12/f1a [230288,59789] 0 2023-12-12T11:51:41.323 INFO:tasks.workunit.client.1.smithi093.stdout:6/319: dwrite d0/da/d32/d39/d5b/f64 [0,4194304] 0 2023-12-12T11:51:41.324 INFO:tasks.workunit.client.1.smithi093.stdout:1/210: mknod d4/c45 0 2023-12-12T11:51:41.328 INFO:tasks.workunit.client.1.smithi093.stdout:8/198: mkdir d3/d1a/d1f/d29/d3a 0 2023-12-12T11:51:41.329 INFO:tasks.workunit.client.1.smithi093.stdout:4/358: link d0/l24 d0/d36/d61/l72 0 2023-12-12T11:51:41.330 INFO:tasks.workunit.client.1.smithi093.stdout:4/359: read - d0/d31/d5c/f6b zero size 2023-12-12T11:51:41.331 INFO:tasks.workunit.client.1.smithi093.stdout:2/293: mkdir d5/d14/d5e 0 2023-12-12T11:51:41.331 INFO:tasks.workunit.client.1.smithi093.stdout:3/227: dwrite df/f19 [0,4194304] 0 2023-12-12T11:51:41.332 INFO:tasks.workunit.client.1.smithi093.stdout:0/196: link d5/d21/d2f/f3d d5/d21/d2f/f3e 0 2023-12-12T11:51:41.332 INFO:tasks.workunit.client.1.smithi093.stdout:0/197: truncate d5/d21/d2f/f3e 699183 0 2023-12-12T11:51:41.335 INFO:tasks.workunit.client.1.smithi093.stdout:7/171: dwrite da/d15/d19/f1e [0,4194304] 0 2023-12-12T11:51:41.335 INFO:tasks.workunit.client.1.smithi093.stdout:5/152: rename d0/d7/d8/d22 to d0/d7/d36 0 2023-12-12T11:51:41.337 INFO:tasks.workunit.client.1.smithi093.stdout:9/142: symlink d1/l2d 0 2023-12-12T11:51:41.343 INFO:tasks.workunit.client.1.smithi093.stdout:6/320: mknod d0/da/d14/d21/c78 0 2023-12-12T11:51:41.344 INFO:tasks.workunit.client.1.smithi093.stdout:1/211: truncate d4/fd 1349897 0 2023-12-12T11:51:41.350 INFO:tasks.workunit.client.1.smithi093.stdout:8/199: mknod d3/d1a/d1f/d29/d3a/c3b 0 2023-12-12T11:51:41.350 INFO:tasks.workunit.client.1.smithi093.stdout:4/360: symlink d0/d31/l73 0 2023-12-12T11:51:41.351 INFO:tasks.workunit.client.1.smithi093.stdout:4/361: chown d0/d36/c3f 344 1 2023-12-12T11:51:41.351 INFO:tasks.workunit.client.1.smithi093.stdout:0/198: creat d5/dd/d14/d26/f3f x:0 0 0 2023-12-12T11:51:41.351 INFO:tasks.workunit.client.1.smithi093.stdout:9/143: dread d1/f16 [0,4194304] 0 2023-12-12T11:51:41.351 INFO:tasks.workunit.client.1.smithi093.stdout:0/199: dread - d5/dd/f35 zero size 2023-12-12T11:51:41.351 INFO:tasks.workunit.client.1.smithi093.stdout:9/144: stat d1/d23/d24 0 2023-12-12T11:51:41.360 INFO:tasks.workunit.client.1.smithi093.stdout:7/172: mknod da/de/c3a 0 2023-12-12T11:51:41.360 INFO:tasks.workunit.client.1.smithi093.stdout:5/153: getdents d0 0 2023-12-12T11:51:41.361 INFO:tasks.workunit.client.1.smithi093.stdout:3/228: rename df/d25/d3e/c4a to df/d22/c4d 0 2023-12-12T11:51:41.364 INFO:tasks.workunit.client.1.smithi093.stdout:9/145: read d1/d12/d1f/f20 [711454,18533] 0 2023-12-12T11:51:41.366 INFO:tasks.workunit.client.1.smithi093.stdout:0/200: dread d5/f31 [0,4194304] 0 2023-12-12T11:51:41.366 INFO:tasks.workunit.client.1.smithi093.stdout:0/201: readlink d5/dd/l11 0 2023-12-12T11:51:41.382 INFO:tasks.workunit.client.1.smithi093.stdout:6/321: symlink d0/da/d14/d21/l79 0 2023-12-12T11:51:41.383 INFO:tasks.workunit.client.1.smithi093.stdout:1/212: symlink d4/d1c/l46 0 2023-12-12T11:51:41.384 INFO:tasks.workunit.client.1.smithi093.stdout:1/213: dread - d4/d1c/d2a/f2b zero size 2023-12-12T11:51:41.387 INFO:tasks.workunit.client.1.smithi093.stdout:5/154: truncate d0/d7/d8/f13 4016835 0 2023-12-12T11:51:41.387 INFO:tasks.workunit.client.1.smithi093.stdout:5/155: write d0/d7/d27/d35/f31 [480011,95263] 0 2023-12-12T11:51:41.393 INFO:tasks.workunit.client.1.smithi093.stdout:9/146: creat d1/d23/d24/f2e x:0 0 0 2023-12-12T11:51:41.393 INFO:tasks.workunit.client.1.smithi093.stdout:9/147: write d1/d12/f1a [2029708,124362] 0 2023-12-12T11:51:41.399 INFO:tasks.workunit.client.1.smithi093.stdout:6/322: link d0/da/d14/f72 d0/da/d14/f7a 0 2023-12-12T11:51:41.402 INFO:tasks.workunit.client.1.smithi093.stdout:4/362: getdents d0/d36/d61 0 2023-12-12T11:51:41.402 INFO:tasks.workunit.client.1.smithi093.stdout:4/363: chown d0/d36/f4c 244498004 1 2023-12-12T11:51:41.402 INFO:tasks.workunit.client.1.smithi093.stdout:4/364: truncate d0/d36/d40/f57 349045 0 2023-12-12T11:51:41.405 INFO:tasks.workunit.client.1.smithi093.stdout:5/156: creat d0/d7/d8/f37 x:0 0 0 2023-12-12T11:51:41.407 INFO:tasks.workunit.client.1.smithi093.stdout:3/229: getdents df/d36/d3d/d42 0 2023-12-12T11:51:41.410 INFO:tasks.workunit.client.1.smithi093.stdout:7/173: dwrite da/de/f10 [0,4194304] 0 2023-12-12T11:51:41.411 INFO:tasks.workunit.client.1.smithi093.stdout:9/148: rmdir d1/d12 39 2023-12-12T11:51:41.415 INFO:tasks.workunit.client.1.smithi093.stdout:6/323: mkdir d0/d7b 0 2023-12-12T11:51:41.415 INFO:tasks.workunit.client.1.smithi093.stdout:6/324: chown d0/da/d14/d38/d43 69 1 2023-12-12T11:51:41.417 INFO:tasks.workunit.client.1.smithi093.stdout:4/365: creat d0/d36/d68/f74 x:0 0 0 2023-12-12T11:51:41.417 INFO:tasks.workunit.client.1.smithi093.stdout:4/366: creat d0/d36/f75 x:0 0 0 2023-12-12T11:51:41.417 INFO:tasks.workunit.client.1.smithi093.stdout:4/367: write d0/f1f [2342250,91804] 0 2023-12-12T11:51:41.420 INFO:tasks.workunit.client.1.smithi093.stdout:3/230: link df/c1b df/d36/c4e 0 2023-12-12T11:51:41.422 INFO:tasks.workunit.client.1.smithi093.stdout:1/214: dwrite d4/dc/f10 [0,4194304] 0 2023-12-12T11:51:41.424 INFO:tasks.workunit.client.1.smithi093.stdout:0/202: truncate d5/d21/d2f/f3e 605629 0 2023-12-12T11:51:41.424 INFO:tasks.workunit.client.1.smithi093.stdout:9/149: creat d1/f2f x:0 0 0 2023-12-12T11:51:41.425 INFO:tasks.workunit.client.1.smithi093.stdout:6/325: symlink d0/d52/l7c 0 2023-12-12T11:51:41.430 INFO:tasks.workunit.client.1.smithi093.stdout:3/231: mknod df/d30/d33/c4f 0 2023-12-12T11:51:41.431 INFO:tasks.workunit.client.1.smithi093.stdout:4/368: dread d0/f14 [0,4194304] 0 2023-12-12T11:51:41.444 INFO:tasks.workunit.client.1.smithi093.stdout:1/215: symlink d4/d1a/d1b/d26/d31/l47 0 2023-12-12T11:51:41.444 INFO:tasks.workunit.client.1.smithi093.stdout:1/216: dread - d4/f25 zero size 2023-12-12T11:51:41.447 INFO:tasks.workunit.client.1.smithi093.stdout:0/203: creat d5/f40 x:0 0 0 2023-12-12T11:51:41.447 INFO:tasks.workunit.client.1.smithi093.stdout:0/204: fdatasync d5/dd/d14/d26/f3f 0 2023-12-12T11:51:41.447 INFO:tasks.workunit.client.1.smithi093.stdout:0/205: truncate d5/dd/d33/f3c 662435 0 2023-12-12T11:51:41.447 INFO:tasks.workunit.client.1.smithi093.stdout:0/206: dread - d5/f40 zero size 2023-12-12T11:51:41.450 INFO:tasks.workunit.client.1.smithi093.stdout:5/157: write d0/d7/d8/f13 [1185436,41033] 0 2023-12-12T11:51:41.451 INFO:tasks.workunit.client.1.smithi093.stdout:3/232: truncate df/d22/f27 2883380 0 2023-12-12T11:51:41.456 INFO:tasks.workunit.client.1.smithi093.stdout:4/369: link d0/d36/d49/c5d d0/d31/d5c/c76 0 2023-12-12T11:51:41.456 INFO:tasks.workunit.client.1.smithi093.stdout:4/370: dread - d0/d31/d5c/f6b zero size 2023-12-12T11:51:41.457 INFO:tasks.workunit.client.1.smithi093.stdout:0/207: write d5/d21/d2f/f3d [461221,111008] 0 2023-12-12T11:51:41.458 INFO:tasks.workunit.client.1.smithi093.stdout:0/208: write d5/d21/d2f/f3d [946513,115358] 0 2023-12-12T11:51:41.458 INFO:tasks.workunit.client.1.smithi093.stdout:1/217: creat d4/d1a/d1b/f48 x:0 0 0 2023-12-12T11:51:41.460 INFO:tasks.workunit.client.1.smithi093.stdout:6/326: getdents d0/da/d73 0 2023-12-12T11:51:41.460 INFO:tasks.workunit.client.1.smithi093.stdout:6/327: fdatasync d0/f29 0 2023-12-12T11:51:41.460 INFO:tasks.workunit.client.1.smithi093.stdout:6/328: chown d0/da/d14/d38/l54 1448838 1 2023-12-12T11:51:41.463 INFO:tasks.workunit.client.1.smithi093.stdout:5/158: unlink d0/d7/d8/de/f2e 0 2023-12-12T11:51:41.465 INFO:tasks.workunit.client.1.smithi093.stdout:4/371: unlink d0/d31/f28 0 2023-12-12T11:51:41.467 INFO:tasks.workunit.client.1.smithi093.stdout:1/218: mknod d4/d1a/d1b/d26/d40/c49 0 2023-12-12T11:51:41.468 INFO:tasks.workunit.client.1.smithi093.stdout:3/233: write df/f19 [3058073,84690] 0 2023-12-12T11:51:41.469 INFO:tasks.workunit.client.1.smithi093.stdout:9/150: dwrite d1/d12/f1a [0,4194304] 0 2023-12-12T11:51:41.469 INFO:tasks.workunit.client.1.smithi093.stdout:6/329: creat d0/da/d73/f7d x:0 0 0 2023-12-12T11:51:41.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:40 smithi093 ceph-mon[115914]: mgrmap e23: smithi093.nbtltu(active, since 3s) 2023-12-12T11:51:41.473 INFO:tasks.workunit.client.1.smithi093.stdout:4/372: symlink d0/d36/d68/l77 0 2023-12-12T11:51:41.475 INFO:tasks.workunit.client.1.smithi093.stdout:1/219: creat d4/d1c/d2a/d2d/f4a x:0 0 0 2023-12-12T11:51:41.475 INFO:tasks.workunit.client.1.smithi093.stdout:1/220: creat d4/d1c/d2a/f4b x:0 0 0 2023-12-12T11:51:41.476 INFO:tasks.workunit.client.1.smithi093.stdout:1/221: write d4/ff [136180,9170] 0 2023-12-12T11:51:41.480 INFO:tasks.workunit.client.1.smithi093.stdout:2/294: sync 2023-12-12T11:51:41.485 INFO:tasks.workunit.client.1.smithi093.stdout:4/373: creat d0/d36/d49/f78 x:0 0 0 2023-12-12T11:51:41.485 INFO:tasks.workunit.client.1.smithi093.stdout:4/374: chown d0 88779 1 2023-12-12T11:51:41.485 INFO:tasks.workunit.client.1.smithi093.stdout:4/375: chown d0/c43 3006226 1 2023-12-12T11:51:41.495 INFO:tasks.workunit.client.1.smithi093.stdout:3/234: dread df/f2f [0,4194304] 0 2023-12-12T11:51:41.496 INFO:tasks.workunit.client.1.smithi093.stdout:3/235: write df/d30/d33/f45 [954128,11785] 0 2023-12-12T11:51:41.496 INFO:tasks.workunit.client.1.smithi093.stdout:3/236: write df/f21 [547473,43147] 0 2023-12-12T11:51:41.500 INFO:tasks.workunit.client.1.smithi093.stdout:0/209: dwrite d5/f31 [0,4194304] 0 2023-12-12T11:51:41.500 INFO:tasks.workunit.client.1.smithi093.stdout:0/210: chown d5/dd/d33/f3c 105 1 2023-12-12T11:51:41.505 INFO:tasks.workunit.client.1.smithi093.stdout:1/222: mknod d4/c4c 0 2023-12-12T11:51:41.505 INFO:tasks.workunit.client.1.smithi093.stdout:5/159: rmdir d0/d7/d8/de 39 2023-12-12T11:51:41.507 INFO:tasks.workunit.client.1.smithi093.stdout:9/151: dwrite d1/d12/d1f/f20 [0,4194304] 0 2023-12-12T11:51:41.509 INFO:tasks.workunit.client.1.smithi093.stdout:6/330: rename d0/d19 to d0/d52/d7e 0 2023-12-12T11:51:41.510 INFO:tasks.workunit.client.1.smithi093.stdout:6/331: write d0/d52/d7e/d42/f53 [1415640,2060] 0 2023-12-12T11:51:41.531 INFO:tasks.workunit.client.1.smithi093.stdout:9/152: symlink d1/d23/l30 0 2023-12-12T11:51:41.533 INFO:tasks.workunit.client.1.smithi093.stdout:2/295: rename d5/c43 to d5/d46/c5f 0 2023-12-12T11:51:41.537 INFO:tasks.workunit.client.1.smithi093.stdout:9/153: link d1/d23/d24/f2e d1/d23/f31 0 2023-12-12T11:51:41.537 INFO:tasks.workunit.client.1.smithi093.stdout:9/154: truncate d1/d23/d24/f2e 124089 0 2023-12-12T11:51:41.538 INFO:tasks.workunit.client.1.smithi093.stdout:1/223: dread d4/dc/f17 [0,4194304] 0 2023-12-12T11:51:41.542 INFO:tasks.workunit.client.1.smithi093.stdout:9/155: mkdir d1/d12/d1f/d32 0 2023-12-12T11:51:41.550 INFO:tasks.workunit.client.1.smithi093.stdout:9/156: symlink d1/d23/l33 0 2023-12-12T11:51:41.550 INFO:tasks.workunit.client.1.smithi093.stdout:1/224: getdents d4/dc 0 2023-12-12T11:51:41.550 INFO:tasks.workunit.client.1.smithi093.stdout:1/225: truncate d4/d1a/d1b/f3a 915775 0 2023-12-12T11:51:41.550 INFO:tasks.workunit.client.1.smithi093.stdout:5/160: rename d0/d7/d19 to d0/d7/d36/d38 0 2023-12-12T11:51:41.550 INFO:tasks.workunit.client.1.smithi093.stdout:5/161: fdatasync d0/d7/d36/d38/f34 0 2023-12-12T11:51:41.551 INFO:tasks.workunit.client.1.smithi093.stdout:8/200: sync 2023-12-12T11:51:41.552 INFO:tasks.workunit.client.1.smithi093.stdout:9/157: unlink d1/d12/d1f/f28 0 2023-12-12T11:51:41.554 INFO:tasks.workunit.client.1.smithi093.stdout:1/226: creat d4/d1a/d1b/d26/f4d x:0 0 0 2023-12-12T11:51:41.554 INFO:tasks.workunit.client.1.smithi093.stdout:1/227: fdatasync d4/dc/f17 0 2023-12-12T11:51:41.555 INFO:tasks.workunit.client.1.smithi093.stdout:5/162: creat d0/d7/d36/d38/f39 x:0 0 0 2023-12-12T11:51:41.558 INFO:tasks.workunit.client.1.smithi093.stdout:8/201: dread d3/d1a/d1f/f2a [0,4194304] 0 2023-12-12T11:51:41.558 INFO:tasks.workunit.client.1.smithi093.stdout:9/158: unlink d1/d23/l33 0 2023-12-12T11:51:41.558 INFO:tasks.workunit.client.1.smithi093.stdout:8/202: chown d3/d8/l14 77175830 1 2023-12-12T11:51:41.560 INFO:tasks.workunit.client.1.smithi093.stdout:1/228: symlink d4/d1a/d1b/d26/d31/l4e 0 2023-12-12T11:51:41.560 INFO:tasks.workunit.client.1.smithi093.stdout:1/229: chown d4/d1a/d1b/d26/d31/f38 14 1 2023-12-12T11:51:41.561 INFO:tasks.workunit.client.1.smithi093.stdout:5/163: creat d0/d7/d8/de/f3a x:0 0 0 2023-12-12T11:51:41.563 INFO:tasks.workunit.client.1.smithi093.stdout:8/203: mknod d3/c3c 0 2023-12-12T11:51:41.563 INFO:tasks.workunit.client.1.smithi093.stdout:8/204: dread - d3/d1a/d1f/d29/f32 zero size 2023-12-12T11:51:41.565 INFO:tasks.workunit.client.1.smithi093.stdout:1/230: symlink d4/d1a/l4f 0 2023-12-12T11:51:41.565 INFO:tasks.workunit.client.1.smithi093.stdout:1/231: chown d4/c44 4102 1 2023-12-12T11:51:41.566 INFO:tasks.workunit.client.1.smithi093.stdout:4/376: dwrite d0/f1 [0,4194304] 0 2023-12-12T11:51:41.566 INFO:tasks.workunit.client.1.smithi093.stdout:0/211: dwrite d5/dd/d14/f18 [0,4194304] 0 2023-12-12T11:51:41.566 INFO:tasks.workunit.client.1.smithi093.stdout:6/332: dread d0/da/f20 [4194304,4194304] 0 2023-12-12T11:51:41.566 INFO:tasks.workunit.client.1.smithi093.stdout:0/212: write d5/dd/d14/f37 [849448,57935] 0 2023-12-12T11:51:41.566 INFO:tasks.workunit.client.1.smithi093.stdout:0/213: dread - d5/dd/d14/d26/f3f zero size 2023-12-12T11:51:41.566 INFO:tasks.workunit.client.1.smithi093.stdout:0/214: chown d5/d21/l38 53105 1 2023-12-12T11:51:41.566 INFO:tasks.workunit.client.1.smithi093.stdout:0/215: fsync d5/dd/d33/f3c 0 2023-12-12T11:51:41.579 INFO:tasks.workunit.client.1.smithi093.stdout:5/164: dread d0/d7/d8/de/f28 [0,4194304] 0 2023-12-12T11:51:41.580 INFO:tasks.workunit.client.1.smithi093.stdout:5/165: dread - d0/d7/d36/d38/f34 zero size 2023-12-12T11:51:41.587 INFO:tasks.workunit.client.1.smithi093.stdout:4/377: mkdir d0/d36/d68/d79 0 2023-12-12T11:51:41.589 INFO:tasks.workunit.client.1.smithi093.stdout:1/232: getdents d4/d1a/d1b/d26/d31 0 2023-12-12T11:51:41.589 INFO:tasks.workunit.client.1.smithi093.stdout:1/233: chown d4/l12 65765 1 2023-12-12T11:51:41.589 INFO:tasks.workunit.client.1.smithi093.stdout:1/234: stat d4/f3e 0 2023-12-12T11:51:41.589 INFO:tasks.workunit.client.1.smithi093.stdout:8/205: getdents d3/d1a/d1f/d29 0 2023-12-12T11:51:41.589 INFO:tasks.workunit.client.1.smithi093.stdout:8/206: dread - d3/d1a/d1f/f2f zero size 2023-12-12T11:51:41.591 INFO:tasks.workunit.client.1.smithi093.stdout:6/333: write d0/d52/d7e/f3f [2523189,25882] 0 2023-12-12T11:51:41.592 INFO:tasks.workunit.client.1.smithi093.stdout:2/296: dwrite d5/f3a [4194304,4194304] 0 2023-12-12T11:51:41.593 INFO:tasks.workunit.client.1.smithi093.stdout:0/216: mkdir d5/d41 0 2023-12-12T11:51:41.595 INFO:tasks.workunit.client.1.smithi093.stdout:1/235: dread d4/dc/f18 [0,4194304] 0 2023-12-12T11:51:41.595 INFO:tasks.workunit.client.1.smithi093.stdout:1/236: fsync d4/d1c/d2a/d2d/f4a 0 2023-12-12T11:51:41.595 INFO:tasks.workunit.client.1.smithi093.stdout:1/237: creat d4/d1c/d2a/d2d/f50 x:0 0 0 2023-12-12T11:51:41.595 INFO:tasks.workunit.client.1.smithi093.stdout:1/238: rename d4/d1c to d4/d1c/d2a/d2d/d51 22 2023-12-12T11:51:41.596 INFO:tasks.workunit.client.1.smithi093.stdout:8/207: unlink d3/d8/f12 0 2023-12-12T11:51:41.599 INFO:tasks.workunit.client.1.smithi093.stdout:6/334: creat d0/d7b/f7f x:0 0 0 2023-12-12T11:51:41.603 INFO:tasks.workunit.client.1.smithi093.stdout:0/217: creat d5/d21/d27/f42 x:0 0 0 2023-12-12T11:51:41.603 INFO:tasks.workunit.client.1.smithi093.stdout:7/174: sync 2023-12-12T11:51:41.603 INFO:tasks.workunit.client.1.smithi093.stdout:7/175: fdatasync da/f29 0 2023-12-12T11:51:41.611 INFO:tasks.workunit.client.1.smithi093.stdout:8/208: link d3/d8/f19 d3/d1a/d1f/f3d 0 2023-12-12T11:51:41.614 INFO:tasks.workunit.client.1.smithi093.stdout:0/218: link d5/d21/l38 d5/dd/d14/d26/l43 0 2023-12-12T11:51:41.617 INFO:tasks.workunit.client.1.smithi093.stdout:1/239: rmdir d4/d1a/d1b/d26 39 2023-12-12T11:51:41.617 INFO:tasks.workunit.client.1.smithi093.stdout:1/240: chown d4/dc/f41 1 1 2023-12-12T11:51:41.617 INFO:tasks.workunit.client.1.smithi093.stdout:6/335: dread d0/da/d14/f7a [0,4194304] 0 2023-12-12T11:51:41.618 INFO:tasks.workunit.client.1.smithi093.stdout:1/241: creat d4/f52 x:0 0 0 2023-12-12T11:51:41.618 INFO:tasks.workunit.client.1.smithi093.stdout:1/242: rename d4 to d4/d1a/d1b/d26/d53 22 2023-12-12T11:51:41.618 INFO:tasks.workunit.client.1.smithi093.stdout:1/243: truncate d4/d1c/d2a/f2c 982979 0 2023-12-12T11:51:41.618 INFO:tasks.workunit.client.1.smithi093.stdout:1/244: write d4/d1c/f43 [359244,119747] 0 2023-12-12T11:51:41.618 INFO:tasks.workunit.client.1.smithi093.stdout:7/176: dread da/f1d [4194304,4194304] 0 2023-12-12T11:51:41.619 INFO:tasks.workunit.client.1.smithi093.stdout:7/177: chown da/d15/f2c 33519339 1 2023-12-12T11:51:41.619 INFO:tasks.workunit.client.1.smithi093.stdout:7/178: creat da/de/f3b x:0 0 0 2023-12-12T11:51:41.621 INFO:tasks.workunit.client.1.smithi093.stdout:8/209: mknod d3/d1a/d1f/d29/c3e 0 2023-12-12T11:51:41.621 INFO:tasks.workunit.client.1.smithi093.stdout:8/210: creat d3/d1a/d1f/f3f x:0 0 0 2023-12-12T11:51:41.622 INFO:tasks.workunit.client.1.smithi093.stdout:0/219: mknod d5/d41/c44 0 2023-12-12T11:51:41.635 INFO:tasks.workunit.client.1.smithi093.stdout:4/378: dwrite d0/fe [0,4194304] 0 2023-12-12T11:51:41.635 INFO:tasks.workunit.client.1.smithi093.stdout:4/379: creat d0/d31/d5c/f7a x:0 0 0 2023-12-12T11:51:41.635 INFO:tasks.workunit.client.1.smithi093.stdout:4/380: read - d0/d31/f5a zero size 2023-12-12T11:51:41.638 INFO:tasks.workunit.client.1.smithi093.stdout:7/179: creat da/d15/d2d/f3c x:0 0 0 2023-12-12T11:51:41.638 INFO:tasks.workunit.client.1.smithi093.stdout:7/180: chown l2 221792 1 2023-12-12T11:51:41.638 INFO:tasks.workunit.client.1.smithi093.stdout:8/211: rmdir d3/d1a/d1f/d29 39 2023-12-12T11:51:41.639 INFO:tasks.workunit.client.1.smithi093.stdout:0/220: mknod d5/d21/d27/d3a/c45 0 2023-12-12T11:51:41.639 INFO:tasks.workunit.client.1.smithi093.stdout:0/221: chown d5/fa 206528 1 2023-12-12T11:51:41.644 INFO:tasks.workunit.client.1.smithi093.stdout:0/222: rmdir d5/d21/d2f 39 2023-12-12T11:51:41.644 INFO:tasks.workunit.client.1.smithi093.stdout:0/223: chown d5/dd/d33/f3c 3109952 1 2023-12-12T11:51:41.644 INFO:tasks.workunit.client.1.smithi093.stdout:0/224: creat d5/dd/d33/f46 x:0 0 0 2023-12-12T11:51:41.644 INFO:tasks.workunit.client.1.smithi093.stdout:0/225: chown d5/d21/d27/d3a/c45 51 1 2023-12-12T11:51:41.652 INFO:tasks.workunit.client.1.smithi093.stdout:0/226: chown d5/c8 328536411 1 2023-12-12T11:51:41.679 INFO:tasks.workunit.client.1.smithi093.stdout:8/212: dwrite d3/d1a/d1f/f3d [4194304,4194304] 0 2023-12-12T11:51:41.682 INFO:tasks.workunit.client.1.smithi093.stdout:8/213: mkdir d3/d1a/d1f/d29/d3a/d40 0 2023-12-12T11:51:41.684 INFO:tasks.workunit.client.1.smithi093.stdout:8/214: symlink d3/d8/l41 0 2023-12-12T11:51:41.690 INFO:tasks.workunit.client.1.smithi093.stdout:4/381: dread d0/d36/f59 [0,4194304] 0 2023-12-12T11:51:41.691 INFO:tasks.workunit.client.1.smithi093.stdout:4/382: write d0/d36/d49/f4a [802672,109979] 0 2023-12-12T11:51:41.693 INFO:tasks.workunit.client.1.smithi093.stdout:1/245: dwrite d4/dc/f33 [0,4194304] 0 2023-12-12T11:51:41.697 INFO:tasks.workunit.client.1.smithi093.stdout:4/383: unlink d0/d31/d5c/d66/l5b 0 2023-12-12T11:51:41.697 INFO:tasks.workunit.client.1.smithi093.stdout:4/384: chown d0/d36/c3f 91791 1 2023-12-12T11:51:41.697 INFO:tasks.workunit.client.1.smithi093.stdout:4/385: write d0/d36/f50 [822720,86814] 0 2023-12-12T11:51:41.704 INFO:tasks.workunit.client.1.smithi093.stdout:8/215: write d3/d1a/f25 [934869,16668] 0 2023-12-12T11:51:41.704 INFO:tasks.workunit.client.1.smithi093.stdout:8/216: write d3/d8/f39 [710406,107629] 0 2023-12-12T11:51:41.704 INFO:tasks.workunit.client.1.smithi093.stdout:8/217: write d3/f36 [873137,68638] 0 2023-12-12T11:51:41.704 INFO:tasks.workunit.client.1.smithi093.stdout:8/218: write d3/d1a/d1f/f3f [677495,56807] 0 2023-12-12T11:51:41.704 INFO:tasks.workunit.client.1.smithi093.stdout:8/219: creat d3/f42 x:0 0 0 2023-12-12T11:51:41.705 INFO:tasks.workunit.client.1.smithi093.stdout:1/246: rename l2 to d4/d1a/d1b/l54 0 2023-12-12T11:51:41.706 INFO:tasks.workunit.client.1.smithi093.stdout:0/227: dwrite d5/dd/f1d [0,4194304] 0 2023-12-12T11:51:41.706 INFO:tasks.workunit.client.1.smithi093.stdout:0/228: truncate d5/dd/d14/f37 1478724 0 2023-12-12T11:51:41.708 INFO:tasks.workunit.client.1.smithi093.stdout:7/181: dwrite da/d15/d2d/f3c [0,4194304] 0 2023-12-12T11:51:41.708 INFO:tasks.workunit.client.1.smithi093.stdout:7/182: dread - da/de/f30 zero size 2023-12-12T11:51:41.712 INFO:tasks.workunit.client.1.smithi093.stdout:4/386: write d0/f1 [3678453,30797] 0 2023-12-12T11:51:41.712 INFO:tasks.workunit.client.1.smithi093.stdout:4/387: write d0/d36/f50 [1575492,96303] 0 2023-12-12T11:51:41.715 INFO:tasks.workunit.client.1.smithi093.stdout:8/220: creat d3/d1a/d1f/d29/f43 x:0 0 0 2023-12-12T11:51:41.727 INFO:tasks.workunit.client.1.smithi093.stdout:7/183: creat da/d15/d2d/d2f/f3d x:0 0 0 2023-12-12T11:51:41.727 INFO:tasks.workunit.client.1.smithi093.stdout:7/184: truncate da/d15/d19/f21 66309 0 2023-12-12T11:51:41.727 INFO:tasks.workunit.client.1.smithi093.stdout:7/185: fdatasync da/fb 0 2023-12-12T11:51:41.728 INFO:tasks.workunit.client.1.smithi093.stdout:7/186: chown da/d2e 7699384 1 2023-12-12T11:51:41.728 INFO:tasks.workunit.client.1.smithi093.stdout:7/187: stat da/d15/d19/f2b 0 2023-12-12T11:51:41.729 INFO:tasks.workunit.client.1.smithi093.stdout:4/388: mknod d0/d36/d61/c7b 0 2023-12-12T11:51:41.732 INFO:tasks.workunit.client.1.smithi093.stdout:7/188: rename da/f20 to da/de/f3e 0 2023-12-12T11:51:41.732 INFO:tasks.workunit.client.1.smithi093.stdout:7/189: chown da/d2e 119088665 1 2023-12-12T11:51:41.735 INFO:tasks.workunit.client.1.smithi093.stdout:1/247: dwrite d4/dc/f41 [0,4194304] 0 2023-12-12T11:51:41.735 INFO:tasks.workunit.client.1.smithi093.stdout:4/389: creat d0/d31/f7c x:0 0 0 2023-12-12T11:51:41.735 INFO:tasks.workunit.client.1.smithi093.stdout:4/390: stat d0/l21 0 2023-12-12T11:51:41.737 INFO:tasks.workunit.client.1.smithi093.stdout:8/221: dread d3/d8/f23 [0,4194304] 0 2023-12-12T11:51:41.737 INFO:tasks.workunit.client.1.smithi093.stdout:8/222: creat d3/d1a/f44 x:0 0 0 2023-12-12T11:51:41.744 INFO:tasks.workunit.client.1.smithi093.stdout:1/248: symlink d4/d1a/l55 0 2023-12-12T11:51:41.746 INFO:tasks.workunit.client.1.smithi093.stdout:4/391: rename d0/d36/d68 to d0/d31/d5c/d7d 0 2023-12-12T11:51:41.747 INFO:tasks.workunit.client.1.smithi093.stdout:4/392: dread - d0/d31/f5a zero size 2023-12-12T11:51:41.749 INFO:tasks.workunit.client.1.smithi093.stdout:7/190: dread da/d15/d2d/f3c [0,4194304] 0 2023-12-12T11:51:41.749 INFO:tasks.workunit.client.1.smithi093.stdout:0/229: dwrite d5/f24 [0,4194304] 0 2023-12-12T11:51:41.751 INFO:tasks.workunit.client.0.smithi063.stdout:4/41: sync 2023-12-12T11:51:41.751 INFO:tasks.workunit.client.0.smithi063.stdout:6/47: sync 2023-12-12T11:51:41.752 INFO:tasks.workunit.client.0.smithi063.stdout:3/38: sync 2023-12-12T11:51:41.752 INFO:tasks.workunit.client.0.smithi063.stdout:7/13: sync 2023-12-12T11:51:41.752 INFO:tasks.workunit.client.0.smithi063.stdout:7/14: read - no filename 2023-12-12T11:51:41.752 INFO:tasks.workunit.client.0.smithi063.stdout:1/32: sync 2023-12-12T11:51:41.752 INFO:tasks.workunit.client.0.smithi063.stdout:4/42: write d2/d8/fe [177629,7312] 0 2023-12-12T11:51:41.752 INFO:tasks.workunit.client.0.smithi063.stdout:0/3: sync 2023-12-12T11:51:41.752 INFO:tasks.workunit.client.0.smithi063.stdout:0/4: dread - no filename 2023-12-12T11:51:41.752 INFO:tasks.workunit.client.0.smithi063.stdout:0/5: dread - no filename 2023-12-12T11:51:41.753 INFO:tasks.workunit.client.0.smithi063.stdout:4/43: readlink l1 0 2023-12-12T11:51:41.753 INFO:tasks.workunit.client.0.smithi063.stdout:3/39: write d4/f6 [8398499,53338] 0 2023-12-12T11:51:41.753 INFO:tasks.workunit.client.0.smithi063.stdout:0/6: chown . 386328 1 2023-12-12T11:51:41.753 INFO:tasks.workunit.client.0.smithi063.stdout:5/78: sync 2023-12-12T11:51:41.753 INFO:tasks.workunit.client.0.smithi063.stdout:0/7: getdents . 0 2023-12-12T11:51:41.753 INFO:tasks.workunit.client.0.smithi063.stdout:0/8: write - no filename 2023-12-12T11:51:41.753 INFO:tasks.workunit.client.0.smithi063.stdout:0/9: dwrite - no filename 2023-12-12T11:51:41.753 INFO:tasks.workunit.client.0.smithi063.stdout:5/79: dread - d7/f15 zero size 2023-12-12T11:51:41.753 INFO:tasks.workunit.client.0.smithi063.stdout:0/10: write - no filename 2023-12-12T11:51:41.753 INFO:tasks.workunit.client.0.smithi063.stdout:8/117: sync 2023-12-12T11:51:41.753 INFO:tasks.workunit.client.0.smithi063.stdout:9/17: sync 2023-12-12T11:51:41.754 INFO:tasks.workunit.client.0.smithi063.stdout:2/24: sync 2023-12-12T11:51:41.754 INFO:tasks.workunit.client.1.smithi093.stdout:9/159: sync 2023-12-12T11:51:41.754 INFO:tasks.workunit.client.1.smithi093.stdout:3/237: sync 2023-12-12T11:51:41.754 INFO:tasks.workunit.client.1.smithi093.stdout:3/238: chown df/f1c 45722 1 2023-12-12T11:51:41.754 INFO:tasks.workunit.client.1.smithi093.stdout:7/191: mknod da/d15/d2d/d2f/c3f 0 2023-12-12T11:51:41.755 INFO:tasks.workunit.client.1.smithi093.stdout:8/223: dread d3/d1a/d1f/f3d [0,4194304] 0 2023-12-12T11:51:41.756 INFO:tasks.workunit.client.1.smithi093.stdout:0/230: dread d5/d21/d2f/f3e [0,4194304] 0 2023-12-12T11:51:41.756 INFO:tasks.workunit.client.1.smithi093.stdout:0/231: truncate d5/dd/d14/d26/f3f 1036077 0 2023-12-12T11:51:41.759 INFO:tasks.workunit.client.1.smithi093.stdout:1/249: read d4/f8 [1766731,38819] 0 2023-12-12T11:51:41.760 INFO:tasks.workunit.client.0.smithi063.stdout:6/48: truncate f5 115796 0 2023-12-12T11:51:41.760 INFO:tasks.workunit.client.0.smithi063.stdout:7/15: symlink l3 0 2023-12-12T11:51:41.761 INFO:tasks.workunit.client.0.smithi063.stdout:3/40: dread d4/f7 [0,4194304] 0 2023-12-12T11:51:41.763 INFO:tasks.workunit.client.0.smithi063.stdout:1/33: creat d3/f7 x:0 0 0 2023-12-12T11:51:41.765 INFO:tasks.workunit.client.0.smithi063.stdout:4/44: rmdir d2/d8/d14/d16 0 2023-12-12T11:51:41.769 INFO:tasks.workunit.client.0.smithi063.stdout:0/11: mkdir d0 0 2023-12-12T11:51:41.773 INFO:tasks.workunit.client.1.smithi093.stdout:7/192: mknod da/d15/c40 0 2023-12-12T11:51:41.773 INFO:tasks.workunit.client.1.smithi093.stdout:8/224: symlink d3/d1a/d1f/d29/d30/l45 0 2023-12-12T11:51:41.773 INFO:tasks.workunit.client.1.smithi093.stdout:0/232: symlink d5/dd/d14/d26/l47 0 2023-12-12T11:51:41.773 INFO:tasks.workunit.client.1.smithi093.stdout:0/233: write d5/dd/f1a [1218286,89723] 0 2023-12-12T11:51:41.773 INFO:tasks.workunit.client.1.smithi093.stdout:3/239: dread df/f21 [0,4194304] 0 2023-12-12T11:51:41.773 INFO:tasks.workunit.client.1.smithi093.stdout:3/240: fsync df/d30/d33/f45 0 2023-12-12T11:51:41.773 INFO:tasks.workunit.client.1.smithi093.stdout:3/241: fsync df/f1c 0 2023-12-12T11:51:41.774 INFO:tasks.workunit.client.0.smithi063.stdout:8/118: rename d4/lb to d4/de/d1e/l21 0 2023-12-12T11:51:41.774 INFO:tasks.workunit.client.1.smithi093.stdout:4/393: dread d0/d31/f51 [0,4194304] 0 2023-12-12T11:51:41.775 INFO:tasks.workunit.client.1.smithi093.stdout:1/250: mknod d4/d1a/d1b/d26/c56 0 2023-12-12T11:51:41.775 INFO:tasks.workunit.client.1.smithi093.stdout:1/251: getdents d4/d1a/d1b/d26/d31 0 2023-12-12T11:51:41.777 INFO:tasks.workunit.client.0.smithi063.stdout:9/18: truncate f0 2823699 0 2023-12-12T11:51:41.777 INFO:tasks.workunit.client.0.smithi063.stdout:9/19: stat c2 0 2023-12-12T11:51:41.777 INFO:tasks.workunit.client.1.smithi093.stdout:6/336: sync 2023-12-12T11:51:41.777 INFO:tasks.workunit.client.1.smithi093.stdout:2/297: sync 2023-12-12T11:51:41.777 INFO:tasks.workunit.client.1.smithi093.stdout:5/166: sync 2023-12-12T11:51:41.778 INFO:tasks.workunit.client.1.smithi093.stdout:6/337: dread - d0/da/d14/f55 zero size 2023-12-12T11:51:41.778 INFO:tasks.workunit.client.1.smithi093.stdout:6/338: creat d0/da/d14/f80 x:0 0 0 2023-12-12T11:51:41.778 INFO:tasks.workunit.client.1.smithi093.stdout:6/339: truncate d0/f11 1649021 0 2023-12-12T11:51:41.781 INFO:tasks.workunit.client.0.smithi063.stdout:2/25: symlink d0/l7 0 2023-12-12T11:51:41.784 INFO:tasks.workunit.client.1.smithi093.stdout:8/225: write d3/d1a/d1f/f3d [1308177,86261] 0 2023-12-12T11:51:41.788 INFO:tasks.workunit.client.1.smithi093.stdout:3/242: unlink df/l14 0 2023-12-12T11:51:41.788 INFO:tasks.workunit.client.1.smithi093.stdout:3/243: chown df/d36/d3d/d42 339881202 1 2023-12-12T11:51:41.788 INFO:tasks.workunit.client.1.smithi093.stdout:0/234: creat d5/d21/d27/d3a/f48 x:0 0 0 2023-12-12T11:51:41.789 INFO:tasks.workunit.client.0.smithi063.stdout:3/41: read d4/f6 [3216955,95854] 0 2023-12-12T11:51:41.790 INFO:tasks.workunit.client.1.smithi093.stdout:9/160: dwrite d1/d12/d1f/f20 [0,4194304] 0 2023-12-12T11:51:41.790 INFO:tasks.workunit.client.1.smithi093.stdout:4/394: rename d0/d31/f5a to d0/d36/d49/f7e 0 2023-12-12T11:51:41.790 INFO:tasks.workunit.client.1.smithi093.stdout:4/395: fsync d0/fe 0 2023-12-12T11:51:41.792 INFO:tasks.workunit.client.0.smithi063.stdout:7/16: creat f4 x:0 0 0 2023-12-12T11:51:41.792 INFO:tasks.workunit.client.0.smithi063.stdout:7/17: chown l3 1 1 2023-12-12T11:51:41.792 INFO:tasks.workunit.client.1.smithi093.stdout:1/252: mknod d4/d1c/c57 0 2023-12-12T11:51:41.793 INFO:tasks.workunit.client.1.smithi093.stdout:7/193: dread da/f1d [0,4194304] 0 2023-12-12T11:51:41.795 INFO:tasks.workunit.client.1.smithi093.stdout:3/244: dread df/d22/f23 [0,4194304] 0 2023-12-12T11:51:41.797 INFO:tasks.workunit.client.1.smithi093.stdout:5/167: mkdir d0/d3b 0 2023-12-12T11:51:41.797 INFO:tasks.workunit.client.1.smithi093.stdout:5/168: chown d0/d7/d27/d35 152589195 1 2023-12-12T11:51:41.797 INFO:tasks.workunit.client.1.smithi093.stdout:5/169: write d0/d7/d8/f37 [780649,4113] 0 2023-12-12T11:51:41.798 INFO:tasks.workunit.client.0.smithi063.stdout:4/45: creat d2/d8/d14/f18 x:0 0 0 2023-12-12T11:51:41.798 INFO:tasks.workunit.client.0.smithi063.stdout:4/46: truncate d2/d8/fe 756392 0 2023-12-12T11:51:41.798 INFO:tasks.workunit.client.0.smithi063.stdout:4/47: chown d2/d8/fa 227243211 1 2023-12-12T11:51:41.798 INFO:tasks.workunit.client.0.smithi063.stdout:4/48: chown d2/d8 0 1 2023-12-12T11:51:41.798 INFO:tasks.workunit.client.0.smithi063.stdout:5/80: getdents d7 0 2023-12-12T11:51:41.798 INFO:tasks.workunit.client.0.smithi063.stdout:5/81: truncate d7/d10/f14 984511 0 2023-12-12T11:51:41.799 INFO:tasks.workunit.client.1.smithi093.stdout:8/226: symlink d3/d1a/d1f/d29/d3a/l46 0 2023-12-12T11:51:41.802 INFO:tasks.workunit.client.0.smithi063.stdout:0/12: symlink d0/l1 0 2023-12-12T11:51:41.802 INFO:tasks.workunit.client.0.smithi063.stdout:1/34: rename c0 to d3/c8 0 2023-12-12T11:51:41.802 INFO:tasks.workunit.client.0.smithi063.stdout:1/35: creat d3/f9 x:0 0 0 2023-12-12T11:51:41.803 INFO:tasks.workunit.client.1.smithi093.stdout:0/235: mknod d5/dd/d33/c49 0 2023-12-12T11:51:41.803 INFO:tasks.workunit.client.1.smithi093.stdout:0/236: chown d5/c23 1146693 1 2023-12-12T11:51:41.803 INFO:tasks.workunit.client.1.smithi093.stdout:0/237: fdatasync d5/dd/f16 0 2023-12-12T11:51:41.803 INFO:tasks.workunit.client.1.smithi093.stdout:0/238: write d5/fa [1587657,24687] 0 2023-12-12T11:51:41.803 INFO:tasks.workunit.client.1.smithi093.stdout:0/239: write d5/f13 [5719057,112327] 0 2023-12-12T11:51:41.803 INFO:tasks.workunit.client.1.smithi093.stdout:0/240: creat d5/d21/d27/d3a/f4a x:0 0 0 2023-12-12T11:51:41.812 INFO:tasks.workunit.client.0.smithi063.stdout:9/20: mknod c4 0 2023-12-12T11:51:41.812 INFO:tasks.workunit.client.0.smithi063.stdout:8/119: creat d4/f22 x:0 0 0 2023-12-12T11:51:41.812 INFO:tasks.workunit.client.0.smithi063.stdout:3/42: unlink d4/c9 0 2023-12-12T11:51:41.815 INFO:tasks.workunit.client.1.smithi093.stdout:7/194: getdents da/d15/d19 0 2023-12-12T11:51:41.815 INFO:tasks.workunit.client.1.smithi093.stdout:9/161: mknod d1/d12/d1f/c34 0 2023-12-12T11:51:41.815 INFO:tasks.workunit.client.1.smithi093.stdout:7/195: rename da/d15/d2d to da/d15/d2d/d2f/d41 22 2023-12-12T11:51:41.815 INFO:tasks.workunit.client.1.smithi093.stdout:9/162: truncate d1/d23/f31 753378 0 2023-12-12T11:51:41.815 INFO:tasks.workunit.client.1.smithi093.stdout:4/396: mkdir d0/d31/d5c/d7d/d79/d7f 0 2023-12-12T11:51:41.815 INFO:tasks.workunit.client.1.smithi093.stdout:9/163: creat d1/d12/d1f/f35 x:0 0 0 2023-12-12T11:51:41.816 INFO:tasks.workunit.client.0.smithi063.stdout:7/18: unlink l0 0 2023-12-12T11:51:41.819 INFO:tasks.workunit.client.1.smithi093.stdout:2/298: dread d5/d14/d2d/f1e [0,4194304] 0 2023-12-12T11:51:41.820 INFO:tasks.workunit.client.1.smithi093.stdout:5/170: symlink d0/d7/d36/d29/l3c 0 2023-12-12T11:51:41.824 INFO:tasks.workunit.client.0.smithi063.stdout:9/21: creat f5 x:0 0 0 2023-12-12T11:51:41.825 INFO:tasks.workunit.client.0.smithi063.stdout:4/49: read d2/f10 [3186566,82155] 0 2023-12-12T11:51:41.825 INFO:tasks.workunit.client.0.smithi063.stdout:4/50: dread - d2/d8/d14/f18 zero size 2023-12-12T11:51:41.835 INFO:tasks.workunit.client.0.smithi063.stdout:5/82: dread d7/f12 [0,4194304] 0 2023-12-12T11:51:41.835 INFO:tasks.workunit.client.0.smithi063.stdout:5/83: chown d7 1675 1 2023-12-12T11:51:41.835 INFO:tasks.workunit.client.0.smithi063.stdout:7/19: rename c2 to c5 0 2023-12-12T11:51:41.837 INFO:tasks.workunit.client.1.smithi093.stdout:0/241: chown d5/c1c 663812 1 2023-12-12T11:51:41.838 INFO:tasks.workunit.client.0.smithi063.stdout:4/51: write d2/f6 [41594,17943] 0 2023-12-12T11:51:41.838 INFO:tasks.workunit.client.0.smithi063.stdout:4/52: chown l1 122741735 1 2023-12-12T11:51:41.838 INFO:tasks.workunit.client.0.smithi063.stdout:4/53: chown d2/d8/c11 1846830 1 2023-12-12T11:51:41.841 INFO:tasks.workunit.client.0.smithi063.stdout:7/20: symlink l6 0 2023-12-12T11:51:41.845 INFO:tasks.workunit.client.1.smithi093.stdout:4/397: symlink d0/d36/l80 0 2023-12-12T11:51:41.847 INFO:tasks.workunit.client.0.smithi063.stdout:7/21: link l3 l7 0 2023-12-12T11:51:41.849 INFO:tasks.workunit.client.0.smithi063.stdout:2/26: dwrite d0/f6 [0,4194304] 0 2023-12-12T11:51:41.849 INFO:tasks.workunit.client.0.smithi063.stdout:6/49: dwrite f6 [0,4194304] 0 2023-12-12T11:51:41.849 INFO:tasks.workunit.client.0.smithi063.stdout:6/50: stat f6 0 2023-12-12T11:51:41.854 INFO:tasks.workunit.client.1.smithi093.stdout:9/164: symlink d1/d12/l36 0 2023-12-12T11:51:41.854 INFO:tasks.workunit.client.1.smithi093.stdout:3/245: symlink df/d25/l50 0 2023-12-12T11:51:41.855 INFO:tasks.workunit.client.1.smithi093.stdout:1/253: dwrite d4/dc/f28 [4194304,4194304] 0 2023-12-12T11:51:41.855 INFO:tasks.workunit.client.1.smithi093.stdout:1/254: chown d4/d1c/l46 512 1 2023-12-12T11:51:41.856 INFO:tasks.workunit.client.1.smithi093.stdout:2/299: truncate d5/d14/d27/f36 1574993 0 2023-12-12T11:51:41.861 INFO:tasks.workunit.client.1.smithi093.stdout:5/171: unlink d0/f9 0 2023-12-12T11:51:41.868 INFO:tasks.workunit.client.0.smithi063.stdout:7/22: fsync f4 0 2023-12-12T11:51:41.868 INFO:tasks.workunit.client.0.smithi063.stdout:7/23: creat f8 x:0 0 0 2023-12-12T11:51:41.869 INFO:tasks.workunit.client.0.smithi063.stdout:2/27: mknod d0/c8 0 2023-12-12T11:51:41.872 INFO:tasks.workunit.client.1.smithi093.stdout:7/196: dwrite da/d15/d19/f2b [0,4194304] 0 2023-12-12T11:51:41.872 INFO:tasks.workunit.client.1.smithi093.stdout:7/197: write da/d15/f26 [752832,128611] 0 2023-12-12T11:51:41.873 INFO:tasks.workunit.client.1.smithi093.stdout:0/242: truncate d5/d21/d2f/f3e 208077 0 2023-12-12T11:51:41.873 INFO:tasks.workunit.client.1.smithi093.stdout:0/243: stat d5/d21/d27/d3a/f4a 0 2023-12-12T11:51:41.873 INFO:tasks.workunit.client.1.smithi093.stdout:0/244: dread - d5/d21/d27/d3a/f48 zero size 2023-12-12T11:51:41.876 INFO:tasks.workunit.client.0.smithi063.stdout:6/51: symlink d9/d10/l12 0 2023-12-12T11:51:41.876 INFO:tasks.workunit.client.0.smithi063.stdout:6/52: chown c2 850357 1 2023-12-12T11:51:41.881 INFO:tasks.workunit.client.1.smithi093.stdout:8/227: rmdir d3/d1a/d1f 39 2023-12-12T11:51:41.886 INFO:tasks.workunit.client.1.smithi093.stdout:9/165: mknod d1/d23/c37 0 2023-12-12T11:51:41.886 INFO:tasks.workunit.client.1.smithi093.stdout:9/166: creat d1/d12/d1f/f38 x:0 0 0 2023-12-12T11:51:41.887 INFO:tasks.workunit.client.0.smithi063.stdout:8/120: fsync d4/f22 0 2023-12-12T11:51:41.887 INFO:tasks.workunit.client.0.smithi063.stdout:8/121: readlink d4/de/d1e/l1f 0 2023-12-12T11:51:41.891 INFO:tasks.workunit.client.1.smithi093.stdout:1/255: symlink d4/l58 0 2023-12-12T11:51:41.891 INFO:tasks.workunit.client.0.smithi063.stdout:9/22: write f0 [2055619,90099] 0 2023-12-12T11:51:41.891 INFO:tasks.workunit.client.0.smithi063.stdout:9/23: creat f6 x:0 0 0 2023-12-12T11:51:41.891 INFO:tasks.workunit.client.0.smithi063.stdout:9/24: read - f5 zero size 2023-12-12T11:51:41.891 INFO:tasks.workunit.client.0.smithi063.stdout:9/25: dread - f6 zero size 2023-12-12T11:51:41.891 INFO:tasks.workunit.client.0.smithi063.stdout:9/26: dread - f5 zero size 2023-12-12T11:51:41.893 INFO:tasks.workunit.client.1.smithi093.stdout:2/300: creat d5/d46/d55/f60 x:0 0 0 2023-12-12T11:51:41.897 INFO:tasks.workunit.client.1.smithi093.stdout:5/172: rename d0/d7/d36/c2b to d0/d7/d36/c3d 0 2023-12-12T11:51:41.897 INFO:tasks.workunit.client.0.smithi063.stdout:4/54: dwrite d2/f9 [0,4194304] 0 2023-12-12T11:51:41.897 INFO:tasks.workunit.client.0.smithi063.stdout:4/55: rename d2/d8 to d2/d8/d14/d19 22 2023-12-12T11:51:41.902 INFO:tasks.workunit.client.0.smithi063.stdout:7/24: dwrite f4 [0,4194304] 0 2023-12-12T11:51:41.902 INFO:tasks.workunit.client.0.smithi063.stdout:7/25: chown l3 4014 1 2023-12-12T11:51:41.902 INFO:tasks.workunit.client.0.smithi063.stdout:9/27: mkdir d7 0 2023-12-12T11:51:41.902 INFO:tasks.workunit.client.0.smithi063.stdout:1/36: rmdir d3 39 2023-12-12T11:51:41.902 INFO:tasks.workunit.client.0.smithi063.stdout:1/37: stat d3/c4 0 2023-12-12T11:51:41.909 INFO:tasks.workunit.client.1.smithi093.stdout:8/228: dread d3/d8/f18 [0,4194304] 0 2023-12-12T11:51:41.909 INFO:tasks.workunit.client.0.smithi063.stdout:4/56: rename d2/d8/d14/f18 to d2/d8/d14/f1a 0 2023-12-12T11:51:41.909 INFO:tasks.workunit.client.0.smithi063.stdout:4/57: write d2/d8/d14/f1a [480211,67619] 0 2023-12-12T11:51:41.910 INFO:tasks.workunit.client.0.smithi063.stdout:8/122: write f0 [3931890,86381] 0 2023-12-12T11:51:41.910 INFO:tasks.workunit.client.0.smithi063.stdout:8/123: creat d4/f23 x:0 0 0 2023-12-12T11:51:41.914 INFO:tasks.workunit.client.1.smithi093.stdout:7/198: creat da/d2e/f42 x:0 0 0 2023-12-12T11:51:41.917 INFO:tasks.workunit.client.0.smithi063.stdout:7/26: rename l1 to l9 0 2023-12-12T11:51:41.918 INFO:tasks.workunit.client.1.smithi093.stdout:0/245: mknod d5/d21/d27/d3a/c4b 0 2023-12-12T11:51:41.919 INFO:tasks.workunit.client.0.smithi063.stdout:9/28: creat d7/f8 x:0 0 0 2023-12-12T11:51:41.919 INFO:tasks.workunit.client.0.smithi063.stdout:9/29: read - f6 zero size 2023-12-12T11:51:41.919 INFO:tasks.workunit.client.0.smithi063.stdout:9/30: dread - f5 zero size 2023-12-12T11:51:41.920 INFO:tasks.workunit.client.1.smithi093.stdout:4/398: getdents d0/d31/d5c 0 2023-12-12T11:51:41.921 INFO:tasks.workunit.client.0.smithi063.stdout:1/38: symlink d3/la 0 2023-12-12T11:51:41.926 INFO:tasks.workunit.client.0.smithi063.stdout:8/124: rmdir d4/de 39 2023-12-12T11:51:41.930 INFO:tasks.workunit.client.1.smithi093.stdout:3/246: rmdir df 39 2023-12-12T11:51:41.932 INFO:tasks.workunit.client.0.smithi063.stdout:1/39: mkdir d3/db 0 2023-12-12T11:51:41.937 INFO:tasks.workunit.client.0.smithi063.stdout:2/28: getdents d0 0 2023-12-12T11:51:41.940 INFO:tasks.workunit.client.0.smithi063.stdout:7/27: fsync f8 0 2023-12-12T11:51:41.941 INFO:tasks.workunit.client.0.smithi063.stdout:8/125: rmdir d4/de/d11 39 2023-12-12T11:51:41.943 INFO:tasks.workunit.client.0.smithi063.stdout:5/84: write d7/f12 [4043749,4028] 0 2023-12-12T11:51:41.943 INFO:tasks.workunit.client.0.smithi063.stdout:5/85: write d7/d10/f14 [1457619,56051] 0 2023-12-12T11:51:41.943 INFO:tasks.workunit.client.1.smithi093.stdout:9/167: creat d1/d12/d1f/d32/f39 x:0 0 0 2023-12-12T11:51:41.944 INFO:tasks.workunit.client.1.smithi093.stdout:9/168: creat d1/d12/d1f/f3a x:0 0 0 2023-12-12T11:51:41.944 INFO:tasks.workunit.client.1.smithi093.stdout:9/169: creat d1/d12/d1f/d32/f3b x:0 0 0 2023-12-12T11:51:41.944 INFO:tasks.workunit.client.0.smithi063.stdout:6/53: write f5 [887669,113568] 0 2023-12-12T11:51:41.945 INFO:tasks.workunit.client.0.smithi063.stdout:1/40: rmdir d3 39 2023-12-12T11:51:41.948 INFO:tasks.workunit.client.1.smithi093.stdout:1/256: creat d4/dc/f59 x:0 0 0 2023-12-12T11:51:41.950 INFO:tasks.workunit.client.0.smithi063.stdout:2/29: mknod d0/c9 0 2023-12-12T11:51:41.951 INFO:tasks.workunit.client.1.smithi093.stdout:2/301: mkdir d5/d46/d61 0 2023-12-12T11:51:41.953 INFO:tasks.workunit.client.0.smithi063.stdout:8/126: mkdir d4/d24 0 2023-12-12T11:51:41.953 INFO:tasks.workunit.client.0.smithi063.stdout:8/127: chown d4/de 2 1 2023-12-12T11:51:41.953 INFO:tasks.workunit.client.0.smithi063.stdout:9/31: fsync f6 0 2023-12-12T11:51:41.954 INFO:tasks.workunit.client.0.smithi063.stdout:9/32: fsync f6 0 2023-12-12T11:51:41.958 INFO:tasks.workunit.client.1.smithi093.stdout:5/173: creat d0/f3e x:0 0 0 2023-12-12T11:51:41.960 INFO:tasks.workunit.client.1.smithi093.stdout:0/246: dwrite d5/dd/d14/d26/f3f [0,4194304] 0 2023-12-12T11:51:41.962 INFO:tasks.workunit.client.1.smithi093.stdout:8/229: creat d3/d1a/d1f/f47 x:0 0 0 2023-12-12T11:51:41.962 INFO:tasks.workunit.client.1.smithi093.stdout:8/230: fsync d3/f6 0 2023-12-12T11:51:41.962 INFO:tasks.workunit.client.1.smithi093.stdout:8/231: creat d3/f48 x:0 0 0 2023-12-12T11:51:41.963 INFO:tasks.workunit.client.1.smithi093.stdout:6/340: sync 2023-12-12T11:51:41.963 INFO:tasks.workunit.client.1.smithi093.stdout:6/341: dread - d0/da/d14/f80 zero size 2023-12-12T11:51:41.963 INFO:tasks.workunit.client.1.smithi093.stdout:6/342: stat d0/da/l27 0 2023-12-12T11:51:41.963 INFO:tasks.workunit.client.0.smithi063.stdout:6/54: mknod d9/c13 0 2023-12-12T11:51:41.966 INFO:tasks.workunit.client.1.smithi093.stdout:7/199: mknod da/d15/d19/c43 0 2023-12-12T11:51:41.967 INFO:tasks.workunit.client.0.smithi063.stdout:4/58: dwrite d2/d8/f12 [0,4194304] 0 2023-12-12T11:51:41.967 INFO:tasks.workunit.client.0.smithi063.stdout:4/59: truncate d2/d8/fe 938112 0 2023-12-12T11:51:41.967 INFO:tasks.workunit.client.1.smithi093.stdout:4/399: dwrite d0/f14 [0,4194304] 0 2023-12-12T11:51:41.968 INFO:tasks.workunit.client.0.smithi063.stdout:1/41: creat d3/db/fc x:0 0 0 2023-12-12T11:51:41.971 INFO:tasks.workunit.client.1.smithi093.stdout:3/247: symlink df/l51 0 2023-12-12T11:51:41.976 INFO:tasks.workunit.client.0.smithi063.stdout:2/30: symlink d0/la 0 2023-12-12T11:51:41.977 INFO:tasks.workunit.client.0.smithi063.stdout:2/31: fdatasync d0/f5 0 2023-12-12T11:51:41.977 INFO:tasks.workunit.client.0.smithi063.stdout:2/32: write d0/f4 [497829,125475] 0 2023-12-12T11:51:41.979 INFO:tasks.workunit.client.0.smithi063.stdout:8/128: mknod d4/de/d1e/c25 0 2023-12-12T11:51:41.979 INFO:tasks.workunit.client.0.smithi063.stdout:8/129: dread - d4/de/d11/f18 zero size 2023-12-12T11:51:41.979 INFO:tasks.workunit.client.0.smithi063.stdout:8/130: write d4/f23 [504212,121538] 0 2023-12-12T11:51:41.979 INFO:tasks.workunit.client.0.smithi063.stdout:8/131: write d4/de/d11/f18 [547303,104132] 0 2023-12-12T11:51:41.979 INFO:tasks.workunit.client.0.smithi063.stdout:8/132: readlink d4/de/l10 0 2023-12-12T11:51:41.980 INFO:tasks.workunit.client.0.smithi063.stdout:8/133: creat d4/de/d1e/f26 x:0 0 0 2023-12-12T11:51:41.981 INFO:tasks.workunit.client.0.smithi063.stdout:6/55: rename d9/d10/l12 to d9/d10/l14 0 2023-12-12T11:51:41.982 INFO:tasks.workunit.client.0.smithi063.stdout:6/56: write d9/fd [601123,11289] 0 2023-12-12T11:51:41.984 INFO:tasks.workunit.client.1.smithi093.stdout:9/170: mknod d1/c3c 0 2023-12-12T11:51:41.984 INFO:tasks.workunit.client.1.smithi093.stdout:9/171: chown d1/d12/d1f/f3a 1833558606 1 2023-12-12T11:51:41.984 INFO:tasks.workunit.client.1.smithi093.stdout:9/172: dread - d1/d12/d1f/f27 zero size 2023-12-12T11:51:41.988 INFO:tasks.workunit.client.0.smithi063.stdout:5/86: dread d7/d10/f14 [0,4194304] 0 2023-12-12T11:51:41.989 INFO:tasks.workunit.client.1.smithi093.stdout:4/400: read d0/d31/f29 [86371,46935] 0 2023-12-12T11:51:41.990 INFO:tasks.workunit.client.1.smithi093.stdout:4/401: write d0/fa [5425018,125462] 0 2023-12-12T11:51:41.990 INFO:tasks.workunit.client.1.smithi093.stdout:4/402: chown d0/d36/d40/f4e 678702841 1 2023-12-12T11:51:41.990 INFO:tasks.workunit.client.0.smithi063.stdout:7/28: dwrite f4 [0,4194304] 0 2023-12-12T11:51:41.990 INFO:tasks.workunit.client.0.smithi063.stdout:7/29: fsync f8 0 2023-12-12T11:51:41.991 INFO:tasks.workunit.client.0.smithi063.stdout:7/30: creat fa x:0 0 0 2023-12-12T11:51:41.991 INFO:tasks.workunit.client.0.smithi063.stdout:7/31: chown l3 3 1 2023-12-12T11:51:41.992 INFO:tasks.workunit.client.0.smithi063.stdout:7/32: chown fa 221 1 2023-12-12T11:51:41.996 INFO:tasks.workunit.client.1.smithi093.stdout:3/248: dread df/d25/d3e/f4b [0,4194304] 0 2023-12-12T11:51:41.997 INFO:tasks.workunit.client.0.smithi063.stdout:2/33: dread d0/f6 [0,4194304] 0 2023-12-12T11:51:42.001 INFO:tasks.workunit.client.1.smithi093.stdout:7/200: dwrite da/d15/f24 [0,4194304] 0 2023-12-12T11:51:42.037 INFO:tasks.workunit.client.1.smithi093.stdout:7/201: dread da/d15/f24 [0,4194304] 0 2023-12-12T11:51:42.043 INFO:tasks.workunit.client.1.smithi093.stdout:4/403: dwrite d0/f20 [0,4194304] 0 2023-12-12T11:51:42.043 INFO:tasks.workunit.client.1.smithi093.stdout:4/404: creat d0/d36/d49/f81 x:0 0 0 2023-12-12T11:51:42.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:41 smithi063 ceph-mon[107117]: [12/Dec/2023:11:51:40] ENGINE Bus STARTING 2023-12-12T11:51:42.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:41 smithi063 ceph-mon[107117]: [12/Dec/2023:11:51:40] ENGINE Serving on http://172.21.15.93:8765 2023-12-12T11:51:42.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:41 smithi063 ceph-mon[107117]: [12/Dec/2023:11:51:40] ENGINE Serving on https://172.21.15.93:7150 2023-12-12T11:51:42.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:41 smithi063 ceph-mon[107117]: [12/Dec/2023:11:51:40] ENGINE Bus STARTED 2023-12-12T11:51:42.046 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:41 smithi063 ceph-mon[107117]: pgmap v5: 65 pgs: 65 active+clean; 504 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail 2023-12-12T11:51:42.049 INFO:tasks.workunit.client.0.smithi063.stdout:7/33: dwrite f4 [0,4194304] 0 2023-12-12T11:51:42.053 INFO:tasks.workunit.client.1.smithi093.stdout:1/257: rename d4/c44 to d4/d1c/d2a/d2d/c5a 0 2023-12-12T11:51:42.053 INFO:tasks.workunit.client.1.smithi093.stdout:1/258: fsync d4/dc/f17 0 2023-12-12T11:51:42.064 INFO:tasks.workunit.client.1.smithi093.stdout:2/302: unlink d5/f3a 0 2023-12-12T11:51:42.070 INFO:tasks.workunit.client.1.smithi093.stdout:5/174: mkdir d0/d7/d36/d3f 0 2023-12-12T11:51:42.077 INFO:tasks.workunit.client.1.smithi093.stdout:7/202: dwrite da/d15/f26 [0,4194304] 0 2023-12-12T11:51:42.077 INFO:tasks.workunit.client.1.smithi093.stdout:7/203: creat da/de/f44 x:0 0 0 2023-12-12T11:51:42.081 INFO:tasks.workunit.client.1.smithi093.stdout:0/247: creat d5/d21/f4c x:0 0 0 2023-12-12T11:51:42.091 INFO:tasks.workunit.client.1.smithi093.stdout:8/232: unlink d3/d8/f37 0 2023-12-12T11:51:42.091 INFO:tasks.workunit.client.1.smithi093.stdout:8/233: write d3/d1a/d1f/f27 [443833,87137] 0 2023-12-12T11:51:42.091 INFO:tasks.workunit.client.1.smithi093.stdout:8/234: write d3/d1a/d1f/d29/f32 [712097,37136] 0 2023-12-12T11:51:42.091 INFO:tasks.workunit.client.1.smithi093.stdout:8/235: stat d3/d1a/d1f/f3d 0 2023-12-12T11:51:42.091 INFO:tasks.workunit.client.1.smithi093.stdout:8/236: chown d3/d1a 120289 1 2023-12-12T11:51:42.091 INFO:tasks.workunit.client.1.smithi093.stdout:8/237: readlink d3/lf 0 2023-12-12T11:51:42.095 INFO:tasks.workunit.client.0.smithi063.stdout:8/134: creat d4/d24/f27 x:0 0 0 2023-12-12T11:51:42.098 INFO:tasks.workunit.client.0.smithi063.stdout:8/135: truncate d4/de/f13 314560 0 2023-12-12T11:51:42.099 INFO:tasks.workunit.client.0.smithi063.stdout:6/57: creat d9/d10/f15 x:0 0 0 2023-12-12T11:51:42.100 INFO:tasks.workunit.client.1.smithi093.stdout:9/173: mkdir d1/d12/d1f/d3d 0 2023-12-12T11:51:42.103 INFO:tasks.workunit.client.0.smithi063.stdout:5/87: link d7/f13 d7/d10/f17 0 2023-12-12T11:51:42.106 INFO:tasks.workunit.client.1.smithi093.stdout:3/249: getdents df/d25 0 2023-12-12T11:51:42.133 INFO:tasks.workunit.client.1.smithi093.stdout:7/204: dwrite da/fb [4194304,4194304] 0 2023-12-12T11:51:42.137 INFO:tasks.workunit.client.1.smithi093.stdout:4/405: mkdir d0/d31/d5c/d7d/d79/d7f/d82 0 2023-12-12T11:51:42.142 INFO:tasks.workunit.client.1.smithi093.stdout:1/259: symlink d4/d1c/d2a/d2d/l5b 0 2023-12-12T11:51:42.146 INFO:tasks.workunit.client.1.smithi093.stdout:2/303: mknod d5/d14/d47/d4e/d51/c62 0 2023-12-12T11:51:42.149 INFO:tasks.workunit.client.0.smithi063.stdout:8/136: dwrite d4/d24/f27 [0,4194304] 0 2023-12-12T11:51:42.149 INFO:tasks.workunit.client.0.smithi063.stdout:8/137: chown d4/de/d11/c1c 14 1 2023-12-12T11:51:42.149 INFO:tasks.workunit.client.0.smithi063.stdout:8/138: chown d4/fd 111401 1 2023-12-12T11:51:42.160 INFO:tasks.workunit.client.1.smithi093.stdout:0/248: truncate d5/d21/f2e 625569 0 2023-12-12T11:51:42.162 INFO:tasks.workunit.client.1.smithi093.stdout:8/238: symlink d3/d1a/d1f/d29/d3a/d40/l49 0 2023-12-12T11:51:42.167 INFO:tasks.workunit.client.1.smithi093.stdout:9/174: mkdir d1/d12/d3e 0 2023-12-12T11:51:42.168 INFO:tasks.workunit.client.1.smithi093.stdout:9/175: truncate d1/d23/d24/d29/f2b 550406 0 2023-12-12T11:51:42.172 INFO:tasks.workunit.client.1.smithi093.stdout:3/250: getdents df/d36/d3d 0 2023-12-12T11:51:42.180 INFO:tasks.workunit.client.1.smithi093.stdout:7/205: creat da/d15/d19/f45 x:0 0 0 2023-12-12T11:51:42.181 INFO:tasks.workunit.client.0.smithi063.stdout:5/88: dwrite d7/f9 [0,4194304] 0 2023-12-12T11:51:42.181 INFO:tasks.workunit.client.0.smithi063.stdout:2/34: creat d0/fb x:0 0 0 2023-12-12T11:51:42.187 INFO:tasks.workunit.client.1.smithi093.stdout:4/406: mknod d0/d31/d5c/d7d/d79/d7f/c83 0 2023-12-12T11:51:42.187 INFO:tasks.workunit.client.1.smithi093.stdout:4/407: creat d0/d31/d5c/d66/f84 x:0 0 0 2023-12-12T11:51:42.191 INFO:tasks.workunit.client.1.smithi093.stdout:9/176: dread d1/d12/d1f/f25 [0,4194304] 0 2023-12-12T11:51:42.191 INFO:tasks.workunit.client.1.smithi093.stdout:9/177: fsync d1/d12/d1f/f20 0 2023-12-12T11:51:42.191 INFO:tasks.workunit.client.1.smithi093.stdout:9/178: chown d1/d23/f31 1620445 1 2023-12-12T11:51:42.192 INFO:tasks.workunit.client.1.smithi093.stdout:2/304: mkdir d5/d14/d2d/d63 0 2023-12-12T11:51:42.193 INFO:tasks.workunit.client.1.smithi093.stdout:2/305: fsync d5/d14/d2d/d12/f22 0 2023-12-12T11:51:42.193 INFO:tasks.workunit.client.1.smithi093.stdout:2/306: creat d5/d31/f64 x:0 0 0 2023-12-12T11:51:42.196 INFO:tasks.workunit.client.1.smithi093.stdout:3/251: write df/d25/f32 [1801966,123306] 0 2023-12-12T11:51:42.200 INFO:tasks.workunit.client.1.smithi093.stdout:5/175: link d0/f3e d0/d7/d36/d38/f40 0 2023-12-12T11:51:42.207 INFO:tasks.workunit.client.1.smithi093.stdout:8/239: symlink d3/d1a/d1f/d29/l4a 0 2023-12-12T11:51:42.209 INFO:tasks.workunit.client.1.smithi093.stdout:7/206: mkdir da/de/d46 0 2023-12-12T11:51:42.211 INFO:tasks.workunit.client.1.smithi093.stdout:1/260: dwrite d4/d1c/d2a/d2d/f4a [0,4194304] 0 2023-12-12T11:51:42.211 INFO:tasks.workunit.client.1.smithi093.stdout:1/261: creat d4/dc/f5c x:0 0 0 2023-12-12T11:51:42.219 INFO:tasks.workunit.client.1.smithi093.stdout:4/408: rmdir d0/d31/d5c/d7d/d79 39 2023-12-12T11:51:42.219 INFO:tasks.workunit.client.1.smithi093.stdout:4/409: fsync d0/d31/d5c/f7a 0 2023-12-12T11:51:42.225 INFO:tasks.workunit.client.1.smithi093.stdout:9/179: rename d1/d12/f19 to d1/d12/d1f/d32/f3f 0 2023-12-12T11:51:42.226 INFO:tasks.workunit.client.1.smithi093.stdout:9/180: fsync d1/d23/d24/f2e 0 2023-12-12T11:51:42.226 INFO:tasks.workunit.client.1.smithi093.stdout:9/181: fsync d1/f2f 0 2023-12-12T11:51:42.233 INFO:tasks.workunit.client.1.smithi093.stdout:9/182: dread d1/d12/f1c [0,4194304] 0 2023-12-12T11:51:42.233 INFO:tasks.workunit.client.1.smithi093.stdout:9/183: creat d1/d23/f40 x:0 0 0 2023-12-12T11:51:42.233 INFO:tasks.workunit.client.1.smithi093.stdout:9/184: truncate d1/d12/d1f/d32/f39 467658 0 2023-12-12T11:51:42.237 INFO:tasks.workunit.client.1.smithi093.stdout:2/307: dwrite d5/d14/d2d/f1c [0,4194304] 0 2023-12-12T11:51:42.240 INFO:tasks.workunit.client.1.smithi093.stdout:0/249: mkdir d5/d4d 0 2023-12-12T11:51:42.240 INFO:tasks.workunit.client.1.smithi093.stdout:8/240: symlink d3/d1a/d1f/l4b 0 2023-12-12T11:51:42.249 INFO:tasks.workunit.client.1.smithi093.stdout:3/252: dwrite df/d22/f27 [0,4194304] 0 2023-12-12T11:51:42.249 INFO:tasks.workunit.client.1.smithi093.stdout:3/253: truncate df/f2e 1481773 0 2023-12-12T11:51:42.252 INFO:tasks.workunit.client.1.smithi093.stdout:9/185: dread d1/d12/f1a [0,4194304] 0 2023-12-12T11:51:42.252 INFO:tasks.workunit.client.1.smithi093.stdout:9/186: chown d1/d12/d3e 1082 1 2023-12-12T11:51:42.254 INFO:tasks.workunit.client.1.smithi093.stdout:1/262: link d4/d1c/d2a/d2d/l3f d4/d1c/l5d 0 2023-12-12T11:51:42.257 INFO:tasks.workunit.client.1.smithi093.stdout:4/410: link d0/d36/d40/c5e d0/c85 0 2023-12-12T11:51:42.259 INFO:tasks.workunit.client.1.smithi093.stdout:6/343: sync 2023-12-12T11:51:42.259 INFO:tasks.workunit.client.1.smithi093.stdout:5/176: rename d0/d7/d8/de/c2f to d0/d7/d36/d29/c41 0 2023-12-12T11:51:42.260 INFO:tasks.workunit.client.1.smithi093.stdout:5/177: creat d0/d7/f42 x:0 0 0 2023-12-12T11:51:42.261 INFO:tasks.workunit.client.1.smithi093.stdout:0/250: dread d5/dd/f1d [0,4194304] 0 2023-12-12T11:51:42.261 INFO:tasks.workunit.client.1.smithi093.stdout:0/251: truncate d5/d21/d2f/f3e 1072290 0 2023-12-12T11:51:42.273 INFO:tasks.workunit.client.1.smithi093.stdout:9/187: dread d1/d12/d1f/f25 [0,4194304] 0 2023-12-12T11:51:42.273 INFO:tasks.workunit.client.1.smithi093.stdout:9/188: creat d1/d23/f41 x:0 0 0 2023-12-12T11:51:42.274 INFO:tasks.workunit.client.1.smithi093.stdout:6/344: write d0/f11 [1261189,503] 0 2023-12-12T11:51:42.274 INFO:tasks.workunit.client.1.smithi093.stdout:6/345: write d0/da/f20 [627358,119313] 0 2023-12-12T11:51:42.274 INFO:tasks.workunit.client.1.smithi093.stdout:6/346: stat d0/da/d14/d3a/f6a 0 2023-12-12T11:51:42.274 INFO:tasks.workunit.client.1.smithi093.stdout:6/347: fdatasync d0/da/d14/f55 0 2023-12-12T11:51:42.274 INFO:tasks.workunit.client.1.smithi093.stdout:6/348: dread - d0/d7b/f7f zero size 2023-12-12T11:51:42.275 INFO:tasks.workunit.client.1.smithi093.stdout:6/349: fdatasync d0/f29 0 2023-12-12T11:51:42.278 INFO:tasks.workunit.client.1.smithi093.stdout:4/411: read d0/f54 [2600991,1159] 0 2023-12-12T11:51:42.278 INFO:tasks.workunit.client.1.smithi093.stdout:4/412: write d0/f17 [4479721,117039] 0 2023-12-12T11:51:42.278 INFO:tasks.workunit.client.1.smithi093.stdout:8/241: mknod d3/d1a/d1f/d29/c4c 0 2023-12-12T11:51:42.278 INFO:tasks.workunit.client.1.smithi093.stdout:4/413: dread - d0/d36/d40/f4e zero size 2023-12-12T11:51:42.278 INFO:tasks.workunit.client.1.smithi093.stdout:4/414: write d0/f47 [1383669,78139] 0 2023-12-12T11:51:42.278 INFO:tasks.workunit.client.1.smithi093.stdout:4/415: chown d0/c85 46 1 2023-12-12T11:51:42.283 INFO:tasks.workunit.client.1.smithi093.stdout:3/254: mknod df/c52 0 2023-12-12T11:51:42.285 INFO:tasks.workunit.client.1.smithi093.stdout:4/416: dread d0/d36/f4c [0,4194304] 0 2023-12-12T11:51:42.285 INFO:tasks.workunit.client.1.smithi093.stdout:1/263: symlink d4/d1c/l5e 0 2023-12-12T11:51:42.285 INFO:tasks.workunit.client.1.smithi093.stdout:1/264: chown d4/d1a/d1b/f3a 16335 1 2023-12-12T11:51:42.291 INFO:tasks.workunit.client.1.smithi093.stdout:7/207: rename da/f29 to da/de/d46/f47 0 2023-12-12T11:51:42.293 INFO:tasks.workunit.client.1.smithi093.stdout:0/252: symlink d5/d4d/l4e 0 2023-12-12T11:51:42.296 INFO:tasks.workunit.client.1.smithi093.stdout:2/308: dwrite d5/f10 [4194304,4194304] 0 2023-12-12T11:51:42.298 INFO:tasks.workunit.client.0.smithi063.stdout:6/58: mknod d9/d10/c16 0 2023-12-12T11:51:42.299 INFO:tasks.workunit.client.0.smithi063.stdout:6/59: write d9/fb [916491,7738] 0 2023-12-12T11:51:42.309 INFO:tasks.workunit.client.1.smithi093.stdout:6/350: symlink d0/d52/d7e/l81 0 2023-12-12T11:51:42.310 INFO:tasks.workunit.client.1.smithi093.stdout:7/208: dread f0 [4194304,4194304] 0 2023-12-12T11:51:42.318 INFO:tasks.workunit.client.0.smithi063.stdout:2/35: rename d0/c9 to d0/cc 0 2023-12-12T11:51:42.318 INFO:tasks.workunit.client.1.smithi093.stdout:8/242: dwrite d3/d1a/d1f/f3f [0,4194304] 0 2023-12-12T11:51:42.320 INFO:tasks.workunit.client.0.smithi063.stdout:7/34: rename fa to fb 0 2023-12-12T11:51:42.325 INFO:tasks.workunit.client.0.smithi063.stdout:7/35: symlink lc 0 2023-12-12T11:51:42.325 INFO:tasks.workunit.client.0.smithi063.stdout:7/36: write f8 [514224,3684] 0 2023-12-12T11:51:42.325 INFO:tasks.workunit.client.0.smithi063.stdout:7/37: readlink lc 0 2023-12-12T11:51:42.326 INFO:tasks.workunit.client.0.smithi063.stdout:7/38: rmdir - no directory 2023-12-12T11:51:42.338 INFO:tasks.workunit.client.1.smithi093.stdout:1/265: unlink d4/ff 0 2023-12-12T11:51:42.338 INFO:tasks.workunit.client.1.smithi093.stdout:1/266: chown d4/d1a/d1b/d26/d31 4 1 2023-12-12T11:51:42.338 INFO:tasks.workunit.client.1.smithi093.stdout:1/267: fdatasync d4/d1a/d1b/d26/d31/f38 0 2023-12-12T11:51:42.338 INFO:tasks.workunit.client.0.smithi063.stdout:5/89: mknod d7/c18 0 2023-12-12T11:51:42.338 INFO:tasks.workunit.client.0.smithi063.stdout:5/90: write d7/f9 [5426619,34633] 0 2023-12-12T11:51:42.341 INFO:tasks.workunit.client.1.smithi093.stdout:3/255: rename df/d25/d2c/f3c to df/d36/d3d/d42/f53 0 2023-12-12T11:51:42.341 INFO:tasks.workunit.client.1.smithi093.stdout:3/256: fsync df/d36/f41 0 2023-12-12T11:51:42.343 INFO:tasks.workunit.client.0.smithi063.stdout:7/39: dread f8 [0,4194304] 0 2023-12-12T11:51:42.344 INFO:tasks.workunit.client.1.smithi093.stdout:4/417: dwrite d0/d36/f70 [0,4194304] 0 2023-12-12T11:51:42.344 INFO:tasks.workunit.client.1.smithi093.stdout:4/418: chown d0/c43 5130 1 2023-12-12T11:51:42.344 INFO:tasks.workunit.client.1.smithi093.stdout:4/419: fsync d0/d31/f3b 0 2023-12-12T11:51:42.345 INFO:tasks.workunit.client.0.smithi063.stdout:5/91: mknod d7/c19 0 2023-12-12T11:51:42.347 INFO:tasks.workunit.client.1.smithi093.stdout:0/253: link d5/dd/d14/d26/f3f d5/dd/f4f 0 2023-12-12T11:51:42.348 INFO:tasks.workunit.client.1.smithi093.stdout:2/309: link d5/d14/d2d/d12/d25/f2a d5/d14/d2d/d4c/d54/f65 0 2023-12-12T11:51:42.353 INFO:tasks.workunit.client.1.smithi093.stdout:3/257: write df/d25/d3e/f4b [162001,124996] 0 2023-12-12T11:51:42.356 INFO:tasks.workunit.client.1.smithi093.stdout:4/420: write d0/f17 [2658272,8429] 0 2023-12-12T11:51:42.358 INFO:tasks.workunit.client.0.smithi063.stdout:7/40: mknod cd 0 2023-12-12T11:51:42.358 INFO:tasks.workunit.client.0.smithi063.stdout:6/60: dwrite f5 [0,4194304] 0 2023-12-12T11:51:42.365 INFO:tasks.workunit.client.0.smithi063.stdout:8/139: symlink d4/de/l28 0 2023-12-12T11:51:42.365 INFO:tasks.workunit.client.0.smithi063.stdout:8/140: fsync d4/f17 0 2023-12-12T11:51:42.372 INFO:tasks.workunit.client.1.smithi093.stdout:7/209: symlink da/l48 0 2023-12-12T11:51:42.373 INFO:tasks.workunit.client.0.smithi063.stdout:7/41: dread f4 [0,4194304] 0 2023-12-12T11:51:42.378 INFO:tasks.workunit.client.1.smithi093.stdout:6/351: dwrite d0/da/d32/d39/d5b/f64 [0,4194304] 0 2023-12-12T11:51:42.378 INFO:tasks.workunit.client.1.smithi093.stdout:6/352: write d0/d52/d7e/d42/f60 [425825,3922] 0 2023-12-12T11:51:42.384 INFO:tasks.workunit.client.1.smithi093.stdout:9/189: rmdir d1/d12/d1f 39 2023-12-12T11:51:42.384 INFO:tasks.workunit.client.1.smithi093.stdout:9/190: truncate d1/d12/d1f/f3a 381956 0 2023-12-12T11:51:42.392 INFO:tasks.workunit.client.1.smithi093.stdout:7/210: dread da/fb [4194304,4194304] 0 2023-12-12T11:51:42.393 INFO:tasks.workunit.client.0.smithi063.stdout:6/61: truncate f0 2692811 0 2023-12-12T11:51:42.393 INFO:tasks.workunit.client.0.smithi063.stdout:6/62: stat d9/ca 0 2023-12-12T11:51:42.398 INFO:tasks.workunit.client.1.smithi093.stdout:1/268: rmdir d4/d1a/d1b/d26 39 2023-12-12T11:51:42.399 INFO:tasks.workunit.client.0.smithi063.stdout:8/141: unlink d4/de/d1e/l21 0 2023-12-12T11:51:42.401 INFO:tasks.workunit.client.0.smithi063.stdout:7/42: mkdir de 0 2023-12-12T11:51:42.401 INFO:tasks.workunit.client.0.smithi063.stdout:7/43: fsync f4 0 2023-12-12T11:51:42.409 INFO:tasks.workunit.client.1.smithi093.stdout:2/310: dwrite d5/f19 [0,4194304] 0 2023-12-12T11:51:42.410 INFO:tasks.workunit.client.1.smithi093.stdout:2/311: dread - d5/d14/d2d/f53 zero size 2023-12-12T11:51:42.414 INFO:tasks.workunit.client.1.smithi093.stdout:3/258: creat df/f54 x:0 0 0 2023-12-12T11:51:42.414 INFO:tasks.workunit.client.1.smithi093.stdout:4/421: mkdir d0/d31/d5c/d7d/d79/d86 0 2023-12-12T11:51:42.417 INFO:tasks.workunit.client.0.smithi063.stdout:7/44: write f4 [211059,110014] 0 2023-12-12T11:51:42.424 INFO:tasks.workunit.client.1.smithi093.stdout:9/191: mkdir d1/d12/d1f/d32/d42 0 2023-12-12T11:51:42.426 INFO:tasks.workunit.client.0.smithi063.stdout:5/92: dwrite d7/f12 [0,4194304] 0 2023-12-12T11:51:42.427 INFO:tasks.workunit.client.0.smithi063.stdout:5/93: write d7/d10/f14 [2347383,43757] 0 2023-12-12T11:51:42.433 INFO:tasks.workunit.client.0.smithi063.stdout:7/45: rename cd to de/cf 0 2023-12-12T11:51:42.433 INFO:tasks.workunit.client.0.smithi063.stdout:7/46: write f8 [1539667,6563] 0 2023-12-12T11:51:42.436 INFO:tasks.workunit.client.1.smithi093.stdout:6/353: dwrite d0/da/d14/f18 [0,4194304] 0 2023-12-12T11:51:42.439 INFO:tasks.workunit.client.0.smithi063.stdout:5/94: creat d7/f1a x:0 0 0 2023-12-12T11:51:42.439 INFO:tasks.workunit.client.0.smithi063.stdout:5/95: truncate d7/f1a 810724 0 2023-12-12T11:51:42.442 INFO:tasks.workunit.client.1.smithi093.stdout:1/269: link d4/d1c/d2a/d2d/f50 d4/d1a/f5f 0 2023-12-12T11:51:42.444 INFO:tasks.workunit.client.1.smithi093.stdout:0/254: getdents d5/d21 0 2023-12-12T11:51:42.449 INFO:tasks.workunit.client.1.smithi093.stdout:0/255: read d5/dd/f16 [4568663,103906] 0 2023-12-12T11:51:42.449 INFO:tasks.workunit.client.1.smithi093.stdout:7/211: dwrite da/d15/f2c [0,4194304] 0 2023-12-12T11:51:42.449 INFO:tasks.workunit.client.1.smithi093.stdout:4/422: dread d0/f1c [0,4194304] 0 2023-12-12T11:51:42.449 INFO:tasks.workunit.client.1.smithi093.stdout:0/256: write d5/dd/f1a [2039143,116135] 0 2023-12-12T11:51:42.449 INFO:tasks.workunit.client.1.smithi093.stdout:8/243: rmdir d3/d1a 39 2023-12-12T11:51:42.450 INFO:tasks.workunit.client.1.smithi093.stdout:8/244: stat d3/d1a/d1f/d29/d30/l45 0 2023-12-12T11:51:42.451 INFO:tasks.workunit.client.0.smithi063.stdout:6/63: dwrite d9/d10/f15 [0,4194304] 0 2023-12-12T11:51:42.452 INFO:tasks.workunit.client.1.smithi093.stdout:8/245: read d3/d1a/d1f/f27 [42598,123149] 0 2023-12-12T11:51:42.452 INFO:tasks.workunit.client.1.smithi093.stdout:8/246: dread - d3/f42 zero size 2023-12-12T11:51:42.453 INFO:tasks.workunit.client.1.smithi093.stdout:2/312: symlink d5/d14/d2d/d12/d25/l66 0 2023-12-12T11:51:42.454 INFO:tasks.workunit.client.1.smithi093.stdout:9/192: mkdir d1/d23/d24/d29/d43 0 2023-12-12T11:51:42.462 INFO:tasks.workunit.client.1.smithi093.stdout:3/259: dwrite df/f19 [4194304,4194304] 0 2023-12-12T11:51:42.469 INFO:tasks.workunit.client.1.smithi093.stdout:7/212: symlink da/de/l49 0 2023-12-12T11:51:42.472 INFO:tasks.workunit.client.0.smithi063.stdout:7/47: dread f4 [0,4194304] 0 2023-12-12T11:51:42.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:41 smithi093 ceph-mon[115914]: [12/Dec/2023:11:51:40] ENGINE Bus STARTING 2023-12-12T11:51:42.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:41 smithi093 ceph-mon[115914]: [12/Dec/2023:11:51:40] ENGINE Serving on http://172.21.15.93:8765 2023-12-12T11:51:42.473 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:41 smithi093 ceph-mon[115914]: [12/Dec/2023:11:51:40] ENGINE Serving on https://172.21.15.93:7150 2023-12-12T11:51:42.473 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:41 smithi093 ceph-mon[115914]: [12/Dec/2023:11:51:40] ENGINE Bus STARTED 2023-12-12T11:51:42.473 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:41 smithi093 ceph-mon[115914]: pgmap v5: 65 pgs: 65 active+clean; 504 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail 2023-12-12T11:51:42.476 INFO:tasks.workunit.client.1.smithi093.stdout:8/247: creat d3/d1a/d1f/d29/f4d x:0 0 0 2023-12-12T11:51:42.476 INFO:tasks.workunit.client.1.smithi093.stdout:0/257: unlink d5/d21/d27/f42 0 2023-12-12T11:51:42.479 INFO:tasks.workunit.client.0.smithi063.stdout:7/48: symlink de/l10 0 2023-12-12T11:51:42.485 INFO:tasks.workunit.client.1.smithi093.stdout:9/193: mknod d1/d12/d3e/c44 0 2023-12-12T11:51:42.485 INFO:tasks.workunit.client.1.smithi093.stdout:9/194: write d1/d12/d1f/f35 [859518,90043] 0 2023-12-12T11:51:42.486 INFO:tasks.workunit.client.0.smithi063.stdout:4/60: truncate d2/d8/fe 310833 0 2023-12-12T11:51:42.486 INFO:tasks.workunit.client.0.smithi063.stdout:4/61: fsync d2/f10 0 2023-12-12T11:51:42.486 INFO:tasks.workunit.client.1.smithi093.stdout:3/260: rename df/c15 to df/d36/d3d/d42/c55 0 2023-12-12T11:51:42.486 INFO:tasks.workunit.client.1.smithi093.stdout:0/258: rename d5 to d5/d21/d27/d50 22 2023-12-12T11:51:42.486 INFO:tasks.workunit.client.1.smithi093.stdout:3/261: chown df/d22 53 1 2023-12-12T11:51:42.487 INFO:tasks.workunit.client.0.smithi063.stdout:7/49: mknod de/c11 0 2023-12-12T11:51:42.487 INFO:tasks.workunit.client.0.smithi063.stdout:7/50: readlink de/l10 0 2023-12-12T11:51:42.491 INFO:tasks.workunit.client.1.smithi093.stdout:9/195: symlink d1/d12/d1f/d32/l45 0 2023-12-12T11:51:42.492 INFO:tasks.workunit.client.0.smithi063.stdout:4/62: mknod d2/d17/c1b 0 2023-12-12T11:51:42.503 INFO:tasks.workunit.client.1.smithi093.stdout:8/248: read d3/d8/f23 [380429,98035] 0 2023-12-12T11:51:42.503 INFO:tasks.workunit.client.0.smithi063.stdout:2/36: rmdir d0 39 2023-12-12T11:51:42.504 INFO:tasks.workunit.client.0.smithi063.stdout:2/37: chown d0/la 863 1 2023-12-12T11:51:42.504 INFO:tasks.workunit.client.1.smithi093.stdout:3/262: symlink df/d30/l56 0 2023-12-12T11:51:42.507 INFO:tasks.workunit.client.1.smithi093.stdout:9/196: symlink d1/l46 0 2023-12-12T11:51:42.507 INFO:tasks.workunit.client.1.smithi093.stdout:0/259: symlink d5/dd/l51 0 2023-12-12T11:51:42.510 INFO:tasks.workunit.client.0.smithi063.stdout:2/38: symlink d0/ld 0 2023-12-12T11:51:42.520 INFO:tasks.workunit.client.1.smithi093.stdout:7/213: write da/d15/d19/f2b [204375,88631] 0 2023-12-12T11:51:42.524 INFO:tasks.workunit.client.1.smithi093.stdout:7/214: mknod da/de/c4a 0 2023-12-12T11:51:42.530 INFO:tasks.workunit.client.1.smithi093.stdout:7/215: rename da/f11 to da/f4b 0 2023-12-12T11:51:42.530 INFO:tasks.workunit.client.1.smithi093.stdout:7/216: readlink da/d15/d19/l33 0 2023-12-12T11:51:42.532 INFO:tasks.workunit.client.1.smithi093.stdout:7/217: mkdir da/d15/d19/d4c 0 2023-12-12T11:51:42.534 INFO:tasks.workunit.client.1.smithi093.stdout:7/218: readlink da/de/l49 0 2023-12-12T11:51:42.535 INFO:tasks.workunit.client.1.smithi093.stdout:1/270: dwrite d4/d1c/f21 [0,4194304] 0 2023-12-12T11:51:42.535 INFO:tasks.workunit.client.1.smithi093.stdout:1/271: readlink d4/l58 0 2023-12-12T11:51:42.547 INFO:tasks.workunit.client.1.smithi093.stdout:0/260: write d5/f31 [3394004,109668] 0 2023-12-12T11:51:42.549 INFO:tasks.workunit.client.1.smithi093.stdout:7/219: dread da/d15/d2d/f3c [0,4194304] 0 2023-12-12T11:51:42.549 INFO:tasks.workunit.client.1.smithi093.stdout:7/220: write da/d15/d19/f2b [30685,98500] 0 2023-12-12T11:51:42.549 INFO:tasks.workunit.client.1.smithi093.stdout:7/221: creat da/de/f4d x:0 0 0 2023-12-12T11:51:42.549 INFO:tasks.workunit.client.1.smithi093.stdout:7/222: fdatasync da/f1d 0 2023-12-12T11:51:42.550 INFO:tasks.workunit.client.1.smithi093.stdout:6/354: dwrite d0/d52/d7e/d42/f53 [0,4194304] 0 2023-12-12T11:51:42.550 INFO:tasks.workunit.client.1.smithi093.stdout:6/355: creat d0/da/d32/d40/d4d/f82 x:0 0 0 2023-12-12T11:51:42.551 INFO:tasks.workunit.client.1.smithi093.stdout:6/356: creat d0/da/d14/d21/f83 x:0 0 0 2023-12-12T11:51:42.552 INFO:tasks.workunit.client.0.smithi063.stdout:6/64: dwrite d9/fb [0,4194304] 0 2023-12-12T11:51:42.552 INFO:tasks.workunit.client.0.smithi063.stdout:4/63: dread d2/d8/f12 [0,4194304] 0 2023-12-12T11:51:42.555 INFO:tasks.workunit.client.0.smithi063.stdout:5/96: dwrite d7/f9 [0,4194304] 0 2023-12-12T11:51:42.555 INFO:tasks.workunit.client.0.smithi063.stdout:5/97: creat d7/d10/f1b x:0 0 0 2023-12-12T11:51:42.556 INFO:tasks.workunit.client.1.smithi093.stdout:2/313: dwrite d5/f19 [4194304,4194304] 0 2023-12-12T11:51:42.557 INFO:tasks.workunit.client.1.smithi093.stdout:4/423: dwrite d0/d31/f7c [0,4194304] 0 2023-12-12T11:51:42.563 INFO:tasks.workunit.client.0.smithi063.stdout:5/98: write d7/d10/f14 [115207,36070] 0 2023-12-12T11:51:42.564 INFO:tasks.workunit.client.1.smithi093.stdout:1/272: read d4/f2e [1713654,72366] 0 2023-12-12T11:51:42.565 INFO:tasks.workunit.client.1.smithi093.stdout:1/273: chown d4/dc/l13 51036 1 2023-12-12T11:51:42.565 INFO:tasks.workunit.client.1.smithi093.stdout:1/274: truncate d4/f3c 437897 0 2023-12-12T11:51:42.565 INFO:tasks.workunit.client.1.smithi093.stdout:7/223: dread f0 [4194304,4194304] 0 2023-12-12T11:51:42.565 INFO:tasks.workunit.client.0.smithi063.stdout:7/51: dread f8 [0,4194304] 0 2023-12-12T11:51:42.567 INFO:tasks.workunit.client.1.smithi093.stdout:6/357: mknod d0/d52/d7e/d42/c84 0 2023-12-12T11:51:42.568 INFO:tasks.workunit.client.0.smithi063.stdout:5/99: symlink d7/l1c 0 2023-12-12T11:51:42.569 INFO:tasks.workunit.client.1.smithi093.stdout:5/178: sync 2023-12-12T11:51:42.569 INFO:tasks.workunit.client.1.smithi093.stdout:5/179: chown d0/c33 6 1 2023-12-12T11:51:42.569 INFO:tasks.workunit.client.1.smithi093.stdout:5/180: fsync d0/d7/d27/d35/f31 0 2023-12-12T11:51:42.570 INFO:tasks.workunit.client.1.smithi093.stdout:3/263: dread df/d30/d33/f45 [0,4194304] 0 2023-12-12T11:51:42.570 INFO:tasks.workunit.client.1.smithi093.stdout:3/264: readlink df/l20 0 2023-12-12T11:51:42.570 INFO:tasks.workunit.client.1.smithi093.stdout:3/265: readlink df/l51 0 2023-12-12T11:51:42.572 INFO:tasks.workunit.client.0.smithi063.stdout:7/52: creat de/f12 x:0 0 0 2023-12-12T11:51:42.572 INFO:tasks.workunit.client.0.smithi063.stdout:7/53: chown lc 6503 1 2023-12-12T11:51:42.575 INFO:tasks.workunit.client.0.smithi063.stdout:5/100: symlink d7/de/l1d 0 2023-12-12T11:51:42.578 INFO:tasks.workunit.client.1.smithi093.stdout:8/249: dwrite d3/f17 [0,4194304] 0 2023-12-12T11:51:42.578 INFO:tasks.workunit.client.1.smithi093.stdout:4/424: getdents d0/d36/d61 0 2023-12-12T11:51:42.579 INFO:tasks.workunit.client.0.smithi063.stdout:2/39: dwrite d0/f6 [4194304,4194304] 0 2023-12-12T11:51:42.579 INFO:tasks.workunit.client.1.smithi093.stdout:9/197: dwrite d1/f2f [0,4194304] 0 2023-12-12T11:51:42.579 INFO:tasks.workunit.client.1.smithi093.stdout:9/198: getdents d1/d12/d1f/d32/d42 0 2023-12-12T11:51:42.579 INFO:tasks.workunit.client.1.smithi093.stdout:9/199: chown d1/d12/d1f/d3d 21793528 1 2023-12-12T11:51:42.581 INFO:tasks.workunit.client.1.smithi093.stdout:0/261: rename d5/d21/d27/d3a/c45 to d5/c52 0 2023-12-12T11:51:42.581 INFO:tasks.workunit.client.1.smithi093.stdout:0/262: truncate d5/dd/f1d 4845809 0 2023-12-12T11:51:42.581 INFO:tasks.workunit.client.1.smithi093.stdout:0/263: chown d5/dd/d14 204784 1 2023-12-12T11:51:42.582 INFO:tasks.workunit.client.1.smithi093.stdout:3/266: dread df/f2e [0,4194304] 0 2023-12-12T11:51:42.582 INFO:tasks.workunit.client.1.smithi093.stdout:3/267: chown df/d30/d33/l4c 25 1 2023-12-12T11:51:42.584 INFO:tasks.workunit.client.1.smithi093.stdout:7/224: creat da/de/d46/f4e x:0 0 0 2023-12-12T11:51:42.584 INFO:tasks.workunit.client.1.smithi093.stdout:7/225: readlink da/de/lf 0 2023-12-12T11:51:42.585 INFO:tasks.workunit.client.1.smithi093.stdout:1/275: dread d4/d1a/d1b/d26/f27 [0,4194304] 0 2023-12-12T11:51:42.588 INFO:tasks.workunit.client.1.smithi093.stdout:6/358: stat d0/da/d14/d3a/c3c 0 2023-12-12T11:51:42.588 INFO:tasks.workunit.client.1.smithi093.stdout:6/359: write d0/da/d14/f80 [120039,77434] 0 2023-12-12T11:51:42.589 INFO:tasks.workunit.client.0.smithi063.stdout:8/142: mkdir d4/d29 0 2023-12-12T11:51:42.590 INFO:tasks.workunit.client.0.smithi063.stdout:8/143: write d4/de/f13 [1203607,97560] 0 2023-12-12T11:51:42.591 INFO:tasks.workunit.client.0.smithi063.stdout:2/40: unlink d0/cc 0 2023-12-12T11:51:42.594 INFO:tasks.workunit.client.1.smithi093.stdout:5/181: unlink d0/d7/d36/d38/f39 0 2023-12-12T11:51:42.595 INFO:tasks.workunit.client.1.smithi093.stdout:1/276: dread d4/d1a/d1b/d26/f27 [0,4194304] 0 2023-12-12T11:51:42.595 INFO:tasks.workunit.client.0.smithi063.stdout:4/64: fsync d2/d8/fe 0 2023-12-12T11:51:42.597 INFO:tasks.workunit.client.1.smithi093.stdout:2/314: getdents d5 0 2023-12-12T11:51:42.597 INFO:tasks.workunit.client.1.smithi093.stdout:2/315: write d5/d14/d2d/f42 [1347079,37054] 0 2023-12-12T11:51:42.604 INFO:tasks.workunit.client.0.smithi063.stdout:8/144: mknod d4/d29/c2a 0 2023-12-12T11:51:42.604 INFO:tasks.workunit.client.0.smithi063.stdout:8/145: readlink d4/de/l10 0 2023-12-12T11:51:42.610 INFO:tasks.workunit.client.1.smithi093.stdout:9/200: link d1/c26 d1/d12/d1f/d32/c47 0 2023-12-12T11:51:42.610 INFO:tasks.workunit.client.1.smithi093.stdout:8/250: rename d3/f17 to d3/d1a/d1f/d29/d30/f4e 0 2023-12-12T11:51:42.612 INFO:tasks.workunit.client.1.smithi093.stdout:0/264: truncate d5/fa 3284532 0 2023-12-12T11:51:42.616 INFO:tasks.workunit.client.0.smithi063.stdout:8/146: rename d4/fd to d4/f2b 0 2023-12-12T11:51:42.622 INFO:tasks.workunit.client.1.smithi093.stdout:7/226: mkdir da/de/d46/d4f 0 2023-12-12T11:51:42.622 INFO:tasks.workunit.client.1.smithi093.stdout:7/227: chown da/de/d46 250 1 2023-12-12T11:51:42.622 INFO:tasks.workunit.client.1.smithi093.stdout:7/228: fsync da/d15/f2c 0 2023-12-12T11:51:42.622 INFO:tasks.workunit.client.1.smithi093.stdout:7/229: creat da/d15/d2d/f50 x:0 0 0 2023-12-12T11:51:42.622 INFO:tasks.workunit.client.1.smithi093.stdout:7/230: chown da/d15/d19/l33 26634308 1 2023-12-12T11:51:42.623 INFO:tasks.workunit.client.1.smithi093.stdout:8/251: write d3/d8/f18 [92838,70280] 0 2023-12-12T11:51:42.628 INFO:tasks.workunit.client.0.smithi063.stdout:6/65: dwrite d9/fb [0,4194304] 0 2023-12-12T11:51:42.628 INFO:tasks.workunit.client.0.smithi063.stdout:6/66: fdatasync f6 0 2023-12-12T11:51:42.630 INFO:tasks.workunit.client.1.smithi093.stdout:9/201: write d1/ff [791185,104070] 0 2023-12-12T11:51:42.633 INFO:tasks.workunit.client.1.smithi093.stdout:6/360: rmdir d0/da/d14/d38/d43 39 2023-12-12T11:51:42.633 INFO:tasks.workunit.client.1.smithi093.stdout:5/182: creat d0/d7/d36/d38/f43 x:0 0 0 2023-12-12T11:51:42.633 INFO:tasks.workunit.client.1.smithi093.stdout:2/316: mkdir d5/d14/d2d/d4c/d54/d67 0 2023-12-12T11:51:42.633 INFO:tasks.workunit.client.1.smithi093.stdout:5/183: fsync d0/d7/f42 0 2023-12-12T11:51:42.633 INFO:tasks.workunit.client.1.smithi093.stdout:4/425: rename d0/d31/d5c/d7d to d0/d87 0 2023-12-12T11:51:42.636 INFO:tasks.workunit.client.1.smithi093.stdout:7/231: link da/de/d46/f4e da/d15/d2d/f51 0 2023-12-12T11:51:42.636 INFO:tasks.workunit.client.1.smithi093.stdout:7/232: creat da/de/d46/f52 x:0 0 0 2023-12-12T11:51:42.638 INFO:tasks.workunit.client.1.smithi093.stdout:8/252: mknod d3/c4f 0 2023-12-12T11:51:42.638 INFO:tasks.workunit.client.0.smithi063.stdout:5/101: rmdir d7 39 2023-12-12T11:51:42.639 INFO:tasks.workunit.client.1.smithi093.stdout:5/184: dread d0/d7/d8/f37 [0,4194304] 0 2023-12-12T11:51:42.643 INFO:tasks.workunit.client.1.smithi093.stdout:9/202: creat d1/d23/d24/d29/d43/f48 x:0 0 0 2023-12-12T11:51:42.643 INFO:tasks.workunit.client.1.smithi093.stdout:6/361: dread d0/da/d14/d21/f5f [0,4194304] 0 2023-12-12T11:51:42.645 INFO:tasks.workunit.client.0.smithi063.stdout:6/67: write f5 [2951814,129413] 0 2023-12-12T11:51:42.646 INFO:tasks.workunit.client.0.smithi063.stdout:4/65: dwrite d2/f10 [0,4194304] 0 2023-12-12T11:51:42.646 INFO:tasks.workunit.client.0.smithi063.stdout:4/66: readlink l1 0 2023-12-12T11:51:42.646 INFO:tasks.workunit.client.0.smithi063.stdout:4/67: chown d2/f9 2 1 2023-12-12T11:51:42.647 INFO:tasks.workunit.client.1.smithi093.stdout:2/317: creat d5/d14/d2d/d12/d25/f68 x:0 0 0 2023-12-12T11:51:42.650 INFO:tasks.workunit.client.1.smithi093.stdout:1/277: rename d4/f2e to d4/d1c/d2a/d2d/f60 0 2023-12-12T11:51:42.651 INFO:tasks.workunit.client.1.smithi093.stdout:4/426: symlink d0/d36/d49/l88 0 2023-12-12T11:51:42.658 INFO:tasks.workunit.client.1.smithi093.stdout:7/233: truncate da/d15/f16 3580708 0 2023-12-12T11:51:42.659 INFO:tasks.workunit.client.1.smithi093.stdout:7/234: dread - da/de/f4d zero size 2023-12-12T11:51:42.660 INFO:tasks.workunit.client.0.smithi063.stdout:6/68: mknod d9/d10/c17 0 2023-12-12T11:51:42.664 INFO:tasks.workunit.client.1.smithi093.stdout:8/253: mkdir d3/d1a/d1f/d50 0 2023-12-12T11:51:42.665 INFO:tasks.workunit.client.1.smithi093.stdout:2/318: write d5/d14/d2d/d12/f22 [2585798,84762] 0 2023-12-12T11:51:42.665 INFO:tasks.workunit.client.0.smithi063.stdout:4/68: symlink d2/d17/l1c 0 2023-12-12T11:51:42.666 INFO:tasks.workunit.client.1.smithi093.stdout:0/265: dwrite d5/d21/d2f/f3d [0,4194304] 0 2023-12-12T11:51:42.672 INFO:tasks.workunit.client.0.smithi063.stdout:4/69: getdents d2 0 2023-12-12T11:51:42.677 INFO:tasks.workunit.client.1.smithi093.stdout:6/362: link d0/c3 d0/da/d14/d38/d43/c85 0 2023-12-12T11:51:42.677 INFO:tasks.workunit.client.1.smithi093.stdout:4/427: mkdir d0/d31/d89 0 2023-12-12T11:51:42.678 INFO:tasks.workunit.client.1.smithi093.stdout:8/254: mknod d3/d1a/d1f/d29/d30/c51 0 2023-12-12T11:51:42.678 INFO:tasks.workunit.client.1.smithi093.stdout:8/255: chown d3/d1a/d1f/d29/c3e 37 1 2023-12-12T11:51:42.678 INFO:tasks.workunit.client.1.smithi093.stdout:2/319: mkdir d5/d14/d2d/d4c/d54/d67/d69 0 2023-12-12T11:51:42.679 INFO:tasks.workunit.client.1.smithi093.stdout:2/320: creat d5/d46/d55/f6a x:0 0 0 2023-12-12T11:51:42.680 INFO:tasks.workunit.client.1.smithi093.stdout:3/268: truncate df/f19 5216678 0 2023-12-12T11:51:42.680 INFO:tasks.workunit.client.1.smithi093.stdout:3/269: stat df/d25/d2c/l37 0 2023-12-12T11:51:42.686 INFO:tasks.workunit.client.1.smithi093.stdout:0/266: write d5/d21/d2f/f3e [2295413,67284] 0 2023-12-12T11:51:42.686 INFO:tasks.workunit.client.1.smithi093.stdout:5/185: rmdir d0/d7/d8 39 2023-12-12T11:51:42.687 INFO:tasks.workunit.client.1.smithi093.stdout:6/363: creat d0/da/d14/d38/d43/f86 x:0 0 0 2023-12-12T11:51:42.690 INFO:tasks.workunit.client.1.smithi093.stdout:4/428: link d0/d36/d49/f7e d0/d87/d79/d86/f8a 0 2023-12-12T11:51:42.690 INFO:tasks.workunit.client.1.smithi093.stdout:4/429: chown d0/d87/d79/d7f/d82 10131788 1 2023-12-12T11:51:42.691 INFO:tasks.workunit.client.1.smithi093.stdout:8/256: mknod d3/c52 0 2023-12-12T11:51:42.691 INFO:tasks.workunit.client.1.smithi093.stdout:8/257: chown d3/d1a/d1f/f27 4 1 2023-12-12T11:51:42.693 INFO:tasks.workunit.client.1.smithi093.stdout:3/270: dread df/f2f [0,4194304] 0 2023-12-12T11:51:42.694 INFO:tasks.workunit.client.1.smithi093.stdout:6/364: mknod d0/da/d32/c87 0 2023-12-12T11:51:42.703 INFO:tasks.workunit.client.1.smithi093.stdout:9/203: rmdir d1/d23/d24/d29 39 2023-12-12T11:51:42.703 INFO:tasks.workunit.client.1.smithi093.stdout:1/278: dwrite d4/dc/f28 [0,4194304] 0 2023-12-12T11:51:42.703 INFO:tasks.workunit.client.1.smithi093.stdout:8/258: creat d3/d1a/d1f/d29/d3a/d40/f53 x:0 0 0 2023-12-12T11:51:42.703 INFO:tasks.workunit.client.1.smithi093.stdout:3/271: rmdir df/d30/d33 39 2023-12-12T11:51:42.703 INFO:tasks.workunit.client.1.smithi093.stdout:3/272: truncate df/f54 158926 0 2023-12-12T11:51:42.703 INFO:tasks.workunit.client.1.smithi093.stdout:3/273: stat l8 0 2023-12-12T11:51:42.703 INFO:tasks.workunit.client.1.smithi093.stdout:3/274: getdents df/d36/d3d 0 2023-12-12T11:51:42.703 INFO:tasks.workunit.client.1.smithi093.stdout:6/365: link d0/c5c d0/d52/d7e/c88 0 2023-12-12T11:51:42.703 INFO:tasks.workunit.client.1.smithi093.stdout:6/366: dread - d0/da/d32/d40/d4d/f82 zero size 2023-12-12T11:51:42.706 INFO:tasks.workunit.client.1.smithi093.stdout:0/267: dread d5/dd/f16 [0,4194304] 0 2023-12-12T11:51:42.706 INFO:tasks.workunit.client.1.smithi093.stdout:8/259: rmdir d3/d1a 39 2023-12-12T11:51:42.707 INFO:tasks.workunit.client.1.smithi093.stdout:0/268: creat d5/dd/f53 x:0 0 0 2023-12-12T11:51:42.707 INFO:tasks.workunit.client.1.smithi093.stdout:6/367: link d0/d52/d7e/d42/f53 d0/da/f89 0 2023-12-12T11:51:42.709 INFO:tasks.workunit.client.0.smithi063.stdout:4/70: write d2/f9 [466132,62801] 0 2023-12-12T11:51:42.709 INFO:tasks.workunit.client.1.smithi093.stdout:8/260: rmdir d3/d1a/d1f 39 2023-12-12T11:51:42.710 INFO:tasks.workunit.client.1.smithi093.stdout:8/261: creat d3/d1a/d1f/d29/f54 x:0 0 0 2023-12-12T11:51:42.717 INFO:tasks.workunit.client.1.smithi093.stdout:6/368: symlink d0/da/d32/d39/l8a 0 2023-12-12T11:51:42.719 INFO:tasks.workunit.client.1.smithi093.stdout:0/269: mkdir d5/d21/d2f/d54 0 2023-12-12T11:51:42.727 INFO:tasks.workunit.client.0.smithi063.stdout:6/69: dwrite d9/fd [0,4194304] 0 2023-12-12T11:51:42.729 INFO:tasks.workunit.client.1.smithi093.stdout:6/369: creat d0/d52/d7e/d42/f8b x:0 0 0 2023-12-12T11:51:42.729 INFO:tasks.workunit.client.1.smithi093.stdout:6/370: fsync d0/da/d14/d3a/f6a 0 2023-12-12T11:51:42.729 INFO:tasks.workunit.client.1.smithi093.stdout:6/371: chown d0/da/d32 631938813 1 2023-12-12T11:51:42.729 INFO:tasks.workunit.client.1.smithi093.stdout:6/372: stat d0/da/d14/d38/d43/f76 0 2023-12-12T11:51:42.729 INFO:tasks.workunit.client.1.smithi093.stdout:0/270: mknod d5/d21/d2f/d54/c55 0 2023-12-12T11:51:42.732 INFO:tasks.workunit.client.1.smithi093.stdout:0/271: write d5/dd/d33/f3c [1087718,46472] 0 2023-12-12T11:51:42.732 INFO:tasks.workunit.client.1.smithi093.stdout:7/235: dwrite da/d15/d2d/f3c [0,4194304] 0 2023-12-12T11:51:42.737 INFO:tasks.workunit.client.1.smithi093.stdout:6/373: dread d0/d52/d7e/d42/f60 [0,4194304] 0 2023-12-12T11:51:42.737 INFO:tasks.workunit.client.1.smithi093.stdout:6/374: chown d0/d52/d7e/f58 905 1 2023-12-12T11:51:42.740 INFO:tasks.workunit.client.0.smithi063.stdout:4/71: dread d2/f9 [0,4194304] 0 2023-12-12T11:51:42.753 INFO:tasks.workunit.client.1.smithi093.stdout:6/375: symlink d0/da/d14/d38/d43/l8c 0 2023-12-12T11:51:42.753 INFO:tasks.workunit.client.1.smithi093.stdout:6/376: write d0/d52/d7e/d42/f60 [973234,85935] 0 2023-12-12T11:51:42.753 INFO:tasks.workunit.client.1.smithi093.stdout:4/430: dwrite d0/d36/f75 [0,4194304] 0 2023-12-12T11:51:42.760 INFO:tasks.workunit.client.1.smithi093.stdout:6/377: mknod d0/da/d32/c8d 0 2023-12-12T11:51:42.762 INFO:tasks.workunit.client.1.smithi093.stdout:4/431: rmdir d0/d87/d79/d7f/d82 0 2023-12-12T11:51:42.762 INFO:tasks.workunit.client.1.smithi093.stdout:4/432: write d0/f1f [4707880,16047] 0 2023-12-12T11:51:42.762 INFO:tasks.workunit.client.1.smithi093.stdout:4/433: chown d0/d36/f60 2077651 1 2023-12-12T11:51:42.764 INFO:tasks.workunit.client.1.smithi093.stdout:4/434: rmdir d0/d31/d5c/d66 39 2023-12-12T11:51:42.764 INFO:tasks.workunit.client.1.smithi093.stdout:4/435: write d0/ff [1083458,11083] 0 2023-12-12T11:51:42.764 INFO:tasks.workunit.client.1.smithi093.stdout:4/436: chown d0/f17 56 1 2023-12-12T11:51:42.766 INFO:tasks.workunit.client.1.smithi093.stdout:4/437: getdents d0/d31/d5c 0 2023-12-12T11:51:42.766 INFO:tasks.workunit.client.1.smithi093.stdout:4/438: chown d0/d31/c38 553 1 2023-12-12T11:51:42.776 INFO:tasks.workunit.client.1.smithi093.stdout:4/439: dread d0/d36/f59 [0,4194304] 0 2023-12-12T11:51:42.784 INFO:tasks.workunit.client.1.smithi093.stdout:4/440: dread d0/d36/f50 [0,4194304] 0 2023-12-12T11:51:42.789 INFO:tasks.workunit.client.1.smithi093.stdout:4/441: mknod d0/d31/d5c/c8b 0 2023-12-12T11:51:42.791 INFO:tasks.workunit.client.1.smithi093.stdout:6/378: dread d0/d52/d7e/f3f [0,4194304] 0 2023-12-12T11:51:42.792 INFO:tasks.workunit.client.1.smithi093.stdout:1/279: dwrite d4/d1a/d1b/f48 [0,4194304] 0 2023-12-12T11:51:42.795 INFO:tasks.workunit.client.1.smithi093.stdout:9/204: dwrite d1/d12/d1f/f27 [0,4194304] 0 2023-12-12T11:51:42.795 INFO:tasks.workunit.client.1.smithi093.stdout:9/205: chown d1/f2f 117 1 2023-12-12T11:51:42.795 INFO:tasks.workunit.client.1.smithi093.stdout:9/206: readlink d1/d23/l2c 0 2023-12-12T11:51:42.795 INFO:tasks.workunit.client.1.smithi093.stdout:9/207: chown d1/d23/d24/d29/d43/f48 98247 1 2023-12-12T11:51:42.795 INFO:tasks.workunit.client.1.smithi093.stdout:6/379: rename d0/da/d32/f36 to d0/d52/d7e/d42/f8e 0 2023-12-12T11:51:42.796 INFO:tasks.workunit.client.1.smithi093.stdout:6/380: write d0/da/d73/f7d [1007548,21533] 0 2023-12-12T11:51:42.805 INFO:tasks.workunit.client.1.smithi093.stdout:9/208: rmdir d1/d12 39 2023-12-12T11:51:42.805 INFO:tasks.workunit.client.1.smithi093.stdout:9/209: readlink d1/l46 0 2023-12-12T11:51:42.807 INFO:tasks.workunit.client.1.smithi093.stdout:1/280: getdents d4/d1c 0 2023-12-12T11:51:42.807 INFO:tasks.workunit.client.1.smithi093.stdout:1/281: chown d4/d1a/d1b/d26/d40 265863562 1 2023-12-12T11:51:42.807 INFO:tasks.workunit.client.1.smithi093.stdout:1/282: creat d4/f61 x:0 0 0 2023-12-12T11:51:42.810 INFO:tasks.workunit.client.1.smithi093.stdout:0/272: dwrite d5/dd/d14/d26/f3f [4194304,4194304] 0 2023-12-12T11:51:42.810 INFO:tasks.workunit.client.1.smithi093.stdout:0/273: dread - d5/d21/f4c zero size 2023-12-12T11:51:42.811 INFO:tasks.workunit.client.1.smithi093.stdout:9/210: creat d1/d12/d1f/d32/f49 x:0 0 0 2023-12-12T11:51:42.811 INFO:tasks.workunit.client.1.smithi093.stdout:9/211: chown d1/d23/f41 13822756 1 2023-12-12T11:51:42.812 INFO:tasks.workunit.client.1.smithi093.stdout:6/381: getdents d0/d7b 0 2023-12-12T11:51:42.812 INFO:tasks.workunit.client.1.smithi093.stdout:6/382: creat d0/da/d32/d40/d4d/f8f x:0 0 0 2023-12-12T11:51:42.816 INFO:tasks.workunit.client.1.smithi093.stdout:1/283: dread d4/dc/f18 [0,4194304] 0 2023-12-12T11:51:42.816 INFO:tasks.workunit.client.1.smithi093.stdout:1/284: stat d4/dc/f10 0 2023-12-12T11:51:42.816 INFO:tasks.workunit.client.1.smithi093.stdout:1/285: fdatasync d4/d1a/d1b/d26/f27 0 2023-12-12T11:51:42.817 INFO:tasks.workunit.client.1.smithi093.stdout:0/274: rmdir d5/d4d 39 2023-12-12T11:51:42.818 INFO:tasks.workunit.client.1.smithi093.stdout:0/275: creat d5/d21/d27/d3a/f56 x:0 0 0 2023-12-12T11:51:42.819 INFO:tasks.workunit.client.1.smithi093.stdout:1/286: symlink d4/d1a/d1b/d26/l62 0 2023-12-12T11:51:42.821 INFO:tasks.workunit.client.0.smithi063.stdout:4/72: dwrite d2/f10 [4194304,4194304] 0 2023-12-12T11:51:42.827 INFO:tasks.workunit.client.1.smithi093.stdout:0/276: symlink d5/dd/l57 0 2023-12-12T11:51:42.827 INFO:tasks.workunit.client.1.smithi093.stdout:3/275: dwrite df/d25/d3e/f4b [0,4194304] 0 2023-12-12T11:51:42.827 INFO:tasks.workunit.client.1.smithi093.stdout:3/276: chown df/l18 43971076 1 2023-12-12T11:51:42.829 INFO:tasks.workunit.client.1.smithi093.stdout:8/262: dwrite d3/d1a/d1f/f2f [0,4194304] 0 2023-12-12T11:51:42.833 INFO:tasks.workunit.client.1.smithi093.stdout:4/442: dwrite d0/d31/f2c [0,4194304] 0 2023-12-12T11:51:42.833 INFO:tasks.workunit.client.1.smithi093.stdout:4/443: creat d0/d36/d49/f8c x:0 0 0 2023-12-12T11:51:42.837 INFO:tasks.workunit.client.1.smithi093.stdout:3/277: creat df/d36/d3d/d42/f57 x:0 0 0 2023-12-12T11:51:42.837 INFO:tasks.workunit.client.1.smithi093.stdout:3/278: write df/d36/d3d/d42/f57 [552595,30801] 0 2023-12-12T11:51:42.838 INFO:tasks.workunit.client.1.smithi093.stdout:3/279: readlink df/d25/l40 0 2023-12-12T11:51:42.842 INFO:tasks.workunit.client.0.smithi063.stdout:4/73: dread d2/d8/f12 [0,4194304] 0 2023-12-12T11:51:42.843 INFO:tasks.workunit.client.1.smithi093.stdout:7/236: dwrite da/d15/d2d/f51 [0,4194304] 0 2023-12-12T11:51:42.845 INFO:tasks.workunit.client.1.smithi093.stdout:4/444: rename d0/c6 to d0/d87/c8d 0 2023-12-12T11:51:42.862 INFO:tasks.workunit.client.1.smithi093.stdout:7/237: link da/d15/d2d/d2f/f3d da/de/f53 0 2023-12-12T11:51:42.862 INFO:tasks.workunit.client.1.smithi093.stdout:7/238: readlink da/l12 0 2023-12-12T11:51:42.865 INFO:tasks.workunit.client.1.smithi093.stdout:4/445: creat d0/d36/d40/f8e x:0 0 0 2023-12-12T11:51:42.867 INFO:tasks.workunit.client.1.smithi093.stdout:4/446: unlink d0/f1 0 2023-12-12T11:51:42.869 INFO:tasks.workunit.client.1.smithi093.stdout:4/447: rename d0/d31/d5c/f7a to d0/d87/f8f 0 2023-12-12T11:51:42.877 INFO:tasks.workunit.client.1.smithi093.stdout:3/280: write df/d25/d3e/f4b [3047055,117088] 0 2023-12-12T11:51:42.879 INFO:tasks.workunit.client.1.smithi093.stdout:9/212: dwrite d1/d23/f41 [0,4194304] 0 2023-12-12T11:51:42.879 INFO:tasks.workunit.client.1.smithi093.stdout:3/281: truncate fc 2412685 0 2023-12-12T11:51:42.882 INFO:tasks.workunit.client.0.smithi063.stdout:6/70: dwrite f0 [0,4194304] 0 2023-12-12T11:51:42.884 INFO:tasks.workunit.client.1.smithi093.stdout:6/383: dwrite d0/da/d32/d39/d5b/f64 [0,4194304] 0 2023-12-12T11:51:42.884 INFO:tasks.workunit.client.1.smithi093.stdout:6/384: creat d0/da/d73/f90 x:0 0 0 2023-12-12T11:51:42.884 INFO:tasks.workunit.client.0.smithi063.stdout:6/71: creat d9/f18 x:0 0 0 2023-12-12T11:51:42.886 INFO:tasks.workunit.client.1.smithi093.stdout:9/213: rmdir d1/d23/d24 39 2023-12-12T11:51:42.886 INFO:tasks.workunit.client.1.smithi093.stdout:9/214: write d1/fa [1167345,37590] 0 2023-12-12T11:51:42.886 INFO:tasks.workunit.client.1.smithi093.stdout:9/215: creat d1/f4a x:0 0 0 2023-12-12T11:51:42.888 INFO:tasks.workunit.client.1.smithi093.stdout:6/385: creat d0/da/d32/d39/f91 x:0 0 0 2023-12-12T11:51:42.889 INFO:tasks.workunit.client.1.smithi093.stdout:1/287: dwrite d4/dc/f5c [0,4194304] 0 2023-12-12T11:51:42.889 INFO:tasks.workunit.client.1.smithi093.stdout:1/288: chown d4/d1a/d1b/d26/f4d 51606 1 2023-12-12T11:51:42.889 INFO:tasks.workunit.client.1.smithi093.stdout:6/386: creat d0/da/d32/d40/d4d/f92 x:0 0 0 2023-12-12T11:51:42.889 INFO:tasks.workunit.client.1.smithi093.stdout:6/387: truncate d0/da/d73/f77 439081 0 2023-12-12T11:51:42.890 INFO:tasks.workunit.client.1.smithi093.stdout:4/448: dread d0/f18 [0,4194304] 0 2023-12-12T11:51:42.891 INFO:tasks.workunit.client.1.smithi093.stdout:4/449: write d0/d36/d40/f4e [965332,104693] 0 2023-12-12T11:51:42.898 INFO:tasks.workunit.client.1.smithi093.stdout:0/277: dwrite d5/dd/d14/f18 [0,4194304] 0 2023-12-12T11:51:42.905 INFO:tasks.workunit.client.1.smithi093.stdout:4/450: dread d0/d36/f59 [0,4194304] 0 2023-12-12T11:51:42.905 INFO:tasks.workunit.client.1.smithi093.stdout:1/289: mknod d4/d1a/c63 0 2023-12-12T11:51:42.909 INFO:tasks.workunit.client.1.smithi093.stdout:6/388: rename d0/da/d14/d3a/c70 to d0/d52/d6b/c93 0 2023-12-12T11:51:42.911 INFO:tasks.workunit.client.1.smithi093.stdout:8/263: dwrite d3/f42 [0,4194304] 0 2023-12-12T11:51:42.913 INFO:tasks.workunit.client.0.smithi063.stdout:4/74: dwrite d2/f6 [0,4194304] 0 2023-12-12T11:51:42.918 INFO:tasks.workunit.client.1.smithi093.stdout:0/278: mkdir d5/dd/d14/d26/d58 0 2023-12-12T11:51:42.918 INFO:tasks.workunit.client.1.smithi093.stdout:4/451: link d0/c10 d0/d87/c90 0 2023-12-12T11:51:42.918 INFO:tasks.workunit.client.1.smithi093.stdout:4/452: read - d0/d36/d49/f78 zero size 2023-12-12T11:51:42.918 INFO:tasks.workunit.client.1.smithi093.stdout:7/239: fsync da/de/f53 0 2023-12-12T11:51:42.919 INFO:tasks.workunit.client.1.smithi093.stdout:1/290: rename d4/d1a/d1b/d26/c56 to d4/d1c/c64 0 2023-12-12T11:51:42.921 INFO:tasks.workunit.client.1.smithi093.stdout:2/321: sync 2023-12-12T11:51:42.921 INFO:tasks.workunit.client.1.smithi093.stdout:2/322: truncate d5/d14/d2d/d12/d44/f57 963080 0 2023-12-12T11:51:42.921 INFO:tasks.workunit.client.1.smithi093.stdout:2/323: read d5/f10 [3906609,105268] 0 2023-12-12T11:51:42.921 INFO:tasks.workunit.client.1.smithi093.stdout:5/186: sync 2023-12-12T11:51:42.922 INFO:tasks.workunit.client.1.smithi093.stdout:6/389: creat d0/d7b/f94 x:0 0 0 2023-12-12T11:51:42.929 INFO:tasks.workunit.client.0.smithi063.stdout:6/72: dwrite d9/fc [4194304,4194304] 0 2023-12-12T11:51:42.931 INFO:tasks.workunit.client.1.smithi093.stdout:4/453: dread d0/d36/d49/f4a [0,4194304] 0 2023-12-12T11:51:42.931 INFO:tasks.workunit.client.1.smithi093.stdout:4/454: stat d0/d36/f60 0 2023-12-12T11:51:42.931 INFO:tasks.workunit.client.1.smithi093.stdout:3/282: dwrite df/f28 [4194304,4194304] 0 2023-12-12T11:51:42.931 INFO:tasks.workunit.client.1.smithi093.stdout:7/240: dread da/d15/d19/f2b [0,4194304] 0 2023-12-12T11:51:42.934 INFO:tasks.workunit.client.1.smithi093.stdout:1/291: mkdir d4/d1a/d1b/d26/d65 0 2023-12-12T11:51:42.934 INFO:tasks.workunit.client.1.smithi093.stdout:1/292: write d4/fa [416163,52049] 0 2023-12-12T11:51:42.934 INFO:tasks.workunit.client.1.smithi093.stdout:1/293: write d4/fd [1781867,6139] 0 2023-12-12T11:51:42.935 INFO:tasks.workunit.client.1.smithi093.stdout:9/216: dwrite d1/fe [0,4194304] 0 2023-12-12T11:51:42.938 INFO:tasks.workunit.client.1.smithi093.stdout:2/324: symlink d5/d46/d55/l6b 0 2023-12-12T11:51:42.938 INFO:tasks.workunit.client.1.smithi093.stdout:2/325: dread - d5/d14/d47/d4e/d51/f5a zero size 2023-12-12T11:51:42.938 INFO:tasks.workunit.client.0.smithi063.stdout:6/73: symlink d9/d10/l19 0 2023-12-12T11:51:42.948 INFO:tasks.workunit.client.1.smithi093.stdout:5/187: mkdir d0/d7/d36/d29/d44 0 2023-12-12T11:51:42.951 INFO:tasks.workunit.client.1.smithi093.stdout:6/390: unlink d0/da/d32/d40/l63 0 2023-12-12T11:51:42.958 INFO:tasks.workunit.client.0.smithi063.stdout:4/75: truncate d2/f6 589118 0 2023-12-12T11:51:42.958 INFO:tasks.workunit.client.1.smithi093.stdout:3/283: mknod df/d30/d33/c58 0 2023-12-12T11:51:42.958 INFO:tasks.workunit.client.1.smithi093.stdout:3/284: write df/d25/f44 [537044,123385] 0 2023-12-12T11:51:42.961 INFO:tasks.workunit.client.1.smithi093.stdout:9/217: mknod d1/d12/c4b 0 2023-12-12T11:51:42.965 INFO:tasks.workunit.client.1.smithi093.stdout:3/285: mkdir df/d36/d3d/d59 0 2023-12-12T11:51:42.965 INFO:tasks.workunit.client.1.smithi093.stdout:3/286: chown df/d30/d33/f3a 103350657 1 2023-12-12T11:51:42.972 INFO:tasks.workunit.client.1.smithi093.stdout:9/218: creat d1/d12/f4c x:0 0 0 2023-12-12T11:51:42.975 INFO:tasks.workunit.client.1.smithi093.stdout:8/264: dwrite d3/d1a/f2b [0,4194304] 0 2023-12-12T11:51:42.979 INFO:tasks.workunit.client.1.smithi093.stdout:6/391: dread d0/da/f20 [4194304,4194304] 0 2023-12-12T11:51:42.980 INFO:tasks.workunit.client.0.smithi063.stdout:4/76: rename d2/f9 to d2/f1d 0 2023-12-12T11:51:42.983 INFO:tasks.workunit.client.1.smithi093.stdout:3/287: link df/l11 df/d22/d49/l5a 0 2023-12-12T11:51:42.983 INFO:tasks.workunit.client.1.smithi093.stdout:9/219: mknod d1/c4d 0 2023-12-12T11:51:42.985 INFO:tasks.workunit.client.1.smithi093.stdout:4/455: dwrite d0/d36/d61/f62 [0,4194304] 0 2023-12-12T11:51:42.987 INFO:tasks.workunit.client.1.smithi093.stdout:0/279: dwrite d5/f7 [0,4194304] 0 2023-12-12T11:51:42.987 INFO:tasks.workunit.client.1.smithi093.stdout:0/280: creat d5/dd/d14/d26/f59 x:0 0 0 2023-12-12T11:51:42.987 INFO:tasks.workunit.client.1.smithi093.stdout:0/281: creat d5/d21/d27/f5a x:0 0 0 2023-12-12T11:51:42.987 INFO:tasks.workunit.client.1.smithi093.stdout:8/265: rename d3/f24 to d3/d1a/d1f/d29/d3a/f55 0 2023-12-12T11:51:42.988 INFO:tasks.workunit.client.1.smithi093.stdout:8/266: fdatasync d3/d1a/d1f/f2f 0 2023-12-12T11:51:42.990 INFO:tasks.workunit.client.1.smithi093.stdout:6/392: mkdir d0/da/d14/d3a/d95 0 2023-12-12T11:51:42.995 INFO:tasks.workunit.client.1.smithi093.stdout:4/456: creat d0/f91 x:0 0 0 2023-12-12T11:51:42.999 INFO:tasks.workunit.client.0.smithi063.stdout:0/13: sync 2023-12-12T11:51:43.000 INFO:tasks.workunit.client.0.smithi063.stdout:0/14: chown d0 1163 1 2023-12-12T11:51:43.000 INFO:tasks.workunit.client.0.smithi063.stdout:0/15: dread - no filename 2023-12-12T11:51:43.000 INFO:tasks.workunit.client.1.smithi093.stdout:0/282: truncate d5/dd/f4f 7378124 0 2023-12-12T11:51:43.002 INFO:tasks.workunit.client.1.smithi093.stdout:8/267: symlink d3/d1a/d1f/l56 0 2023-12-12T11:51:43.004 INFO:tasks.workunit.client.0.smithi063.stdout:4/77: dread d2/f1d [0,4194304] 0 2023-12-12T11:51:43.005 INFO:tasks.workunit.client.1.smithi093.stdout:4/457: rename d0/d31/d5c/c5f to d0/d36/d49/c92 0 2023-12-12T11:51:43.005 INFO:tasks.workunit.client.1.smithi093.stdout:4/458: readlink d0/d31/d5c/d66/l64 0 2023-12-12T11:51:43.006 INFO:tasks.workunit.client.0.smithi063.stdout:0/16: symlink d0/l2 0 2023-12-12T11:51:43.006 INFO:tasks.workunit.client.0.smithi063.stdout:0/17: truncate - no filename 2023-12-12T11:51:43.006 INFO:tasks.workunit.client.0.smithi063.stdout:0/18: dread - no filename 2023-12-12T11:51:43.006 INFO:tasks.workunit.client.0.smithi063.stdout:0/19: dwrite - no filename 2023-12-12T11:51:43.006 INFO:tasks.workunit.client.0.smithi063.stdout:0/20: dread - no filename 2023-12-12T11:51:43.007 INFO:tasks.workunit.client.1.smithi093.stdout:5/188: dwrite d0/d7/f42 [0,4194304] 0 2023-12-12T11:51:43.008 INFO:tasks.workunit.client.1.smithi093.stdout:0/283: truncate d5/f31 1919735 0 2023-12-12T11:51:43.008 INFO:tasks.workunit.client.1.smithi093.stdout:0/284: truncate d5/d21/d27/d3a/f48 445654 0 2023-12-12T11:51:43.008 INFO:tasks.workunit.client.1.smithi093.stdout:0/285: readlink d5/d21/l38 0 2023-12-12T11:51:43.008 INFO:tasks.workunit.client.1.smithi093.stdout:0/286: chown d5/dd/d14/d26/f34 24 1 2023-12-12T11:51:43.010 INFO:tasks.workunit.client.1.smithi093.stdout:3/288: write fc [1589923,38423] 0 2023-12-12T11:51:43.011 INFO:tasks.workunit.client.1.smithi093.stdout:9/220: dread d1/fe [0,4194304] 0 2023-12-12T11:51:43.011 INFO:tasks.workunit.client.1.smithi093.stdout:9/221: write d1/d12/d1f/d32/f49 [232718,41442] 0 2023-12-12T11:51:43.012 INFO:tasks.workunit.client.1.smithi093.stdout:9/222: chown d1/d12/d1f/f25 255685985 1 2023-12-12T11:51:43.013 INFO:tasks.workunit.client.0.smithi063.stdout:4/78: unlink d2/d8/d14/f1a 0 2023-12-12T11:51:43.013 INFO:tasks.workunit.client.1.smithi093.stdout:4/459: getdents d0/d87/d79/d86 0 2023-12-12T11:51:43.013 INFO:tasks.workunit.client.1.smithi093.stdout:4/460: write d0/d31/d5c/d66/f84 [23065,72390] 0 2023-12-12T11:51:43.014 INFO:tasks.workunit.client.0.smithi063.stdout:0/21: symlink d0/l3 0 2023-12-12T11:51:43.014 INFO:tasks.workunit.client.0.smithi063.stdout:0/22: chown d0/l2 21145570 1 2023-12-12T11:51:43.014 INFO:tasks.workunit.client.0.smithi063.stdout:0/23: truncate - no filename 2023-12-12T11:51:43.014 INFO:tasks.workunit.client.0.smithi063.stdout:0/24: truncate - no filename 2023-12-12T11:51:43.017 INFO:tasks.workunit.client.1.smithi093.stdout:0/287: mknod d5/d21/d2f/d54/c5b 0 2023-12-12T11:51:43.017 INFO:tasks.workunit.client.1.smithi093.stdout:3/289: mknod df/d25/d3e/c5b 0 2023-12-12T11:51:43.018 INFO:tasks.workunit.client.1.smithi093.stdout:7/241: dwrite da/d15/f16 [0,4194304] 0 2023-12-12T11:51:43.019 INFO:tasks.workunit.client.1.smithi093.stdout:1/294: dwrite d4/d1c/d2a/f2b [0,4194304] 0 2023-12-12T11:51:43.019 INFO:tasks.workunit.client.1.smithi093.stdout:1/295: chown d4/d1c/d2a 74 1 2023-12-12T11:51:43.021 INFO:tasks.workunit.client.0.smithi063.stdout:0/25: link d0/l1 d0/l4 0 2023-12-12T11:51:43.021 INFO:tasks.workunit.client.0.smithi063.stdout:0/26: dread - no filename 2023-12-12T11:51:43.022 INFO:tasks.workunit.client.0.smithi063.stdout:4/79: dread d2/d8/fe [0,4194304] 0 2023-12-12T11:51:43.024 INFO:tasks.workunit.client.1.smithi093.stdout:4/461: mkdir d0/d31/d5c/d6c/d93 0 2023-12-12T11:51:43.024 INFO:tasks.workunit.client.1.smithi093.stdout:9/223: dread d1/d12/d1f/f25 [0,4194304] 0 2023-12-12T11:51:43.025 INFO:tasks.workunit.client.1.smithi093.stdout:8/268: read d3/d1a/d1f/d29/d30/f4e [3923207,111132] 0 2023-12-12T11:51:43.025 INFO:tasks.workunit.client.1.smithi093.stdout:8/269: creat d3/f57 x:0 0 0 2023-12-12T11:51:43.025 INFO:tasks.workunit.client.0.smithi063.stdout:0/27: symlink d0/l5 0 2023-12-12T11:51:43.028 INFO:tasks.workunit.client.0.smithi063.stdout:6/74: dwrite d9/fd [0,4194304] 0 2023-12-12T11:51:43.028 INFO:tasks.workunit.client.0.smithi063.stdout:6/75: fdatasync f5 0 2023-12-12T11:51:43.028 INFO:tasks.workunit.client.0.smithi063.stdout:6/76: fsync f6 0 2023-12-12T11:51:43.029 INFO:tasks.workunit.client.1.smithi093.stdout:0/288: rename d5/f7 to d5/d21/d2f/d54/f5c 0 2023-12-12T11:51:43.029 INFO:tasks.workunit.client.1.smithi093.stdout:0/289: fdatasync d5/dd/d14/d26/f59 0 2023-12-12T11:51:43.029 INFO:tasks.workunit.client.1.smithi093.stdout:0/290: creat d5/d21/d27/f5d x:0 0 0 2023-12-12T11:51:43.029 INFO:tasks.workunit.client.1.smithi093.stdout:0/291: dread - d5/d21/d27/d3a/f56 zero size 2023-12-12T11:51:43.030 INFO:tasks.workunit.client.1.smithi093.stdout:6/393: dwrite d0/d52/d7e/d42/f45 [0,4194304] 0 2023-12-12T11:51:43.030 INFO:tasks.workunit.client.0.smithi063.stdout:4/80: symlink d2/d17/l1e 0 2023-12-12T11:51:43.032 INFO:tasks.workunit.client.1.smithi093.stdout:3/290: creat df/d36/d3d/d59/f5c x:0 0 0 2023-12-12T11:51:43.032 INFO:tasks.workunit.client.1.smithi093.stdout:3/291: write df/d25/d3e/f4b [744498,48215] 0 2023-12-12T11:51:43.034 INFO:tasks.workunit.client.0.smithi063.stdout:0/28: rename d0/l4 to d0/l6 0 2023-12-12T11:51:43.034 INFO:tasks.workunit.client.0.smithi063.stdout:0/29: dwrite - no filename 2023-12-12T11:51:43.034 INFO:tasks.workunit.client.0.smithi063.stdout:0/30: dread - no filename 2023-12-12T11:51:43.034 INFO:tasks.workunit.client.0.smithi063.stdout:0/31: stat d0/l2 0 2023-12-12T11:51:43.034 INFO:tasks.workunit.client.0.smithi063.stdout:0/32: dread - no filename 2023-12-12T11:51:43.034 INFO:tasks.workunit.client.0.smithi063.stdout:0/33: write - no filename 2023-12-12T11:51:43.036 INFO:tasks.workunit.client.1.smithi093.stdout:7/242: symlink da/d15/d2d/l54 0 2023-12-12T11:51:43.037 INFO:tasks.workunit.client.1.smithi093.stdout:9/224: dread d1/f2f [0,4194304] 0 2023-12-12T11:51:43.044 INFO:tasks.workunit.client.0.smithi063.stdout:4/81: creat d2/d17/f1f x:0 0 0 2023-12-12T11:51:43.048 INFO:tasks.workunit.client.0.smithi063.stdout:0/34: unlink d0/l2 0 2023-12-12T11:51:43.051 INFO:tasks.workunit.client.0.smithi063.stdout:6/77: rmdir d9/d10 39 2023-12-12T11:51:43.052 INFO:tasks.workunit.client.0.smithi063.stdout:6/78: write d9/fd [4693541,123800] 0 2023-12-12T11:51:43.052 INFO:tasks.workunit.client.0.smithi063.stdout:6/79: chown d9/d10/l11 668 1 2023-12-12T11:51:43.052 INFO:tasks.workunit.client.0.smithi063.stdout:6/80: chown d9/ca 648 1 2023-12-12T11:51:43.052 INFO:tasks.workunit.client.0.smithi063.stdout:6/81: creat d9/f1a x:0 0 0 2023-12-12T11:51:43.053 INFO:tasks.workunit.client.0.smithi063.stdout:4/82: mknod d2/d8/c20 0 2023-12-12T11:51:43.055 INFO:tasks.workunit.client.0.smithi063.stdout:0/35: mkdir d0/d7 0 2023-12-12T11:51:43.055 INFO:tasks.workunit.client.0.smithi063.stdout:0/36: chown d0/d7 116118 1 2023-12-12T11:51:43.058 INFO:tasks.workunit.client.1.smithi093.stdout:0/292: write d5/f31 [2892081,115868] 0 2023-12-12T11:51:43.058 INFO:tasks.workunit.client.1.smithi093.stdout:0/293: write d5/f30 [546711,88411] 0 2023-12-12T11:51:43.062 INFO:tasks.workunit.client.0.smithi063.stdout:6/82: unlink d9/d10/l19 0 2023-12-12T11:51:43.062 INFO:tasks.workunit.client.0.smithi063.stdout:6/83: chown c8 2485 1 2023-12-12T11:51:43.063 INFO:tasks.workunit.client.0.smithi063.stdout:4/83: mknod d2/c21 0 2023-12-12T11:51:43.063 INFO:tasks.workunit.client.0.smithi063.stdout:4/84: creat d2/d17/f22 x:0 0 0 2023-12-12T11:51:43.067 INFO:tasks.workunit.client.0.smithi063.stdout:0/37: creat d0/f8 x:0 0 0 2023-12-12T11:51:43.067 INFO:tasks.workunit.client.0.smithi063.stdout:6/84: creat d9/d10/f1b x:0 0 0 2023-12-12T11:51:43.071 INFO:tasks.workunit.client.1.smithi093.stdout:1/296: truncate d4/d1c/d2a/f2c 8532 0 2023-12-12T11:51:43.072 INFO:tasks.workunit.client.1.smithi093.stdout:7/243: dwrite da/de/f44 [0,4194304] 0 2023-12-12T11:51:43.072 INFO:tasks.workunit.client.0.smithi063.stdout:0/38: mkdir d0/d9 0 2023-12-12T11:51:43.075 INFO:tasks.workunit.client.1.smithi093.stdout:4/462: mkdir d0/d31/d5c/d66/d94 0 2023-12-12T11:51:43.076 INFO:tasks.workunit.client.1.smithi093.stdout:4/463: write d0/f20 [4366946,80047] 0 2023-12-12T11:51:43.077 INFO:tasks.workunit.client.0.smithi063.stdout:9/33: sync 2023-12-12T11:51:43.077 INFO:tasks.workunit.client.0.smithi063.stdout:9/34: dread - f5 zero size 2023-12-12T11:51:43.077 INFO:tasks.workunit.client.0.smithi063.stdout:9/35: fdatasync f5 0 2023-12-12T11:51:43.077 INFO:tasks.workunit.client.0.smithi063.stdout:3/43: sync 2023-12-12T11:51:43.077 INFO:tasks.workunit.client.0.smithi063.stdout:3/44: creat d4/fb x:0 0 0 2023-12-12T11:51:43.079 INFO:tasks.workunit.client.1.smithi093.stdout:8/270: mkdir d3/d1a/d1f/d29/d30/d58 0 2023-12-12T11:51:43.088 INFO:tasks.workunit.client.0.smithi063.stdout:3/45: symlink d4/lc 0 2023-12-12T11:51:43.090 INFO:tasks.workunit.client.0.smithi063.stdout:3/46: dread - d4/fb zero size 2023-12-12T11:51:43.095 INFO:tasks.workunit.client.1.smithi093.stdout:6/394: rename d0/da/d14/f7a to d0/f96 0 2023-12-12T11:51:43.098 INFO:tasks.workunit.client.1.smithi093.stdout:9/225: mknod d1/d23/c4e 0 2023-12-12T11:51:43.099 INFO:tasks.workunit.client.1.smithi093.stdout:0/294: stat d5/dd/c22 0 2023-12-12T11:51:43.102 INFO:tasks.workunit.client.1.smithi093.stdout:1/297: creat d4/d1c/f66 x:0 0 0 2023-12-12T11:51:43.114 INFO:tasks.workunit.client.1.smithi093.stdout:7/244: mknod da/d15/d2d/d2f/c55 0 2023-12-12T11:51:43.118 INFO:tasks.workunit.client.1.smithi093.stdout:4/464: creat d0/d31/d5c/d6c/f95 x:0 0 0 2023-12-12T11:51:43.118 INFO:tasks.workunit.client.1.smithi093.stdout:4/465: chown d0/d31/c38 143571017 1 2023-12-12T11:51:43.118 INFO:tasks.workunit.client.1.smithi093.stdout:4/466: write d0/d36/d49/f7e [786393,60520] 0 2023-12-12T11:51:43.119 INFO:tasks.workunit.client.0.smithi063.stdout:3/47: write d4/f7 [8970,6665] 0 2023-12-12T11:51:43.119 INFO:tasks.workunit.client.0.smithi063.stdout:3/48: fdatasync f0 0 2023-12-12T11:51:43.121 INFO:tasks.workunit.client.1.smithi093.stdout:6/395: mknod d0/da/d32/d40/d4d/c97 0 2023-12-12T11:51:43.122 INFO:tasks.workunit.client.0.smithi063.stdout:9/36: dread f0 [0,4194304] 0 2023-12-12T11:51:43.126 INFO:tasks.workunit.client.1.smithi093.stdout:0/295: rmdir d5/d21/d2f/d54 39 2023-12-12T11:51:43.127 INFO:tasks.workunit.client.1.smithi093.stdout:0/296: fdatasync d5/dd/f53 0 2023-12-12T11:51:43.127 INFO:tasks.workunit.client.1.smithi093.stdout:3/292: truncate fc 1716503 0 2023-12-12T11:51:43.127 INFO:tasks.workunit.client.1.smithi093.stdout:0/297: write d5/dd/f1a [1236397,33723] 0 2023-12-12T11:51:43.127 INFO:tasks.workunit.client.1.smithi093.stdout:0/298: creat d5/dd/d33/f5e x:0 0 0 2023-12-12T11:51:43.127 INFO:tasks.workunit.client.1.smithi093.stdout:0/299: readlink d5/dd/l11 0 2023-12-12T11:51:43.130 INFO:tasks.workunit.client.0.smithi063.stdout:9/37: link f5 d7/f9 0 2023-12-12T11:51:43.130 INFO:tasks.workunit.client.0.smithi063.stdout:9/38: stat d7/f9 0 2023-12-12T11:51:43.130 INFO:tasks.workunit.client.0.smithi063.stdout:9/39: chown d7/f9 3868410 1 2023-12-12T11:51:43.130 INFO:tasks.workunit.client.0.smithi063.stdout:9/40: truncate f5 87578 0 2023-12-12T11:51:43.130 INFO:tasks.workunit.client.0.smithi063.stdout:9/41: write f0 [2223113,34964] 0 2023-12-12T11:51:43.132 INFO:tasks.workunit.client.0.smithi063.stdout:6/85: dwrite d9/d10/f15 [0,4194304] 0 2023-12-12T11:51:43.132 INFO:tasks.workunit.client.0.smithi063.stdout:6/86: creat d9/f1c x:0 0 0 2023-12-12T11:51:43.132 INFO:tasks.workunit.client.0.smithi063.stdout:6/87: chown d9/f1c 2773 1 2023-12-12T11:51:43.132 INFO:tasks.workunit.client.1.smithi093.stdout:1/298: dread d4/fd [0,4194304] 0 2023-12-12T11:51:43.134 INFO:tasks.workunit.client.1.smithi093.stdout:7/245: creat da/de/d46/d4f/f56 x:0 0 0 2023-12-12T11:51:43.134 INFO:tasks.workunit.client.1.smithi093.stdout:4/467: mkdir d0/d87/d79/d96 0 2023-12-12T11:51:43.135 INFO:tasks.workunit.client.1.smithi093.stdout:4/468: dread - d0/f27 zero size 2023-12-12T11:51:43.135 INFO:tasks.workunit.client.1.smithi093.stdout:4/469: stat d0/f47 0 2023-12-12T11:51:43.135 INFO:tasks.workunit.client.1.smithi093.stdout:4/470: write d0/d36/d49/f4a [1241119,47039] 0 2023-12-12T11:51:43.135 INFO:tasks.workunit.client.0.smithi063.stdout:9/42: link f6 d7/fa 0 2023-12-12T11:51:43.140 INFO:tasks.workunit.client.1.smithi093.stdout:3/293: mknod df/d30/c5d 0 2023-12-12T11:51:43.140 INFO:tasks.workunit.client.1.smithi093.stdout:3/294: creat df/d36/d3d/d42/f5e x:0 0 0 2023-12-12T11:51:43.141 INFO:tasks.workunit.client.1.smithi093.stdout:3/295: truncate df/d36/d3d/d59/f5c 1028477 0 2023-12-12T11:51:43.141 INFO:tasks.workunit.client.1.smithi093.stdout:3/296: truncate df/d22/f23 687785 0 2023-12-12T11:51:43.141 INFO:tasks.workunit.client.0.smithi063.stdout:6/88: mknod d9/d10/c1d 0 2023-12-12T11:51:43.144 INFO:tasks.workunit.client.0.smithi063.stdout:9/43: symlink d7/lb 0 2023-12-12T11:51:43.145 INFO:tasks.workunit.client.0.smithi063.stdout:9/44: creat d7/fc x:0 0 0 2023-12-12T11:51:43.145 INFO:tasks.workunit.client.0.smithi063.stdout:9/45: truncate d7/f8 485231 0 2023-12-12T11:51:43.145 INFO:tasks.workunit.client.0.smithi063.stdout:9/46: creat d7/fd x:0 0 0 2023-12-12T11:51:43.146 INFO:tasks.workunit.client.1.smithi093.stdout:6/396: getdents d0 0 2023-12-12T11:51:43.150 INFO:tasks.workunit.client.1.smithi093.stdout:7/246: creat da/f57 x:0 0 0 2023-12-12T11:51:43.151 INFO:tasks.workunit.client.1.smithi093.stdout:0/300: write d5/dd/d14/d26/f34 [3606438,98586] 0 2023-12-12T11:51:43.153 INFO:tasks.workunit.client.0.smithi063.stdout:4/85: dwrite d2/d17/f1f [0,4194304] 0 2023-12-12T11:51:43.154 INFO:tasks.workunit.client.0.smithi063.stdout:6/89: rename d9/f1c to d9/d10/f1e 0 2023-12-12T11:51:43.154 INFO:tasks.workunit.client.0.smithi063.stdout:6/90: chown f5 2812 1 2023-12-12T11:51:43.154 INFO:tasks.workunit.client.0.smithi063.stdout:6/91: creat d9/f1f x:0 0 0 2023-12-12T11:51:43.155 INFO:tasks.workunit.client.0.smithi063.stdout:6/92: write d9/f1f [73241,33460] 0 2023-12-12T11:51:43.155 INFO:tasks.workunit.client.0.smithi063.stdout:6/93: write d9/d10/f15 [4739681,105822] 0 2023-12-12T11:51:43.155 INFO:tasks.workunit.client.0.smithi063.stdout:6/94: write d9/f1a [250107,23228] 0 2023-12-12T11:51:43.156 INFO:tasks.workunit.client.1.smithi093.stdout:9/226: dwrite d1/d23/f41 [0,4194304] 0 2023-12-12T11:51:43.156 INFO:tasks.workunit.client.0.smithi063.stdout:6/95: creat d9/d10/f20 x:0 0 0 2023-12-12T11:51:43.156 INFO:tasks.workunit.client.0.smithi063.stdout:6/96: fdatasync d9/fd 0 2023-12-12T11:51:43.157 INFO:tasks.workunit.client.0.smithi063.stdout:9/47: dread d7/f8 [0,4194304] 0 2023-12-12T11:51:43.157 INFO:tasks.workunit.client.0.smithi063.stdout:9/48: dread - d7/fa zero size 2023-12-12T11:51:43.163 INFO:tasks.workunit.client.1.smithi093.stdout:4/471: mkdir d0/d36/d61/d97 0 2023-12-12T11:51:43.163 INFO:tasks.workunit.client.1.smithi093.stdout:1/299: dread d4/dc/f32 [0,4194304] 0 2023-12-12T11:51:43.163 INFO:tasks.workunit.client.1.smithi093.stdout:1/300: write d4/d1a/d1b/f3a [1319081,61729] 0 2023-12-12T11:51:43.163 INFO:tasks.workunit.client.1.smithi093.stdout:3/297: truncate df/d25/f32 536821 0 2023-12-12T11:51:43.163 INFO:tasks.workunit.client.1.smithi093.stdout:6/397: symlink d0/d7b/l98 0 2023-12-12T11:51:43.163 INFO:tasks.workunit.client.1.smithi093.stdout:6/398: write d0/d7b/f94 [375724,7522] 0 2023-12-12T11:51:43.165 INFO:tasks.workunit.client.1.smithi093.stdout:1/301: write d4/fd [1115604,82669] 0 2023-12-12T11:51:43.165 INFO:tasks.workunit.client.1.smithi093.stdout:1/302: chown d4/fa 272 1 2023-12-12T11:51:43.167 INFO:tasks.workunit.client.1.smithi093.stdout:9/227: write d1/f2f [451528,63997] 0 2023-12-12T11:51:43.167 INFO:tasks.workunit.client.1.smithi093.stdout:9/228: fsync d1/d12/d1f/d32/f49 0 2023-12-12T11:51:43.168 INFO:tasks.workunit.client.0.smithi063.stdout:4/86: rename d2/c15 to d2/d8/c23 0 2023-12-12T11:51:43.168 INFO:tasks.workunit.client.0.smithi063.stdout:4/87: write d2/d8/fe [687292,100150] 0 2023-12-12T11:51:43.169 INFO:tasks.workunit.client.1.smithi093.stdout:5/189: sync 2023-12-12T11:51:43.169 INFO:tasks.workunit.client.1.smithi093.stdout:2/326: sync 2023-12-12T11:51:43.169 INFO:tasks.workunit.client.0.smithi063.stdout:3/49: dwrite d4/fb [0,4194304] 0 2023-12-12T11:51:43.173 INFO:tasks.workunit.client.0.smithi063.stdout:6/97: rename d9/d10/c1d to d9/d10/c21 0 2023-12-12T11:51:43.174 INFO:tasks.workunit.client.0.smithi063.stdout:6/98: creat d9/d10/f22 x:0 0 0 2023-12-12T11:51:43.176 INFO:tasks.workunit.client.0.smithi063.stdout:6/99: creat d9/d10/f23 x:0 0 0 2023-12-12T11:51:43.176 INFO:tasks.workunit.client.0.smithi063.stdout:6/100: creat d9/f24 x:0 0 0 2023-12-12T11:51:43.184 INFO:tasks.workunit.client.0.smithi063.stdout:9/49: link f5 d7/fe 0 2023-12-12T11:51:43.184 INFO:tasks.workunit.client.0.smithi063.stdout:9/50: creat d7/ff x:0 0 0 2023-12-12T11:51:43.184 INFO:tasks.workunit.client.0.smithi063.stdout:9/51: creat d7/f10 x:0 0 0 2023-12-12T11:51:43.192 INFO:tasks.workunit.client.1.smithi093.stdout:3/298: creat df/d25/d2c/f5f x:0 0 0 2023-12-12T11:51:43.196 INFO:tasks.workunit.client.1.smithi093.stdout:6/399: link d0/d52/c6d d0/da/d14/d38/d43/c99 0 2023-12-12T11:51:43.201 INFO:tasks.workunit.client.1.smithi093.stdout:9/229: unlink d1/c4d 0 2023-12-12T11:51:43.204 INFO:tasks.workunit.client.1.smithi093.stdout:5/190: mknod d0/d7/d8/c45 0 2023-12-12T11:51:43.204 INFO:tasks.workunit.client.1.smithi093.stdout:5/191: readlink d0/d7/l17 0 2023-12-12T11:51:43.204 INFO:tasks.workunit.client.1.smithi093.stdout:5/192: chown d0/d7/d8/de/l1b 18 1 2023-12-12T11:51:43.204 INFO:tasks.workunit.client.1.smithi093.stdout:5/193: fsync d0/d7/f1c 0 2023-12-12T11:51:43.205 INFO:tasks.workunit.client.1.smithi093.stdout:4/472: read d0/f20 [269440,22995] 0 2023-12-12T11:51:43.205 INFO:tasks.workunit.client.1.smithi093.stdout:4/473: stat d0/d36/d40 0 2023-12-12T11:51:43.205 INFO:tasks.workunit.client.1.smithi093.stdout:4/474: read - d0/d36/d40/f8e zero size 2023-12-12T11:51:43.206 INFO:tasks.workunit.client.1.smithi093.stdout:7/247: dwrite da/d15/d2d/f51 [0,4194304] 0 2023-12-12T11:51:43.206 INFO:tasks.workunit.client.1.smithi093.stdout:7/248: write da/d15/d2d/d2f/f3d [434765,78312] 0 2023-12-12T11:51:43.211 INFO:tasks.workunit.client.1.smithi093.stdout:2/327: rename d5/d14/d47/d4e/d51 to d5/d14/d2d/d4c/d54/d67/d69/d6c 0 2023-12-12T11:51:43.212 INFO:tasks.workunit.client.1.smithi093.stdout:3/299: truncate df/f2e 447992 0 2023-12-12T11:51:43.212 INFO:tasks.workunit.client.1.smithi093.stdout:9/230: link d1/d23/d24/f2e d1/f4f 0 2023-12-12T11:51:43.212 INFO:tasks.workunit.client.1.smithi093.stdout:6/400: dread d0/da/d14/f18 [0,4194304] 0 2023-12-12T11:51:43.213 INFO:tasks.workunit.client.1.smithi093.stdout:4/475: stat d0/d36/d49/c92 0 2023-12-12T11:51:43.215 INFO:tasks.workunit.client.0.smithi063.stdout:6/101: mkdir d9/d10/d25 0 2023-12-12T11:51:43.216 INFO:tasks.workunit.client.0.smithi063.stdout:9/52: mkdir d7/d11 0 2023-12-12T11:51:43.218 INFO:tasks.workunit.client.1.smithi093.stdout:7/249: mkdir da/de/d46/d58 0 2023-12-12T11:51:43.228 INFO:tasks.workunit.client.0.smithi063.stdout:4/88: dwrite d2/d17/f22 [0,4194304] 0 2023-12-12T11:51:43.229 INFO:tasks.workunit.client.0.smithi063.stdout:4/89: chown d2 458 1 2023-12-12T11:51:43.229 INFO:tasks.workunit.client.1.smithi093.stdout:6/401: symlink d0/l9a 0 2023-12-12T11:51:43.229 INFO:tasks.workunit.client.1.smithi093.stdout:4/476: rmdir d0/d87 39 2023-12-12T11:51:43.230 INFO:tasks.workunit.client.1.smithi093.stdout:7/250: mkdir da/d15/d59 0 2023-12-12T11:51:43.230 INFO:tasks.workunit.client.1.smithi093.stdout:7/251: truncate da/de/d46/f52 431103 0 2023-12-12T11:51:43.230 INFO:tasks.workunit.client.1.smithi093.stdout:7/252: readlink da/d15/d2d/l54 0 2023-12-12T11:51:43.231 INFO:tasks.workunit.client.1.smithi093.stdout:0/301: dwrite d5/dd/d14/d26/f34 [0,4194304] 0 2023-12-12T11:51:43.231 INFO:tasks.workunit.client.1.smithi093.stdout:0/302: creat d5/d21/d27/f5f x:0 0 0 2023-12-12T11:51:43.231 INFO:tasks.workunit.client.1.smithi093.stdout:4/477: write d0/f32 [98682,45722] 0 2023-12-12T11:51:43.234 INFO:tasks.workunit.client.1.smithi093.stdout:5/194: dread d0/d7/d8/f13 [0,4194304] 0 2023-12-12T11:51:43.236 INFO:tasks.workunit.client.1.smithi093.stdout:7/253: rename da/f1d to da/d15/d19/f5a 0 2023-12-12T11:51:43.240 INFO:tasks.workunit.client.1.smithi093.stdout:8/271: sync 2023-12-12T11:51:43.240 INFO:tasks.workunit.client.1.smithi093.stdout:8/272: fsync d3/f42 0 2023-12-12T11:51:43.242 INFO:tasks.workunit.client.0.smithi063.stdout:9/53: mkdir d7/d11/d12 0 2023-12-12T11:51:43.245 INFO:tasks.workunit.client.1.smithi093.stdout:0/303: unlink d5/d21/c39 0 2023-12-12T11:51:43.245 INFO:tasks.workunit.client.1.smithi093.stdout:0/304: creat d5/d21/d27/d3a/f60 x:0 0 0 2023-12-12T11:51:43.247 INFO:tasks.workunit.client.0.smithi063.stdout:4/90: dread d2/d8/fa [0,4194304] 0 2023-12-12T11:51:43.252 INFO:tasks.workunit.client.1.smithi093.stdout:8/273: mkdir d3/d1a/d1f/d59 0 2023-12-12T11:51:43.253 INFO:tasks.workunit.client.0.smithi063.stdout:9/54: creat d7/d11/d12/f13 x:0 0 0 2023-12-12T11:51:43.253 INFO:tasks.workunit.client.0.smithi063.stdout:9/55: stat d7/fd 0 2023-12-12T11:51:43.256 INFO:tasks.workunit.client.0.smithi063.stdout:4/91: unlink d2/d17/l1c 0 2023-12-12T11:51:43.260 INFO:tasks.workunit.client.1.smithi093.stdout:0/305: link d5/dd/f35 d5/d41/f61 0 2023-12-12T11:51:43.260 INFO:tasks.workunit.client.0.smithi063.stdout:6/102: dread d9/fc [4194304,4194304] 0 2023-12-12T11:51:43.261 INFO:tasks.workunit.client.0.smithi063.stdout:9/56: rename d7/fc to d7/f14 0 2023-12-12T11:51:43.261 INFO:tasks.workunit.client.0.smithi063.stdout:9/57: dread - d7/fa zero size 2023-12-12T11:51:43.263 INFO:tasks.workunit.client.1.smithi093.stdout:5/195: rmdir d0/d7/d36/d38 39 2023-12-12T11:51:43.263 INFO:tasks.workunit.client.1.smithi093.stdout:5/196: dread - d0/d7/d36/d38/f40 zero size 2023-12-12T11:51:43.265 INFO:tasks.workunit.client.0.smithi063.stdout:6/103: symlink d9/d10/l26 0 2023-12-12T11:51:43.265 INFO:tasks.workunit.client.0.smithi063.stdout:4/92: symlink d2/l24 0 2023-12-12T11:51:43.266 INFO:tasks.workunit.client.1.smithi093.stdout:8/274: unlink d3/d1a/d1f/d29/d30/f34 0 2023-12-12T11:51:43.268 INFO:tasks.workunit.client.0.smithi063.stdout:4/93: link d2/d8/fe d2/f25 0 2023-12-12T11:51:43.269 INFO:tasks.workunit.client.1.smithi093.stdout:1/303: dwrite d4/fd [0,4194304] 0 2023-12-12T11:51:43.269 INFO:tasks.workunit.client.1.smithi093.stdout:4/478: dread d0/ff [0,4194304] 0 2023-12-12T11:51:43.269 INFO:tasks.workunit.client.1.smithi093.stdout:1/304: chown d4/dc/f28 8539 1 2023-12-12T11:51:43.270 INFO:tasks.workunit.client.0.smithi063.stdout:4/94: creat d2/d8/f26 x:0 0 0 2023-12-12T11:51:43.271 INFO:tasks.workunit.client.1.smithi093.stdout:1/305: write d4/dc/f18 [1068885,72109] 0 2023-12-12T11:51:43.271 INFO:tasks.workunit.client.1.smithi093.stdout:2/328: dwrite d5/d31/f4a [0,4194304] 0 2023-12-12T11:51:43.271 INFO:tasks.workunit.client.1.smithi093.stdout:3/300: dwrite df/d22/f27 [0,4194304] 0 2023-12-12T11:51:43.273 INFO:tasks.workunit.client.1.smithi093.stdout:8/275: creat d3/d1a/d1f/f5a x:0 0 0 2023-12-12T11:51:43.278 INFO:tasks.workunit.client.0.smithi063.stdout:4/95: symlink d2/d8/d14/l27 0 2023-12-12T11:51:43.280 INFO:tasks.workunit.client.0.smithi063.stdout:4/96: rename d2/d17 to d2/d17/d28 22 2023-12-12T11:51:43.283 INFO:tasks.workunit.client.1.smithi093.stdout:4/479: mkdir d0/d31/d89/d98 0 2023-12-12T11:51:43.286 INFO:tasks.workunit.client.1.smithi093.stdout:4/480: read d0/d36/d49/f4a [375482,70615] 0 2023-12-12T11:51:43.286 INFO:tasks.workunit.client.1.smithi093.stdout:4/481: read - d0/d31/d5c/d6c/f95 zero size 2023-12-12T11:51:43.286 INFO:tasks.workunit.client.1.smithi093.stdout:4/482: readlink d0/d36/l80 0 2023-12-12T11:51:43.287 INFO:tasks.workunit.client.1.smithi093.stdout:5/197: write d0/d7/d8/de/f28 [3913845,25393] 0 2023-12-12T11:51:43.291 INFO:tasks.workunit.client.0.smithi063.stdout:6/104: write f4 [2217441,18574] 0 2023-12-12T11:51:43.292 INFO:tasks.workunit.client.1.smithi093.stdout:9/231: dwrite d1/d12/d1f/f3a [0,4194304] 0 2023-12-12T11:51:43.292 INFO:tasks.workunit.client.0.smithi063.stdout:6/105: creat d9/f27 x:0 0 0 2023-12-12T11:51:43.294 INFO:tasks.workunit.client.0.smithi063.stdout:4/97: read d2/d8/f12 [1550480,21102] 0 2023-12-12T11:51:43.294 INFO:tasks.workunit.client.0.smithi063.stdout:4/98: readlink d2/d17/l1e 0 2023-12-12T11:51:43.294 INFO:tasks.workunit.client.0.smithi063.stdout:4/99: truncate d2/f1d 685862 0 2023-12-12T11:51:43.294 INFO:tasks.workunit.client.0.smithi063.stdout:4/100: chown d2/l24 3 1 2023-12-12T11:51:43.296 INFO:tasks.workunit.client.1.smithi093.stdout:2/329: creat d5/d14/d27/f6d x:0 0 0 2023-12-12T11:51:43.298 INFO:tasks.workunit.client.0.smithi063.stdout:4/101: symlink d2/d17/l29 0 2023-12-12T11:51:43.298 INFO:tasks.workunit.client.0.smithi063.stdout:4/102: fdatasync d2/d8/f12 0 2023-12-12T11:51:43.301 INFO:tasks.workunit.client.1.smithi093.stdout:3/301: symlink df/d25/l60 0 2023-12-12T11:51:43.303 INFO:tasks.workunit.client.0.smithi063.stdout:3/50: dwrite d4/f7 [0,4194304] 0 2023-12-12T11:51:43.305 INFO:tasks.workunit.client.1.smithi093.stdout:8/276: mknod d3/d1a/d1f/d29/d3a/c5b 0 2023-12-12T11:51:43.305 INFO:tasks.workunit.client.1.smithi093.stdout:8/277: dread - d3/f57 zero size 2023-12-12T11:51:43.305 INFO:tasks.workunit.client.0.smithi063.stdout:1/42: sync 2023-12-12T11:51:43.306 INFO:tasks.workunit.client.0.smithi063.stdout:1/43: write d3/db/fc [963849,111352] 0 2023-12-12T11:51:43.313 INFO:tasks.workunit.client.1.smithi093.stdout:0/306: fsync d5/d21/d27/f5f 0 2023-12-12T11:51:43.316 INFO:tasks.workunit.client.1.smithi093.stdout:9/232: dread d1/f16 [0,4194304] 0 2023-12-12T11:51:43.324 INFO:tasks.workunit.client.0.smithi063.stdout:9/58: dwrite d7/f10 [0,4194304] 0 2023-12-12T11:51:43.324 INFO:tasks.workunit.client.0.smithi063.stdout:9/59: chown d7/d11 773392229 1 2023-12-12T11:51:43.326 INFO:tasks.workunit.client.1.smithi093.stdout:4/483: dwrite d0/f1d [4194304,4194304] 0 2023-12-12T11:51:43.327 INFO:tasks.workunit.client.1.smithi093.stdout:3/302: dread df/f1c [0,4194304] 0 2023-12-12T11:51:43.330 INFO:tasks.workunit.client.1.smithi093.stdout:7/254: dwrite da/de/f10 [0,4194304] 0 2023-12-12T11:51:43.330 INFO:tasks.workunit.client.1.smithi093.stdout:7/255: chown da/l28 105062 1 2023-12-12T11:51:43.330 INFO:tasks.workunit.client.1.smithi093.stdout:3/303: write df/d30/d33/f3a [892886,53544] 0 2023-12-12T11:51:43.330 INFO:tasks.workunit.client.1.smithi093.stdout:7/256: dread - da/d15/d2d/f50 zero size 2023-12-12T11:51:43.338 INFO:tasks.workunit.client.0.smithi063.stdout:1/44: write f2 [3573479,39217] 0 2023-12-12T11:51:43.338 INFO:tasks.workunit.client.0.smithi063.stdout:1/45: creat d3/db/fd x:0 0 0 2023-12-12T11:51:43.339 INFO:tasks.workunit.client.0.smithi063.stdout:1/46: write d3/db/fd [652784,131043] 0 2023-12-12T11:51:43.339 INFO:tasks.workunit.client.0.smithi063.stdout:1/47: chown d3/f9 0 1 2023-12-12T11:51:43.340 INFO:tasks.workunit.client.0.smithi063.stdout:1/48: creat d3/db/fe x:0 0 0 2023-12-12T11:51:43.348 INFO:tasks.workunit.client.0.smithi063.stdout:3/51: getdents d4 0 2023-12-12T11:51:43.348 INFO:tasks.workunit.client.0.smithi063.stdout:3/52: chown d4/f6 171076850 1 2023-12-12T11:51:43.352 INFO:tasks.workunit.client.0.smithi063.stdout:9/60: write d7/f10 [1967106,7842] 0 2023-12-12T11:51:43.353 INFO:tasks.workunit.client.1.smithi093.stdout:1/306: rmdir d4 39 2023-12-12T11:51:43.360 INFO:tasks.workunit.client.1.smithi093.stdout:5/198: rmdir d0/d7/d8 39 2023-12-12T11:51:43.360 INFO:tasks.workunit.client.1.smithi093.stdout:5/199: write d0/d7/d36/f32 [204109,45889] 0 2023-12-12T11:51:43.362 INFO:tasks.workunit.client.1.smithi093.stdout:2/330: dwrite d5/d14/d2d/f1c [0,4194304] 0 2023-12-12T11:51:43.362 INFO:tasks.workunit.client.0.smithi063.stdout:1/49: symlink d3/db/lf 0 2023-12-12T11:51:43.364 INFO:tasks.workunit.client.1.smithi093.stdout:0/307: dwrite d5/d21/d27/d3a/f4a [0,4194304] 0 2023-12-12T11:51:43.365 INFO:tasks.workunit.client.0.smithi063.stdout:4/103: dwrite d2/d17/f22 [0,4194304] 0 2023-12-12T11:51:43.365 INFO:tasks.workunit.client.0.smithi063.stdout:4/104: fdatasync d2/f6 0 2023-12-12T11:51:43.374 INFO:tasks.workunit.client.0.smithi063.stdout:3/53: creat d4/fd x:0 0 0 2023-12-12T11:51:43.379 INFO:tasks.workunit.client.1.smithi093.stdout:8/278: rename d3/f57 to d3/d1a/d1f/d29/d3a/f5c 0 2023-12-12T11:51:43.382 INFO:tasks.workunit.client.1.smithi093.stdout:9/233: mknod d1/d12/d1f/d3d/c50 0 2023-12-12T11:51:43.382 INFO:tasks.workunit.client.1.smithi093.stdout:9/234: write d1/d23/f2a [953146,63284] 0 2023-12-12T11:51:43.382 INFO:tasks.workunit.client.0.smithi063.stdout:4/105: dread d2/f6 [0,4194304] 0 2023-12-12T11:51:43.382 INFO:tasks.workunit.client.0.smithi063.stdout:4/106: write d2/d8/f26 [914090,19746] 0 2023-12-12T11:51:43.389 INFO:tasks.workunit.client.1.smithi093.stdout:3/304: link df/d30/d33/c4f df/d30/d33/c61 0 2023-12-12T11:51:43.390 INFO:tasks.workunit.client.1.smithi093.stdout:3/305: chown df/d25/d3e/c48 16989938 1 2023-12-12T11:51:43.391 INFO:tasks.workunit.client.1.smithi093.stdout:1/307: mknod d4/d1a/d1b/d26/d31/c67 0 2023-12-12T11:51:43.391 INFO:tasks.workunit.client.0.smithi063.stdout:8/147: sync 2023-12-12T11:51:43.392 INFO:tasks.workunit.client.0.smithi063.stdout:3/54: mknod d4/ce 0 2023-12-12T11:51:43.394 INFO:tasks.workunit.client.1.smithi093.stdout:5/200: mknod d0/d7/d8/de/c46 0 2023-12-12T11:51:43.398 INFO:tasks.workunit.client.1.smithi093.stdout:4/484: dwrite d0/d36/f75 [0,4194304] 0 2023-12-12T11:51:43.398 INFO:tasks.workunit.client.1.smithi093.stdout:4/485: getdents d0/d87/d79/d86 0 2023-12-12T11:51:43.399 INFO:tasks.workunit.client.0.smithi063.stdout:7/54: sync 2023-12-12T11:51:43.399 INFO:tasks.workunit.client.0.smithi063.stdout:2/41: sync 2023-12-12T11:51:43.399 INFO:tasks.workunit.client.0.smithi063.stdout:0/39: sync 2023-12-12T11:51:43.399 INFO:tasks.workunit.client.0.smithi063.stdout:5/102: sync 2023-12-12T11:51:43.399 INFO:tasks.workunit.client.0.smithi063.stdout:7/55: creat de/f13 x:0 0 0 2023-12-12T11:51:43.399 INFO:tasks.workunit.client.0.smithi063.stdout:7/56: fsync f4 0 2023-12-12T11:51:43.403 INFO:tasks.workunit.client.1.smithi093.stdout:4/486: write d0/d36/d49/f7e [499357,58572] 0 2023-12-12T11:51:43.405 INFO:tasks.workunit.client.0.smithi063.stdout:8/148: dread d4/de/d11/f18 [0,4194304] 0 2023-12-12T11:51:43.405 INFO:tasks.workunit.client.0.smithi063.stdout:8/149: chown f0 1 1 2023-12-12T11:51:43.411 INFO:tasks.workunit.client.1.smithi093.stdout:2/331: creat d5/f6e x:0 0 0 2023-12-12T11:51:43.412 INFO:tasks.workunit.client.0.smithi063.stdout:4/107: dread d2/d17/f1f [0,4194304] 0 2023-12-12T11:51:43.412 INFO:tasks.workunit.client.0.smithi063.stdout:4/108: fdatasync d2/d17/f22 0 2023-12-12T11:51:43.412 INFO:tasks.workunit.client.0.smithi063.stdout:0/40: rename d0/l1 to d0/d7/la 0 2023-12-12T11:51:43.415 INFO:tasks.workunit.client.0.smithi063.stdout:7/57: rename de/c11 to de/c14 0 2023-12-12T11:51:43.415 INFO:tasks.workunit.client.0.smithi063.stdout:7/58: fsync de/f12 0 2023-12-12T11:51:43.415 INFO:tasks.workunit.client.0.smithi063.stdout:4/109: write d2/f25 [486394,107348] 0 2023-12-12T11:51:43.415 INFO:tasks.workunit.client.0.smithi063.stdout:2/42: rmdir d0 39 2023-12-12T11:51:43.418 INFO:tasks.workunit.client.0.smithi063.stdout:0/41: creat d0/d9/fb x:0 0 0 2023-12-12T11:51:43.418 INFO:tasks.workunit.client.0.smithi063.stdout:0/42: chown d0/d7/la 108643711 1 2023-12-12T11:51:43.418 INFO:tasks.workunit.client.0.smithi063.stdout:0/43: chown d0/d7 0 1 2023-12-12T11:51:43.418 INFO:tasks.workunit.client.1.smithi093.stdout:0/308: truncate d5/d21/d2f/f3d 379069 0 2023-12-12T11:51:43.418 INFO:tasks.workunit.client.1.smithi093.stdout:0/309: fdatasync d5/d21/f4c 0 2023-12-12T11:51:43.425 INFO:tasks.workunit.client.0.smithi063.stdout:1/50: dwrite d3/f7 [0,4194304] 0 2023-12-12T11:51:43.427 INFO:tasks.workunit.client.1.smithi093.stdout:8/279: symlink d3/d1a/l5d 0 2023-12-12T11:51:43.427 INFO:tasks.workunit.client.1.smithi093.stdout:9/235: link d1/d12/f4c d1/d23/d24/d29/d43/f51 0 2023-12-12T11:51:43.427 INFO:tasks.workunit.client.1.smithi093.stdout:3/306: truncate df/d22/f23 64943 0 2023-12-12T11:51:43.427 INFO:tasks.workunit.client.1.smithi093.stdout:9/236: creat d1/d23/f52 x:0 0 0 2023-12-12T11:51:43.427 INFO:tasks.workunit.client.1.smithi093.stdout:3/307: fsync fc 0 2023-12-12T11:51:43.428 INFO:tasks.workunit.client.1.smithi093.stdout:9/237: stat d1/d23/d24/d29/d43/f51 0 2023-12-12T11:51:43.428 INFO:tasks.workunit.client.1.smithi093.stdout:1/308: link d4/l5 d4/d1a/d1b/d26/d31/l68 0 2023-12-12T11:51:43.428 INFO:tasks.workunit.client.1.smithi093.stdout:5/201: symlink d0/d7/l47 0 2023-12-12T11:51:43.430 INFO:tasks.workunit.client.1.smithi093.stdout:0/310: mkdir d5/dd/d62 0 2023-12-12T11:51:43.431 INFO:tasks.workunit.client.1.smithi093.stdout:4/487: write d0/d31/f2c [1869040,68243] 0 2023-12-12T11:51:43.433 INFO:tasks.workunit.client.1.smithi093.stdout:8/280: link d3/lf d3/l5e 0 2023-12-12T11:51:43.434 INFO:tasks.workunit.client.1.smithi093.stdout:0/311: creat d5/dd/d14/d26/d58/f63 x:0 0 0 2023-12-12T11:51:43.434 INFO:tasks.workunit.client.1.smithi093.stdout:0/312: chown d5/d21/d27/f5a 9552 1 2023-12-12T11:51:43.434 INFO:tasks.workunit.client.1.smithi093.stdout:0/313: stat d5/d21/d2f 0 2023-12-12T11:51:43.434 INFO:tasks.workunit.client.0.smithi063.stdout:5/103: read d7/f13 [2372709,45096] 0 2023-12-12T11:51:43.435 INFO:tasks.workunit.client.0.smithi063.stdout:0/44: link d0/l3 d0/d9/lc 0 2023-12-12T11:51:43.435 INFO:tasks.workunit.client.0.smithi063.stdout:2/43: mknod d0/ce 0 2023-12-12T11:51:43.435 INFO:tasks.workunit.client.0.smithi063.stdout:0/45: dread - d0/f8 zero size 2023-12-12T11:51:43.435 INFO:tasks.workunit.client.0.smithi063.stdout:0/46: read - d0/f8 zero size 2023-12-12T11:51:43.437 INFO:tasks.workunit.client.1.smithi093.stdout:9/238: getdents d1/d12/d1f/d32 0 2023-12-12T11:51:43.437 INFO:tasks.workunit.client.1.smithi093.stdout:9/239: chown d1/d12/c18 620159 1 2023-12-12T11:51:43.442 INFO:tasks.workunit.client.0.smithi063.stdout:9/61: dwrite d7/f9 [0,4194304] 0 2023-12-12T11:51:43.442 INFO:tasks.workunit.client.1.smithi093.stdout:7/257: dwrite da/d15/d2d/f3c [0,4194304] 0 2023-12-12T11:51:43.443 INFO:tasks.workunit.client.0.smithi063.stdout:3/55: read d4/f6 [6045532,76368] 0 2023-12-12T11:51:43.443 INFO:tasks.workunit.client.1.smithi093.stdout:0/314: mkdir d5/dd/d14/d26/d58/d64 0 2023-12-12T11:51:43.448 INFO:tasks.workunit.client.1.smithi093.stdout:9/240: dread d1/d12/f1c [0,4194304] 0 2023-12-12T11:51:43.451 INFO:tasks.workunit.client.0.smithi063.stdout:1/51: write d3/f7 [1022016,126556] 0 2023-12-12T11:51:43.452 INFO:tasks.workunit.client.0.smithi063.stdout:4/110: truncate d2/d17/f22 2254054 0 2023-12-12T11:51:43.461 INFO:tasks.workunit.client.1.smithi093.stdout:3/308: read df/d30/d33/f3a [773459,23186] 0 2023-12-12T11:51:43.461 INFO:tasks.workunit.client.1.smithi093.stdout:8/281: dread d3/f42 [0,4194304] 0 2023-12-12T11:51:43.461 INFO:tasks.workunit.client.0.smithi063.stdout:2/44: creat d0/ff x:0 0 0 2023-12-12T11:51:43.461 INFO:tasks.workunit.client.0.smithi063.stdout:2/45: chown d0/ld 1703 1 2023-12-12T11:51:43.461 INFO:tasks.workunit.client.0.smithi063.stdout:2/46: fdatasync d0/fb 0 2023-12-12T11:51:43.462 INFO:tasks.workunit.client.1.smithi093.stdout:4/488: rmdir d0/d31 39 2023-12-12T11:51:43.464 INFO:tasks.workunit.client.0.smithi063.stdout:0/47: symlink d0/d9/ld 0 2023-12-12T11:51:43.466 INFO:tasks.workunit.client.1.smithi093.stdout:6/402: sync 2023-12-12T11:51:43.466 INFO:tasks.workunit.client.1.smithi093.stdout:2/332: dwrite d5/f8 [4194304,4194304] 0 2023-12-12T11:51:43.467 INFO:tasks.workunit.client.1.smithi093.stdout:7/258: truncate da/d15/d19/f5a 2807826 0 2023-12-12T11:51:43.468 INFO:tasks.workunit.client.1.smithi093.stdout:7/259: creat da/d15/d2d/f5b x:0 0 0 2023-12-12T11:51:43.468 INFO:tasks.workunit.client.1.smithi093.stdout:5/202: dread d0/d7/d27/d35/f1f [0,4194304] 0 2023-12-12T11:51:43.469 INFO:tasks.workunit.client.1.smithi093.stdout:0/315: mknod d5/dd/c65 0 2023-12-12T11:51:43.470 INFO:tasks.workunit.client.1.smithi093.stdout:0/316: dread - d5/d21/f4c zero size 2023-12-12T11:51:43.472 INFO:tasks.workunit.client.1.smithi093.stdout:9/241: dread d1/d12/d1f/f3a [0,4194304] 0 2023-12-12T11:51:43.477 INFO:tasks.workunit.client.1.smithi093.stdout:8/282: symlink d3/d1a/l5f 0 2023-12-12T11:51:43.477 INFO:tasks.workunit.client.1.smithi093.stdout:8/283: read - d3/d1a/d1f/d29/d3a/f5c zero size 2023-12-12T11:51:43.477 INFO:tasks.workunit.client.1.smithi093.stdout:8/284: write d3/d1a/d1f/f2a [937772,91533] 0 2023-12-12T11:51:43.477 INFO:tasks.workunit.client.1.smithi093.stdout:8/285: chown d3/d1a/d1f/d29/d3a 41845677 1 2023-12-12T11:51:43.483 INFO:tasks.workunit.client.1.smithi093.stdout:4/489: rename d0/d87/f74 to d0/d36/d40/f99 0 2023-12-12T11:51:43.485 INFO:tasks.workunit.client.0.smithi063.stdout:1/52: truncate f2 1335919 0 2023-12-12T11:51:43.486 INFO:tasks.workunit.client.0.smithi063.stdout:9/62: write d7/fe [2669450,117097] 0 2023-12-12T11:51:43.488 INFO:tasks.workunit.client.1.smithi093.stdout:6/403: mknod d0/d52/c9b 0 2023-12-12T11:51:43.488 INFO:tasks.workunit.client.1.smithi093.stdout:6/404: dread - d0/da/d32/d40/d4d/f82 zero size 2023-12-12T11:51:43.489 INFO:tasks.workunit.client.0.smithi063.stdout:4/111: unlink d2/l5 0 2023-12-12T11:51:43.490 INFO:tasks.workunit.client.0.smithi063.stdout:4/112: write d2/d8/f26 [1908067,101991] 0 2023-12-12T11:51:43.490 INFO:tasks.workunit.client.0.smithi063.stdout:4/113: fdatasync d2/d17/f1f 0 2023-12-12T11:51:43.490 INFO:tasks.workunit.client.0.smithi063.stdout:4/114: truncate d2/d8/f26 2801046 0 2023-12-12T11:51:43.492 INFO:tasks.workunit.client.1.smithi093.stdout:2/333: mkdir d5/d14/d47/d56/d6f 0 2023-12-12T11:51:43.493 INFO:tasks.workunit.client.1.smithi093.stdout:7/260: dread da/de/f10 [0,4194304] 0 2023-12-12T11:51:43.493 INFO:tasks.workunit.client.1.smithi093.stdout:7/261: fdatasync da/de/f3e 0 2023-12-12T11:51:43.493 INFO:tasks.workunit.client.0.smithi063.stdout:2/47: write d0/f4 [84741,12433] 0 2023-12-12T11:51:43.494 INFO:tasks.workunit.client.0.smithi063.stdout:0/48: mknod d0/d9/ce 0 2023-12-12T11:51:43.497 INFO:tasks.workunit.client.0.smithi063.stdout:8/150: dwrite d4/f1d [0,4194304] 0 2023-12-12T11:51:43.497 INFO:tasks.workunit.client.0.smithi063.stdout:8/151: chown d4 49815488 1 2023-12-12T11:51:43.497 INFO:tasks.workunit.client.0.smithi063.stdout:8/152: fdatasync d4/de/d11/f14 0 2023-12-12T11:51:43.498 INFO:tasks.workunit.client.1.smithi093.stdout:1/309: dwrite d4/d1a/d1b/d26/d31/f38 [0,4194304] 0 2023-12-12T11:51:43.504 INFO:tasks.workunit.client.0.smithi063.stdout:3/56: mkdir d4/df 0 2023-12-12T11:51:43.506 INFO:tasks.workunit.client.1.smithi093.stdout:6/405: dread d0/d52/f6e [0,4194304] 0 2023-12-12T11:51:43.506 INFO:tasks.workunit.client.1.smithi093.stdout:4/490: dread d0/d36/f59 [0,4194304] 0 2023-12-12T11:51:43.506 INFO:tasks.workunit.client.1.smithi093.stdout:4/491: chown d0/d31/l2a 549 1 2023-12-12T11:51:43.507 INFO:tasks.workunit.client.1.smithi093.stdout:1/310: write d4/d1a/d1b/f3a [974161,123560] 0 2023-12-12T11:51:43.508 INFO:tasks.workunit.client.0.smithi063.stdout:4/115: dread d2/f6 [0,4194304] 0 2023-12-12T11:51:43.511 INFO:tasks.workunit.client.0.smithi063.stdout:7/59: dwrite de/f13 [0,4194304] 0 2023-12-12T11:51:43.511 INFO:tasks.workunit.client.1.smithi093.stdout:5/203: unlink d0/d7/f42 0 2023-12-12T11:51:43.514 INFO:tasks.workunit.client.0.smithi063.stdout:1/53: rename d3/f7 to d3/f10 0 2023-12-12T11:51:43.514 INFO:tasks.workunit.client.0.smithi063.stdout:1/54: readlink d3/la 0 2023-12-12T11:51:43.516 INFO:tasks.workunit.client.1.smithi093.stdout:0/317: creat d5/f66 x:0 0 0 2023-12-12T11:51:43.516 INFO:tasks.workunit.client.1.smithi093.stdout:0/318: creat d5/d21/d27/d3a/f67 x:0 0 0 2023-12-12T11:51:43.518 INFO:tasks.workunit.client.0.smithi063.stdout:9/63: mkdir d7/d15 0 2023-12-12T11:51:43.521 INFO:tasks.workunit.client.0.smithi063.stdout:3/57: dread d4/f6 [4194304,4194304] 0 2023-12-12T11:51:43.521 INFO:tasks.workunit.client.0.smithi063.stdout:0/49: creat d0/d7/ff x:0 0 0 2023-12-12T11:51:43.524 INFO:tasks.workunit.client.0.smithi063.stdout:8/153: link d4/f7 d4/d24/f2c 0 2023-12-12T11:51:43.526 INFO:tasks.workunit.client.1.smithi093.stdout:2/334: creat d5/d14/d5e/f70 x:0 0 0 2023-12-12T11:51:43.526 INFO:tasks.workunit.client.1.smithi093.stdout:2/335: readlink d5/d14/d47/d56/l5d 0 2023-12-12T11:51:43.529 INFO:tasks.workunit.client.1.smithi093.stdout:7/262: link da/de/f30 da/de/f5c 0 2023-12-12T11:51:43.530 INFO:tasks.workunit.client.1.smithi093.stdout:9/242: dwrite d1/d12/f1a [0,4194304] 0 2023-12-12T11:51:43.530 INFO:tasks.workunit.client.1.smithi093.stdout:9/243: truncate d1/d12/f4c 965783 0 2023-12-12T11:51:43.530 INFO:tasks.workunit.client.0.smithi063.stdout:5/104: dwrite d7/d10/f14 [0,4194304] 0 2023-12-12T11:51:43.531 INFO:tasks.workunit.client.1.smithi093.stdout:3/309: dwrite fc [0,4194304] 0 2023-12-12T11:51:43.541 INFO:tasks.workunit.client.0.smithi063.stdout:7/60: mknod de/c15 0 2023-12-12T11:51:43.542 INFO:tasks.workunit.client.0.smithi063.stdout:7/61: read f4 [3574249,120540] 0 2023-12-12T11:51:43.545 INFO:tasks.workunit.client.1.smithi093.stdout:6/406: unlink d0/da/d32/d39/d5b/f64 0 2023-12-12T11:51:43.545 INFO:tasks.workunit.client.1.smithi093.stdout:6/407: truncate d0/da/d14/d38/f4f 500469 0 2023-12-12T11:51:43.545 INFO:tasks.workunit.client.1.smithi093.stdout:6/408: chown d0/d7b/f94 6 1 2023-12-12T11:51:43.546 INFO:tasks.workunit.client.0.smithi063.stdout:1/55: symlink d3/l11 0 2023-12-12T11:51:43.549 INFO:tasks.workunit.client.0.smithi063.stdout:3/58: dread f0 [0,4194304] 0 2023-12-12T11:51:43.549 INFO:tasks.workunit.client.0.smithi063.stdout:2/48: dwrite d0/ff [0,4194304] 0 2023-12-12T11:51:43.549 INFO:tasks.workunit.client.1.smithi093.stdout:9/244: write d1/d12/d1f/f25 [1525220,65539] 0 2023-12-12T11:51:43.549 INFO:tasks.workunit.client.1.smithi093.stdout:9/245: dread - d1/d23/f52 zero size 2023-12-12T11:51:43.550 INFO:tasks.workunit.client.1.smithi093.stdout:1/311: mknod d4/d1c/c69 0 2023-12-12T11:51:43.550 INFO:tasks.workunit.client.1.smithi093.stdout:1/312: fsync f1 0 2023-12-12T11:51:43.551 INFO:tasks.workunit.client.0.smithi063.stdout:9/64: symlink d7/d11/l16 0 2023-12-12T11:51:43.551 INFO:tasks.workunit.client.0.smithi063.stdout:9/65: write d7/f14 [526453,119948] 0 2023-12-12T11:51:43.551 INFO:tasks.workunit.client.0.smithi063.stdout:9/66: write f0 [1167927,28630] 0 2023-12-12T11:51:43.551 INFO:tasks.workunit.client.0.smithi063.stdout:9/67: write d7/fe [714590,37300] 0 2023-12-12T11:51:43.554 INFO:tasks.workunit.client.1.smithi093.stdout:5/204: mkdir d0/d7/d27/d48 0 2023-12-12T11:51:43.557 INFO:tasks.workunit.client.0.smithi063.stdout:0/50: unlink d0/l3 0 2023-12-12T11:51:43.560 INFO:tasks.workunit.client.0.smithi063.stdout:8/154: symlink d4/de/l2d 0 2023-12-12T11:51:43.561 INFO:tasks.workunit.client.1.smithi093.stdout:0/319: symlink d5/dd/d33/l68 0 2023-12-12T11:51:43.576 INFO:tasks.workunit.client.1.smithi093.stdout:8/286: rmdir d3/d1a/d1f/d29/d3a/d40 39 2023-12-12T11:51:43.580 INFO:tasks.workunit.client.1.smithi093.stdout:2/336: getdents d5/d14/d2d/d4c 0 2023-12-12T11:51:43.580 INFO:tasks.workunit.client.1.smithi093.stdout:2/337: dread - d5/d31/f64 zero size 2023-12-12T11:51:43.585 INFO:tasks.workunit.client.1.smithi093.stdout:7/263: mknod da/de/d46/d4f/c5d 0 2023-12-12T11:51:43.588 INFO:tasks.workunit.client.1.smithi093.stdout:3/310: truncate df/f10 1656907 0 2023-12-12T11:51:43.588 INFO:tasks.workunit.client.1.smithi093.stdout:3/311: chown df/d25/d3e 2 1 2023-12-12T11:51:43.588 INFO:tasks.workunit.client.1.smithi093.stdout:3/312: truncate df/d22/f31 520950 0 2023-12-12T11:51:43.590 INFO:tasks.workunit.client.0.smithi063.stdout:4/116: getdents d2/d8 0 2023-12-12T11:51:43.594 INFO:tasks.workunit.client.0.smithi063.stdout:7/62: unlink de/f12 0 2023-12-12T11:51:43.599 INFO:tasks.workunit.client.0.smithi063.stdout:1/56: mkdir d3/db/d12 0 2023-12-12T11:51:43.601 INFO:tasks.workunit.client.1.smithi093.stdout:2/338: read d5/f10 [5498157,114551] 0 2023-12-12T11:51:43.601 INFO:tasks.workunit.client.1.smithi093.stdout:2/339: fdatasync d5/d14/d2d/f42 0 2023-12-12T11:51:43.601 INFO:tasks.workunit.client.1.smithi093.stdout:8/287: dread d3/f6 [0,4194304] 0 2023-12-12T11:51:43.610 INFO:tasks.workunit.client.0.smithi063.stdout:0/51: dwrite d0/d9/fb [0,4194304] 0 2023-12-12T11:51:43.613 INFO:tasks.workunit.client.1.smithi093.stdout:9/246: rename d1/d23/c4e to d1/d23/c53 0 2023-12-12T11:51:43.617 INFO:tasks.workunit.client.1.smithi093.stdout:5/205: creat d0/d7/d36/d38/f49 x:0 0 0 2023-12-12T11:51:43.617 INFO:tasks.workunit.client.1.smithi093.stdout:5/206: write d0/d7/d8/de/f3a [797506,15241] 0 2023-12-12T11:51:43.620 INFO:tasks.workunit.client.1.smithi093.stdout:1/313: dwrite d4/d1a/d1b/d26/f27 [0,4194304] 0 2023-12-12T11:51:43.622 INFO:tasks.workunit.client.1.smithi093.stdout:7/264: mknod da/d15/d19/c5e 0 2023-12-12T11:51:43.622 INFO:tasks.workunit.client.1.smithi093.stdout:7/265: readlink l5 0 2023-12-12T11:51:43.622 INFO:tasks.workunit.client.1.smithi093.stdout:7/266: creat da/d15/d2d/d2f/f5f x:0 0 0 2023-12-12T11:51:43.622 INFO:tasks.workunit.client.1.smithi093.stdout:7/267: readlink l2 0 2023-12-12T11:51:43.622 INFO:tasks.workunit.client.1.smithi093.stdout:7/268: chown da/d15/f24 2 1 2023-12-12T11:51:43.626 INFO:tasks.workunit.client.0.smithi063.stdout:8/155: creat d4/de/f2e x:0 0 0 2023-12-12T11:51:43.627 INFO:tasks.workunit.client.1.smithi093.stdout:3/313: symlink df/d36/d3d/d42/l62 0 2023-12-12T11:51:43.627 INFO:tasks.workunit.client.1.smithi093.stdout:3/314: read - df/d25/d2c/f5f zero size 2023-12-12T11:51:43.627 INFO:tasks.workunit.client.0.smithi063.stdout:4/117: creat d2/d8/f2a x:0 0 0 2023-12-12T11:51:43.630 INFO:tasks.workunit.client.1.smithi093.stdout:9/247: dread d1/f1e [0,4194304] 0 2023-12-12T11:51:43.630 INFO:tasks.workunit.client.1.smithi093.stdout:9/248: creat d1/f54 x:0 0 0 2023-12-12T11:51:43.630 INFO:tasks.workunit.client.0.smithi063.stdout:7/63: symlink de/l16 0 2023-12-12T11:51:43.634 INFO:tasks.workunit.client.1.smithi093.stdout:0/320: dwrite d5/dd/d14/d26/f34 [0,4194304] 0 2023-12-12T11:51:43.635 INFO:tasks.workunit.client.0.smithi063.stdout:6/106: sync 2023-12-12T11:51:43.637 INFO:tasks.workunit.client.1.smithi093.stdout:7/269: write da/d15/d19/f5a [2055171,120327] 0 2023-12-12T11:51:43.639 INFO:tasks.workunit.client.1.smithi093.stdout:9/249: dread d1/d12/d1f/f35 [0,4194304] 0 2023-12-12T11:51:43.639 INFO:tasks.workunit.client.1.smithi093.stdout:9/250: fsync d1/d23/f31 0 2023-12-12T11:51:43.639 INFO:tasks.workunit.client.1.smithi093.stdout:6/409: getdents d0/da/d32 0 2023-12-12T11:51:43.639 INFO:tasks.workunit.client.0.smithi063.stdout:8/156: dread d4/de/f13 [0,4194304] 0 2023-12-12T11:51:43.639 INFO:tasks.workunit.client.0.smithi063.stdout:8/157: dread - d4/de/f19 zero size 2023-12-12T11:51:43.639 INFO:tasks.workunit.client.0.smithi063.stdout:8/158: chown d4/d29/c2a 3294780 1 2023-12-12T11:51:43.640 INFO:tasks.workunit.client.1.smithi093.stdout:2/340: dwrite d5/d14/d2d/d4c/d54/f65 [4194304,4194304] 0 2023-12-12T11:51:43.644 INFO:tasks.workunit.client.0.smithi063.stdout:3/59: link d4/la d4/df/l10 0 2023-12-12T11:51:43.644 INFO:tasks.workunit.client.0.smithi063.stdout:3/60: write f0 [1009847,28045] 0 2023-12-12T11:51:43.646 INFO:tasks.workunit.client.1.smithi093.stdout:5/207: stat d0/d7/d36/c3d 0 2023-12-12T11:51:43.652 INFO:tasks.workunit.client.1.smithi093.stdout:2/341: dread d5/d14/d2d/f1e [0,4194304] 0 2023-12-12T11:51:43.652 INFO:tasks.workunit.client.1.smithi093.stdout:2/342: write d5/d14/d2d/d4c/d54/d67/d69/d6c/f5a [164596,23086] 0 2023-12-12T11:51:43.653 INFO:tasks.workunit.client.0.smithi063.stdout:0/52: dwrite d0/d7/ff [0,4194304] 0 2023-12-12T11:51:43.654 INFO:tasks.workunit.client.0.smithi063.stdout:7/64: write de/f13 [4179919,19350] 0 2023-12-12T11:51:43.658 INFO:tasks.workunit.client.1.smithi093.stdout:5/208: dread d0/d7/d27/d35/f1f [0,4194304] 0 2023-12-12T11:51:43.664 INFO:tasks.workunit.client.0.smithi063.stdout:6/107: mknod d9/d10/d25/c28 0 2023-12-12T11:51:43.681 INFO:tasks.workunit.client.1.smithi093.stdout:0/321: rename d5/dd/d14/f18 to d5/dd/d62/f69 0 2023-12-12T11:51:43.690 INFO:tasks.workunit.client.1.smithi093.stdout:7/270: symlink da/de/d46/l60 0 2023-12-12T11:51:43.694 INFO:tasks.workunit.client.1.smithi093.stdout:9/251: link d1/d12/d1f/c34 d1/d12/d1f/d32/c55 0 2023-12-12T11:51:43.694 INFO:tasks.workunit.client.1.smithi093.stdout:9/252: chown d1/d12/d1f/d32/f3f 4004 1 2023-12-12T11:51:43.698 INFO:tasks.workunit.client.0.smithi063.stdout:8/159: dwrite d4/de/d1e/f20 [0,4194304] 0 2023-12-12T11:51:43.701 INFO:tasks.workunit.client.0.smithi063.stdout:3/61: truncate d4/f7 3406603 0 2023-12-12T11:51:43.706 INFO:tasks.workunit.client.0.smithi063.stdout:7/65: rmdir de 39 2023-12-12T11:51:43.706 INFO:tasks.workunit.client.0.smithi063.stdout:7/66: write fb [385331,111762] 0 2023-12-12T11:51:43.708 INFO:tasks.workunit.client.1.smithi093.stdout:2/343: symlink d5/d14/d2d/d4c/d54/d67/l71 0 2023-12-12T11:51:43.709 INFO:tasks.workunit.client.0.smithi063.stdout:4/118: getdents d2/d8/d14 0 2023-12-12T11:51:43.717 INFO:tasks.workunit.client.1.smithi093.stdout:5/209: dwrite d0/f15 [0,4194304] 0 2023-12-12T11:51:43.724 INFO:tasks.workunit.client.0.smithi063.stdout:4/119: read d2/d17/f22 [926231,20873] 0 2023-12-12T11:51:43.725 INFO:tasks.workunit.client.0.smithi063.stdout:4/120: write d2/f1d [1515469,57422] 0 2023-12-12T11:51:43.725 INFO:tasks.workunit.client.1.smithi093.stdout:3/315: rmdir df 39 2023-12-12T11:51:43.726 INFO:tasks.workunit.client.1.smithi093.stdout:4/492: sync 2023-12-12T11:51:43.726 INFO:tasks.workunit.client.0.smithi063.stdout:6/108: dwrite d9/f18 [0,4194304] 0 2023-12-12T11:51:43.732 INFO:tasks.workunit.client.0.smithi063.stdout:0/53: rename d0/d9 to d0/d10 0 2023-12-12T11:51:43.732 INFO:tasks.workunit.client.0.smithi063.stdout:0/54: readlink d0/l6 0 2023-12-12T11:51:43.739 INFO:tasks.workunit.client.0.smithi063.stdout:7/67: rename de/cf to de/c17 0 2023-12-12T11:51:43.743 INFO:tasks.workunit.client.1.smithi093.stdout:9/253: mkdir d1/d23/d24/d29/d43/d56 0 2023-12-12T11:51:43.743 INFO:tasks.workunit.client.1.smithi093.stdout:0/322: unlink d5/d21/d27/d3a/f60 0 2023-12-12T11:51:43.744 INFO:tasks.workunit.client.0.smithi063.stdout:4/121: symlink d2/d8/d14/l2b 0 2023-12-12T11:51:43.751 INFO:tasks.workunit.client.1.smithi093.stdout:5/210: truncate d0/d7/d36/f2a 2157042 0 2023-12-12T11:51:43.753 INFO:tasks.workunit.client.0.smithi063.stdout:7/68: mknod de/c18 0 2023-12-12T11:51:43.758 INFO:tasks.workunit.client.0.smithi063.stdout:7/69: creat de/f19 x:0 0 0 2023-12-12T11:51:43.759 INFO:tasks.workunit.client.1.smithi093.stdout:3/316: creat df/d36/f63 x:0 0 0 2023-12-12T11:51:43.759 INFO:tasks.workunit.client.1.smithi093.stdout:4/493: truncate d0/f1c 1602664 0 2023-12-12T11:51:43.766 INFO:tasks.workunit.client.1.smithi093.stdout:2/344: dwrite d5/d14/d27/f36 [0,4194304] 0 2023-12-12T11:51:43.771 INFO:tasks.workunit.client.1.smithi093.stdout:7/271: dwrite da/d15/d2d/f34 [0,4194304] 0 2023-12-12T11:51:43.771 INFO:tasks.workunit.client.1.smithi093.stdout:7/272: creat da/d15/d2d/d2f/f61 x:0 0 0 2023-12-12T11:51:43.771 INFO:tasks.workunit.client.1.smithi093.stdout:9/254: mkdir d1/d12/d1f/d3d/d57 0 2023-12-12T11:51:43.771 INFO:tasks.workunit.client.1.smithi093.stdout:0/323: truncate d5/dd/d62/f69 4193547 0 2023-12-12T11:51:43.771 INFO:tasks.workunit.client.1.smithi093.stdout:5/211: creat d0/d7/d36/f4a x:0 0 0 2023-12-12T11:51:43.771 INFO:tasks.workunit.client.1.smithi093.stdout:6/410: rename d0/da/d73 to d0/da/d14/d9c 0 2023-12-12T11:51:43.771 INFO:tasks.workunit.client.1.smithi093.stdout:7/273: write da/de/f44 [4675685,107221] 0 2023-12-12T11:51:43.771 INFO:tasks.workunit.client.1.smithi093.stdout:0/324: creat d5/d21/d27/f6a x:0 0 0 2023-12-12T11:51:43.771 INFO:tasks.workunit.client.1.smithi093.stdout:7/274: readlink da/d2e/l35 0 2023-12-12T11:51:43.772 INFO:tasks.workunit.client.1.smithi093.stdout:6/411: write d0/da/d14/f55 [998528,45830] 0 2023-12-12T11:51:43.772 INFO:tasks.workunit.client.1.smithi093.stdout:3/317: creat df/d36/d3d/d59/f64 x:0 0 0 2023-12-12T11:51:43.772 INFO:tasks.workunit.client.1.smithi093.stdout:6/412: chown d0/d52/d7e/f49 3577 1 2023-12-12T11:51:43.772 INFO:tasks.workunit.client.1.smithi093.stdout:7/275: creat da/de/d46/d4f/f62 x:0 0 0 2023-12-12T11:51:43.772 INFO:tasks.workunit.client.1.smithi093.stdout:6/413: creat d0/da/d14/d38/d43/f9d x:0 0 0 2023-12-12T11:51:43.772 INFO:tasks.workunit.client.1.smithi093.stdout:6/414: dread - d0/d52/d7e/f67 zero size 2023-12-12T11:51:43.772 INFO:tasks.workunit.client.0.smithi063.stdout:3/62: read d4/f7 [469066,12762] 0 2023-12-12T11:51:43.772 INFO:tasks.workunit.client.0.smithi063.stdout:3/63: fdatasync d4/f6 0 2023-12-12T11:51:43.777 INFO:tasks.workunit.client.1.smithi093.stdout:2/345: truncate d5/d14/d2d/d4c/d54/f65 8182289 0 2023-12-12T11:51:43.782 INFO:tasks.workunit.client.0.smithi063.stdout:8/160: dwrite d4/de/f13 [0,4194304] 0 2023-12-12T11:51:43.783 INFO:tasks.workunit.client.0.smithi063.stdout:0/55: write d0/d10/fb [4107013,70366] 0 2023-12-12T11:51:43.783 INFO:tasks.workunit.client.0.smithi063.stdout:0/56: chown d0/d7/la 25 1 2023-12-12T11:51:43.787 INFO:tasks.workunit.client.1.smithi093.stdout:9/255: truncate d1/d23/f31 525839 0 2023-12-12T11:51:43.789 INFO:tasks.workunit.client.0.smithi063.stdout:5/105: sync 2023-12-12T11:51:43.803 INFO:tasks.workunit.client.1.smithi093.stdout:4/494: dwrite d0/d36/d40/f63 [0,4194304] 0 2023-12-12T11:51:43.803 INFO:tasks.workunit.client.1.smithi093.stdout:7/276: dread da/d15/d19/f31 [0,4194304] 0 2023-12-12T11:51:43.806 INFO:tasks.workunit.client.0.smithi063.stdout:4/122: dread d2/f6 [0,4194304] 0 2023-12-12T11:51:43.807 INFO:tasks.workunit.client.0.smithi063.stdout:6/109: dwrite d9/fd [0,4194304] 0 2023-12-12T11:51:43.824 INFO:tasks.workunit.client.1.smithi093.stdout:8/288: sync 2023-12-12T11:51:43.825 INFO:tasks.workunit.client.1.smithi093.stdout:1/314: sync 2023-12-12T11:51:43.825 INFO:tasks.workunit.client.1.smithi093.stdout:1/315: stat d4/c45 0 2023-12-12T11:51:43.825 INFO:tasks.workunit.client.1.smithi093.stdout:3/318: mkdir df/d22/d65 0 2023-12-12T11:51:43.825 INFO:tasks.workunit.client.1.smithi093.stdout:1/316: write d4/d1a/f5f [426104,70722] 0 2023-12-12T11:51:43.830 INFO:tasks.workunit.client.1.smithi093.stdout:2/346: mknod d5/d31/c72 0 2023-12-12T11:51:43.830 INFO:tasks.workunit.client.1.smithi093.stdout:7/277: read da/d15/f16 [191801,15355] 0 2023-12-12T11:51:43.830 INFO:tasks.workunit.client.1.smithi093.stdout:2/347: truncate d5/d14/d2d/d12/d44/f4d 315190 0 2023-12-12T11:51:43.844 INFO:tasks.workunit.client.0.smithi063.stdout:8/161: getdents d4/de/d1e 0 2023-12-12T11:51:43.854 INFO:tasks.workunit.client.0.smithi063.stdout:4/123: unlink d2/d8/c11 0 2023-12-12T11:51:43.863 INFO:tasks.workunit.client.0.smithi063.stdout:5/106: dwrite d7/f1a [0,4194304] 0 2023-12-12T11:51:43.870 INFO:tasks.workunit.client.1.smithi093.stdout:9/256: mkdir d1/d23/d24/d29/d43/d58 0 2023-12-12T11:51:43.870 INFO:tasks.workunit.client.1.smithi093.stdout:9/257: fsync d1/d23/f31 0 2023-12-12T11:51:43.870 INFO:tasks.workunit.client.1.smithi093.stdout:9/258: creat d1/f59 x:0 0 0 2023-12-12T11:51:43.870 INFO:tasks.workunit.client.1.smithi093.stdout:9/259: readlink d1/d12/d1f/d32/l45 0 2023-12-12T11:51:43.871 INFO:tasks.workunit.client.0.smithi063.stdout:4/124: dread d2/d17/f1f [0,4194304] 0 2023-12-12T11:51:43.871 INFO:tasks.workunit.client.0.smithi063.stdout:8/162: dread d4/de/d11/f18 [0,4194304] 0 2023-12-12T11:51:43.871 INFO:tasks.workunit.client.0.smithi063.stdout:7/70: dwrite de/f13 [0,4194304] 0 2023-12-12T11:51:43.877 INFO:tasks.workunit.client.1.smithi093.stdout:8/289: dwrite d3/d8/f18 [0,4194304] 0 2023-12-12T11:51:43.877 INFO:tasks.workunit.client.1.smithi093.stdout:8/290: chown d3/f48 11536752 1 2023-12-12T11:51:43.877 INFO:tasks.workunit.client.1.smithi093.stdout:8/291: fdatasync d3/d1a/d1f/f3d 0 2023-12-12T11:51:43.884 INFO:tasks.workunit.client.0.smithi063.stdout:5/107: creat d7/de/f1e x:0 0 0 2023-12-12T11:51:43.884 INFO:tasks.workunit.client.0.smithi063.stdout:5/108: truncate d7/f15 94950 0 2023-12-12T11:51:43.884 INFO:tasks.workunit.client.1.smithi093.stdout:4/495: symlink d0/d87/d79/l9a 0 2023-12-12T11:51:43.884 INFO:tasks.workunit.client.0.smithi063.stdout:8/163: rename d4/c6 to d4/d24/c2f 0 2023-12-12T11:51:43.889 INFO:tasks.workunit.client.1.smithi093.stdout:1/317: creat d4/d1a/d1b/d26/d40/f6a x:0 0 0 2023-12-12T11:51:43.890 INFO:tasks.workunit.client.1.smithi093.stdout:9/260: dread d1/d23/f41 [0,4194304] 0 2023-12-12T11:51:43.894 INFO:tasks.workunit.client.1.smithi093.stdout:7/278: link da/d15/d19/c43 da/d15/c63 0 2023-12-12T11:51:43.894 INFO:tasks.workunit.client.1.smithi093.stdout:7/279: chown da/de/d46/f47 16616060 1 2023-12-12T11:51:43.896 INFO:tasks.workunit.client.1.smithi093.stdout:3/319: dwrite df/f1c [0,4194304] 0 2023-12-12T11:51:43.897 INFO:tasks.workunit.client.0.smithi063.stdout:6/110: dwrite d9/d10/f1b [0,4194304] 0 2023-12-12T11:51:43.897 INFO:tasks.workunit.client.0.smithi063.stdout:6/111: write d9/fb [5228668,31436] 0 2023-12-12T11:51:43.898 INFO:tasks.workunit.client.0.smithi063.stdout:6/112: truncate d9/d10/f1e 187800 0 2023-12-12T11:51:43.898 INFO:tasks.workunit.client.0.smithi063.stdout:8/164: unlink d4/d24/f2c 0 2023-12-12T11:51:43.907 INFO:tasks.workunit.client.0.smithi063.stdout:0/57: dwrite d0/d10/fb [0,4194304] 0 2023-12-12T11:51:43.908 INFO:tasks.workunit.client.0.smithi063.stdout:5/109: dread d7/f9 [0,4194304] 0 2023-12-12T11:51:43.908 INFO:tasks.workunit.client.1.smithi093.stdout:8/292: truncate d3/d1a/d1f/f3f 3279730 0 2023-12-12T11:51:43.913 INFO:tasks.workunit.client.1.smithi093.stdout:4/496: unlink d0/fa 0 2023-12-12T11:51:43.915 INFO:tasks.workunit.client.0.smithi063.stdout:6/113: mknod d9/d10/d25/c29 0 2023-12-12T11:51:43.917 INFO:tasks.workunit.client.1.smithi093.stdout:6/415: rename d0/da/d32/d40 to d0/da/d32/d9e 0 2023-12-12T11:51:43.917 INFO:tasks.workunit.client.1.smithi093.stdout:6/416: dread - d0/f44 zero size 2023-12-12T11:51:43.919 INFO:tasks.workunit.client.1.smithi093.stdout:1/318: getdents d4/dc 0 2023-12-12T11:51:43.920 INFO:tasks.workunit.client.0.smithi063.stdout:2/49: sync 2023-12-12T11:51:43.921 INFO:tasks.workunit.client.0.smithi063.stdout:0/58: rename d0/d10 to d0/d10/d11 22 2023-12-12T11:51:43.924 INFO:tasks.workunit.client.1.smithi093.stdout:9/261: rename d1/f4a to d1/d12/d1f/d32/d42/f5a 0 2023-12-12T11:51:43.933 INFO:tasks.workunit.client.0.smithi063.stdout:4/125: dread d2/d8/f12 [0,4194304] 0 2023-12-12T11:51:43.943 INFO:tasks.workunit.client.0.smithi063.stdout:7/71: dwrite f8 [0,4194304] 0 2023-12-12T11:51:43.945 INFO:tasks.workunit.client.0.smithi063.stdout:2/50: symlink d0/l10 0 2023-12-12T11:51:43.945 INFO:tasks.workunit.client.0.smithi063.stdout:2/51: readlink d0/l7 0 2023-12-12T11:51:43.948 INFO:tasks.workunit.client.0.smithi063.stdout:0/59: stat d0/d7/la 0 2023-12-12T11:51:43.951 INFO:tasks.workunit.client.1.smithi093.stdout:7/280: dwrite da/d15/f2c [0,4194304] 0 2023-12-12T11:51:43.952 INFO:tasks.workunit.client.1.smithi093.stdout:7/281: creat da/de/d46/d4f/f64 x:0 0 0 2023-12-12T11:51:43.953 INFO:tasks.workunit.client.1.smithi093.stdout:8/293: getdents d3/d1a/d1f/d29/d3a/d40 0 2023-12-12T11:51:43.953 INFO:tasks.workunit.client.1.smithi093.stdout:8/294: fsync f0 0 2023-12-12T11:51:43.953 INFO:tasks.workunit.client.1.smithi093.stdout:8/295: dread - d3/d1a/d1f/d29/d3a/f5c zero size 2023-12-12T11:51:43.956 INFO:tasks.workunit.client.1.smithi093.stdout:6/417: rmdir d0/da/d14/d38 39 2023-12-12T11:51:43.959 INFO:tasks.workunit.client.1.smithi093.stdout:9/262: truncate d1/d23/f41 1296413 0 2023-12-12T11:51:43.960 INFO:tasks.workunit.client.1.smithi093.stdout:9/263: fdatasync d1/d23/f41 0 2023-12-12T11:51:43.965 INFO:tasks.workunit.client.0.smithi063.stdout:4/126: getdents d2 0 2023-12-12T11:51:43.966 INFO:tasks.workunit.client.1.smithi093.stdout:8/296: symlink d3/d8/l60 0 2023-12-12T11:51:43.966 INFO:tasks.workunit.client.1.smithi093.stdout:6/418: mknod d0/d52/d6b/c9f 0 2023-12-12T11:51:43.966 INFO:tasks.workunit.client.1.smithi093.stdout:8/297: write d3/d1a/d1f/d29/f54 [450047,97184] 0 2023-12-12T11:51:43.968 INFO:tasks.workunit.client.0.smithi063.stdout:2/52: write d0/ff [1326883,11776] 0 2023-12-12T11:51:43.971 INFO:tasks.workunit.client.0.smithi063.stdout:2/53: mkdir d0/d11 0 2023-12-12T11:51:43.977 INFO:tasks.workunit.client.0.smithi063.stdout:4/127: dread d2/f6 [0,4194304] 0 2023-12-12T11:51:43.979 INFO:tasks.workunit.client.0.smithi063.stdout:4/128: truncate d2/d8/fa 850939 0 2023-12-12T11:51:43.984 INFO:tasks.workunit.client.1.smithi093.stdout:3/320: dwrite df/f43 [0,4194304] 0 2023-12-12T11:51:43.984 INFO:tasks.workunit.client.1.smithi093.stdout:4/497: dwrite d0/d31/f51 [0,4194304] 0 2023-12-12T11:51:43.984 INFO:tasks.workunit.client.1.smithi093.stdout:4/498: chown d0/d87/d79 2 1 2023-12-12T11:51:43.984 INFO:tasks.workunit.client.1.smithi093.stdout:3/321: dread - df/d36/d3d/d42/f5e zero size 2023-12-12T11:51:43.987 INFO:tasks.workunit.client.1.smithi093.stdout:7/282: dread da/d15/d19/f21 [0,4194304] 0 2023-12-12T11:51:43.988 INFO:tasks.workunit.client.0.smithi063.stdout:4/129: creat d2/d8/d14/f2c x:0 0 0 2023-12-12T11:51:43.988 INFO:tasks.workunit.client.1.smithi093.stdout:7/283: write da/de/d46/f52 [1435723,129610] 0 2023-12-12T11:51:43.993 INFO:tasks.workunit.client.1.smithi093.stdout:2/348: sync 2023-12-12T11:51:43.993 INFO:tasks.workunit.client.1.smithi093.stdout:5/212: sync 2023-12-12T11:51:44.004 INFO:tasks.workunit.client.1.smithi093.stdout:6/419: write d0/da/f89 [1713739,12998] 0 2023-12-12T11:51:44.007 INFO:tasks.workunit.client.1.smithi093.stdout:4/499: rmdir d0/d31/d89/d98 0 2023-12-12T11:51:44.008 INFO:tasks.workunit.client.1.smithi093.stdout:3/322: rename df/d22/d65 to df/d30/d33/d66 0 2023-12-12T11:51:44.008 INFO:tasks.workunit.client.1.smithi093.stdout:3/323: fsync df/d30/d33/f3a 0 2023-12-12T11:51:44.008 INFO:tasks.workunit.client.1.smithi093.stdout:3/324: stat df/f1a 0 2023-12-12T11:51:44.008 INFO:tasks.workunit.client.1.smithi093.stdout:3/325: read - df/d36/d3d/d42/f5e zero size 2023-12-12T11:51:44.009 INFO:tasks.workunit.client.1.smithi093.stdout:9/264: dwrite d1/d23/f31 [0,4194304] 0 2023-12-12T11:51:44.009 INFO:tasks.workunit.client.1.smithi093.stdout:9/265: stat d1/d12/d1f/f20 0 2023-12-12T11:51:44.009 INFO:tasks.workunit.client.1.smithi093.stdout:9/266: chown d1/d23/d24 27330 1 2023-12-12T11:51:44.009 INFO:tasks.workunit.client.0.smithi063.stdout:0/60: read d0/d7/ff [2253206,42249] 0 2023-12-12T11:51:44.010 INFO:tasks.workunit.client.0.smithi063.stdout:0/61: fsync d0/f8 0 2023-12-12T11:51:44.010 INFO:tasks.workunit.client.0.smithi063.stdout:0/62: read - d0/f8 zero size 2023-12-12T11:51:44.010 INFO:tasks.workunit.client.1.smithi093.stdout:7/284: unlink da/d15/d19/c43 0 2023-12-12T11:51:44.017 INFO:tasks.workunit.client.1.smithi093.stdout:3/326: dread df/d30/d33/f3a [0,4194304] 0 2023-12-12T11:51:44.017 INFO:tasks.workunit.client.1.smithi093.stdout:3/327: chown l8 19 1 2023-12-12T11:51:44.017 INFO:tasks.workunit.client.1.smithi093.stdout:3/328: truncate df/f28 8856197 0 2023-12-12T11:51:44.018 INFO:tasks.workunit.client.1.smithi093.stdout:1/319: dwrite d4/d1a/d1b/f48 [0,4194304] 0 2023-12-12T11:51:44.020 INFO:tasks.workunit.client.0.smithi063.stdout:6/114: dwrite d9/d10/f20 [0,4194304] 0 2023-12-12T11:51:44.021 INFO:tasks.workunit.client.1.smithi093.stdout:2/349: unlink d5/d14/d27/c2f 0 2023-12-12T11:51:44.021 INFO:tasks.workunit.client.1.smithi093.stdout:0/325: sync 2023-12-12T11:51:44.021 INFO:tasks.workunit.client.1.smithi093.stdout:6/420: stat d0/c5c 0 2023-12-12T11:51:44.023 INFO:tasks.workunit.client.1.smithi093.stdout:8/298: dwrite d3/d1a/f33 [0,4194304] 0 2023-12-12T11:51:44.023 INFO:tasks.workunit.client.1.smithi093.stdout:8/299: stat d3/d1a/d1f/d29/d30 0 2023-12-12T11:51:44.023 INFO:tasks.workunit.client.1.smithi093.stdout:8/300: readlink d3/lf 0 2023-12-12T11:51:44.030 INFO:tasks.workunit.client.1.smithi093.stdout:4/500: symlink d0/d31/d5c/l9b 0 2023-12-12T11:51:44.031 INFO:tasks.workunit.client.1.smithi093.stdout:6/421: dread d0/da/d14/f55 [0,4194304] 0 2023-12-12T11:51:44.035 INFO:tasks.workunit.client.0.smithi063.stdout:6/115: unlink f5 0 2023-12-12T11:51:44.037 INFO:tasks.workunit.client.0.smithi063.stdout:2/54: getdents d0 0 2023-12-12T11:51:44.038 INFO:tasks.workunit.client.0.smithi063.stdout:2/55: chown d0/f6 167 1 2023-12-12T11:51:44.038 INFO:tasks.workunit.client.1.smithi093.stdout:9/267: creat d1/d12/d1f/d3d/d57/f5b x:0 0 0 2023-12-12T11:51:44.042 INFO:tasks.workunit.client.1.smithi093.stdout:7/285: rename da/d15/d2d/d2f/f5f to da/de/d46/f65 0 2023-12-12T11:51:44.042 INFO:tasks.workunit.client.1.smithi093.stdout:7/286: write da/d15/f26 [4957183,59986] 0 2023-12-12T11:51:44.042 INFO:tasks.workunit.client.1.smithi093.stdout:7/287: write da/de/f27 [334578,2319] 0 2023-12-12T11:51:44.043 INFO:tasks.workunit.client.1.smithi093.stdout:3/329: mknod df/d22/d49/c67 0 2023-12-12T11:51:44.043 INFO:tasks.workunit.client.1.smithi093.stdout:3/330: chown df/d22 506479 1 2023-12-12T11:51:44.044 INFO:tasks.workunit.client.0.smithi063.stdout:5/110: dwrite d7/f9 [0,4194304] 0 2023-12-12T11:51:44.050 INFO:tasks.workunit.client.0.smithi063.stdout:1/57: sync 2023-12-12T11:51:44.051 INFO:tasks.workunit.client.0.smithi063.stdout:9/68: sync 2023-12-12T11:51:44.051 INFO:tasks.workunit.client.0.smithi063.stdout:9/69: read d7/fe [3039235,10477] 0 2023-12-12T11:51:44.051 INFO:tasks.workunit.client.0.smithi063.stdout:2/56: symlink d0/l12 0 2023-12-12T11:51:44.051 INFO:tasks.workunit.client.0.smithi063.stdout:2/57: chown d0/ff 983628880 1 2023-12-12T11:51:44.055 INFO:tasks.workunit.client.0.smithi063.stdout:4/130: dwrite d2/f10 [0,4194304] 0 2023-12-12T11:51:44.056 INFO:tasks.workunit.client.0.smithi063.stdout:4/131: creat d2/d8/d14/f2d x:0 0 0 2023-12-12T11:51:44.061 INFO:tasks.workunit.client.0.smithi063.stdout:1/58: dread d3/db/fd [0,4194304] 0 2023-12-12T11:51:44.065 INFO:tasks.workunit.client.0.smithi063.stdout:9/70: creat d7/d15/f17 x:0 0 0 2023-12-12T11:51:44.065 INFO:tasks.workunit.client.0.smithi063.stdout:9/71: chown d7/f8 88950868 1 2023-12-12T11:51:44.065 INFO:tasks.workunit.client.0.smithi063.stdout:9/72: stat c2 0 2023-12-12T11:51:44.077 INFO:tasks.workunit.client.1.smithi093.stdout:5/213: rmdir d0/d7 39 2023-12-12T11:51:44.081 INFO:tasks.workunit.client.0.smithi063.stdout:4/132: mknod d2/d17/c2e 0 2023-12-12T11:51:44.083 INFO:tasks.workunit.client.1.smithi093.stdout:1/320: dwrite d4/d1c/d2a/d2d/f60 [0,4194304] 0 2023-12-12T11:51:44.086 INFO:tasks.workunit.client.1.smithi093.stdout:2/350: mkdir d5/d14/d47/d56/d6f/d73 0 2023-12-12T11:51:44.086 INFO:tasks.workunit.client.1.smithi093.stdout:2/351: truncate d5/d14/d2d/d4c/d54/d67/d69/d6c/f5a 410177 0 2023-12-12T11:51:44.088 INFO:tasks.workunit.client.0.smithi063.stdout:1/59: unlink d3/la 0 2023-12-12T11:51:44.089 INFO:tasks.workunit.client.0.smithi063.stdout:1/60: dread - d3/db/fe zero size 2023-12-12T11:51:44.090 INFO:tasks.workunit.client.0.smithi063.stdout:0/63: dwrite d0/f8 [0,4194304] 0 2023-12-12T11:51:44.090 INFO:tasks.workunit.client.0.smithi063.stdout:0/64: creat d0/f12 x:0 0 0 2023-12-12T11:51:44.091 INFO:tasks.workunit.client.0.smithi063.stdout:0/65: fsync d0/f8 0 2023-12-12T11:51:44.094 INFO:tasks.workunit.client.0.smithi063.stdout:9/73: truncate f5 2573407 0 2023-12-12T11:51:44.094 INFO:tasks.workunit.client.0.smithi063.stdout:9/74: read d7/f14 [631881,118307] 0 2023-12-12T11:51:44.097 INFO:tasks.workunit.client.1.smithi093.stdout:9/268: dwrite d1/d12/d1f/f38 [0,4194304] 0 2023-12-12T11:51:44.097 INFO:tasks.workunit.client.1.smithi093.stdout:9/269: getdents d1/d23/d24/d29/d43/d58 0 2023-12-12T11:51:44.098 INFO:tasks.workunit.client.1.smithi093.stdout:1/321: dread d4/d1a/d1b/f3a [0,4194304] 0 2023-12-12T11:51:44.099 INFO:tasks.workunit.client.0.smithi063.stdout:6/116: dwrite d9/d10/f1b [0,4194304] 0 2023-12-12T11:51:44.101 INFO:tasks.workunit.client.1.smithi093.stdout:8/301: creat d3/d1a/d1f/d29/d3a/d40/f61 x:0 0 0 2023-12-12T11:51:44.103 INFO:tasks.workunit.client.1.smithi093.stdout:4/501: creat d0/d31/d89/f9c x:0 0 0 2023-12-12T11:51:44.103 INFO:tasks.workunit.client.0.smithi063.stdout:1/61: mkdir d3/db/d13 0 2023-12-12T11:51:44.116 INFO:tasks.workunit.client.1.smithi093.stdout:6/422: mknod d0/da/d32/ca0 0 2023-12-12T11:51:44.116 INFO:tasks.workunit.client.1.smithi093.stdout:0/326: rename d5/d21/d2f/f3e to d5/d21/f6b 0 2023-12-12T11:51:44.117 INFO:tasks.workunit.client.1.smithi093.stdout:0/327: dread - d5/dd/d14/d26/d58/f63 zero size 2023-12-12T11:51:44.117 INFO:tasks.workunit.client.1.smithi093.stdout:7/288: creat da/d15/d59/f66 x:0 0 0 2023-12-12T11:51:44.117 INFO:tasks.workunit.client.1.smithi093.stdout:0/328: write d5/d21/d27/d3a/f56 [259218,100741] 0 2023-12-12T11:51:44.118 INFO:tasks.workunit.client.0.smithi063.stdout:0/66: creat d0/d10/f13 x:0 0 0 2023-12-12T11:51:44.120 INFO:tasks.workunit.client.1.smithi093.stdout:0/329: write d5/dd/d14/d26/f59 [821499,119371] 0 2023-12-12T11:51:44.120 INFO:tasks.workunit.client.1.smithi093.stdout:0/330: write d5/d21/d27/d3a/f67 [516923,104544] 0 2023-12-12T11:51:44.121 INFO:tasks.workunit.client.0.smithi063.stdout:2/58: dwrite d0/ff [0,4194304] 0 2023-12-12T11:51:44.131 INFO:tasks.workunit.client.0.smithi063.stdout:9/75: dread d7/f9 [0,4194304] 0 2023-12-12T11:51:44.131 INFO:tasks.workunit.client.0.smithi063.stdout:9/76: truncate d7/f14 707419 0 2023-12-12T11:51:44.131 INFO:tasks.workunit.client.0.smithi063.stdout:9/77: read - d7/d15/f17 zero size 2023-12-12T11:51:44.132 INFO:tasks.workunit.client.0.smithi063.stdout:3/64: sync 2023-12-12T11:51:44.141 INFO:tasks.workunit.client.1.smithi093.stdout:2/352: truncate d5/d14/d2d/f1f 6115 0 2023-12-12T11:51:44.145 INFO:tasks.workunit.client.0.smithi063.stdout:6/117: mkdir d9/d10/d2a 0 2023-12-12T11:51:44.147 INFO:tasks.workunit.client.0.smithi063.stdout:4/133: mknod d2/d8/c2f 0 2023-12-12T11:51:44.148 INFO:tasks.workunit.client.1.smithi093.stdout:0/331: write d5/dd/d14/f37 [83880,85204] 0 2023-12-12T11:51:44.150 INFO:tasks.workunit.client.0.smithi063.stdout:4/134: creat d2/d8/d14/f30 x:0 0 0 2023-12-12T11:51:44.151 INFO:tasks.workunit.client.1.smithi093.stdout:6/423: creat d0/da/d32/fa1 x:0 0 0 2023-12-12T11:51:44.151 INFO:tasks.workunit.client.1.smithi093.stdout:6/424: creat d0/da/d32/d39/d5b/fa2 x:0 0 0 2023-12-12T11:51:44.153 INFO:tasks.workunit.client.0.smithi063.stdout:9/78: dread d7/f10 [0,4194304] 0 2023-12-12T11:51:44.155 INFO:tasks.workunit.client.1.smithi093.stdout:3/331: rename df/d25/f32 to df/f68 0 2023-12-12T11:51:44.155 INFO:tasks.workunit.client.1.smithi093.stdout:3/332: chown df/d22/l35 40952069 1 2023-12-12T11:51:44.156 INFO:tasks.workunit.client.1.smithi093.stdout:7/289: chown da/d15/f24 2024 1 2023-12-12T11:51:44.159 INFO:tasks.workunit.client.1.smithi093.stdout:5/214: link d0/c6 d0/d7/d36/d38/c4b 0 2023-12-12T11:51:44.161 INFO:tasks.workunit.client.0.smithi063.stdout:4/135: dread d2/d17/f22 [0,4194304] 0 2023-12-12T11:51:44.162 INFO:tasks.workunit.client.0.smithi063.stdout:6/118: symlink d9/d10/d25/l2b 0 2023-12-12T11:51:44.166 INFO:tasks.workunit.client.1.smithi093.stdout:1/322: dwrite d4/dc/f5c [0,4194304] 0 2023-12-12T11:51:44.167 INFO:tasks.workunit.client.0.smithi063.stdout:0/67: link d0/d10/ld d0/l14 0 2023-12-12T11:51:44.167 INFO:tasks.workunit.client.0.smithi063.stdout:0/68: dread - d0/f12 zero size 2023-12-12T11:51:44.169 INFO:tasks.workunit.client.1.smithi093.stdout:7/290: truncate da/d15/d59/f66 262843 0 2023-12-12T11:51:44.170 INFO:tasks.workunit.client.0.smithi063.stdout:1/62: dwrite d3/db/fc [0,4194304] 0 2023-12-12T11:51:44.171 INFO:tasks.workunit.client.1.smithi093.stdout:5/215: rename d0/f3e to d0/d7/d27/d48/f4c 0 2023-12-12T11:51:44.171 INFO:tasks.workunit.client.0.smithi063.stdout:3/65: getdents d4 0 2023-12-12T11:51:44.173 INFO:tasks.workunit.client.1.smithi093.stdout:3/333: mkdir df/d22/d49/d69 0 2023-12-12T11:51:44.173 INFO:tasks.workunit.client.1.smithi093.stdout:0/332: getdents d5/dd/d14 0 2023-12-12T11:51:44.173 INFO:tasks.workunit.client.1.smithi093.stdout:0/333: fsync d5/d21/f4c 0 2023-12-12T11:51:44.173 INFO:tasks.workunit.client.1.smithi093.stdout:0/334: fsync d5/dd/f4f 0 2023-12-12T11:51:44.174 INFO:tasks.workunit.client.1.smithi093.stdout:8/302: dwrite d3/d1a/d1f/d29/f54 [0,4194304] 0 2023-12-12T11:51:44.174 INFO:tasks.workunit.client.1.smithi093.stdout:8/303: truncate d3/d1a/f2b 4248237 0 2023-12-12T11:51:44.174 INFO:tasks.workunit.client.1.smithi093.stdout:9/270: dwrite d1/d23/f31 [0,4194304] 0 2023-12-12T11:51:44.174 INFO:tasks.workunit.client.1.smithi093.stdout:8/304: creat d3/d1a/d1f/d29/d3a/d40/f62 x:0 0 0 2023-12-12T11:51:44.175 INFO:tasks.workunit.client.0.smithi063.stdout:0/69: unlink d0/f8 0 2023-12-12T11:51:44.175 INFO:tasks.workunit.client.0.smithi063.stdout:0/70: write d0/d7/ff [499554,93098] 0 2023-12-12T11:51:44.175 INFO:tasks.workunit.client.0.smithi063.stdout:9/79: rmdir d7/d15 39 2023-12-12T11:51:44.176 INFO:tasks.workunit.client.0.smithi063.stdout:9/80: fdatasync f6 0 2023-12-12T11:51:44.180 INFO:tasks.workunit.client.1.smithi093.stdout:4/502: dwrite d0/d36/d40/f57 [0,4194304] 0 2023-12-12T11:51:44.181 INFO:tasks.workunit.client.1.smithi093.stdout:2/353: dwrite d5/d14/d2d/d12/f2c [0,4194304] 0 2023-12-12T11:51:44.183 INFO:tasks.workunit.client.1.smithi093.stdout:5/216: rmdir d0/d7/d36/d3f 0 2023-12-12T11:51:44.183 INFO:tasks.workunit.client.1.smithi093.stdout:5/217: dread - d0/d7/f1a zero size 2023-12-12T11:51:44.183 INFO:tasks.workunit.client.1.smithi093.stdout:5/218: readlink d0/d7/l47 0 2023-12-12T11:51:44.184 INFO:tasks.workunit.client.0.smithi063.stdout:1/63: truncate d3/f10 1591766 0 2023-12-12T11:51:44.185 INFO:tasks.workunit.client.1.smithi093.stdout:3/334: creat df/d22/d49/d69/f6a x:0 0 0 2023-12-12T11:51:44.190 INFO:tasks.workunit.client.0.smithi063.stdout:3/66: unlink d4/fd 0 2023-12-12T11:51:44.193 INFO:tasks.workunit.client.0.smithi063.stdout:0/71: mkdir d0/d15 0 2023-12-12T11:51:44.193 INFO:tasks.workunit.client.0.smithi063.stdout:0/72: chown d0 728 1 2023-12-12T11:51:44.194 INFO:tasks.workunit.client.0.smithi063.stdout:8/165: sync 2023-12-12T11:51:44.198 INFO:tasks.workunit.client.1.smithi093.stdout:9/271: mkdir d1/d12/d1f/d3d/d5c 0 2023-12-12T11:51:44.198 INFO:tasks.workunit.client.1.smithi093.stdout:9/272: chown d1/c17 1908731 1 2023-12-12T11:51:44.199 INFO:tasks.workunit.client.0.smithi063.stdout:7/72: sync 2023-12-12T11:51:44.200 INFO:tasks.workunit.client.0.smithi063.stdout:9/81: rename d7/d11/d12/f13 to d7/d11/d12/f18 0 2023-12-12T11:51:44.200 INFO:tasks.workunit.client.0.smithi063.stdout:7/73: creat de/f1a x:0 0 0 2023-12-12T11:51:44.200 INFO:tasks.workunit.client.0.smithi063.stdout:9/82: creat d7/f19 x:0 0 0 2023-12-12T11:51:44.200 INFO:tasks.workunit.client.0.smithi063.stdout:9/83: dread - d7/fa zero size 2023-12-12T11:51:44.201 INFO:tasks.workunit.client.1.smithi093.stdout:1/323: write f1 [194736,36588] 0 2023-12-12T11:51:44.201 INFO:tasks.workunit.client.0.smithi063.stdout:1/64: symlink d3/db/d13/l14 0 2023-12-12T11:51:44.201 INFO:tasks.workunit.client.0.smithi063.stdout:8/166: write d4/de/d11/f14 [22563,98829] 0 2023-12-12T11:51:44.201 INFO:tasks.workunit.client.0.smithi063.stdout:8/167: fdatasync d4/f2b 0 2023-12-12T11:51:44.204 INFO:tasks.workunit.client.1.smithi093.stdout:0/335: dread d5/dd/d62/f69 [0,4194304] 0 2023-12-12T11:51:44.205 INFO:tasks.workunit.client.1.smithi093.stdout:6/425: dwrite d0/d7b/f94 [0,4194304] 0 2023-12-12T11:51:44.205 INFO:tasks.workunit.client.1.smithi093.stdout:6/426: creat d0/da/d32/d39/d5b/fa3 x:0 0 0 2023-12-12T11:51:44.207 INFO:tasks.workunit.client.1.smithi093.stdout:8/305: mkdir d3/d1a/d1f/d29/d63 0 2023-12-12T11:51:44.207 INFO:tasks.workunit.client.1.smithi093.stdout:8/306: chown d3/d1a/d1f/f27 446 1 2023-12-12T11:51:44.207 INFO:tasks.workunit.client.1.smithi093.stdout:7/291: symlink da/d15/d19/l67 0 2023-12-12T11:51:44.213 INFO:tasks.workunit.client.0.smithi063.stdout:7/74: mknod de/c1b 0 2023-12-12T11:51:44.216 INFO:tasks.workunit.client.0.smithi063.stdout:9/84: dread f0 [0,4194304] 0 2023-12-12T11:51:44.220 INFO:tasks.workunit.client.0.smithi063.stdout:8/168: truncate f2 2723024 0 2023-12-12T11:51:44.220 INFO:tasks.workunit.client.1.smithi093.stdout:1/324: write d4/dc/f32 [1935912,120753] 0 2023-12-12T11:51:44.223 INFO:tasks.workunit.client.1.smithi093.stdout:2/354: rename d5/d14/d2d/d12/d44/c52 to d5/d14/d2d/d4c/d54/d67/c74 0 2023-12-12T11:51:44.223 INFO:tasks.workunit.client.1.smithi093.stdout:3/335: unlink df/d25/d2c/l3f 0 2023-12-12T11:51:44.224 INFO:tasks.workunit.client.1.smithi093.stdout:6/427: dread d0/d52/d7e/f49 [4194304,4194304] 0 2023-12-12T11:51:44.224 INFO:tasks.workunit.client.1.smithi093.stdout:6/428: truncate d0/da/d14/d9c/f7d 1245714 0 2023-12-12T11:51:44.224 INFO:tasks.workunit.client.0.smithi063.stdout:0/73: symlink d0/d10/l16 0 2023-12-12T11:51:44.226 INFO:tasks.workunit.client.0.smithi063.stdout:1/65: truncate d3/f10 2436592 0 2023-12-12T11:51:44.228 INFO:tasks.workunit.client.1.smithi093.stdout:9/273: rmdir d1/d12/d1f 39 2023-12-12T11:51:44.229 INFO:tasks.workunit.client.0.smithi063.stdout:0/74: fdatasync d0/d7/ff 0 2023-12-12T11:51:44.230 INFO:tasks.workunit.client.0.smithi063.stdout:6/119: dwrite d9/f1f [0,4194304] 0 2023-12-12T11:51:44.230 INFO:tasks.workunit.client.0.smithi063.stdout:6/120: getdents d9/d10/d2a 0 2023-12-12T11:51:44.231 INFO:tasks.workunit.client.0.smithi063.stdout:7/75: truncate f8 2608128 0 2023-12-12T11:51:44.231 INFO:tasks.workunit.client.0.smithi063.stdout:7/76: read fb [387211,4151] 0 2023-12-12T11:51:44.237 INFO:tasks.workunit.client.1.smithi093.stdout:0/336: creat d5/d4d/f6c x:0 0 0 2023-12-12T11:51:44.244 INFO:tasks.workunit.client.0.smithi063.stdout:1/66: unlink d3/db/fc 0 2023-12-12T11:51:44.248 INFO:tasks.workunit.client.0.smithi063.stdout:9/85: fsync d7/d11/d12/f18 0 2023-12-12T11:51:44.248 INFO:tasks.workunit.client.0.smithi063.stdout:9/86: fdatasync f0 0 2023-12-12T11:51:44.248 INFO:tasks.workunit.client.0.smithi063.stdout:9/87: creat d7/d11/d12/f1a x:0 0 0 2023-12-12T11:51:44.251 INFO:tasks.workunit.client.1.smithi093.stdout:4/503: dwrite d0/f1c [0,4194304] 0 2023-12-12T11:51:44.251 INFO:tasks.workunit.client.1.smithi093.stdout:4/504: dread - d0/d31/d5c/d66/f6a zero size 2023-12-12T11:51:44.251 INFO:tasks.workunit.client.1.smithi093.stdout:4/505: truncate d0/d36/d49/f4b 1030000 0 2023-12-12T11:51:44.251 INFO:tasks.workunit.client.1.smithi093.stdout:4/506: chown d0/d31/d89 256499557 1 2023-12-12T11:51:44.252 INFO:tasks.workunit.client.1.smithi093.stdout:8/307: mknod d3/d1a/d1f/d29/d30/c64 0 2023-12-12T11:51:44.254 INFO:tasks.workunit.client.1.smithi093.stdout:9/274: dread d1/d23/d24/f2e [0,4194304] 0 2023-12-12T11:51:44.254 INFO:tasks.workunit.client.1.smithi093.stdout:9/275: chown d1/d12/d1f/d32/c47 239 1 2023-12-12T11:51:44.254 INFO:tasks.workunit.client.1.smithi093.stdout:9/276: write d1/d12/f1c [1236797,14083] 0 2023-12-12T11:51:44.254 INFO:tasks.workunit.client.1.smithi093.stdout:9/277: creat d1/d12/d1f/d3d/d57/f5d x:0 0 0 2023-12-12T11:51:44.254 INFO:tasks.workunit.client.1.smithi093.stdout:9/278: write d1/d12/d1f/d32/d42/f5a [734273,117894] 0 2023-12-12T11:51:44.255 INFO:tasks.workunit.client.1.smithi093.stdout:9/279: chown d1/d12/d1f/c34 9 1 2023-12-12T11:51:44.255 INFO:tasks.workunit.client.0.smithi063.stdout:3/67: dwrite f0 [0,4194304] 0 2023-12-12T11:51:44.256 INFO:tasks.workunit.client.0.smithi063.stdout:6/121: write d9/d10/f20 [608727,30853] 0 2023-12-12T11:51:44.257 INFO:tasks.workunit.client.0.smithi063.stdout:6/122: fdatasync d9/d10/f1b 0 2023-12-12T11:51:44.257 INFO:tasks.workunit.client.0.smithi063.stdout:6/123: stat d9/f1f 0 2023-12-12T11:51:44.257 INFO:tasks.workunit.client.0.smithi063.stdout:6/124: readlink d9/d10/d25/l2b 0 2023-12-12T11:51:44.260 INFO:tasks.workunit.client.1.smithi093.stdout:7/292: rename da/de/d46/d4f/c5d to da/de/d46/d58/c68 0 2023-12-12T11:51:44.269 INFO:tasks.workunit.client.1.smithi093.stdout:2/355: mkdir d5/d46/d55/d75 0 2023-12-12T11:51:44.269 INFO:tasks.workunit.client.1.smithi093.stdout:5/219: dwrite d0/d7/d27/d35/f1f [0,4194304] 0 2023-12-12T11:51:44.273 INFO:tasks.workunit.client.1.smithi093.stdout:3/336: truncate df/d36/d3d/d59/f5c 1005044 0 2023-12-12T11:51:44.273 INFO:tasks.workunit.client.1.smithi093.stdout:3/337: readlink df/d22/d49/l5a 0 2023-12-12T11:51:44.277 INFO:tasks.workunit.client.0.smithi063.stdout:0/75: rename d0/d10 to d0/d10/d17 22 2023-12-12T11:51:44.277 INFO:tasks.workunit.client.0.smithi063.stdout:0/76: dread - d0/d10/f13 zero size 2023-12-12T11:51:44.278 INFO:tasks.workunit.client.1.smithi093.stdout:6/429: unlink d0/d7b/f7f 0 2023-12-12T11:51:44.278 INFO:tasks.workunit.client.0.smithi063.stdout:6/125: dread d9/d10/f1b [0,4194304] 0 2023-12-12T11:51:44.280 INFO:tasks.workunit.client.0.smithi063.stdout:7/77: mknod de/c1c 0 2023-12-12T11:51:44.284 INFO:tasks.workunit.client.1.smithi093.stdout:0/337: link d5/f40 d5/d41/f6d 0 2023-12-12T11:51:44.284 INFO:tasks.workunit.client.1.smithi093.stdout:0/338: creat d5/dd/d14/d26/f6e x:0 0 0 2023-12-12T11:51:44.287 INFO:tasks.workunit.client.0.smithi063.stdout:1/67: truncate d3/f10 3450602 0 2023-12-12T11:51:44.295 INFO:tasks.workunit.client.1.smithi093.stdout:8/308: dwrite d3/d1a/f44 [0,4194304] 0 2023-12-12T11:51:44.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:44 smithi063 ceph-mon[107117]: pgmap v6: 65 pgs: 65 active+clean; 548 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 12 MiB/s rd, 21 MiB/s wr, 15 op/s 2023-12-12T11:51:44.297 INFO:tasks.workunit.client.1.smithi093.stdout:0/339: dread d5/dd/f1a [0,4194304] 0 2023-12-12T11:51:44.297 INFO:tasks.workunit.client.1.smithi093.stdout:0/340: fsync d5/d41/f61 0 2023-12-12T11:51:44.297 INFO:tasks.workunit.client.1.smithi093.stdout:9/280: creat d1/d23/d24/d29/d43/f5e x:0 0 0 2023-12-12T11:51:44.298 INFO:tasks.workunit.client.0.smithi063.stdout:9/88: dwrite f6 [0,4194304] 0 2023-12-12T11:51:44.299 INFO:tasks.workunit.client.1.smithi093.stdout:1/325: truncate d4/dc/f5c 2575336 0 2023-12-12T11:51:44.304 INFO:tasks.workunit.client.0.smithi063.stdout:0/77: symlink d0/d15/l18 0 2023-12-12T11:51:44.304 INFO:tasks.workunit.client.0.smithi063.stdout:0/78: write d0/d7/ff [1774406,106654] 0 2023-12-12T11:51:44.305 INFO:tasks.workunit.client.1.smithi093.stdout:7/293: dread - da/d15/d2d/f50 zero size 2023-12-12T11:51:44.306 INFO:tasks.workunit.client.0.smithi063.stdout:3/68: chown d4/f7 87717 1 2023-12-12T11:51:44.309 INFO:tasks.workunit.client.0.smithi063.stdout:6/126: mkdir d9/d2c 0 2023-12-12T11:51:44.309 INFO:tasks.workunit.client.0.smithi063.stdout:6/127: chown d9/d10/d25/c29 20376 1 2023-12-12T11:51:44.312 INFO:tasks.workunit.client.1.smithi093.stdout:4/507: rename d0/d31/d5c/d66/d94 to d0/d31/d9d 0 2023-12-12T11:51:44.312 INFO:tasks.workunit.client.1.smithi093.stdout:4/508: fdatasync d0/d36/d40/f8e 0 2023-12-12T11:51:44.312 INFO:tasks.workunit.client.1.smithi093.stdout:0/341: dread d5/dd/d33/f3c [0,4194304] 0 2023-12-12T11:51:44.312 INFO:tasks.workunit.client.1.smithi093.stdout:0/342: fdatasync d5/d21/d2f/d54/f5c 0 2023-12-12T11:51:44.314 INFO:tasks.workunit.client.0.smithi063.stdout:1/68: link d3/l11 d3/db/d12/l15 0 2023-12-12T11:51:44.314 INFO:tasks.workunit.client.0.smithi063.stdout:1/69: chown f2 0 1 2023-12-12T11:51:44.320 INFO:tasks.workunit.client.1.smithi093.stdout:9/281: dread d1/fe [0,4194304] 0 2023-12-12T11:51:44.320 INFO:tasks.workunit.client.1.smithi093.stdout:9/282: chown d1/fa 5210845 1 2023-12-12T11:51:44.320 INFO:tasks.workunit.client.1.smithi093.stdout:9/283: fsync d1/d12/f4c 0 2023-12-12T11:51:44.324 INFO:tasks.workunit.client.1.smithi093.stdout:5/220: mkdir d0/d7/d27/d48/d4d 0 2023-12-12T11:51:44.329 INFO:tasks.workunit.client.1.smithi093.stdout:3/338: mkdir df/d25/d6b 0 2023-12-12T11:51:44.332 INFO:tasks.workunit.client.0.smithi063.stdout:8/169: dwrite f1 [0,4194304] 0 2023-12-12T11:51:44.333 INFO:tasks.workunit.client.0.smithi063.stdout:5/111: sync 2023-12-12T11:51:44.335 INFO:tasks.workunit.client.1.smithi093.stdout:7/294: write da/de/d46/f4e [57065,3396] 0 2023-12-12T11:51:44.336 INFO:tasks.workunit.client.1.smithi093.stdout:6/430: creat d0/d52/d6b/fa4 x:0 0 0 2023-12-12T11:51:44.337 INFO:tasks.workunit.client.0.smithi063.stdout:9/89: dread f6 [0,4194304] 0 2023-12-12T11:51:44.345 INFO:tasks.workunit.client.0.smithi063.stdout:6/128: mknod d9/d10/c2d 0 2023-12-12T11:51:44.351 INFO:tasks.workunit.client.1.smithi093.stdout:1/326: truncate d4/d1c/f21 2021412 0 2023-12-12T11:51:44.352 INFO:tasks.workunit.client.0.smithi063.stdout:1/70: mkdir d3/db/d16 0 2023-12-12T11:51:44.352 INFO:tasks.workunit.client.0.smithi063.stdout:1/71: truncate d3/db/fe 609350 0 2023-12-12T11:51:44.352 INFO:tasks.workunit.client.0.smithi063.stdout:1/72: fsync d3/db/fe 0 2023-12-12T11:51:44.356 INFO:tasks.workunit.client.0.smithi063.stdout:5/112: dread d7/f12 [0,4194304] 0 2023-12-12T11:51:44.357 INFO:tasks.workunit.client.1.smithi093.stdout:4/509: symlink d0/d36/l9e 0 2023-12-12T11:51:44.365 INFO:tasks.workunit.client.0.smithi063.stdout:0/79: unlink d0/d10/lc 0 2023-12-12T11:51:44.367 INFO:tasks.workunit.client.1.smithi093.stdout:0/343: mkdir d5/dd/d14/d26/d58/d64/d6f 0 2023-12-12T11:51:44.367 INFO:tasks.workunit.client.0.smithi063.stdout:6/129: symlink d9/d10/l2e 0 2023-12-12T11:51:44.369 INFO:tasks.workunit.client.1.smithi093.stdout:9/284: creat d1/d12/d1f/d32/d42/f5f x:0 0 0 2023-12-12T11:51:44.374 INFO:tasks.workunit.client.1.smithi093.stdout:2/356: getdents d5/d31 0 2023-12-12T11:51:44.376 INFO:tasks.workunit.client.0.smithi063.stdout:1/73: rename d3/db/d13 to d3/db/d16/d17 0 2023-12-12T11:51:44.377 INFO:tasks.workunit.client.1.smithi093.stdout:8/309: dwrite d3/f42 [0,4194304] 0 2023-12-12T11:51:44.382 INFO:tasks.workunit.client.1.smithi093.stdout:3/339: dread df/d36/d3d/d42/f57 [0,4194304] 0 2023-12-12T11:51:44.384 INFO:tasks.workunit.client.0.smithi063.stdout:8/170: getdents d4/de 0 2023-12-12T11:51:44.384 INFO:tasks.workunit.client.0.smithi063.stdout:8/171: chown d4/de/d1e/l1f 216814 1 2023-12-12T11:51:44.384 INFO:tasks.workunit.client.1.smithi093.stdout:1/327: creat d4/d1a/f6b x:0 0 0 2023-12-12T11:51:44.387 INFO:tasks.workunit.client.0.smithi063.stdout:4/136: sync 2023-12-12T11:51:44.388 INFO:tasks.workunit.client.0.smithi063.stdout:2/59: sync 2023-12-12T11:51:44.394 INFO:tasks.workunit.client.1.smithi093.stdout:5/221: dwrite d0/d7/d8/de/f3a [0,4194304] 0 2023-12-12T11:51:44.394 INFO:tasks.workunit.client.1.smithi093.stdout:5/222: readlink d0/d7/d8/de/ld 0 2023-12-12T11:51:44.394 INFO:tasks.workunit.client.1.smithi093.stdout:5/223: fdatasync d0/d7/f1a 0 2023-12-12T11:51:44.394 INFO:tasks.workunit.client.1.smithi093.stdout:5/224: write d0/d7/d8/de/f28 [3428360,111291] 0 2023-12-12T11:51:44.395 INFO:tasks.workunit.client.1.smithi093.stdout:4/510: mknod d0/d31/d5c/d6c/d93/c9f 0 2023-12-12T11:51:44.397 INFO:tasks.workunit.client.0.smithi063.stdout:6/130: symlink d9/d10/d2a/l2f 0 2023-12-12T11:51:44.400 INFO:tasks.workunit.client.1.smithi093.stdout:2/357: write d5/f8 [3905826,42168] 0 2023-12-12T11:51:44.400 INFO:tasks.workunit.client.1.smithi093.stdout:2/358: write d5/d46/d55/f60 [558863,18307] 0 2023-12-12T11:51:44.400 INFO:tasks.workunit.client.1.smithi093.stdout:9/285: symlink d1/d23/d24/d29/d43/d58/l60 0 2023-12-12T11:51:44.402 INFO:tasks.workunit.client.1.smithi093.stdout:6/431: dwrite d0/da/d32/d9e/d4d/f8f [0,4194304] 0 2023-12-12T11:51:44.402 INFO:tasks.workunit.client.1.smithi093.stdout:6/432: creat d0/da/d14/d21/fa5 x:0 0 0 2023-12-12T11:51:44.403 INFO:tasks.workunit.client.0.smithi063.stdout:9/90: dwrite d7/d11/d12/f18 [0,4194304] 0 2023-12-12T11:51:44.403 INFO:tasks.workunit.client.0.smithi063.stdout:9/91: write f6 [4258845,54616] 0 2023-12-12T11:51:44.403 INFO:tasks.workunit.client.0.smithi063.stdout:9/92: write f5 [2134042,48699] 0 2023-12-12T11:51:44.404 INFO:tasks.workunit.client.0.smithi063.stdout:9/93: read d7/f10 [3783548,17095] 0 2023-12-12T11:51:44.404 INFO:tasks.workunit.client.1.smithi093.stdout:1/328: dread d4/d1a/f5f [0,4194304] 0 2023-12-12T11:51:44.405 INFO:tasks.workunit.client.0.smithi063.stdout:7/78: dwrite fb [0,4194304] 0 2023-12-12T11:51:44.412 INFO:tasks.workunit.client.0.smithi063.stdout:1/74: getdents d3/db/d12 0 2023-12-12T11:51:44.412 INFO:tasks.workunit.client.1.smithi093.stdout:3/340: read df/f2f [1097444,16844] 0 2023-12-12T11:51:44.417 INFO:tasks.workunit.client.0.smithi063.stdout:5/113: dwrite d7/d10/f14 [0,4194304] 0 2023-12-12T11:51:44.417 INFO:tasks.workunit.client.0.smithi063.stdout:8/172: creat d4/de/f30 x:0 0 0 2023-12-12T11:51:44.417 INFO:tasks.workunit.client.1.smithi093.stdout:6/433: dread d0/f29 [0,4194304] 0 2023-12-12T11:51:44.417 INFO:tasks.workunit.client.1.smithi093.stdout:6/434: truncate d0/da/f89 5006631 0 2023-12-12T11:51:44.430 INFO:tasks.workunit.client.0.smithi063.stdout:2/60: mknod d0/c13 0 2023-12-12T11:51:44.430 INFO:tasks.workunit.client.1.smithi093.stdout:0/344: dwrite d5/d21/d27/d3a/f56 [0,4194304] 0 2023-12-12T11:51:44.432 INFO:tasks.workunit.client.0.smithi063.stdout:0/80: unlink d0/d10/ce 0 2023-12-12T11:51:44.432 INFO:tasks.workunit.client.0.smithi063.stdout:0/81: readlink d0/d10/l16 0 2023-12-12T11:51:44.433 INFO:tasks.workunit.client.0.smithi063.stdout:0/82: write d0/d7/ff [3195111,113252] 0 2023-12-12T11:51:44.440 INFO:tasks.workunit.client.1.smithi093.stdout:7/295: rmdir da 39 2023-12-12T11:51:44.440 INFO:tasks.workunit.client.1.smithi093.stdout:7/296: write da/de/f30 [486497,58416] 0 2023-12-12T11:51:44.442 INFO:tasks.workunit.client.0.smithi063.stdout:4/137: dwrite d2/d8/fa [0,4194304] 0 2023-12-12T11:51:44.447 INFO:tasks.workunit.client.0.smithi063.stdout:9/94: mknod d7/d15/c1b 0 2023-12-12T11:51:44.451 INFO:tasks.workunit.client.1.smithi093.stdout:5/225: creat d0/d7/d36/d29/f4e x:0 0 0 2023-12-12T11:51:44.453 INFO:tasks.workunit.client.1.smithi093.stdout:6/435: dwrite d0/da/d14/d21/fa5 [0,4194304] 0 2023-12-12T11:51:44.453 INFO:tasks.workunit.client.1.smithi093.stdout:6/436: write d0/d52/d7e/d42/f65 [513524,91200] 0 2023-12-12T11:51:44.453 INFO:tasks.workunit.client.1.smithi093.stdout:4/511: mkdir d0/d31/d9d/da0 0 2023-12-12T11:51:44.454 INFO:tasks.workunit.client.1.smithi093.stdout:6/437: write d0/d52/f6e [76196,60824] 0 2023-12-12T11:51:44.455 INFO:tasks.workunit.client.0.smithi063.stdout:7/79: link f4 de/f1d 0 2023-12-12T11:51:44.455 INFO:tasks.workunit.client.0.smithi063.stdout:7/80: chown de/f1a 8246317 1 2023-12-12T11:51:44.458 INFO:tasks.workunit.client.0.smithi063.stdout:1/75: rename c1 to d3/db/d16/c18 0 2023-12-12T11:51:44.464 INFO:tasks.workunit.client.1.smithi093.stdout:4/512: write d0/f1c [1986772,32484] 0 2023-12-12T11:51:44.468 INFO:tasks.workunit.client.1.smithi093.stdout:2/359: mkdir d5/d14/d2d/d4c/d76 0 2023-12-12T11:51:44.469 INFO:tasks.workunit.client.0.smithi063.stdout:5/114: mknod d7/de/c1f 0 2023-12-12T11:51:44.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:44 smithi093 ceph-mon[115914]: pgmap v6: 65 pgs: 65 active+clean; 548 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 12 MiB/s rd, 21 MiB/s wr, 15 op/s 2023-12-12T11:51:44.471 INFO:tasks.workunit.client.1.smithi093.stdout:9/286: symlink d1/d23/d24/d29/d43/l61 0 2023-12-12T11:51:44.472 INFO:tasks.workunit.client.1.smithi093.stdout:9/287: stat d1/d12/f4c 0 2023-12-12T11:51:44.472 INFO:tasks.workunit.client.0.smithi063.stdout:8/173: stat d4/f7 0 2023-12-12T11:51:44.472 INFO:tasks.workunit.client.0.smithi063.stdout:8/174: creat d4/d24/f31 x:0 0 0 2023-12-12T11:51:44.478 INFO:tasks.workunit.client.0.smithi063.stdout:2/61: creat d0/f14 x:0 0 0 2023-12-12T11:51:44.479 INFO:tasks.workunit.client.0.smithi063.stdout:2/62: readlink d0/ld 0 2023-12-12T11:51:44.487 INFO:tasks.workunit.client.0.smithi063.stdout:6/131: rmdir d9 39 2023-12-12T11:51:44.496 INFO:tasks.workunit.client.0.smithi063.stdout:9/95: symlink d7/d15/l1c 0 2023-12-12T11:51:44.497 INFO:tasks.workunit.client.1.smithi093.stdout:1/329: truncate f1 1857075 0 2023-12-12T11:51:44.498 INFO:tasks.workunit.client.0.smithi063.stdout:7/81: link de/f13 de/f1e 0 2023-12-12T11:51:44.499 INFO:tasks.workunit.client.0.smithi063.stdout:1/76: stat d3/db/d12/l15 0 2023-12-12T11:51:44.499 INFO:tasks.workunit.client.0.smithi063.stdout:1/77: chown d3/db/d12 2 1 2023-12-12T11:51:44.508 INFO:tasks.workunit.client.0.smithi063.stdout:4/138: dwrite d2/d8/fa [0,4194304] 0 2023-12-12T11:51:44.512 INFO:tasks.workunit.client.0.smithi063.stdout:0/83: mkdir d0/d10/d19 0 2023-12-12T11:51:44.514 INFO:tasks.workunit.client.0.smithi063.stdout:7/82: dread de/f1d [0,4194304] 0 2023-12-12T11:51:44.514 INFO:tasks.workunit.client.0.smithi063.stdout:7/83: write de/f1d [1294682,59735] 0 2023-12-12T11:51:44.518 INFO:tasks.workunit.client.0.smithi063.stdout:6/132: rename d9/d10/d2a/l2f to d9/d10/l30 0 2023-12-12T11:51:44.518 INFO:tasks.workunit.client.0.smithi063.stdout:6/133: chown d9/f24 685 1 2023-12-12T11:51:44.521 INFO:tasks.workunit.client.0.smithi063.stdout:9/96: creat d7/d15/f1d x:0 0 0 2023-12-12T11:51:44.521 INFO:tasks.workunit.client.0.smithi063.stdout:9/97: truncate d7/f19 187146 0 2023-12-12T11:51:44.521 INFO:tasks.workunit.client.0.smithi063.stdout:9/98: write d7/f9 [1253931,5456] 0 2023-12-12T11:51:44.522 INFO:tasks.workunit.client.0.smithi063.stdout:2/63: dwrite d0/ff [0,4194304] 0 2023-12-12T11:51:44.522 INFO:tasks.workunit.client.0.smithi063.stdout:2/64: readlink d0/l3 0 2023-12-12T11:51:44.524 INFO:tasks.workunit.client.1.smithi093.stdout:2/360: dwrite d5/d14/d2d/d12/d25/f30 [0,4194304] 0 2023-12-12T11:51:44.535 INFO:tasks.workunit.client.0.smithi063.stdout:1/78: mkdir d3/db/d16/d17/d19 0 2023-12-12T11:51:44.535 INFO:tasks.workunit.client.0.smithi063.stdout:8/175: mkdir d4/de/d32 0 2023-12-12T11:51:44.536 INFO:tasks.workunit.client.0.smithi063.stdout:3/69: sync 2023-12-12T11:51:44.536 INFO:tasks.workunit.client.0.smithi063.stdout:3/70: fsync d4/f7 0 2023-12-12T11:51:44.545 INFO:tasks.workunit.client.0.smithi063.stdout:0/84: mkdir d0/d1a 0 2023-12-12T11:51:44.555 INFO:tasks.workunit.client.0.smithi063.stdout:6/134: creat d9/f31 x:0 0 0 2023-12-12T11:51:44.555 INFO:tasks.workunit.client.0.smithi063.stdout:6/135: creat d9/f32 x:0 0 0 2023-12-12T11:51:44.556 INFO:tasks.workunit.client.0.smithi063.stdout:6/136: write d9/d10/f23 [1001052,78577] 0 2023-12-12T11:51:44.556 INFO:tasks.workunit.client.0.smithi063.stdout:6/137: write d9/f31 [460521,60298] 0 2023-12-12T11:51:44.556 INFO:tasks.workunit.client.0.smithi063.stdout:6/138: stat d9/f1f 0 2023-12-12T11:51:44.564 INFO:tasks.workunit.client.0.smithi063.stdout:9/99: truncate d7/fa 601865 0 2023-12-12T11:51:44.565 INFO:tasks.workunit.client.0.smithi063.stdout:9/100: creat d7/f1e x:0 0 0 2023-12-12T11:51:44.565 INFO:tasks.workunit.client.0.smithi063.stdout:9/101: rename d7 to d7/d1f 22 2023-12-12T11:51:44.565 INFO:tasks.workunit.client.0.smithi063.stdout:9/102: fsync d7/ff 0 2023-12-12T11:51:44.571 INFO:tasks.workunit.client.0.smithi063.stdout:1/79: creat d3/f1a x:0 0 0 2023-12-12T11:51:44.577 INFO:tasks.workunit.client.1.smithi093.stdout:3/341: truncate df/d22/f27 1921074 0 2023-12-12T11:51:44.583 INFO:tasks.workunit.client.0.smithi063.stdout:9/103: mkdir d7/d20 0 2023-12-12T11:51:44.584 INFO:tasks.workunit.client.0.smithi063.stdout:7/84: dwrite de/f1d [0,4194304] 0 2023-12-12T11:51:44.584 INFO:tasks.workunit.client.1.smithi093.stdout:5/226: mknod d0/d7/d8/de/c4f 0 2023-12-12T11:51:44.585 INFO:tasks.workunit.client.0.smithi063.stdout:2/65: dwrite d0/ff [0,4194304] 0 2023-12-12T11:51:44.585 INFO:tasks.workunit.client.0.smithi063.stdout:2/66: creat d0/f15 x:0 0 0 2023-12-12T11:51:44.586 INFO:tasks.workunit.client.0.smithi063.stdout:2/67: write d0/f4 [442521,72818] 0 2023-12-12T11:51:44.586 INFO:tasks.workunit.client.0.smithi063.stdout:4/139: dwrite d2/d8/fa [0,4194304] 0 2023-12-12T11:51:44.586 INFO:tasks.workunit.client.0.smithi063.stdout:2/68: fdatasync d0/ff 0 2023-12-12T11:51:44.586 INFO:tasks.workunit.client.0.smithi063.stdout:4/140: chown d2/c21 254317364 1 2023-12-12T11:51:44.590 INFO:tasks.workunit.client.0.smithi063.stdout:8/176: creat d4/de/d1e/f33 x:0 0 0 2023-12-12T11:51:44.591 INFO:tasks.workunit.client.1.smithi093.stdout:6/438: creat d0/fa6 x:0 0 0 2023-12-12T11:51:44.591 INFO:tasks.workunit.client.1.smithi093.stdout:6/439: write d0/da/d14/d38/d43/f86 [421057,61544] 0 2023-12-12T11:51:44.592 INFO:tasks.workunit.client.0.smithi063.stdout:1/80: mknod d3/db/d12/c1b 0 2023-12-12T11:51:44.592 INFO:tasks.workunit.client.0.smithi063.stdout:1/81: readlink d3/db/d12/l15 0 2023-12-12T11:51:44.594 INFO:tasks.workunit.client.0.smithi063.stdout:3/71: mknod d4/c11 0 2023-12-12T11:51:44.596 INFO:tasks.workunit.client.1.smithi093.stdout:9/288: truncate d1/f2f 2771055 0 2023-12-12T11:51:44.596 INFO:tasks.workunit.client.0.smithi063.stdout:0/85: rmdir d0/d7 39 2023-12-12T11:51:44.600 INFO:tasks.workunit.client.0.smithi063.stdout:9/104: creat d7/d11/f21 x:0 0 0 2023-12-12T11:51:44.600 INFO:tasks.workunit.client.0.smithi063.stdout:9/105: truncate d7/d15/f17 737894 0 2023-12-12T11:51:44.600 INFO:tasks.workunit.client.0.smithi063.stdout:9/106: stat d7 0 2023-12-12T11:51:44.603 INFO:tasks.workunit.client.1.smithi093.stdout:6/440: read d0/d7b/f94 [1869633,42977] 0 2023-12-12T11:51:44.603 INFO:tasks.workunit.client.1.smithi093.stdout:6/441: read - d0/da/d32/d39/d5b/fa2 zero size 2023-12-12T11:51:44.611 INFO:tasks.workunit.client.1.smithi093.stdout:1/330: mknod d4/d1a/d1b/d26/c6c 0 2023-12-12T11:51:44.614 INFO:tasks.workunit.client.0.smithi063.stdout:0/86: write d0/d10/fb [3689014,115827] 0 2023-12-12T11:51:44.615 INFO:tasks.workunit.client.0.smithi063.stdout:0/87: write d0/d10/fb [1504231,112178] 0 2023-12-12T11:51:44.620 INFO:tasks.workunit.client.0.smithi063.stdout:2/69: rename d0/l3 to d0/d11/l16 0 2023-12-12T11:51:44.620 INFO:tasks.workunit.client.0.smithi063.stdout:2/70: creat d0/f17 x:0 0 0 2023-12-12T11:51:44.625 INFO:tasks.workunit.client.1.smithi093.stdout:2/361: link d5/d14/d2d/f1f d5/d31/f77 0 2023-12-12T11:51:44.625 INFO:tasks.workunit.client.1.smithi093.stdout:3/342: rmdir df/d30/d33 39 2023-12-12T11:51:44.627 INFO:tasks.workunit.client.1.smithi093.stdout:0/345: getdents d5/d21/d27 0 2023-12-12T11:51:44.627 INFO:tasks.workunit.client.1.smithi093.stdout:0/346: readlink d5/dd/d14/d26/l43 0 2023-12-12T11:51:44.627 INFO:tasks.workunit.client.0.smithi063.stdout:8/177: creat d4/d29/f34 x:0 0 0 2023-12-12T11:51:44.627 INFO:tasks.workunit.client.0.smithi063.stdout:8/178: dread - d4/de/f30 zero size 2023-12-12T11:51:44.628 INFO:tasks.workunit.client.1.smithi093.stdout:7/297: link da/d15/f1c da/de/d46/f69 0 2023-12-12T11:51:44.631 INFO:tasks.workunit.client.0.smithi063.stdout:1/82: rmdir d3/db/d16 39 2023-12-12T11:51:44.631 INFO:tasks.workunit.client.1.smithi093.stdout:5/227: link d0/d7/d27/d35/f1f d0/d7/d27/d48/f50 0 2023-12-12T11:51:44.631 INFO:tasks.workunit.client.1.smithi093.stdout:5/228: readlink d0/d7/l12 0 2023-12-12T11:51:44.632 INFO:tasks.workunit.client.0.smithi063.stdout:9/107: unlink c2 0 2023-12-12T11:51:44.632 INFO:tasks.workunit.client.0.smithi063.stdout:9/108: write d7/f14 [635571,11882] 0 2023-12-12T11:51:44.633 INFO:tasks.workunit.client.1.smithi093.stdout:8/310: sync 2023-12-12T11:51:44.635 INFO:tasks.workunit.client.0.smithi063.stdout:4/141: dread d2/d8/fe [0,4194304] 0 2023-12-12T11:51:44.635 INFO:tasks.workunit.client.0.smithi063.stdout:4/142: readlink d2/d8/d14/l2b 0 2023-12-12T11:51:44.638 INFO:tasks.workunit.client.1.smithi093.stdout:4/513: rmdir d0/d36 39 2023-12-12T11:51:44.638 INFO:tasks.workunit.client.1.smithi093.stdout:4/514: readlink d0/d31/d5c/l9b 0 2023-12-12T11:51:44.638 INFO:tasks.workunit.client.0.smithi063.stdout:7/85: rmdir de 39 2023-12-12T11:51:44.638 INFO:tasks.workunit.client.0.smithi063.stdout:7/86: readlink l7 0 2023-12-12T11:51:44.643 INFO:tasks.workunit.client.1.smithi093.stdout:9/289: symlink d1/d23/d24/d29/d43/l62 0 2023-12-12T11:51:44.646 INFO:tasks.workunit.client.1.smithi093.stdout:9/290: write d1/d12/f1c [1175917,78920] 0 2023-12-12T11:51:44.648 INFO:tasks.workunit.client.1.smithi093.stdout:6/442: mknod d0/d52/d7e/d42/ca7 0 2023-12-12T11:51:44.651 INFO:tasks.workunit.client.0.smithi063.stdout:2/71: rename d0/d11/l16 to d0/l18 0 2023-12-12T11:51:44.651 INFO:tasks.workunit.client.0.smithi063.stdout:2/72: chown d0/ce 170656 1 2023-12-12T11:51:44.653 INFO:tasks.workunit.client.1.smithi093.stdout:2/362: rename d5/l23 to d5/d14/d2d/d12/d44/l78 0 2023-12-12T11:51:44.660 INFO:tasks.workunit.client.0.smithi063.stdout:3/72: mknod d4/df/c12 0 2023-12-12T11:51:44.662 INFO:tasks.workunit.client.1.smithi093.stdout:0/347: getdents d5/d21/d2f 0 2023-12-12T11:51:44.662 INFO:tasks.workunit.client.1.smithi093.stdout:0/348: truncate d5/dd/d14/d26/d58/f63 775248 0 2023-12-12T11:51:44.662 INFO:tasks.workunit.client.1.smithi093.stdout:0/349: chown d5/d21/d27/f5d 564619 1 2023-12-12T11:51:44.662 INFO:tasks.workunit.client.1.smithi093.stdout:0/350: read - d5/d21/d27/f5a zero size 2023-12-12T11:51:44.662 INFO:tasks.workunit.client.1.smithi093.stdout:5/229: stat d0/d7/d36/d29/c41 0 2023-12-12T11:51:44.662 INFO:tasks.workunit.client.0.smithi063.stdout:1/83: getdents d3/db/d16 0 2023-12-12T11:51:44.663 INFO:tasks.workunit.client.1.smithi093.stdout:4/515: dread d0/d31/f3b [0,4194304] 0 2023-12-12T11:51:44.663 INFO:tasks.workunit.client.1.smithi093.stdout:8/311: unlink d3/d1a/f25 0 2023-12-12T11:51:44.664 INFO:tasks.workunit.client.1.smithi093.stdout:8/312: dread - d3/d1a/d1f/d29/d3a/d40/f53 zero size 2023-12-12T11:51:44.664 INFO:tasks.workunit.client.1.smithi093.stdout:8/313: chown d3/d1a/l1b 966580 1 2023-12-12T11:51:44.668 INFO:tasks.workunit.client.1.smithi093.stdout:6/443: getdents d0/da 0 2023-12-12T11:51:44.670 INFO:tasks.workunit.client.0.smithi063.stdout:0/88: rename d0/l14 to d0/d1a/l1b 0 2023-12-12T11:51:44.671 INFO:tasks.workunit.client.0.smithi063.stdout:4/143: getdents d2/d8/d14 0 2023-12-12T11:51:44.672 INFO:tasks.workunit.client.0.smithi063.stdout:1/84: dread d3/db/fd [0,4194304] 0 2023-12-12T11:51:44.673 INFO:tasks.workunit.client.1.smithi093.stdout:2/363: mknod d5/d14/d2d/d12/d25/c79 0 2023-12-12T11:51:44.673 INFO:tasks.workunit.client.1.smithi093.stdout:2/364: chown d5/d14/d2d/d12/d25/l66 1001414 1 2023-12-12T11:51:44.676 INFO:tasks.workunit.client.1.smithi093.stdout:6/444: dread d0/da/f2e [0,4194304] 0 2023-12-12T11:51:44.676 INFO:tasks.workunit.client.1.smithi093.stdout:7/298: link da/d15/c39 da/d15/d19/c6a 0 2023-12-12T11:51:44.676 INFO:tasks.workunit.client.1.smithi093.stdout:6/445: dread - d0/da/d32/d9e/d4d/f92 zero size 2023-12-12T11:51:44.678 INFO:tasks.workunit.client.1.smithi093.stdout:5/230: unlink d0/d7/d36/f32 0 2023-12-12T11:51:44.679 INFO:tasks.workunit.client.1.smithi093.stdout:7/299: write da/de/f30 [108753,76568] 0 2023-12-12T11:51:44.685 INFO:tasks.workunit.client.0.smithi063.stdout:2/73: read d0/ff [1873965,113861] 0 2023-12-12T11:51:44.688 INFO:tasks.workunit.client.0.smithi063.stdout:3/73: rename c1 to d4/df/c13 0 2023-12-12T11:51:44.689 INFO:tasks.workunit.client.0.smithi063.stdout:4/144: dread d2/f6 [0,4194304] 0 2023-12-12T11:51:44.689 INFO:tasks.workunit.client.0.smithi063.stdout:4/145: chown d2/d17/c2e 1406318 1 2023-12-12T11:51:44.691 INFO:tasks.workunit.client.0.smithi063.stdout:2/74: mknod d0/d11/c19 0 2023-12-12T11:51:44.691 INFO:tasks.workunit.client.0.smithi063.stdout:2/75: readlink d0/l12 0 2023-12-12T11:51:44.694 INFO:tasks.workunit.client.1.smithi093.stdout:4/516: mkdir d0/d31/d89/da1 0 2023-12-12T11:51:44.695 INFO:tasks.workunit.client.1.smithi093.stdout:4/517: chown d0/f1d 13157 1 2023-12-12T11:51:44.695 INFO:tasks.workunit.client.1.smithi093.stdout:4/518: chown d0 571 1 2023-12-12T11:51:44.695 INFO:tasks.workunit.client.1.smithi093.stdout:4/519: fsync d0/f47 0 2023-12-12T11:51:44.695 INFO:tasks.workunit.client.1.smithi093.stdout:8/314: creat d3/d1a/d1f/d29/d63/f65 x:0 0 0 2023-12-12T11:51:44.695 INFO:tasks.workunit.client.1.smithi093.stdout:8/315: truncate d3/f36 1260280 0 2023-12-12T11:51:44.695 INFO:tasks.workunit.client.1.smithi093.stdout:8/316: fdatasync d3/d1a/d1f/f47 0 2023-12-12T11:51:44.695 INFO:tasks.workunit.client.0.smithi063.stdout:8/179: dread d4/de/f13 [0,4194304] 0 2023-12-12T11:51:44.695 INFO:tasks.workunit.client.0.smithi063.stdout:8/180: fsync f1 0 2023-12-12T11:51:44.696 INFO:tasks.workunit.client.0.smithi063.stdout:8/181: stat d4/f22 0 2023-12-12T11:51:44.696 INFO:tasks.workunit.client.1.smithi093.stdout:2/365: getdents d5/d31 0 2023-12-12T11:51:44.696 INFO:tasks.workunit.client.1.smithi093.stdout:5/231: dread d0/f15 [4194304,4194304] 0 2023-12-12T11:51:44.696 INFO:tasks.workunit.client.1.smithi093.stdout:5/232: truncate d0/d7/d36/d38/f34 828663 0 2023-12-12T11:51:44.696 INFO:tasks.workunit.client.1.smithi093.stdout:5/233: chown d0/c6 392 1 2023-12-12T11:51:44.698 INFO:tasks.workunit.client.0.smithi063.stdout:1/85: rename d3/c4 to d3/db/d16/d17/d19/c1c 0 2023-12-12T11:51:44.698 INFO:tasks.workunit.client.0.smithi063.stdout:1/86: creat d3/db/f1d x:0 0 0 2023-12-12T11:51:44.698 INFO:tasks.workunit.client.0.smithi063.stdout:1/87: chown d3/c8 233 1 2023-12-12T11:51:44.705 INFO:tasks.workunit.client.0.smithi063.stdout:9/109: dwrite d7/d11/d12/f18 [0,4194304] 0 2023-12-12T11:51:44.705 INFO:tasks.workunit.client.0.smithi063.stdout:9/110: chown l1 29953426 1 2023-12-12T11:51:44.705 INFO:tasks.workunit.client.0.smithi063.stdout:9/111: dread - d7/f1e zero size 2023-12-12T11:51:44.705 INFO:tasks.workunit.client.0.smithi063.stdout:9/112: write d7/f8 [1081896,1408] 0 2023-12-12T11:51:44.707 INFO:tasks.workunit.client.0.smithi063.stdout:4/146: creat d2/d8/d14/f31 x:0 0 0 2023-12-12T11:51:44.708 INFO:tasks.workunit.client.1.smithi093.stdout:6/446: creat d0/da/d14/d9c/fa8 x:0 0 0 2023-12-12T11:51:44.713 INFO:tasks.workunit.client.1.smithi093.stdout:7/300: mknod da/d15/d19/d4c/c6b 0 2023-12-12T11:51:44.713 INFO:tasks.workunit.client.1.smithi093.stdout:7/301: chown da/d15/d19/c6a 159122 1 2023-12-12T11:51:44.714 INFO:tasks.workunit.client.0.smithi063.stdout:2/76: mkdir d0/d1a 0 2023-12-12T11:51:44.714 INFO:tasks.workunit.client.0.smithi063.stdout:2/77: dread - d0/f14 zero size 2023-12-12T11:51:44.716 INFO:tasks.workunit.client.1.smithi093.stdout:8/317: creat d3/d1a/f66 x:0 0 0 2023-12-12T11:51:44.719 INFO:tasks.workunit.client.1.smithi093.stdout:2/366: mkdir d5/d14/d2d/d12/d25/d7a 0 2023-12-12T11:51:44.719 INFO:tasks.workunit.client.1.smithi093.stdout:2/367: chown d5/d14/d5e/f70 7 1 2023-12-12T11:51:44.720 INFO:tasks.workunit.client.1.smithi093.stdout:2/368: chown d5/d46/d61 1166229 1 2023-12-12T11:51:44.720 INFO:tasks.workunit.client.0.smithi063.stdout:7/87: dwrite f8 [0,4194304] 0 2023-12-12T11:51:44.721 INFO:tasks.workunit.client.1.smithi093.stdout:5/234: symlink d0/d7/d27/d48/l51 0 2023-12-12T11:51:44.722 INFO:tasks.workunit.client.1.smithi093.stdout:5/235: write d0/f3 [5589399,94936] 0 2023-12-12T11:51:44.722 INFO:tasks.workunit.client.1.smithi093.stdout:5/236: chown d0 0 1 2023-12-12T11:51:44.723 INFO:tasks.workunit.client.0.smithi063.stdout:1/88: creat d3/db/d16/d17/d19/f1e x:0 0 0 2023-12-12T11:51:44.723 INFO:tasks.workunit.client.0.smithi063.stdout:1/89: readlink d3/l11 0 2023-12-12T11:51:44.723 INFO:tasks.workunit.client.0.smithi063.stdout:9/113: symlink d7/d15/l22 0 2023-12-12T11:51:44.723 INFO:tasks.workunit.client.0.smithi063.stdout:9/114: write f6 [1563964,12193] 0 2023-12-12T11:51:44.723 INFO:tasks.workunit.client.0.smithi063.stdout:9/115: dread - d7/f1e zero size 2023-12-12T11:51:44.723 INFO:tasks.workunit.client.0.smithi063.stdout:9/116: truncate f0 2935654 0 2023-12-12T11:51:44.726 INFO:tasks.workunit.client.0.smithi063.stdout:3/74: write f0 [3870432,22976] 0 2023-12-12T11:51:44.730 INFO:tasks.workunit.client.1.smithi093.stdout:2/369: read d5/d14/d2d/d12/d44/f4d [63626,38074] 0 2023-12-12T11:51:44.730 INFO:tasks.workunit.client.1.smithi093.stdout:2/370: fsync d5/d14/d2d/ff 0 2023-12-12T11:51:44.730 INFO:tasks.workunit.client.1.smithi093.stdout:2/371: write d5/f8 [2732370,21246] 0 2023-12-12T11:51:44.731 INFO:tasks.workunit.client.1.smithi093.stdout:2/372: dread - d5/d14/d47/f5b zero size 2023-12-12T11:51:44.734 INFO:tasks.workunit.client.1.smithi093.stdout:5/237: dread d0/f5 [0,4194304] 0 2023-12-12T11:51:44.734 INFO:tasks.workunit.client.1.smithi093.stdout:5/238: stat d0/d7/d8/de/f3a 0 2023-12-12T11:51:44.735 INFO:tasks.workunit.client.1.smithi093.stdout:2/373: dread d5/d14/d2d/d12/d44/f57 [0,4194304] 0 2023-12-12T11:51:44.736 INFO:tasks.workunit.client.1.smithi093.stdout:6/447: rmdir d0/da 39 2023-12-12T11:51:44.736 INFO:tasks.workunit.client.1.smithi093.stdout:6/448: stat d0/f44 0 2023-12-12T11:51:44.736 INFO:tasks.workunit.client.1.smithi093.stdout:6/449: creat d0/da/d32/fa9 x:0 0 0 2023-12-12T11:51:44.741 INFO:tasks.workunit.client.0.smithi063.stdout:2/78: symlink d0/d1a/l1b 0 2023-12-12T11:51:44.741 INFO:tasks.workunit.client.0.smithi063.stdout:7/88: write de/f1e [1977263,36028] 0 2023-12-12T11:51:44.742 INFO:tasks.workunit.client.1.smithi093.stdout:8/318: creat d3/d1a/d1f/d29/d30/d58/f67 x:0 0 0 2023-12-12T11:51:44.742 INFO:tasks.workunit.client.1.smithi093.stdout:8/319: dread - d3/d1a/d1f/f47 zero size 2023-12-12T11:51:44.743 INFO:tasks.workunit.client.0.smithi063.stdout:7/89: readlink de/l10 0 2023-12-12T11:51:44.743 INFO:tasks.workunit.client.0.smithi063.stdout:7/90: write de/f1d [4452757,23303] 0 2023-12-12T11:51:44.743 INFO:tasks.workunit.client.0.smithi063.stdout:7/91: write de/f13 [984586,63314] 0 2023-12-12T11:51:44.743 INFO:tasks.workunit.client.0.smithi063.stdout:7/92: fsync fb 0 2023-12-12T11:51:44.743 INFO:tasks.workunit.client.0.smithi063.stdout:0/89: dwrite d0/d7/ff [0,4194304] 0 2023-12-12T11:51:44.743 INFO:tasks.workunit.client.0.smithi063.stdout:7/93: write de/f19 [422915,116154] 0 2023-12-12T11:51:44.745 INFO:tasks.workunit.client.1.smithi093.stdout:5/239: rename d0/d7/d36/c3d to d0/d7/c52 0 2023-12-12T11:51:44.746 INFO:tasks.workunit.client.1.smithi093.stdout:5/240: dread - d0/d7/d36/d38/f49 zero size 2023-12-12T11:51:44.746 INFO:tasks.workunit.client.0.smithi063.stdout:1/90: mknod d3/db/d12/c1f 0 2023-12-12T11:51:44.746 INFO:tasks.workunit.client.0.smithi063.stdout:1/91: dread - d3/f1a zero size 2023-12-12T11:51:44.747 INFO:tasks.workunit.client.0.smithi063.stdout:1/92: creat d3/db/f20 x:0 0 0 2023-12-12T11:51:44.747 INFO:tasks.workunit.client.1.smithi093.stdout:7/302: dread da/fb [0,4194304] 0 2023-12-12T11:51:44.750 INFO:tasks.workunit.client.1.smithi093.stdout:6/450: rename d0/da/d14/d38/d43/c85 to d0/da/d14/d38/d69/caa 0 2023-12-12T11:51:44.750 INFO:tasks.workunit.client.1.smithi093.stdout:6/451: fsync d0/da/d14/d3a/f6a 0 2023-12-12T11:51:44.750 INFO:tasks.workunit.client.1.smithi093.stdout:6/452: dread - d0/da/d32/d9e/d4d/f82 zero size 2023-12-12T11:51:44.751 INFO:tasks.workunit.client.1.smithi093.stdout:5/241: symlink d0/d7/d8/l53 0 2023-12-12T11:51:44.754 INFO:tasks.workunit.client.1.smithi093.stdout:7/303: creat da/d15/d2d/d2f/f6c x:0 0 0 2023-12-12T11:51:44.754 INFO:tasks.workunit.client.1.smithi093.stdout:7/304: write da/de/f30 [213971,6235] 0 2023-12-12T11:51:44.755 INFO:tasks.workunit.client.0.smithi063.stdout:4/147: unlink d2/d8/ld 0 2023-12-12T11:51:44.755 INFO:tasks.workunit.client.0.smithi063.stdout:4/148: write d2/d8/d14/f2d [420495,45334] 0 2023-12-12T11:51:44.756 INFO:tasks.workunit.client.0.smithi063.stdout:8/182: dwrite d4/f1d [0,4194304] 0 2023-12-12T11:51:44.757 INFO:tasks.workunit.client.1.smithi093.stdout:6/453: creat d0/da/d14/d3a/d95/fab x:0 0 0 2023-12-12T11:51:44.758 INFO:tasks.workunit.client.1.smithi093.stdout:8/320: dread d3/d1a/f44 [0,4194304] 0 2023-12-12T11:51:44.759 INFO:tasks.workunit.client.1.smithi093.stdout:8/321: fdatasync d3/d1a/d1f/d29/d3a/f5c 0 2023-12-12T11:51:44.759 INFO:tasks.workunit.client.0.smithi063.stdout:2/79: creat d0/d1a/f1c x:0 0 0 2023-12-12T11:51:44.759 INFO:tasks.workunit.client.1.smithi093.stdout:5/242: mknod d0/d7/d27/c54 0 2023-12-12T11:51:44.762 INFO:tasks.workunit.client.1.smithi093.stdout:7/305: mkdir da/d15/d19/d4c/d6d 0 2023-12-12T11:51:44.766 INFO:tasks.workunit.client.1.smithi093.stdout:6/454: symlink d0/da/lac 0 2023-12-12T11:51:44.766 INFO:tasks.workunit.client.1.smithi093.stdout:8/322: unlink d3/d8/l15 0 2023-12-12T11:51:44.768 INFO:tasks.workunit.client.0.smithi063.stdout:7/94: link l3 de/l1f 0 2023-12-12T11:51:44.769 INFO:tasks.workunit.client.1.smithi093.stdout:5/243: symlink d0/d7/d8/l55 0 2023-12-12T11:51:44.773 INFO:tasks.workunit.client.1.smithi093.stdout:8/323: truncate d3/d1a/d1f/f2f 212764 0 2023-12-12T11:51:44.773 INFO:tasks.workunit.client.1.smithi093.stdout:8/324: write d3/d1a/d1f/d29/d3a/f5c [644779,123477] 0 2023-12-12T11:51:44.773 INFO:tasks.workunit.client.1.smithi093.stdout:8/325: readlink d3/lf 0 2023-12-12T11:51:44.781 INFO:tasks.workunit.client.1.smithi093.stdout:2/374: dwrite d5/d31/f77 [0,4194304] 0 2023-12-12T11:51:44.788 INFO:tasks.workunit.client.1.smithi093.stdout:8/326: mkdir d3/d1a/d1f/d29/d3a/d68 0 2023-12-12T11:51:44.793 INFO:tasks.workunit.client.0.smithi063.stdout:4/149: rename d2/f25 to d2/d8/f32 0 2023-12-12T11:51:44.793 INFO:tasks.workunit.client.0.smithi063.stdout:0/90: dread d0/d7/ff [0,4194304] 0 2023-12-12T11:51:44.795 INFO:tasks.workunit.client.0.smithi063.stdout:3/75: link d4/df/c13 d4/df/c14 0 2023-12-12T11:51:44.797 INFO:tasks.workunit.client.1.smithi093.stdout:2/375: mknod d5/d14/d47/c7b 0 2023-12-12T11:51:44.802 INFO:tasks.workunit.client.1.smithi093.stdout:4/520: getdents d0/d31/d89 0 2023-12-12T11:51:44.802 INFO:tasks.workunit.client.1.smithi093.stdout:4/521: rename d0/d31 to d0/d31/d9d/da2 22 2023-12-12T11:51:44.811 INFO:tasks.workunit.client.0.smithi063.stdout:8/183: rename d4/f2b to d4/d29/f35 0 2023-12-12T11:51:44.814 INFO:tasks.workunit.client.0.smithi063.stdout:4/150: chown d2/d8/f2a 0 1 2023-12-12T11:51:44.815 INFO:tasks.workunit.client.1.smithi093.stdout:8/327: mkdir d3/d1a/d1f/d59/d69 0 2023-12-12T11:51:44.815 INFO:tasks.workunit.client.1.smithi093.stdout:2/376: symlink d5/d14/d2d/d4c/d76/l7c 0 2023-12-12T11:51:44.821 INFO:tasks.workunit.client.1.smithi093.stdout:2/377: rmdir d5/d14/d2d/d4c/d54/d67 39 2023-12-12T11:51:44.821 INFO:tasks.workunit.client.1.smithi093.stdout:2/378: write d5/d14/d2d/d12/f59 [491030,109191] 0 2023-12-12T11:51:44.822 INFO:tasks.workunit.client.0.smithi063.stdout:8/184: mkdir d4/de/d32/d36 0 2023-12-12T11:51:44.831 INFO:tasks.workunit.client.0.smithi063.stdout:9/117: dwrite d7/d15/f1d [0,4194304] 0 2023-12-12T11:51:44.831 INFO:tasks.workunit.client.0.smithi063.stdout:9/118: creat d7/d15/f23 x:0 0 0 2023-12-12T11:51:44.838 INFO:tasks.workunit.client.1.smithi093.stdout:5/244: dwrite d0/f5 [0,4194304] 0 2023-12-12T11:51:44.842 INFO:tasks.workunit.client.1.smithi093.stdout:2/379: mkdir d5/d14/d5e/d7d 0 2023-12-12T11:51:44.842 INFO:tasks.workunit.client.1.smithi093.stdout:5/245: read d0/d7/d8/f37 [459815,75611] 0 2023-12-12T11:51:44.844 INFO:tasks.workunit.client.0.smithi063.stdout:2/80: dwrite d0/f4 [0,4194304] 0 2023-12-12T11:51:44.844 INFO:tasks.workunit.client.0.smithi063.stdout:2/81: write d0/fb [372726,69181] 0 2023-12-12T11:51:44.845 INFO:tasks.workunit.client.0.smithi063.stdout:8/185: mknod d4/d24/c37 0 2023-12-12T11:51:44.848 INFO:tasks.workunit.client.0.smithi063.stdout:1/93: dwrite d3/f10 [0,4194304] 0 2023-12-12T11:51:44.850 INFO:tasks.workunit.client.0.smithi063.stdout:4/151: symlink d2/d8/l33 0 2023-12-12T11:51:44.852 INFO:tasks.workunit.client.1.smithi093.stdout:6/455: dwrite d0/fa6 [0,4194304] 0 2023-12-12T11:51:44.852 INFO:tasks.workunit.client.1.smithi093.stdout:6/456: creat d0/da/d14/d9c/fad x:0 0 0 2023-12-12T11:51:44.861 INFO:tasks.workunit.client.1.smithi093.stdout:5/246: link d0/f15 d0/d7/d27/d48/f56 0 2023-12-12T11:51:44.861 INFO:tasks.workunit.client.1.smithi093.stdout:7/306: dwrite da/de/d46/f69 [4194304,4194304] 0 2023-12-12T11:51:44.862 INFO:tasks.workunit.client.1.smithi093.stdout:7/307: write da/d2e/f42 [862684,47733] 0 2023-12-12T11:51:44.868 INFO:tasks.workunit.client.0.smithi063.stdout:9/119: symlink d7/l24 0 2023-12-12T11:51:44.868 INFO:tasks.workunit.client.0.smithi063.stdout:4/152: dread d2/f1d [0,4194304] 0 2023-12-12T11:51:44.868 INFO:tasks.workunit.client.0.smithi063.stdout:4/153: write d2/d8/d14/f31 [658549,105489] 0 2023-12-12T11:51:44.869 INFO:tasks.workunit.client.1.smithi093.stdout:6/457: mknod d0/d7b/cae 0 2023-12-12T11:51:44.869 INFO:tasks.workunit.client.1.smithi093.stdout:1/331: sync 2023-12-12T11:51:44.869 INFO:tasks.workunit.client.1.smithi093.stdout:1/332: fdatasync d4/dc/f59 0 2023-12-12T11:51:44.872 INFO:tasks.workunit.client.1.smithi093.stdout:8/328: dwrite d3/d1a/d1f/d29/f4d [0,4194304] 0 2023-12-12T11:51:44.874 INFO:tasks.workunit.client.0.smithi063.stdout:5/115: sync 2023-12-12T11:51:44.874 INFO:tasks.workunit.client.0.smithi063.stdout:6/139: sync 2023-12-12T11:51:44.875 INFO:tasks.workunit.client.0.smithi063.stdout:8/186: write d4/de/d1e/f20 [574857,93499] 0 2023-12-12T11:51:44.882 INFO:tasks.workunit.client.0.smithi063.stdout:2/82: rename d0/fb to d0/d1a/f1d 0 2023-12-12T11:51:44.887 INFO:tasks.workunit.client.1.smithi093.stdout:5/247: dread d0/d7/d27/d48/f56 [0,4194304] 0 2023-12-12T11:51:44.888 INFO:tasks.workunit.client.0.smithi063.stdout:2/83: dread d0/f5 [0,4194304] 0 2023-12-12T11:51:44.890 INFO:tasks.workunit.client.0.smithi063.stdout:0/91: dwrite d0/d10/f13 [0,4194304] 0 2023-12-12T11:51:44.890 INFO:tasks.workunit.client.0.smithi063.stdout:1/94: creat d3/db/d16/f21 x:0 0 0 2023-12-12T11:51:44.890 INFO:tasks.workunit.client.0.smithi063.stdout:1/95: read - d3/f1a zero size 2023-12-12T11:51:44.890 INFO:tasks.workunit.client.0.smithi063.stdout:1/96: stat d3/db/f1d 0 2023-12-12T11:51:44.890 INFO:tasks.workunit.client.0.smithi063.stdout:1/97: write d3/f1a [997319,51405] 0 2023-12-12T11:51:44.891 INFO:tasks.workunit.client.0.smithi063.stdout:3/76: dwrite d4/fb [0,4194304] 0 2023-12-12T11:51:44.897 INFO:tasks.workunit.client.1.smithi093.stdout:2/380: dwrite d5/d14/d2d/d4c/d54/f65 [4194304,4194304] 0 2023-12-12T11:51:44.898 INFO:tasks.workunit.client.1.smithi093.stdout:4/522: dwrite d0/d36/f60 [0,4194304] 0 2023-12-12T11:51:44.898 INFO:tasks.workunit.client.0.smithi063.stdout:4/154: symlink d2/d8/d14/l34 0 2023-12-12T11:51:44.898 INFO:tasks.workunit.client.0.smithi063.stdout:9/120: write d7/d11/d12/f18 [3355491,52706] 0 2023-12-12T11:51:44.905 INFO:tasks.workunit.client.0.smithi063.stdout:6/140: symlink d9/d2c/l33 0 2023-12-12T11:51:44.910 INFO:tasks.workunit.client.1.smithi093.stdout:8/329: dread d3/d1a/d1f/d29/d3a/f5c [0,4194304] 0 2023-12-12T11:51:44.912 INFO:tasks.workunit.client.0.smithi063.stdout:2/84: mkdir d0/d1a/d1e 0 2023-12-12T11:51:44.912 INFO:tasks.workunit.client.0.smithi063.stdout:2/85: truncate d0/f5 849279 0 2023-12-12T11:51:44.917 INFO:tasks.workunit.client.1.smithi093.stdout:7/308: creat da/d15/d2d/f6e x:0 0 0 2023-12-12T11:51:44.926 INFO:tasks.workunit.client.0.smithi063.stdout:5/116: write d7/f9 [1928395,15977] 0 2023-12-12T11:51:44.928 INFO:tasks.workunit.client.0.smithi063.stdout:7/95: dwrite de/f19 [0,4194304] 0 2023-12-12T11:51:44.929 INFO:tasks.workunit.client.0.smithi063.stdout:5/117: creat d7/de/f20 x:0 0 0 2023-12-12T11:51:44.931 INFO:tasks.workunit.client.0.smithi063.stdout:7/96: fdatasync de/f1a 0 2023-12-12T11:51:44.936 INFO:tasks.workunit.client.0.smithi063.stdout:0/92: dread d0/d10/f13 [0,4194304] 0 2023-12-12T11:51:44.936 INFO:tasks.workunit.client.0.smithi063.stdout:3/77: chown d4/f6 1428155 1 2023-12-12T11:51:44.937 INFO:tasks.workunit.client.1.smithi093.stdout:6/458: creat d0/d52/d7e/faf x:0 0 0 2023-12-12T11:51:44.945 INFO:tasks.workunit.client.0.smithi063.stdout:6/141: creat d9/d10/d2a/f34 x:0 0 0 2023-12-12T11:51:44.946 INFO:tasks.workunit.client.1.smithi093.stdout:1/333: rename d4/dc/f59 to d4/d1c/f6d 0 2023-12-12T11:51:44.947 INFO:tasks.workunit.client.1.smithi093.stdout:5/248: dwrite d0/d7/f1c [0,4194304] 0 2023-12-12T11:51:44.947 INFO:tasks.workunit.client.1.smithi093.stdout:5/249: write d0/d7/d27/d35/f31 [509979,73078] 0 2023-12-12T11:51:44.951 INFO:tasks.workunit.client.1.smithi093.stdout:2/381: mkdir d5/d14/d2d/d12/d25/d7a/d7e 0 2023-12-12T11:51:44.952 INFO:tasks.workunit.client.1.smithi093.stdout:2/382: chown d5/d46/d55/l6b 13340 1 2023-12-12T11:51:44.957 INFO:tasks.workunit.client.0.smithi063.stdout:3/78: truncate f0 2135488 0 2023-12-12T11:51:44.957 INFO:tasks.workunit.client.0.smithi063.stdout:2/86: write d0/f4 [2525926,66123] 0 2023-12-12T11:51:44.961 INFO:tasks.workunit.client.0.smithi063.stdout:9/121: getdents d7/d11 0 2023-12-12T11:51:44.963 INFO:tasks.workunit.client.0.smithi063.stdout:6/142: dread d9/f31 [0,4194304] 0 2023-12-12T11:51:44.963 INFO:tasks.workunit.client.0.smithi063.stdout:8/187: dwrite d4/de/f30 [0,4194304] 0 2023-12-12T11:51:44.963 INFO:tasks.workunit.client.0.smithi063.stdout:0/93: fdatasync d0/d10/fb 0 2023-12-12T11:51:44.964 INFO:tasks.workunit.client.0.smithi063.stdout:0/94: fsync d0/d10/fb 0 2023-12-12T11:51:44.966 INFO:tasks.workunit.client.0.smithi063.stdout:4/155: dwrite d2/f6 [0,4194304] 0 2023-12-12T11:51:44.971 INFO:tasks.workunit.client.0.smithi063.stdout:7/97: write fb [2466862,121696] 0 2023-12-12T11:51:44.972 INFO:tasks.workunit.client.0.smithi063.stdout:3/79: creat d4/f15 x:0 0 0 2023-12-12T11:51:44.973 INFO:tasks.workunit.client.1.smithi093.stdout:4/523: getdents d0/d87/d79/d7f 0 2023-12-12T11:51:44.973 INFO:tasks.workunit.client.1.smithi093.stdout:4/524: stat d0/c53 0 2023-12-12T11:51:44.973 INFO:tasks.workunit.client.1.smithi093.stdout:4/525: creat d0/fa3 x:0 0 0 2023-12-12T11:51:44.976 INFO:tasks.workunit.client.0.smithi063.stdout:1/98: dwrite f2 [0,4194304] 0 2023-12-12T11:51:44.978 INFO:tasks.workunit.client.0.smithi063.stdout:9/122: link d7/f10 d7/d11/f25 0 2023-12-12T11:51:44.978 INFO:tasks.workunit.client.0.smithi063.stdout:9/123: fsync d7/d15/f23 0 2023-12-12T11:51:44.978 INFO:tasks.workunit.client.0.smithi063.stdout:9/124: fsync d7/d15/f1d 0 2023-12-12T11:51:44.979 INFO:tasks.workunit.client.0.smithi063.stdout:9/125: creat d7/d15/f26 x:0 0 0 2023-12-12T11:51:44.979 INFO:tasks.workunit.client.0.smithi063.stdout:9/126: chown d7 477917380 1 2023-12-12T11:51:44.979 INFO:tasks.workunit.client.0.smithi063.stdout:9/127: creat d7/f27 x:0 0 0 2023-12-12T11:51:44.979 INFO:tasks.workunit.client.0.smithi063.stdout:5/118: dread d7/f1a [0,4194304] 0 2023-12-12T11:51:44.981 INFO:tasks.workunit.client.0.smithi063.stdout:2/87: dread d0/f4 [0,4194304] 0 2023-12-12T11:51:44.981 INFO:tasks.workunit.client.0.smithi063.stdout:2/88: chown d0/l7 189158037 1 2023-12-12T11:51:44.983 INFO:tasks.workunit.client.1.smithi093.stdout:8/330: creat d3/d1a/d1f/d59/f6a x:0 0 0 2023-12-12T11:51:44.983 INFO:tasks.workunit.client.0.smithi063.stdout:1/99: write d3/db/fe [481688,10699] 0 2023-12-12T11:51:44.983 INFO:tasks.workunit.client.0.smithi063.stdout:1/100: rename d3/db to d3/db/d22 22 2023-12-12T11:51:44.987 INFO:tasks.workunit.client.0.smithi063.stdout:9/128: dread d7/d15/f17 [0,4194304] 0 2023-12-12T11:51:44.991 INFO:tasks.workunit.client.0.smithi063.stdout:6/143: mknod d9/c35 0 2023-12-12T11:51:44.991 INFO:tasks.workunit.client.0.smithi063.stdout:6/144: chown d9/d2c/l33 85888298 1 2023-12-12T11:51:44.993 INFO:tasks.workunit.client.1.smithi093.stdout:4/526: read d0/d36/d40/f57 [2193879,854] 0 2023-12-12T11:51:44.993 INFO:tasks.workunit.client.1.smithi093.stdout:4/527: read - d0/d31/d5c/d66/f6a zero size 2023-12-12T11:51:44.993 INFO:tasks.workunit.client.1.smithi093.stdout:6/459: dwrite d0/d52/d7e/d42/f8b [0,4194304] 0 2023-12-12T11:51:44.993 INFO:tasks.workunit.client.1.smithi093.stdout:1/334: dwrite d4/f61 [0,4194304] 0 2023-12-12T11:51:44.993 INFO:tasks.workunit.client.1.smithi093.stdout:1/335: truncate d4/d1c/f6d 285619 0 2023-12-12T11:51:44.993 INFO:tasks.workunit.client.1.smithi093.stdout:1/336: chown d4/dc/f33 511120356 1 2023-12-12T11:51:44.993 INFO:tasks.workunit.client.1.smithi093.stdout:1/337: fsync d4/f52 0 2023-12-12T11:51:44.993 INFO:tasks.workunit.client.1.smithi093.stdout:1/338: readlink d4/l1f 0 2023-12-12T11:51:44.994 INFO:tasks.workunit.client.0.smithi063.stdout:8/188: mkdir d4/d24/d38 0 2023-12-12T11:51:44.994 INFO:tasks.workunit.client.0.smithi063.stdout:8/189: chown d4/de/d1e/f33 8 1 2023-12-12T11:51:44.995 INFO:tasks.workunit.client.0.smithi063.stdout:8/190: chown d4 269154428 1 2023-12-12T11:51:44.995 INFO:tasks.workunit.client.0.smithi063.stdout:8/191: rename d4/de to d4/de/d32/d36/d39 22 2023-12-12T11:51:44.995 INFO:tasks.workunit.client.1.smithi093.stdout:3/343: sync 2023-12-12T11:51:44.999 INFO:tasks.workunit.client.0.smithi063.stdout:0/95: creat d0/d1a/f1c x:0 0 0 2023-12-12T11:51:45.000 INFO:tasks.workunit.client.0.smithi063.stdout:0/96: fsync d0/f12 0 2023-12-12T11:51:45.002 INFO:tasks.workunit.client.1.smithi093.stdout:2/383: symlink d5/d14/l7f 0 2023-12-12T11:51:45.003 INFO:tasks.workunit.client.1.smithi093.stdout:9/291: sync 2023-12-12T11:51:45.003 INFO:tasks.workunit.client.1.smithi093.stdout:9/292: chown d1/c26 303740 1 2023-12-12T11:51:45.009 INFO:tasks.workunit.client.1.smithi093.stdout:0/351: sync 2023-12-12T11:51:45.009 INFO:tasks.workunit.client.1.smithi093.stdout:4/528: dread d0/d36/d40/f4e [0,4194304] 0 2023-12-12T11:51:45.013 INFO:tasks.workunit.client.1.smithi093.stdout:8/331: symlink d3/d1a/d1f/d29/d30/d58/l6b 0 2023-12-12T11:51:45.013 INFO:tasks.workunit.client.1.smithi093.stdout:8/332: fsync d3/d1a/d1f/f2f 0 2023-12-12T11:51:45.017 INFO:tasks.workunit.client.0.smithi063.stdout:0/97: dread d0/d7/ff [0,4194304] 0 2023-12-12T11:51:45.018 INFO:tasks.workunit.client.0.smithi063.stdout:0/98: fdatasync d0/d1a/f1c 0 2023-12-12T11:51:45.018 INFO:tasks.workunit.client.1.smithi093.stdout:1/339: write d4/dc/f10 [1926401,29292] 0 2023-12-12T11:51:45.019 INFO:tasks.workunit.client.1.smithi093.stdout:7/309: link da/de/f3e da/d15/f6f 0 2023-12-12T11:51:45.025 INFO:tasks.workunit.client.0.smithi063.stdout:7/98: dwrite de/f1a [0,4194304] 0 2023-12-12T11:51:45.032 INFO:tasks.workunit.client.1.smithi093.stdout:6/460: mkdir d0/d52/d6b/db0 0 2023-12-12T11:51:45.033 INFO:tasks.workunit.client.0.smithi063.stdout:5/119: symlink d7/de/l21 0 2023-12-12T11:51:45.034 INFO:tasks.workunit.client.1.smithi093.stdout:4/529: write d0/d36/f70 [3612314,25218] 0 2023-12-12T11:51:45.035 INFO:tasks.workunit.client.0.smithi063.stdout:0/99: write d0/d7/ff [3793494,29851] 0 2023-12-12T11:51:45.038 INFO:tasks.workunit.client.0.smithi063.stdout:2/89: symlink d0/d1a/d1e/l1f 0 2023-12-12T11:51:45.038 INFO:tasks.workunit.client.0.smithi063.stdout:2/90: fsync d0/ff 0 2023-12-12T11:51:45.039 INFO:tasks.workunit.client.0.smithi063.stdout:1/101: mknod d3/db/d16/d17/c23 0 2023-12-12T11:51:45.041 INFO:tasks.workunit.client.1.smithi093.stdout:3/344: symlink df/d22/d49/l6c 0 2023-12-12T11:51:45.043 INFO:tasks.workunit.client.0.smithi063.stdout:9/129: mknod d7/d15/c28 0 2023-12-12T11:51:45.045 INFO:tasks.workunit.client.1.smithi093.stdout:5/250: link d0/d7/d27/d35/c25 d0/d7/d36/d38/c57 0 2023-12-12T11:51:45.045 INFO:tasks.workunit.client.1.smithi093.stdout:5/251: truncate d0/d7/d36/f4a 132759 0 2023-12-12T11:51:45.045 INFO:tasks.workunit.client.1.smithi093.stdout:5/252: chown d0/d7/d8/f37 237 1 2023-12-12T11:51:45.046 INFO:tasks.workunit.client.0.smithi063.stdout:8/192: creat d4/de/d32/d36/f3a x:0 0 0 2023-12-12T11:51:45.047 INFO:tasks.workunit.client.1.smithi093.stdout:9/293: mkdir d1/d12/d1f/d3d/d57/d63 0 2023-12-12T11:51:45.047 INFO:tasks.workunit.client.1.smithi093.stdout:9/294: chown d1/d12/l13 1805729826 1 2023-12-12T11:51:45.048 INFO:tasks.workunit.client.1.smithi093.stdout:8/333: mkdir d3/d1a/d1f/d59/d6c 0 2023-12-12T11:51:45.049 INFO:tasks.workunit.client.0.smithi063.stdout:7/99: dread fb [0,4194304] 0 2023-12-12T11:51:45.051 INFO:tasks.workunit.client.1.smithi093.stdout:1/340: creat d4/d1c/d2a/f6e x:0 0 0 2023-12-12T11:51:45.061 INFO:tasks.workunit.client.0.smithi063.stdout:4/156: mknod d2/d8/c35 0 2023-12-12T11:51:45.063 INFO:tasks.workunit.client.1.smithi093.stdout:6/461: symlink d0/da/d14/d21/lb1 0 2023-12-12T11:51:45.066 INFO:tasks.workunit.client.1.smithi093.stdout:0/352: dwrite d5/d21/d27/d3a/f48 [0,4194304] 0 2023-12-12T11:51:45.075 INFO:tasks.workunit.client.1.smithi093.stdout:3/345: rename df/d22/f27 to df/d22/f6d 0 2023-12-12T11:51:45.075 INFO:tasks.workunit.client.1.smithi093.stdout:3/346: dread - df/d22/d49/d69/f6a zero size 2023-12-12T11:51:45.080 INFO:tasks.workunit.client.0.smithi063.stdout:3/80: unlink d4/lc 0 2023-12-12T11:51:45.080 INFO:tasks.workunit.client.0.smithi063.stdout:3/81: read f0 [1415156,9530] 0 2023-12-12T11:51:45.080 INFO:tasks.workunit.client.0.smithi063.stdout:3/82: dread - d4/f15 zero size 2023-12-12T11:51:45.088 INFO:tasks.workunit.client.1.smithi093.stdout:9/295: getdents d1/d23/d24/d29 0 2023-12-12T11:51:45.088 INFO:tasks.workunit.client.1.smithi093.stdout:8/334: mknod d3/d1a/d1f/d59/c6d 0 2023-12-12T11:51:45.089 INFO:tasks.workunit.client.1.smithi093.stdout:8/335: fsync d3/f6 0 2023-12-12T11:51:45.092 INFO:tasks.workunit.client.1.smithi093.stdout:1/341: mkdir d4/d1a/d1b/d26/d65/d6f 0 2023-12-12T11:51:45.099 INFO:tasks.workunit.client.1.smithi093.stdout:7/310: dwrite da/d15/f6f [0,4194304] 0 2023-12-12T11:51:45.101 INFO:tasks.workunit.client.0.smithi063.stdout:5/120: mknod d7/c22 0 2023-12-12T11:51:45.101 INFO:tasks.workunit.client.0.smithi063.stdout:5/121: write d7/de/f20 [146098,66499] 0 2023-12-12T11:51:45.102 INFO:tasks.workunit.client.0.smithi063.stdout:5/122: write d7/de/f1e [915090,77689] 0 2023-12-12T11:51:45.111 INFO:tasks.workunit.client.1.smithi093.stdout:0/353: mknod d5/dd/d14/d26/d58/d64/c70 0 2023-12-12T11:51:45.112 INFO:tasks.workunit.client.0.smithi063.stdout:9/130: creat d7/d20/f29 x:0 0 0 2023-12-12T11:51:45.114 INFO:tasks.workunit.client.1.smithi093.stdout:3/347: mkdir df/d22/d49/d69/d6e 0 2023-12-12T11:51:45.116 INFO:tasks.workunit.client.0.smithi063.stdout:7/100: dwrite f4 [0,4194304] 0 2023-12-12T11:51:45.117 INFO:tasks.workunit.client.1.smithi093.stdout:0/354: dread d5/dd/d14/d26/d58/f63 [0,4194304] 0 2023-12-12T11:51:45.121 INFO:tasks.workunit.client.1.smithi093.stdout:5/253: dwrite d0/d7/d36/d38/f43 [0,4194304] 0 2023-12-12T11:51:45.121 INFO:tasks.workunit.client.1.smithi093.stdout:5/254: readlink d0/d7/d8/de/ld 0 2023-12-12T11:51:45.122 INFO:tasks.workunit.client.1.smithi093.stdout:8/336: mknod d3/d1a/d1f/d29/c6e 0 2023-12-12T11:51:45.122 INFO:tasks.workunit.client.1.smithi093.stdout:1/342: mknod d4/d1a/d1b/c70 0 2023-12-12T11:51:45.123 INFO:tasks.workunit.client.1.smithi093.stdout:6/462: getdents d0/da/d32/d39/d5b 0 2023-12-12T11:51:45.130 INFO:tasks.workunit.client.0.smithi063.stdout:5/123: creat d7/d10/f23 x:0 0 0 2023-12-12T11:51:45.131 INFO:tasks.workunit.client.0.smithi063.stdout:4/157: dwrite d2/d8/f32 [0,4194304] 0 2023-12-12T11:51:45.132 INFO:tasks.workunit.client.1.smithi093.stdout:7/311: unlink da/d15/d19/f2b 0 2023-12-12T11:51:45.132 INFO:tasks.workunit.client.1.smithi093.stdout:0/355: symlink d5/dd/d62/l71 0 2023-12-12T11:51:45.132 INFO:tasks.workunit.client.1.smithi093.stdout:0/356: fdatasync d5/dd/d14/d26/d58/f63 0 2023-12-12T11:51:45.132 INFO:tasks.workunit.client.1.smithi093.stdout:7/312: write da/d15/d2d/f6e [590133,89654] 0 2023-12-12T11:51:45.132 INFO:tasks.workunit.client.1.smithi093.stdout:3/348: dread df/f1a [0,4194304] 0 2023-12-12T11:51:45.133 INFO:tasks.workunit.client.1.smithi093.stdout:3/349: fsync df/d22/f23 0 2023-12-12T11:51:45.135 INFO:tasks.workunit.client.0.smithi063.stdout:1/102: truncate d3/f1a 368817 0 2023-12-12T11:51:45.138 INFO:tasks.workunit.client.0.smithi063.stdout:9/131: rename d7/d15/f26 to d7/f2a 0 2023-12-12T11:51:45.140 INFO:tasks.workunit.client.1.smithi093.stdout:8/337: write d3/d1a/d1f/f3f [232616,106154] 0 2023-12-12T11:51:45.144 INFO:tasks.workunit.client.1.smithi093.stdout:5/255: rename d0/d7/d36/d38/f34 to d0/d7/d27/d35/f58 0 2023-12-12T11:51:45.147 INFO:tasks.workunit.client.0.smithi063.stdout:7/101: symlink de/l20 0 2023-12-12T11:51:45.148 INFO:tasks.workunit.client.1.smithi093.stdout:9/296: dwrite d1/f59 [0,4194304] 0 2023-12-12T11:51:45.150 INFO:tasks.workunit.client.1.smithi093.stdout:1/343: mknod d4/d1a/c71 0 2023-12-12T11:51:45.150 INFO:tasks.workunit.client.1.smithi093.stdout:1/344: truncate d4/d1a/d1b/d26/f4d 560198 0 2023-12-12T11:51:45.150 INFO:tasks.workunit.client.0.smithi063.stdout:8/193: mkdir d4/de/d3b 0 2023-12-12T11:51:45.150 INFO:tasks.workunit.client.0.smithi063.stdout:8/194: creat d4/de/d1e/f3c x:0 0 0 2023-12-12T11:51:45.151 INFO:tasks.workunit.client.0.smithi063.stdout:8/195: dread - d4/de/d1e/f33 zero size 2023-12-12T11:51:45.152 INFO:tasks.workunit.client.1.smithi093.stdout:0/357: mkdir d5/dd/d14/d26/d58/d72 0 2023-12-12T11:51:45.152 INFO:tasks.workunit.client.1.smithi093.stdout:0/358: fdatasync d5/dd/d14/f37 0 2023-12-12T11:51:45.153 INFO:tasks.workunit.client.1.smithi093.stdout:0/359: write d5/dd/d14/d26/d58/f63 [384748,49976] 0 2023-12-12T11:51:45.153 INFO:tasks.workunit.client.1.smithi093.stdout:0/360: fdatasync d5/fa 0 2023-12-12T11:51:45.154 INFO:tasks.workunit.client.1.smithi093.stdout:7/313: truncate da/de/d46/f4e 3561314 0 2023-12-12T11:51:45.157 INFO:tasks.workunit.client.0.smithi063.stdout:4/158: read d2/d8/fe [505636,62387] 0 2023-12-12T11:51:45.159 INFO:tasks.workunit.client.0.smithi063.stdout:3/83: dwrite d4/f15 [0,4194304] 0 2023-12-12T11:51:45.159 INFO:tasks.workunit.client.0.smithi063.stdout:9/132: rename d7/f10 to d7/f2b 0 2023-12-12T11:51:45.160 INFO:tasks.workunit.client.0.smithi063.stdout:9/133: dread - d7/d11/f21 zero size 2023-12-12T11:51:45.162 INFO:tasks.workunit.client.0.smithi063.stdout:5/124: mkdir d7/d24 0 2023-12-12T11:51:45.165 INFO:tasks.workunit.client.0.smithi063.stdout:8/196: mknod d4/de/d32/c3d 0 2023-12-12T11:51:45.168 INFO:tasks.workunit.client.1.smithi093.stdout:9/297: rename d1/c22 to d1/d12/d1f/d32/c64 0 2023-12-12T11:51:45.168 INFO:tasks.workunit.client.1.smithi093.stdout:9/298: chown d1/d12/d1f/d32/d42/f5a 12 1 2023-12-12T11:51:45.168 INFO:tasks.workunit.client.1.smithi093.stdout:9/299: creat d1/f65 x:0 0 0 2023-12-12T11:51:45.175 INFO:tasks.workunit.client.1.smithi093.stdout:1/345: symlink d4/d1a/d1b/d26/d40/l72 0 2023-12-12T11:51:45.175 INFO:tasks.workunit.client.1.smithi093.stdout:1/346: write d4/d1c/d2a/f2c [929409,51542] 0 2023-12-12T11:51:45.175 INFO:tasks.workunit.client.1.smithi093.stdout:0/361: creat d5/d21/d2f/d54/f73 x:0 0 0 2023-12-12T11:51:45.181 INFO:tasks.workunit.client.0.smithi063.stdout:3/84: rename d4/df/c14 to d4/c16 0 2023-12-12T11:51:45.185 INFO:tasks.workunit.client.0.smithi063.stdout:7/102: dread fb [0,4194304] 0 2023-12-12T11:51:45.186 INFO:tasks.workunit.client.0.smithi063.stdout:0/100: dwrite d0/d7/ff [4194304,4194304] 0 2023-12-12T11:51:45.187 INFO:tasks.workunit.client.0.smithi063.stdout:3/85: mknod d4/c17 0 2023-12-12T11:51:45.188 INFO:tasks.workunit.client.0.smithi063.stdout:0/101: link d0/d1a/l1b d0/d15/l1d 0 2023-12-12T11:51:45.190 INFO:tasks.workunit.client.0.smithi063.stdout:3/86: truncate d4/f7 539282 0 2023-12-12T11:51:45.193 INFO:tasks.workunit.client.0.smithi063.stdout:0/102: rename d0/d10/l16 to d0/l1e 0 2023-12-12T11:51:45.193 INFO:tasks.workunit.client.0.smithi063.stdout:0/103: chown d0/l6 104239920 1 2023-12-12T11:51:45.193 INFO:tasks.workunit.client.0.smithi063.stdout:0/104: readlink d0/d15/l1d 0 2023-12-12T11:51:45.207 INFO:tasks.workunit.client.0.smithi063.stdout:0/105: mkdir d0/d10/d1f 0 2023-12-12T11:51:45.211 INFO:tasks.workunit.client.1.smithi093.stdout:5/256: rename d0/d7/d27 to d0/d7/d59 0 2023-12-12T11:51:45.211 INFO:tasks.workunit.client.1.smithi093.stdout:0/362: read d5/d21/f2e [242787,119178] 0 2023-12-12T11:51:45.211 INFO:tasks.workunit.client.1.smithi093.stdout:0/363: fdatasync d5/dd/f1a 0 2023-12-12T11:51:45.211 INFO:tasks.workunit.client.1.smithi093.stdout:8/338: dwrite d3/d8/f18 [0,4194304] 0 2023-12-12T11:51:45.211 INFO:tasks.workunit.client.1.smithi093.stdout:8/339: dread - d3/d1a/d1f/d29/d3a/d40/f53 zero size 2023-12-12T11:51:45.211 INFO:tasks.workunit.client.1.smithi093.stdout:8/340: write d3/d1a/d1f/f3f [505804,24336] 0 2023-12-12T11:51:45.211 INFO:tasks.workunit.client.1.smithi093.stdout:8/341: write d3/d1a/d1f/d29/d30/f4e [101843,14148] 0 2023-12-12T11:51:45.212 INFO:tasks.workunit.client.1.smithi093.stdout:5/257: write d0/d7/d59/d35/f31 [298700,86034] 0 2023-12-12T11:51:45.221 INFO:tasks.workunit.client.1.smithi093.stdout:0/364: link d5/dd/d14/d26/d58/d64/c70 d5/d21/d27/d3a/c74 0 2023-12-12T11:51:45.221 INFO:tasks.workunit.client.1.smithi093.stdout:6/463: dwrite d0/da/d14/d9c/f7d [0,4194304] 0 2023-12-12T11:51:45.231 INFO:tasks.workunit.client.0.smithi063.stdout:8/197: dread f1 [0,4194304] 0 2023-12-12T11:51:45.231 INFO:tasks.workunit.client.0.smithi063.stdout:8/198: fdatasync d4/f1d 0 2023-12-12T11:51:45.240 INFO:tasks.workunit.client.0.smithi063.stdout:4/159: dwrite d2/d17/f22 [0,4194304] 0 2023-12-12T11:51:45.241 INFO:tasks.workunit.client.0.smithi063.stdout:4/160: readlink d2/l24 0 2023-12-12T11:51:45.241 INFO:tasks.workunit.client.0.smithi063.stdout:4/161: read d2/d8/d14/f2d [428685,93300] 0 2023-12-12T11:51:45.241 INFO:tasks.workunit.client.0.smithi063.stdout:4/162: dread - d2/d8/f2a zero size 2023-12-12T11:51:45.241 INFO:tasks.workunit.client.0.smithi063.stdout:4/163: fsync d2/d17/f22 0 2023-12-12T11:51:45.241 INFO:tasks.workunit.client.0.smithi063.stdout:8/199: mkdir d4/d24/d3e 0 2023-12-12T11:51:45.245 INFO:tasks.workunit.client.0.smithi063.stdout:1/103: dwrite d3/db/d16/d17/d19/f1e [0,4194304] 0 2023-12-12T11:51:45.255 INFO:tasks.workunit.client.1.smithi093.stdout:7/314: write da/d15/f26 [3103195,71952] 0 2023-12-12T11:51:45.280 INFO:tasks.workunit.client.0.smithi063.stdout:3/87: getdents d4/df 0 2023-12-12T11:51:45.282 INFO:tasks.workunit.client.0.smithi063.stdout:9/134: dwrite d7/fa [0,4194304] 0 2023-12-12T11:51:45.282 INFO:tasks.workunit.client.0.smithi063.stdout:9/135: write d7/f14 [222831,89542] 0 2023-12-12T11:51:45.282 INFO:tasks.workunit.client.0.smithi063.stdout:8/200: chown d4/de/f19 3310 1 2023-12-12T11:51:45.282 INFO:tasks.workunit.client.0.smithi063.stdout:8/201: fdatasync d4/d24/f31 0 2023-12-12T11:51:45.282 INFO:tasks.workunit.client.0.smithi063.stdout:8/202: dread - d4/de/d1e/f26 zero size 2023-12-12T11:51:45.282 INFO:tasks.workunit.client.0.smithi063.stdout:8/203: truncate d4/de/d1e/f26 558125 0 2023-12-12T11:51:45.282 INFO:tasks.workunit.client.0.smithi063.stdout:4/164: symlink d2/d8/l36 0 2023-12-12T11:51:45.282 INFO:tasks.workunit.client.0.smithi063.stdout:0/106: dwrite d0/f12 [0,4194304] 0 2023-12-12T11:51:45.283 INFO:tasks.workunit.client.1.smithi093.stdout:6/464: rmdir d0/d52/d6b 39 2023-12-12T11:51:45.283 INFO:tasks.workunit.client.1.smithi093.stdout:6/465: stat d0/da/d32/d9e/d4d/f6f 0 2023-12-12T11:51:45.283 INFO:tasks.workunit.client.1.smithi093.stdout:6/466: creat d0/da/d32/d39/fb2 x:0 0 0 2023-12-12T11:51:45.283 INFO:tasks.workunit.client.1.smithi093.stdout:6/467: creat d0/da/d14/fb3 x:0 0 0 2023-12-12T11:51:45.283 INFO:tasks.workunit.client.1.smithi093.stdout:6/468: creat d0/da/d14/d3a/d95/fb4 x:0 0 0 2023-12-12T11:51:45.283 INFO:tasks.workunit.client.1.smithi093.stdout:3/350: dwrite df/d22/f23 [0,4194304] 0 2023-12-12T11:51:45.283 INFO:tasks.workunit.client.1.smithi093.stdout:3/351: write df/d22/d49/d69/f6a [843105,43841] 0 2023-12-12T11:51:45.283 INFO:tasks.workunit.client.1.smithi093.stdout:3/352: chown df/f10 668212173 1 2023-12-12T11:51:45.283 INFO:tasks.workunit.client.1.smithi093.stdout:9/300: dwrite d1/d23/d24/d29/d43/f48 [0,4194304] 0 2023-12-12T11:51:45.283 INFO:tasks.workunit.client.1.smithi093.stdout:9/301: creat d1/d12/d1f/d3d/d57/f66 x:0 0 0 2023-12-12T11:51:45.283 INFO:tasks.workunit.client.1.smithi093.stdout:5/258: read d0/d7/d36/d38/f43 [357788,89595] 0 2023-12-12T11:51:45.283 INFO:tasks.workunit.client.1.smithi093.stdout:5/259: fdatasync d0/d7/d8/de/f28 0 2023-12-12T11:51:45.283 INFO:tasks.workunit.client.1.smithi093.stdout:1/347: dwrite d4/d1a/d1b/d26/d31/f38 [4194304,4194304] 0 2023-12-12T11:51:45.283 INFO:tasks.workunit.client.1.smithi093.stdout:2/384: sync 2023-12-12T11:51:45.284 INFO:tasks.workunit.client.1.smithi093.stdout:4/530: sync 2023-12-12T11:51:45.284 INFO:tasks.workunit.client.1.smithi093.stdout:3/353: rename df/d25/d3e to df/d36/d3d/d6f 0 2023-12-12T11:51:45.284 INFO:tasks.workunit.client.1.smithi093.stdout:3/354: chown df/f21 183401 1 2023-12-12T11:51:45.284 INFO:tasks.workunit.client.1.smithi093.stdout:6/469: dread d0/d52/d7e/d42/f8e [0,4194304] 0 2023-12-12T11:51:45.284 INFO:tasks.workunit.client.0.smithi063.stdout:7/103: dwrite de/f19 [0,4194304] 0 2023-12-12T11:51:45.285 INFO:tasks.workunit.client.0.smithi063.stdout:3/88: rmdir d4/df 39 2023-12-12T11:51:45.289 INFO:tasks.workunit.client.0.smithi063.stdout:9/136: mknod d7/d11/d12/c2c 0 2023-12-12T11:51:45.292 INFO:tasks.workunit.client.1.smithi093.stdout:6/470: write d0/d52/d7e/d42/f8e [3512380,110312] 0 2023-12-12T11:51:45.292 INFO:tasks.workunit.client.1.smithi093.stdout:6/471: chown d0/d7b/cae 0 1 2023-12-12T11:51:45.293 INFO:tasks.workunit.client.1.smithi093.stdout:6/472: chown d0/da/d14/l1e 7333 1 2023-12-12T11:51:45.299 INFO:tasks.workunit.client.1.smithi093.stdout:0/365: dwrite d5/d21/d2f/d54/f73 [0,4194304] 0 2023-12-12T11:51:45.300 INFO:tasks.workunit.client.1.smithi093.stdout:0/366: fsync d5/d4d/f6c 0 2023-12-12T11:51:45.300 INFO:tasks.workunit.client.1.smithi093.stdout:0/367: dread - d5/d21/d27/f5a zero size 2023-12-12T11:51:45.300 INFO:tasks.workunit.client.1.smithi093.stdout:0/368: creat d5/dd/f75 x:0 0 0 2023-12-12T11:51:45.304 INFO:tasks.workunit.client.1.smithi093.stdout:9/302: link d1/fe d1/d12/d1f/d3d/d57/f67 0 2023-12-12T11:51:45.307 INFO:tasks.workunit.client.1.smithi093.stdout:3/355: dread df/d30/d33/f45 [0,4194304] 0 2023-12-12T11:51:45.311 INFO:tasks.workunit.client.1.smithi093.stdout:5/260: mknod d0/d7/d8/c5a 0 2023-12-12T11:51:45.311 INFO:tasks.workunit.client.1.smithi093.stdout:8/342: dwrite f0 [0,4194304] 0 2023-12-12T11:51:45.311 INFO:tasks.workunit.client.1.smithi093.stdout:8/343: readlink d3/d1a/d1f/l4b 0 2023-12-12T11:51:45.311 INFO:tasks.workunit.client.1.smithi093.stdout:8/344: read - d3/d1a/d1f/d29/d3a/d40/f61 zero size 2023-12-12T11:51:45.315 INFO:tasks.workunit.client.1.smithi093.stdout:1/348: rename d4/d1c/d2a/d2d to d4/d1a/d73 0 2023-12-12T11:51:45.315 INFO:tasks.workunit.client.1.smithi093.stdout:1/349: dread - d4/d1c/d2a/f4b zero size 2023-12-12T11:51:45.318 INFO:tasks.workunit.client.0.smithi063.stdout:7/104: creat de/f21 x:0 0 0 2023-12-12T11:51:45.318 INFO:tasks.workunit.client.0.smithi063.stdout:7/105: chown de/l1f 335 1 2023-12-12T11:51:45.327 INFO:tasks.workunit.client.1.smithi093.stdout:0/369: write d5/d21/d2f/d54/f5c [3873783,23120] 0 2023-12-12T11:51:45.327 INFO:tasks.workunit.client.1.smithi093.stdout:9/303: mkdir d1/d23/d24/d29/d43/d56/d68 0 2023-12-12T11:51:45.329 INFO:tasks.workunit.client.1.smithi093.stdout:2/385: dwrite d5/d14/d2d/f1f [0,4194304] 0 2023-12-12T11:51:45.330 INFO:tasks.workunit.client.0.smithi063.stdout:9/137: unlink d7/fe 0 2023-12-12T11:51:45.330 INFO:tasks.workunit.client.0.smithi063.stdout:9/138: stat d7/d11/d12/c2c 0 2023-12-12T11:51:45.330 INFO:tasks.workunit.client.0.smithi063.stdout:9/139: chown c4 1 1 2023-12-12T11:51:45.330 INFO:tasks.workunit.client.1.smithi093.stdout:8/345: symlink d3/d1a/d1f/d59/d69/l6f 0 2023-12-12T11:51:45.331 INFO:tasks.workunit.client.0.smithi063.stdout:8/204: rmdir d4/d29 39 2023-12-12T11:51:45.333 INFO:tasks.workunit.client.0.smithi063.stdout:0/107: symlink d0/d10/l20 0 2023-12-12T11:51:45.333 INFO:tasks.workunit.client.0.smithi063.stdout:0/108: creat d0/f21 x:0 0 0 2023-12-12T11:51:45.337 INFO:tasks.workunit.client.1.smithi093.stdout:7/315: dwrite f0 [0,4194304] 0 2023-12-12T11:51:45.337 INFO:tasks.workunit.client.1.smithi093.stdout:5/261: dread d0/d7/d59/f2d [0,4194304] 0 2023-12-12T11:51:45.337 INFO:tasks.workunit.client.1.smithi093.stdout:5/262: chown d0/d7/f1a 32671231 1 2023-12-12T11:51:45.337 INFO:tasks.workunit.client.1.smithi093.stdout:5/263: fdatasync d0/d7/d59/d35/f1f 0 2023-12-12T11:51:45.337 INFO:tasks.workunit.client.1.smithi093.stdout:6/473: rename d0/da/d14/f18 to d0/d7b/fb5 0 2023-12-12T11:51:45.337 INFO:tasks.workunit.client.1.smithi093.stdout:6/474: chown d0/da/l27 1 1 2023-12-12T11:51:45.337 INFO:tasks.workunit.client.0.smithi063.stdout:4/165: dwrite d2/d8/d14/f2d [0,4194304] 0 2023-12-12T11:51:45.342 INFO:tasks.workunit.client.0.smithi063.stdout:7/106: mkdir de/d22 0 2023-12-12T11:51:45.343 INFO:tasks.workunit.client.0.smithi063.stdout:8/205: dread d4/f23 [0,4194304] 0 2023-12-12T11:51:45.344 INFO:tasks.workunit.client.1.smithi093.stdout:1/350: symlink d4/d1a/d1b/d26/d65/l74 0 2023-12-12T11:51:45.344 INFO:tasks.workunit.client.1.smithi093.stdout:1/351: write d4/d1c/f66 [115342,70330] 0 2023-12-12T11:51:45.344 INFO:tasks.workunit.client.1.smithi093.stdout:1/352: write d4/fa [4410024,110139] 0 2023-12-12T11:51:45.344 INFO:tasks.workunit.client.1.smithi093.stdout:9/304: dread d1/d12/d1f/d3d/d57/f67 [0,4194304] 0 2023-12-12T11:51:45.345 INFO:tasks.workunit.client.1.smithi093.stdout:1/353: readlink d4/d1a/d1b/d26/d31/l4e 0 2023-12-12T11:51:45.346 INFO:tasks.workunit.client.0.smithi063.stdout:3/89: rename c3 to d4/c18 0 2023-12-12T11:51:45.351 INFO:tasks.workunit.client.1.smithi093.stdout:6/475: write d0/da/d14/d21/fa5 [1834925,17736] 0 2023-12-12T11:51:45.357 INFO:tasks.workunit.client.0.smithi063.stdout:0/109: mknod d0/d7/c22 0 2023-12-12T11:51:45.364 INFO:tasks.workunit.client.0.smithi063.stdout:6/145: sync 2023-12-12T11:51:45.367 INFO:tasks.workunit.client.1.smithi093.stdout:9/305: dread d1/d12/d1f/f20 [0,4194304] 0 2023-12-12T11:51:45.367 INFO:tasks.workunit.client.1.smithi093.stdout:8/346: mknod d3/d1a/d1f/d29/d3a/c70 0 2023-12-12T11:51:45.367 INFO:tasks.workunit.client.1.smithi093.stdout:8/347: chown d3/d1a/d1f/f27 4 1 2023-12-12T11:51:45.367 INFO:tasks.workunit.client.1.smithi093.stdout:2/386: truncate d5/f8 3293007 0 2023-12-12T11:51:45.367 INFO:tasks.workunit.client.1.smithi093.stdout:2/387: write d5/f6e [802987,81470] 0 2023-12-12T11:51:45.369 INFO:tasks.workunit.client.0.smithi063.stdout:7/107: creat de/d22/f23 x:0 0 0 2023-12-12T11:51:45.383 INFO:tasks.workunit.client.1.smithi093.stdout:7/316: creat da/f70 x:0 0 0 2023-12-12T11:51:45.385 INFO:tasks.workunit.client.0.smithi063.stdout:8/206: dread f3 [0,4194304] 0 2023-12-12T11:51:45.387 INFO:tasks.workunit.client.0.smithi063.stdout:4/166: rename d2/d8/f2a to d2/d8/f37 0 2023-12-12T11:51:45.387 INFO:tasks.workunit.client.0.smithi063.stdout:4/167: readlink d2/d8/d14/l27 0 2023-12-12T11:51:45.387 INFO:tasks.workunit.client.1.smithi093.stdout:5/264: getdents d0/d7/d8 0 2023-12-12T11:51:45.387 INFO:tasks.workunit.client.1.smithi093.stdout:3/356: dwrite df/f10 [0,4194304] 0 2023-12-12T11:51:45.388 INFO:tasks.workunit.client.1.smithi093.stdout:3/357: fsync df/f1c 0 2023-12-12T11:51:45.388 INFO:tasks.workunit.client.1.smithi093.stdout:3/358: chown df/d36/d3d/d42/f57 1594351 1 2023-12-12T11:51:45.388 INFO:tasks.workunit.client.1.smithi093.stdout:3/359: write df/d36/f63 [91816,94145] 0 2023-12-12T11:51:45.389 INFO:tasks.workunit.client.1.smithi093.stdout:9/306: dread d1/f59 [0,4194304] 0 2023-12-12T11:51:45.389 INFO:tasks.workunit.client.1.smithi093.stdout:9/307: chown d1/d12/d1f/f25 1871428 1 2023-12-12T11:51:45.395 INFO:tasks.workunit.client.0.smithi063.stdout:4/168: symlink d2/d8/d14/l38 0 2023-12-12T11:51:45.396 INFO:tasks.workunit.client.1.smithi093.stdout:6/476: symlink d0/d52/d6b/lb6 0 2023-12-12T11:51:45.402 INFO:tasks.workunit.client.1.smithi093.stdout:2/388: rmdir d5/d31 39 2023-12-12T11:51:45.407 INFO:tasks.workunit.client.0.smithi063.stdout:8/207: write d4/de/d11/f14 [1142299,87249] 0 2023-12-12T11:51:45.409 INFO:tasks.workunit.client.1.smithi093.stdout:7/317: rename da/de/d46/f65 to da/d15/d2d/f71 0 2023-12-12T11:51:45.413 INFO:tasks.workunit.client.1.smithi093.stdout:7/318: write da/d2e/f42 [667014,109561] 0 2023-12-12T11:51:45.413 INFO:tasks.workunit.client.1.smithi093.stdout:7/319: chown da/d15/c39 7 1 2023-12-12T11:51:45.413 INFO:tasks.workunit.client.0.smithi063.stdout:4/169: truncate d2/d8/f26 1257083 0 2023-12-12T11:51:45.414 INFO:tasks.workunit.client.0.smithi063.stdout:4/170: creat d2/d8/d14/f39 x:0 0 0 2023-12-12T11:51:45.414 INFO:tasks.workunit.client.0.smithi063.stdout:4/171: readlink d2/d8/d14/l38 0 2023-12-12T11:51:45.418 INFO:tasks.workunit.client.1.smithi093.stdout:5/265: symlink d0/d7/d36/l5b 0 2023-12-12T11:51:45.421 INFO:tasks.workunit.client.0.smithi063.stdout:8/208: rename d4/de/d11/c1c to d4/de/d32/c3f 0 2023-12-12T11:51:45.425 INFO:tasks.workunit.client.1.smithi093.stdout:3/360: dread df/f28 [4194304,4194304] 0 2023-12-12T11:51:45.425 INFO:tasks.workunit.client.1.smithi093.stdout:3/361: creat df/d36/f70 x:0 0 0 2023-12-12T11:51:45.428 INFO:tasks.workunit.client.1.smithi093.stdout:0/370: dwrite d5/fa [0,4194304] 0 2023-12-12T11:51:45.430 INFO:tasks.workunit.client.0.smithi063.stdout:4/172: rename d2/d8/d14/l27 to d2/d8/d14/l3a 0 2023-12-12T11:51:45.431 INFO:tasks.workunit.client.1.smithi093.stdout:6/477: write d0/f96 [607434,54574] 0 2023-12-12T11:51:45.433 INFO:tasks.workunit.client.0.smithi063.stdout:8/209: unlink d4/d24/f27 0 2023-12-12T11:51:45.433 INFO:tasks.workunit.client.0.smithi063.stdout:8/210: write d4/f17 [2037179,15280] 0 2023-12-12T11:51:45.433 INFO:tasks.workunit.client.0.smithi063.stdout:8/211: write d4/f7 [4505178,76405] 0 2023-12-12T11:51:45.433 INFO:tasks.workunit.client.0.smithi063.stdout:8/212: truncate d4/de/f30 4397005 0 2023-12-12T11:51:45.434 INFO:tasks.workunit.client.0.smithi063.stdout:8/213: write d4/de/d32/d36/f3a [544242,116009] 0 2023-12-12T11:51:45.434 INFO:tasks.workunit.client.1.smithi093.stdout:8/348: truncate d3/d8/fc 5663494 0 2023-12-12T11:51:45.434 INFO:tasks.workunit.client.1.smithi093.stdout:8/349: fsync d3/d1a/d1f/d29/d3a/d40/f53 0 2023-12-12T11:51:45.434 INFO:tasks.workunit.client.1.smithi093.stdout:8/350: chown d3/d1a/f66 490 1 2023-12-12T11:51:45.436 INFO:tasks.workunit.client.0.smithi063.stdout:4/173: unlink d2/d17/f1f 0 2023-12-12T11:51:45.437 INFO:tasks.workunit.client.1.smithi093.stdout:2/389: mknod d5/d14/d2d/d12/d44/c80 0 2023-12-12T11:51:45.440 INFO:tasks.workunit.client.1.smithi093.stdout:7/320: creat da/de/f72 x:0 0 0 2023-12-12T11:51:45.445 INFO:tasks.workunit.client.1.smithi093.stdout:3/362: symlink df/d36/d3d/d6f/l71 0 2023-12-12T11:51:45.445 INFO:tasks.workunit.client.1.smithi093.stdout:3/363: stat df/c52 0 2023-12-12T11:51:45.446 INFO:tasks.workunit.client.0.smithi063.stdout:5/125: sync 2023-12-12T11:51:45.447 INFO:tasks.workunit.client.0.smithi063.stdout:2/91: sync 2023-12-12T11:51:45.451 INFO:tasks.workunit.client.1.smithi093.stdout:6/478: stat d0/d52/c6d 0 2023-12-12T11:51:45.451 INFO:tasks.workunit.client.1.smithi093.stdout:5/266: getdents d0/d7/d36/d29 0 2023-12-12T11:51:45.451 INFO:tasks.workunit.client.1.smithi093.stdout:2/390: creat d5/d14/d2d/d12/d25/d7a/f81 x:0 0 0 2023-12-12T11:51:45.452 INFO:tasks.workunit.client.0.smithi063.stdout:3/90: dwrite d4/f7 [0,4194304] 0 2023-12-12T11:51:45.453 INFO:tasks.workunit.client.0.smithi063.stdout:9/140: dwrite d7/d15/f1d [0,4194304] 0 2023-12-12T11:51:45.454 INFO:tasks.workunit.client.1.smithi093.stdout:3/364: mkdir df/d36/d3d/d59/d72 0 2023-12-12T11:51:45.456 INFO:tasks.workunit.client.1.smithi093.stdout:8/351: getdents d3/d1a/d1f/d29 0 2023-12-12T11:51:45.458 INFO:tasks.workunit.client.1.smithi093.stdout:5/267: rename d0/d7/d8/de/l18 to d0/d7/d8/de/l5c 0 2023-12-12T11:51:45.458 INFO:tasks.workunit.client.1.smithi093.stdout:5/268: chown d0/d7/d36/d29/c41 880593 1 2023-12-12T11:51:45.459 INFO:tasks.workunit.client.0.smithi063.stdout:4/174: write d2/d8/d14/f2d [3426119,74037] 0 2023-12-12T11:51:45.460 INFO:tasks.workunit.client.0.smithi063.stdout:7/108: dwrite de/f1a [0,4194304] 0 2023-12-12T11:51:45.460 INFO:tasks.workunit.client.0.smithi063.stdout:7/109: write de/f1a [5138837,94040] 0 2023-12-12T11:51:45.462 INFO:tasks.workunit.client.1.smithi093.stdout:9/308: dwrite d1/d12/d1f/d32/f3f [0,4194304] 0 2023-12-12T11:51:45.462 INFO:tasks.workunit.client.1.smithi093.stdout:5/269: creat d0/d7/d8/f5d x:0 0 0 2023-12-12T11:51:45.464 INFO:tasks.workunit.client.0.smithi063.stdout:0/110: dwrite d0/d10/fb [0,4194304] 0 2023-12-12T11:51:45.480 INFO:tasks.workunit.client.1.smithi093.stdout:2/391: dread d5/d14/d2d/d12/f22 [0,4194304] 0 2023-12-12T11:51:45.481 INFO:tasks.workunit.client.1.smithi093.stdout:5/270: rename d0/d7/d36/d38/c1d to d0/d7/d36/d29/d44/c5e 0 2023-12-12T11:51:45.482 INFO:tasks.workunit.client.0.smithi063.stdout:4/175: symlink d2/d8/d14/l3b 0 2023-12-12T11:51:45.482 INFO:tasks.workunit.client.0.smithi063.stdout:4/176: chown d2/d17/c2e 24773 1 2023-12-12T11:51:45.482 INFO:tasks.workunit.client.0.smithi063.stdout:4/177: readlink d2/d8/d14/l38 0 2023-12-12T11:51:45.482 INFO:tasks.workunit.client.0.smithi063.stdout:4/178: fsync d2/d8/fe 0 2023-12-12T11:51:45.484 INFO:tasks.workunit.client.1.smithi093.stdout:2/392: link d5/d14/d2d/d12/d44/c80 d5/d14/d2d/d12/d25/d7a/c82 0 2023-12-12T11:51:45.486 INFO:tasks.workunit.client.0.smithi063.stdout:7/110: rename de/d22/f23 to de/d22/f24 0 2023-12-12T11:51:45.488 INFO:tasks.workunit.client.1.smithi093.stdout:5/271: creat d0/d7/d59/d48/f5f x:0 0 0 2023-12-12T11:51:45.489 INFO:tasks.workunit.client.0.smithi063.stdout:0/111: mkdir d0/d1a/d23 0 2023-12-12T11:51:45.491 INFO:tasks.workunit.client.0.smithi063.stdout:4/179: rename d2/d8/d14/f39 to d2/d17/f3c 0 2023-12-12T11:51:45.495 INFO:tasks.workunit.client.1.smithi093.stdout:5/272: rename d0/d7/f1a to d0/d7/d59/f60 0 2023-12-12T11:51:45.495 INFO:tasks.workunit.client.1.smithi093.stdout:5/273: chown d0/d7/d36/d38 95496 1 2023-12-12T11:51:45.496 INFO:tasks.workunit.client.0.smithi063.stdout:0/112: truncate d0/d7/ff 1854317 0 2023-12-12T11:51:45.497 INFO:tasks.workunit.client.0.smithi063.stdout:4/180: creat d2/f3d x:0 0 0 2023-12-12T11:51:45.497 INFO:tasks.workunit.client.0.smithi063.stdout:4/181: write d2/f3d [64461,105136] 0 2023-12-12T11:51:45.501 INFO:tasks.workunit.client.0.smithi063.stdout:0/113: unlink d0/d10/f13 0 2023-12-12T11:51:45.501 INFO:tasks.workunit.client.0.smithi063.stdout:0/114: write d0/f12 [4195082,123653] 0 2023-12-12T11:51:45.504 INFO:tasks.workunit.client.0.smithi063.stdout:7/111: dread fb [0,4194304] 0 2023-12-12T11:51:45.508 INFO:tasks.workunit.client.0.smithi063.stdout:7/112: symlink de/l25 0 2023-12-12T11:51:45.513 INFO:tasks.workunit.client.0.smithi063.stdout:7/113: mknod de/c26 0 2023-12-12T11:51:45.514 INFO:tasks.workunit.client.1.smithi093.stdout:6/479: dwrite d0/d52/d7e/faf [0,4194304] 0 2023-12-12T11:51:45.514 INFO:tasks.workunit.client.1.smithi093.stdout:6/480: chown d0/da/d14/d38/d43/l8c 4228 1 2023-12-12T11:51:45.514 INFO:tasks.workunit.client.1.smithi093.stdout:6/481: write d0/da/d14/d3a/f6a [162400,3777] 0 2023-12-12T11:51:45.514 INFO:tasks.workunit.client.1.smithi093.stdout:6/482: creat d0/da/d14/d21/fb7 x:0 0 0 2023-12-12T11:51:45.514 INFO:tasks.workunit.client.1.smithi093.stdout:0/371: dwrite d5/dd/f75 [0,4194304] 0 2023-12-12T11:51:45.514 INFO:tasks.workunit.client.1.smithi093.stdout:0/372: dread - d5/d41/f61 zero size 2023-12-12T11:51:45.518 INFO:tasks.workunit.client.1.smithi093.stdout:5/274: write d0/d7/d59/d35/f1f [3673072,42083] 0 2023-12-12T11:51:45.518 INFO:tasks.workunit.client.1.smithi093.stdout:6/483: getdents d0/da/d14/d38/d69 0 2023-12-12T11:51:45.519 INFO:tasks.workunit.client.1.smithi093.stdout:5/275: truncate d0/f5 3524311 0 2023-12-12T11:51:45.519 INFO:tasks.workunit.client.1.smithi093.stdout:5/276: chown d0/d7/d36/d29/d44/c5e 648 1 2023-12-12T11:51:45.519 INFO:tasks.workunit.client.1.smithi093.stdout:5/277: stat d0/d7/d36/d38/f40 0 2023-12-12T11:51:45.520 INFO:tasks.workunit.client.1.smithi093.stdout:5/278: symlink d0/d7/d36/d29/d44/l61 0 2023-12-12T11:51:45.521 INFO:tasks.workunit.client.1.smithi093.stdout:5/279: mkdir d0/d7/d59/d62 0 2023-12-12T11:51:45.525 INFO:tasks.workunit.client.0.smithi063.stdout:5/126: dwrite d7/f13 [0,4194304] 0 2023-12-12T11:51:45.525 INFO:tasks.workunit.client.0.smithi063.stdout:5/127: write d7/f1a [5003831,115324] 0 2023-12-12T11:51:45.528 INFO:tasks.workunit.client.1.smithi093.stdout:6/484: dread d0/da/d14/d21/f5f [0,4194304] 0 2023-12-12T11:51:45.528 INFO:tasks.workunit.client.1.smithi093.stdout:6/485: write d0/da/d14/d3a/f47 [718777,44150] 0 2023-12-12T11:51:45.531 INFO:tasks.workunit.client.1.smithi093.stdout:6/486: rename d0/da/d32/ca0 to d0/da/d32/d39/d5b/cb8 0 2023-12-12T11:51:45.531 INFO:tasks.workunit.client.1.smithi093.stdout:0/373: write d5/d21/d27/d3a/f56 [1672960,94380] 0 2023-12-12T11:51:45.531 INFO:tasks.workunit.client.1.smithi093.stdout:6/487: write d0/f29 [757783,113528] 0 2023-12-12T11:51:45.533 INFO:tasks.workunit.client.1.smithi093.stdout:0/374: symlink d5/d41/l76 0 2023-12-12T11:51:45.533 INFO:tasks.workunit.client.1.smithi093.stdout:0/375: write d5/f66 [33157,78653] 0 2023-12-12T11:51:45.533 INFO:tasks.workunit.client.1.smithi093.stdout:0/376: truncate d5/d21/d27/f5f 637147 0 2023-12-12T11:51:45.537 INFO:tasks.workunit.client.0.smithi063.stdout:0/115: write d0/f12 [3308634,41561] 0 2023-12-12T11:51:45.538 INFO:tasks.workunit.client.0.smithi063.stdout:0/116: chown d0/d10/d1f 0 1 2023-12-12T11:51:45.567 INFO:tasks.workunit.client.1.smithi093.stdout:5/280: dwrite d0/d7/d36/f4a [0,4194304] 0 2023-12-12T11:51:45.567 INFO:tasks.workunit.client.1.smithi093.stdout:5/281: write d0/d7/d36/d29/f4e [1013677,110792] 0 2023-12-12T11:51:45.578 INFO:tasks.workunit.client.0.smithi063.stdout:9/141: write d7/d15/f17 [232469,18535] 0 2023-12-12T11:51:45.579 INFO:tasks.workunit.client.1.smithi093.stdout:5/282: dread d0/d7/d59/d35/f1f [0,4194304] 0 2023-12-12T11:51:45.580 INFO:tasks.workunit.client.1.smithi093.stdout:5/283: fdatasync d0/d7/d8/f13 0 2023-12-12T11:51:45.580 INFO:tasks.workunit.client.1.smithi093.stdout:5/284: truncate d0/f15 7582617 0 2023-12-12T11:51:45.590 INFO:tasks.workunit.client.1.smithi093.stdout:4/531: sync 2023-12-12T11:51:45.592 INFO:tasks.workunit.client.1.smithi093.stdout:1/354: sync 2023-12-12T11:51:45.594 INFO:tasks.workunit.client.0.smithi063.stdout:1/104: sync 2023-12-12T11:51:45.595 INFO:tasks.workunit.client.1.smithi093.stdout:1/355: symlink d4/d1a/d1b/l75 0 2023-12-12T11:51:45.600 INFO:tasks.workunit.client.1.smithi093.stdout:1/356: link d4/d1c/d2a/l35 d4/d1a/d1b/d26/d31/l76 0 2023-12-12T11:51:45.606 INFO:tasks.workunit.client.0.smithi063.stdout:1/105: mkdir d3/db/d16/d24 0 2023-12-12T11:51:45.608 INFO:tasks.workunit.client.0.smithi063.stdout:5/128: write d7/d10/f14 [1557028,52544] 0 2023-12-12T11:51:45.608 INFO:tasks.workunit.client.0.smithi063.stdout:5/129: chown d7/lc 106417526 1 2023-12-12T11:51:45.609 INFO:tasks.workunit.client.0.smithi063.stdout:1/106: write d3/f1a [160238,33161] 0 2023-12-12T11:51:45.609 INFO:tasks.workunit.client.0.smithi063.stdout:1/107: rename d3/db/d16 to d3/db/d16/d25 22 2023-12-12T11:51:45.609 INFO:tasks.workunit.client.0.smithi063.stdout:5/130: creat d7/de/f25 x:0 0 0 2023-12-12T11:51:45.615 INFO:tasks.workunit.client.0.smithi063.stdout:3/91: dwrite f0 [0,4194304] 0 2023-12-12T11:51:45.616 INFO:tasks.workunit.client.0.smithi063.stdout:7/114: dwrite f8 [4194304,4194304] 0 2023-12-12T11:51:45.617 INFO:tasks.workunit.client.0.smithi063.stdout:1/108: rename d3/db/lf to d3/db/l26 0 2023-12-12T11:51:45.620 INFO:tasks.workunit.client.0.smithi063.stdout:5/131: creat d7/f26 x:0 0 0 2023-12-12T11:51:45.620 INFO:tasks.workunit.client.0.smithi063.stdout:5/132: chown d7/c18 245002 1 2023-12-12T11:51:45.623 INFO:tasks.workunit.client.1.smithi093.stdout:8/352: dwrite d3/d1a/d1f/f2f [0,4194304] 0 2023-12-12T11:51:45.630 INFO:tasks.workunit.client.1.smithi093.stdout:6/488: dread d0/da/d14/f80 [0,4194304] 0 2023-12-12T11:51:45.631 INFO:tasks.workunit.client.0.smithi063.stdout:3/92: creat d4/df/f19 x:0 0 0 2023-12-12T11:51:45.635 INFO:tasks.workunit.client.1.smithi093.stdout:8/353: mknod d3/d1a/d1f/d29/d3a/d68/c71 0 2023-12-12T11:51:45.635 INFO:tasks.workunit.client.1.smithi093.stdout:8/354: write d3/d1a/d1f/d29/d30/d58/f67 [827926,92644] 0 2023-12-12T11:51:45.638 INFO:tasks.workunit.client.0.smithi063.stdout:0/117: dread d0/f12 [0,4194304] 0 2023-12-12T11:51:45.640 INFO:tasks.workunit.client.0.smithi063.stdout:2/92: dwrite d0/f14 [0,4194304] 0 2023-12-12T11:51:45.640 INFO:tasks.workunit.client.0.smithi063.stdout:2/93: creat d0/f20 x:0 0 0 2023-12-12T11:51:45.644 INFO:tasks.workunit.client.0.smithi063.stdout:2/94: write d0/f5 [1349674,92072] 0 2023-12-12T11:51:45.644 INFO:tasks.workunit.client.0.smithi063.stdout:2/95: write d0/ff [122683,69671] 0 2023-12-12T11:51:45.644 INFO:tasks.workunit.client.0.smithi063.stdout:2/96: write d0/f20 [474544,97547] 0 2023-12-12T11:51:45.644 INFO:tasks.workunit.client.0.smithi063.stdout:2/97: fdatasync d0/f15 0 2023-12-12T11:51:45.644 INFO:tasks.workunit.client.0.smithi063.stdout:2/98: fsync d0/d1a/f1c 0 2023-12-12T11:51:45.647 INFO:tasks.workunit.client.1.smithi093.stdout:5/285: fsync d0/d7/d36/d29/f4e 0 2023-12-12T11:51:45.647 INFO:tasks.workunit.client.1.smithi093.stdout:5/286: fsync d0/d7/d59/d35/f1f 0 2023-12-12T11:51:45.647 INFO:tasks.workunit.client.1.smithi093.stdout:9/309: dwrite d1/d12/d1f/d3d/d57/f5b [0,4194304] 0 2023-12-12T11:51:45.649 INFO:tasks.workunit.client.0.smithi063.stdout:7/115: rename l9 to de/d22/l27 0 2023-12-12T11:51:45.651 INFO:tasks.workunit.client.1.smithi093.stdout:0/377: dwrite d5/dd/f53 [0,4194304] 0 2023-12-12T11:51:45.651 INFO:tasks.workunit.client.1.smithi093.stdout:0/378: chown d5/dd/d14/d26/f59 103125 1 2023-12-12T11:51:45.652 INFO:tasks.workunit.client.1.smithi093.stdout:8/355: symlink d3/d1a/d1f/d59/d69/l72 0 2023-12-12T11:51:45.652 INFO:tasks.workunit.client.1.smithi093.stdout:1/357: dwrite d4/d1a/d1b/d26/d40/f6a [0,4194304] 0 2023-12-12T11:51:45.659 INFO:tasks.workunit.client.0.smithi063.stdout:1/109: creat d3/db/d12/f27 x:0 0 0 2023-12-12T11:51:45.659 INFO:tasks.workunit.client.0.smithi063.stdout:1/110: chown d3/c8 1695 1 2023-12-12T11:51:45.660 INFO:tasks.workunit.client.0.smithi063.stdout:1/111: stat d3/db/d16/c18 0 2023-12-12T11:51:45.660 INFO:tasks.workunit.client.0.smithi063.stdout:3/93: mkdir d4/df/d1a 0 2023-12-12T11:51:45.663 INFO:tasks.workunit.client.0.smithi063.stdout:4/182: dwrite d2/f3d [0,4194304] 0 2023-12-12T11:51:45.674 INFO:tasks.workunit.client.0.smithi063.stdout:0/118: mknod d0/d1a/d23/c24 0 2023-12-12T11:51:45.674 INFO:tasks.workunit.client.0.smithi063.stdout:0/119: stat d0/l6 0 2023-12-12T11:51:45.677 INFO:tasks.workunit.client.0.smithi063.stdout:5/133: dwrite d7/de/f25 [0,4194304] 0 2023-12-12T11:51:45.687 INFO:tasks.workunit.client.1.smithi093.stdout:6/489: dwrite d0/d52/d7e/d42/f8b [0,4194304] 0 2023-12-12T11:51:45.694 INFO:tasks.workunit.client.1.smithi093.stdout:6/490: fsync d0/f29 0 2023-12-12T11:51:45.699 INFO:tasks.workunit.client.1.smithi093.stdout:4/532: dwrite d0/d36/d49/f78 [0,4194304] 0 2023-12-12T11:51:45.700 INFO:tasks.workunit.client.0.smithi063.stdout:0/120: rename d0/d7/c22 to d0/d1a/d23/c25 0 2023-12-12T11:51:45.711 INFO:tasks.workunit.client.0.smithi063.stdout:0/121: symlink d0/d15/l26 0 2023-12-12T11:51:45.712 INFO:tasks.workunit.client.1.smithi093.stdout:4/533: write d0/fe [2054022,114012] 0 2023-12-12T11:51:45.713 INFO:tasks.workunit.client.1.smithi093.stdout:5/287: rename d0/d7/d8/de/f3a to d0/d3b/f63 0 2023-12-12T11:51:45.714 INFO:tasks.workunit.client.1.smithi093.stdout:9/310: symlink d1/d12/d1f/d32/d42/l69 0 2023-12-12T11:51:45.716 INFO:tasks.workunit.client.0.smithi063.stdout:7/116: rmdir de 39 2023-12-12T11:51:45.717 INFO:tasks.workunit.client.0.smithi063.stdout:7/117: stat de/l25 0 2023-12-12T11:51:45.718 INFO:tasks.workunit.client.1.smithi093.stdout:4/534: dread d0/d31/f30 [0,4194304] 0 2023-12-12T11:51:45.718 INFO:tasks.workunit.client.1.smithi093.stdout:4/535: read - d0/d31/d89/f9c zero size 2023-12-12T11:51:45.718 INFO:tasks.workunit.client.1.smithi093.stdout:4/536: fsync d0/d36/d61/f62 0 2023-12-12T11:51:45.723 INFO:tasks.workunit.client.0.smithi063.stdout:7/118: creat de/f28 x:0 0 0 2023-12-12T11:51:45.725 INFO:tasks.workunit.client.1.smithi093.stdout:0/379: mkdir d5/d41/d77 0 2023-12-12T11:51:45.725 INFO:tasks.workunit.client.1.smithi093.stdout:0/380: fdatasync d5/d21/f4c 0 2023-12-12T11:51:45.727 INFO:tasks.workunit.client.0.smithi063.stdout:0/122: rename d0/d10 to d0/d7/d27 0 2023-12-12T11:51:45.727 INFO:tasks.workunit.client.0.smithi063.stdout:0/123: readlink d0/d15/l26 0 2023-12-12T11:51:45.733 INFO:tasks.workunit.client.0.smithi063.stdout:7/119: getdents de/d22 0 2023-12-12T11:51:45.734 INFO:tasks.workunit.client.0.smithi063.stdout:2/99: dread d0/f14 [0,4194304] 0 2023-12-12T11:51:45.734 INFO:tasks.workunit.client.0.smithi063.stdout:2/100: dread - d0/d1a/f1c zero size 2023-12-12T11:51:45.734 INFO:tasks.workunit.client.0.smithi063.stdout:4/183: dread d2/f3d [0,4194304] 0 2023-12-12T11:51:45.735 INFO:tasks.workunit.client.1.smithi093.stdout:4/537: write d0/f44 [821797,58036] 0 2023-12-12T11:51:45.735 INFO:tasks.workunit.client.0.smithi063.stdout:1/112: dwrite d3/db/f20 [0,4194304] 0 2023-12-12T11:51:45.735 INFO:tasks.workunit.client.0.smithi063.stdout:1/113: write d3/db/f1d [40128,52347] 0 2023-12-12T11:51:45.736 INFO:tasks.workunit.client.0.smithi063.stdout:1/114: write d3/db/d16/f21 [57568,95067] 0 2023-12-12T11:51:45.736 INFO:tasks.workunit.client.0.smithi063.stdout:1/115: write d3/db/fe [422018,16690] 0 2023-12-12T11:51:45.736 INFO:tasks.workunit.client.1.smithi093.stdout:8/356: mkdir d3/d73 0 2023-12-12T11:51:45.736 INFO:tasks.workunit.client.1.smithi093.stdout:8/357: dread - d3/d1a/d1f/d29/d3a/d40/f53 zero size 2023-12-12T11:51:45.738 INFO:tasks.workunit.client.0.smithi063.stdout:0/124: symlink d0/l28 0 2023-12-12T11:51:45.741 INFO:tasks.workunit.client.1.smithi093.stdout:1/358: mknod d4/d1a/d1b/d26/d31/c77 0 2023-12-12T11:51:45.744 INFO:tasks.workunit.client.0.smithi063.stdout:3/94: dwrite d4/f15 [0,4194304] 0 2023-12-12T11:51:45.749 INFO:tasks.workunit.client.1.smithi093.stdout:3/365: sync 2023-12-12T11:51:45.754 INFO:tasks.workunit.client.0.smithi063.stdout:1/116: dread d3/db/d16/f21 [0,4194304] 0 2023-12-12T11:51:45.754 INFO:tasks.workunit.client.0.smithi063.stdout:1/117: write d3/db/d16/d17/d19/f1e [4635398,109680] 0 2023-12-12T11:51:45.756 INFO:tasks.workunit.client.1.smithi093.stdout:2/393: sync 2023-12-12T11:51:45.756 INFO:tasks.workunit.client.1.smithi093.stdout:7/321: sync 2023-12-12T11:51:45.762 INFO:tasks.workunit.client.1.smithi093.stdout:5/288: rename d0/d7/l47 to d0/d7/d8/l64 0 2023-12-12T11:51:45.764 INFO:tasks.workunit.client.0.smithi063.stdout:0/125: dread d0/d7/d27/fb [0,4194304] 0 2023-12-12T11:51:45.765 INFO:tasks.workunit.client.1.smithi093.stdout:9/311: link d1/d23/f40 d1/d12/d1f/d32/f6a 0 2023-12-12T11:51:45.768 INFO:tasks.workunit.client.0.smithi063.stdout:7/120: creat de/d22/f29 x:0 0 0 2023-12-12T11:51:45.768 INFO:tasks.workunit.client.1.smithi093.stdout:8/358: dread d3/d1a/f2b [0,4194304] 0 2023-12-12T11:51:45.768 INFO:tasks.workunit.client.1.smithi093.stdout:8/359: read - d3/d1a/d1f/f5a zero size 2023-12-12T11:51:45.770 INFO:tasks.workunit.client.1.smithi093.stdout:0/381: dwrite d5/d21/d27/f5f [0,4194304] 0 2023-12-12T11:51:45.773 INFO:tasks.workunit.client.1.smithi093.stdout:4/538: mkdir d0/d31/d5c/d6c/da4 0 2023-12-12T11:51:45.773 INFO:tasks.workunit.client.1.smithi093.stdout:6/491: getdents d0/da/d14/d3a/d95 0 2023-12-12T11:51:45.775 INFO:tasks.workunit.client.0.smithi063.stdout:2/101: link d0/l12 d0/d11/l21 0 2023-12-12T11:51:45.777 INFO:tasks.workunit.client.1.smithi093.stdout:3/366: mknod df/d25/d6b/c73 0 2023-12-12T11:51:45.779 INFO:tasks.workunit.client.0.smithi063.stdout:4/184: fdatasync d2/d8/f12 0 2023-12-12T11:51:45.784 INFO:tasks.workunit.client.1.smithi093.stdout:0/382: read d5/dd/f16 [3368028,25491] 0 2023-12-12T11:51:45.787 INFO:tasks.workunit.client.1.smithi093.stdout:2/394: unlink d5/d14/d2d/d12/l18 0 2023-12-12T11:51:45.787 INFO:tasks.workunit.client.1.smithi093.stdout:2/395: chown d5/d14/f4f 9228 1 2023-12-12T11:51:45.788 INFO:tasks.workunit.client.1.smithi093.stdout:2/396: readlink d5/d14/d2d/d12/d25/l66 0 2023-12-12T11:51:45.788 INFO:tasks.workunit.client.0.smithi063.stdout:2/102: dread d0/f20 [0,4194304] 0 2023-12-12T11:51:45.789 INFO:tasks.workunit.client.0.smithi063.stdout:2/103: creat d0/f22 x:0 0 0 2023-12-12T11:51:45.789 INFO:tasks.workunit.client.0.smithi063.stdout:2/104: fsync d0/f20 0 2023-12-12T11:51:45.790 INFO:tasks.workunit.client.0.smithi063.stdout:3/95: mknod d4/df/c1b 0 2023-12-12T11:51:45.791 INFO:tasks.workunit.client.1.smithi093.stdout:5/289: rmdir d0/d7/d59 39 2023-12-12T11:51:45.795 INFO:tasks.workunit.client.1.smithi093.stdout:7/322: rename da/de/c14 to da/c73 0 2023-12-12T11:51:45.795 INFO:tasks.workunit.client.1.smithi093.stdout:5/290: rename d0/d7/d36 to d0/d7/d36/d29/d65 22 2023-12-12T11:51:45.795 INFO:tasks.workunit.client.1.smithi093.stdout:5/291: read d0/d7/d59/d48/f50 [18159,31573] 0 2023-12-12T11:51:45.796 INFO:tasks.workunit.client.0.smithi063.stdout:1/118: mknod d3/db/d16/d24/c28 0 2023-12-12T11:51:45.799 INFO:tasks.workunit.client.1.smithi093.stdout:9/312: mkdir d1/d23/d6b 0 2023-12-12T11:51:45.799 INFO:tasks.workunit.client.1.smithi093.stdout:9/313: chown d1/d12/d1f/d32/f3b 1 1 2023-12-12T11:51:45.799 INFO:tasks.workunit.client.1.smithi093.stdout:9/314: readlink d1/d12/l14 0 2023-12-12T11:51:45.799 INFO:tasks.workunit.client.1.smithi093.stdout:9/315: chown d1/d12/d1f/f20 0 1 2023-12-12T11:51:45.799 INFO:tasks.workunit.client.1.smithi093.stdout:9/316: truncate d1/f65 164769 0 2023-12-12T11:51:45.800 INFO:tasks.workunit.client.0.smithi063.stdout:6/146: sync 2023-12-12T11:51:45.800 INFO:tasks.workunit.client.0.smithi063.stdout:6/147: read - d9/f27 zero size 2023-12-12T11:51:45.813 INFO:tasks.workunit.client.1.smithi093.stdout:8/360: dwrite d3/d1a/d1f/d29/f43 [0,4194304] 0 2023-12-12T11:51:45.813 INFO:tasks.workunit.client.1.smithi093.stdout:8/361: creat d3/f74 x:0 0 0 2023-12-12T11:51:45.813 INFO:tasks.workunit.client.1.smithi093.stdout:8/362: dread - d3/d1a/f66 zero size 2023-12-12T11:51:45.813 INFO:tasks.workunit.client.1.smithi093.stdout:8/363: chown d3/f6 177 1 2023-12-12T11:51:45.813 INFO:tasks.workunit.client.1.smithi093.stdout:8/364: write d3/d1a/d1f/f5a [30965,45869] 0 2023-12-12T11:51:45.813 INFO:tasks.workunit.client.1.smithi093.stdout:4/539: creat d0/d31/d9d/da0/fa5 x:0 0 0 2023-12-12T11:51:45.815 INFO:tasks.workunit.client.1.smithi093.stdout:8/365: write d3/f36 [698999,92996] 0 2023-12-12T11:51:45.817 INFO:tasks.workunit.client.0.smithi063.stdout:0/126: creat d0/d7/d27/f29 x:0 0 0 2023-12-12T11:51:45.826 INFO:tasks.workunit.client.0.smithi063.stdout:7/121: mknod de/c2a 0 2023-12-12T11:51:45.834 INFO:tasks.workunit.client.1.smithi093.stdout:9/317: creat d1/d23/d24/d29/d43/d58/f6c x:0 0 0 2023-12-12T11:51:45.834 INFO:tasks.workunit.client.1.smithi093.stdout:3/367: dwrite df/f43 [0,4194304] 0 2023-12-12T11:51:45.836 INFO:tasks.workunit.client.0.smithi063.stdout:2/105: stat d0/l18 0 2023-12-12T11:51:45.836 INFO:tasks.workunit.client.0.smithi063.stdout:2/106: truncate d0/f17 54316 0 2023-12-12T11:51:45.836 INFO:tasks.workunit.client.0.smithi063.stdout:2/107: fdatasync d0/d1a/f1d 0 2023-12-12T11:51:45.841 INFO:tasks.workunit.client.1.smithi093.stdout:9/318: dread d1/d23/d24/d29/f2b [0,4194304] 0 2023-12-12T11:51:45.842 INFO:tasks.workunit.client.0.smithi063.stdout:3/96: mkdir d4/df/d1a/d1c 0 2023-12-12T11:51:45.842 INFO:tasks.workunit.client.0.smithi063.stdout:3/97: read - d4/df/f19 zero size 2023-12-12T11:51:45.846 INFO:tasks.workunit.client.0.smithi063.stdout:1/119: rename d3/f10 to d3/db/d16/d24/f29 0 2023-12-12T11:51:45.848 INFO:tasks.workunit.client.0.smithi063.stdout:6/148: mknod d9/d10/d2a/c36 0 2023-12-12T11:51:45.848 INFO:tasks.workunit.client.0.smithi063.stdout:6/149: fsync d9/d10/d2a/f34 0 2023-12-12T11:51:45.849 INFO:tasks.workunit.client.1.smithi093.stdout:4/540: stat d0/d31/c38 0 2023-12-12T11:51:45.849 INFO:tasks.workunit.client.1.smithi093.stdout:4/541: fsync d0/d31/f7c 0 2023-12-12T11:51:45.849 INFO:tasks.workunit.client.1.smithi093.stdout:4/542: fsync d0/f20 0 2023-12-12T11:51:45.850 INFO:tasks.workunit.client.0.smithi063.stdout:0/127: symlink d0/d1a/d23/l2a 0 2023-12-12T11:51:45.851 INFO:tasks.workunit.client.0.smithi063.stdout:0/128: readlink d0/d7/d27/l20 0 2023-12-12T11:51:45.851 INFO:tasks.workunit.client.0.smithi063.stdout:2/108: rmdir d0/d11 39 2023-12-12T11:51:45.852 INFO:tasks.workunit.client.0.smithi063.stdout:2/109: write d0/f20 [1405405,113510] 0 2023-12-12T11:51:45.853 INFO:tasks.workunit.client.0.smithi063.stdout:7/122: write de/f1a [3229960,6029] 0 2023-12-12T11:51:45.854 INFO:tasks.workunit.client.0.smithi063.stdout:3/98: chown d4/ce 502437046 1 2023-12-12T11:51:45.854 INFO:tasks.workunit.client.0.smithi063.stdout:3/99: chown d4/df/c12 3 1 2023-12-12T11:51:45.856 INFO:tasks.workunit.client.1.smithi093.stdout:8/366: mkdir d3/d1a/d1f/d75 0 2023-12-12T11:51:45.856 INFO:tasks.workunit.client.1.smithi093.stdout:9/319: dread d1/d23/d24/d29/d43/f48 [0,4194304] 0 2023-12-12T11:51:45.859 INFO:tasks.workunit.client.1.smithi093.stdout:6/492: rmdir d0/da/d32/d39 39 2023-12-12T11:51:45.859 INFO:tasks.workunit.client.1.smithi093.stdout:0/383: mkdir d5/d78 0 2023-12-12T11:51:45.859 INFO:tasks.workunit.client.1.smithi093.stdout:0/384: fsync d5/d21/d27/f5d 0 2023-12-12T11:51:45.859 INFO:tasks.workunit.client.1.smithi093.stdout:0/385: write d5/dd/f1d [5205068,68572] 0 2023-12-12T11:51:45.862 INFO:tasks.workunit.client.0.smithi063.stdout:1/120: creat d3/db/d16/d24/f2a x:0 0 0 2023-12-12T11:51:45.862 INFO:tasks.workunit.client.0.smithi063.stdout:6/150: creat d9/d10/f37 x:0 0 0 2023-12-12T11:51:45.864 INFO:tasks.workunit.client.1.smithi093.stdout:7/323: dwrite da/de/f30 [0,4194304] 0 2023-12-12T11:51:45.864 INFO:tasks.workunit.client.1.smithi093.stdout:4/543: dread d0/f17 [0,4194304] 0 2023-12-12T11:51:45.866 INFO:tasks.workunit.client.0.smithi063.stdout:0/129: rename d0/f12 to d0/d15/f2b 0 2023-12-12T11:51:45.867 INFO:tasks.workunit.client.1.smithi093.stdout:3/368: rename df/d25/d6b/c73 to df/c74 0 2023-12-12T11:51:45.869 INFO:tasks.workunit.client.0.smithi063.stdout:1/121: dread d3/db/d16/f21 [0,4194304] 0 2023-12-12T11:51:45.869 INFO:tasks.workunit.client.0.smithi063.stdout:1/122: chown d3/db/d16/d24/f29 4489353 1 2023-12-12T11:51:45.869 INFO:tasks.workunit.client.0.smithi063.stdout:1/123: write d3/db/d16/f21 [185274,9251] 0 2023-12-12T11:51:45.869 INFO:tasks.workunit.client.0.smithi063.stdout:1/124: creat d3/db/d16/f2b x:0 0 0 2023-12-12T11:51:45.871 INFO:tasks.workunit.client.0.smithi063.stdout:4/185: dwrite d2/d17/f22 [0,4194304] 0 2023-12-12T11:51:45.872 INFO:tasks.workunit.client.1.smithi093.stdout:2/397: dwrite d5/d14/d2d/d12/d25/f29 [0,4194304] 0 2023-12-12T11:51:45.872 INFO:tasks.workunit.client.1.smithi093.stdout:5/292: dwrite d0/d7/d8/de/f28 [0,4194304] 0 2023-12-12T11:51:45.872 INFO:tasks.workunit.client.1.smithi093.stdout:5/293: chown d0/d7/d59/d48 32408 1 2023-12-12T11:51:45.875 INFO:tasks.workunit.client.1.smithi093.stdout:0/386: dread d5/f31 [0,4194304] 0 2023-12-12T11:51:45.875 INFO:tasks.workunit.client.1.smithi093.stdout:0/387: write d5/d21/d27/f5a [1020603,14225] 0 2023-12-12T11:51:45.875 INFO:tasks.workunit.client.1.smithi093.stdout:0/388: dread - d5/dd/d33/f5e zero size 2023-12-12T11:51:45.878 INFO:tasks.workunit.client.0.smithi063.stdout:0/130: creat d0/d7/d27/d1f/f2c x:0 0 0 2023-12-12T11:51:45.878 INFO:tasks.workunit.client.0.smithi063.stdout:0/131: write d0/d7/ff [1630045,10046] 0 2023-12-12T11:51:45.883 INFO:tasks.workunit.client.1.smithi093.stdout:5/294: write d0/d7/d59/d48/f56 [5261517,112495] 0 2023-12-12T11:51:45.883 INFO:tasks.workunit.client.1.smithi093.stdout:9/320: unlink d1/d12/d1f/d32/d42/f5f 0 2023-12-12T11:51:45.887 INFO:tasks.workunit.client.0.smithi063.stdout:7/123: mkdir de/d22/d2b 0 2023-12-12T11:51:45.888 INFO:tasks.workunit.client.1.smithi093.stdout:6/493: dread d0/d52/d7e/d42/f53 [0,4194304] 0 2023-12-12T11:51:45.890 INFO:tasks.workunit.client.1.smithi093.stdout:7/324: symlink da/de/d46/l74 0 2023-12-12T11:51:45.890 INFO:tasks.workunit.client.1.smithi093.stdout:7/325: chown da/f57 24 1 2023-12-12T11:51:45.890 INFO:tasks.workunit.client.1.smithi093.stdout:7/326: chown da/d15/d2d/d2f/c37 1349547349 1 2023-12-12T11:51:45.892 INFO:tasks.workunit.client.1.smithi093.stdout:0/389: dread d5/f30 [0,4194304] 0 2023-12-12T11:51:45.894 INFO:tasks.workunit.client.1.smithi093.stdout:4/544: rename d0/d36/l9e to d0/d36/d61/la6 0 2023-12-12T11:51:45.895 INFO:tasks.workunit.client.1.smithi093.stdout:4/545: write d0/f44 [3304667,36928] 0 2023-12-12T11:51:45.908 INFO:tasks.workunit.client.0.smithi063.stdout:0/132: unlink d0/d15/l1d 0 2023-12-12T11:51:45.914 INFO:tasks.workunit.client.0.smithi063.stdout:1/125: rmdir d3/db/d16 39 2023-12-12T11:51:45.914 INFO:tasks.workunit.client.0.smithi063.stdout:1/126: stat d3/db/d16/d24/f29 0 2023-12-12T11:51:45.916 INFO:tasks.workunit.client.1.smithi093.stdout:3/369: mknod df/d30/d33/c75 0 2023-12-12T11:51:45.917 INFO:tasks.workunit.client.0.smithi063.stdout:6/151: dread d9/f31 [0,4194304] 0 2023-12-12T11:51:45.917 INFO:tasks.workunit.client.0.smithi063.stdout:6/152: chown d9/le 5031800 1 2023-12-12T11:51:45.918 INFO:tasks.workunit.client.0.smithi063.stdout:7/124: symlink de/l2c 0 2023-12-12T11:51:45.918 INFO:tasks.workunit.client.1.smithi093.stdout:1/359: sync 2023-12-12T11:51:45.923 INFO:tasks.workunit.client.1.smithi093.stdout:5/295: rmdir d0/d7/d59/d48/d4d 0 2023-12-12T11:51:45.923 INFO:tasks.workunit.client.1.smithi093.stdout:9/321: creat d1/d12/d1f/d32/f6d x:0 0 0 2023-12-12T11:51:45.925 INFO:tasks.workunit.client.1.smithi093.stdout:1/360: dread d4/d1c/f6d [0,4194304] 0 2023-12-12T11:51:45.925 INFO:tasks.workunit.client.1.smithi093.stdout:1/361: truncate d4/d1c/f43 557825 0 2023-12-12T11:51:45.926 INFO:tasks.workunit.client.1.smithi093.stdout:6/494: link d0/da/d14/d38/l54 d0/d7b/lb9 0 2023-12-12T11:51:45.927 INFO:tasks.workunit.client.0.smithi063.stdout:2/110: dwrite d0/ff [4194304,4194304] 0 2023-12-12T11:51:45.930 INFO:tasks.workunit.client.1.smithi093.stdout:7/327: creat da/d15/d19/d4c/d6d/f75 x:0 0 0 2023-12-12T11:51:45.936 INFO:tasks.workunit.client.0.smithi063.stdout:1/127: truncate d3/db/d16/d17/d19/f1e 1066121 0 2023-12-12T11:51:45.936 INFO:tasks.workunit.client.0.smithi063.stdout:1/128: truncate d3/db/fe 1363152 0 2023-12-12T11:51:45.937 INFO:tasks.workunit.client.0.smithi063.stdout:1/129: read d3/db/fe [660643,93621] 0 2023-12-12T11:51:45.939 INFO:tasks.workunit.client.0.smithi063.stdout:6/153: rename d9/d10/l30 to d9/l38 0 2023-12-12T11:51:45.939 INFO:tasks.workunit.client.0.smithi063.stdout:6/154: write d9/f27 [35787,78823] 0 2023-12-12T11:51:45.939 INFO:tasks.workunit.client.0.smithi063.stdout:6/155: chown d9/fc 3725 1 2023-12-12T11:51:45.943 INFO:tasks.workunit.client.0.smithi063.stdout:7/125: creat de/d22/d2b/f2d x:0 0 0 2023-12-12T11:51:45.945 INFO:tasks.workunit.client.1.smithi093.stdout:3/370: symlink df/d22/d49/d69/l76 0 2023-12-12T11:51:45.950 INFO:tasks.workunit.client.1.smithi093.stdout:8/367: dwrite d3/d8/f19 [8388608,4194304] 0 2023-12-12T11:51:45.953 INFO:tasks.workunit.client.1.smithi093.stdout:2/398: rename d5/d14/d27/f6d to d5/d14/d47/d56/f83 0 2023-12-12T11:51:45.960 INFO:tasks.workunit.client.0.smithi063.stdout:2/111: mknod d0/d11/c23 0 2023-12-12T11:51:45.963 INFO:tasks.workunit.client.1.smithi093.stdout:5/296: mkdir d0/d3b/d66 0 2023-12-12T11:51:45.963 INFO:tasks.workunit.client.0.smithi063.stdout:1/130: rmdir d3/db/d16/d24 39 2023-12-12T11:51:45.963 INFO:tasks.workunit.client.1.smithi093.stdout:1/362: mknod d4/d1a/d73/c78 0 2023-12-12T11:51:45.965 INFO:tasks.workunit.client.1.smithi093.stdout:7/328: dread da/f4b [0,4194304] 0 2023-12-12T11:51:45.969 INFO:tasks.workunit.client.0.smithi063.stdout:2/112: mknod d0/d1a/c24 0 2023-12-12T11:51:45.970 INFO:tasks.workunit.client.0.smithi063.stdout:3/100: dwrite d4/f6 [0,4194304] 0 2023-12-12T11:51:45.970 INFO:tasks.workunit.client.0.smithi063.stdout:3/101: dread - d4/df/f19 zero size 2023-12-12T11:51:45.970 INFO:tasks.workunit.client.1.smithi093.stdout:3/371: rmdir df/d25 39 2023-12-12T11:51:45.970 INFO:tasks.workunit.client.1.smithi093.stdout:8/368: mkdir d3/d1a/d1f/d29/d30/d58/d76 0 2023-12-12T11:51:45.971 INFO:tasks.workunit.client.0.smithi063.stdout:9/142: sync 2023-12-12T11:51:45.971 INFO:tasks.workunit.client.0.smithi063.stdout:1/131: creat d3/db/d16/d17/d19/f2c x:0 0 0 2023-12-12T11:51:45.971 INFO:tasks.workunit.client.0.smithi063.stdout:8/214: sync 2023-12-12T11:51:45.971 INFO:tasks.workunit.client.0.smithi063.stdout:5/134: sync 2023-12-12T11:51:45.976 INFO:tasks.workunit.client.1.smithi093.stdout:6/495: rename d0/da/d32/c87 to d0/da/d32/d9e/d4d/cba 0 2023-12-12T11:51:45.980 INFO:tasks.workunit.client.0.smithi063.stdout:3/102: readlink d4/la 0 2023-12-12T11:51:45.982 INFO:tasks.workunit.client.1.smithi093.stdout:2/399: symlink d5/d14/d5e/d7d/l84 0 2023-12-12T11:51:45.989 INFO:tasks.workunit.client.1.smithi093.stdout:3/372: write df/f43 [551850,31203] 0 2023-12-12T11:51:45.990 INFO:tasks.workunit.client.1.smithi093.stdout:3/373: write df/d36/d3d/d42/f5e [559846,53896] 0 2023-12-12T11:51:45.991 INFO:tasks.workunit.client.1.smithi093.stdout:5/297: mknod d0/c67 0 2023-12-12T11:51:45.991 INFO:tasks.workunit.client.1.smithi093.stdout:5/298: fdatasync d0/d7/d36/f2a 0 2023-12-12T11:51:45.991 INFO:tasks.workunit.client.1.smithi093.stdout:5/299: chown d0/d7/d36/d38/f49 1824 1 2023-12-12T11:51:45.996 INFO:tasks.workunit.client.1.smithi093.stdout:1/363: link d4/dc/c16 d4/c79 0 2023-12-12T11:51:45.996 INFO:tasks.workunit.client.0.smithi063.stdout:0/133: dwrite d0/d7/d27/fb [0,4194304] 0 2023-12-12T11:51:45.997 INFO:tasks.workunit.client.1.smithi093.stdout:4/546: dwrite d0/f33 [0,4194304] 0 2023-12-12T11:51:45.999 INFO:tasks.workunit.client.0.smithi063.stdout:0/134: write d0/d15/f2b [136324,104588] 0 2023-12-12T11:51:45.999 INFO:tasks.workunit.client.0.smithi063.stdout:0/135: chown d0/d7 666 1 2023-12-12T11:51:46.001 INFO:tasks.workunit.client.0.smithi063.stdout:1/132: creat d3/db/d16/f2d x:0 0 0 2023-12-12T11:51:46.001 INFO:tasks.workunit.client.0.smithi063.stdout:9/143: creat d7/d11/f2d x:0 0 0 2023-12-12T11:51:46.001 INFO:tasks.workunit.client.0.smithi063.stdout:9/144: chown d7/d11/d12 11 1 2023-12-12T11:51:46.001 INFO:tasks.workunit.client.0.smithi063.stdout:1/133: stat d3/db/d12/l15 0 2023-12-12T11:51:46.006 INFO:tasks.workunit.client.0.smithi063.stdout:5/135: write d7/de/f25 [351359,20547] 0 2023-12-12T11:51:46.006 INFO:tasks.workunit.client.0.smithi063.stdout:5/136: fsync d7/f13 0 2023-12-12T11:51:46.006 INFO:tasks.workunit.client.0.smithi063.stdout:5/137: read - d7/d10/f23 zero size 2023-12-12T11:51:46.006 INFO:tasks.workunit.client.1.smithi093.stdout:7/329: link c8 da/d2e/c76 0 2023-12-12T11:51:46.006 INFO:tasks.workunit.client.1.smithi093.stdout:7/330: chown da/d15/d19/d4c/d6d 3253934 1 2023-12-12T11:51:46.006 INFO:tasks.workunit.client.1.smithi093.stdout:7/331: chown l5 29579 1 2023-12-12T11:51:46.007 INFO:tasks.workunit.client.1.smithi093.stdout:7/332: creat da/de/f77 x:0 0 0 2023-12-12T11:51:46.007 INFO:tasks.workunit.client.1.smithi093.stdout:7/333: write da/d15/d19/f31 [3414918,5848] 0 2023-12-12T11:51:46.007 INFO:tasks.workunit.client.1.smithi093.stdout:7/334: chown da/de/d46 8 1 2023-12-12T11:51:46.007 INFO:tasks.workunit.client.1.smithi093.stdout:8/369: rename d3/f48 to d3/d73/f77 0 2023-12-12T11:51:46.007 INFO:tasks.workunit.client.1.smithi093.stdout:8/370: fdatasync d3/d1a/d1f/f2a 0 2023-12-12T11:51:46.007 INFO:tasks.workunit.client.1.smithi093.stdout:8/371: getdents d3/d1a/d1f/d59/d6c 0 2023-12-12T11:51:46.007 INFO:tasks.workunit.client.1.smithi093.stdout:2/400: mknod d5/d14/d2d/d12/d44/c85 0 2023-12-12T11:51:46.013 INFO:tasks.workunit.client.0.smithi063.stdout:0/136: mkdir d0/d7/d27/d19/d2d 0 2023-12-12T11:51:46.013 INFO:tasks.workunit.client.0.smithi063.stdout:0/137: chown d0/d15 0 1 2023-12-12T11:51:46.013 INFO:tasks.workunit.client.0.smithi063.stdout:0/138: chown d0/d7/d27/f29 307 1 2023-12-12T11:51:46.013 INFO:tasks.workunit.client.0.smithi063.stdout:4/186: dwrite d2/d8/d14/f2c [0,4194304] 0 2023-12-12T11:51:46.013 INFO:tasks.workunit.client.0.smithi063.stdout:6/156: dwrite d9/fb [0,4194304] 0 2023-12-12T11:51:46.015 INFO:tasks.workunit.client.1.smithi093.stdout:9/322: dwrite d1/d23/d24/d29/d43/f51 [0,4194304] 0 2023-12-12T11:51:46.019 INFO:tasks.workunit.client.0.smithi063.stdout:7/126: dwrite de/f28 [0,4194304] 0 2023-12-12T11:51:46.019 INFO:tasks.workunit.client.1.smithi093.stdout:9/323: creat d1/d12/d1f/d32/d42/f6e x:0 0 0 2023-12-12T11:51:46.020 INFO:tasks.workunit.client.0.smithi063.stdout:1/134: symlink d3/db/d16/d17/l2e 0 2023-12-12T11:51:46.020 INFO:tasks.workunit.client.0.smithi063.stdout:5/138: mkdir d7/d24/d27 0 2023-12-12T11:51:46.020 INFO:tasks.workunit.client.0.smithi063.stdout:1/135: chown d3/c6 158829 1 2023-12-12T11:51:46.022 INFO:tasks.workunit.client.1.smithi093.stdout:7/335: dread da/d15/d59/f66 [0,4194304] 0 2023-12-12T11:51:46.025 INFO:tasks.workunit.client.1.smithi093.stdout:8/372: mknod d3/d1a/c78 0 2023-12-12T11:51:46.030 INFO:tasks.workunit.client.1.smithi093.stdout:2/401: unlink d5/d14/d5e/d7d/l84 0 2023-12-12T11:51:46.030 INFO:tasks.workunit.client.1.smithi093.stdout:2/402: chown d5/d14/d2d/d63 32655041 1 2023-12-12T11:51:46.035 INFO:tasks.workunit.client.1.smithi093.stdout:4/547: dread d0/d36/f75 [0,4194304] 0 2023-12-12T11:51:46.038 INFO:tasks.workunit.client.0.smithi063.stdout:4/187: rename d2/f3d to d2/d17/f3e 0 2023-12-12T11:51:46.040 INFO:tasks.workunit.client.0.smithi063.stdout:8/215: dwrite d4/d29/f34 [0,4194304] 0 2023-12-12T11:51:46.041 INFO:tasks.workunit.client.1.smithi093.stdout:6/496: rename d0/d52/d7e/d42/f65 to d0/d52/d7e/fbb 0 2023-12-12T11:51:46.053 INFO:tasks.workunit.client.0.smithi063.stdout:6/157: dread d9/fb [0,4194304] 0 2023-12-12T11:51:46.055 INFO:tasks.workunit.client.0.smithi063.stdout:7/127: symlink de/d22/d2b/l2e 0 2023-12-12T11:51:46.055 INFO:tasks.workunit.client.0.smithi063.stdout:7/128: read de/f1e [1321706,128373] 0 2023-12-12T11:51:46.055 INFO:tasks.workunit.client.0.smithi063.stdout:7/129: creat de/d22/d2b/f2f x:0 0 0 2023-12-12T11:51:46.055 INFO:tasks.workunit.client.0.smithi063.stdout:7/130: readlink de/d22/d2b/l2e 0 2023-12-12T11:51:46.057 INFO:tasks.workunit.client.0.smithi063.stdout:0/139: write d0/d7/d27/fb [1801050,113715] 0 2023-12-12T11:51:46.058 INFO:tasks.workunit.client.0.smithi063.stdout:0/140: dread - d0/d7/d27/d1f/f2c zero size 2023-12-12T11:51:46.058 INFO:tasks.workunit.client.1.smithi093.stdout:1/364: dwrite d4/f3c [0,4194304] 0 2023-12-12T11:51:46.065 INFO:tasks.workunit.client.0.smithi063.stdout:4/188: dread d2/d8/f32 [0,4194304] 0 2023-12-12T11:51:46.069 INFO:tasks.workunit.client.0.smithi063.stdout:5/139: mkdir d7/d28 0 2023-12-12T11:51:46.070 INFO:tasks.workunit.client.0.smithi063.stdout:5/140: chown d7/de/l21 52219980 1 2023-12-12T11:51:46.073 INFO:tasks.workunit.client.1.smithi093.stdout:3/374: dwrite df/f28 [4194304,4194304] 0 2023-12-12T11:51:46.074 INFO:tasks.workunit.client.0.smithi063.stdout:9/145: dwrite d7/f2b [4194304,4194304] 0 2023-12-12T11:51:46.074 INFO:tasks.workunit.client.0.smithi063.stdout:3/103: dwrite d4/df/f19 [0,4194304] 0 2023-12-12T11:51:46.075 INFO:tasks.workunit.client.1.smithi093.stdout:5/300: dwrite d0/d7/d36/d38/f40 [0,4194304] 0 2023-12-12T11:51:46.075 INFO:tasks.workunit.client.0.smithi063.stdout:2/113: dwrite d0/f5 [0,4194304] 0 2023-12-12T11:51:46.078 INFO:tasks.workunit.client.0.smithi063.stdout:6/158: dread f0 [0,4194304] 0 2023-12-12T11:51:46.087 INFO:tasks.workunit.client.0.smithi063.stdout:8/216: readlink d4/de/l2d 0 2023-12-12T11:51:46.089 INFO:tasks.workunit.client.1.smithi093.stdout:9/324: mknod d1/d12/d1f/d32/d42/c6f 0 2023-12-12T11:51:46.092 INFO:tasks.workunit.client.0.smithi063.stdout:7/131: truncate de/f1a 2085517 0 2023-12-12T11:51:46.094 INFO:tasks.workunit.client.1.smithi093.stdout:7/336: truncate da/d15/f6f 1441426 0 2023-12-12T11:51:46.095 INFO:tasks.workunit.client.0.smithi063.stdout:3/104: read d4/fb [2708000,38108] 0 2023-12-12T11:51:46.095 INFO:tasks.workunit.client.0.smithi063.stdout:0/141: mkdir d0/d1a/d23/d2e 0 2023-12-12T11:51:46.100 INFO:tasks.workunit.client.1.smithi093.stdout:8/373: creat d3/d1a/d1f/d29/f79 x:0 0 0 2023-12-12T11:51:46.100 INFO:tasks.workunit.client.1.smithi093.stdout:8/374: chown d3/d1a/f2b 13 1 2023-12-12T11:51:46.110 INFO:tasks.workunit.client.1.smithi093.stdout:4/548: symlink d0/d36/la7 0 2023-12-12T11:51:46.110 INFO:tasks.workunit.client.1.smithi093.stdout:4/549: readlink d0/d31/l73 0 2023-12-12T11:51:46.110 INFO:tasks.workunit.client.1.smithi093.stdout:9/325: write d1/f59 [3785606,124592] 0 2023-12-12T11:51:46.110 INFO:tasks.workunit.client.1.smithi093.stdout:6/497: mkdir d0/d52/dbc 0 2023-12-12T11:51:46.112 INFO:tasks.workunit.client.1.smithi093.stdout:3/375: dwrite df/d30/d33/f3a [0,4194304] 0 2023-12-12T11:51:46.119 INFO:tasks.workunit.client.0.smithi063.stdout:1/136: rmdir d3 39 2023-12-12T11:51:46.120 INFO:tasks.workunit.client.1.smithi093.stdout:1/365: mkdir d4/dc/d7a 0 2023-12-12T11:51:46.122 INFO:tasks.workunit.client.1.smithi093.stdout:8/375: dread d3/d1a/d1f/d29/f4d [0,4194304] 0 2023-12-12T11:51:46.125 INFO:tasks.workunit.client.0.smithi063.stdout:4/189: rename d2/d8/fe to d2/d8/d14/f3f 0 2023-12-12T11:51:46.130 INFO:tasks.workunit.client.1.smithi093.stdout:0/390: sync 2023-12-12T11:51:46.130 INFO:tasks.workunit.client.1.smithi093.stdout:0/391: write d5/dd/d14/d26/d58/f63 [1001692,532] 0 2023-12-12T11:51:46.135 INFO:tasks.workunit.client.1.smithi093.stdout:5/301: rmdir d0/d7 39 2023-12-12T11:51:46.136 INFO:tasks.workunit.client.0.smithi063.stdout:5/141: truncate d7/f9 68613 0 2023-12-12T11:51:46.141 INFO:tasks.workunit.client.1.smithi093.stdout:3/376: dread df/d22/f31 [0,4194304] 0 2023-12-12T11:51:46.147 INFO:tasks.workunit.client.1.smithi093.stdout:7/337: mkdir da/de/d78 0 2023-12-12T11:51:46.147 INFO:tasks.workunit.client.1.smithi093.stdout:7/338: fsync da/de/d46/f69 0 2023-12-12T11:51:46.147 INFO:tasks.workunit.client.1.smithi093.stdout:1/366: write d4/dc/f28 [5916282,55312] 0 2023-12-12T11:51:46.147 INFO:tasks.workunit.client.1.smithi093.stdout:2/403: mkdir d5/d31/d86 0 2023-12-12T11:51:46.148 INFO:tasks.workunit.client.0.smithi063.stdout:4/190: write d2/f10 [7815903,14852] 0 2023-12-12T11:51:46.148 INFO:tasks.workunit.client.0.smithi063.stdout:4/191: write d2/d8/f37 [13651,49196] 0 2023-12-12T11:51:46.148 INFO:tasks.workunit.client.0.smithi063.stdout:4/192: write d2/d8/f32 [205909,26481] 0 2023-12-12T11:51:46.148 INFO:tasks.workunit.client.0.smithi063.stdout:4/193: readlink l1 0 2023-12-12T11:51:46.148 INFO:tasks.workunit.client.0.smithi063.stdout:4/194: creat d2/f40 x:0 0 0 2023-12-12T11:51:46.150 INFO:tasks.workunit.client.1.smithi093.stdout:8/376: dread d3/d1a/f2b [0,4194304] 0 2023-12-12T11:51:46.151 INFO:tasks.workunit.client.1.smithi093.stdout:8/377: dread - d3/d1a/d1f/d59/f6a zero size 2023-12-12T11:51:46.151 INFO:tasks.workunit.client.1.smithi093.stdout:8/378: creat d3/d8/f7a x:0 0 0 2023-12-12T11:51:46.158 INFO:tasks.workunit.client.0.smithi063.stdout:9/146: link d7/f2a d7/d15/f2e 0 2023-12-12T11:51:46.158 INFO:tasks.workunit.client.0.smithi063.stdout:9/147: write d7/d11/f25 [2695927,34254] 0 2023-12-12T11:51:46.161 INFO:tasks.workunit.client.1.smithi093.stdout:0/392: mkdir d5/d41/d77/d79 0 2023-12-12T11:51:46.161 INFO:tasks.workunit.client.1.smithi093.stdout:3/377: symlink df/d25/d2c/l77 0 2023-12-12T11:51:46.164 INFO:tasks.workunit.client.0.smithi063.stdout:2/114: symlink d0/d1a/l25 0 2023-12-12T11:51:46.169 INFO:tasks.workunit.client.0.smithi063.stdout:6/159: dwrite f0 [4194304,4194304] 0 2023-12-12T11:51:46.169 INFO:tasks.workunit.client.0.smithi063.stdout:6/160: fsync d9/fc 0 2023-12-12T11:51:46.170 INFO:tasks.workunit.client.0.smithi063.stdout:7/132: mkdir de/d30 0 2023-12-12T11:51:46.171 INFO:tasks.workunit.client.0.smithi063.stdout:1/137: symlink d3/db/d12/l2f 0 2023-12-12T11:51:46.174 INFO:tasks.workunit.client.1.smithi093.stdout:7/339: rmdir da/de/d46/d4f 39 2023-12-12T11:51:46.175 INFO:tasks.workunit.client.1.smithi093.stdout:7/340: chown da/d15/d19/d4c/d6d/f75 8161 1 2023-12-12T11:51:46.175 INFO:tasks.workunit.client.1.smithi093.stdout:0/393: rmdir d5/d21/d27 39 2023-12-12T11:51:46.175 INFO:tasks.workunit.client.1.smithi093.stdout:0/394: dread - d5/dd/f35 zero size 2023-12-12T11:51:46.175 INFO:tasks.workunit.client.1.smithi093.stdout:3/378: mkdir df/d22/d49/d69/d78 0 2023-12-12T11:51:46.175 INFO:tasks.workunit.client.1.smithi093.stdout:6/498: dread d0/d52/d7e/d42/f53 [0,4194304] 0 2023-12-12T11:51:46.175 INFO:tasks.workunit.client.1.smithi093.stdout:6/499: read - d0/da/d14/d9c/f90 zero size 2023-12-12T11:51:46.175 INFO:tasks.workunit.client.1.smithi093.stdout:1/367: creat d4/d1a/d1b/d26/d65/f7b x:0 0 0 2023-12-12T11:51:46.175 INFO:tasks.workunit.client.1.smithi093.stdout:9/326: dwrite d1/d12/d1f/f25 [4194304,4194304] 0 2023-12-12T11:51:46.176 INFO:tasks.workunit.client.0.smithi063.stdout:9/148: symlink d7/d20/l2f 0 2023-12-12T11:51:46.176 INFO:tasks.workunit.client.0.smithi063.stdout:9/149: fsync d7/f27 0 2023-12-12T11:51:46.176 INFO:tasks.workunit.client.0.smithi063.stdout:9/150: readlink d7/lb 0 2023-12-12T11:51:46.176 INFO:tasks.workunit.client.0.smithi063.stdout:9/151: dread - d7/d11/f2d zero size 2023-12-12T11:51:46.177 INFO:tasks.workunit.client.1.smithi093.stdout:8/379: symlink d3/d73/l7b 0 2023-12-12T11:51:46.178 INFO:tasks.workunit.client.1.smithi093.stdout:2/404: symlink d5/d14/d47/d56/d6f/d73/l87 0 2023-12-12T11:51:46.179 INFO:tasks.workunit.client.1.smithi093.stdout:7/341: truncate da/de/d46/f69 4841682 0 2023-12-12T11:51:46.179 INFO:tasks.workunit.client.1.smithi093.stdout:7/342: truncate da/d15/d19/f45 496354 0 2023-12-12T11:51:46.179 INFO:tasks.workunit.client.1.smithi093.stdout:7/343: dread - da/de/f38 zero size 2023-12-12T11:51:46.189 INFO:tasks.workunit.client.1.smithi093.stdout:0/395: rename d5/c28 to d5/d21/d27/c7a 0 2023-12-12T11:51:46.190 INFO:tasks.workunit.client.0.smithi063.stdout:8/217: link d4/de/l28 d4/l40 0 2023-12-12T11:51:46.190 INFO:tasks.workunit.client.0.smithi063.stdout:8/218: fdatasync d4/de/d1e/f26 0 2023-12-12T11:51:46.190 INFO:tasks.workunit.client.1.smithi093.stdout:3/379: mkdir df/d36/d3d/d59/d72/d79 0 2023-12-12T11:51:46.191 INFO:tasks.workunit.client.1.smithi093.stdout:3/380: write df/d36/f63 [572571,71751] 0 2023-12-12T11:51:46.192 INFO:tasks.workunit.client.0.smithi063.stdout:6/161: creat d9/d2c/f39 x:0 0 0 2023-12-12T11:51:46.194 INFO:tasks.workunit.client.0.smithi063.stdout:0/142: dwrite d0/f21 [0,4194304] 0 2023-12-12T11:51:46.196 INFO:tasks.workunit.client.1.smithi093.stdout:9/327: creat d1/d12/d1f/f70 x:0 0 0 2023-12-12T11:51:46.196 INFO:tasks.workunit.client.1.smithi093.stdout:9/328: write d1/f2f [1459640,81135] 0 2023-12-12T11:51:46.196 INFO:tasks.workunit.client.1.smithi093.stdout:9/329: creat d1/d23/d24/d29/d43/f71 x:0 0 0 2023-12-12T11:51:46.197 INFO:tasks.workunit.client.0.smithi063.stdout:3/105: link d4/df/c1b d4/c1d 0 2023-12-12T11:51:46.198 INFO:tasks.workunit.client.1.smithi093.stdout:8/380: symlink d3/d1a/d1f/d59/l7c 0 2023-12-12T11:51:46.200 INFO:tasks.workunit.client.0.smithi063.stdout:3/106: creat d4/df/f1e x:0 0 0 2023-12-12T11:51:46.200 INFO:tasks.workunit.client.0.smithi063.stdout:3/107: read d4/f6 [7937286,24138] 0 2023-12-12T11:51:46.200 INFO:tasks.workunit.client.0.smithi063.stdout:7/133: rmdir de/d30 0 2023-12-12T11:51:46.203 INFO:tasks.workunit.client.1.smithi093.stdout:4/550: dwrite d0/f20 [0,4194304] 0 2023-12-12T11:51:46.204 INFO:tasks.workunit.client.0.smithi063.stdout:5/142: getdents d7/de 0 2023-12-12T11:51:46.206 INFO:tasks.workunit.client.1.smithi093.stdout:0/396: rename d5/dd/d14/f37 to d5/d21/d2f/d54/f7b 0 2023-12-12T11:51:46.211 INFO:tasks.workunit.client.0.smithi063.stdout:2/115: rmdir d0/d1a 39 2023-12-12T11:51:46.217 INFO:tasks.workunit.client.1.smithi093.stdout:5/302: dwrite d0/d7/d36/d29/f30 [0,4194304] 0 2023-12-12T11:51:46.217 INFO:tasks.workunit.client.1.smithi093.stdout:9/330: symlink d1/d23/d24/d29/d43/l72 0 2023-12-12T11:51:46.217 INFO:tasks.workunit.client.1.smithi093.stdout:9/331: chown d1/d12/d1f/d32/c64 2 1 2023-12-12T11:51:46.217 INFO:tasks.workunit.client.0.smithi063.stdout:4/195: dwrite d2/d8/d14/f2c [0,4194304] 0 2023-12-12T11:51:46.220 INFO:tasks.workunit.client.0.smithi063.stdout:6/162: mknod d9/d2c/c3a 0 2023-12-12T11:51:46.227 INFO:tasks.workunit.client.1.smithi093.stdout:4/551: truncate d0/f54 1167428 0 2023-12-12T11:51:46.228 INFO:tasks.workunit.client.0.smithi063.stdout:3/108: write d4/f15 [2156598,106527] 0 2023-12-12T11:51:46.228 INFO:tasks.workunit.client.0.smithi063.stdout:3/109: write d4/df/f1e [1041925,61043] 0 2023-12-12T11:51:46.228 INFO:tasks.workunit.client.1.smithi093.stdout:7/344: getdents da/d15/d19/d4c/d6d 0 2023-12-12T11:51:46.229 INFO:tasks.workunit.client.0.smithi063.stdout:1/138: dwrite d3/db/d16/d24/f2a [0,4194304] 0 2023-12-12T11:51:46.235 INFO:tasks.workunit.client.1.smithi093.stdout:2/405: rename d5/d14/l7f to d5/d14/d2d/d4c/l88 0 2023-12-12T11:51:46.235 INFO:tasks.workunit.client.1.smithi093.stdout:2/406: truncate d5/d31/f64 282590 0 2023-12-12T11:51:46.236 INFO:tasks.workunit.client.0.smithi063.stdout:2/116: dread d0/f5 [0,4194304] 0 2023-12-12T11:51:46.239 INFO:tasks.workunit.client.0.smithi063.stdout:6/163: write f0 [8041651,40151] 0 2023-12-12T11:51:46.239 INFO:tasks.workunit.client.0.smithi063.stdout:6/164: fsync d9/f24 0 2023-12-12T11:51:46.240 INFO:tasks.workunit.client.0.smithi063.stdout:0/143: symlink d0/d7/l2f 0 2023-12-12T11:51:46.240 INFO:tasks.workunit.client.0.smithi063.stdout:0/144: truncate d0/d7/d27/f29 390673 0 2023-12-12T11:51:46.240 INFO:tasks.workunit.client.0.smithi063.stdout:6/165: creat d9/f3b x:0 0 0 2023-12-12T11:51:46.243 INFO:tasks.workunit.client.0.smithi063.stdout:0/145: creat d0/d7/d27/d1f/f30 x:0 0 0 2023-12-12T11:51:46.243 INFO:tasks.workunit.client.0.smithi063.stdout:7/134: truncate de/f28 1628967 0 2023-12-12T11:51:46.246 INFO:tasks.workunit.client.1.smithi093.stdout:9/332: truncate d1/d12/d1f/d3d/d57/f67 4518934 0 2023-12-12T11:51:46.248 INFO:tasks.workunit.client.0.smithi063.stdout:5/143: unlink d7/de/c16 0 2023-12-12T11:51:46.259 INFO:tasks.workunit.client.0.smithi063.stdout:4/196: dread d2/d8/d14/f2c [0,4194304] 0 2023-12-12T11:51:46.259 INFO:tasks.workunit.client.0.smithi063.stdout:4/197: truncate d2/d8/fa 4816814 0 2023-12-12T11:51:46.262 INFO:tasks.workunit.client.0.smithi063.stdout:9/152: getdents d7/d11/d12 0 2023-12-12T11:51:46.262 INFO:tasks.workunit.client.0.smithi063.stdout:8/219: link d4/d24/f31 d4/de/f41 0 2023-12-12T11:51:46.262 INFO:tasks.workunit.client.0.smithi063.stdout:8/220: fdatasync f1 0 2023-12-12T11:51:46.269 INFO:tasks.workunit.client.0.smithi063.stdout:3/110: symlink d4/df/d1a/d1c/l1f 0 2023-12-12T11:51:46.280 INFO:tasks.workunit.client.1.smithi093.stdout:9/333: read d1/f4f [3058854,100414] 0 2023-12-12T11:51:46.281 INFO:tasks.workunit.client.1.smithi093.stdout:9/334: chown d1/d23/d24/d29/d43/f71 21493 1 2023-12-12T11:51:46.281 INFO:tasks.workunit.client.1.smithi093.stdout:9/335: dread - d1/f54 zero size 2023-12-12T11:51:46.285 INFO:tasks.workunit.client.1.smithi093.stdout:6/500: dwrite d0/d52/d7e/fbb [0,4194304] 0 2023-12-12T11:51:46.285 INFO:tasks.workunit.client.1.smithi093.stdout:6/501: truncate d0/da/d14/d38/d43/f5a 776939 0 2023-12-12T11:51:46.288 INFO:tasks.workunit.client.1.smithi093.stdout:0/397: dwrite d5/dd/d33/f46 [0,4194304] 0 2023-12-12T11:51:46.289 INFO:tasks.workunit.client.1.smithi093.stdout:5/303: dwrite d0/d7/d36/d38/f43 [0,4194304] 0 2023-12-12T11:51:46.302 INFO:tasks.workunit.client.0.smithi063.stdout:2/117: mkdir d0/d1a/d26 0 2023-12-12T11:51:46.309 INFO:tasks.workunit.client.1.smithi093.stdout:4/552: symlink d0/la8 0 2023-12-12T11:51:46.312 INFO:tasks.workunit.client.1.smithi093.stdout:3/381: rename df/f28 to df/d36/d3d/d6f/f7a 0 2023-12-12T11:51:46.316 INFO:tasks.workunit.client.1.smithi093.stdout:2/407: getdents d5/d14/d47/d56/d6f/d73 0 2023-12-12T11:51:46.316 INFO:tasks.workunit.client.1.smithi093.stdout:2/408: write d5/d14/d2d/f53 [525723,126610] 0 2023-12-12T11:51:46.318 INFO:tasks.workunit.client.0.smithi063.stdout:5/144: unlink d7/d10/f17 0 2023-12-12T11:51:46.321 INFO:tasks.workunit.client.0.smithi063.stdout:6/166: dwrite d9/f1a [0,4194304] 0 2023-12-12T11:51:46.321 INFO:tasks.workunit.client.0.smithi063.stdout:4/198: stat d2/d8/cb 0 2023-12-12T11:51:46.322 INFO:tasks.workunit.client.0.smithi063.stdout:8/221: dread f0 [0,4194304] 0 2023-12-12T11:51:46.322 INFO:tasks.workunit.client.0.smithi063.stdout:8/222: stat d4/de/d32 0 2023-12-12T11:51:46.323 INFO:tasks.workunit.client.0.smithi063.stdout:7/135: dwrite de/f21 [0,4194304] 0 2023-12-12T11:51:46.326 INFO:tasks.workunit.client.1.smithi093.stdout:9/336: mkdir d1/d12/d1f/d73 0 2023-12-12T11:51:46.327 INFO:tasks.workunit.client.0.smithi063.stdout:9/153: mkdir d7/d11/d12/d30 0 2023-12-12T11:51:46.337 INFO:tasks.workunit.client.0.smithi063.stdout:3/111: creat d4/df/d1a/f20 x:0 0 0 2023-12-12T11:51:46.337 INFO:tasks.workunit.client.0.smithi063.stdout:3/112: readlink d4/df/d1a/d1c/l1f 0 2023-12-12T11:51:46.345 INFO:tasks.workunit.client.0.smithi063.stdout:2/118: link d0/d1a/f1c d0/d1a/d1e/f27 0 2023-12-12T11:51:46.345 INFO:tasks.workunit.client.0.smithi063.stdout:2/119: write d0/d1a/f1c [100898,14981] 0 2023-12-12T11:51:46.350 INFO:tasks.workunit.client.1.smithi093.stdout:6/502: mknod d0/da/d14/d21/cbd 0 2023-12-12T11:51:46.350 INFO:tasks.workunit.client.1.smithi093.stdout:6/503: write d0/da/d32/d39/d5b/fa3 [20946,65480] 0 2023-12-12T11:51:46.357 INFO:tasks.workunit.client.0.smithi063.stdout:1/139: write d3/db/d16/d24/f2a [4750928,67055] 0 2023-12-12T11:51:46.366 INFO:tasks.workunit.client.0.smithi063.stdout:1/140: fdatasync d3/db/fe 0 2023-12-12T11:51:46.366 INFO:tasks.workunit.client.0.smithi063.stdout:1/141: chown d3/db/d12/l15 1693 1 2023-12-12T11:51:46.367 INFO:tasks.workunit.client.1.smithi093.stdout:0/398: mkdir d5/dd/d14/d26/d58/d64/d7c 0 2023-12-12T11:51:46.367 INFO:tasks.workunit.client.1.smithi093.stdout:0/399: write d5/d21/d2f/f3d [1061592,117551] 0 2023-12-12T11:51:46.367 INFO:tasks.workunit.client.0.smithi063.stdout:1/142: write d3/f1a [641040,81673] 0 2023-12-12T11:51:46.369 INFO:tasks.workunit.client.0.smithi063.stdout:0/146: dwrite d0/d15/f2b [4194304,4194304] 0 2023-12-12T11:51:46.371 INFO:tasks.workunit.client.0.smithi063.stdout:6/167: symlink d9/d10/l3c 0 2023-12-12T11:51:46.373 INFO:tasks.workunit.client.1.smithi093.stdout:9/337: dwrite d1/d12/d1f/f35 [0,4194304] 0 2023-12-12T11:51:46.373 INFO:tasks.workunit.client.1.smithi093.stdout:3/382: dwrite df/d36/d3d/d42/f5e [0,4194304] 0 2023-12-12T11:51:46.373 INFO:tasks.workunit.client.1.smithi093.stdout:3/383: fdatasync df/f54 0 2023-12-12T11:51:46.374 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:46 smithi063 ceph-mon[107117]: pgmap v7: 65 pgs: 65 active+clean; 992 MiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 111 MiB/s rd, 137 MiB/s wr, 223 op/s 2023-12-12T11:51:46.389 INFO:tasks.workunit.client.1.smithi093.stdout:5/304: mkdir d0/d7/d36/d68 0 2023-12-12T11:51:46.394 INFO:tasks.workunit.client.0.smithi063.stdout:8/223: creat d4/f42 x:0 0 0 2023-12-12T11:51:46.395 INFO:tasks.workunit.client.0.smithi063.stdout:8/224: write d4/d29/f35 [1109397,52038] 0 2023-12-12T11:51:46.395 INFO:tasks.workunit.client.0.smithi063.stdout:8/225: stat f1 0 2023-12-12T11:51:46.395 INFO:tasks.workunit.client.1.smithi093.stdout:4/553: rmdir d0/d87/d79 39 2023-12-12T11:51:46.395 INFO:tasks.workunit.client.1.smithi093.stdout:4/554: chown d0/d87/c8d 102 1 2023-12-12T11:51:46.395 INFO:tasks.workunit.client.1.smithi093.stdout:4/555: fdatasync d0/f20 0 2023-12-12T11:51:46.398 INFO:tasks.workunit.client.0.smithi063.stdout:7/136: creat de/d22/f31 x:0 0 0 2023-12-12T11:51:46.400 INFO:tasks.workunit.client.1.smithi093.stdout:6/504: dwrite d0/da/d14/d9c/f90 [0,4194304] 0 2023-12-12T11:51:46.404 INFO:tasks.workunit.client.1.smithi093.stdout:8/381: rename f0 to d3/d8/f7d 0 2023-12-12T11:51:46.404 INFO:tasks.workunit.client.1.smithi093.stdout:8/382: dread - d3/d1a/d1f/d59/f6a zero size 2023-12-12T11:51:46.404 INFO:tasks.workunit.client.1.smithi093.stdout:8/383: write d3/d1a/d1f/d29/d30/d58/f67 [1197070,45562] 0 2023-12-12T11:51:46.407 INFO:tasks.workunit.client.0.smithi063.stdout:3/113: dwrite f0 [0,4194304] 0 2023-12-12T11:51:46.407 INFO:tasks.workunit.client.0.smithi063.stdout:0/147: write d0/d15/f2b [6690731,23755] 0 2023-12-12T11:51:46.407 INFO:tasks.workunit.client.0.smithi063.stdout:5/145: getdents d7 0 2023-12-12T11:51:46.407 INFO:tasks.workunit.client.1.smithi093.stdout:2/409: creat d5/d14/d2d/d4c/d54/d67/d69/d6c/f89 x:0 0 0 2023-12-12T11:51:46.408 INFO:tasks.workunit.client.0.smithi063.stdout:9/154: dwrite d7/ff [0,4194304] 0 2023-12-12T11:51:46.412 INFO:tasks.workunit.client.0.smithi063.stdout:6/168: creat d9/d10/d25/f3d x:0 0 0 2023-12-12T11:51:46.412 INFO:tasks.workunit.client.0.smithi063.stdout:6/169: creat d9/d10/d2a/f3e x:0 0 0 2023-12-12T11:51:46.412 INFO:tasks.workunit.client.0.smithi063.stdout:6/170: readlink d9/l38 0 2023-12-12T11:51:46.415 INFO:tasks.workunit.client.1.smithi093.stdout:0/400: chown d5/cf 9090517 1 2023-12-12T11:51:46.417 INFO:tasks.workunit.client.0.smithi063.stdout:2/120: dwrite d0/f22 [0,4194304] 0 2023-12-12T11:51:46.417 INFO:tasks.workunit.client.0.smithi063.stdout:4/199: getdents d2/d8/d14 0 2023-12-12T11:51:46.417 INFO:tasks.workunit.client.1.smithi093.stdout:3/384: dwrite fc [0,4194304] 0 2023-12-12T11:51:46.420 INFO:tasks.workunit.client.0.smithi063.stdout:4/200: write d2/d8/f37 [1078275,30755] 0 2023-12-12T11:51:46.441 INFO:tasks.workunit.client.0.smithi063.stdout:5/146: unlink d7/f9 0 2023-12-12T11:51:46.442 INFO:tasks.workunit.client.0.smithi063.stdout:5/147: fsync d7/ff 0 2023-12-12T11:51:46.445 INFO:tasks.workunit.client.1.smithi093.stdout:6/505: dwrite d0/da/f20 [0,4194304] 0 2023-12-12T11:51:46.445 INFO:tasks.workunit.client.1.smithi093.stdout:6/506: stat d0/d52/d6b/c74 0 2023-12-12T11:51:46.445 INFO:tasks.workunit.client.1.smithi093.stdout:6/507: stat d0/da/d14/f55 0 2023-12-12T11:51:46.448 INFO:tasks.workunit.client.1.smithi093.stdout:7/345: sync 2023-12-12T11:51:46.448 INFO:tasks.workunit.client.1.smithi093.stdout:1/368: sync 2023-12-12T11:51:46.449 INFO:tasks.workunit.client.1.smithi093.stdout:9/338: unlink d1/d12/d1f/d32/f39 0 2023-12-12T11:51:46.449 INFO:tasks.workunit.client.1.smithi093.stdout:1/369: write d4/fa [1564536,69897] 0 2023-12-12T11:51:46.450 INFO:tasks.workunit.client.1.smithi093.stdout:1/370: write d4/d1a/f6b [979830,28451] 0 2023-12-12T11:51:46.450 INFO:tasks.workunit.client.1.smithi093.stdout:1/371: chown d4/d1a/l23 58758861 1 2023-12-12T11:51:46.450 INFO:tasks.workunit.client.1.smithi093.stdout:1/372: readlink d4/l5 0 2023-12-12T11:51:46.453 INFO:tasks.workunit.client.1.smithi093.stdout:5/305: symlink d0/d7/d59/l69 0 2023-12-12T11:51:46.456 INFO:tasks.workunit.client.0.smithi063.stdout:1/143: dwrite d3/f1a [0,4194304] 0 2023-12-12T11:51:46.457 INFO:tasks.workunit.client.0.smithi063.stdout:3/114: rename d4/ce to d4/df/d1a/d1c/c21 0 2023-12-12T11:51:46.459 INFO:tasks.workunit.client.0.smithi063.stdout:1/144: dread - d3/db/d16/f2b zero size 2023-12-12T11:51:46.461 INFO:tasks.workunit.client.1.smithi093.stdout:8/384: rename d3/d1a/d1f/d59/c6d to d3/d1a/d1f/d29/d3a/d40/c7e 0 2023-12-12T11:51:46.463 INFO:tasks.workunit.client.1.smithi093.stdout:7/346: dread da/de/f5c [0,4194304] 0 2023-12-12T11:51:46.465 INFO:tasks.workunit.client.1.smithi093.stdout:4/556: dwrite d0/f27 [0,4194304] 0 2023-12-12T11:51:46.466 INFO:tasks.workunit.client.1.smithi093.stdout:3/385: symlink df/d36/l7b 0 2023-12-12T11:51:46.468 INFO:tasks.workunit.client.0.smithi063.stdout:5/148: dread d7/f12 [0,4194304] 0 2023-12-12T11:51:46.468 INFO:tasks.workunit.client.1.smithi093.stdout:2/410: dwrite d5/d31/f77 [0,4194304] 0 2023-12-12T11:51:46.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:46 smithi093 ceph-mon[115914]: pgmap v7: 65 pgs: 65 active+clean; 992 MiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 111 MiB/s rd, 137 MiB/s wr, 223 op/s 2023-12-12T11:51:46.472 INFO:tasks.workunit.client.1.smithi093.stdout:6/508: mknod d0/da/d14/d38/d43/cbe 0 2023-12-12T11:51:46.474 INFO:tasks.workunit.client.0.smithi063.stdout:4/201: mkdir d2/d17/d41 0 2023-12-12T11:51:46.478 INFO:tasks.workunit.client.1.smithi093.stdout:9/339: mknod d1/d12/d1f/c74 0 2023-12-12T11:51:46.482 INFO:tasks.workunit.client.0.smithi063.stdout:8/226: getdents d4 0 2023-12-12T11:51:46.482 INFO:tasks.workunit.client.0.smithi063.stdout:3/115: dread d4/f7 [0,4194304] 0 2023-12-12T11:51:46.482 INFO:tasks.workunit.client.0.smithi063.stdout:3/116: creat d4/df/d1a/f22 x:0 0 0 2023-12-12T11:51:46.484 INFO:tasks.workunit.client.1.smithi093.stdout:7/347: dread da/d15/d19/f5a [0,4194304] 0 2023-12-12T11:51:46.492 INFO:tasks.workunit.client.0.smithi063.stdout:1/145: getdents d3/db/d12 0 2023-12-12T11:51:46.492 INFO:tasks.workunit.client.0.smithi063.stdout:1/146: readlink d3/db/d12/l15 0 2023-12-12T11:51:46.492 INFO:tasks.workunit.client.0.smithi063.stdout:1/147: fsync d3/db/d16/d24/f29 0 2023-12-12T11:51:46.497 INFO:tasks.workunit.client.0.smithi063.stdout:9/155: rename d7/f8 to d7/d15/f31 0 2023-12-12T11:51:46.506 INFO:tasks.workunit.client.1.smithi093.stdout:4/557: mkdir d0/d87/d79/d86/da9 0 2023-12-12T11:51:46.507 INFO:tasks.workunit.client.0.smithi063.stdout:6/171: getdents d9 0 2023-12-12T11:51:46.507 INFO:tasks.workunit.client.0.smithi063.stdout:5/149: creat d7/f29 x:0 0 0 2023-12-12T11:51:46.512 INFO:tasks.workunit.client.0.smithi063.stdout:4/202: rmdir d2/d8/d14 39 2023-12-12T11:51:46.512 INFO:tasks.workunit.client.1.smithi093.stdout:5/306: dwrite d0/d7/d36/f4a [0,4194304] 0 2023-12-12T11:51:46.512 INFO:tasks.workunit.client.1.smithi093.stdout:5/307: chown d0/d7/d59/f2d 6126329 1 2023-12-12T11:51:46.515 INFO:tasks.workunit.client.1.smithi093.stdout:6/509: mkdir d0/da/dbf 0 2023-12-12T11:51:46.517 INFO:tasks.workunit.client.0.smithi063.stdout:1/148: getdents d3/db/d16/d17/d19 0 2023-12-12T11:51:46.521 INFO:tasks.workunit.client.0.smithi063.stdout:2/121: rename d0/l7 to d0/d1a/d26/l28 0 2023-12-12T11:51:46.521 INFO:tasks.workunit.client.0.smithi063.stdout:2/122: stat d0/ce 0 2023-12-12T11:51:46.521 INFO:tasks.workunit.client.0.smithi063.stdout:6/172: symlink d9/d10/d25/l3f 0 2023-12-12T11:51:46.521 INFO:tasks.workunit.client.0.smithi063.stdout:6/173: fsync d9/d10/f23 0 2023-12-12T11:51:46.539 INFO:tasks.workunit.client.0.smithi063.stdout:1/149: dread d3/f1a [0,4194304] 0 2023-12-12T11:51:46.539 INFO:tasks.workunit.client.1.smithi093.stdout:1/373: rmdir d4/d1a/d1b/d26/d65 39 2023-12-12T11:51:46.539 INFO:tasks.workunit.client.1.smithi093.stdout:1/374: truncate d4/d1a/f5f 635686 0 2023-12-12T11:51:46.539 INFO:tasks.workunit.client.1.smithi093.stdout:1/375: chown d4/d1a/d1b/d26/d31/c67 0 1 2023-12-12T11:51:46.540 INFO:tasks.workunit.client.0.smithi063.stdout:2/123: getdents d0/d11 0 2023-12-12T11:51:46.540 INFO:tasks.workunit.client.0.smithi063.stdout:8/227: link d4/de/d32/d36/f3a d4/de/f43 0 2023-12-12T11:51:46.543 INFO:tasks.workunit.client.0.smithi063.stdout:8/228: write f0 [1773826,17367] 0 2023-12-12T11:51:46.543 INFO:tasks.workunit.client.0.smithi063.stdout:8/229: fsync d4/f42 0 2023-12-12T11:51:46.550 INFO:tasks.workunit.client.1.smithi093.stdout:0/401: rename d5/d4d/f6c to d5/f7d 0 2023-12-12T11:51:46.551 INFO:tasks.workunit.client.1.smithi093.stdout:0/402: write d5/d21/d27/d3a/f4a [4529712,101164] 0 2023-12-12T11:51:46.551 INFO:tasks.workunit.client.1.smithi093.stdout:0/403: write d5/d21/d27/d3a/f56 [2581081,1573] 0 2023-12-12T11:51:46.551 INFO:tasks.workunit.client.1.smithi093.stdout:0/404: fdatasync d5/dd/f35 0 2023-12-12T11:51:46.551 INFO:tasks.workunit.client.1.smithi093.stdout:0/405: truncate d5/dd/f16 5679329 0 2023-12-12T11:51:46.551 INFO:tasks.workunit.client.1.smithi093.stdout:0/406: stat d5/d21/d27/f5a 0 2023-12-12T11:51:46.551 INFO:tasks.workunit.client.1.smithi093.stdout:0/407: chown d5/d41/f61 477 1 2023-12-12T11:51:46.553 INFO:tasks.workunit.client.0.smithi063.stdout:9/156: dread d7/d11/d12/f18 [0,4194304] 0 2023-12-12T11:51:46.553 INFO:tasks.workunit.client.1.smithi093.stdout:5/308: read d0/d3b/f63 [963206,125355] 0 2023-12-12T11:51:46.553 INFO:tasks.workunit.client.1.smithi093.stdout:0/408: write d5/d21/d27/d3a/f67 [479374,111329] 0 2023-12-12T11:51:46.560 INFO:tasks.workunit.client.1.smithi093.stdout:4/558: symlink d0/d31/laa 0 2023-12-12T11:51:46.567 INFO:tasks.workunit.client.0.smithi063.stdout:6/174: creat d9/f40 x:0 0 0 2023-12-12T11:51:46.567 INFO:tasks.workunit.client.0.smithi063.stdout:4/203: write d2/d8/f12 [1634252,109139] 0 2023-12-12T11:51:46.567 INFO:tasks.workunit.client.0.smithi063.stdout:7/137: dwrite de/d22/f24 [0,4194304] 0 2023-12-12T11:51:46.567 INFO:tasks.workunit.client.0.smithi063.stdout:2/124: fsync d0/f20 0 2023-12-12T11:51:46.567 INFO:tasks.workunit.client.0.smithi063.stdout:5/150: dread d7/de/f1e [0,4194304] 0 2023-12-12T11:51:46.569 INFO:tasks.workunit.client.0.smithi063.stdout:4/204: symlink d2/d17/d41/l42 0 2023-12-12T11:51:46.570 INFO:tasks.workunit.client.1.smithi093.stdout:2/411: dwrite d5/d14/d2d/d12/d25/f30 [0,4194304] 0 2023-12-12T11:51:46.571 INFO:tasks.workunit.client.0.smithi063.stdout:1/150: write d3/f1a [1523399,28016] 0 2023-12-12T11:51:46.573 INFO:tasks.workunit.client.0.smithi063.stdout:3/117: dwrite d4/df/d1a/f20 [0,4194304] 0 2023-12-12T11:51:46.576 INFO:tasks.workunit.client.1.smithi093.stdout:6/510: creat d0/da/dbf/fc0 x:0 0 0 2023-12-12T11:51:46.576 INFO:tasks.workunit.client.1.smithi093.stdout:6/511: readlink d0/d7b/lb9 0 2023-12-12T11:51:46.576 INFO:tasks.workunit.client.1.smithi093.stdout:6/512: fsync d0/da/d32/d9e/d4d/f92 0 2023-12-12T11:51:46.576 INFO:tasks.workunit.client.1.smithi093.stdout:6/513: fdatasync d0/da/d32/d39/f91 0 2023-12-12T11:51:46.576 INFO:tasks.workunit.client.1.smithi093.stdout:6/514: chown d0/d52/d7e/faf 363 1 2023-12-12T11:51:46.577 INFO:tasks.workunit.client.0.smithi063.stdout:0/148: dwrite d0/d15/f2b [0,4194304] 0 2023-12-12T11:51:46.585 INFO:tasks.workunit.client.0.smithi063.stdout:7/138: symlink de/l32 0 2023-12-12T11:51:46.585 INFO:tasks.workunit.client.0.smithi063.stdout:7/139: write de/d22/f29 [248058,16082] 0 2023-12-12T11:51:46.588 INFO:tasks.workunit.client.0.smithi063.stdout:2/125: read d0/f14 [2109276,99228] 0 2023-12-12T11:51:46.588 INFO:tasks.workunit.client.0.smithi063.stdout:9/157: rmdir d7/d20 39 2023-12-12T11:51:46.589 INFO:tasks.workunit.client.0.smithi063.stdout:2/126: read d0/f17 [295,92077] 0 2023-12-12T11:51:46.589 INFO:tasks.workunit.client.0.smithi063.stdout:2/127: stat d0/f5 0 2023-12-12T11:51:46.592 INFO:tasks.workunit.client.0.smithi063.stdout:5/151: creat d7/d24/f2a x:0 0 0 2023-12-12T11:51:46.592 INFO:tasks.workunit.client.0.smithi063.stdout:5/152: dread - d7/d10/f1b zero size 2023-12-12T11:51:46.592 INFO:tasks.workunit.client.0.smithi063.stdout:5/153: chown d7/ff 3236275 1 2023-12-12T11:51:46.595 INFO:tasks.workunit.client.1.smithi093.stdout:9/340: rmdir d1/d12 39 2023-12-12T11:51:46.596 INFO:tasks.workunit.client.0.smithi063.stdout:6/175: write d9/f18 [260992,82825] 0 2023-12-12T11:51:46.597 INFO:tasks.workunit.client.0.smithi063.stdout:6/176: creat d9/d10/f41 x:0 0 0 2023-12-12T11:51:46.600 INFO:tasks.workunit.client.1.smithi093.stdout:1/376: mknod d4/d1a/d1b/d26/c7c 0 2023-12-12T11:51:46.600 INFO:tasks.workunit.client.1.smithi093.stdout:1/377: stat d4/d1c/l46 0 2023-12-12T11:51:46.601 INFO:tasks.workunit.client.1.smithi093.stdout:0/409: dwrite d5/d21/f2e [0,4194304] 0 2023-12-12T11:51:46.604 INFO:tasks.workunit.client.0.smithi063.stdout:1/151: mkdir d3/db/d16/d24/d30 0 2023-12-12T11:51:46.607 INFO:tasks.workunit.client.1.smithi093.stdout:8/385: rename d3/d8/f18 to d3/d1a/d1f/d59/d69/f7f 0 2023-12-12T11:51:46.607 INFO:tasks.workunit.client.1.smithi093.stdout:8/386: write d3/d1a/d1f/f2a [1541113,36008] 0 2023-12-12T11:51:46.608 INFO:tasks.workunit.client.1.smithi093.stdout:8/387: write d3/d1a/d1f/d29/d3a/d40/f62 [824056,71199] 0 2023-12-12T11:51:46.608 INFO:tasks.workunit.client.1.smithi093.stdout:8/388: dread - d3/d1a/d1f/d59/f6a zero size 2023-12-12T11:51:46.608 INFO:tasks.workunit.client.1.smithi093.stdout:8/389: creat d3/f80 x:0 0 0 2023-12-12T11:51:46.608 INFO:tasks.workunit.client.1.smithi093.stdout:8/390: creat d3/f81 x:0 0 0 2023-12-12T11:51:46.608 INFO:tasks.workunit.client.1.smithi093.stdout:8/391: write d3/f1c [178691,127191] 0 2023-12-12T11:51:46.612 INFO:tasks.workunit.client.1.smithi093.stdout:5/309: mkdir d0/d7/d59/d35/d6a 0 2023-12-12T11:51:46.612 INFO:tasks.workunit.client.1.smithi093.stdout:5/310: chown d0/d7/d36/l5b 48 1 2023-12-12T11:51:46.616 INFO:tasks.workunit.client.0.smithi063.stdout:5/154: read d7/de/f1e [394776,99694] 0 2023-12-12T11:51:46.616 INFO:tasks.workunit.client.0.smithi063.stdout:5/155: fdatasync d7/f1a 0 2023-12-12T11:51:46.621 INFO:tasks.workunit.client.0.smithi063.stdout:0/149: creat d0/d7/f31 x:0 0 0 2023-12-12T11:51:46.622 INFO:tasks.workunit.client.0.smithi063.stdout:0/150: creat d0/d1a/f32 x:0 0 0 2023-12-12T11:51:46.625 INFO:tasks.workunit.client.0.smithi063.stdout:7/140: mkdir de/d33 0 2023-12-12T11:51:46.626 INFO:tasks.workunit.client.0.smithi063.stdout:7/141: write de/d22/f29 [899008,96307] 0 2023-12-12T11:51:46.628 INFO:tasks.workunit.client.0.smithi063.stdout:9/158: symlink d7/d11/d12/d30/l32 0 2023-12-12T11:51:46.636 INFO:tasks.workunit.client.0.smithi063.stdout:8/230: dwrite d4/de/d32/d36/f3a [0,4194304] 0 2023-12-12T11:51:46.636 INFO:tasks.workunit.client.0.smithi063.stdout:2/128: creat d0/d1a/d26/f29 x:0 0 0 2023-12-12T11:51:46.639 INFO:tasks.workunit.client.0.smithi063.stdout:7/142: dread de/f1a [0,4194304] 0 2023-12-12T11:51:46.641 INFO:tasks.workunit.client.0.smithi063.stdout:4/205: getdents d2 0 2023-12-12T11:51:46.650 INFO:tasks.workunit.client.1.smithi093.stdout:2/412: write d5/d46/d55/f6a [116140,18277] 0 2023-12-12T11:51:46.650 INFO:tasks.workunit.client.1.smithi093.stdout:2/413: chown d5/d14/d2d/d4c/d54/d67/l71 290 1 2023-12-12T11:51:46.652 INFO:tasks.workunit.client.0.smithi063.stdout:1/152: mknod d3/db/d16/c31 0 2023-12-12T11:51:46.652 INFO:tasks.workunit.client.0.smithi063.stdout:1/153: chown d3/db/d12/f27 4097209 1 2023-12-12T11:51:46.652 INFO:tasks.workunit.client.1.smithi093.stdout:5/311: dwrite d0/d3b/f63 [0,4194304] 0 2023-12-12T11:51:46.656 INFO:tasks.workunit.client.1.smithi093.stdout:9/341: creat d1/d12/d1f/d73/f75 x:0 0 0 2023-12-12T11:51:46.656 INFO:tasks.workunit.client.1.smithi093.stdout:9/342: chown d1/d23/d24/d29/d43/d56/d68 55914 1 2023-12-12T11:51:46.657 INFO:tasks.workunit.client.0.smithi063.stdout:6/177: dwrite d9/f3b [0,4194304] 0 2023-12-12T11:51:46.658 INFO:tasks.workunit.client.0.smithi063.stdout:5/156: truncate d7/ff 3488145 0 2023-12-12T11:51:46.658 INFO:tasks.workunit.client.0.smithi063.stdout:5/157: chown d7/f26 3201837 1 2023-12-12T11:51:46.660 INFO:tasks.workunit.client.1.smithi093.stdout:1/378: rmdir d4/dc 39 2023-12-12T11:51:46.661 INFO:tasks.workunit.client.0.smithi063.stdout:3/118: mkdir d4/d23 0 2023-12-12T11:51:46.671 INFO:tasks.workunit.client.0.smithi063.stdout:1/154: dread d3/db/fe [0,4194304] 0 2023-12-12T11:51:46.676 INFO:tasks.workunit.client.1.smithi093.stdout:0/410: mkdir d5/d21/d2f/d54/d7e 0 2023-12-12T11:51:46.676 INFO:tasks.workunit.client.1.smithi093.stdout:0/411: stat d5/f40 0 2023-12-12T11:51:46.676 INFO:tasks.workunit.client.1.smithi093.stdout:0/412: readlink d5/dd/l11 0 2023-12-12T11:51:46.676 INFO:tasks.workunit.client.1.smithi093.stdout:0/413: fdatasync d5/d21/f2e 0 2023-12-12T11:51:46.676 INFO:tasks.workunit.client.1.smithi093.stdout:0/414: dread - d5/dd/f35 zero size 2023-12-12T11:51:46.679 INFO:tasks.workunit.client.0.smithi063.stdout:5/158: dread d7/f15 [0,4194304] 0 2023-12-12T11:51:46.680 INFO:tasks.workunit.client.1.smithi093.stdout:7/348: rename da/d15/f6f to da/d2e/f79 0 2023-12-12T11:51:46.690 INFO:tasks.workunit.client.0.smithi063.stdout:9/159: dread d7/f2b [0,4194304] 0 2023-12-12T11:51:46.690 INFO:tasks.workunit.client.0.smithi063.stdout:9/160: fdatasync d7/f9 0 2023-12-12T11:51:46.690 INFO:tasks.workunit.client.0.smithi063.stdout:9/161: creat d7/d15/f33 x:0 0 0 2023-12-12T11:51:46.691 INFO:tasks.workunit.client.0.smithi063.stdout:9/162: write d7/f19 [14208,77782] 0 2023-12-12T11:51:46.691 INFO:tasks.workunit.client.0.smithi063.stdout:9/163: readlink d7/d11/l16 0 2023-12-12T11:51:46.691 INFO:tasks.workunit.client.0.smithi063.stdout:5/159: dread d7/f15 [0,4194304] 0 2023-12-12T11:51:46.698 INFO:tasks.workunit.client.1.smithi093.stdout:2/414: dwrite d5/d14/d27/f36 [0,4194304] 0 2023-12-12T11:51:46.699 INFO:tasks.workunit.client.1.smithi093.stdout:8/392: mknod d3/d73/c82 0 2023-12-12T11:51:46.699 INFO:tasks.workunit.client.1.smithi093.stdout:8/393: chown d3/d1a/d1f/d59/f6a 287364 1 2023-12-12T11:51:46.699 INFO:tasks.workunit.client.1.smithi093.stdout:8/394: chown d3/d1a/d1f/d29/d30/d58/d76 11 1 2023-12-12T11:51:46.700 INFO:tasks.workunit.client.0.smithi063.stdout:8/231: symlink d4/de/d3b/l44 0 2023-12-12T11:51:46.700 INFO:tasks.workunit.client.0.smithi063.stdout:2/129: mknod d0/d1a/d1e/c2a 0 2023-12-12T11:51:46.700 INFO:tasks.workunit.client.0.smithi063.stdout:4/206: creat d2/d8/f43 x:0 0 0 2023-12-12T11:51:46.700 INFO:tasks.workunit.client.0.smithi063.stdout:7/143: mkdir de/d34 0 2023-12-12T11:51:46.703 INFO:tasks.workunit.client.1.smithi093.stdout:1/379: creat d4/d1a/d1b/d26/f7d x:0 0 0 2023-12-12T11:51:46.703 INFO:tasks.workunit.client.1.smithi093.stdout:1/380: fdatasync d4/dc/f41 0 2023-12-12T11:51:46.703 INFO:tasks.workunit.client.1.smithi093.stdout:1/381: chown d4/c30 1 1 2023-12-12T11:51:46.708 INFO:tasks.workunit.client.0.smithi063.stdout:7/144: write de/f1a [1051029,13819] 0 2023-12-12T11:51:46.719 INFO:tasks.workunit.client.0.smithi063.stdout:4/207: dread d2/d8/f37 [0,4194304] 0 2023-12-12T11:51:46.726 INFO:tasks.workunit.client.1.smithi093.stdout:1/382: dread d4/f25 [0,4194304] 0 2023-12-12T11:51:46.726 INFO:tasks.workunit.client.1.smithi093.stdout:1/383: chown d4/d1a/d1b/d26 57 1 2023-12-12T11:51:46.727 INFO:tasks.workunit.client.0.smithi063.stdout:6/178: unlink f0 0 2023-12-12T11:51:46.731 INFO:tasks.workunit.client.1.smithi093.stdout:0/415: unlink d5/c23 0 2023-12-12T11:51:46.735 INFO:tasks.workunit.client.1.smithi093.stdout:8/395: dread d3/d8/f7d [0,4194304] 0 2023-12-12T11:51:46.736 INFO:tasks.workunit.client.1.smithi093.stdout:4/559: rename d0/d31/l2a to d0/d31/d89/da1/lab 0 2023-12-12T11:51:46.737 INFO:tasks.workunit.client.1.smithi093.stdout:4/560: fdatasync d0/f27 0 2023-12-12T11:51:46.741 INFO:tasks.workunit.client.1.smithi093.stdout:4/561: write d0/d36/f50 [1298857,107069] 0 2023-12-12T11:51:46.746 INFO:tasks.workunit.client.0.smithi063.stdout:3/119: unlink d4/fb 0 2023-12-12T11:51:46.746 INFO:tasks.workunit.client.0.smithi063.stdout:1/155: dwrite d3/db/d16/d24/f2a [0,4194304] 0 2023-12-12T11:51:46.764 INFO:tasks.workunit.client.0.smithi063.stdout:0/151: link d0/d7/d27/d1f/f30 d0/d7/d27/f33 0 2023-12-12T11:51:46.765 INFO:tasks.workunit.client.1.smithi093.stdout:3/386: sync 2023-12-12T11:51:46.765 INFO:tasks.workunit.client.1.smithi093.stdout:3/387: write df/d36/d3d/d59/f5c [2007067,87518] 0 2023-12-12T11:51:46.767 INFO:tasks.workunit.client.1.smithi093.stdout:2/415: creat d5/d14/d47/d4e/f8a x:0 0 0 2023-12-12T11:51:46.773 INFO:tasks.workunit.client.0.smithi063.stdout:9/164: truncate d7/d15/f1d 3477735 0 2023-12-12T11:51:46.778 INFO:tasks.workunit.client.1.smithi093.stdout:1/384: truncate d4/dc/f5c 1720932 0 2023-12-12T11:51:46.783 INFO:tasks.workunit.client.1.smithi093.stdout:8/396: dwrite d3/d1a/d1f/d29/d63/f65 [0,4194304] 0 2023-12-12T11:51:46.783 INFO:tasks.workunit.client.1.smithi093.stdout:8/397: fsync d3/d1a/d1f/d29/d3a/d40/f61 0 2023-12-12T11:51:46.784 INFO:tasks.workunit.client.1.smithi093.stdout:8/398: creat d3/d1a/f83 x:0 0 0 2023-12-12T11:51:46.795 INFO:tasks.workunit.client.0.smithi063.stdout:0/152: dread d0/f21 [0,4194304] 0 2023-12-12T11:51:46.796 INFO:tasks.workunit.client.1.smithi093.stdout:8/399: dread d3/d1a/d1f/d29/f32 [0,4194304] 0 2023-12-12T11:51:46.797 INFO:tasks.workunit.client.0.smithi063.stdout:0/153: chown d0/d1a/d23/l2a 62535 1 2023-12-12T11:51:46.797 INFO:tasks.workunit.client.0.smithi063.stdout:7/145: dwrite de/f21 [4194304,4194304] 0 2023-12-12T11:51:46.797 INFO:tasks.workunit.client.0.smithi063.stdout:7/146: fdatasync de/d22/d2b/f2d 0 2023-12-12T11:51:46.797 INFO:tasks.workunit.client.0.smithi063.stdout:7/147: stat de/d33 0 2023-12-12T11:51:46.797 INFO:tasks.workunit.client.0.smithi063.stdout:0/154: dread - d0/d7/d27/f33 zero size 2023-12-12T11:51:46.797 INFO:tasks.workunit.client.0.smithi063.stdout:0/155: readlink d0/d7/la 0 2023-12-12T11:51:46.797 INFO:tasks.workunit.client.0.smithi063.stdout:0/156: dread - d0/d1a/f32 zero size 2023-12-12T11:51:46.800 INFO:tasks.workunit.client.1.smithi093.stdout:0/416: mknod d5/dd/d62/c7f 0 2023-12-12T11:51:46.801 INFO:tasks.workunit.client.0.smithi063.stdout:5/160: mkdir d7/d10/d2b 0 2023-12-12T11:51:46.802 INFO:tasks.workunit.client.0.smithi063.stdout:8/232: mkdir d4/d24/d38/d45 0 2023-12-12T11:51:46.802 INFO:tasks.workunit.client.0.smithi063.stdout:5/161: truncate d7/d24/f2a 799894 0 2023-12-12T11:51:46.804 INFO:tasks.workunit.client.0.smithi063.stdout:8/233: write d4/f42 [919316,129026] 0 2023-12-12T11:51:46.805 INFO:tasks.workunit.client.0.smithi063.stdout:8/234: readlink d4/lc 0 2023-12-12T11:51:46.815 INFO:tasks.workunit.client.1.smithi093.stdout:2/416: write d5/d14/d2d/f1e [1715584,5821] 0 2023-12-12T11:51:46.817 INFO:tasks.workunit.client.0.smithi063.stdout:2/130: mknod d0/c2b 0 2023-12-12T11:51:46.817 INFO:tasks.workunit.client.0.smithi063.stdout:2/131: write d0/f4 [3313864,31064] 0 2023-12-12T11:51:46.817 INFO:tasks.workunit.client.0.smithi063.stdout:2/132: readlink d0/l12 0 2023-12-12T11:51:46.819 INFO:tasks.workunit.client.1.smithi093.stdout:6/515: rename d0/d52/d7e/c88 to d0/da/d14/cc1 0 2023-12-12T11:51:46.820 INFO:tasks.workunit.client.0.smithi063.stdout:4/208: read - d2/d8/d14/f30 zero size 2023-12-12T11:51:46.820 INFO:tasks.workunit.client.1.smithi093.stdout:6/516: write d0/da/d14/d21/fa5 [776127,51988] 0 2023-12-12T11:51:46.820 INFO:tasks.workunit.client.1.smithi093.stdout:6/517: write d0/da/d14/f72 [1332648,58103] 0 2023-12-12T11:51:46.838 INFO:tasks.workunit.client.1.smithi093.stdout:7/349: rmdir da/d15/d19 39 2023-12-12T11:51:46.838 INFO:tasks.workunit.client.1.smithi093.stdout:7/350: chown da/de/d46/l60 6 1 2023-12-12T11:51:46.838 INFO:tasks.workunit.client.1.smithi093.stdout:4/562: link d0/d31/c69 d0/d87/d79/d86/da9/cac 0 2023-12-12T11:51:46.839 INFO:tasks.workunit.client.0.smithi063.stdout:9/165: dwrite d7/d15/f17 [0,4194304] 0 2023-12-12T11:51:46.839 INFO:tasks.workunit.client.0.smithi063.stdout:3/120: truncate d4/df/f19 2816629 0 2023-12-12T11:51:46.841 INFO:tasks.workunit.client.1.smithi093.stdout:4/563: creat d0/fad x:0 0 0 2023-12-12T11:51:46.851 INFO:tasks.workunit.client.0.smithi063.stdout:1/156: creat d3/db/d16/f32 x:0 0 0 2023-12-12T11:51:46.851 INFO:tasks.workunit.client.0.smithi063.stdout:1/157: chown d3/db/d16/c31 180137232 1 2023-12-12T11:51:46.859 INFO:tasks.workunit.client.1.smithi093.stdout:3/388: symlink df/d22/l7c 0 2023-12-12T11:51:46.864 INFO:tasks.workunit.client.0.smithi063.stdout:3/121: write d4/df/d1a/f20 [947003,48696] 0 2023-12-12T11:51:46.866 INFO:tasks.workunit.client.1.smithi093.stdout:1/385: creat d4/d1a/d1b/d26/d31/f7e x:0 0 0 2023-12-12T11:51:46.867 INFO:tasks.workunit.client.0.smithi063.stdout:0/157: mkdir d0/d1a/d23/d34 0 2023-12-12T11:51:46.867 INFO:tasks.workunit.client.0.smithi063.stdout:0/158: write d0/d1a/f1c [113815,95903] 0 2023-12-12T11:51:46.870 INFO:tasks.workunit.client.0.smithi063.stdout:8/235: dread d4/de/d32/d36/f3a [0,4194304] 0 2023-12-12T11:51:46.870 INFO:tasks.workunit.client.0.smithi063.stdout:8/236: dread - d4/d24/f31 zero size 2023-12-12T11:51:46.870 INFO:tasks.workunit.client.0.smithi063.stdout:8/237: fdatasync d4/f17 0 2023-12-12T11:51:46.875 INFO:tasks.workunit.client.1.smithi093.stdout:6/518: dwrite d0/da/d14/d3a/f6a [0,4194304] 0 2023-12-12T11:51:46.875 INFO:tasks.workunit.client.1.smithi093.stdout:6/519: chown d0/d52/d7e/d42/c57 0 1 2023-12-12T11:51:46.875 INFO:tasks.workunit.client.1.smithi093.stdout:6/520: chown d0/d52/c9b 797364 1 2023-12-12T11:51:46.876 INFO:tasks.workunit.client.1.smithi093.stdout:6/521: chown d0/da/d14/d38/c59 3652769 1 2023-12-12T11:51:46.876 INFO:tasks.workunit.client.0.smithi063.stdout:6/179: dwrite d9/d10/d2a/f3e [0,4194304] 0 2023-12-12T11:51:46.877 INFO:tasks.workunit.client.0.smithi063.stdout:5/162: mknod d7/c2c 0 2023-12-12T11:51:46.877 INFO:tasks.workunit.client.0.smithi063.stdout:5/163: write d7/f29 [303073,86740] 0 2023-12-12T11:51:46.877 INFO:tasks.workunit.client.0.smithi063.stdout:5/164: creat d7/d24/f2d x:0 0 0 2023-12-12T11:51:46.878 INFO:tasks.workunit.client.1.smithi093.stdout:3/389: write df/d36/d3d/d6f/f7a [5351730,35074] 0 2023-12-12T11:51:46.879 INFO:tasks.workunit.client.0.smithi063.stdout:7/148: dwrite de/f19 [0,4194304] 0 2023-12-12T11:51:46.886 INFO:tasks.workunit.client.0.smithi063.stdout:2/133: getdents d0/d1a/d1e 0 2023-12-12T11:51:46.913 INFO:tasks.workunit.client.0.smithi063.stdout:8/238: dread d4/d29/f34 [0,4194304] 0 2023-12-12T11:51:46.922 INFO:tasks.workunit.client.1.smithi093.stdout:8/400: mknod d3/d1a/d1f/d75/c84 0 2023-12-12T11:51:46.922 INFO:tasks.workunit.client.0.smithi063.stdout:1/158: symlink d3/db/d16/d17/l33 0 2023-12-12T11:51:46.925 INFO:tasks.workunit.client.1.smithi093.stdout:0/417: symlink d5/d78/l80 0 2023-12-12T11:51:46.928 INFO:tasks.workunit.client.0.smithi063.stdout:2/134: dread d0/f4 [0,4194304] 0 2023-12-12T11:51:46.935 INFO:tasks.workunit.client.0.smithi063.stdout:3/122: dread d4/df/d1a/f20 [0,4194304] 0 2023-12-12T11:51:46.936 INFO:tasks.workunit.client.0.smithi063.stdout:8/239: dread d4/f42 [0,4194304] 0 2023-12-12T11:51:46.936 INFO:tasks.workunit.client.0.smithi063.stdout:8/240: stat d4/f17 0 2023-12-12T11:51:46.936 INFO:tasks.workunit.client.0.smithi063.stdout:8/241: stat d4/de/d1e/l1f 0 2023-12-12T11:51:46.937 INFO:tasks.workunit.client.1.smithi093.stdout:2/417: mkdir d5/d14/d2d/d8b 0 2023-12-12T11:51:46.939 INFO:tasks.workunit.client.1.smithi093.stdout:5/312: rename d0/d7/c52 to d0/d7/d36/d29/c6b 0 2023-12-12T11:51:46.940 INFO:tasks.workunit.client.1.smithi093.stdout:5/313: creat d0/d7/d59/d48/f6c x:0 0 0 2023-12-12T11:51:46.941 INFO:tasks.workunit.client.0.smithi063.stdout:9/166: dwrite d7/f9 [0,4194304] 0 2023-12-12T11:51:46.942 INFO:tasks.workunit.client.0.smithi063.stdout:9/167: write d7/d11/d12/f18 [1205572,22015] 0 2023-12-12T11:51:46.948 INFO:tasks.workunit.client.0.smithi063.stdout:7/149: dwrite f4 [0,4194304] 0 2023-12-12T11:51:46.952 INFO:tasks.workunit.client.0.smithi063.stdout:0/159: rename d0/d15/l26 to d0/d7/d27/d1f/l35 0 2023-12-12T11:51:46.959 INFO:tasks.workunit.client.1.smithi093.stdout:4/564: creat d0/d31/d5c/d6c/d93/fae x:0 0 0 2023-12-12T11:51:46.962 INFO:tasks.workunit.client.0.smithi063.stdout:3/123: dread d4/f6 [0,4194304] 0 2023-12-12T11:51:46.962 INFO:tasks.workunit.client.0.smithi063.stdout:3/124: chown d4/f15 362 1 2023-12-12T11:51:46.962 INFO:tasks.workunit.client.0.smithi063.stdout:3/125: dread - d4/df/d1a/f22 zero size 2023-12-12T11:51:46.963 INFO:tasks.workunit.client.1.smithi093.stdout:7/351: creat da/d15/d19/d4c/f7a x:0 0 0 2023-12-12T11:51:46.975 INFO:tasks.workunit.client.1.smithi093.stdout:1/386: link d4/d1c/c69 d4/d1a/d1b/c7f 0 2023-12-12T11:51:46.976 INFO:tasks.workunit.client.1.smithi093.stdout:3/390: creat df/d22/d49/d69/d78/f7d x:0 0 0 2023-12-12T11:51:46.978 INFO:tasks.workunit.client.0.smithi063.stdout:6/180: mknod d9/c42 0 2023-12-12T11:51:46.978 INFO:tasks.workunit.client.0.smithi063.stdout:6/181: creat d9/f43 x:0 0 0 2023-12-12T11:51:46.983 INFO:tasks.workunit.client.1.smithi093.stdout:8/401: link d3/d1a/d1f/d29/d3a/d40/f62 d3/d1a/d1f/d29/d30/d58/f85 0 2023-12-12T11:51:46.985 INFO:tasks.workunit.client.1.smithi093.stdout:0/418: symlink d5/dd/d14/d26/d58/d64/d6f/l81 0 2023-12-12T11:51:46.989 INFO:tasks.workunit.client.1.smithi093.stdout:2/418: mkdir d5/d14/d2d/d8b/d8c 0 2023-12-12T11:51:47.014 INFO:tasks.workunit.client.1.smithi093.stdout:8/402: dread d3/d1a/d1f/d29/f43 [0,4194304] 0 2023-12-12T11:51:47.015 INFO:tasks.workunit.client.1.smithi093.stdout:8/403: fdatasync d3/f74 0 2023-12-12T11:51:47.019 INFO:tasks.workunit.client.1.smithi093.stdout:4/565: dwrite d0/f54 [0,4194304] 0 2023-12-12T11:51:47.020 INFO:tasks.workunit.client.1.smithi093.stdout:4/566: truncate d0/d31/d5c/d6c/d93/fae 971205 0 2023-12-12T11:51:47.031 INFO:tasks.workunit.client.0.smithi063.stdout:3/126: dwrite d4/f7 [4194304,4194304] 0 2023-12-12T11:51:47.035 INFO:tasks.workunit.client.1.smithi093.stdout:1/387: dwrite d4/f3c [4194304,4194304] 0 2023-12-12T11:51:47.035 INFO:tasks.workunit.client.1.smithi093.stdout:1/388: write d4/d1a/d1b/d26/d65/f7b [780356,7077] 0 2023-12-12T11:51:47.039 INFO:tasks.workunit.client.1.smithi093.stdout:8/404: write d3/d1a/f33 [1977984,35859] 0 2023-12-12T11:51:47.070 INFO:tasks.workunit.client.1.smithi093.stdout:6/522: rename d0/f96 to d0/d52/dbc/fc2 0 2023-12-12T11:51:47.081 INFO:tasks.workunit.client.1.smithi093.stdout:8/405: dwrite d3/d1a/d1f/f2f [0,4194304] 0 2023-12-12T11:51:47.081 INFO:tasks.workunit.client.1.smithi093.stdout:8/406: chown d3/d1a/d1f/d29/f43 74450630 1 2023-12-12T11:51:47.096 INFO:tasks.workunit.client.1.smithi093.stdout:9/343: sync 2023-12-12T11:51:47.096 INFO:tasks.workunit.client.1.smithi093.stdout:9/344: creat d1/d12/d1f/d73/f76 x:0 0 0 2023-12-12T11:51:47.096 INFO:tasks.workunit.client.1.smithi093.stdout:9/345: write d1/d12/d1f/d32/f3b [1008639,8413] 0 2023-12-12T11:51:47.097 INFO:tasks.workunit.client.1.smithi093.stdout:1/389: dwrite d4/dc/f33 [0,4194304] 0 2023-12-12T11:51:47.105 INFO:tasks.workunit.client.0.smithi063.stdout:2/135: link d0/d11/c19 d0/d11/c2c 0 2023-12-12T11:51:47.105 INFO:tasks.workunit.client.0.smithi063.stdout:2/136: write d0/f15 [895433,55598] 0 2023-12-12T11:51:47.110 INFO:tasks.workunit.client.0.smithi063.stdout:8/242: link d4/d24/c37 d4/d24/d38/d45/c46 0 2023-12-12T11:51:47.112 INFO:tasks.workunit.client.0.smithi063.stdout:9/168: mkdir d7/d34 0 2023-12-12T11:51:47.118 INFO:tasks.workunit.client.0.smithi063.stdout:3/127: dwrite d4/df/f19 [0,4194304] 0 2023-12-12T11:51:47.122 INFO:tasks.workunit.client.0.smithi063.stdout:7/150: mknod de/d33/c35 0 2023-12-12T11:51:47.123 INFO:tasks.workunit.client.0.smithi063.stdout:9/169: dread d7/f14 [0,4194304] 0 2023-12-12T11:51:47.124 INFO:tasks.workunit.client.0.smithi063.stdout:9/170: readlink d7/lb 0 2023-12-12T11:51:47.128 INFO:tasks.workunit.client.1.smithi093.stdout:6/523: dwrite d0/f11 [0,4194304] 0 2023-12-12T11:51:47.131 INFO:tasks.workunit.client.0.smithi063.stdout:0/160: mknod d0/d1a/d23/c36 0 2023-12-12T11:51:47.131 INFO:tasks.workunit.client.0.smithi063.stdout:0/161: chown d0/d1a 5268 1 2023-12-12T11:51:47.131 INFO:tasks.workunit.client.1.smithi093.stdout:8/407: dwrite d3/d1a/d1f/f47 [0,4194304] 0 2023-12-12T11:51:47.146 INFO:tasks.workunit.client.0.smithi063.stdout:6/182: mkdir d9/d10/d2a/d44 0 2023-12-12T11:51:47.152 INFO:tasks.workunit.client.0.smithi063.stdout:0/162: write d0/f21 [2949701,14339] 0 2023-12-12T11:51:47.152 INFO:tasks.workunit.client.0.smithi063.stdout:0/163: truncate d0/d1a/f32 981068 0 2023-12-12T11:51:47.152 INFO:tasks.workunit.client.0.smithi063.stdout:0/164: chown d0/d1a/d23/l2a 29418 1 2023-12-12T11:51:47.154 INFO:tasks.workunit.client.0.smithi063.stdout:3/128: read d4/f7 [5489363,78618] 0 2023-12-12T11:51:47.165 INFO:tasks.workunit.client.0.smithi063.stdout:2/137: link d0/d1a/d26/l28 d0/d1a/l2d 0 2023-12-12T11:51:47.174 INFO:tasks.workunit.client.0.smithi063.stdout:8/243: rename d4/la to d4/d24/d38/l47 0 2023-12-12T11:51:47.176 INFO:tasks.workunit.client.0.smithi063.stdout:3/129: dread d4/f7 [4194304,4194304] 0 2023-12-12T11:51:47.176 INFO:tasks.workunit.client.0.smithi063.stdout:3/130: read d4/df/d1a/f20 [3027140,124417] 0 2023-12-12T11:51:47.197 INFO:tasks.workunit.client.0.smithi063.stdout:7/151: dwrite de/d22/d2b/f2d [0,4194304] 0 2023-12-12T11:51:47.212 INFO:tasks.workunit.client.0.smithi063.stdout:2/138: dwrite d0/f20 [0,4194304] 0 2023-12-12T11:51:47.223 INFO:tasks.workunit.client.0.smithi063.stdout:8/244: dwrite d4/de/d1e/f33 [0,4194304] 0 2023-12-12T11:51:47.234 INFO:tasks.workunit.client.1.smithi093.stdout:4/567: creat d0/d36/d49/faf x:0 0 0 2023-12-12T11:51:47.245 INFO:tasks.workunit.client.0.smithi063.stdout:6/183: symlink d9/l45 0 2023-12-12T11:51:47.245 INFO:tasks.workunit.client.0.smithi063.stdout:6/184: fsync d9/f32 0 2023-12-12T11:51:47.254 INFO:tasks.workunit.client.0.smithi063.stdout:9/171: rename d7/d34 to d7/d20/d35 0 2023-12-12T11:51:47.268 INFO:tasks.workunit.client.0.smithi063.stdout:7/152: link de/l32 de/l36 0 2023-12-12T11:51:47.269 INFO:tasks.workunit.client.0.smithi063.stdout:9/172: dread d7/d11/f25 [0,4194304] 0 2023-12-12T11:51:47.270 INFO:tasks.workunit.client.0.smithi063.stdout:9/173: dread - d7/d11/f2d zero size 2023-12-12T11:51:47.270 INFO:tasks.workunit.client.0.smithi063.stdout:9/174: fsync d7/d15/f17 0 2023-12-12T11:51:47.274 INFO:tasks.workunit.client.1.smithi093.stdout:4/568: dwrite d0/f14 [0,4194304] 0 2023-12-12T11:51:47.289 INFO:tasks.workunit.client.1.smithi093.stdout:4/569: dread d0/d31/f3b [4194304,4194304] 0 2023-12-12T11:51:47.290 INFO:tasks.workunit.client.0.smithi063.stdout:8/245: symlink d4/l48 0 2023-12-12T11:51:47.293 INFO:tasks.workunit.client.0.smithi063.stdout:9/175: dread f6 [0,4194304] 0 2023-12-12T11:51:47.296 INFO:tasks.workunit.client.0.smithi063.stdout:6/185: symlink d9/d10/l46 0 2023-12-12T11:51:47.296 INFO:tasks.workunit.client.0.smithi063.stdout:6/186: creat d9/d10/f47 x:0 0 0 2023-12-12T11:51:47.297 INFO:tasks.workunit.client.0.smithi063.stdout:0/165: getdents d0/d1a 0 2023-12-12T11:51:47.297 INFO:tasks.workunit.client.0.smithi063.stdout:0/166: write d0/d7/d27/d1f/f2c [457193,14900] 0 2023-12-12T11:51:47.300 INFO:tasks.workunit.client.1.smithi093.stdout:9/346: getdents d1/d12/d3e 0 2023-12-12T11:51:47.300 INFO:tasks.workunit.client.1.smithi093.stdout:9/347: dread - d1/d12/d1f/d3d/d57/f66 zero size 2023-12-12T11:51:47.303 INFO:tasks.workunit.client.0.smithi063.stdout:3/131: truncate d4/df/d1a/f20 3993143 0 2023-12-12T11:51:47.305 INFO:tasks.workunit.client.0.smithi063.stdout:7/153: symlink de/d22/d2b/l37 0 2023-12-12T11:51:47.308 INFO:tasks.workunit.client.1.smithi093.stdout:4/570: dread d0/d31/f2c [0,4194304] 0 2023-12-12T11:51:47.308 INFO:tasks.workunit.client.1.smithi093.stdout:4/571: chown d0/d36/l80 40436516 1 2023-12-12T11:51:47.310 INFO:tasks.workunit.client.0.smithi063.stdout:8/246: symlink d4/de/d32/d36/l49 0 2023-12-12T11:51:47.319 INFO:tasks.workunit.client.0.smithi063.stdout:3/132: read d4/df/f19 [2680083,113648] 0 2023-12-12T11:51:47.320 INFO:tasks.workunit.client.0.smithi063.stdout:6/187: unlink d9/d10/f23 0 2023-12-12T11:51:47.324 INFO:tasks.workunit.client.0.smithi063.stdout:0/167: rename d0/d1a/l1b to d0/d1a/l37 0 2023-12-12T11:51:47.325 INFO:tasks.workunit.client.0.smithi063.stdout:0/168: chown d0/l5 1852237 1 2023-12-12T11:51:47.330 INFO:tasks.workunit.client.1.smithi093.stdout:6/524: creat d0/da/d14/d38/fc3 x:0 0 0 2023-12-12T11:51:47.331 INFO:tasks.workunit.client.0.smithi063.stdout:7/154: truncate de/f1e 67315 0 2023-12-12T11:51:47.332 INFO:tasks.workunit.client.0.smithi063.stdout:8/247: stat d4/de/l10 0 2023-12-12T11:51:47.338 INFO:tasks.workunit.client.0.smithi063.stdout:3/133: creat d4/d23/f24 x:0 0 0 2023-12-12T11:51:47.341 INFO:tasks.workunit.client.0.smithi063.stdout:6/188: rename d9/d10/c17 to d9/d2c/c48 0 2023-12-12T11:51:47.342 INFO:tasks.workunit.client.1.smithi093.stdout:8/408: truncate d3/d1a/d1f/d29/f32 58149 0 2023-12-12T11:51:47.342 INFO:tasks.workunit.client.1.smithi093.stdout:8/409: write d3/f42 [4445171,12898] 0 2023-12-12T11:51:47.342 INFO:tasks.workunit.client.1.smithi093.stdout:8/410: fsync d3/d1a/d1f/d29/d3a/f55 0 2023-12-12T11:51:47.344 INFO:tasks.workunit.client.0.smithi063.stdout:0/169: mknod d0/d1a/d23/d2e/c38 0 2023-12-12T11:51:47.347 INFO:tasks.workunit.client.1.smithi093.stdout:9/348: unlink d1/d12/d1f/d73/f75 0 2023-12-12T11:51:47.349 INFO:tasks.workunit.client.0.smithi063.stdout:7/155: symlink de/d33/l38 0 2023-12-12T11:51:47.353 INFO:tasks.workunit.client.0.smithi063.stdout:8/248: write d4/de/f43 [1450189,114967] 0 2023-12-12T11:51:47.353 INFO:tasks.workunit.client.1.smithi093.stdout:6/525: symlink d0/da/d14/d9c/lc4 0 2023-12-12T11:51:47.353 INFO:tasks.workunit.client.1.smithi093.stdout:6/526: fsync d0/da/d32/d39/d5b/fa2 0 2023-12-12T11:51:47.358 INFO:tasks.workunit.client.0.smithi063.stdout:7/156: mkdir de/d39 0 2023-12-12T11:51:47.361 INFO:tasks.workunit.client.1.smithi093.stdout:9/349: dread d1/d12/f1a [0,4194304] 0 2023-12-12T11:51:47.369 INFO:tasks.workunit.client.1.smithi093.stdout:8/411: truncate d3/d8/fc 509659 0 2023-12-12T11:51:47.373 INFO:tasks.workunit.client.0.smithi063.stdout:8/249: rmdir d4/d24/d38 39 2023-12-12T11:51:47.376 INFO:tasks.workunit.client.1.smithi093.stdout:6/527: rmdir d0/da/d14/d38/d69 39 2023-12-12T11:51:47.376 INFO:tasks.workunit.client.1.smithi093.stdout:6/528: creat d0/d52/d7e/d42/fc5 x:0 0 0 2023-12-12T11:51:47.376 INFO:tasks.workunit.client.1.smithi093.stdout:6/529: fdatasync d0/d52/d7e/f67 0 2023-12-12T11:51:47.377 INFO:tasks.workunit.client.1.smithi093.stdout:6/530: fsync d0/d52/d7e/f3f 0 2023-12-12T11:51:47.377 INFO:tasks.workunit.client.1.smithi093.stdout:6/531: creat d0/da/d14/d9c/fc6 x:0 0 0 2023-12-12T11:51:47.377 INFO:tasks.workunit.client.1.smithi093.stdout:6/532: write d0/f44 [419287,125670] 0 2023-12-12T11:51:47.377 INFO:tasks.workunit.client.1.smithi093.stdout:6/533: creat d0/da/d14/d21/fc7 x:0 0 0 2023-12-12T11:51:47.380 INFO:tasks.workunit.client.0.smithi063.stdout:3/134: link d4/df/f1e d4/f25 0 2023-12-12T11:51:47.380 INFO:tasks.workunit.client.0.smithi063.stdout:7/157: mknod de/d39/c3a 0 2023-12-12T11:51:47.382 INFO:tasks.workunit.client.0.smithi063.stdout:8/250: truncate d4/f17 205669 0 2023-12-12T11:51:47.388 INFO:tasks.workunit.client.1.smithi093.stdout:2/419: rmdir d5/d14/d2d/d12/d25 39 2023-12-12T11:51:47.392 INFO:tasks.workunit.client.0.smithi063.stdout:7/158: rename de/l32 to de/d33/l3b 0 2023-12-12T11:51:47.392 INFO:tasks.workunit.client.0.smithi063.stdout:7/159: write de/d22/f29 [1883957,79073] 0 2023-12-12T11:51:47.392 INFO:tasks.workunit.client.0.smithi063.stdout:7/160: creat de/f3c x:0 0 0 2023-12-12T11:51:47.398 INFO:tasks.workunit.client.0.smithi063.stdout:8/251: creat d4/de/f4a x:0 0 0 2023-12-12T11:51:47.398 INFO:tasks.workunit.client.0.smithi063.stdout:8/252: readlink d4/de/l10 0 2023-12-12T11:51:47.400 INFO:tasks.workunit.client.0.smithi063.stdout:0/170: dwrite d0/d7/f31 [0,4194304] 0 2023-12-12T11:51:47.404 INFO:tasks.workunit.client.0.smithi063.stdout:6/189: dwrite d9/fc [8388608,4194304] 0 2023-12-12T11:51:47.404 INFO:tasks.workunit.client.0.smithi063.stdout:6/190: fdatasync d9/d10/f47 0 2023-12-12T11:51:47.404 INFO:tasks.workunit.client.0.smithi063.stdout:6/191: readlink d9/d2c/l33 0 2023-12-12T11:51:47.404 INFO:tasks.workunit.client.0.smithi063.stdout:6/192: chown d9/f27 14726939 1 2023-12-12T11:51:47.404 INFO:tasks.workunit.client.0.smithi063.stdout:6/193: read - d9/d10/f41 zero size 2023-12-12T11:51:47.404 INFO:tasks.workunit.client.0.smithi063.stdout:6/194: fsync d9/d10/f1e 0 2023-12-12T11:51:47.404 INFO:tasks.workunit.client.0.smithi063.stdout:6/195: write d9/d10/f1e [423050,53088] 0 2023-12-12T11:51:47.411 INFO:tasks.workunit.client.0.smithi063.stdout:7/161: symlink de/d33/l3d 0 2023-12-12T11:51:47.412 INFO:tasks.workunit.client.0.smithi063.stdout:8/253: dread d4/f1d [0,4194304] 0 2023-12-12T11:51:47.414 INFO:tasks.workunit.client.1.smithi093.stdout:9/350: dwrite d1/d23/d24/d29/d43/f5e [0,4194304] 0 2023-12-12T11:51:47.414 INFO:tasks.workunit.client.1.smithi093.stdout:9/351: read - d1/d12/d1f/d32/d42/f6e zero size 2023-12-12T11:51:47.417 INFO:tasks.workunit.client.1.smithi093.stdout:6/534: link d0/da/d14/d38/c4b d0/d52/d6b/cc8 0 2023-12-12T11:51:47.417 INFO:tasks.workunit.client.1.smithi093.stdout:6/535: stat d0/da/d14/d9c/lc4 0 2023-12-12T11:51:47.418 INFO:tasks.workunit.client.0.smithi063.stdout:8/254: write d4/f42 [466022,51902] 0 2023-12-12T11:51:47.419 INFO:tasks.workunit.client.0.smithi063.stdout:8/255: stat d4/f8 0 2023-12-12T11:51:47.424 INFO:tasks.workunit.client.0.smithi063.stdout:0/171: rename d0/d7/l2f to d0/d15/l39 0 2023-12-12T11:51:47.431 INFO:tasks.workunit.client.1.smithi093.stdout:8/412: dwrite d3/f74 [0,4194304] 0 2023-12-12T11:51:47.431 INFO:tasks.workunit.client.1.smithi093.stdout:8/413: fsync d3/f1c 0 2023-12-12T11:51:47.431 INFO:tasks.workunit.client.1.smithi093.stdout:8/414: write d3/d1a/d1f/f5a [302451,53042] 0 2023-12-12T11:51:47.431 INFO:tasks.workunit.client.0.smithi063.stdout:6/196: dread d9/d10/f15 [0,4194304] 0 2023-12-12T11:51:47.431 INFO:tasks.workunit.client.0.smithi063.stdout:6/197: chown d9/f40 6694 1 2023-12-12T11:51:47.436 INFO:tasks.workunit.client.0.smithi063.stdout:7/162: write f4 [221329,104160] 0 2023-12-12T11:51:47.437 INFO:tasks.workunit.client.1.smithi093.stdout:2/420: unlink d5/l6 0 2023-12-12T11:51:47.438 INFO:tasks.workunit.client.1.smithi093.stdout:2/421: fsync d5/d14/d2d/f42 0 2023-12-12T11:51:47.459 INFO:tasks.workunit.client.0.smithi063.stdout:0/172: mknod d0/d15/c3a 0 2023-12-12T11:51:47.459 INFO:tasks.workunit.client.0.smithi063.stdout:7/163: write de/f28 [627767,93625] 0 2023-12-12T11:51:47.462 INFO:tasks.workunit.client.0.smithi063.stdout:9/176: getdents d7/d20 0 2023-12-12T11:51:47.467 INFO:tasks.workunit.client.0.smithi063.stdout:7/164: symlink de/d34/l3e 0 2023-12-12T11:51:47.468 INFO:tasks.workunit.client.0.smithi063.stdout:9/177: mknod d7/d11/d12/d30/c36 0 2023-12-12T11:51:47.469 INFO:tasks.workunit.client.0.smithi063.stdout:9/178: truncate d7/f2a 842762 0 2023-12-12T11:51:47.470 INFO:tasks.workunit.client.0.smithi063.stdout:9/179: creat d7/d11/d12/f37 x:0 0 0 2023-12-12T11:51:47.470 INFO:tasks.workunit.client.0.smithi063.stdout:9/180: rename d7 to d7/d11/d12/d30/d38 22 2023-12-12T11:51:47.476 INFO:tasks.workunit.client.0.smithi063.stdout:9/181: mkdir d7/d15/d39 0 2023-12-12T11:51:47.476 INFO:tasks.workunit.client.0.smithi063.stdout:9/182: chown d7/d15/f23 1038 1 2023-12-12T11:51:47.476 INFO:tasks.workunit.client.0.smithi063.stdout:9/183: write d7/d15/f33 [268297,82727] 0 2023-12-12T11:51:47.478 INFO:tasks.workunit.client.1.smithi093.stdout:9/352: dwrite d1/d12/f1a [4194304,4194304] 0 2023-12-12T11:51:47.478 INFO:tasks.workunit.client.1.smithi093.stdout:9/353: write d1/d12/d1f/d3d/d57/f67 [4941233,68046] 0 2023-12-12T11:51:47.482 INFO:tasks.workunit.client.1.smithi093.stdout:6/536: dwrite d0/d52/d7e/f3f [4194304,4194304] 0 2023-12-12T11:51:47.483 INFO:tasks.workunit.client.1.smithi093.stdout:9/354: mknod d1/d12/d1f/c77 0 2023-12-12T11:51:47.483 INFO:tasks.workunit.client.1.smithi093.stdout:9/355: dread - d1/d23/f40 zero size 2023-12-12T11:51:47.483 INFO:tasks.workunit.client.1.smithi093.stdout:9/356: readlink d1/d12/d1f/d32/l45 0 2023-12-12T11:51:47.484 INFO:tasks.workunit.client.0.smithi063.stdout:3/135: fsync d4/df/d1a/f20 0 2023-12-12T11:51:47.486 INFO:tasks.workunit.client.0.smithi063.stdout:8/256: dwrite d4/f42 [0,4194304] 0 2023-12-12T11:51:47.491 INFO:tasks.workunit.client.0.smithi063.stdout:3/136: mknod d4/d23/c26 0 2023-12-12T11:51:47.493 INFO:tasks.workunit.client.0.smithi063.stdout:6/198: dwrite d9/d10/d2a/f3e [0,4194304] 0 2023-12-12T11:51:47.493 INFO:tasks.workunit.client.0.smithi063.stdout:6/199: write d9/fd [5647715,102973] 0 2023-12-12T11:51:47.493 INFO:tasks.workunit.client.0.smithi063.stdout:6/200: fdatasync d9/d10/d25/f3d 0 2023-12-12T11:51:47.495 INFO:tasks.workunit.client.1.smithi093.stdout:1/390: mknod d4/d1c/c80 0 2023-12-12T11:51:47.496 INFO:tasks.workunit.client.0.smithi063.stdout:8/257: rmdir d4/d29 39 2023-12-12T11:51:47.497 INFO:tasks.workunit.client.0.smithi063.stdout:8/258: fsync d4/de/d1e/f3c 0 2023-12-12T11:51:47.498 INFO:tasks.workunit.client.1.smithi093.stdout:1/391: mkdir d4/d81 0 2023-12-12T11:51:47.498 INFO:tasks.workunit.client.0.smithi063.stdout:6/201: fsync d9/fd 0 2023-12-12T11:51:47.498 INFO:tasks.workunit.client.0.smithi063.stdout:6/202: truncate d9/d10/f37 727612 0 2023-12-12T11:51:47.502 INFO:tasks.workunit.client.0.smithi063.stdout:3/137: mknod d4/c27 0 2023-12-12T11:51:47.503 INFO:tasks.workunit.client.0.smithi063.stdout:7/165: write de/f13 [903063,26307] 0 2023-12-12T11:51:47.505 INFO:tasks.workunit.client.0.smithi063.stdout:6/203: rmdir d9/d10/d2a/d44 0 2023-12-12T11:51:47.506 INFO:tasks.workunit.client.1.smithi093.stdout:5/314: mknod d0/c6d 0 2023-12-12T11:51:47.506 INFO:tasks.workunit.client.1.smithi093.stdout:5/315: chown d0/d7/d36/d29/d44 425 1 2023-12-12T11:51:47.506 INFO:tasks.workunit.client.1.smithi093.stdout:5/316: dread - d0/d7/d8/f5d zero size 2023-12-12T11:51:47.506 INFO:tasks.workunit.client.0.smithi063.stdout:3/138: creat d4/df/d1a/d1c/f28 x:0 0 0 2023-12-12T11:51:47.507 INFO:tasks.workunit.client.0.smithi063.stdout:3/139: creat d4/df/d1a/d1c/f29 x:0 0 0 2023-12-12T11:51:47.507 INFO:tasks.workunit.client.0.smithi063.stdout:3/140: write d4/f7 [6233945,37822] 0 2023-12-12T11:51:47.507 INFO:tasks.workunit.client.0.smithi063.stdout:7/166: mkdir de/d3f 0 2023-12-12T11:51:47.511 INFO:tasks.workunit.client.0.smithi063.stdout:3/141: creat d4/f2a x:0 0 0 2023-12-12T11:51:47.511 INFO:tasks.workunit.client.0.smithi063.stdout:3/142: truncate d4/df/d1a/f22 8930 0 2023-12-12T11:51:47.512 INFO:tasks.workunit.client.1.smithi093.stdout:5/317: dread d0/d7/d8/f37 [0,4194304] 0 2023-12-12T11:51:47.515 INFO:tasks.workunit.client.0.smithi063.stdout:7/167: mknod de/c40 0 2023-12-12T11:51:47.516 INFO:tasks.workunit.client.0.smithi063.stdout:6/204: getdents d9/d10/d25 0 2023-12-12T11:51:47.516 INFO:tasks.workunit.client.1.smithi093.stdout:7/352: rename da/d2e/f42 to da/f7b 0 2023-12-12T11:51:47.517 INFO:tasks.workunit.client.1.smithi093.stdout:0/419: rename d5/dd/d14/d26/d58 to d5/dd/d14/d26/d58/d82 22 2023-12-12T11:51:47.517 INFO:tasks.workunit.client.1.smithi093.stdout:7/353: write da/d15/d2d/d2f/f6c [709820,61246] 0 2023-12-12T11:51:47.520 INFO:tasks.workunit.client.0.smithi063.stdout:6/205: mknod d9/d2c/c49 0 2023-12-12T11:51:47.528 INFO:tasks.workunit.client.0.smithi063.stdout:8/259: link d4/de/d11/f14 d4/de/d32/f4b 0 2023-12-12T11:51:47.529 INFO:tasks.workunit.client.1.smithi093.stdout:4/572: rename d0/l24 to d0/d31/d89/lb0 0 2023-12-12T11:51:47.529 INFO:tasks.workunit.client.1.smithi093.stdout:4/573: write d0/d87/d79/d86/f8a [1470409,43595] 0 2023-12-12T11:51:47.530 INFO:tasks.workunit.client.1.smithi093.stdout:4/574: fdatasync d0/f32 0 2023-12-12T11:51:47.535 INFO:tasks.workunit.client.0.smithi063.stdout:7/168: write de/f21 [7328561,46891] 0 2023-12-12T11:51:47.540 INFO:tasks.workunit.client.1.smithi093.stdout:9/357: rename d1/d12/d1f/f20 to d1/d23/d24/d29/d43/d58/f78 0 2023-12-12T11:51:47.557 INFO:tasks.workunit.client.1.smithi093.stdout:8/415: rmdir d3/d1a/d1f/d75 39 2023-12-12T11:51:47.557 INFO:tasks.workunit.client.1.smithi093.stdout:8/416: fdatasync d3/d1a/d1f/d29/d30/f4e 0 2023-12-12T11:51:47.560 INFO:tasks.workunit.client.0.smithi063.stdout:8/260: read d4/de/f13 [630458,114468] 0 2023-12-12T11:51:47.562 INFO:tasks.workunit.client.1.smithi093.stdout:9/358: write d1/d12/d1f/f38 [1549224,87147] 0 2023-12-12T11:51:47.564 INFO:tasks.workunit.client.1.smithi093.stdout:8/417: truncate d3/d1a/d1f/f2a 1157514 0 2023-12-12T11:51:47.567 INFO:tasks.workunit.client.0.smithi063.stdout:3/143: dwrite d4/df/d1a/f20 [0,4194304] 0 2023-12-12T11:51:47.567 INFO:tasks.workunit.client.0.smithi063.stdout:3/144: chown d4/df/c12 212819619 1 2023-12-12T11:51:47.583 INFO:tasks.workunit.client.1.smithi093.stdout:9/359: link d1/d23/f52 d1/d12/d1f/d3d/d57/d63/f79 0 2023-12-12T11:51:47.586 INFO:tasks.workunit.client.1.smithi093.stdout:8/418: rename d3/d1a/d1f/f2f to d3/d1a/d1f/d29/d30/d58/d76/f86 0 2023-12-12T11:51:47.594 INFO:tasks.workunit.client.0.smithi063.stdout:2/139: sync 2023-12-12T11:51:47.594 INFO:tasks.workunit.client.0.smithi063.stdout:5/165: sync 2023-12-12T11:51:47.594 INFO:tasks.workunit.client.0.smithi063.stdout:5/166: write d7/d10/f14 [2032928,119188] 0 2023-12-12T11:51:47.598 INFO:tasks.workunit.client.1.smithi093.stdout:5/318: dwrite d0/d7/d36/d38/f40 [0,4194304] 0 2023-12-12T11:51:47.598 INFO:tasks.workunit.client.1.smithi093.stdout:5/319: readlink d0/d7/d8/l53 0 2023-12-12T11:51:47.600 INFO:tasks.workunit.client.0.smithi063.stdout:4/209: sync 2023-12-12T11:51:47.602 INFO:tasks.workunit.client.1.smithi093.stdout:9/360: dread d1/f16 [0,4194304] 0 2023-12-12T11:51:47.603 INFO:tasks.workunit.client.0.smithi063.stdout:7/169: dread de/f28 [0,4194304] 0 2023-12-12T11:51:47.612 INFO:tasks.workunit.client.0.smithi063.stdout:1/159: sync 2023-12-12T11:51:47.612 INFO:tasks.workunit.client.0.smithi063.stdout:0/173: rmdir d0 39 2023-12-12T11:51:47.613 INFO:tasks.workunit.client.0.smithi063.stdout:2/140: truncate d0/f5 1578144 0 2023-12-12T11:51:47.617 INFO:tasks.workunit.client.0.smithi063.stdout:1/160: rmdir d3/db/d16/d24 39 2023-12-12T11:51:47.618 INFO:tasks.workunit.client.0.smithi063.stdout:6/206: dwrite d9/fc [12582912,4194304] 0 2023-12-12T11:51:47.622 INFO:tasks.workunit.client.1.smithi093.stdout:8/419: link d3/d8/l2c d3/d1a/d1f/d29/l87 0 2023-12-12T11:51:47.623 INFO:tasks.workunit.client.0.smithi063.stdout:2/141: creat d0/d1a/d1e/f2e x:0 0 0 2023-12-12T11:51:47.628 INFO:tasks.workunit.client.1.smithi093.stdout:0/420: dwrite d5/d21/d27/f5f [0,4194304] 0 2023-12-12T11:51:47.628 INFO:tasks.workunit.client.1.smithi093.stdout:0/421: chown d5/d21/d2f 232249465 1 2023-12-12T11:51:47.629 INFO:tasks.workunit.client.0.smithi063.stdout:0/174: dread d0/d1a/f1c [0,4194304] 0 2023-12-12T11:51:47.629 INFO:tasks.workunit.client.0.smithi063.stdout:0/175: fdatasync d0/d1a/f1c 0 2023-12-12T11:51:47.629 INFO:tasks.workunit.client.0.smithi063.stdout:0/176: readlink d0/d7/d27/l20 0 2023-12-12T11:51:47.629 INFO:tasks.workunit.client.0.smithi063.stdout:0/177: chown d0/d1a/d23/d34 19944 1 2023-12-12T11:51:47.629 INFO:tasks.workunit.client.0.smithi063.stdout:0/178: chown d0/d1a/d23/l2a 7807 1 2023-12-12T11:51:47.629 INFO:tasks.workunit.client.0.smithi063.stdout:6/207: unlink f6 0 2023-12-12T11:51:47.629 INFO:tasks.workunit.client.0.smithi063.stdout:5/167: dread d7/f1a [4194304,4194304] 0 2023-12-12T11:51:47.629 INFO:tasks.workunit.client.0.smithi063.stdout:5/168: readlink d7/de/l1d 0 2023-12-12T11:51:47.634 INFO:tasks.workunit.client.0.smithi063.stdout:4/210: dread d2/d17/f3e [0,4194304] 0 2023-12-12T11:51:47.635 INFO:tasks.workunit.client.0.smithi063.stdout:4/211: truncate d2/d8/f26 1469595 0 2023-12-12T11:51:47.635 INFO:tasks.workunit.client.1.smithi093.stdout:2/422: symlink d5/d14/d47/l8d 0 2023-12-12T11:51:47.635 INFO:tasks.workunit.client.1.smithi093.stdout:2/423: readlink d5/d14/d2d/d12/l32 0 2023-12-12T11:51:47.636 INFO:tasks.workunit.client.1.smithi093.stdout:2/424: chown d5/d31/f4a 24 1 2023-12-12T11:51:47.636 INFO:tasks.workunit.client.1.smithi093.stdout:2/425: truncate d5/d14/d2d/d12/d25/f33 1288999 0 2023-12-12T11:51:47.637 INFO:tasks.workunit.client.0.smithi063.stdout:2/142: symlink d0/d11/l2f 0 2023-12-12T11:51:47.637 INFO:tasks.workunit.client.0.smithi063.stdout:0/179: dread d0/d7/d27/f29 [0,4194304] 0 2023-12-12T11:51:47.639 INFO:tasks.workunit.client.0.smithi063.stdout:3/145: dwrite d4/df/d1a/d1c/f28 [0,4194304] 0 2023-12-12T11:51:47.639 INFO:tasks.workunit.client.0.smithi063.stdout:0/180: write d0/d7/d27/f29 [136948,35170] 0 2023-12-12T11:51:47.640 INFO:tasks.workunit.client.1.smithi093.stdout:4/575: dwrite d0/f27 [0,4194304] 0 2023-12-12T11:51:47.641 INFO:tasks.workunit.client.1.smithi093.stdout:4/576: truncate d0/f91 370487 0 2023-12-12T11:51:47.646 INFO:tasks.workunit.client.0.smithi063.stdout:8/261: dwrite d4/de/f30 [0,4194304] 0 2023-12-12T11:51:47.647 INFO:tasks.workunit.client.1.smithi093.stdout:6/537: creat d0/d52/fc9 x:0 0 0 2023-12-12T11:51:47.652 INFO:tasks.workunit.client.0.smithi063.stdout:5/169: unlink l2 0 2023-12-12T11:51:47.657 INFO:tasks.workunit.client.1.smithi093.stdout:5/320: rename d0/f3 to d0/d7/d59/d62/f6e 0 2023-12-12T11:51:47.657 INFO:tasks.workunit.client.0.smithi063.stdout:9/184: rmdir d7/d11/d12 39 2023-12-12T11:51:47.657 INFO:tasks.workunit.client.0.smithi063.stdout:9/185: fsync f5 0 2023-12-12T11:51:47.661 INFO:tasks.workunit.client.0.smithi063.stdout:3/146: write d4/f7 [3483506,25771] 0 2023-12-12T11:51:47.662 INFO:tasks.workunit.client.0.smithi063.stdout:3/147: creat d4/df/d1a/f2b x:0 0 0 2023-12-12T11:51:47.662 INFO:tasks.workunit.client.0.smithi063.stdout:4/212: rename d2/f1d to d2/d17/d41/f44 0 2023-12-12T11:51:47.662 INFO:tasks.workunit.client.0.smithi063.stdout:4/213: readlink d2/d8/d14/l2b 0 2023-12-12T11:51:47.666 INFO:tasks.workunit.client.0.smithi063.stdout:3/148: write d4/f25 [727849,40853] 0 2023-12-12T11:51:47.666 INFO:tasks.workunit.client.1.smithi093.stdout:1/392: mkdir d4/d1a/d1b/d26/d82 0 2023-12-12T11:51:47.666 INFO:tasks.workunit.client.1.smithi093.stdout:1/393: chown d4/d1a/d73/f60 1722324458 1 2023-12-12T11:51:47.680 INFO:tasks.workunit.client.1.smithi093.stdout:9/361: creat d1/d12/d1f/d32/f7a x:0 0 0 2023-12-12T11:51:47.686 INFO:tasks.workunit.client.0.smithi063.stdout:2/143: creat d0/d11/f30 x:0 0 0 2023-12-12T11:51:47.686 INFO:tasks.workunit.client.0.smithi063.stdout:2/144: chown d0/d1a/d26 4870 1 2023-12-12T11:51:47.686 INFO:tasks.workunit.client.0.smithi063.stdout:2/145: creat d0/d1a/d1e/f31 x:0 0 0 2023-12-12T11:51:47.694 INFO:tasks.workunit.client.0.smithi063.stdout:6/208: dwrite d9/d10/f15 [0,4194304] 0 2023-12-12T11:51:47.702 INFO:tasks.workunit.client.1.smithi093.stdout:2/426: dread d5/d14/d2d/d12/d25/f30 [0,4194304] 0 2023-12-12T11:51:47.702 INFO:tasks.workunit.client.1.smithi093.stdout:5/321: write d0/d7/d36/d38/f40 [3881517,14756] 0 2023-12-12T11:51:47.702 INFO:tasks.workunit.client.1.smithi093.stdout:5/322: read - d0/d7/d36/d38/f49 zero size 2023-12-12T11:51:47.702 INFO:tasks.workunit.client.0.smithi063.stdout:7/170: dwrite de/f13 [0,4194304] 0 2023-12-12T11:51:47.702 INFO:tasks.workunit.client.0.smithi063.stdout:7/171: fdatasync de/d22/d2b/f2d 0 2023-12-12T11:51:47.704 INFO:tasks.workunit.client.1.smithi093.stdout:3/391: sync 2023-12-12T11:51:47.705 INFO:tasks.workunit.client.0.smithi063.stdout:0/181: creat d0/d7/d27/f3b x:0 0 0 2023-12-12T11:51:47.706 INFO:tasks.workunit.client.0.smithi063.stdout:0/182: fdatasync d0/d7/f31 0 2023-12-12T11:51:47.706 INFO:tasks.workunit.client.0.smithi063.stdout:0/183: readlink d0/l5 0 2023-12-12T11:51:47.710 INFO:tasks.workunit.client.1.smithi093.stdout:4/577: creat d0/d87/d79/d7f/fb1 x:0 0 0 2023-12-12T11:51:47.710 INFO:tasks.workunit.client.1.smithi093.stdout:4/578: fdatasync d0/d36/d61/f62 0 2023-12-12T11:51:47.710 INFO:tasks.workunit.client.1.smithi093.stdout:4/579: read d0/d36/f70 [2164281,115073] 0 2023-12-12T11:51:47.712 INFO:tasks.workunit.client.1.smithi093.stdout:8/420: dwrite d3/d8/f23 [0,4194304] 0 2023-12-12T11:51:47.715 INFO:tasks.workunit.client.1.smithi093.stdout:8/421: chown d3/d1a/d1f/d59/f6a 6 1 2023-12-12T11:51:47.715 INFO:tasks.workunit.client.0.smithi063.stdout:8/262: mknod d4/d24/d38/d45/c4c 0 2023-12-12T11:51:47.716 INFO:tasks.workunit.client.0.smithi063.stdout:7/172: dread f4 [0,4194304] 0 2023-12-12T11:51:47.720 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:47 smithi093 ceph-mon[115914]: pgmap v8: 65 pgs: 65 active+clean; 992 MiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 86 MiB/s rd, 106 MiB/s wr, 173 op/s 2023-12-12T11:51:47.721 INFO:tasks.workunit.client.0.smithi063.stdout:9/186: rmdir d7/d11/d12/d30 39 2023-12-12T11:51:47.722 INFO:tasks.workunit.client.1.smithi093.stdout:1/394: mkdir d4/d1a/d83 0 2023-12-12T11:51:47.723 INFO:tasks.workunit.client.1.smithi093.stdout:6/538: creat d0/d52/dbc/fca x:0 0 0 2023-12-12T11:51:47.723 INFO:tasks.workunit.client.1.smithi093.stdout:9/362: unlink d1/ff 0 2023-12-12T11:51:47.723 INFO:tasks.workunit.client.1.smithi093.stdout:9/363: readlink d1/d23/d24/d29/d43/l62 0 2023-12-12T11:51:47.723 INFO:tasks.workunit.client.1.smithi093.stdout:9/364: fsync d1/f16 0 2023-12-12T11:51:47.725 INFO:tasks.workunit.client.0.smithi063.stdout:5/170: dwrite d7/de/f20 [0,4194304] 0 2023-12-12T11:51:47.729 INFO:tasks.workunit.client.1.smithi093.stdout:9/365: write d1/d12/d1f/d32/d42/f5a [698780,11523] 0 2023-12-12T11:51:47.729 INFO:tasks.workunit.client.1.smithi093.stdout:9/366: fdatasync d1/d12/d1f/f25 0 2023-12-12T11:51:47.732 INFO:tasks.workunit.client.1.smithi093.stdout:2/427: write d5/f6e [912760,111203] 0 2023-12-12T11:51:47.732 INFO:tasks.workunit.client.1.smithi093.stdout:2/428: creat d5/d46/d55/f8e x:0 0 0 2023-12-12T11:51:47.734 INFO:tasks.workunit.client.0.smithi063.stdout:4/214: link d2/d17/f3e d2/d17/d41/f45 0 2023-12-12T11:51:47.736 INFO:tasks.workunit.client.0.smithi063.stdout:0/184: dread d0/d15/f2b [4194304,4194304] 0 2023-12-12T11:51:47.740 INFO:tasks.workunit.client.0.smithi063.stdout:6/209: dwrite d9/d10/f15 [4194304,4194304] 0 2023-12-12T11:51:47.743 INFO:tasks.workunit.client.1.smithi093.stdout:5/323: link d0/d7/d8/de/l5c d0/d3b/l6f 0 2023-12-12T11:51:47.751 INFO:tasks.workunit.client.1.smithi093.stdout:3/392: dwrite df/d36/d3d/d42/f53 [0,4194304] 0 2023-12-12T11:51:47.758 INFO:tasks.workunit.client.0.smithi063.stdout:3/149: rename d4/df/d1a/f22 to d4/df/f2c 0 2023-12-12T11:51:47.759 INFO:tasks.workunit.client.0.smithi063.stdout:3/150: write d4/f7 [6552442,102029] 0 2023-12-12T11:51:47.759 INFO:tasks.workunit.client.0.smithi063.stdout:2/146: mkdir d0/d11/d32 0 2023-12-12T11:51:47.759 INFO:tasks.workunit.client.0.smithi063.stdout:2/147: creat d0/f33 x:0 0 0 2023-12-12T11:51:47.759 INFO:tasks.workunit.client.0.smithi063.stdout:2/148: fdatasync d0/f5 0 2023-12-12T11:51:47.759 INFO:tasks.workunit.client.1.smithi093.stdout:1/395: mknod d4/d81/c84 0 2023-12-12T11:51:47.767 INFO:tasks.workunit.client.0.smithi063.stdout:7/173: getdents de/d39 0 2023-12-12T11:51:47.768 INFO:tasks.workunit.client.1.smithi093.stdout:6/539: creat d0/da/fcb x:0 0 0 2023-12-12T11:51:47.772 INFO:tasks.workunit.client.1.smithi093.stdout:9/367: creat d1/d12/d1f/d3d/d5c/f7b x:0 0 0 2023-12-12T11:51:47.774 INFO:tasks.workunit.client.0.smithi063.stdout:8/263: mknod d4/de/d3b/c4d 0 2023-12-12T11:51:47.778 INFO:tasks.workunit.client.0.smithi063.stdout:9/187: mknod d7/d11/d12/d30/c3a 0 2023-12-12T11:51:47.781 INFO:tasks.workunit.client.1.smithi093.stdout:2/429: creat d5/d14/d2d/d4c/d54/d67/d69/f8f x:0 0 0 2023-12-12T11:51:47.785 INFO:tasks.workunit.client.1.smithi093.stdout:5/324: link d0/d7/d59/d35/c26 d0/d7/d8/c70 0 2023-12-12T11:51:47.785 INFO:tasks.workunit.client.1.smithi093.stdout:5/325: fdatasync d0/d3b/f63 0 2023-12-12T11:51:47.786 INFO:tasks.workunit.client.1.smithi093.stdout:7/354: sync 2023-12-12T11:51:47.786 INFO:tasks.workunit.client.1.smithi093.stdout:7/355: chown da/d15/d19 1634759685 1 2023-12-12T11:51:47.797 INFO:tasks.workunit.client.0.smithi063.stdout:4/215: creat d2/d8/d14/f46 x:0 0 0 2023-12-12T11:51:47.798 INFO:tasks.workunit.client.0.smithi063.stdout:0/185: truncate d0/d7/d27/fb 548367 0 2023-12-12T11:51:47.798 INFO:tasks.workunit.client.0.smithi063.stdout:0/186: truncate d0/d7/d27/d1f/f30 691792 0 2023-12-12T11:51:47.798 INFO:tasks.workunit.client.0.smithi063.stdout:0/187: fsync d0/d7/f31 0 2023-12-12T11:51:47.803 INFO:tasks.workunit.client.0.smithi063.stdout:7/174: write de/f13 [1203589,65914] 0 2023-12-12T11:51:47.803 INFO:tasks.workunit.client.0.smithi063.stdout:7/175: dread - de/f3c zero size 2023-12-12T11:51:47.803 INFO:tasks.workunit.client.1.smithi093.stdout:3/393: symlink df/d30/d33/d66/l7e 0 2023-12-12T11:51:47.812 INFO:tasks.workunit.client.0.smithi063.stdout:6/210: dwrite d9/fc [4194304,4194304] 0 2023-12-12T11:51:47.813 INFO:tasks.workunit.client.1.smithi093.stdout:9/368: link d1/d12/d1f/d32/c64 d1/d12/d1f/d3d/d57/d63/c7c 0 2023-12-12T11:51:47.818 INFO:tasks.workunit.client.1.smithi093.stdout:2/430: getdents d5/d14/d47/d56/d6f 0 2023-12-12T11:51:47.822 INFO:tasks.workunit.client.0.smithi063.stdout:3/151: dwrite d4/d23/f24 [0,4194304] 0 2023-12-12T11:51:47.824 INFO:tasks.workunit.client.0.smithi063.stdout:3/152: chown d4/df/d1a/d1c/c21 322705095 1 2023-12-12T11:51:47.825 INFO:tasks.workunit.client.1.smithi093.stdout:5/326: symlink d0/d7/d59/d35/d6a/l71 0 2023-12-12T11:51:47.825 INFO:tasks.workunit.client.1.smithi093.stdout:7/356: creat da/d15/d19/f7c x:0 0 0 2023-12-12T11:51:47.825 INFO:tasks.workunit.client.1.smithi093.stdout:5/327: chown d0/d7/d8/de/c46 124473 1 2023-12-12T11:51:47.827 INFO:tasks.workunit.client.1.smithi093.stdout:1/396: dwrite d4/d1a/f6b [0,4194304] 0 2023-12-12T11:51:47.827 INFO:tasks.workunit.client.1.smithi093.stdout:1/397: fdatasync d4/d1a/d1b/d26/d40/f6a 0 2023-12-12T11:51:47.829 INFO:tasks.workunit.client.1.smithi093.stdout:6/540: dwrite d0/d52/fc9 [0,4194304] 0 2023-12-12T11:51:47.833 INFO:tasks.workunit.client.1.smithi093.stdout:4/580: rename d0/d31/d5c/d6c/d93 to d0/d87/d79/db2 0 2023-12-12T11:51:47.833 INFO:tasks.workunit.client.1.smithi093.stdout:4/581: chown d0/d87/d79/d7f/fb1 3 1 2023-12-12T11:51:47.836 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:47 smithi063 ceph-mon[107117]: pgmap v8: 65 pgs: 65 active+clean; 992 MiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 86 MiB/s rd, 106 MiB/s wr, 173 op/s 2023-12-12T11:51:47.841 INFO:tasks.workunit.client.1.smithi093.stdout:3/394: rmdir df/d36/d3d 39 2023-12-12T11:51:47.841 INFO:tasks.workunit.client.1.smithi093.stdout:9/369: unlink d1/fe 0 2023-12-12T11:51:47.847 INFO:tasks.workunit.client.0.smithi063.stdout:2/149: dwrite d0/f33 [0,4194304] 0 2023-12-12T11:51:47.847 INFO:tasks.workunit.client.0.smithi063.stdout:2/150: creat d0/d11/f34 x:0 0 0 2023-12-12T11:51:47.847 INFO:tasks.workunit.client.0.smithi063.stdout:5/171: dwrite d7/f13 [0,4194304] 0 2023-12-12T11:51:47.849 INFO:tasks.workunit.client.1.smithi093.stdout:7/357: mkdir da/de/d46/d58/d7d 0 2023-12-12T11:51:47.849 INFO:tasks.workunit.client.1.smithi093.stdout:7/358: truncate da/d15/d2d/d2f/f61 571096 0 2023-12-12T11:51:47.855 INFO:tasks.workunit.client.1.smithi093.stdout:5/328: write d0/d7/d36/f4a [2446623,6762] 0 2023-12-12T11:51:47.855 INFO:tasks.workunit.client.1.smithi093.stdout:5/329: fdatasync d0/d7/d36/d38/f49 0 2023-12-12T11:51:47.859 INFO:tasks.workunit.client.1.smithi093.stdout:1/398: mkdir d4/d85 0 2023-12-12T11:51:47.861 INFO:tasks.workunit.client.1.smithi093.stdout:2/431: write d5/f49 [2151890,106774] 0 2023-12-12T11:51:47.867 INFO:tasks.workunit.client.0.smithi063.stdout:8/264: creat d4/f4e x:0 0 0 2023-12-12T11:51:47.867 INFO:tasks.workunit.client.0.smithi063.stdout:8/265: chown f2 167426 1 2023-12-12T11:51:47.881 INFO:tasks.workunit.client.0.smithi063.stdout:9/188: unlink d7/d11/d12/f18 0 2023-12-12T11:51:47.887 INFO:tasks.workunit.client.0.smithi063.stdout:6/211: dwrite d9/d10/d2a/f34 [0,4194304] 0 2023-12-12T11:51:47.887 INFO:tasks.workunit.client.0.smithi063.stdout:6/212: chown d9/d10/f20 3702 1 2023-12-12T11:51:47.887 INFO:tasks.workunit.client.0.smithi063.stdout:6/213: stat d9/d10/d2a/c36 0 2023-12-12T11:51:47.887 INFO:tasks.workunit.client.0.smithi063.stdout:6/214: truncate d9/d10/d2a/f34 4246355 0 2023-12-12T11:51:47.887 INFO:tasks.workunit.client.0.smithi063.stdout:6/215: chown d9/f32 1 1 2023-12-12T11:51:47.887 INFO:tasks.workunit.client.0.smithi063.stdout:6/216: chown d9/l38 112245 1 2023-12-12T11:51:47.888 INFO:tasks.workunit.client.1.smithi093.stdout:9/370: dwrite d1/d12/f1c [0,4194304] 0 2023-12-12T11:51:47.892 INFO:tasks.workunit.client.0.smithi063.stdout:8/266: dread f3 [0,4194304] 0 2023-12-12T11:51:47.892 INFO:tasks.workunit.client.0.smithi063.stdout:8/267: creat d4/de/d1e/f4f x:0 0 0 2023-12-12T11:51:47.896 INFO:tasks.workunit.client.0.smithi063.stdout:8/268: write d4/de/d1e/f4f [910451,111852] 0 2023-12-12T11:51:47.896 INFO:tasks.workunit.client.0.smithi063.stdout:8/269: chown d4/f8 480165 1 2023-12-12T11:51:47.896 INFO:tasks.workunit.client.0.smithi063.stdout:8/270: write d4/de/d1e/f3c [581809,2283] 0 2023-12-12T11:51:47.896 INFO:tasks.workunit.client.0.smithi063.stdout:9/189: dread d7/d15/f31 [0,4194304] 0 2023-12-12T11:51:47.898 INFO:tasks.workunit.client.1.smithi093.stdout:8/422: dwrite d3/d8/f23 [4194304,4194304] 0 2023-12-12T11:51:47.901 INFO:tasks.workunit.client.1.smithi093.stdout:4/582: creat d0/d36/d40/fb3 x:0 0 0 2023-12-12T11:51:47.905 INFO:tasks.workunit.client.0.smithi063.stdout:0/188: symlink d0/d15/l3c 0 2023-12-12T11:51:47.905 INFO:tasks.workunit.client.1.smithi093.stdout:9/371: write d1/d12/d1f/d32/f3f [3415953,108166] 0 2023-12-12T11:51:47.907 INFO:tasks.workunit.client.1.smithi093.stdout:3/395: mkdir df/d36/d7f 0 2023-12-12T11:51:47.910 INFO:tasks.workunit.client.0.smithi063.stdout:7/176: mkdir de/d33/d41 0 2023-12-12T11:51:47.911 INFO:tasks.workunit.client.1.smithi093.stdout:6/541: dwrite d0/da/d14/d9c/fc6 [0,4194304] 0 2023-12-12T11:51:47.911 INFO:tasks.workunit.client.1.smithi093.stdout:6/542: creat d0/d7b/fcc x:0 0 0 2023-12-12T11:51:47.914 INFO:tasks.workunit.client.1.smithi093.stdout:7/359: unlink da/d15/d19/d4c/d6d/f75 0 2023-12-12T11:51:47.914 INFO:tasks.workunit.client.1.smithi093.stdout:7/360: read - da/de/d46/d4f/f62 zero size 2023-12-12T11:51:47.915 INFO:tasks.workunit.client.0.smithi063.stdout:3/153: dwrite d4/df/d1a/d1c/f29 [0,4194304] 0 2023-12-12T11:51:47.915 INFO:tasks.workunit.client.1.smithi093.stdout:2/432: dwrite d5/d14/d2d/d12/f59 [0,4194304] 0 2023-12-12T11:51:47.924 INFO:tasks.workunit.client.1.smithi093.stdout:5/330: creat d0/d7/d59/d35/d6a/f72 x:0 0 0 2023-12-12T11:51:47.925 INFO:tasks.workunit.client.1.smithi093.stdout:0/422: sync 2023-12-12T11:51:47.925 INFO:tasks.workunit.client.0.smithi063.stdout:0/189: dread d0/d7/f31 [0,4194304] 0 2023-12-12T11:51:47.928 INFO:tasks.workunit.client.1.smithi093.stdout:1/399: mknod d4/d1a/d1b/d26/d65/c86 0 2023-12-12T11:51:47.928 INFO:tasks.workunit.client.1.smithi093.stdout:1/400: write d4/f8 [4460957,111777] 0 2023-12-12T11:51:47.930 INFO:tasks.workunit.client.0.smithi063.stdout:2/151: rmdir d0/d11/d32 0 2023-12-12T11:51:47.930 INFO:tasks.workunit.client.0.smithi063.stdout:2/152: truncate d0/d11/f30 300685 0 2023-12-12T11:51:47.931 INFO:tasks.workunit.client.0.smithi063.stdout:2/153: creat d0/d1a/d1e/f35 x:0 0 0 2023-12-12T11:51:47.931 INFO:tasks.workunit.client.0.smithi063.stdout:2/154: truncate d0/d11/f34 1002991 0 2023-12-12T11:51:47.931 INFO:tasks.workunit.client.0.smithi063.stdout:2/155: readlink d0/l18 0 2023-12-12T11:51:47.933 INFO:tasks.workunit.client.0.smithi063.stdout:7/177: dread de/d22/f29 [0,4194304] 0 2023-12-12T11:51:47.934 INFO:tasks.workunit.client.0.smithi063.stdout:7/178: stat de/d34 0 2023-12-12T11:51:47.934 INFO:tasks.workunit.client.0.smithi063.stdout:5/172: mknod d7/d10/c2e 0 2023-12-12T11:51:47.943 INFO:tasks.workunit.client.1.smithi093.stdout:8/423: mkdir d3/d8/d88 0 2023-12-12T11:51:47.943 INFO:tasks.workunit.client.0.smithi063.stdout:6/217: mknod d9/d10/d25/c4a 0 2023-12-12T11:51:47.945 INFO:tasks.workunit.client.0.smithi063.stdout:8/271: dwrite f3 [0,4194304] 0 2023-12-12T11:51:47.946 INFO:tasks.workunit.client.1.smithi093.stdout:4/583: link d0/l3c d0/d31/d89/lb4 0 2023-12-12T11:51:47.947 INFO:tasks.workunit.client.0.smithi063.stdout:8/272: read d4/f23 [480669,121570] 0 2023-12-12T11:51:47.951 INFO:tasks.workunit.client.0.smithi063.stdout:9/190: getdents d7/d11/d12/d30 0 2023-12-12T11:51:47.951 INFO:tasks.workunit.client.0.smithi063.stdout:9/191: read - d7/d11/d12/f37 zero size 2023-12-12T11:51:47.954 INFO:tasks.workunit.client.1.smithi093.stdout:9/372: mknod d1/d23/d6b/c7d 0 2023-12-12T11:51:47.954 INFO:tasks.workunit.client.1.smithi093.stdout:9/373: write d1/d23/d24/d29/d43/f71 [99851,32994] 0 2023-12-12T11:51:47.957 INFO:tasks.workunit.client.1.smithi093.stdout:3/396: mknod df/d22/d49/c80 0 2023-12-12T11:51:47.963 INFO:tasks.workunit.client.0.smithi063.stdout:6/218: write d9/d10/f1b [3382500,19144] 0 2023-12-12T11:51:47.968 INFO:tasks.workunit.client.0.smithi063.stdout:3/154: chown d4/c8 292 1 2023-12-12T11:51:47.974 INFO:tasks.workunit.client.0.smithi063.stdout:0/190: truncate d0/d7/f31 2387195 0 2023-12-12T11:51:47.975 INFO:tasks.workunit.client.0.smithi063.stdout:0/191: write d0/d7/d27/d1f/f2c [1263776,69462] 0 2023-12-12T11:51:47.976 INFO:tasks.workunit.client.1.smithi093.stdout:6/543: creat d0/da/d32/d39/d5b/fcd x:0 0 0 2023-12-12T11:51:47.976 INFO:tasks.workunit.client.1.smithi093.stdout:6/544: chown d0/da/d14/d21/fc7 232193 1 2023-12-12T11:51:47.985 INFO:tasks.workunit.client.0.smithi063.stdout:7/179: creat de/d33/f42 x:0 0 0 2023-12-12T11:51:47.986 INFO:tasks.workunit.client.0.smithi063.stdout:5/173: creat d7/d28/f2f x:0 0 0 2023-12-12T11:51:47.986 INFO:tasks.workunit.client.0.smithi063.stdout:2/156: dwrite d0/f6 [0,4194304] 0 2023-12-12T11:51:47.987 INFO:tasks.workunit.client.1.smithi093.stdout:7/361: rename da/f57 to da/d15/d19/d4c/d6d/f7e 0 2023-12-12T11:51:47.989 INFO:tasks.workunit.client.1.smithi093.stdout:2/433: creat d5/d14/d2d/d4c/d54/d67/f90 x:0 0 0 2023-12-12T11:51:47.990 INFO:tasks.workunit.client.1.smithi093.stdout:2/434: write d5/d31/f64 [277721,84862] 0 2023-12-12T11:51:47.990 INFO:tasks.workunit.client.0.smithi063.stdout:9/192: symlink d7/d20/l3b 0 2023-12-12T11:51:47.990 INFO:tasks.workunit.client.1.smithi093.stdout:5/331: symlink d0/d7/d59/d62/l73 0 2023-12-12T11:51:47.995 INFO:tasks.workunit.client.1.smithi093.stdout:0/423: link d5/d21/d27/f5f d5/dd/d62/f83 0 2023-12-12T11:51:47.995 INFO:tasks.workunit.client.0.smithi063.stdout:4/216: rename d2/d8/d14 to d2/d47 0 2023-12-12T11:51:48.000 INFO:tasks.workunit.client.0.smithi063.stdout:0/192: mknod d0/d1a/d23/c3d 0 2023-12-12T11:51:48.003 INFO:tasks.workunit.client.1.smithi093.stdout:8/424: creat d3/d1a/d1f/d29/d30/f89 x:0 0 0 2023-12-12T11:51:48.003 INFO:tasks.workunit.client.1.smithi093.stdout:8/425: truncate d3/d1a/f83 759161 0 2023-12-12T11:51:48.003 INFO:tasks.workunit.client.1.smithi093.stdout:8/426: write d3/d1a/d1f/f2a [1359232,123683] 0 2023-12-12T11:51:48.008 INFO:tasks.workunit.client.1.smithi093.stdout:4/584: mkdir d0/d87/d79/d96/db5 0 2023-12-12T11:51:48.011 INFO:tasks.workunit.client.0.smithi063.stdout:5/174: truncate d7/f1a 4933265 0 2023-12-12T11:51:48.012 INFO:tasks.workunit.client.0.smithi063.stdout:5/175: write d7/f15 [229750,44817] 0 2023-12-12T11:51:48.012 INFO:tasks.workunit.client.0.smithi063.stdout:5/176: chown d7/d24/d27 381484793 1 2023-12-12T11:51:48.012 INFO:tasks.workunit.client.0.smithi063.stdout:5/177: chown d7/de/l21 385413 1 2023-12-12T11:51:48.012 INFO:tasks.workunit.client.1.smithi093.stdout:4/585: write d0/d36/d40/f4e [335313,93791] 0 2023-12-12T11:51:48.012 INFO:tasks.workunit.client.1.smithi093.stdout:4/586: chown d0/d31/l6d 71062 1 2023-12-12T11:51:48.012 INFO:tasks.workunit.client.1.smithi093.stdout:4/587: chown d0/d36/l80 957608 1 2023-12-12T11:51:48.014 INFO:tasks.workunit.client.1.smithi093.stdout:6/545: dwrite d0/f11 [4194304,4194304] 0 2023-12-12T11:51:48.015 INFO:tasks.workunit.client.1.smithi093.stdout:9/374: creat d1/d23/d24/d29/d43/d56/d68/f7e x:0 0 0 2023-12-12T11:51:48.017 INFO:tasks.workunit.client.0.smithi063.stdout:2/157: symlink d0/d1a/d1e/l36 0 2023-12-12T11:51:48.017 INFO:tasks.workunit.client.0.smithi063.stdout:2/158: creat d0/d1a/d26/f37 x:0 0 0 2023-12-12T11:51:48.018 INFO:tasks.workunit.client.1.smithi093.stdout:3/397: getdents df/d36/d3d 0 2023-12-12T11:51:48.018 INFO:tasks.workunit.client.0.smithi063.stdout:7/180: dread de/f13 [0,4194304] 0 2023-12-12T11:51:48.022 INFO:tasks.workunit.client.1.smithi093.stdout:1/401: rename d4/d1a/d1b/d26/d31/f38 to d4/d1a/d73/f87 0 2023-12-12T11:51:48.022 INFO:tasks.workunit.client.1.smithi093.stdout:1/402: write d4/f8 [4939053,26056] 0 2023-12-12T11:51:48.026 INFO:tasks.workunit.client.0.smithi063.stdout:8/273: rename d4/l1b to d4/d24/d38/l50 0 2023-12-12T11:51:48.026 INFO:tasks.workunit.client.0.smithi063.stdout:8/274: write d4/de/f43 [669168,18205] 0 2023-12-12T11:51:48.026 INFO:tasks.workunit.client.0.smithi063.stdout:8/275: fdatasync d4/de/f41 0 2023-12-12T11:51:48.026 INFO:tasks.workunit.client.0.smithi063.stdout:4/217: write d2/d8/fa [4390342,108142] 0 2023-12-12T11:51:48.030 INFO:tasks.workunit.client.1.smithi093.stdout:7/362: symlink da/d15/d19/d4c/l7f 0 2023-12-12T11:51:48.030 INFO:tasks.workunit.client.1.smithi093.stdout:7/363: stat da/de/d46/d4f/f62 0 2023-12-12T11:51:48.030 INFO:tasks.workunit.client.1.smithi093.stdout:7/364: truncate da/d15/d19/f7c 1033045 0 2023-12-12T11:51:48.032 INFO:tasks.workunit.client.0.smithi063.stdout:5/178: creat d7/de/f30 x:0 0 0 2023-12-12T11:51:48.032 INFO:tasks.workunit.client.1.smithi093.stdout:2/435: unlink d5/d14/d2d/d12/d25/c79 0 2023-12-12T11:51:48.032 INFO:tasks.workunit.client.1.smithi093.stdout:2/436: write d5/d14/d2d/f1e [2009155,72005] 0 2023-12-12T11:51:48.032 INFO:tasks.workunit.client.1.smithi093.stdout:5/332: creat d0/d7/d36/d29/d44/f74 x:0 0 0 2023-12-12T11:51:48.033 INFO:tasks.workunit.client.1.smithi093.stdout:6/546: dread d0/d7b/fb5 [0,4194304] 0 2023-12-12T11:51:48.033 INFO:tasks.workunit.client.1.smithi093.stdout:6/547: creat d0/da/d32/d39/d5b/fce x:0 0 0 2023-12-12T11:51:48.033 INFO:tasks.workunit.client.1.smithi093.stdout:6/548: readlink d0/l6 0 2023-12-12T11:51:48.034 INFO:tasks.workunit.client.1.smithi093.stdout:0/424: mknod d5/d21/d2f/d54/d7e/c84 0 2023-12-12T11:51:48.036 INFO:tasks.workunit.client.1.smithi093.stdout:1/403: dread d4/d1a/d73/f50 [0,4194304] 0 2023-12-12T11:51:48.038 INFO:tasks.workunit.client.0.smithi063.stdout:3/155: dwrite f0 [4194304,4194304] 0 2023-12-12T11:51:48.038 INFO:tasks.workunit.client.0.smithi063.stdout:3/156: fdatasync d4/df/f19 0 2023-12-12T11:51:48.038 INFO:tasks.workunit.client.0.smithi063.stdout:3/157: write d4/df/f1e [1903081,18897] 0 2023-12-12T11:51:48.038 INFO:tasks.workunit.client.0.smithi063.stdout:2/159: symlink d0/d11/l38 0 2023-12-12T11:51:48.041 INFO:tasks.workunit.client.0.smithi063.stdout:7/181: mkdir de/d34/d43 0 2023-12-12T11:51:48.045 INFO:tasks.workunit.client.0.smithi063.stdout:8/276: mkdir d4/de/d11/d51 0 2023-12-12T11:51:48.045 INFO:tasks.workunit.client.0.smithi063.stdout:8/277: write d4/de/f13 [15317,4541] 0 2023-12-12T11:51:48.048 INFO:tasks.workunit.client.1.smithi093.stdout:4/588: mknod d0/d31/d5c/cb6 0 2023-12-12T11:51:48.048 INFO:tasks.workunit.client.0.smithi063.stdout:0/193: dwrite d0/d7/d27/d1f/f30 [0,4194304] 0 2023-12-12T11:51:48.049 INFO:tasks.workunit.client.0.smithi063.stdout:4/218: mkdir d2/d48 0 2023-12-12T11:51:48.050 INFO:tasks.workunit.client.0.smithi063.stdout:4/219: stat d2/d17/d41/f44 0 2023-12-12T11:51:48.050 INFO:tasks.workunit.client.0.smithi063.stdout:4/220: chown d2/d8/l36 203958 1 2023-12-12T11:51:48.051 INFO:tasks.workunit.client.0.smithi063.stdout:5/179: mknod d7/d24/d27/c31 0 2023-12-12T11:51:48.052 INFO:tasks.workunit.client.1.smithi093.stdout:3/398: rmdir df/d30 39 2023-12-12T11:51:48.053 INFO:tasks.workunit.client.1.smithi093.stdout:3/399: write df/d22/d49/d69/d78/f7d [224035,58104] 0 2023-12-12T11:51:48.057 INFO:tasks.workunit.client.1.smithi093.stdout:7/365: rmdir da/de/d46 39 2023-12-12T11:51:48.059 INFO:tasks.workunit.client.1.smithi093.stdout:7/366: truncate da/d15/d19/d4c/d6d/f7e 210825 0 2023-12-12T11:51:48.060 INFO:tasks.workunit.client.0.smithi063.stdout:3/158: unlink d4/df/f1e 0 2023-12-12T11:51:48.062 INFO:tasks.workunit.client.0.smithi063.stdout:3/159: creat d4/df/d1a/d1c/f2d x:0 0 0 2023-12-12T11:51:48.062 INFO:tasks.workunit.client.0.smithi063.stdout:3/160: creat d4/df/d1a/f2e x:0 0 0 2023-12-12T11:51:48.063 INFO:tasks.workunit.client.1.smithi093.stdout:4/589: dread d0/ff [4194304,4194304] 0 2023-12-12T11:51:48.065 INFO:tasks.workunit.client.0.smithi063.stdout:7/182: mkdir de/d33/d41/d44 0 2023-12-12T11:51:48.067 INFO:tasks.workunit.client.1.smithi093.stdout:2/437: mknod d5/d14/d2d/d12/d25/d7a/c91 0 2023-12-12T11:51:48.071 INFO:tasks.workunit.client.1.smithi093.stdout:8/427: write d3/d8/fc [1436026,99149] 0 2023-12-12T11:51:48.071 INFO:tasks.workunit.client.1.smithi093.stdout:5/333: rename d0/d7/d36/d38/f49 to d0/d3b/f75 0 2023-12-12T11:51:48.072 INFO:tasks.workunit.client.0.smithi063.stdout:5/180: read d7/f1a [2454076,105524] 0 2023-12-12T11:51:48.072 INFO:tasks.workunit.client.0.smithi063.stdout:5/181: chown d7/de/f25 2037607 1 2023-12-12T11:51:48.072 INFO:tasks.workunit.client.0.smithi063.stdout:5/182: readlink d7/l1c 0 2023-12-12T11:51:48.073 INFO:tasks.workunit.client.0.smithi063.stdout:8/278: mkdir d4/d29/d52 0 2023-12-12T11:51:48.079 INFO:tasks.workunit.client.1.smithi093.stdout:6/549: symlink d0/da/lcf 0 2023-12-12T11:51:48.079 INFO:tasks.workunit.client.1.smithi093.stdout:6/550: fsync d0/d7b/f94 0 2023-12-12T11:51:48.086 INFO:tasks.workunit.client.1.smithi093.stdout:0/425: link d5/dd/d33/f46 d5/d4d/f85 0 2023-12-12T11:51:48.089 INFO:tasks.workunit.client.1.smithi093.stdout:9/375: creat d1/d12/d1f/d3d/d57/d63/f7f x:0 0 0 2023-12-12T11:51:48.090 INFO:tasks.workunit.client.1.smithi093.stdout:8/428: dread d3/d1a/f44 [0,4194304] 0 2023-12-12T11:51:48.093 INFO:tasks.workunit.client.1.smithi093.stdout:3/400: unlink df/d22/d49/c80 0 2023-12-12T11:51:48.093 INFO:tasks.workunit.client.1.smithi093.stdout:3/401: fsync df/d22/f6d 0 2023-12-12T11:51:48.093 INFO:tasks.workunit.client.1.smithi093.stdout:3/402: fdatasync df/d30/d33/f45 0 2023-12-12T11:51:48.094 INFO:tasks.workunit.client.1.smithi093.stdout:7/367: mkdir da/d15/d59/d80 0 2023-12-12T11:51:48.095 INFO:tasks.workunit.client.1.smithi093.stdout:4/590: mkdir d0/d31/d89/da1/db7 0 2023-12-12T11:51:48.098 INFO:tasks.workunit.client.0.smithi063.stdout:0/194: getdents d0/d7 0 2023-12-12T11:51:48.098 INFO:tasks.workunit.client.0.smithi063.stdout:0/195: write d0/d7/ff [22285,7356] 0 2023-12-12T11:51:48.105 INFO:tasks.workunit.client.1.smithi093.stdout:4/591: dread d0/d36/d49/f4a [0,4194304] 0 2023-12-12T11:51:48.105 INFO:tasks.workunit.client.0.smithi063.stdout:4/221: dwrite d2/d17/d41/f45 [4194304,4194304] 0 2023-12-12T11:51:48.105 INFO:tasks.workunit.client.0.smithi063.stdout:3/161: symlink d4/df/l2f 0 2023-12-12T11:51:48.109 INFO:tasks.workunit.client.0.smithi063.stdout:8/279: rmdir d4/d29 39 2023-12-12T11:51:48.111 INFO:tasks.workunit.client.1.smithi093.stdout:2/438: link l3 d5/d31/l92 0 2023-12-12T11:51:48.111 INFO:tasks.workunit.client.1.smithi093.stdout:2/439: readlink d5/d14/d2d/d12/d25/l3e 0 2023-12-12T11:51:48.111 INFO:tasks.workunit.client.1.smithi093.stdout:1/404: rename d4/d1a/d73/f87 to d4/d1c/f88 0 2023-12-12T11:51:48.111 INFO:tasks.workunit.client.1.smithi093.stdout:1/405: fsync d4/f25 0 2023-12-12T11:51:48.111 INFO:tasks.workunit.client.1.smithi093.stdout:6/551: mkdir d0/da/d14/d21/dd0 0 2023-12-12T11:51:48.111 INFO:tasks.workunit.client.1.smithi093.stdout:9/376: dread d1/d23/d24/d29/d43/f48 [0,4194304] 0 2023-12-12T11:51:48.118 INFO:tasks.workunit.client.1.smithi093.stdout:4/592: dread d0/f33 [0,4194304] 0 2023-12-12T11:51:48.119 INFO:tasks.workunit.client.1.smithi093.stdout:0/426: dread d5/dd/f4f [4194304,4194304] 0 2023-12-12T11:51:48.119 INFO:tasks.workunit.client.1.smithi093.stdout:0/427: chown d5/d21/d27/d3a/c74 465407579 1 2023-12-12T11:51:48.121 INFO:tasks.workunit.client.0.smithi063.stdout:4/222: getdents d2/d47 0 2023-12-12T11:51:48.121 INFO:tasks.workunit.client.1.smithi093.stdout:3/403: mknod df/d36/c81 0 2023-12-12T11:51:48.121 INFO:tasks.workunit.client.1.smithi093.stdout:3/404: chown df/d25/l34 3523 1 2023-12-12T11:51:48.121 INFO:tasks.workunit.client.1.smithi093.stdout:3/405: truncate df/f68 726678 0 2023-12-12T11:51:48.122 INFO:tasks.workunit.client.0.smithi063.stdout:3/162: write d4/df/d1a/f2b [930780,101967] 0 2023-12-12T11:51:48.122 INFO:tasks.workunit.client.0.smithi063.stdout:5/183: rmdir d7/d28 39 2023-12-12T11:51:48.123 INFO:tasks.workunit.client.1.smithi093.stdout:7/368: mkdir da/de/d81 0 2023-12-12T11:51:48.123 INFO:tasks.workunit.client.0.smithi063.stdout:8/280: creat d4/de/f53 x:0 0 0 2023-12-12T11:51:48.126 INFO:tasks.workunit.client.0.smithi063.stdout:5/184: symlink d7/d10/d2b/l32 0 2023-12-12T11:51:48.127 INFO:tasks.workunit.client.0.smithi063.stdout:8/281: stat d4/de/d32/c3f 0 2023-12-12T11:51:48.127 INFO:tasks.workunit.client.0.smithi063.stdout:8/282: write d4/de/d11/f18 [1312972,82667] 0 2023-12-12T11:51:48.133 INFO:tasks.workunit.client.1.smithi093.stdout:2/440: unlink d5/d14/d27/f41 0 2023-12-12T11:51:48.134 INFO:tasks.workunit.client.0.smithi063.stdout:3/163: symlink d4/d23/l30 0 2023-12-12T11:51:48.134 INFO:tasks.workunit.client.0.smithi063.stdout:3/164: creat d4/df/d1a/f31 x:0 0 0 2023-12-12T11:51:48.135 INFO:tasks.workunit.client.1.smithi093.stdout:1/406: rename d4/f61 to d4/d1a/d1b/d26/d65/d6f/f89 0 2023-12-12T11:51:48.135 INFO:tasks.workunit.client.1.smithi093.stdout:1/407: chown d4/c45 7604499 1 2023-12-12T11:51:48.136 INFO:tasks.workunit.client.1.smithi093.stdout:0/428: creat d5/d41/d77/f86 x:0 0 0 2023-12-12T11:51:48.137 INFO:tasks.workunit.client.1.smithi093.stdout:0/429: readlink d5/d21/l2d 0 2023-12-12T11:51:48.139 INFO:tasks.workunit.client.0.smithi063.stdout:3/165: chown d4/f2a 16183 1 2023-12-12T11:51:48.140 INFO:tasks.workunit.client.0.smithi063.stdout:3/166: read d4/df/f19 [3870725,80652] 0 2023-12-12T11:51:48.140 INFO:tasks.workunit.client.0.smithi063.stdout:3/167: write d4/df/d1a/f2e [808133,40075] 0 2023-12-12T11:51:48.140 INFO:tasks.workunit.client.1.smithi093.stdout:3/406: symlink df/d36/d3d/d59/d72/l82 0 2023-12-12T11:51:48.141 INFO:tasks.workunit.client.1.smithi093.stdout:2/441: link d5/d14/f4f d5/d14/d2d/d4c/d54/d67/d69/d6c/f93 0 2023-12-12T11:51:48.142 INFO:tasks.workunit.client.1.smithi093.stdout:7/369: dread da/de/f44 [0,4194304] 0 2023-12-12T11:51:48.142 INFO:tasks.workunit.client.1.smithi093.stdout:1/408: creat d4/d1a/d1b/d26/d65/f8a x:0 0 0 2023-12-12T11:51:48.143 INFO:tasks.workunit.client.1.smithi093.stdout:2/442: mknod d5/d14/d2d/c94 0 2023-12-12T11:51:48.162 INFO:tasks.workunit.client.0.smithi063.stdout:3/168: dread d4/f7 [0,4194304] 0 2023-12-12T11:51:48.166 INFO:tasks.workunit.client.1.smithi093.stdout:3/407: dread df/d36/f41 [0,4194304] 0 2023-12-12T11:51:48.168 INFO:tasks.workunit.client.1.smithi093.stdout:3/408: link df/c1d df/d25/c83 0 2023-12-12T11:51:48.169 INFO:tasks.workunit.client.1.smithi093.stdout:3/409: rename df/d22/c24 to df/d22/c84 0 2023-12-12T11:51:48.172 INFO:tasks.workunit.client.1.smithi093.stdout:3/410: mkdir df/d25/d2c/d85 0 2023-12-12T11:51:48.174 INFO:tasks.workunit.client.1.smithi093.stdout:3/411: creat df/f86 x:0 0 0 2023-12-12T11:51:48.175 INFO:tasks.workunit.client.0.smithi063.stdout:5/185: dread d7/d24/f2a [0,4194304] 0 2023-12-12T11:51:48.175 INFO:tasks.workunit.client.0.smithi063.stdout:5/186: truncate d7/d10/f1b 584664 0 2023-12-12T11:51:48.175 INFO:tasks.workunit.client.0.smithi063.stdout:5/187: creat d7/d10/f33 x:0 0 0 2023-12-12T11:51:48.175 INFO:tasks.workunit.client.1.smithi093.stdout:1/409: dread d4/d1a/d73/f50 [0,4194304] 0 2023-12-12T11:51:48.176 INFO:tasks.workunit.client.1.smithi093.stdout:1/410: fsync d4/dc/f28 0 2023-12-12T11:51:48.176 INFO:tasks.workunit.client.1.smithi093.stdout:1/411: truncate d4/d1a/d1b/d26/f7d 858452 0 2023-12-12T11:51:48.176 INFO:tasks.workunit.client.1.smithi093.stdout:3/412: creat df/d36/d3d/d59/d72/f87 x:0 0 0 2023-12-12T11:51:48.176 INFO:tasks.workunit.client.1.smithi093.stdout:3/413: readlink df/d22/d49/d69/l76 0 2023-12-12T11:51:48.177 INFO:tasks.workunit.client.1.smithi093.stdout:3/414: chown df/d36/d3d/d6f 564743333 1 2023-12-12T11:51:48.177 INFO:tasks.workunit.client.1.smithi093.stdout:3/415: chown ce 2046 1 2023-12-12T11:51:48.177 INFO:tasks.workunit.client.1.smithi093.stdout:3/416: fdatasync df/d25/f44 0 2023-12-12T11:51:48.178 INFO:tasks.workunit.client.1.smithi093.stdout:1/412: creat d4/d1a/d83/f8b x:0 0 0 2023-12-12T11:51:48.178 INFO:tasks.workunit.client.1.smithi093.stdout:3/417: stat df/c1b 0 2023-12-12T11:51:48.178 INFO:tasks.workunit.client.1.smithi093.stdout:1/413: fsync d4/d1a/d1b/f3a 0 2023-12-12T11:51:48.180 INFO:tasks.workunit.client.1.smithi093.stdout:3/418: link df/c1b df/d30/c88 0 2023-12-12T11:51:48.180 INFO:tasks.workunit.client.1.smithi093.stdout:3/419: truncate df/d22/d49/d69/f6a 1036348 0 2023-12-12T11:51:48.185 INFO:tasks.workunit.client.1.smithi093.stdout:1/414: symlink d4/d1c/d2a/l8c 0 2023-12-12T11:51:48.186 INFO:tasks.workunit.client.1.smithi093.stdout:1/415: write d4/d1c/d2a/f4b [110170,123283] 0 2023-12-12T11:51:48.186 INFO:tasks.workunit.client.1.smithi093.stdout:1/416: chown d4/d1c/f6d 0 1 2023-12-12T11:51:48.188 INFO:tasks.workunit.client.1.smithi093.stdout:2/443: dread d5/d14/d27/f36 [0,4194304] 0 2023-12-12T11:51:48.188 INFO:tasks.workunit.client.0.smithi063.stdout:5/188: dread d7/f15 [0,4194304] 0 2023-12-12T11:51:48.190 INFO:tasks.workunit.client.1.smithi093.stdout:9/377: dread d1/d12/d1f/d32/f3f [0,4194304] 0 2023-12-12T11:51:48.193 INFO:tasks.workunit.client.1.smithi093.stdout:6/552: dread d0/d52/dbc/fc2 [0,4194304] 0 2023-12-12T11:51:48.193 INFO:tasks.workunit.client.0.smithi063.stdout:8/283: dread f3 [0,4194304] 0 2023-12-12T11:51:48.193 INFO:tasks.workunit.client.0.smithi063.stdout:5/189: creat d7/d10/d2b/f34 x:0 0 0 2023-12-12T11:51:48.195 INFO:tasks.workunit.client.1.smithi093.stdout:9/378: write d1/d12/d1f/d3d/d57/f66 [931423,37534] 0 2023-12-12T11:51:48.197 INFO:tasks.workunit.client.1.smithi093.stdout:3/420: dread df/d36/f63 [0,4194304] 0 2023-12-12T11:51:48.201 INFO:tasks.workunit.client.1.smithi093.stdout:6/553: rename d0/da/d14/f66 to d0/da/d14/d21/fd1 0 2023-12-12T11:51:48.203 INFO:tasks.workunit.client.0.smithi063.stdout:4/223: dwrite d2/f40 [0,4194304] 0 2023-12-12T11:51:48.204 INFO:tasks.workunit.client.0.smithi063.stdout:5/190: unlink d7/d24/f2a 0 2023-12-12T11:51:48.204 INFO:tasks.workunit.client.0.smithi063.stdout:5/191: chown d7/d10/f1b 23340355 1 2023-12-12T11:51:48.204 INFO:tasks.workunit.client.1.smithi093.stdout:0/430: dwrite d5/dd/d33/f5e [0,4194304] 0 2023-12-12T11:51:48.204 INFO:tasks.workunit.client.0.smithi063.stdout:5/192: fdatasync d7/d10/f14 0 2023-12-12T11:51:48.206 INFO:tasks.workunit.client.1.smithi093.stdout:1/417: dread d4/dc/f28 [0,4194304] 0 2023-12-12T11:51:48.207 INFO:tasks.workunit.client.1.smithi093.stdout:7/370: dwrite da/d15/d19/f7c [0,4194304] 0 2023-12-12T11:51:48.207 INFO:tasks.workunit.client.1.smithi093.stdout:1/418: write d4/d1a/d73/f50 [38876,98792] 0 2023-12-12T11:51:48.207 INFO:tasks.workunit.client.1.smithi093.stdout:1/419: fdatasync d4/d1c/f21 0 2023-12-12T11:51:48.208 INFO:tasks.workunit.client.1.smithi093.stdout:9/379: creat d1/d23/f80 x:0 0 0 2023-12-12T11:51:48.211 INFO:tasks.workunit.client.1.smithi093.stdout:8/429: dwrite d3/d1a/d1f/d29/f32 [0,4194304] 0 2023-12-12T11:51:48.211 INFO:tasks.workunit.client.1.smithi093.stdout:8/430: stat d3/d1a/d1f/d29/d30/f89 0 2023-12-12T11:51:48.211 INFO:tasks.workunit.client.1.smithi093.stdout:8/431: fdatasync d3/d1a/d1f/d29/d30/d58/f85 0 2023-12-12T11:51:48.211 INFO:tasks.workunit.client.1.smithi093.stdout:6/554: dread d0/da/d14/d21/f5f [0,4194304] 0 2023-12-12T11:51:48.213 INFO:tasks.workunit.client.1.smithi093.stdout:2/444: dread d5/f19 [0,4194304] 0 2023-12-12T11:51:48.213 INFO:tasks.workunit.client.1.smithi093.stdout:2/445: read d5/d14/d2d/d12/d44/f4d [284164,6460] 0 2023-12-12T11:51:48.214 INFO:tasks.workunit.client.1.smithi093.stdout:3/421: link df/d36/d3d/d42/f53 df/d22/f89 0 2023-12-12T11:51:48.215 INFO:tasks.workunit.client.0.smithi063.stdout:4/224: creat d2/d8/f49 x:0 0 0 2023-12-12T11:51:48.215 INFO:tasks.workunit.client.0.smithi063.stdout:4/225: fsync d2/d17/d41/f45 0 2023-12-12T11:51:48.215 INFO:tasks.workunit.client.0.smithi063.stdout:4/226: stat d2/c13 0 2023-12-12T11:51:48.218 INFO:tasks.workunit.client.0.smithi063.stdout:7/183: dwrite de/f13 [0,4194304] 0 2023-12-12T11:51:48.222 INFO:tasks.workunit.client.0.smithi063.stdout:5/193: mkdir d7/d10/d35 0 2023-12-12T11:51:48.222 INFO:tasks.workunit.client.0.smithi063.stdout:5/194: creat d7/d24/f36 x:0 0 0 2023-12-12T11:51:48.225 INFO:tasks.workunit.client.1.smithi093.stdout:0/431: truncate d5/dd/d62/f69 2586046 0 2023-12-12T11:51:48.225 INFO:tasks.workunit.client.1.smithi093.stdout:0/432: fdatasync d5/d21/d27/d3a/f56 0 2023-12-12T11:51:48.230 INFO:tasks.workunit.client.1.smithi093.stdout:8/432: write d3/d1a/d1f/d29/d30/d58/d76/f86 [2215507,121333] 0 2023-12-12T11:51:48.231 INFO:tasks.workunit.client.0.smithi063.stdout:7/184: mkdir de/d34/d43/d45 0 2023-12-12T11:51:48.231 INFO:tasks.workunit.client.0.smithi063.stdout:7/185: creat de/d22/d2b/f46 x:0 0 0 2023-12-12T11:51:48.232 INFO:tasks.workunit.client.1.smithi093.stdout:7/371: rename da/de/l49 to da/d15/d19/d4c/l82 0 2023-12-12T11:51:48.233 INFO:tasks.workunit.client.1.smithi093.stdout:7/372: readlink da/l28 0 2023-12-12T11:51:48.238 INFO:tasks.workunit.client.0.smithi063.stdout:3/169: truncate f0 6519920 0 2023-12-12T11:51:48.238 INFO:tasks.workunit.client.0.smithi063.stdout:3/170: write d4/df/d1a/d1c/f29 [4854968,35072] 0 2023-12-12T11:51:48.239 INFO:tasks.workunit.client.1.smithi093.stdout:1/420: truncate d4/dc/f5c 617677 0 2023-12-12T11:51:48.240 INFO:tasks.workunit.client.1.smithi093.stdout:9/380: symlink d1/d23/d24/d29/d43/l81 0 2023-12-12T11:51:48.241 INFO:tasks.workunit.client.1.smithi093.stdout:6/555: dread d0/d52/d7e/d42/f8b [0,4194304] 0 2023-12-12T11:51:48.241 INFO:tasks.workunit.client.1.smithi093.stdout:6/556: dread - d0/da/d32/fa1 zero size 2023-12-12T11:51:48.250 INFO:tasks.workunit.client.0.smithi063.stdout:4/227: dwrite d2/d8/f26 [0,4194304] 0 2023-12-12T11:51:48.267 INFO:tasks.workunit.client.1.smithi093.stdout:3/422: mknod df/d25/d6b/c8a 0 2023-12-12T11:51:48.268 INFO:tasks.workunit.client.1.smithi093.stdout:3/423: readlink df/d22/l35 0 2023-12-12T11:51:48.276 INFO:tasks.workunit.client.1.smithi093.stdout:0/433: mkdir d5/dd/d33/d87 0 2023-12-12T11:51:48.276 INFO:tasks.workunit.client.1.smithi093.stdout:8/433: mkdir d3/d1a/d1f/d29/d3a/d68/d8a 0 2023-12-12T11:51:48.277 INFO:tasks.workunit.client.1.smithi093.stdout:8/434: rename d3 to d3/d8/d8b 22 2023-12-12T11:51:48.283 INFO:tasks.workunit.client.1.smithi093.stdout:7/373: link da/de/c4a da/de/d46/d4f/c83 0 2023-12-12T11:51:48.292 INFO:tasks.workunit.client.1.smithi093.stdout:1/421: creat d4/dc/d7a/f8d x:0 0 0 2023-12-12T11:51:48.292 INFO:tasks.workunit.client.1.smithi093.stdout:1/422: write d4/d1a/d1b/d26/f27 [206054,45369] 0 2023-12-12T11:51:48.292 INFO:tasks.workunit.client.1.smithi093.stdout:1/423: getdents d4/d1a/d1b/d26/d82 0 2023-12-12T11:51:48.293 INFO:tasks.workunit.client.0.smithi063.stdout:5/195: read d7/f13 [2842485,24322] 0 2023-12-12T11:51:48.293 INFO:tasks.workunit.client.0.smithi063.stdout:5/196: readlink d7/de/l1d 0 2023-12-12T11:51:48.293 INFO:tasks.workunit.client.0.smithi063.stdout:7/186: symlink de/d34/d43/d45/l47 0 2023-12-12T11:51:48.294 INFO:tasks.workunit.client.0.smithi063.stdout:8/284: dwrite f0 [0,4194304] 0 2023-12-12T11:51:48.294 INFO:tasks.workunit.client.1.smithi093.stdout:9/381: dwrite d1/d23/f2a [0,4194304] 0 2023-12-12T11:51:48.294 INFO:tasks.workunit.client.1.smithi093.stdout:9/382: chown d1/f54 231 1 2023-12-12T11:51:48.294 INFO:tasks.workunit.client.1.smithi093.stdout:8/435: dread d3/d1a/f2b [0,4194304] 0 2023-12-12T11:51:48.294 INFO:tasks.workunit.client.1.smithi093.stdout:2/446: dwrite d5/d31/f4a [4194304,4194304] 0 2023-12-12T11:51:48.295 INFO:tasks.workunit.client.1.smithi093.stdout:2/447: creat d5/d46/d55/f95 x:0 0 0 2023-12-12T11:51:48.296 INFO:tasks.workunit.client.0.smithi063.stdout:8/285: read d4/de/d11/f18 [1278026,88525] 0 2023-12-12T11:51:48.296 INFO:tasks.workunit.client.1.smithi093.stdout:6/557: mkdir d0/da/d32/d39/d5b/dd2 0 2023-12-12T11:51:48.296 INFO:tasks.workunit.client.1.smithi093.stdout:6/558: fsync d0/da/d14/d38/d43/f9d 0 2023-12-12T11:51:48.297 INFO:tasks.workunit.client.1.smithi093.stdout:6/559: chown d0/c6c 1 1 2023-12-12T11:51:48.305 INFO:tasks.workunit.client.0.smithi063.stdout:4/228: mknod d2/d48/c4a 0 2023-12-12T11:51:48.306 INFO:tasks.workunit.client.0.smithi063.stdout:5/197: symlink d7/d24/l37 0 2023-12-12T11:51:48.310 INFO:tasks.workunit.client.1.smithi093.stdout:8/436: write d3/d8/f23 [584332,51091] 0 2023-12-12T11:51:48.312 INFO:tasks.workunit.client.0.smithi063.stdout:8/286: stat d4/d24/c37 0 2023-12-12T11:51:48.312 INFO:tasks.workunit.client.0.smithi063.stdout:8/287: fsync d4/de/f30 0 2023-12-12T11:51:48.312 INFO:tasks.workunit.client.0.smithi063.stdout:8/288: truncate d4/de/d32/d36/f3a 4426815 0 2023-12-12T11:51:48.312 INFO:tasks.workunit.client.0.smithi063.stdout:8/289: read - d4/de/f4a zero size 2023-12-12T11:51:48.314 INFO:tasks.workunit.client.1.smithi093.stdout:0/434: mknod d5/dd/d14/d26/d58/d64/c88 0 2023-12-12T11:51:48.315 INFO:tasks.workunit.client.0.smithi063.stdout:5/198: mknod d7/d24/c38 0 2023-12-12T11:51:48.315 INFO:tasks.workunit.client.0.smithi063.stdout:5/199: dread - d7/de/f30 zero size 2023-12-12T11:51:48.316 INFO:tasks.workunit.client.1.smithi093.stdout:7/374: fdatasync da/d15/f2c 0 2023-12-12T11:51:48.318 INFO:tasks.workunit.client.0.smithi063.stdout:7/187: mknod de/d22/c48 0 2023-12-12T11:51:48.318 INFO:tasks.workunit.client.0.smithi063.stdout:7/188: stat de/d22/d2b/l2e 0 2023-12-12T11:51:48.321 INFO:tasks.workunit.client.1.smithi093.stdout:3/424: dwrite df/d36/d3d/d42/f53 [0,4194304] 0 2023-12-12T11:51:48.322 INFO:tasks.workunit.client.0.smithi063.stdout:3/171: dwrite d4/df/d1a/d1c/f2d [0,4194304] 0 2023-12-12T11:51:48.324 INFO:tasks.workunit.client.1.smithi093.stdout:1/424: creat d4/d1a/d1b/f8e x:0 0 0 2023-12-12T11:51:48.325 INFO:tasks.workunit.client.0.smithi063.stdout:8/290: rmdir d4/de/d11/d51 0 2023-12-12T11:51:48.327 INFO:tasks.workunit.client.0.smithi063.stdout:7/189: mknod de/d33/d41/c49 0 2023-12-12T11:51:48.332 INFO:tasks.workunit.client.1.smithi093.stdout:9/383: link d1/d12/d1f/d32/f49 d1/d12/d1f/d32/d42/f82 0 2023-12-12T11:51:48.332 INFO:tasks.workunit.client.1.smithi093.stdout:9/384: chown d1/d12/d1f/d3d 195 1 2023-12-12T11:51:48.333 INFO:tasks.workunit.client.0.smithi063.stdout:5/200: dread d7/de/f20 [0,4194304] 0 2023-12-12T11:51:48.346 INFO:tasks.workunit.client.1.smithi093.stdout:2/448: mkdir d5/d14/d2d/d96 0 2023-12-12T11:51:48.346 INFO:tasks.workunit.client.1.smithi093.stdout:2/449: chown d5/d14/d2d/f1c 0 1 2023-12-12T11:51:48.349 INFO:tasks.workunit.client.0.smithi063.stdout:4/229: dwrite d2/d8/f49 [0,4194304] 0 2023-12-12T11:51:48.352 INFO:tasks.workunit.client.1.smithi093.stdout:8/437: symlink d3/d1a/d1f/d29/d30/d58/l8c 0 2023-12-12T11:51:48.352 INFO:tasks.workunit.client.0.smithi063.stdout:7/190: mkdir de/d22/d2b/d4a 0 2023-12-12T11:51:48.354 INFO:tasks.workunit.client.0.smithi063.stdout:1/161: sync 2023-12-12T11:51:48.356 INFO:tasks.workunit.client.1.smithi093.stdout:0/435: creat d5/dd/d14/d26/d58/d64/d7c/f89 x:0 0 0 2023-12-12T11:51:48.356 INFO:tasks.workunit.client.1.smithi093.stdout:0/436: chown d5/dd/d33/f5e 2269 1 2023-12-12T11:51:48.358 INFO:tasks.workunit.client.1.smithi093.stdout:7/375: mknod da/de/d78/c84 0 2023-12-12T11:51:48.358 INFO:tasks.workunit.client.0.smithi063.stdout:5/201: creat d7/d10/d35/f39 x:0 0 0 2023-12-12T11:51:48.359 INFO:tasks.workunit.client.0.smithi063.stdout:5/202: readlink d7/lc 0 2023-12-12T11:51:48.359 INFO:tasks.workunit.client.0.smithi063.stdout:3/172: mknod d4/c32 0 2023-12-12T11:51:48.359 INFO:tasks.workunit.client.0.smithi063.stdout:8/291: mknod d4/de/c54 0 2023-12-12T11:51:48.368 INFO:tasks.workunit.client.1.smithi093.stdout:3/425: symlink df/d36/d3d/d59/d72/d79/l8b 0 2023-12-12T11:51:48.370 INFO:tasks.workunit.client.1.smithi093.stdout:7/376: write da/d2e/f79 [582718,6251] 0 2023-12-12T11:51:48.377 INFO:tasks.workunit.client.0.smithi063.stdout:1/162: truncate d3/f1a 2744999 0 2023-12-12T11:51:48.378 INFO:tasks.workunit.client.1.smithi093.stdout:1/425: link d4/d1a/d1b/d26/f7d d4/d1a/d1b/f8f 0 2023-12-12T11:51:48.380 INFO:tasks.workunit.client.0.smithi063.stdout:5/203: write d7/f12 [1069485,51007] 0 2023-12-12T11:51:48.380 INFO:tasks.workunit.client.0.smithi063.stdout:5/204: dread - d7/d24/f2d zero size 2023-12-12T11:51:48.387 INFO:tasks.workunit.client.1.smithi093.stdout:3/426: unlink df/d36/d3d/d42/f5e 0 2023-12-12T11:51:48.390 INFO:tasks.workunit.client.1.smithi093.stdout:7/377: symlink da/d15/d19/l85 0 2023-12-12T11:51:48.392 INFO:tasks.workunit.client.0.smithi063.stdout:8/292: unlink f2 0 2023-12-12T11:51:48.395 INFO:tasks.workunit.client.1.smithi093.stdout:1/426: symlink d4/d1a/d1b/l90 0 2023-12-12T11:51:48.395 INFO:tasks.workunit.client.1.smithi093.stdout:5/334: sync 2023-12-12T11:51:48.395 INFO:tasks.workunit.client.1.smithi093.stdout:5/335: chown d0/d7/d8 6 1 2023-12-12T11:51:48.397 INFO:tasks.workunit.client.1.smithi093.stdout:6/560: rename d0/d7b to d0/da/d32/dd3 0 2023-12-12T11:51:48.400 INFO:tasks.workunit.client.0.smithi063.stdout:4/230: mknod d2/d8/c4b 0 2023-12-12T11:51:48.400 INFO:tasks.workunit.client.0.smithi063.stdout:4/231: write d2/d8/f32 [4381798,43572] 0 2023-12-12T11:51:48.401 INFO:tasks.workunit.client.0.smithi063.stdout:4/232: stat d2/d48/c4a 0 2023-12-12T11:51:48.402 INFO:tasks.workunit.client.1.smithi093.stdout:5/336: mkdir d0/d7/d36/d29/d76 0 2023-12-12T11:51:48.402 INFO:tasks.workunit.client.1.smithi093.stdout:5/337: fsync d0/d3b/f63 0 2023-12-12T11:51:48.402 INFO:tasks.workunit.client.1.smithi093.stdout:5/338: getdents d0/d3b/d66 0 2023-12-12T11:51:48.402 INFO:tasks.workunit.client.1.smithi093.stdout:5/339: write d0/d7/d59/f2d [5168830,121025] 0 2023-12-12T11:51:48.402 INFO:tasks.workunit.client.1.smithi093.stdout:5/340: readlink d0/d7/d59/d48/l51 0 2023-12-12T11:51:48.407 INFO:tasks.workunit.client.1.smithi093.stdout:9/385: rename d1/d12/d1f/d32/d42/f5a to d1/d12/d1f/d3d/d57/d63/f83 0 2023-12-12T11:51:48.407 INFO:tasks.workunit.client.1.smithi093.stdout:9/386: dread - d1/d12/d1f/d3d/d5c/f7b zero size 2023-12-12T11:51:48.407 INFO:tasks.workunit.client.1.smithi093.stdout:9/387: creat d1/d12/d1f/d73/f84 x:0 0 0 2023-12-12T11:51:48.407 INFO:tasks.workunit.client.1.smithi093.stdout:9/388: fsync d1/d12/d1f/f27 0 2023-12-12T11:51:48.407 INFO:tasks.workunit.client.1.smithi093.stdout:9/389: fdatasync d1/d12/d1f/d3d/d57/f66 0 2023-12-12T11:51:48.407 INFO:tasks.workunit.client.1.smithi093.stdout:9/390: stat d1/d23/f40 0 2023-12-12T11:51:48.407 INFO:tasks.workunit.client.1.smithi093.stdout:9/391: chown d1/d12/d1f/c74 451742 1 2023-12-12T11:51:48.407 INFO:tasks.workunit.client.1.smithi093.stdout:3/427: dread df/d36/d3d/d42/f57 [0,4194304] 0 2023-12-12T11:51:48.408 INFO:tasks.workunit.client.1.smithi093.stdout:3/428: chown df/d25/d2c/d85 3873 1 2023-12-12T11:51:48.412 INFO:tasks.workunit.client.0.smithi063.stdout:4/233: mknod d2/c4c 0 2023-12-12T11:51:48.412 INFO:tasks.workunit.client.0.smithi063.stdout:4/234: chown d2/c21 0 1 2023-12-12T11:51:48.412 INFO:tasks.workunit.client.0.smithi063.stdout:4/235: read d2/d8/f32 [3752030,85882] 0 2023-12-12T11:51:48.412 INFO:tasks.workunit.client.0.smithi063.stdout:4/236: readlink d2/l24 0 2023-12-12T11:51:48.415 INFO:tasks.workunit.client.1.smithi093.stdout:5/341: unlink d0/d7/l12 0 2023-12-12T11:51:48.417 INFO:tasks.workunit.client.1.smithi093.stdout:9/392: getdents d1/d12/d1f/d3d/d57 0 2023-12-12T11:51:48.419 INFO:tasks.workunit.client.1.smithi093.stdout:3/429: mkdir df/d22/d49/d69/d8c 0 2023-12-12T11:51:48.419 INFO:tasks.workunit.client.0.smithi063.stdout:8/293: dread d4/de/d1e/f3c [0,4194304] 0 2023-12-12T11:51:48.420 INFO:tasks.workunit.client.1.smithi093.stdout:9/393: mkdir d1/d23/d24/d29/d43/d56/d85 0 2023-12-12T11:51:48.420 INFO:tasks.workunit.client.1.smithi093.stdout:9/394: readlink d1/d12/l13 0 2023-12-12T11:51:48.420 INFO:tasks.workunit.client.1.smithi093.stdout:9/395: chown d1/d12/c4b 0 1 2023-12-12T11:51:48.420 INFO:tasks.workunit.client.1.smithi093.stdout:3/430: mknod df/d25/d2c/c8d 0 2023-12-12T11:51:48.421 INFO:tasks.workunit.client.1.smithi093.stdout:6/561: write d0/d52/d7e/faf [2204879,43490] 0 2023-12-12T11:51:48.422 INFO:tasks.workunit.client.0.smithi063.stdout:8/294: truncate d4/de/f43 3821151 0 2023-12-12T11:51:48.425 INFO:tasks.workunit.client.1.smithi093.stdout:2/450: dwrite d5/d14/d2d/d12/d25/f30 [4194304,4194304] 0 2023-12-12T11:51:48.425 INFO:tasks.workunit.client.1.smithi093.stdout:2/451: creat d5/d14/d2d/d4c/d54/d67/d69/f97 x:0 0 0 2023-12-12T11:51:48.425 INFO:tasks.workunit.client.1.smithi093.stdout:1/427: dread d4/d1a/d1b/f8f [0,4194304] 0 2023-12-12T11:51:48.426 INFO:tasks.workunit.client.1.smithi093.stdout:1/428: chown d4/d1a/d1b/d26/f7d 0 1 2023-12-12T11:51:48.426 INFO:tasks.workunit.client.1.smithi093.stdout:7/378: dread da/d15/d2d/d2f/f3d [0,4194304] 0 2023-12-12T11:51:48.429 INFO:tasks.workunit.client.1.smithi093.stdout:9/396: truncate d1/d23/d24/d29/f2b 370860 0 2023-12-12T11:51:48.429 INFO:tasks.workunit.client.1.smithi093.stdout:9/397: truncate d1/d12/d1f/d32/f7a 670829 0 2023-12-12T11:51:48.431 INFO:tasks.workunit.client.1.smithi093.stdout:0/437: dwrite d5/dd/d14/d26/d58/f63 [0,4194304] 0 2023-12-12T11:51:48.431 INFO:tasks.workunit.client.1.smithi093.stdout:0/438: creat d5/dd/d14/d26/d58/f8a x:0 0 0 2023-12-12T11:51:48.438 INFO:tasks.workunit.client.0.smithi063.stdout:8/295: rename d4/d29 to d4/d55 0 2023-12-12T11:51:48.442 INFO:tasks.workunit.client.0.smithi063.stdout:5/205: dwrite d7/de/f20 [4194304,4194304] 0 2023-12-12T11:51:48.442 INFO:tasks.workunit.client.0.smithi063.stdout:5/206: write d7/f13 [4836464,47731] 0 2023-12-12T11:51:48.442 INFO:tasks.workunit.client.0.smithi063.stdout:5/207: write d7/de/f30 [498782,84662] 0 2023-12-12T11:51:48.445 INFO:tasks.workunit.client.0.smithi063.stdout:6/219: sync 2023-12-12T11:51:48.446 INFO:tasks.workunit.client.0.smithi063.stdout:8/296: symlink d4/d55/d52/l56 0 2023-12-12T11:51:48.449 INFO:tasks.workunit.client.1.smithi093.stdout:6/562: dread d0/da/d14/d38/d43/f5a [0,4194304] 0 2023-12-12T11:51:48.449 INFO:tasks.workunit.client.1.smithi093.stdout:6/563: read - d0/da/d14/d3a/d95/fb4 zero size 2023-12-12T11:51:48.449 INFO:tasks.workunit.client.1.smithi093.stdout:6/564: fsync d0/da/d14/d38/d43/f5a 0 2023-12-12T11:51:48.451 INFO:tasks.workunit.client.0.smithi063.stdout:4/237: fsync d2/d47/f3f 0 2023-12-12T11:51:48.451 INFO:tasks.workunit.client.0.smithi063.stdout:4/238: write d2/d8/f43 [376359,41488] 0 2023-12-12T11:51:48.451 INFO:tasks.workunit.client.0.smithi063.stdout:4/239: chown d2/c21 315 1 2023-12-12T11:51:48.452 INFO:tasks.workunit.client.1.smithi093.stdout:2/452: mkdir d5/d14/d2d/d12/d25/d7a/d7e/d98 0 2023-12-12T11:51:48.452 INFO:tasks.workunit.client.1.smithi093.stdout:2/453: write d5/d14/d2d/d12/d25/d7a/f81 [329964,10965] 0 2023-12-12T11:51:48.454 INFO:tasks.workunit.client.1.smithi093.stdout:1/429: truncate d4/d1a/d73/f4a 2362700 0 2023-12-12T11:51:48.457 INFO:tasks.workunit.client.1.smithi093.stdout:7/379: mknod da/d15/d2d/d2f/c86 0 2023-12-12T11:51:48.462 INFO:tasks.workunit.client.0.smithi063.stdout:6/220: unlink d9/f31 0 2023-12-12T11:51:48.462 INFO:tasks.workunit.client.0.smithi063.stdout:6/221: write d9/f24 [555153,118378] 0 2023-12-12T11:51:48.462 INFO:tasks.workunit.client.0.smithi063.stdout:6/222: creat d9/f4b x:0 0 0 2023-12-12T11:51:48.463 INFO:tasks.workunit.client.1.smithi093.stdout:9/398: rename d1/d12/l13 to d1/d23/d24/d29/d43/d56/d85/l86 0 2023-12-12T11:51:48.466 INFO:tasks.workunit.client.1.smithi093.stdout:4/593: sync 2023-12-12T11:51:48.470 INFO:tasks.workunit.client.0.smithi063.stdout:8/297: mkdir d4/de/d32/d36/d57 0 2023-12-12T11:51:48.482 INFO:tasks.workunit.client.0.smithi063.stdout:4/240: creat d2/d17/d41/f4d x:0 0 0 2023-12-12T11:51:48.482 INFO:tasks.workunit.client.0.smithi063.stdout:4/241: write d2/d47/f30 [436267,31700] 0 2023-12-12T11:51:48.487 INFO:tasks.workunit.client.0.smithi063.stdout:1/163: dwrite f2 [4194304,4194304] 0 2023-12-12T11:51:48.488 INFO:tasks.workunit.client.0.smithi063.stdout:1/164: write d3/db/d16/f32 [894124,85917] 0 2023-12-12T11:51:48.490 INFO:tasks.workunit.client.1.smithi093.stdout:4/594: write d0/d87/d79/d86/f8a [1311832,69829] 0 2023-12-12T11:51:48.495 INFO:tasks.workunit.client.0.smithi063.stdout:5/208: rmdir d7/d10/d2b 39 2023-12-12T11:51:48.495 INFO:tasks.workunit.client.0.smithi063.stdout:5/209: stat d7/d24/d27/c31 0 2023-12-12T11:51:48.501 INFO:tasks.workunit.client.1.smithi093.stdout:2/454: link d5/f49 d5/d14/d2d/d12/f99 0 2023-12-12T11:51:48.501 INFO:tasks.workunit.client.0.smithi063.stdout:7/191: dwrite fb [0,4194304] 0 2023-12-12T11:51:48.501 INFO:tasks.workunit.client.0.smithi063.stdout:8/298: mkdir d4/de/d11/d58 0 2023-12-12T11:51:48.505 INFO:tasks.workunit.client.0.smithi063.stdout:4/242: mkdir d2/d17/d4e 0 2023-12-12T11:51:48.507 INFO:tasks.workunit.client.1.smithi093.stdout:7/380: creat da/de/d46/d58/f87 x:0 0 0 2023-12-12T11:51:48.514 INFO:tasks.workunit.client.0.smithi063.stdout:1/165: mknod d3/db/c34 0 2023-12-12T11:51:48.515 INFO:tasks.workunit.client.0.smithi063.stdout:1/166: write d3/db/d16/f2d [550840,74208] 0 2023-12-12T11:51:48.516 INFO:tasks.workunit.client.1.smithi093.stdout:4/595: mkdir d0/d31/db8 0 2023-12-12T11:51:48.519 INFO:tasks.workunit.client.0.smithi063.stdout:3/173: dwrite d4/df/d1a/d1c/f29 [0,4194304] 0 2023-12-12T11:51:48.519 INFO:tasks.workunit.client.1.smithi093.stdout:3/431: dwrite df/d36/d3d/d59/f5c [0,4194304] 0 2023-12-12T11:51:48.520 INFO:tasks.workunit.client.0.smithi063.stdout:7/192: truncate f8 2409483 0 2023-12-12T11:51:48.522 INFO:tasks.workunit.client.1.smithi093.stdout:6/565: rmdir d0/da/d14/d3a 39 2023-12-12T11:51:48.522 INFO:tasks.workunit.client.1.smithi093.stdout:3/432: read df/d36/d3d/d42/f57 [335095,130420] 0 2023-12-12T11:51:48.525 INFO:tasks.workunit.client.1.smithi093.stdout:5/342: dwrite d0/d7/d8/f13 [0,4194304] 0 2023-12-12T11:51:48.526 INFO:tasks.workunit.client.1.smithi093.stdout:5/343: chown d0/d7/d8/c45 833613 1 2023-12-12T11:51:48.526 INFO:tasks.workunit.client.1.smithi093.stdout:5/344: readlink d0/d7/d8/l55 0 2023-12-12T11:51:48.526 INFO:tasks.workunit.client.1.smithi093.stdout:5/345: truncate d0/d7/d8/f5d 449166 0 2023-12-12T11:51:48.528 INFO:tasks.workunit.client.1.smithi093.stdout:0/439: dwrite d5/dd/d14/d26/f3f [0,4194304] 0 2023-12-12T11:51:48.529 INFO:tasks.workunit.client.1.smithi093.stdout:0/440: chown d5/dd/d14/d26/d58/d64 3118 1 2023-12-12T11:51:48.530 INFO:tasks.workunit.client.0.smithi063.stdout:8/299: rename d4/de/d1e/f20 to d4/d55/f59 0 2023-12-12T11:51:48.530 INFO:tasks.workunit.client.0.smithi063.stdout:4/243: mkdir d2/d48/d4f 0 2023-12-12T11:51:48.531 INFO:tasks.workunit.client.0.smithi063.stdout:1/167: mkdir d3/db/d16/d17/d19/d35 0 2023-12-12T11:51:48.531 INFO:tasks.workunit.client.0.smithi063.stdout:1/168: readlink d3/db/d12/l15 0 2023-12-12T11:51:48.531 INFO:tasks.workunit.client.0.smithi063.stdout:1/169: creat d3/db/d16/f36 x:0 0 0 2023-12-12T11:51:48.555 INFO:tasks.workunit.client.0.smithi063.stdout:5/210: dwrite d7/de/f25 [0,4194304] 0 2023-12-12T11:51:48.555 INFO:tasks.workunit.client.0.smithi063.stdout:5/211: write d7/d10/f1b [1113724,47047] 0 2023-12-12T11:51:48.560 INFO:tasks.workunit.client.1.smithi093.stdout:6/566: link d0/d52/d7e/f67 d0/da/d14/d38/fd4 0 2023-12-12T11:51:48.573 INFO:tasks.workunit.client.1.smithi093.stdout:7/381: dwrite da/de/f3e [0,4194304] 0 2023-12-12T11:51:48.573 INFO:tasks.workunit.client.1.smithi093.stdout:7/382: chown da/d15/f26 33392827 1 2023-12-12T11:51:48.574 INFO:tasks.workunit.client.1.smithi093.stdout:3/433: dwrite df/d30/d33/f3a [0,4194304] 0 2023-12-12T11:51:48.575 INFO:tasks.workunit.client.0.smithi063.stdout:8/300: dwrite d4/f22 [0,4194304] 0 2023-12-12T11:51:48.575 INFO:tasks.workunit.client.0.smithi063.stdout:8/301: chown d4/de/d1e/c25 238 1 2023-12-12T11:51:48.575 INFO:tasks.workunit.client.0.smithi063.stdout:8/302: chown d4/d24/d3e 21 1 2023-12-12T11:51:48.575 INFO:tasks.workunit.client.0.smithi063.stdout:8/303: fdatasync d4/de/d1e/f3c 0 2023-12-12T11:51:48.576 INFO:tasks.workunit.client.0.smithi063.stdout:3/174: mknod d4/df/c33 0 2023-12-12T11:51:48.580 INFO:tasks.workunit.client.0.smithi063.stdout:7/193: mkdir de/d39/d4b 0 2023-12-12T11:51:48.581 INFO:tasks.workunit.client.0.smithi063.stdout:7/194: dread - de/d33/f42 zero size 2023-12-12T11:51:48.581 INFO:tasks.workunit.client.0.smithi063.stdout:7/195: creat de/f4c x:0 0 0 2023-12-12T11:51:48.588 INFO:tasks.workunit.client.0.smithi063.stdout:4/244: mknod d2/d47/c50 0 2023-12-12T11:51:48.589 INFO:tasks.workunit.client.1.smithi093.stdout:6/567: mkdir d0/d52/d7e/d42/dd5 0 2023-12-12T11:51:48.590 INFO:tasks.workunit.client.1.smithi093.stdout:6/568: getdents d0/d52/d7e/d42/dd5 0 2023-12-12T11:51:48.590 INFO:tasks.workunit.client.1.smithi093.stdout:6/569: write d0/da/d14/f80 [1153967,86687] 0 2023-12-12T11:51:48.593 INFO:tasks.workunit.client.1.smithi093.stdout:5/346: getdents d0/d7 0 2023-12-12T11:51:48.596 INFO:tasks.workunit.client.0.smithi063.stdout:1/170: link d3/db/d12/c1b d3/db/d16/d24/c37 0 2023-12-12T11:51:48.602 INFO:tasks.workunit.client.1.smithi093.stdout:7/383: rename da/de/d46/f69 to da/de/d46/d58/d7d/f88 0 2023-12-12T11:51:48.606 INFO:tasks.workunit.client.0.smithi063.stdout:5/212: mknod d7/d10/c3a 0 2023-12-12T11:51:48.606 INFO:tasks.workunit.client.0.smithi063.stdout:5/213: chown d7/de/f25 5233913 1 2023-12-12T11:51:48.608 INFO:tasks.workunit.client.1.smithi093.stdout:3/434: dwrite fc [0,4194304] 0 2023-12-12T11:51:48.613 INFO:tasks.workunit.client.1.smithi093.stdout:8/438: sync 2023-12-12T11:51:48.614 INFO:tasks.workunit.client.1.smithi093.stdout:5/347: unlink d0/d7/d36/d29/f4e 0 2023-12-12T11:51:48.614 INFO:tasks.workunit.client.1.smithi093.stdout:0/441: mknod d5/c8b 0 2023-12-12T11:51:48.618 INFO:tasks.workunit.client.0.smithi063.stdout:0/196: sync 2023-12-12T11:51:48.618 INFO:tasks.workunit.client.0.smithi063.stdout:8/304: symlink d4/de/d32/l5a 0 2023-12-12T11:51:48.618 INFO:tasks.workunit.client.0.smithi063.stdout:8/305: fsync d4/de/d32/d36/f3a 0 2023-12-12T11:51:48.619 INFO:tasks.workunit.client.0.smithi063.stdout:9/193: sync 2023-12-12T11:51:48.622 INFO:tasks.workunit.client.0.smithi063.stdout:8/306: write d4/de/d1e/f26 [532236,54393] 0 2023-12-12T11:51:48.622 INFO:tasks.workunit.client.0.smithi063.stdout:8/307: write d4/de/d32/d36/f3a [2135671,105402] 0 2023-12-12T11:51:48.623 INFO:tasks.workunit.client.0.smithi063.stdout:2/160: sync 2023-12-12T11:51:48.623 INFO:tasks.workunit.client.0.smithi063.stdout:2/161: readlink d0/d1a/d26/l28 0 2023-12-12T11:51:48.623 INFO:tasks.workunit.client.1.smithi093.stdout:6/570: rename d0/da/d32/dd3/l98 to d0/da/d32/d39/d5b/ld6 0 2023-12-12T11:51:48.624 INFO:tasks.workunit.client.1.smithi093.stdout:7/384: dread da/d15/d2d/f34 [0,4194304] 0 2023-12-12T11:51:48.624 INFO:tasks.workunit.client.1.smithi093.stdout:7/385: dread - da/de/d46/d4f/f62 zero size 2023-12-12T11:51:48.625 INFO:tasks.workunit.client.1.smithi093.stdout:2/455: dwrite d5/d14/d2d/d12/d25/f33 [0,4194304] 0 2023-12-12T11:51:48.631 INFO:tasks.workunit.client.1.smithi093.stdout:5/348: mkdir d0/d7/d59/d62/d77 0 2023-12-12T11:51:48.633 INFO:tasks.workunit.client.0.smithi063.stdout:1/171: symlink d3/db/d12/l38 0 2023-12-12T11:51:48.633 INFO:tasks.workunit.client.0.smithi063.stdout:1/172: chown d3/db/d16/d24/f29 20 1 2023-12-12T11:51:48.633 INFO:tasks.workunit.client.0.smithi063.stdout:1/173: dread - d3/db/d16/d17/d19/f2c zero size 2023-12-12T11:51:48.635 INFO:tasks.workunit.client.1.smithi093.stdout:6/571: mknod d0/d52/dbc/cd7 0 2023-12-12T11:51:48.637 INFO:tasks.workunit.client.1.smithi093.stdout:9/399: sync 2023-12-12T11:51:48.637 INFO:tasks.workunit.client.1.smithi093.stdout:4/596: sync 2023-12-12T11:51:48.637 INFO:tasks.workunit.client.1.smithi093.stdout:1/430: sync 2023-12-12T11:51:48.637 INFO:tasks.workunit.client.1.smithi093.stdout:9/400: write d1/d23/f80 [461787,42382] 0 2023-12-12T11:51:48.637 INFO:tasks.workunit.client.1.smithi093.stdout:9/401: stat d1/d23/l30 0 2023-12-12T11:51:48.637 INFO:tasks.workunit.client.1.smithi093.stdout:9/402: creat d1/d23/d24/d29/d43/d56/d68/f87 x:0 0 0 2023-12-12T11:51:48.638 INFO:tasks.workunit.client.0.smithi063.stdout:7/196: mkdir de/d22/d4d 0 2023-12-12T11:51:48.639 INFO:tasks.workunit.client.0.smithi063.stdout:4/245: dwrite d2/d8/f26 [0,4194304] 0 2023-12-12T11:51:48.649 INFO:tasks.workunit.client.1.smithi093.stdout:2/456: link d5/d14/d47/c7b d5/d14/d47/c9a 0 2023-12-12T11:51:48.651 INFO:tasks.workunit.client.0.smithi063.stdout:8/308: mkdir d4/d24/d38/d45/d5b 0 2023-12-12T11:51:48.652 INFO:tasks.workunit.client.0.smithi063.stdout:2/162: unlink d0/d1a/f1c 0 2023-12-12T11:51:48.654 INFO:tasks.workunit.client.1.smithi093.stdout:3/435: rmdir df/d25/d2c 39 2023-12-12T11:51:48.655 INFO:tasks.workunit.client.0.smithi063.stdout:8/309: creat d4/de/d1e/f5c x:0 0 0 2023-12-12T11:51:48.659 INFO:tasks.workunit.client.0.smithi063.stdout:1/174: symlink d3/db/d16/d17/l39 0 2023-12-12T11:51:48.661 INFO:tasks.workunit.client.0.smithi063.stdout:7/197: mkdir de/d34/d43/d45/d4e 0 2023-12-12T11:51:48.664 INFO:tasks.workunit.client.0.smithi063.stdout:2/163: mkdir d0/d1a/d39 0 2023-12-12T11:51:48.668 INFO:tasks.workunit.client.1.smithi093.stdout:5/349: creat d0/d7/d59/d35/f78 x:0 0 0 2023-12-12T11:51:48.671 INFO:tasks.workunit.client.1.smithi093.stdout:9/403: dread d1/d12/d1f/f27 [0,4194304] 0 2023-12-12T11:51:48.674 INFO:tasks.workunit.client.1.smithi093.stdout:9/404: creat d1/d12/d1f/d3d/d5c/f88 x:0 0 0 2023-12-12T11:51:48.674 INFO:tasks.workunit.client.1.smithi093.stdout:7/386: dread da/de/f44 [0,4194304] 0 2023-12-12T11:51:48.676 INFO:tasks.workunit.client.1.smithi093.stdout:6/572: mkdir d0/da/d32/d9e/d4d/dd8 0 2023-12-12T11:51:48.676 INFO:tasks.workunit.client.1.smithi093.stdout:6/573: chown d0/da/d14/d38/c59 17596382 1 2023-12-12T11:51:48.676 INFO:tasks.workunit.client.1.smithi093.stdout:6/574: truncate d0/d52/f6e 1716948 0 2023-12-12T11:51:48.679 INFO:tasks.workunit.client.0.smithi063.stdout:6/223: sync 2023-12-12T11:51:48.679 INFO:tasks.workunit.client.0.smithi063.stdout:6/224: read - d9/f32 zero size 2023-12-12T11:51:48.679 INFO:tasks.workunit.client.0.smithi063.stdout:6/225: creat d9/d10/f4c x:0 0 0 2023-12-12T11:51:48.680 INFO:tasks.workunit.client.0.smithi063.stdout:6/226: creat d9/d2c/f4d x:0 0 0 2023-12-12T11:51:48.681 INFO:tasks.workunit.client.1.smithi093.stdout:4/597: link d0/d36/d40/f99 d0/d31/d5c/fb9 0 2023-12-12T11:51:48.682 INFO:tasks.workunit.client.0.smithi063.stdout:7/198: creat de/d34/f4f x:0 0 0 2023-12-12T11:51:48.683 INFO:tasks.workunit.client.0.smithi063.stdout:7/199: readlink lc 0 2023-12-12T11:51:48.683 INFO:tasks.workunit.client.1.smithi093.stdout:1/431: dwrite d4/f8 [4194304,4194304] 0 2023-12-12T11:51:48.684 INFO:tasks.workunit.client.1.smithi093.stdout:1/432: read d4/dc/f18 [995518,2361] 0 2023-12-12T11:51:48.684 INFO:tasks.workunit.client.1.smithi093.stdout:1/433: stat d4/d1c/d2a/f4b 0 2023-12-12T11:51:48.686 INFO:tasks.workunit.client.1.smithi093.stdout:6/575: dread d0/d52/d7e/d42/f60 [0,4194304] 0 2023-12-12T11:51:48.687 INFO:tasks.workunit.client.0.smithi063.stdout:2/164: write d0/d1a/d1e/f27 [724900,58234] 0 2023-12-12T11:51:48.687 INFO:tasks.workunit.client.0.smithi063.stdout:2/165: readlink d0/d11/l21 0 2023-12-12T11:51:48.691 INFO:tasks.workunit.client.0.smithi063.stdout:1/175: dread d3/db/d16/d24/f29 [0,4194304] 0 2023-12-12T11:51:48.691 INFO:tasks.workunit.client.0.smithi063.stdout:1/176: write d3/db/d16/d24/f2a [5025574,93296] 0 2023-12-12T11:51:48.694 INFO:tasks.workunit.client.0.smithi063.stdout:3/175: dwrite d4/f25 [0,4194304] 0 2023-12-12T11:51:48.694 INFO:tasks.workunit.client.0.smithi063.stdout:5/214: dwrite d7/d10/f33 [0,4194304] 0 2023-12-12T11:51:48.701 INFO:tasks.workunit.client.1.smithi093.stdout:3/436: mkdir df/d36/d3d/d42/d8e 0 2023-12-12T11:51:48.701 INFO:tasks.workunit.client.1.smithi093.stdout:3/437: fsync df/d36/d3d/d6f/f7a 0 2023-12-12T11:51:48.701 INFO:tasks.workunit.client.1.smithi093.stdout:3/438: truncate df/d36/d3d/d42/f57 1050838 0 2023-12-12T11:51:48.705 INFO:tasks.workunit.client.0.smithi063.stdout:8/310: getdents d4/d24 0 2023-12-12T11:51:48.706 INFO:tasks.workunit.client.0.smithi063.stdout:8/311: chown d4/l48 2404354 1 2023-12-12T11:51:48.707 INFO:tasks.workunit.client.1.smithi093.stdout:0/442: dwrite d5/d21/d27/d3a/f48 [0,4194304] 0 2023-12-12T11:51:48.711 INFO:tasks.workunit.client.1.smithi093.stdout:9/405: mkdir d1/d23/d24/d89 0 2023-12-12T11:51:48.714 INFO:tasks.workunit.client.0.smithi063.stdout:6/227: symlink d9/l4e 0 2023-12-12T11:51:48.714 INFO:tasks.workunit.client.0.smithi063.stdout:6/228: dread - d9/f4b zero size 2023-12-12T11:51:48.716 INFO:tasks.workunit.client.0.smithi063.stdout:7/200: mknod de/d3f/c50 0 2023-12-12T11:51:48.722 INFO:tasks.workunit.client.1.smithi093.stdout:0/443: dread d5/dd/f16 [0,4194304] 0 2023-12-12T11:51:48.722 INFO:tasks.workunit.client.1.smithi093.stdout:1/434: rename d4/d1c/f43 to d4/d1a/d1b/d26/f91 0 2023-12-12T11:51:48.724 INFO:tasks.workunit.client.1.smithi093.stdout:2/457: rmdir d5/d14/d2d/d12/d44 39 2023-12-12T11:51:48.725 INFO:tasks.workunit.client.1.smithi093.stdout:4/598: getdents d0/d36/d40 0 2023-12-12T11:51:48.736 INFO:tasks.workunit.client.1.smithi093.stdout:9/406: dread d1/d23/d24/d29/f2b [0,4194304] 0 2023-12-12T11:51:48.738 INFO:tasks.workunit.client.1.smithi093.stdout:0/444: truncate d5/dd/f16 1584291 0 2023-12-12T11:51:48.739 INFO:tasks.workunit.client.0.smithi063.stdout:6/229: rmdir d9/d10/d2a 39 2023-12-12T11:51:48.739 INFO:tasks.workunit.client.1.smithi093.stdout:2/458: symlink d5/d14/d2d/d8b/l9b 0 2023-12-12T11:51:48.740 INFO:tasks.workunit.client.0.smithi063.stdout:6/230: write d9/f1f [5005726,112004] 0 2023-12-12T11:51:48.744 INFO:tasks.workunit.client.0.smithi063.stdout:4/246: dread d2/f6 [0,4194304] 0 2023-12-12T11:51:48.747 INFO:tasks.workunit.client.1.smithi093.stdout:9/407: mknod d1/d23/d24/d29/d43/c8a 0 2023-12-12T11:51:48.747 INFO:tasks.workunit.client.1.smithi093.stdout:7/387: dread da/d15/f16 [0,4194304] 0 2023-12-12T11:51:48.747 INFO:tasks.workunit.client.1.smithi093.stdout:7/388: dread - da/d15/d2d/f50 zero size 2023-12-12T11:51:48.748 INFO:tasks.workunit.client.1.smithi093.stdout:0/445: unlink d5/dd/d14/d26/d58/f63 0 2023-12-12T11:51:48.749 INFO:tasks.workunit.client.0.smithi063.stdout:4/247: creat d2/d17/d4e/f51 x:0 0 0 2023-12-12T11:51:48.752 INFO:tasks.workunit.client.0.smithi063.stdout:3/176: write d4/f25 [963335,55082] 0 2023-12-12T11:51:48.752 INFO:tasks.workunit.client.0.smithi063.stdout:3/177: fsync d4/df/d1a/f20 0 2023-12-12T11:51:48.753 INFO:tasks.workunit.client.0.smithi063.stdout:4/248: getdents d2/d8 0 2023-12-12T11:51:48.754 INFO:tasks.workunit.client.0.smithi063.stdout:1/177: read d3/db/fd [274883,5186] 0 2023-12-12T11:51:48.754 INFO:tasks.workunit.client.0.smithi063.stdout:1/178: chown d3/db/d16/c31 9643891 1 2023-12-12T11:51:48.754 INFO:tasks.workunit.client.0.smithi063.stdout:3/178: mkdir d4/df/d1a/d1c/d34 0 2023-12-12T11:51:48.755 INFO:tasks.workunit.client.1.smithi093.stdout:6/576: write d0/d52/d7e/f49 [683433,46661] 0 2023-12-12T11:51:48.755 INFO:tasks.workunit.client.1.smithi093.stdout:5/350: dwrite d0/d7/d59/d35/f58 [0,4194304] 0 2023-12-12T11:51:48.755 INFO:tasks.workunit.client.1.smithi093.stdout:9/408: rename d1/d23/d24/d29/d43/l81 to d1/d12/d1f/d3d/d5c/l8b 0 2023-12-12T11:51:48.755 INFO:tasks.workunit.client.1.smithi093.stdout:9/409: write d1/d23/d24/d29/d43/d56/d68/f7e [98223,105833] 0 2023-12-12T11:51:48.756 INFO:tasks.workunit.client.0.smithi063.stdout:4/249: truncate d2/d47/f3f 320022 0 2023-12-12T11:51:48.756 INFO:tasks.workunit.client.0.smithi063.stdout:4/250: chown l1 499 1 2023-12-12T11:51:48.757 INFO:tasks.workunit.client.0.smithi063.stdout:3/179: mknod d4/df/d1a/d1c/d34/c35 0 2023-12-12T11:51:48.758 INFO:tasks.workunit.client.0.smithi063.stdout:3/180: fsync d4/df/d1a/f20 0 2023-12-12T11:51:48.758 INFO:tasks.workunit.client.0.smithi063.stdout:3/181: read - d4/f2a zero size 2023-12-12T11:51:48.758 INFO:tasks.workunit.client.0.smithi063.stdout:3/182: chown d4/d23/f24 0 1 2023-12-12T11:51:48.763 INFO:tasks.workunit.client.1.smithi093.stdout:5/351: creat d0/d7/d8/f79 x:0 0 0 2023-12-12T11:51:48.766 INFO:tasks.workunit.client.0.smithi063.stdout:9/194: dwrite d7/d15/f1d [0,4194304] 0 2023-12-12T11:51:48.766 INFO:tasks.workunit.client.1.smithi093.stdout:0/446: dread d5/dd/d14/d26/f3f [0,4194304] 0 2023-12-12T11:51:48.771 INFO:tasks.workunit.client.1.smithi093.stdout:9/410: creat d1/d23/d6b/f8c x:0 0 0 2023-12-12T11:51:48.771 INFO:tasks.workunit.client.1.smithi093.stdout:9/411: chown d1/d12/d1f/d32/c47 29785092 1 2023-12-12T11:51:48.772 INFO:tasks.workunit.client.1.smithi093.stdout:7/389: dread da/de/f10 [0,4194304] 0 2023-12-12T11:51:48.777 INFO:tasks.workunit.client.0.smithi063.stdout:0/197: dwrite d0/d7/d27/f33 [4194304,4194304] 0 2023-12-12T11:51:48.779 INFO:tasks.workunit.client.0.smithi063.stdout:4/251: unlink d2/d47/c50 0 2023-12-12T11:51:48.786 INFO:tasks.workunit.client.1.smithi093.stdout:5/352: creat d0/d7/d36/d68/f7a x:0 0 0 2023-12-12T11:51:48.786 INFO:tasks.workunit.client.1.smithi093.stdout:1/435: dread d4/dc/f41 [0,4194304] 0 2023-12-12T11:51:48.787 INFO:tasks.workunit.client.1.smithi093.stdout:9/412: link d1/d23/c37 d1/d12/d1f/d32/c8d 0 2023-12-12T11:51:48.789 INFO:tasks.workunit.client.0.smithi063.stdout:9/195: dread d7/d15/f31 [0,4194304] 0 2023-12-12T11:51:48.790 INFO:tasks.workunit.client.0.smithi063.stdout:9/196: dread - d7/d11/d12/f1a zero size 2023-12-12T11:51:48.790 INFO:tasks.workunit.client.0.smithi063.stdout:0/198: creat d0/d15/f3e x:0 0 0 2023-12-12T11:51:48.793 INFO:tasks.workunit.client.1.smithi093.stdout:1/436: unlink d4/f3c 0 2023-12-12T11:51:48.796 INFO:tasks.workunit.client.1.smithi093.stdout:4/599: dwrite d0/f14 [0,4194304] 0 2023-12-12T11:51:48.799 INFO:tasks.workunit.client.1.smithi093.stdout:9/413: mknod d1/d23/c8e 0 2023-12-12T11:51:48.800 INFO:tasks.workunit.client.1.smithi093.stdout:3/439: dwrite df/d22/d49/d69/d78/f7d [0,4194304] 0 2023-12-12T11:51:48.800 INFO:tasks.workunit.client.1.smithi093.stdout:3/440: getdents df/d36/d7f 0 2023-12-12T11:51:48.801 INFO:tasks.workunit.client.0.smithi063.stdout:9/197: symlink d7/d15/l3c 0 2023-12-12T11:51:48.801 INFO:tasks.workunit.client.1.smithi093.stdout:1/437: stat d4/d1a/d73/l3f 0 2023-12-12T11:51:48.801 INFO:tasks.workunit.client.1.smithi093.stdout:1/438: read - d4/d1c/d2a/f6e zero size 2023-12-12T11:51:48.805 INFO:tasks.workunit.client.0.smithi063.stdout:0/199: creat d0/d7/d27/d1f/f3f x:0 0 0 2023-12-12T11:51:48.806 INFO:tasks.workunit.client.0.smithi063.stdout:0/200: creat d0/d7/d27/d1f/f40 x:0 0 0 2023-12-12T11:51:48.806 INFO:tasks.workunit.client.0.smithi063.stdout:0/201: write d0/d15/f3e [107223,106618] 0 2023-12-12T11:51:48.807 INFO:tasks.workunit.client.1.smithi093.stdout:4/600: mknod d0/d87/d79/d86/cba 0 2023-12-12T11:51:48.807 INFO:tasks.workunit.client.1.smithi093.stdout:4/601: chown d0/d87 5 1 2023-12-12T11:51:48.813 INFO:tasks.workunit.client.0.smithi063.stdout:5/215: dwrite d7/f15 [0,4194304] 0 2023-12-12T11:51:48.814 INFO:tasks.workunit.client.0.smithi063.stdout:0/202: rename d0/d7/d27/ld to d0/d1a/l41 0 2023-12-12T11:51:48.814 INFO:tasks.workunit.client.0.smithi063.stdout:0/203: chown d0/d1a/f1c 501654 1 2023-12-12T11:51:48.829 INFO:tasks.workunit.client.0.smithi063.stdout:5/216: mknod d7/de/c3b 0 2023-12-12T11:51:48.832 INFO:tasks.workunit.client.0.smithi063.stdout:7/201: write fb [3233744,6456] 0 2023-12-12T11:51:48.835 INFO:tasks.workunit.client.1.smithi093.stdout:3/441: link df/d30/d33/f45 df/d25/d2c/d85/f8f 0 2023-12-12T11:51:48.835 INFO:tasks.workunit.client.1.smithi093.stdout:9/414: write d1/d12/d1f/f27 [1639966,44784] 0 2023-12-12T11:51:48.835 INFO:tasks.workunit.client.1.smithi093.stdout:9/415: chown d1/c26 1874649548 1 2023-12-12T11:51:48.836 INFO:tasks.workunit.client.1.smithi093.stdout:1/439: unlink d4/l6 0 2023-12-12T11:51:48.840 INFO:tasks.workunit.client.0.smithi063.stdout:2/166: dwrite d0/f33 [4194304,4194304] 0 2023-12-12T11:51:48.842 INFO:tasks.workunit.client.0.smithi063.stdout:8/312: dwrite d4/de/f41 [0,4194304] 0 2023-12-12T11:51:48.842 INFO:tasks.workunit.client.0.smithi063.stdout:8/313: write d4/de/f43 [3036031,81797] 0 2023-12-12T11:51:48.846 INFO:tasks.workunit.client.1.smithi093.stdout:4/602: creat d0/d36/fbb x:0 0 0 2023-12-12T11:51:48.849 INFO:tasks.workunit.client.1.smithi093.stdout:2/459: dwrite d5/d14/d2d/d12/d25/f33 [0,4194304] 0 2023-12-12T11:51:48.852 INFO:tasks.workunit.client.0.smithi063.stdout:7/202: symlink de/d33/l51 0 2023-12-12T11:51:48.862 INFO:tasks.workunit.client.1.smithi093.stdout:1/440: mkdir d4/d1a/d83/d92 0 2023-12-12T11:51:48.865 INFO:tasks.workunit.client.0.smithi063.stdout:2/167: mkdir d0/d1a/d3a 0 2023-12-12T11:51:48.867 INFO:tasks.workunit.client.1.smithi093.stdout:4/603: symlink d0/d87/d79/d86/da9/lbc 0 2023-12-12T11:51:48.867 INFO:tasks.workunit.client.1.smithi093.stdout:6/577: dwrite d0/d52/f6e [0,4194304] 0 2023-12-12T11:51:48.876 INFO:tasks.workunit.client.1.smithi093.stdout:2/460: readlink d5/l5c 0 2023-12-12T11:51:48.877 INFO:tasks.workunit.client.0.smithi063.stdout:4/252: fsync d2/d47/f3f 0 2023-12-12T11:51:48.877 INFO:tasks.workunit.client.0.smithi063.stdout:4/253: read - d2/d17/d4e/f51 zero size 2023-12-12T11:51:48.878 INFO:tasks.workunit.client.0.smithi063.stdout:4/254: creat d2/d17/d41/f52 x:0 0 0 2023-12-12T11:51:48.878 INFO:tasks.workunit.client.0.smithi063.stdout:4/255: readlink d2/d8/l36 0 2023-12-12T11:51:48.886 INFO:tasks.workunit.client.0.smithi063.stdout:2/168: readlink d0/d1a/d1e/l1f 0 2023-12-12T11:51:48.889 INFO:tasks.workunit.client.0.smithi063.stdout:6/231: dwrite d9/d10/f1b [0,4194304] 0 2023-12-12T11:51:48.889 INFO:tasks.workunit.client.0.smithi063.stdout:6/232: write d9/f43 [473678,31631] 0 2023-12-12T11:51:48.889 INFO:tasks.workunit.client.0.smithi063.stdout:6/233: fsync d9/f18 0 2023-12-12T11:51:48.890 INFO:tasks.workunit.client.1.smithi093.stdout:4/604: rename d0/d36/d49/f4b to d0/d31/d5c/d6c/da4/fbd 0 2023-12-12T11:51:48.896 INFO:tasks.workunit.client.1.smithi093.stdout:6/578: truncate d0/da/d14/f72 3822702 0 2023-12-12T11:51:48.896 INFO:tasks.workunit.client.1.smithi093.stdout:6/579: dread - d0/d52/d6b/fa4 zero size 2023-12-12T11:51:48.896 INFO:tasks.workunit.client.1.smithi093.stdout:6/580: chown d0/da/d14/d38/d43 88168 1 2023-12-12T11:51:48.897 INFO:tasks.workunit.client.1.smithi093.stdout:2/461: mknod d5/d14/d2d/c9c 0 2023-12-12T11:51:48.900 INFO:tasks.workunit.client.0.smithi063.stdout:4/256: creat d2/d47/f53 x:0 0 0 2023-12-12T11:51:48.903 INFO:tasks.workunit.client.1.smithi093.stdout:1/441: read d4/d1c/d2a/f2b [4043719,36669] 0 2023-12-12T11:51:48.904 INFO:tasks.workunit.client.0.smithi063.stdout:0/204: rename d0/d15 to d0/d1a/d23/d34/d42 0 2023-12-12T11:51:48.904 INFO:tasks.workunit.client.0.smithi063.stdout:0/205: write d0/d7/ff [329936,11501] 0 2023-12-12T11:51:48.912 INFO:tasks.workunit.client.1.smithi093.stdout:4/605: mknod d0/d36/d49/cbe 0 2023-12-12T11:51:48.915 INFO:tasks.workunit.client.0.smithi063.stdout:7/203: dread de/f1d [0,4194304] 0 2023-12-12T11:51:48.916 INFO:tasks.workunit.client.1.smithi093.stdout:0/447: dwrite d5/d21/d27/d3a/f56 [0,4194304] 0 2023-12-12T11:51:48.917 INFO:tasks.workunit.client.1.smithi093.stdout:6/581: unlink d0/da/d32/d39/d5b/fa3 0 2023-12-12T11:51:48.917 INFO:tasks.workunit.client.1.smithi093.stdout:6/582: creat d0/d52/fd9 x:0 0 0 2023-12-12T11:51:48.917 INFO:tasks.workunit.client.1.smithi093.stdout:6/583: write d0/da/d14/d38/fc3 [784946,83120] 0 2023-12-12T11:51:48.921 INFO:tasks.workunit.client.1.smithi093.stdout:2/462: symlink d5/d14/l9d 0 2023-12-12T11:51:48.921 INFO:tasks.workunit.client.1.smithi093.stdout:2/463: write d5/d14/d2d/f1e [3853857,124406] 0 2023-12-12T11:51:48.925 INFO:tasks.workunit.client.0.smithi063.stdout:0/206: creat d0/d7/d27/d19/d2d/f43 x:0 0 0 2023-12-12T11:51:48.925 INFO:tasks.workunit.client.0.smithi063.stdout:3/183: dwrite d4/df/d1a/d1c/f2d [0,4194304] 0 2023-12-12T11:51:48.926 INFO:tasks.workunit.client.0.smithi063.stdout:7/204: symlink de/d39/d4b/l52 0 2023-12-12T11:51:48.927 INFO:tasks.workunit.client.1.smithi093.stdout:4/606: read d0/d31/f7c [1857803,38708] 0 2023-12-12T11:51:48.928 INFO:tasks.workunit.client.1.smithi093.stdout:6/584: rename d0/d52/d7e/d42/fc5 to d0/d52/d7e/d42/dd5/fda 0 2023-12-12T11:51:48.928 INFO:tasks.workunit.client.1.smithi093.stdout:6/585: dread - d0/da/d32/d9e/d4d/f82 zero size 2023-12-12T11:51:48.928 INFO:tasks.workunit.client.1.smithi093.stdout:6/586: stat d0/da/d32/dd3/cae 0 2023-12-12T11:51:48.928 INFO:tasks.workunit.client.1.smithi093.stdout:8/439: sync 2023-12-12T11:51:48.928 INFO:tasks.workunit.client.1.smithi093.stdout:8/440: fsync d3/d1a/d1f/d29/f54 0 2023-12-12T11:51:48.933 INFO:tasks.workunit.client.0.smithi063.stdout:3/184: truncate d4/df/f19 1141200 0 2023-12-12T11:51:48.934 INFO:tasks.workunit.client.1.smithi093.stdout:5/353: dwrite d0/d7/d59/d35/f1f [0,4194304] 0 2023-12-12T11:51:48.937 INFO:tasks.workunit.client.0.smithi063.stdout:5/217: rename d7/d24 to d7/d10/d2b/d3c 0 2023-12-12T11:51:48.938 INFO:tasks.workunit.client.0.smithi063.stdout:4/257: dread d2/f40 [0,4194304] 0 2023-12-12T11:51:48.938 INFO:tasks.workunit.client.0.smithi063.stdout:4/258: chown d2/d47/l3b 1383 1 2023-12-12T11:51:48.939 INFO:tasks.workunit.client.1.smithi093.stdout:2/464: read d5/d31/f4a [2056598,101123] 0 2023-12-12T11:51:48.940 INFO:tasks.workunit.client.0.smithi063.stdout:7/205: symlink de/d34/d43/d45/d4e/l53 0 2023-12-12T11:51:48.940 INFO:tasks.workunit.client.0.smithi063.stdout:7/206: readlink de/l20 0 2023-12-12T11:51:48.941 INFO:tasks.workunit.client.1.smithi093.stdout:4/607: creat d0/d31/d5c/d66/fbf x:0 0 0 2023-12-12T11:51:48.941 INFO:tasks.workunit.client.1.smithi093.stdout:4/608: chown d0/d87/d79/d7f/c83 71 1 2023-12-12T11:51:48.944 INFO:tasks.workunit.client.0.smithi063.stdout:3/185: link d4/d23/l30 d4/df/d1a/l36 0 2023-12-12T11:51:48.944 INFO:tasks.workunit.client.0.smithi063.stdout:3/186: creat d4/df/f37 x:0 0 0 2023-12-12T11:51:48.949 INFO:tasks.workunit.client.1.smithi093.stdout:6/587: mkdir d0/d52/d6b/ddb 0 2023-12-12T11:51:48.949 INFO:tasks.workunit.client.0.smithi063.stdout:8/314: rename d4/de/d1e/f26 to d4/d24/f5d 0 2023-12-12T11:51:48.949 INFO:tasks.workunit.client.0.smithi063.stdout:4/259: symlink d2/d8/l54 0 2023-12-12T11:51:48.949 INFO:tasks.workunit.client.0.smithi063.stdout:9/198: dwrite f5 [4194304,4194304] 0 2023-12-12T11:51:48.950 INFO:tasks.workunit.client.0.smithi063.stdout:9/199: write d7/f19 [328753,106769] 0 2023-12-12T11:51:48.950 INFO:tasks.workunit.client.0.smithi063.stdout:9/200: write d7/f2a [1210017,27530] 0 2023-12-12T11:51:48.952 INFO:tasks.workunit.client.0.smithi063.stdout:1/179: dwrite d3/f1a [0,4194304] 0 2023-12-12T11:51:48.955 INFO:tasks.workunit.client.0.smithi063.stdout:7/207: symlink de/d39/d4b/l54 0 2023-12-12T11:51:48.955 INFO:tasks.workunit.client.0.smithi063.stdout:7/208: chown l3 537659190 1 2023-12-12T11:51:48.959 INFO:tasks.workunit.client.1.smithi093.stdout:4/609: dread d0/d31/f51 [0,4194304] 0 2023-12-12T11:51:48.959 INFO:tasks.workunit.client.1.smithi093.stdout:4/610: dread - d0/d31/d5c/d6c/f95 zero size 2023-12-12T11:51:48.960 INFO:tasks.workunit.client.1.smithi093.stdout:5/354: symlink d0/d7/d59/d62/d77/l7b 0 2023-12-12T11:51:48.960 INFO:tasks.workunit.client.1.smithi093.stdout:5/355: fdatasync d0/d3b/f63 0 2023-12-12T11:51:48.960 INFO:tasks.workunit.client.1.smithi093.stdout:5/356: write d0/d7/d59/d35/f31 [1182549,4611] 0 2023-12-12T11:51:48.960 INFO:tasks.workunit.client.1.smithi093.stdout:5/357: getdents d0/d3b/d66 0 2023-12-12T11:51:48.965 INFO:tasks.workunit.client.0.smithi063.stdout:5/218: write d7/d10/f1b [1101237,101954] 0 2023-12-12T11:51:48.966 INFO:tasks.workunit.client.0.smithi063.stdout:5/219: dread - d7/d10/d2b/f34 zero size 2023-12-12T11:51:48.966 INFO:tasks.workunit.client.0.smithi063.stdout:5/220: chown d7/d10/d2b/f34 52719 1 2023-12-12T11:51:48.978 INFO:tasks.workunit.client.1.smithi093.stdout:2/465: mknod d5/d14/d2d/d4c/d54/d67/d69/c9e 0 2023-12-12T11:51:48.998 INFO:tasks.workunit.client.1.smithi093.stdout:1/442: dwrite d4/d1c/d2a/f4b [0,4194304] 0 2023-12-12T11:51:49.001 INFO:tasks.workunit.client.0.smithi063.stdout:8/315: symlink d4/d55/l5e 0 2023-12-12T11:51:49.002 INFO:tasks.workunit.client.0.smithi063.stdout:8/316: fdatasync d4/de/f41 0 2023-12-12T11:51:49.005 INFO:tasks.workunit.client.0.smithi063.stdout:2/169: dwrite d0/f17 [0,4194304] 0 2023-12-12T11:51:49.008 INFO:tasks.workunit.client.1.smithi093.stdout:8/441: dwrite d3/d73/f77 [0,4194304] 0 2023-12-12T11:51:49.008 INFO:tasks.workunit.client.1.smithi093.stdout:8/442: write d3/d1a/d1f/d29/d30/d58/f85 [1713813,91926] 0 2023-12-12T11:51:49.013 INFO:tasks.workunit.client.0.smithi063.stdout:9/201: dwrite d7/d15/f23 [0,4194304] 0 2023-12-12T11:51:49.014 INFO:tasks.workunit.client.1.smithi093.stdout:4/611: dwrite d0/fad [0,4194304] 0 2023-12-12T11:51:49.014 INFO:tasks.workunit.client.1.smithi093.stdout:6/588: mkdir d0/d52/d7e/d42/dd5/ddc 0 2023-12-12T11:51:49.016 INFO:tasks.workunit.client.1.smithi093.stdout:2/466: dread d5/d14/d2d/d12/d25/f29 [0,4194304] 0 2023-12-12T11:51:49.020 INFO:tasks.workunit.client.0.smithi063.stdout:6/234: rename d9/c42 to d9/d10/d2a/c4f 0 2023-12-12T11:51:49.022 INFO:tasks.workunit.client.1.smithi093.stdout:5/358: mkdir d0/d3b/d66/d7c 0 2023-12-12T11:51:49.024 INFO:tasks.workunit.client.0.smithi063.stdout:1/180: dwrite d3/f9 [0,4194304] 0 2023-12-12T11:51:49.028 INFO:tasks.workunit.client.0.smithi063.stdout:1/181: stat d3/db/d16/c18 0 2023-12-12T11:51:49.028 INFO:tasks.workunit.client.0.smithi063.stdout:1/182: fsync d3/db/d16/f32 0 2023-12-12T11:51:49.039 INFO:tasks.workunit.client.0.smithi063.stdout:9/202: dread f5 [4194304,4194304] 0 2023-12-12T11:51:49.039 INFO:tasks.workunit.client.0.smithi063.stdout:5/221: unlink d7/d10/c3a 0 2023-12-12T11:51:49.039 INFO:tasks.workunit.client.0.smithi063.stdout:5/222: rename d7 to d7/d10/d2b/d3c/d3d 22 2023-12-12T11:51:49.039 INFO:tasks.workunit.client.0.smithi063.stdout:5/223: stat d7/de/f30 0 2023-12-12T11:51:49.045 INFO:tasks.workunit.client.0.smithi063.stdout:9/203: write d7/d15/f2e [1036236,48056] 0 2023-12-12T11:51:49.057 INFO:tasks.workunit.client.1.smithi093.stdout:1/443: write d4/fa [1072421,23235] 0 2023-12-12T11:51:49.068 INFO:tasks.workunit.client.1.smithi093.stdout:8/443: truncate d3/d1a/f2b 1596269 0 2023-12-12T11:51:49.079 INFO:tasks.workunit.client.0.smithi063.stdout:8/317: creat d4/d24/f5f x:0 0 0 2023-12-12T11:51:49.083 INFO:tasks.workunit.client.1.smithi093.stdout:4/612: symlink d0/d31/d5c/lc0 0 2023-12-12T11:51:49.083 INFO:tasks.workunit.client.1.smithi093.stdout:4/613: fdatasync d0/d87/d79/db2/fae 0 2023-12-12T11:51:49.088 INFO:tasks.workunit.client.1.smithi093.stdout:6/589: dwrite d0/da/d14/d21/fd1 [0,4194304] 0 2023-12-12T11:51:49.090 INFO:tasks.workunit.client.1.smithi093.stdout:5/359: creat d0/d3b/d66/f7d x:0 0 0 2023-12-12T11:51:49.091 INFO:tasks.workunit.client.0.smithi063.stdout:8/318: write d4/f1d [1496033,89140] 0 2023-12-12T11:51:49.095 INFO:tasks.workunit.client.0.smithi063.stdout:6/235: mkdir d9/d10/d2a/d50 0 2023-12-12T11:51:49.100 INFO:tasks.workunit.client.0.smithi063.stdout:7/209: dwrite f8 [0,4194304] 0 2023-12-12T11:51:49.102 INFO:tasks.workunit.client.1.smithi093.stdout:7/390: sync 2023-12-12T11:51:49.105 INFO:tasks.workunit.client.1.smithi093.stdout:4/614: creat d0/d31/d9d/fc1 x:0 0 0 2023-12-12T11:51:49.105 INFO:tasks.workunit.client.1.smithi093.stdout:4/615: dread - d0/d36/d49/f8c zero size 2023-12-12T11:51:49.105 INFO:tasks.workunit.client.1.smithi093.stdout:4/616: fdatasync d0/f54 0 2023-12-12T11:51:49.107 INFO:tasks.workunit.client.0.smithi063.stdout:3/187: dwrite d4/f6 [8388608,4194304] 0 2023-12-12T11:51:49.112 INFO:tasks.workunit.client.0.smithi063.stdout:1/183: dwrite d3/db/fd [0,4194304] 0 2023-12-12T11:51:49.115 INFO:tasks.workunit.client.0.smithi063.stdout:4/260: rmdir d2/d17/d4e 39 2023-12-12T11:51:49.115 INFO:tasks.workunit.client.0.smithi063.stdout:4/261: truncate d2/d8/f43 1377297 0 2023-12-12T11:51:49.115 INFO:tasks.workunit.client.0.smithi063.stdout:4/262: fdatasync d2/d8/f37 0 2023-12-12T11:51:49.122 INFO:tasks.workunit.client.0.smithi063.stdout:6/236: write d9/f1f [3718206,88548] 0 2023-12-12T11:51:49.123 INFO:tasks.workunit.client.0.smithi063.stdout:6/237: fsync d9/fb 0 2023-12-12T11:51:49.123 INFO:tasks.workunit.client.0.smithi063.stdout:6/238: fsync d9/d10/f20 0 2023-12-12T11:51:49.123 INFO:tasks.workunit.client.1.smithi093.stdout:8/444: dwrite d3/d8/f7a [0,4194304] 0 2023-12-12T11:51:49.123 INFO:tasks.workunit.client.1.smithi093.stdout:8/445: creat d3/d1a/d1f/d29/d30/f8d x:0 0 0 2023-12-12T11:51:49.125 INFO:tasks.workunit.client.1.smithi093.stdout:6/590: symlink d0/d52/d6b/ldd 0 2023-12-12T11:51:49.131 INFO:tasks.workunit.client.0.smithi063.stdout:9/204: dwrite d7/d11/d12/f37 [0,4194304] 0 2023-12-12T11:51:49.131 INFO:tasks.workunit.client.1.smithi093.stdout:7/391: mkdir da/d2e/d89 0 2023-12-12T11:51:49.132 INFO:tasks.workunit.client.1.smithi093.stdout:7/392: write da/de/d46/d4f/f64 [174088,86065] 0 2023-12-12T11:51:49.134 INFO:tasks.workunit.client.1.smithi093.stdout:4/617: mkdir d0/d31/d5c/d6c/da4/dc2 0 2023-12-12T11:51:49.134 INFO:tasks.workunit.client.1.smithi093.stdout:4/618: truncate d0/d31/d5c/d6c/f95 983375 0 2023-12-12T11:51:49.134 INFO:tasks.workunit.client.1.smithi093.stdout:4/619: write d0/d31/d5c/f6b [474904,16173] 0 2023-12-12T11:51:49.134 INFO:tasks.workunit.client.1.smithi093.stdout:4/620: chown d0/d36/c56 52957895 1 2023-12-12T11:51:49.135 INFO:tasks.workunit.client.1.smithi093.stdout:4/621: chown d0/d87/f8f 4767651 1 2023-12-12T11:51:49.135 INFO:tasks.workunit.client.1.smithi093.stdout:8/446: write d3/d73/f77 [3295365,130754] 0 2023-12-12T11:51:49.135 INFO:tasks.workunit.client.1.smithi093.stdout:8/447: fsync d3/d8/f7a 0 2023-12-12T11:51:49.136 INFO:tasks.workunit.client.1.smithi093.stdout:9/416: sync 2023-12-12T11:51:49.136 INFO:tasks.workunit.client.1.smithi093.stdout:3/442: sync 2023-12-12T11:51:49.136 INFO:tasks.workunit.client.1.smithi093.stdout:3/443: stat df/l51 0 2023-12-12T11:51:49.141 INFO:tasks.workunit.client.0.smithi063.stdout:5/224: creat d7/d10/d2b/d3c/d27/f3e x:0 0 0 2023-12-12T11:51:49.142 INFO:tasks.workunit.client.0.smithi063.stdout:5/225: chown d7/de 33 1 2023-12-12T11:51:49.142 INFO:tasks.workunit.client.1.smithi093.stdout:9/417: dread d1/d23/d24/d29/d43/f71 [0,4194304] 0 2023-12-12T11:51:49.155 INFO:tasks.workunit.client.1.smithi093.stdout:4/622: creat d0/d31/d5c/d6c/da4/fc3 x:0 0 0 2023-12-12T11:51:49.161 INFO:tasks.workunit.client.1.smithi093.stdout:0/448: sync 2023-12-12T11:51:49.168 INFO:tasks.workunit.client.1.smithi093.stdout:7/393: read da/de/f44 [1361730,37163] 0 2023-12-12T11:51:49.168 INFO:tasks.workunit.client.1.smithi093.stdout:7/394: write da/de/d46/d4f/f62 [997463,71838] 0 2023-12-12T11:51:49.168 INFO:tasks.workunit.client.1.smithi093.stdout:7/395: fsync da/de/d46/f4e 0 2023-12-12T11:51:49.169 INFO:tasks.workunit.client.1.smithi093.stdout:8/448: creat d3/d1a/d1f/d29/d3a/f8e x:0 0 0 2023-12-12T11:51:49.174 INFO:tasks.workunit.client.1.smithi093.stdout:3/444: mknod df/d36/d3d/d59/d72/d79/c90 0 2023-12-12T11:51:49.177 INFO:tasks.workunit.client.0.smithi063.stdout:3/188: dwrite d4/f25 [0,4194304] 0 2023-12-12T11:51:49.180 INFO:tasks.workunit.client.1.smithi093.stdout:9/418: unlink d1/d23/d24/f2e 0 2023-12-12T11:51:49.180 INFO:tasks.workunit.client.1.smithi093.stdout:9/419: readlink d1/l46 0 2023-12-12T11:51:49.185 INFO:tasks.workunit.client.0.smithi063.stdout:2/170: dwrite d0/d1a/d1e/f2e [0,4194304] 0 2023-12-12T11:51:49.185 INFO:tasks.workunit.client.1.smithi093.stdout:6/591: dwrite d0/da/d32/d39/f91 [0,4194304] 0 2023-12-12T11:51:49.188 INFO:tasks.workunit.client.0.smithi063.stdout:4/263: symlink d2/d48/l55 0 2023-12-12T11:51:49.191 INFO:tasks.workunit.client.1.smithi093.stdout:4/623: creat d0/d87/d79/d86/fc4 x:0 0 0 2023-12-12T11:51:49.195 INFO:tasks.workunit.client.0.smithi063.stdout:6/239: mknod d9/d10/d25/c51 0 2023-12-12T11:51:49.196 INFO:tasks.workunit.client.1.smithi093.stdout:0/449: mkdir d5/dd/d14/d8c 0 2023-12-12T11:51:49.197 INFO:tasks.workunit.client.1.smithi093.stdout:7/396: unlink da/d15/d19/c6a 0 2023-12-12T11:51:49.197 INFO:tasks.workunit.client.1.smithi093.stdout:0/450: write d5/dd/d14/d26/d58/f8a [746520,61702] 0 2023-12-12T11:51:49.197 INFO:tasks.workunit.client.1.smithi093.stdout:9/420: dread d1/d12/d1f/f25 [0,4194304] 0 2023-12-12T11:51:49.200 INFO:tasks.workunit.client.1.smithi093.stdout:3/445: unlink df/d30/d33/f45 0 2023-12-12T11:51:49.202 INFO:tasks.workunit.client.0.smithi063.stdout:5/226: dwrite d7/ff [0,4194304] 0 2023-12-12T11:51:49.202 INFO:tasks.workunit.client.0.smithi063.stdout:5/227: write d7/d10/f23 [750301,126644] 0 2023-12-12T11:51:49.204 INFO:tasks.workunit.client.0.smithi063.stdout:9/205: link d7/f2b d7/d11/d12/f3d 0 2023-12-12T11:51:49.206 INFO:tasks.workunit.client.0.smithi063.stdout:2/171: dread d0/f33 [0,4194304] 0 2023-12-12T11:51:49.207 INFO:tasks.workunit.client.0.smithi063.stdout:2/172: write d0/d1a/f1d [1049030,108514] 0 2023-12-12T11:51:49.222 INFO:tasks.workunit.client.1.smithi093.stdout:6/592: rmdir d0/da/d32/d39/d5b/dd2 0 2023-12-12T11:51:49.225 INFO:tasks.workunit.client.0.smithi063.stdout:4/264: creat d2/f56 x:0 0 0 2023-12-12T11:51:49.225 INFO:tasks.workunit.client.0.smithi063.stdout:4/265: chown d2/d17/d4e 90060783 1 2023-12-12T11:51:49.228 INFO:tasks.workunit.client.1.smithi093.stdout:7/397: creat da/f8a x:0 0 0 2023-12-12T11:51:49.233 INFO:tasks.workunit.client.0.smithi063.stdout:6/240: rmdir d9/d10/d2a/d50 0 2023-12-12T11:51:49.233 INFO:tasks.workunit.client.0.smithi063.stdout:6/241: creat d9/d10/f52 x:0 0 0 2023-12-12T11:51:49.234 INFO:tasks.workunit.client.1.smithi093.stdout:0/451: dwrite d5/dd/d62/f69 [0,4194304] 0 2023-12-12T11:51:49.234 INFO:tasks.workunit.client.1.smithi093.stdout:4/624: dwrite d0/d36/f4c [0,4194304] 0 2023-12-12T11:51:49.238 INFO:tasks.workunit.client.0.smithi063.stdout:5/228: rmdir d7/d10/d2b 39 2023-12-12T11:51:49.238 INFO:tasks.workunit.client.0.smithi063.stdout:5/229: truncate d7/f26 518689 0 2023-12-12T11:51:49.240 INFO:tasks.workunit.client.0.smithi063.stdout:8/319: truncate d4/f1d 2134772 0 2023-12-12T11:51:49.243 INFO:tasks.workunit.client.1.smithi093.stdout:9/421: symlink d1/d12/d1f/d73/l8f 0 2023-12-12T11:51:49.247 INFO:tasks.workunit.client.1.smithi093.stdout:0/452: write d5/d21/d2f/d54/f73 [2629126,64720] 0 2023-12-12T11:51:49.251 INFO:tasks.workunit.client.1.smithi093.stdout:8/449: getdents d3/d1a/d1f/d29/d30/d58 0 2023-12-12T11:51:49.251 INFO:tasks.workunit.client.1.smithi093.stdout:3/446: creat df/d36/d3d/d59/d72/d79/f91 x:0 0 0 2023-12-12T11:51:49.251 INFO:tasks.workunit.client.1.smithi093.stdout:3/447: fdatasync df/d36/d3d/d6f/f7a 0 2023-12-12T11:51:49.252 INFO:tasks.workunit.client.1.smithi093.stdout:1/444: sync 2023-12-12T11:51:49.252 INFO:tasks.workunit.client.1.smithi093.stdout:2/467: sync 2023-12-12T11:51:49.253 INFO:tasks.workunit.client.0.smithi063.stdout:4/266: mknod d2/d17/c57 0 2023-12-12T11:51:49.253 INFO:tasks.workunit.client.0.smithi063.stdout:4/267: creat d2/f58 x:0 0 0 2023-12-12T11:51:49.255 INFO:tasks.workunit.client.1.smithi093.stdout:6/593: rename d0/da/d14/d3a/c3c to d0/cde 0 2023-12-12T11:51:49.260 INFO:tasks.workunit.client.0.smithi063.stdout:9/206: dwrite d7/d11/d12/f3d [0,4194304] 0 2023-12-12T11:51:49.263 INFO:tasks.workunit.client.0.smithi063.stdout:6/242: creat d9/d10/d2a/f53 x:0 0 0 2023-12-12T11:51:49.263 INFO:tasks.workunit.client.0.smithi063.stdout:6/243: creat d9/d2c/f54 x:0 0 0 2023-12-12T11:51:49.263 INFO:tasks.workunit.client.0.smithi063.stdout:6/244: chown c7 1350 1 2023-12-12T11:51:49.266 INFO:tasks.workunit.client.1.smithi093.stdout:3/448: write df/d30/d33/f3a [2551488,8636] 0 2023-12-12T11:51:49.267 INFO:tasks.workunit.client.0.smithi063.stdout:5/230: creat d7/d28/f3f x:0 0 0 2023-12-12T11:51:49.267 INFO:tasks.workunit.client.1.smithi093.stdout:0/453: write d5/d4d/f85 [1680855,27022] 0 2023-12-12T11:51:49.267 INFO:tasks.workunit.client.1.smithi093.stdout:0/454: stat d5/dd/f35 0 2023-12-12T11:51:49.267 INFO:tasks.workunit.client.1.smithi093.stdout:0/455: stat d5/d21/d2f/f3d 0 2023-12-12T11:51:49.267 INFO:tasks.workunit.client.1.smithi093.stdout:8/450: write d3/d1a/d1f/f2a [1355291,8909] 0 2023-12-12T11:51:49.270 INFO:tasks.workunit.client.0.smithi063.stdout:0/207: sync 2023-12-12T11:51:49.271 INFO:tasks.workunit.client.0.smithi063.stdout:0/208: readlink d0/d1a/d23/d34/d42/l39 0 2023-12-12T11:51:49.275 INFO:tasks.workunit.client.1.smithi093.stdout:4/625: creat d0/d31/fc5 x:0 0 0 2023-12-12T11:51:49.276 INFO:tasks.workunit.client.0.smithi063.stdout:6/245: dread d9/fb [0,4194304] 0 2023-12-12T11:51:49.277 INFO:tasks.workunit.client.1.smithi093.stdout:9/422: write d1/d23/d24/d29/d43/f71 [268638,51798] 0 2023-12-12T11:51:49.277 INFO:tasks.workunit.client.1.smithi093.stdout:9/423: creat d1/d23/d24/d29/d43/d56/d68/f90 x:0 0 0 2023-12-12T11:51:49.289 INFO:tasks.workunit.client.0.smithi063.stdout:9/207: mkdir d7/d11/d12/d30/d3e 0 2023-12-12T11:51:49.290 INFO:tasks.workunit.client.0.smithi063.stdout:9/208: write d7/d20/f29 [40722,61247] 0 2023-12-12T11:51:49.308 INFO:tasks.workunit.client.0.smithi063.stdout:5/231: mknod d7/de/c40 0 2023-12-12T11:51:49.309 INFO:tasks.workunit.client.1.smithi093.stdout:2/468: symlink d5/d14/d2d/d8b/l9f 0 2023-12-12T11:51:49.313 INFO:tasks.workunit.client.1.smithi093.stdout:6/594: mknod d0/da/dbf/cdf 0 2023-12-12T11:51:49.320 INFO:tasks.workunit.client.0.smithi063.stdout:2/173: rename d0/d11 to d0/d3b 0 2023-12-12T11:51:49.322 INFO:tasks.workunit.client.1.smithi093.stdout:1/445: dread d4/dc/f33 [0,4194304] 0 2023-12-12T11:51:49.326 INFO:tasks.workunit.client.1.smithi093.stdout:3/449: mkdir df/d92 0 2023-12-12T11:51:49.326 INFO:tasks.workunit.client.1.smithi093.stdout:8/451: mkdir d3/d1a/d1f/d29/d3a/d8f 0 2023-12-12T11:51:49.326 INFO:tasks.workunit.client.1.smithi093.stdout:8/452: chown d3/d1a/f2b 134017 1 2023-12-12T11:51:49.326 INFO:tasks.workunit.client.1.smithi093.stdout:8/453: dread - d3/d1a/d1f/d29/d3a/d40/f53 zero size 2023-12-12T11:51:49.326 INFO:tasks.workunit.client.1.smithi093.stdout:0/456: mknod d5/dd/d14/d26/d58/d64/c8d 0 2023-12-12T11:51:49.327 INFO:tasks.workunit.client.1.smithi093.stdout:0/457: creat d5/dd/d14/d26/f8e x:0 0 0 2023-12-12T11:51:49.327 INFO:tasks.workunit.client.1.smithi093.stdout:4/626: creat d0/d87/fc6 x:0 0 0 2023-12-12T11:51:49.327 INFO:tasks.workunit.client.0.smithi063.stdout:4/268: rmdir d2 39 2023-12-12T11:51:49.330 INFO:tasks.workunit.client.0.smithi063.stdout:9/209: mkdir d7/d20/d3f 0 2023-12-12T11:51:49.335 INFO:tasks.workunit.client.1.smithi093.stdout:9/424: creat d1/d12/d1f/d3d/f91 x:0 0 0 2023-12-12T11:51:49.336 INFO:tasks.workunit.client.1.smithi093.stdout:9/425: readlink d1/d12/l36 0 2023-12-12T11:51:49.336 INFO:tasks.workunit.client.1.smithi093.stdout:6/595: stat d0/da/c10 0 2023-12-12T11:51:49.338 INFO:tasks.workunit.client.0.smithi063.stdout:5/232: mknod d7/c41 0 2023-12-12T11:51:49.338 INFO:tasks.workunit.client.0.smithi063.stdout:5/233: chown d7/f15 332847002 1 2023-12-12T11:51:49.338 INFO:tasks.workunit.client.0.smithi063.stdout:5/234: write d7/d28/f2f [610458,114112] 0 2023-12-12T11:51:49.338 INFO:tasks.workunit.client.0.smithi063.stdout:2/174: rename d0/f14 to d0/f3c 0 2023-12-12T11:51:49.338 INFO:tasks.workunit.client.0.smithi063.stdout:4/269: creat d2/d17/f59 x:0 0 0 2023-12-12T11:51:49.338 INFO:tasks.workunit.client.0.smithi063.stdout:4/270: readlink d2/d47/l38 0 2023-12-12T11:51:49.340 INFO:tasks.workunit.client.1.smithi093.stdout:0/458: symlink d5/dd/d14/d26/d58/l8f 0 2023-12-12T11:51:49.340 INFO:tasks.workunit.client.1.smithi093.stdout:6/596: creat d0/d52/d6b/fe0 x:0 0 0 2023-12-12T11:51:49.340 INFO:tasks.workunit.client.1.smithi093.stdout:0/459: fsync d5/d21/f2e 0 2023-12-12T11:51:49.340 INFO:tasks.workunit.client.1.smithi093.stdout:6/597: chown d0/da/d14/d38/d43/f76 89 1 2023-12-12T11:51:49.341 INFO:tasks.workunit.client.1.smithi093.stdout:0/460: getdents d5/d21/d2f 0 2023-12-12T11:51:49.341 INFO:tasks.workunit.client.1.smithi093.stdout:6/598: write d0/da/d32/fa9 [24769,32747] 0 2023-12-12T11:51:49.341 INFO:tasks.workunit.client.1.smithi093.stdout:6/599: readlink d0/l6 0 2023-12-12T11:51:49.341 INFO:tasks.workunit.client.0.smithi063.stdout:6/246: dwrite d9/f40 [0,4194304] 0 2023-12-12T11:51:49.345 INFO:tasks.workunit.client.1.smithi093.stdout:1/446: unlink d4/d1a/d1b/d26/d65/l74 0 2023-12-12T11:51:49.345 INFO:tasks.workunit.client.0.smithi063.stdout:5/235: mkdir d7/d10/d2b/d3c/d42 0 2023-12-12T11:51:49.346 INFO:tasks.workunit.client.0.smithi063.stdout:5/236: readlink d7/d10/d2b/d3c/l37 0 2023-12-12T11:51:49.346 INFO:tasks.workunit.client.0.smithi063.stdout:5/237: write d7/d10/d2b/f34 [149591,61949] 0 2023-12-12T11:51:49.346 INFO:tasks.workunit.client.0.smithi063.stdout:5/238: chown d7/f29 27 1 2023-12-12T11:51:49.348 INFO:tasks.workunit.client.1.smithi093.stdout:3/450: link df/d25/d2c/d85/f8f df/d36/d3d/d42/f93 0 2023-12-12T11:51:49.348 INFO:tasks.workunit.client.1.smithi093.stdout:3/451: chown df/d22/l2a 210132 1 2023-12-12T11:51:49.349 INFO:tasks.workunit.client.0.smithi063.stdout:2/175: dread d0/f15 [0,4194304] 0 2023-12-12T11:51:49.352 INFO:tasks.workunit.client.1.smithi093.stdout:8/454: dread d3/d8/fc [0,4194304] 0 2023-12-12T11:51:49.352 INFO:tasks.workunit.client.1.smithi093.stdout:6/600: rename d0/da/d14/d38/d43/cbe to d0/da/d14/d38/d43/ce1 0 2023-12-12T11:51:49.353 INFO:tasks.workunit.client.0.smithi063.stdout:0/209: dwrite d0/d7/d27/d1f/f3f [0,4194304] 0 2023-12-12T11:51:49.355 INFO:tasks.workunit.client.0.smithi063.stdout:2/176: getdents d0/d3b 0 2023-12-12T11:51:49.360 INFO:tasks.workunit.client.1.smithi093.stdout:6/601: symlink d0/da/d14/d21/le2 0 2023-12-12T11:51:49.362 INFO:tasks.workunit.client.0.smithi063.stdout:9/210: read d7/d15/f17 [3486500,38275] 0 2023-12-12T11:51:49.363 INFO:tasks.workunit.client.0.smithi063.stdout:9/211: write d7/d15/f2e [402626,69073] 0 2023-12-12T11:51:49.363 INFO:tasks.workunit.client.1.smithi093.stdout:3/452: creat df/d22/d49/d69/d6e/f94 x:0 0 0 2023-12-12T11:51:49.367 INFO:tasks.workunit.client.1.smithi093.stdout:2/469: dwrite d5/d14/d2d/d12/d44/f57 [0,4194304] 0 2023-12-12T11:51:49.370 INFO:tasks.workunit.client.1.smithi093.stdout:8/455: creat d3/d1a/d1f/d29/d3a/d68/d8a/f90 x:0 0 0 2023-12-12T11:51:49.370 INFO:tasks.workunit.client.1.smithi093.stdout:8/456: dread - d3/d1a/d1f/d59/f6a zero size 2023-12-12T11:51:49.370 INFO:tasks.workunit.client.1.smithi093.stdout:1/447: rename d4/d1c/l46 to d4/d1a/d1b/d26/d82/l93 0 2023-12-12T11:51:49.370 INFO:tasks.workunit.client.0.smithi063.stdout:5/239: read d7/f15 [3849654,67669] 0 2023-12-12T11:51:49.371 INFO:tasks.workunit.client.1.smithi093.stdout:6/602: creat d0/da/d14/d21/dd0/fe3 x:0 0 0 2023-12-12T11:51:49.374 INFO:tasks.workunit.client.1.smithi093.stdout:6/603: read d0/da/d14/f55 [27414,118267] 0 2023-12-12T11:51:49.374 INFO:tasks.workunit.client.1.smithi093.stdout:6/604: creat d0/da/d32/d39/d5b/fe4 x:0 0 0 2023-12-12T11:51:49.374 INFO:tasks.workunit.client.1.smithi093.stdout:4/627: dread d0/d36/f75 [0,4194304] 0 2023-12-12T11:51:49.375 INFO:tasks.workunit.client.1.smithi093.stdout:3/453: symlink df/d22/d49/d69/d6e/l95 0 2023-12-12T11:51:49.379 INFO:tasks.workunit.client.0.smithi063.stdout:0/210: rmdir d0/d7 39 2023-12-12T11:51:49.379 INFO:tasks.workunit.client.1.smithi093.stdout:5/360: sync 2023-12-12T11:51:49.379 INFO:tasks.workunit.client.1.smithi093.stdout:5/361: readlink d0/d7/d59/d62/d77/l7b 0 2023-12-12T11:51:49.379 INFO:tasks.workunit.client.1.smithi093.stdout:5/362: dread - d0/d7/d36/d29/d44/f74 zero size 2023-12-12T11:51:49.383 INFO:tasks.workunit.client.0.smithi063.stdout:6/247: getdents d9/d10 0 2023-12-12T11:51:49.383 INFO:tasks.workunit.client.0.smithi063.stdout:6/248: creat d9/f55 x:0 0 0 2023-12-12T11:51:49.385 INFO:tasks.workunit.client.0.smithi063.stdout:2/177: creat d0/d3b/f3d x:0 0 0 2023-12-12T11:51:49.389 INFO:tasks.workunit.client.1.smithi093.stdout:8/457: write d3/d1a/d1f/f3d [4463325,30347] 0 2023-12-12T11:51:49.389 INFO:tasks.workunit.client.1.smithi093.stdout:8/458: getdents d3/d1a/d1f/d59/d6c 0 2023-12-12T11:51:49.389 INFO:tasks.workunit.client.1.smithi093.stdout:8/459: fsync d3/d1a/d1f/d29/d30/d58/d76/f86 0 2023-12-12T11:51:49.389 INFO:tasks.workunit.client.0.smithi063.stdout:9/212: mkdir d7/d20/d3f/d40 0 2023-12-12T11:51:49.393 INFO:tasks.workunit.client.0.smithi063.stdout:5/240: unlink d7/f13 0 2023-12-12T11:51:49.394 INFO:tasks.workunit.client.1.smithi093.stdout:5/363: read d0/d7/d36/d29/f30 [3765549,116852] 0 2023-12-12T11:51:49.397 INFO:tasks.workunit.client.0.smithi063.stdout:4/271: dwrite d2/d8/f26 [0,4194304] 0 2023-12-12T11:51:49.398 INFO:tasks.workunit.client.1.smithi093.stdout:1/448: mkdir d4/d1a/d1b/d26/d82/d94 0 2023-12-12T11:51:49.400 INFO:tasks.workunit.client.0.smithi063.stdout:5/241: fdatasync d7/d10/d2b/f34 0 2023-12-12T11:51:49.403 INFO:tasks.workunit.client.1.smithi093.stdout:9/426: dwrite d1/d12/d1f/d32/f7a [0,4194304] 0 2023-12-12T11:51:49.406 INFO:tasks.workunit.client.1.smithi093.stdout:8/460: dread d3/d1a/d1f/d29/f54 [0,4194304] 0 2023-12-12T11:51:49.408 INFO:tasks.workunit.client.1.smithi093.stdout:4/628: dwrite d0/d36/d49/f7e [0,4194304] 0 2023-12-12T11:51:49.422 INFO:tasks.workunit.client.0.smithi063.stdout:9/213: mknod d7/d11/d12/d30/d3e/c41 0 2023-12-12T11:51:49.424 INFO:tasks.workunit.client.1.smithi093.stdout:4/629: write d0/d36/d49/f7e [3676842,51946] 0 2023-12-12T11:51:49.426 INFO:tasks.workunit.client.1.smithi093.stdout:5/364: rename d0/d7/d8/f79 to d0/d7/d59/f7e 0 2023-12-12T11:51:49.428 INFO:tasks.workunit.client.1.smithi093.stdout:1/449: creat d4/d1a/d73/f95 x:0 0 0 2023-12-12T11:51:49.442 INFO:tasks.workunit.client.0.smithi063.stdout:1/184: sync 2023-12-12T11:51:49.442 INFO:tasks.workunit.client.0.smithi063.stdout:0/211: mkdir d0/d7/d27/d44 0 2023-12-12T11:51:49.447 INFO:tasks.workunit.client.1.smithi093.stdout:8/461: dwrite d3/d1a/d1f/d29/f32 [0,4194304] 0 2023-12-12T11:51:49.455 INFO:tasks.workunit.client.0.smithi063.stdout:7/210: sync 2023-12-12T11:51:49.455 INFO:tasks.workunit.client.0.smithi063.stdout:7/211: creat de/d34/f55 x:0 0 0 2023-12-12T11:51:49.461 INFO:tasks.workunit.client.1.smithi093.stdout:7/398: sync 2023-12-12T11:51:49.463 INFO:tasks.workunit.client.0.smithi063.stdout:6/249: rmdir d9/d2c 39 2023-12-12T11:51:49.475 INFO:tasks.workunit.client.0.smithi063.stdout:9/214: dwrite d7/ff [0,4194304] 0 2023-12-12T11:51:49.478 INFO:tasks.workunit.client.1.smithi093.stdout:6/605: getdents d0/da/dbf 0 2023-12-12T11:51:49.480 INFO:tasks.workunit.client.0.smithi063.stdout:1/185: mkdir d3/d3a 0 2023-12-12T11:51:49.480 INFO:tasks.workunit.client.0.smithi063.stdout:1/186: fsync d3/db/d16/f2d 0 2023-12-12T11:51:49.481 INFO:tasks.workunit.client.0.smithi063.stdout:2/178: dwrite d0/d3b/f34 [0,4194304] 0 2023-12-12T11:51:49.485 INFO:tasks.workunit.client.0.smithi063.stdout:4/272: dwrite d2/d17/f59 [0,4194304] 0 2023-12-12T11:51:49.486 INFO:tasks.workunit.client.0.smithi063.stdout:8/320: sync 2023-12-12T11:51:49.492 INFO:tasks.workunit.client.0.smithi063.stdout:7/212: mkdir de/d3f/d56 0 2023-12-12T11:51:49.497 INFO:tasks.workunit.client.1.smithi093.stdout:3/454: mknod df/d25/d2c/d85/c96 0 2023-12-12T11:51:49.497 INFO:tasks.workunit.client.1.smithi093.stdout:4/630: truncate d0/f27 3224426 0 2023-12-12T11:51:49.497 INFO:tasks.workunit.client.1.smithi093.stdout:4/631: chown d0/d31/c2f 1879111126 1 2023-12-12T11:51:49.505 INFO:tasks.workunit.client.0.smithi063.stdout:6/250: creat d9/d10/d25/f56 x:0 0 0 2023-12-12T11:51:49.505 INFO:tasks.workunit.client.0.smithi063.stdout:6/251: stat d9/d10/f41 0 2023-12-12T11:51:49.507 INFO:tasks.workunit.client.0.smithi063.stdout:3/189: sync 2023-12-12T11:51:49.510 INFO:tasks.workunit.client.0.smithi063.stdout:0/212: truncate d0/d7/d27/d1f/f3f 3648162 0 2023-12-12T11:51:49.510 INFO:tasks.workunit.client.0.smithi063.stdout:0/213: write d0/d7/d27/d19/d2d/f43 [176589,80249] 0 2023-12-12T11:51:49.510 INFO:tasks.workunit.client.0.smithi063.stdout:0/214: stat d0/d7/d27/f29 0 2023-12-12T11:51:49.512 INFO:tasks.workunit.client.1.smithi093.stdout:1/450: rename d4/d1c/f66 to d4/d1a/d1b/d26/d65/d6f/f96 0 2023-12-12T11:51:49.512 INFO:tasks.workunit.client.1.smithi093.stdout:1/451: chown d4/d1a/d1b/d26/d82/l93 146 1 2023-12-12T11:51:49.520 INFO:tasks.workunit.client.0.smithi063.stdout:9/215: rename c4 to d7/c42 0 2023-12-12T11:51:49.520 INFO:tasks.workunit.client.0.smithi063.stdout:9/216: write d7/f19 [539567,54475] 0 2023-12-12T11:51:49.520 INFO:tasks.workunit.client.0.smithi063.stdout:9/217: readlink d7/d15/l1c 0 2023-12-12T11:51:49.524 INFO:tasks.workunit.client.0.smithi063.stdout:1/187: symlink d3/d3a/l3b 0 2023-12-12T11:51:49.529 INFO:tasks.workunit.client.1.smithi093.stdout:6/606: dwrite d0/da/d14/d38/d43/f9d [0,4194304] 0 2023-12-12T11:51:49.529 INFO:tasks.workunit.client.1.smithi093.stdout:6/607: chown d0/da/d14/d21/fa5 1 1 2023-12-12T11:51:49.537 INFO:tasks.workunit.client.1.smithi093.stdout:8/462: rmdir d3 39 2023-12-12T11:51:49.537 INFO:tasks.workunit.client.1.smithi093.stdout:8/463: write d3/d8/f39 [1857105,98200] 0 2023-12-12T11:51:49.537 INFO:tasks.workunit.client.1.smithi093.stdout:8/464: write d3/d1a/d1f/d29/d3a/d40/f61 [802816,129527] 0 2023-12-12T11:51:49.538 INFO:tasks.workunit.client.1.smithi093.stdout:8/465: chown d3/d1a/d1f/d29/d3a/c5b 1163838 1 2023-12-12T11:51:49.538 INFO:tasks.workunit.client.1.smithi093.stdout:8/466: write d3/d8/f23 [443727,103617] 0 2023-12-12T11:51:49.539 INFO:tasks.workunit.client.0.smithi063.stdout:8/321: creat d4/d24/d3e/f60 x:0 0 0 2023-12-12T11:51:49.540 INFO:tasks.workunit.client.1.smithi093.stdout:1/452: dread d4/d1c/f88 [4194304,4194304] 0 2023-12-12T11:51:49.540 INFO:tasks.workunit.client.1.smithi093.stdout:7/399: creat da/d15/d59/d80/f8b x:0 0 0 2023-12-12T11:51:49.541 INFO:tasks.workunit.client.1.smithi093.stdout:9/427: mkdir d1/d23/d6b/d92 0 2023-12-12T11:51:49.541 INFO:tasks.workunit.client.0.smithi063.stdout:2/179: dwrite d0/d1a/d1e/f2e [4194304,4194304] 0 2023-12-12T11:51:49.541 INFO:tasks.workunit.client.0.smithi063.stdout:4/273: dwrite d2/d17/d41/f4d [0,4194304] 0 2023-12-12T11:51:49.541 INFO:tasks.workunit.client.0.smithi063.stdout:4/274: truncate d2/d47/f2c 4482819 0 2023-12-12T11:51:49.544 INFO:tasks.workunit.client.1.smithi093.stdout:2/470: rmdir d5/d14/d5e/d7d 0 2023-12-12T11:51:49.544 INFO:tasks.workunit.client.0.smithi063.stdout:6/252: symlink d9/d10/d2a/l57 0 2023-12-12T11:51:49.552 INFO:tasks.workunit.client.0.smithi063.stdout:0/215: rmdir d0/d7 39 2023-12-12T11:51:49.552 INFO:tasks.workunit.client.0.smithi063.stdout:0/216: read d0/d1a/d23/d34/d42/f2b [5130997,102263] 0 2023-12-12T11:51:49.552 INFO:tasks.workunit.client.0.smithi063.stdout:0/217: chown d0/d7/ff 111 1 2023-12-12T11:51:49.554 INFO:tasks.workunit.client.1.smithi093.stdout:3/455: symlink df/d36/l97 0 2023-12-12T11:51:49.554 INFO:tasks.workunit.client.1.smithi093.stdout:1/453: write d4/d1a/f6b [3142544,17176] 0 2023-12-12T11:51:49.555 INFO:tasks.workunit.client.1.smithi093.stdout:4/632: mknod d0/d87/cc7 0 2023-12-12T11:51:49.555 INFO:tasks.workunit.client.1.smithi093.stdout:4/633: write d0/d31/d5c/fb9 [719729,123020] 0 2023-12-12T11:51:49.555 INFO:tasks.workunit.client.0.smithi063.stdout:4/275: dread d2/d8/f32 [0,4194304] 0 2023-12-12T11:51:49.556 INFO:tasks.workunit.client.0.smithi063.stdout:4/276: readlink d2/d17/l29 0 2023-12-12T11:51:49.556 INFO:tasks.workunit.client.0.smithi063.stdout:8/322: mknod d4/de/d11/c61 0 2023-12-12T11:51:49.556 INFO:tasks.workunit.client.0.smithi063.stdout:8/323: chown d4/d24/d38/d45/d5b 7562732 1 2023-12-12T11:51:49.556 INFO:tasks.workunit.client.0.smithi063.stdout:8/324: chown d4/d24/c37 1675 1 2023-12-12T11:51:49.558 INFO:tasks.workunit.client.1.smithi093.stdout:5/365: getdents d0/d7/d59/d35 0 2023-12-12T11:51:49.558 INFO:tasks.workunit.client.1.smithi093.stdout:5/366: fsync d0/f5 0 2023-12-12T11:51:49.561 INFO:tasks.workunit.client.1.smithi093.stdout:4/634: dread d0/d31/d5c/d66/f84 [0,4194304] 0 2023-12-12T11:51:49.565 INFO:tasks.workunit.client.0.smithi063.stdout:1/188: dwrite d3/db/d16/f36 [0,4194304] 0 2023-12-12T11:51:49.566 INFO:tasks.workunit.client.1.smithi093.stdout:0/461: sync 2023-12-12T11:51:49.567 INFO:tasks.workunit.client.1.smithi093.stdout:6/608: mknod d0/d52/d7e/d42/dd5/ddc/ce5 0 2023-12-12T11:51:49.568 INFO:tasks.workunit.client.0.smithi063.stdout:6/253: write d9/fc [6252746,95273] 0 2023-12-12T11:51:49.568 INFO:tasks.workunit.client.0.smithi063.stdout:6/254: dread - d9/d10/d25/f3d zero size 2023-12-12T11:51:49.569 INFO:tasks.workunit.client.0.smithi063.stdout:9/218: dwrite d7/f14 [0,4194304] 0 2023-12-12T11:51:49.575 INFO:tasks.workunit.client.0.smithi063.stdout:2/180: chown d0/d3b/c23 45883 1 2023-12-12T11:51:49.576 INFO:tasks.workunit.client.0.smithi063.stdout:3/190: symlink d4/l38 0 2023-12-12T11:51:49.578 INFO:tasks.workunit.client.1.smithi093.stdout:8/467: rename d3/d1a/f44 to d3/f91 0 2023-12-12T11:51:49.581 INFO:tasks.workunit.client.0.smithi063.stdout:0/218: creat d0/d7/d27/d19/f45 x:0 0 0 2023-12-12T11:51:49.585 INFO:tasks.workunit.client.1.smithi093.stdout:7/400: symlink da/d2e/l8c 0 2023-12-12T11:51:49.585 INFO:tasks.workunit.client.1.smithi093.stdout:7/401: write da/de/f72 [1041537,66384] 0 2023-12-12T11:51:49.585 INFO:tasks.workunit.client.1.smithi093.stdout:7/402: creat da/d15/d59/d80/f8d x:0 0 0 2023-12-12T11:51:49.585 INFO:tasks.workunit.client.0.smithi063.stdout:9/219: dread d7/f19 [0,4194304] 0 2023-12-12T11:51:49.586 INFO:tasks.workunit.client.0.smithi063.stdout:9/220: creat d7/d15/f43 x:0 0 0 2023-12-12T11:51:49.589 INFO:tasks.workunit.client.1.smithi093.stdout:2/471: mkdir d5/d14/d2d/d12/d25/d7a/d7e/da0 0 2023-12-12T11:51:49.593 INFO:tasks.workunit.client.1.smithi093.stdout:4/635: symlink d0/d36/d61/d97/lc8 0 2023-12-12T11:51:49.594 INFO:tasks.workunit.client.1.smithi093.stdout:4/636: fdatasync d0/d87/fc6 0 2023-12-12T11:51:49.594 INFO:tasks.workunit.client.0.smithi063.stdout:4/277: unlink d2/d47/f2c 0 2023-12-12T11:51:49.594 INFO:tasks.workunit.client.0.smithi063.stdout:4/278: read d2/d47/f30 [434223,91817] 0 2023-12-12T11:51:49.594 INFO:tasks.workunit.client.0.smithi063.stdout:4/279: chown d2/d48/l55 0 1 2023-12-12T11:51:49.595 INFO:tasks.workunit.client.0.smithi063.stdout:6/255: dread d9/f40 [0,4194304] 0 2023-12-12T11:51:49.596 INFO:tasks.workunit.client.0.smithi063.stdout:2/181: dread d0/f6 [4194304,4194304] 0 2023-12-12T11:51:49.596 INFO:tasks.workunit.client.0.smithi063.stdout:2/182: fdatasync d0/f33 0 2023-12-12T11:51:49.598 INFO:tasks.workunit.client.1.smithi093.stdout:9/428: rename d1/d12/d1f/d3d/c50 to d1/d12/d1f/d73/c93 0 2023-12-12T11:51:49.599 INFO:tasks.workunit.client.1.smithi093.stdout:8/468: creat d3/d1a/d1f/d29/d3a/d68/f92 x:0 0 0 2023-12-12T11:51:49.599 INFO:tasks.workunit.client.1.smithi093.stdout:8/469: readlink d3/d1a/d1f/d29/l38 0 2023-12-12T11:51:49.601 INFO:tasks.workunit.client.1.smithi093.stdout:7/403: chown da/d15/c40 3808493 1 2023-12-12T11:51:49.601 INFO:tasks.workunit.client.1.smithi093.stdout:7/404: write da/d2e/f79 [4515069,67583] 0 2023-12-12T11:51:49.603 INFO:tasks.workunit.client.1.smithi093.stdout:2/472: mkdir d5/d14/d2d/d4c/da1 0 2023-12-12T11:51:49.603 INFO:tasks.workunit.client.1.smithi093.stdout:8/470: rmdir d3/d1a/d1f/d29/d30/d58 39 2023-12-12T11:51:49.607 INFO:tasks.workunit.client.1.smithi093.stdout:1/454: rename d4/dc/f32 to d4/d1a/d73/f97 0 2023-12-12T11:51:49.607 INFO:tasks.workunit.client.1.smithi093.stdout:7/405: mkdir da/d8e 0 2023-12-12T11:51:49.607 INFO:tasks.workunit.client.1.smithi093.stdout:7/406: write da/de/f53 [1045015,91797] 0 2023-12-12T11:51:49.609 INFO:tasks.workunit.client.1.smithi093.stdout:2/473: getdents d5/d14/d2d/d4c/d76 0 2023-12-12T11:51:49.610 INFO:tasks.workunit.client.0.smithi063.stdout:9/221: creat d7/d20/d3f/d40/f44 x:0 0 0 2023-12-12T11:51:49.611 INFO:tasks.workunit.client.0.smithi063.stdout:6/256: truncate d9/f18 2943484 0 2023-12-12T11:51:49.611 INFO:tasks.workunit.client.0.smithi063.stdout:8/325: rename d4/de/d32 to d4/de/d3b/d62 0 2023-12-12T11:51:49.613 INFO:tasks.workunit.client.1.smithi093.stdout:1/455: mknod d4/dc/d7a/c98 0 2023-12-12T11:51:49.614 INFO:tasks.workunit.client.1.smithi093.stdout:7/407: creat da/d2e/f8f x:0 0 0 2023-12-12T11:51:49.618 INFO:tasks.workunit.client.1.smithi093.stdout:2/474: mkdir d5/d14/d2d/d8b/da2 0 2023-12-12T11:51:49.620 INFO:tasks.workunit.client.1.smithi093.stdout:4/637: dread d0/f44 [0,4194304] 0 2023-12-12T11:51:49.626 INFO:tasks.workunit.client.1.smithi093.stdout:2/475: mkdir d5/d14/d2d/d8b/da3 0 2023-12-12T11:51:49.626 INFO:tasks.workunit.client.0.smithi063.stdout:6/257: dread d9/f43 [0,4194304] 0 2023-12-12T11:51:49.628 INFO:tasks.workunit.client.1.smithi093.stdout:5/367: dwrite d0/d7/d59/f60 [0,4194304] 0 2023-12-12T11:51:49.633 INFO:tasks.workunit.client.0.smithi063.stdout:8/326: dread d4/f1d [0,4194304] 0 2023-12-12T11:51:49.635 INFO:tasks.workunit.client.1.smithi093.stdout:7/408: rename da/de/d46/d58 to da/d15/d19/d90 0 2023-12-12T11:51:49.635 INFO:tasks.workunit.client.1.smithi093.stdout:7/409: fsync da/de/d46/d4f/f56 0 2023-12-12T11:51:49.635 INFO:tasks.workunit.client.1.smithi093.stdout:7/410: chown da/d15/d19/l33 6931 1 2023-12-12T11:51:49.635 INFO:tasks.workunit.client.1.smithi093.stdout:7/411: stat da/d15/d2d/d2f/f3d 0 2023-12-12T11:51:49.635 INFO:tasks.workunit.client.1.smithi093.stdout:7/412: chown da/de/d81 1 1 2023-12-12T11:51:49.637 INFO:tasks.workunit.client.1.smithi093.stdout:7/413: write da/d15/d19/f21 [832321,101130] 0 2023-12-12T11:51:49.641 INFO:tasks.workunit.client.0.smithi063.stdout:6/258: creat d9/d10/f58 x:0 0 0 2023-12-12T11:51:49.642 INFO:tasks.workunit.client.0.smithi063.stdout:1/189: dwrite d3/db/d16/d24/f29 [0,4194304] 0 2023-12-12T11:51:49.642 INFO:tasks.workunit.client.0.smithi063.stdout:1/190: creat d3/db/d16/f3c x:0 0 0 2023-12-12T11:51:49.647 INFO:tasks.workunit.client.1.smithi093.stdout:8/471: write d3/d1a/d1f/d29/d30/d58/f85 [1435199,63162] 0 2023-12-12T11:51:49.655 INFO:tasks.workunit.client.0.smithi063.stdout:8/327: unlink d4/de/d1e/c25 0 2023-12-12T11:51:49.656 INFO:tasks.workunit.client.1.smithi093.stdout:0/462: dwrite d5/dd/f53 [0,4194304] 0 2023-12-12T11:51:49.657 INFO:tasks.workunit.client.0.smithi063.stdout:3/191: rename d4/df/c12 to d4/c39 0 2023-12-12T11:51:49.657 INFO:tasks.workunit.client.0.smithi063.stdout:3/192: readlink d4/df/d1a/d1c/l1f 0 2023-12-12T11:51:49.657 INFO:tasks.workunit.client.0.smithi063.stdout:4/280: write d2/f10 [62241,14686] 0 2023-12-12T11:51:49.661 INFO:tasks.workunit.client.1.smithi093.stdout:3/456: dwrite df/d30/d33/f3a [0,4194304] 0 2023-12-12T11:51:49.670 INFO:tasks.workunit.client.1.smithi093.stdout:8/472: getdents d3/d1a 0 2023-12-12T11:51:49.670 INFO:tasks.workunit.client.1.smithi093.stdout:8/473: chown d3/d1a/d1f/d59/f6a 6 1 2023-12-12T11:51:49.670 INFO:tasks.workunit.client.1.smithi093.stdout:8/474: stat d3/d1a/d1f/d29 0 2023-12-12T11:51:49.675 INFO:tasks.workunit.client.0.smithi063.stdout:3/193: symlink d4/df/d1a/d1c/d34/l3a 0 2023-12-12T11:51:49.675 INFO:tasks.workunit.client.0.smithi063.stdout:8/328: creat d4/de/d3b/d62/d36/d57/f63 x:0 0 0 2023-12-12T11:51:49.675 INFO:tasks.workunit.client.0.smithi063.stdout:2/183: dwrite d0/d1a/f1d [0,4194304] 0 2023-12-12T11:51:49.675 INFO:tasks.workunit.client.0.smithi063.stdout:2/184: write d0/f22 [5083406,17007] 0 2023-12-12T11:51:49.682 INFO:tasks.workunit.client.1.smithi093.stdout:4/638: dread d0/d36/f4c [0,4194304] 0 2023-12-12T11:51:49.684 INFO:tasks.workunit.client.0.smithi063.stdout:2/185: rmdir d0/d1a/d39 0 2023-12-12T11:51:49.685 INFO:tasks.workunit.client.0.smithi063.stdout:2/186: rename d0 to d0/d3e 22 2023-12-12T11:51:49.685 INFO:tasks.workunit.client.1.smithi093.stdout:8/475: creat d3/d1a/d1f/d59/d6c/f93 x:0 0 0 2023-12-12T11:51:49.688 INFO:tasks.workunit.client.0.smithi063.stdout:2/187: chown d0/d1a/d1e/l36 12242 1 2023-12-12T11:51:49.688 INFO:tasks.workunit.client.0.smithi063.stdout:2/188: readlink d0/la 0 2023-12-12T11:51:49.691 INFO:tasks.workunit.client.0.smithi063.stdout:2/189: creat d0/d3b/f3f x:0 0 0 2023-12-12T11:51:49.692 INFO:tasks.workunit.client.0.smithi063.stdout:2/190: symlink d0/d1a/l40 0 2023-12-12T11:51:49.695 INFO:tasks.workunit.client.0.smithi063.stdout:2/191: mkdir d0/d41 0 2023-12-12T11:51:49.710 INFO:tasks.workunit.client.0.smithi063.stdout:2/192: symlink d0/d3b/l42 0 2023-12-12T11:51:49.710 INFO:tasks.workunit.client.0.smithi063.stdout:2/193: chown d0/f33 42 1 2023-12-12T11:51:49.712 INFO:tasks.workunit.client.0.smithi063.stdout:9/222: dwrite f6 [0,4194304] 0 2023-12-12T11:51:49.712 INFO:tasks.workunit.client.0.smithi063.stdout:1/191: dread d3/db/d16/d24/f2a [0,4194304] 0 2023-12-12T11:51:49.712 INFO:tasks.workunit.client.0.smithi063.stdout:9/223: read d7/d15/f17 [2670581,29974] 0 2023-12-12T11:51:49.712 INFO:tasks.workunit.client.0.smithi063.stdout:1/192: stat d3/db/d16/f36 0 2023-12-12T11:51:49.712 INFO:tasks.workunit.client.0.smithi063.stdout:1/193: dread - d3/db/d16/f3c zero size 2023-12-12T11:51:49.713 INFO:tasks.workunit.client.1.smithi093.stdout:6/609: dwrite d0/da/d14/f72 [4194304,4194304] 0 2023-12-12T11:51:49.713 INFO:tasks.workunit.client.0.smithi063.stdout:2/194: dread - d0/d1a/d1e/f31 zero size 2023-12-12T11:51:49.714 INFO:tasks.workunit.client.0.smithi063.stdout:2/195: creat d0/f43 x:0 0 0 2023-12-12T11:51:49.714 INFO:tasks.workunit.client.0.smithi063.stdout:2/196: fdatasync d0/d3b/f34 0 2023-12-12T11:51:49.717 INFO:tasks.workunit.client.0.smithi063.stdout:9/224: unlink d7/f2a 0 2023-12-12T11:51:49.721 INFO:tasks.workunit.client.1.smithi093.stdout:5/368: dread d0/d7/d59/d35/f1f [0,4194304] 0 2023-12-12T11:51:49.721 INFO:tasks.workunit.client.1.smithi093.stdout:5/369: chown d0/d7/d36/d38/c57 0 1 2023-12-12T11:51:49.722 INFO:tasks.workunit.client.1.smithi093.stdout:1/456: dwrite d4/d1a/d1b/d26/d65/d6f/f96 [0,4194304] 0 2023-12-12T11:51:49.722 INFO:tasks.workunit.client.0.smithi063.stdout:1/194: creat d3/db/d16/d24/d30/f3d x:0 0 0 2023-12-12T11:51:49.723 INFO:tasks.workunit.client.0.smithi063.stdout:1/195: chown d3/d3a 451067 1 2023-12-12T11:51:49.724 INFO:tasks.workunit.client.0.smithi063.stdout:1/196: readlink d3/db/l26 0 2023-12-12T11:51:49.725 INFO:tasks.workunit.client.0.smithi063.stdout:1/197: write d3/db/d16/f32 [1019945,474] 0 2023-12-12T11:51:49.725 INFO:tasks.workunit.client.0.smithi063.stdout:9/225: truncate d7/f2b 3061098 0 2023-12-12T11:51:49.725 INFO:tasks.workunit.client.1.smithi093.stdout:6/610: rename d0/da/ce to d0/da/d32/dd3/ce6 0 2023-12-12T11:51:49.730 INFO:tasks.workunit.client.1.smithi093.stdout:3/457: dwrite df/f21 [0,4194304] 0 2023-12-12T11:51:49.730 INFO:tasks.workunit.client.1.smithi093.stdout:3/458: readlink df/l17 0 2023-12-12T11:51:49.732 INFO:tasks.workunit.client.1.smithi093.stdout:7/414: dwrite da/de/f44 [0,4194304] 0 2023-12-12T11:51:49.732 INFO:tasks.workunit.client.1.smithi093.stdout:7/415: chown da/d15/d2d/f51 87428330 1 2023-12-12T11:51:49.732 INFO:tasks.workunit.client.1.smithi093.stdout:7/416: fdatasync da/de/d46/f4e 0 2023-12-12T11:51:49.735 INFO:tasks.workunit.client.0.smithi063.stdout:3/194: dread d4/df/d1a/f20 [0,4194304] 0 2023-12-12T11:51:49.735 INFO:tasks.workunit.client.0.smithi063.stdout:8/329: dread d4/de/d1e/f4f [0,4194304] 0 2023-12-12T11:51:49.736 INFO:tasks.workunit.client.0.smithi063.stdout:8/330: write d4/d55/f35 [1186972,22439] 0 2023-12-12T11:51:49.736 INFO:tasks.workunit.client.0.smithi063.stdout:8/331: chown d4/de/d1e/f4f 169193401 1 2023-12-12T11:51:49.737 INFO:tasks.workunit.client.1.smithi093.stdout:5/370: symlink d0/l7f 0 2023-12-12T11:51:49.737 INFO:tasks.workunit.client.1.smithi093.stdout:1/457: fsync d4/f25 0 2023-12-12T11:51:49.737 INFO:tasks.workunit.client.1.smithi093.stdout:1/458: read d4/dc/f17 [1092972,101836] 0 2023-12-12T11:51:49.737 INFO:tasks.workunit.client.1.smithi093.stdout:1/459: stat d4/d1a/d1b/d26/d31/c67 0 2023-12-12T11:51:49.738 INFO:tasks.workunit.client.1.smithi093.stdout:1/460: creat d4/d1a/d1b/f99 x:0 0 0 2023-12-12T11:51:49.738 INFO:tasks.workunit.client.0.smithi063.stdout:1/198: creat d3/db/d16/d17/d19/f3e x:0 0 0 2023-12-12T11:51:49.738 INFO:tasks.workunit.client.0.smithi063.stdout:8/332: write d4/f7 [1009565,80427] 0 2023-12-12T11:51:49.740 INFO:tasks.workunit.client.1.smithi093.stdout:6/611: mknod d0/da/d14/d3a/d95/ce7 0 2023-12-12T11:51:49.742 INFO:tasks.workunit.client.0.smithi063.stdout:3/195: mkdir d4/df/d1a/d1c/d3b 0 2023-12-12T11:51:49.745 INFO:tasks.workunit.client.1.smithi093.stdout:9/429: dwrite d1/d12/d1f/f25 [4194304,4194304] 0 2023-12-12T11:51:49.749 INFO:tasks.workunit.client.0.smithi063.stdout:1/199: symlink d3/l3f 0 2023-12-12T11:51:49.751 INFO:tasks.workunit.client.0.smithi063.stdout:8/333: rename d4/d24/f5d to d4/de/d1e/f64 0 2023-12-12T11:51:49.758 INFO:tasks.workunit.client.1.smithi093.stdout:2/476: dwrite d5/d46/d55/f8e [0,4194304] 0 2023-12-12T11:51:49.759 INFO:tasks.workunit.client.1.smithi093.stdout:2/477: truncate d5/d14/d2d/d4c/d54/d67/d69/d6c/f5a 1106640 0 2023-12-12T11:51:49.759 INFO:tasks.workunit.client.1.smithi093.stdout:8/476: dwrite d3/f1c [0,4194304] 0 2023-12-12T11:51:49.759 INFO:tasks.workunit.client.0.smithi063.stdout:1/200: creat d3/d3a/f40 x:0 0 0 2023-12-12T11:51:49.760 INFO:tasks.workunit.client.0.smithi063.stdout:5/242: sync 2023-12-12T11:51:49.763 INFO:tasks.workunit.client.0.smithi063.stdout:4/281: dwrite d2/d17/d4e/f51 [0,4194304] 0 2023-12-12T11:51:49.767 INFO:tasks.workunit.client.0.smithi063.stdout:8/334: unlink d4/de/d3b/l44 0 2023-12-12T11:51:49.782 INFO:tasks.workunit.client.0.smithi063.stdout:1/201: mknod d3/db/d16/c41 0 2023-12-12T11:51:49.782 INFO:tasks.workunit.client.0.smithi063.stdout:3/196: link d4/la d4/df/d1a/d1c/l3c 0 2023-12-12T11:51:49.782 INFO:tasks.workunit.client.0.smithi063.stdout:3/197: readlink d4/df/d1a/l36 0 2023-12-12T11:51:49.784 INFO:tasks.workunit.client.1.smithi093.stdout:4/639: dwrite d0/d31/d5c/d66/f84 [0,4194304] 0 2023-12-12T11:51:49.784 INFO:tasks.workunit.client.1.smithi093.stdout:9/430: dread d1/d12/d1f/d32/d42/f82 [0,4194304] 0 2023-12-12T11:51:49.784 INFO:tasks.workunit.client.1.smithi093.stdout:9/431: dread - d1/d12/d1f/d3d/d57/d63/f79 zero size 2023-12-12T11:51:49.784 INFO:tasks.workunit.client.1.smithi093.stdout:9/432: dread - d1/d12/d1f/d32/d42/f6e zero size 2023-12-12T11:51:49.791 INFO:tasks.workunit.client.0.smithi063.stdout:6/259: dread d9/f18 [0,4194304] 0 2023-12-12T11:51:49.791 INFO:tasks.workunit.client.0.smithi063.stdout:5/243: unlink d7/de/f20 0 2023-12-12T11:51:49.791 INFO:tasks.workunit.client.0.smithi063.stdout:6/260: dread - d9/d10/f52 zero size 2023-12-12T11:51:49.799 INFO:tasks.workunit.client.1.smithi093.stdout:5/371: write d0/d7/d59/d48/f56 [3943841,108664] 0 2023-12-12T11:51:49.799 INFO:tasks.workunit.client.1.smithi093.stdout:5/372: truncate d0/d3b/d66/f7d 352294 0 2023-12-12T11:51:49.799 INFO:tasks.workunit.client.0.smithi063.stdout:4/282: getdents d2/d17/d41 0 2023-12-12T11:51:49.817 INFO:tasks.workunit.client.1.smithi093.stdout:2/478: symlink d5/d14/la4 0 2023-12-12T11:51:49.819 INFO:tasks.workunit.client.1.smithi093.stdout:8/477: dwrite d3/f1c [0,4194304] 0 2023-12-12T11:51:49.823 INFO:tasks.workunit.client.0.smithi063.stdout:3/198: mkdir d4/df/d1a/d3d 0 2023-12-12T11:51:49.823 INFO:tasks.workunit.client.0.smithi063.stdout:1/202: dread d3/db/fe [0,4194304] 0 2023-12-12T11:51:49.824 INFO:tasks.workunit.client.0.smithi063.stdout:1/203: readlink d3/db/d16/d17/l2e 0 2023-12-12T11:51:49.830 INFO:tasks.workunit.client.0.smithi063.stdout:8/335: dwrite d4/de/f41 [4194304,4194304] 0 2023-12-12T11:51:49.830 INFO:tasks.workunit.client.1.smithi093.stdout:2/479: read d5/d14/d2d/d12/d44/f57 [223795,53020] 0 2023-12-12T11:51:49.838 INFO:tasks.workunit.client.0.smithi063.stdout:2/197: dwrite d0/f5 [0,4194304] 0 2023-12-12T11:51:49.839 INFO:tasks.workunit.client.0.smithi063.stdout:2/198: creat d0/d1a/d26/f44 x:0 0 0 2023-12-12T11:51:49.840 INFO:tasks.workunit.client.1.smithi093.stdout:1/461: dwrite d4/d1a/d1b/d26/d65/f8a [0,4194304] 0 2023-12-12T11:51:49.841 INFO:tasks.workunit.client.0.smithi063.stdout:9/226: dwrite d7/d15/f43 [0,4194304] 0 2023-12-12T11:51:49.845 INFO:tasks.workunit.client.1.smithi093.stdout:7/417: dwrite da/d15/d19/f5a [0,4194304] 0 2023-12-12T11:51:49.847 INFO:tasks.workunit.client.1.smithi093.stdout:3/459: dwrite df/f2f [0,4194304] 0 2023-12-12T11:51:49.850 INFO:tasks.workunit.client.0.smithi063.stdout:4/283: rmdir d2/d8 39 2023-12-12T11:51:49.851 INFO:tasks.workunit.client.0.smithi063.stdout:5/244: dwrite d7/f15 [0,4194304] 0 2023-12-12T11:51:49.855 INFO:tasks.workunit.client.1.smithi093.stdout:4/640: link d0/d31/d9d/da0/fa5 d0/d36/d49/fc9 0 2023-12-12T11:51:49.858 INFO:tasks.workunit.client.0.smithi063.stdout:3/199: creat d4/df/d1a/d1c/d3b/f3e x:0 0 0 2023-12-12T11:51:49.858 INFO:tasks.workunit.client.0.smithi063.stdout:3/200: chown d4/c39 97 1 2023-12-12T11:51:49.863 INFO:tasks.workunit.client.1.smithi093.stdout:9/433: link d1/d23/d24/d29/d43/d56/d68/f90 d1/f94 0 2023-12-12T11:51:49.865 INFO:tasks.workunit.client.0.smithi063.stdout:1/204: link d3/f9 d3/db/d12/f42 0 2023-12-12T11:51:49.870 INFO:tasks.workunit.client.1.smithi093.stdout:8/478: unlink d3/d1a/d1f/d29/f54 0 2023-12-12T11:51:49.873 INFO:tasks.workunit.client.0.smithi063.stdout:8/336: unlink d4/f8 0 2023-12-12T11:51:49.873 INFO:tasks.workunit.client.0.smithi063.stdout:8/337: getdents d4/d24/d38/d45/d5b 0 2023-12-12T11:51:49.875 INFO:tasks.workunit.client.1.smithi093.stdout:2/480: mkdir d5/d14/d2d/d12/d25/d7a/d7e/da5 0 2023-12-12T11:51:49.885 INFO:tasks.workunit.client.0.smithi063.stdout:6/261: dwrite d9/d10/f52 [0,4194304] 0 2023-12-12T11:51:49.885 INFO:tasks.workunit.client.0.smithi063.stdout:6/262: truncate d9/f4b 696912 0 2023-12-12T11:51:49.885 INFO:tasks.workunit.client.0.smithi063.stdout:6/263: read - d9/d2c/f39 zero size 2023-12-12T11:51:49.893 INFO:tasks.workunit.client.1.smithi093.stdout:1/462: mkdir d4/d1a/d83/d9a 0 2023-12-12T11:51:49.895 INFO:tasks.workunit.client.1.smithi093.stdout:3/460: dwrite df/d36/f41 [0,4194304] 0 2023-12-12T11:51:49.903 INFO:tasks.workunit.client.1.smithi093.stdout:7/418: rename da/d15/d19/l67 to da/d15/d59/d80/l91 0 2023-12-12T11:51:49.903 INFO:tasks.workunit.client.1.smithi093.stdout:7/419: readlink da/de/d46/l60 0 2023-12-12T11:51:49.913 INFO:tasks.workunit.client.1.smithi093.stdout:2/481: getdents d5/d14/d2d/d8b 0 2023-12-12T11:51:49.916 INFO:tasks.workunit.client.0.smithi063.stdout:4/284: rename d2/d17/c2e to d2/d17/d41/c5a 0 2023-12-12T11:51:49.916 INFO:tasks.workunit.client.0.smithi063.stdout:4/285: write d2/d8/f32 [626232,29600] 0 2023-12-12T11:51:49.916 INFO:tasks.workunit.client.0.smithi063.stdout:4/286: read d2/f10 [8188044,16865] 0 2023-12-12T11:51:49.918 INFO:tasks.workunit.client.1.smithi093.stdout:3/461: dread df/d36/d3d/d59/f5c [0,4194304] 0 2023-12-12T11:51:49.918 INFO:tasks.workunit.client.1.smithi093.stdout:3/462: creat df/d36/d3d/d59/f98 x:0 0 0 2023-12-12T11:51:49.918 INFO:tasks.workunit.client.1.smithi093.stdout:3/463: truncate df/d36/d3d/d59/f64 280999 0 2023-12-12T11:51:49.918 INFO:tasks.workunit.client.1.smithi093.stdout:3/464: fsync df/d22/f23 0 2023-12-12T11:51:49.919 INFO:tasks.workunit.client.1.smithi093.stdout:1/463: mknod d4/d1a/d1b/d26/d65/c9b 0 2023-12-12T11:51:49.919 INFO:tasks.workunit.client.1.smithi093.stdout:1/464: dread - d4/d1a/d73/f95 zero size 2023-12-12T11:51:49.919 INFO:tasks.workunit.client.1.smithi093.stdout:1/465: fdatasync d4/f25 0 2023-12-12T11:51:49.920 INFO:tasks.workunit.client.0.smithi063.stdout:1/205: getdents d3/db/d16/d24 0 2023-12-12T11:51:49.920 INFO:tasks.workunit.client.0.smithi063.stdout:1/206: dread - d3/db/d16/f3c zero size 2023-12-12T11:51:49.922 INFO:tasks.workunit.client.1.smithi093.stdout:2/482: dread d5/d14/d2d/d12/d25/d7a/f81 [0,4194304] 0 2023-12-12T11:51:49.922 INFO:tasks.workunit.client.1.smithi093.stdout:4/641: dwrite d0/f1f [0,4194304] 0 2023-12-12T11:51:49.925 INFO:tasks.workunit.client.1.smithi093.stdout:2/483: write d5/d14/d2d/f42 [1280830,58363] 0 2023-12-12T11:51:49.927 INFO:tasks.workunit.client.1.smithi093.stdout:9/434: dwrite d1/fa [0,4194304] 0 2023-12-12T11:51:49.927 INFO:tasks.workunit.client.0.smithi063.stdout:5/245: dwrite d7/ff [0,4194304] 0 2023-12-12T11:51:49.930 INFO:tasks.workunit.client.0.smithi063.stdout:2/199: dwrite d0/d1a/d1e/f31 [0,4194304] 0 2023-12-12T11:51:49.930 INFO:tasks.workunit.client.0.smithi063.stdout:8/338: getdents d4/de/d3b/d62/d36 0 2023-12-12T11:51:49.939 INFO:tasks.workunit.client.0.smithi063.stdout:1/207: dread d3/db/d16/f2d [0,4194304] 0 2023-12-12T11:51:49.939 INFO:tasks.workunit.client.1.smithi093.stdout:8/479: rename d3/d1a/d1f/f3d to d3/d1a/d1f/d29/d3a/d68/d8a/f94 0 2023-12-12T11:51:49.939 INFO:tasks.workunit.client.1.smithi093.stdout:8/480: dread - d3/f81 zero size 2023-12-12T11:51:49.963 INFO:tasks.workunit.client.1.smithi093.stdout:4/642: dwrite d0/f18 [0,4194304] 0 2023-12-12T11:51:49.972 INFO:tasks.workunit.client.1.smithi093.stdout:7/420: creat da/d15/d19/d4c/d6d/f92 x:0 0 0 2023-12-12T11:51:49.972 INFO:tasks.workunit.client.1.smithi093.stdout:7/421: creat da/d2e/f93 x:0 0 0 2023-12-12T11:51:49.974 INFO:tasks.workunit.client.1.smithi093.stdout:7/422: read da/d15/d59/f66 [184817,86853] 0 2023-12-12T11:51:49.975 INFO:tasks.workunit.client.1.smithi093.stdout:7/423: write da/d15/d19/d4c/f7a [134669,85076] 0 2023-12-12T11:51:49.979 INFO:tasks.workunit.client.1.smithi093.stdout:4/643: dread d0/d31/f30 [0,4194304] 0 2023-12-12T11:51:49.981 INFO:tasks.workunit.client.0.smithi063.stdout:6/264: truncate d9/fb 5185781 0 2023-12-12T11:51:49.982 INFO:tasks.workunit.client.0.smithi063.stdout:6/265: creat d9/f59 x:0 0 0 2023-12-12T11:51:49.982 INFO:tasks.workunit.client.0.smithi063.stdout:6/266: dread - d9/f55 zero size 2023-12-12T11:51:49.982 INFO:tasks.workunit.client.0.smithi063.stdout:6/267: chown d9/f18 31 1 2023-12-12T11:51:49.983 INFO:tasks.workunit.client.1.smithi093.stdout:3/465: unlink df/d25/d2c/c8d 0 2023-12-12T11:51:49.986 INFO:tasks.workunit.client.0.smithi063.stdout:4/287: dwrite d2/d17/f22 [4194304,4194304] 0 2023-12-12T11:51:49.990 INFO:tasks.workunit.client.1.smithi093.stdout:1/466: mkdir d4/dc/d7a/d9c 0 2023-12-12T11:51:49.990 INFO:tasks.workunit.client.1.smithi093.stdout:1/467: getdents d4/d1a/d83/d9a 0 2023-12-12T11:51:49.993 INFO:tasks.workunit.client.0.smithi063.stdout:1/208: dwrite d3/db/f1d [0,4194304] 0 2023-12-12T11:51:49.995 INFO:tasks.workunit.client.0.smithi063.stdout:9/227: dwrite d7/d15/f43 [0,4194304] 0 2023-12-12T11:51:50.008 INFO:tasks.workunit.client.0.smithi063.stdout:3/201: rmdir d4/df 39 2023-12-12T11:51:50.010 INFO:tasks.workunit.client.0.smithi063.stdout:5/246: dwrite d7/d28/f3f [0,4194304] 0 2023-12-12T11:51:50.014 INFO:tasks.workunit.client.1.smithi093.stdout:2/484: mknod d5/d14/d5e/ca6 0 2023-12-12T11:51:50.015 INFO:tasks.workunit.client.0.smithi063.stdout:7/213: sync 2023-12-12T11:51:50.015 INFO:tasks.workunit.client.1.smithi093.stdout:0/463: sync 2023-12-12T11:51:50.015 INFO:tasks.workunit.client.1.smithi093.stdout:6/612: sync 2023-12-12T11:51:50.015 INFO:tasks.workunit.client.1.smithi093.stdout:0/464: fsync d5/d21/d27/f5a 0 2023-12-12T11:51:50.016 INFO:tasks.workunit.client.1.smithi093.stdout:0/465: dread - d5/d21/f4c zero size 2023-12-12T11:51:50.020 INFO:tasks.workunit.client.1.smithi093.stdout:4/644: dwrite d0/d31/d9d/fc1 [0,4194304] 0 2023-12-12T11:51:50.021 INFO:tasks.workunit.client.1.smithi093.stdout:9/435: mknod d1/d12/d1f/d32/c95 0 2023-12-12T11:51:50.025 INFO:tasks.workunit.client.1.smithi093.stdout:8/481: creat d3/d1a/d1f/d59/d69/f95 x:0 0 0 2023-12-12T11:51:50.025 INFO:tasks.workunit.client.1.smithi093.stdout:8/482: creat d3/d8/f96 x:0 0 0 2023-12-12T11:51:50.026 INFO:tasks.workunit.client.0.smithi063.stdout:0/219: sync 2023-12-12T11:51:50.039 INFO:tasks.workunit.client.0.smithi063.stdout:8/339: mkdir d4/de/d11/d58/d65 0 2023-12-12T11:51:50.039 INFO:tasks.workunit.client.0.smithi063.stdout:8/340: chown d4/d24/c2f 1174 1 2023-12-12T11:51:50.039 INFO:tasks.workunit.client.1.smithi093.stdout:7/424: symlink da/d2e/d89/l94 0 2023-12-12T11:51:50.049 INFO:tasks.workunit.client.0.smithi063.stdout:6/268: link d9/d10/d2a/f53 d9/d10/d25/f5a 0 2023-12-12T11:51:50.049 INFO:tasks.workunit.client.0.smithi063.stdout:6/269: readlink d9/d10/d25/l2b 0 2023-12-12T11:51:50.052 INFO:tasks.workunit.client.1.smithi093.stdout:1/468: mknod d4/dc/d7a/d9c/c9d 0 2023-12-12T11:51:50.057 INFO:tasks.workunit.client.1.smithi093.stdout:2/485: rename d5/d14/d2d/d8b/d8c to d5/d14/d47/da7 0 2023-12-12T11:51:50.057 INFO:tasks.workunit.client.1.smithi093.stdout:2/486: dread - d5/d46/d55/f95 zero size 2023-12-12T11:51:50.057 INFO:tasks.workunit.client.1.smithi093.stdout:2/487: write d5/d14/d5e/f70 [528161,28278] 0 2023-12-12T11:51:50.064 INFO:tasks.workunit.client.0.smithi063.stdout:1/209: symlink d3/db/d16/l43 0 2023-12-12T11:51:50.066 INFO:tasks.workunit.client.1.smithi093.stdout:5/373: sync 2023-12-12T11:51:50.066 INFO:tasks.workunit.client.1.smithi093.stdout:5/374: write d0/d7/d59/d35/d6a/f72 [591943,8551] 0 2023-12-12T11:51:50.066 INFO:tasks.workunit.client.1.smithi093.stdout:5/375: chown d0/d7/d8/de/c46 0 1 2023-12-12T11:51:50.067 INFO:tasks.workunit.client.1.smithi093.stdout:9/436: symlink d1/d23/d24/d89/l96 0 2023-12-12T11:51:50.069 INFO:tasks.workunit.client.1.smithi093.stdout:0/466: dwrite d5/dd/d33/f5e [0,4194304] 0 2023-12-12T11:51:50.070 INFO:tasks.workunit.client.1.smithi093.stdout:4/645: dwrite d0/d36/d40/f8e [0,4194304] 0 2023-12-12T11:51:50.070 INFO:tasks.workunit.client.1.smithi093.stdout:4/646: chown d0/d36/f60 2600 1 2023-12-12T11:51:50.071 INFO:tasks.workunit.client.1.smithi093.stdout:3/466: getdents df/d22/d49/d69/d6e 0 2023-12-12T11:51:50.071 INFO:tasks.workunit.client.1.smithi093.stdout:3/467: readlink df/d25/l60 0 2023-12-12T11:51:50.072 INFO:tasks.workunit.client.0.smithi063.stdout:9/228: write d7/d15/f31 [2062692,23870] 0 2023-12-12T11:51:50.072 INFO:tasks.workunit.client.0.smithi063.stdout:3/202: chown d4/df/d1a/d1c/d3b 979425298 1 2023-12-12T11:51:50.074 INFO:tasks.workunit.client.0.smithi063.stdout:7/214: symlink de/d22/d2b/d4a/l57 0 2023-12-12T11:51:50.074 INFO:tasks.workunit.client.0.smithi063.stdout:7/215: dread - de/d34/f4f zero size 2023-12-12T11:51:50.074 INFO:tasks.workunit.client.1.smithi093.stdout:1/469: read d4/d1c/f88 [6039834,52157] 0 2023-12-12T11:51:50.075 INFO:tasks.workunit.client.1.smithi093.stdout:1/470: chown d4/d1c/c80 149051784 1 2023-12-12T11:51:50.075 INFO:tasks.workunit.client.1.smithi093.stdout:1/471: write d4/dc/d7a/f8d [812252,99477] 0 2023-12-12T11:51:50.075 INFO:tasks.workunit.client.1.smithi093.stdout:1/472: creat d4/d1a/d1b/d26/d65/f9e x:0 0 0 2023-12-12T11:51:50.078 INFO:tasks.workunit.client.0.smithi063.stdout:0/220: link d0/d7/d27/d1f/l35 d0/d1a/l46 0 2023-12-12T11:51:50.078 INFO:tasks.workunit.client.0.smithi063.stdout:0/221: write d0/d7/ff [2537509,75620] 0 2023-12-12T11:51:50.085 INFO:tasks.workunit.client.1.smithi093.stdout:7/425: rename c8 to da/d15/d59/d80/c95 0 2023-12-12T11:51:50.085 INFO:tasks.workunit.client.1.smithi093.stdout:2/488: mkdir d5/d14/d2d/d4c/d54/da8 0 2023-12-12T11:51:50.086 INFO:tasks.workunit.client.1.smithi093.stdout:2/489: chown d5/d14/d5e/f70 49 1 2023-12-12T11:51:50.086 INFO:tasks.workunit.client.1.smithi093.stdout:0/467: mkdir d5/dd/d14/d26/d58/d64/d6f/d90 0 2023-12-12T11:51:50.086 INFO:tasks.workunit.client.0.smithi063.stdout:8/341: truncate d4/f42 1382851 0 2023-12-12T11:51:50.086 INFO:tasks.workunit.client.0.smithi063.stdout:8/342: truncate f3 2199830 0 2023-12-12T11:51:50.086 INFO:tasks.workunit.client.0.smithi063.stdout:6/270: unlink d9/d10/d25/f5a 0 2023-12-12T11:51:50.086 INFO:tasks.workunit.client.0.smithi063.stdout:6/271: dread - d9/d2c/f39 zero size 2023-12-12T11:51:50.086 INFO:tasks.workunit.client.0.smithi063.stdout:4/288: dwrite d2/d8/fa [0,4194304] 0 2023-12-12T11:51:50.086 INFO:tasks.workunit.client.0.smithi063.stdout:3/203: getdents d4/df/d1a/d1c/d3b 0 2023-12-12T11:51:50.096 INFO:tasks.workunit.client.0.smithi063.stdout:5/247: getdents d7/d28 0 2023-12-12T11:51:50.096 INFO:tasks.workunit.client.1.smithi093.stdout:4/647: mknod d0/d87/d79/d96/db5/cca 0 2023-12-12T11:51:50.099 INFO:tasks.workunit.client.0.smithi063.stdout:0/222: getdents d0/d1a/d23/d2e 0 2023-12-12T11:51:50.099 INFO:tasks.workunit.client.0.smithi063.stdout:0/223: chown d0/d7/d27/l20 54 1 2023-12-12T11:51:50.099 INFO:tasks.workunit.client.0.smithi063.stdout:3/204: creat d4/f3f x:0 0 0 2023-12-12T11:51:50.100 INFO:tasks.workunit.client.1.smithi093.stdout:3/468: symlink df/d36/d3d/d42/l99 0 2023-12-12T11:51:50.102 INFO:tasks.workunit.client.0.smithi063.stdout:7/216: mkdir de/d22/d2b/d4a/d58 0 2023-12-12T11:51:50.102 INFO:tasks.workunit.client.0.smithi063.stdout:7/217: write de/d22/f31 [439439,41497] 0 2023-12-12T11:51:50.102 INFO:tasks.workunit.client.0.smithi063.stdout:7/218: stat de/d33/d41/d44 0 2023-12-12T11:51:50.104 INFO:tasks.workunit.client.0.smithi063.stdout:0/224: rename d0/d1a/d23/d34/d42/f2b to d0/d7/f47 0 2023-12-12T11:51:50.107 INFO:tasks.workunit.client.0.smithi063.stdout:2/200: dwrite d0/d3b/f30 [0,4194304] 0 2023-12-12T11:51:50.108 INFO:tasks.workunit.client.0.smithi063.stdout:2/201: getdents d0/d41 0 2023-12-12T11:51:50.108 INFO:tasks.workunit.client.0.smithi063.stdout:2/202: write d0/d1a/d26/f37 [198280,3188] 0 2023-12-12T11:51:50.115 INFO:tasks.workunit.client.0.smithi063.stdout:3/205: mknod d4/df/d1a/d1c/d3b/c40 0 2023-12-12T11:51:50.127 INFO:tasks.workunit.client.1.smithi093.stdout:0/468: mknod d5/d78/c91 0 2023-12-12T11:51:50.132 INFO:tasks.workunit.client.0.smithi063.stdout:1/210: read d3/db/f20 [1028418,39359] 0 2023-12-12T11:51:50.133 INFO:tasks.workunit.client.1.smithi093.stdout:3/469: creat df/d25/f9a x:0 0 0 2023-12-12T11:51:50.135 INFO:tasks.workunit.client.0.smithi063.stdout:2/203: readlink d0/d3b/l38 0 2023-12-12T11:51:50.135 INFO:tasks.workunit.client.0.smithi063.stdout:2/204: truncate d0/ff 8668616 0 2023-12-12T11:51:50.136 INFO:tasks.workunit.client.0.smithi063.stdout:2/205: creat d0/f45 x:0 0 0 2023-12-12T11:51:50.136 INFO:tasks.workunit.client.0.smithi063.stdout:2/206: chown d0/d3b 96479281 1 2023-12-12T11:51:50.138 INFO:tasks.workunit.client.1.smithi093.stdout:5/376: rename d0/c33 to d0/d7/d36/d38/c80 0 2023-12-12T11:51:50.152 INFO:tasks.workunit.client.0.smithi063.stdout:3/206: getdents d4/df/d1a/d1c 0 2023-12-12T11:51:50.156 INFO:tasks.workunit.client.1.smithi093.stdout:5/377: dread d0/f5 [0,4194304] 0 2023-12-12T11:51:50.156 INFO:tasks.workunit.client.1.smithi093.stdout:9/437: dwrite d1/d23/d24/d29/d43/d56/d68/f90 [0,4194304] 0 2023-12-12T11:51:50.156 INFO:tasks.workunit.client.1.smithi093.stdout:9/438: stat d1/l2d 0 2023-12-12T11:51:50.156 INFO:tasks.workunit.client.1.smithi093.stdout:5/378: creat d0/d7/d59/d48/f81 x:0 0 0 2023-12-12T11:51:50.164 INFO:tasks.workunit.client.1.smithi093.stdout:0/469: truncate d5/d21/d27/d3a/f4a 4587493 0 2023-12-12T11:51:50.164 INFO:tasks.workunit.client.1.smithi093.stdout:0/470: chown d5/dd/d14/d26/d58/d64 920484 1 2023-12-12T11:51:50.169 INFO:tasks.workunit.client.0.smithi063.stdout:2/207: rename d0/f3c to d0/d1a/d3a/f46 0 2023-12-12T11:51:50.169 INFO:tasks.workunit.client.0.smithi063.stdout:2/208: read - d0/d3b/f3d zero size 2023-12-12T11:51:50.171 INFO:tasks.workunit.client.1.smithi093.stdout:7/426: rename da/d15/d19/c5e to da/d2e/c96 0 2023-12-12T11:51:50.174 INFO:tasks.workunit.client.0.smithi063.stdout:3/207: mkdir d4/df/d1a/d1c/d41 0 2023-12-12T11:51:50.183 INFO:tasks.workunit.client.0.smithi063.stdout:2/209: dread d0/f15 [0,4194304] 0 2023-12-12T11:51:50.184 INFO:tasks.workunit.client.0.smithi063.stdout:4/289: dwrite d2/d17/f22 [4194304,4194304] 0 2023-12-12T11:51:50.194 INFO:tasks.workunit.client.1.smithi093.stdout:9/439: mkdir d1/d12/d1f/d32/d42/d97 0 2023-12-12T11:51:50.194 INFO:tasks.workunit.client.1.smithi093.stdout:5/379: mknod d0/d7/d59/d62/c82 0 2023-12-12T11:51:50.194 INFO:tasks.workunit.client.1.smithi093.stdout:9/440: chown d1/d12/d1f/d3d/d57/d63/f7f 260414 1 2023-12-12T11:51:50.205 INFO:tasks.workunit.client.1.smithi093.stdout:0/471: rmdir d5/d41/d77 39 2023-12-12T11:51:50.205 INFO:tasks.workunit.client.1.smithi093.stdout:0/472: chown d5/d21/d2f/d54/f7b 3930 1 2023-12-12T11:51:50.227 INFO:tasks.workunit.client.1.smithi093.stdout:9/441: write d1/d12/d1f/d32/f7a [239652,11397] 0 2023-12-12T11:51:50.230 INFO:tasks.workunit.client.0.smithi063.stdout:2/210: dread d0/d1a/f1d [0,4194304] 0 2023-12-12T11:51:50.230 INFO:tasks.workunit.client.1.smithi093.stdout:9/442: getdents d1/d23/d24/d29/d43/d56/d85 0 2023-12-12T11:51:50.235 INFO:tasks.workunit.client.1.smithi093.stdout:9/443: rename d1/d12/d1f/d32/c55 to d1/d12/d1f/d32/d42/d97/c98 0 2023-12-12T11:51:50.238 INFO:tasks.workunit.client.0.smithi063.stdout:2/211: symlink d0/l47 0 2023-12-12T11:51:50.243 INFO:tasks.workunit.client.0.smithi063.stdout:6/272: dwrite d9/f27 [0,4194304] 0 2023-12-12T11:51:50.243 INFO:tasks.workunit.client.0.smithi063.stdout:6/273: stat d9/f1f 0 2023-12-12T11:51:50.245 INFO:tasks.workunit.client.1.smithi093.stdout:0/473: dread d5/f13 [4194304,4194304] 0 2023-12-12T11:51:50.245 INFO:tasks.workunit.client.1.smithi093.stdout:0/474: chown d5/dd/d14/d26/l2c 177741 1 2023-12-12T11:51:50.248 INFO:tasks.workunit.client.0.smithi063.stdout:6/274: rmdir d9/d2c 39 2023-12-12T11:51:50.249 INFO:tasks.workunit.client.0.smithi063.stdout:2/212: rename d0/d3b to d0/d1a/d48 0 2023-12-12T11:51:50.251 INFO:tasks.workunit.client.0.smithi063.stdout:9/229: dwrite d7/f14 [0,4194304] 0 2023-12-12T11:51:50.252 INFO:tasks.workunit.client.0.smithi063.stdout:6/275: truncate d9/d10/f1b 916920 0 2023-12-12T11:51:50.253 INFO:tasks.workunit.client.1.smithi093.stdout:2/490: dwrite d5/d14/d2d/d12/f2c [4194304,4194304] 0 2023-12-12T11:51:50.254 INFO:tasks.workunit.client.0.smithi063.stdout:5/248: dwrite d7/de/f1e [0,4194304] 0 2023-12-12T11:51:50.254 INFO:tasks.workunit.client.0.smithi063.stdout:9/230: truncate d7/f9 9423666 0 2023-12-12T11:51:50.254 INFO:tasks.workunit.client.0.smithi063.stdout:6/276: read d9/f43 [173608,95777] 0 2023-12-12T11:51:50.265 INFO:tasks.workunit.client.1.smithi093.stdout:0/475: dread d5/dd/d14/d26/f59 [0,4194304] 0 2023-12-12T11:51:50.266 INFO:tasks.workunit.client.1.smithi093.stdout:2/491: creat d5/d14/d2d/d12/d25/d7a/d7e/da0/fa9 x:0 0 0 2023-12-12T11:51:50.266 INFO:tasks.workunit.client.1.smithi093.stdout:2/492: chown d5/d14/d47/d56/f83 63018965 1 2023-12-12T11:51:50.268 INFO:tasks.workunit.client.0.smithi063.stdout:9/231: mkdir d7/d20/d45 0 2023-12-12T11:51:50.271 INFO:tasks.workunit.client.0.smithi063.stdout:5/249: mkdir d7/d28/d43 0 2023-12-12T11:51:50.274 INFO:tasks.workunit.client.0.smithi063.stdout:2/213: dread d0/d1a/d1e/f2e [0,4194304] 0 2023-12-12T11:51:50.274 INFO:tasks.workunit.client.0.smithi063.stdout:3/208: dwrite d4/f3f [0,4194304] 0 2023-12-12T11:51:50.274 INFO:tasks.workunit.client.0.smithi063.stdout:3/209: chown d4/c39 63 1 2023-12-12T11:51:50.274 INFO:tasks.workunit.client.0.smithi063.stdout:3/210: stat d4/df/f37 0 2023-12-12T11:51:50.274 INFO:tasks.workunit.client.0.smithi063.stdout:2/214: creat d0/f49 x:0 0 0 2023-12-12T11:51:50.275 INFO:tasks.workunit.client.0.smithi063.stdout:6/277: symlink d9/d10/l5b 0 2023-12-12T11:51:50.275 INFO:tasks.workunit.client.0.smithi063.stdout:4/290: dwrite d2/d8/f26 [0,4194304] 0 2023-12-12T11:51:50.277 INFO:tasks.workunit.client.1.smithi093.stdout:0/476: mknod d5/c92 0 2023-12-12T11:51:50.277 INFO:tasks.workunit.client.1.smithi093.stdout:0/477: dread - d5/d41/d77/f86 zero size 2023-12-12T11:51:50.277 INFO:tasks.workunit.client.1.smithi093.stdout:0/478: write d5/d4d/f85 [3306966,101872] 0 2023-12-12T11:51:50.277 INFO:tasks.workunit.client.0.smithi063.stdout:6/278: read d9/f4b [329823,99302] 0 2023-12-12T11:51:50.277 INFO:tasks.workunit.client.1.smithi093.stdout:7/427: dwrite da/d15/d19/d4c/d6d/f92 [0,4194304] 0 2023-12-12T11:51:50.278 INFO:tasks.workunit.client.0.smithi063.stdout:8/343: dwrite d4/d55/f34 [4194304,4194304] 0 2023-12-12T11:51:50.278 INFO:tasks.workunit.client.1.smithi093.stdout:1/473: dwrite d4/d1c/d2a/f2b [0,4194304] 0 2023-12-12T11:51:50.279 INFO:tasks.workunit.client.1.smithi093.stdout:1/474: fdatasync d4/d1c/f21 0 2023-12-12T11:51:50.279 INFO:tasks.workunit.client.1.smithi093.stdout:1/475: getdents d4/d1a/d1b/d26/d82/d94 0 2023-12-12T11:51:50.279 INFO:tasks.workunit.client.1.smithi093.stdout:1/476: chown d4/d1a/d1b/l75 155384 1 2023-12-12T11:51:50.280 INFO:tasks.workunit.client.1.smithi093.stdout:5/380: dwrite d0/d7/d59/d48/f5f [0,4194304] 0 2023-12-12T11:51:50.281 INFO:tasks.workunit.client.1.smithi093.stdout:4/648: dwrite d0/d36/d49/f7e [0,4194304] 0 2023-12-12T11:51:50.283 INFO:tasks.workunit.client.0.smithi063.stdout:1/211: dwrite d3/db/d16/f32 [0,4194304] 0 2023-12-12T11:51:50.283 INFO:tasks.workunit.client.0.smithi063.stdout:7/219: dwrite de/f3c [0,4194304] 0 2023-12-12T11:51:50.286 INFO:tasks.workunit.client.0.smithi063.stdout:5/250: dread d7/d10/f1b [0,4194304] 0 2023-12-12T11:51:50.290 INFO:tasks.workunit.client.0.smithi063.stdout:2/215: unlink d0/d1a/l1b 0 2023-12-12T11:51:50.295 INFO:tasks.workunit.client.0.smithi063.stdout:3/211: symlink d4/df/d1a/d1c/d41/l42 0 2023-12-12T11:51:50.300 INFO:tasks.workunit.client.1.smithi093.stdout:7/428: rename da/d15/d2d/d2f/f3d to da/f97 0 2023-12-12T11:51:50.302 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:49 smithi063 ceph-mon[107117]: pgmap v9: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 154 MiB/s rd, 194 MiB/s wr, 293 op/s 2023-12-12T11:51:50.310 INFO:tasks.workunit.client.0.smithi063.stdout:4/291: creat d2/d17/d41/f5b x:0 0 0 2023-12-12T11:51:50.310 INFO:tasks.workunit.client.0.smithi063.stdout:4/292: readlink l1 0 2023-12-12T11:51:50.323 INFO:tasks.workunit.client.1.smithi093.stdout:1/477: dwrite d4/d1c/d2a/f2b [0,4194304] 0 2023-12-12T11:51:50.328 INFO:tasks.workunit.client.0.smithi063.stdout:6/279: mkdir d9/d10/d5c 0 2023-12-12T11:51:50.328 INFO:tasks.workunit.client.0.smithi063.stdout:6/280: fsync d9/d10/d2a/f3e 0 2023-12-12T11:51:50.328 INFO:tasks.workunit.client.0.smithi063.stdout:6/281: truncate d9/d10/f47 524510 0 2023-12-12T11:51:50.335 INFO:tasks.workunit.client.1.smithi093.stdout:4/649: dwrite d0/d36/f60 [0,4194304] 0 2023-12-12T11:51:50.335 INFO:tasks.workunit.client.0.smithi063.stdout:9/232: getdents d7/d20/d3f/d40 0 2023-12-12T11:51:50.335 INFO:tasks.workunit.client.0.smithi063.stdout:9/233: fdatasync d7/d15/f43 0 2023-12-12T11:51:50.336 INFO:tasks.workunit.client.0.smithi063.stdout:9/234: chown c3 216 1 2023-12-12T11:51:50.357 INFO:tasks.workunit.client.1.smithi093.stdout:0/479: rmdir d5/d21/d27/d3a 39 2023-12-12T11:51:50.358 INFO:tasks.workunit.client.1.smithi093.stdout:0/480: fsync d5/dd/d62/f83 0 2023-12-12T11:51:50.358 INFO:tasks.workunit.client.1.smithi093.stdout:0/481: write d5/dd/d14/d26/d58/d64/d7c/f89 [372515,58424] 0 2023-12-12T11:51:50.360 INFO:tasks.workunit.client.1.smithi093.stdout:7/429: symlink da/d15/d19/d90/d7d/l98 0 2023-12-12T11:51:50.360 INFO:tasks.workunit.client.1.smithi093.stdout:7/430: dread - da/d15/d2d/f50 zero size 2023-12-12T11:51:50.362 INFO:tasks.workunit.client.1.smithi093.stdout:2/493: fsync d5/d14/d2d/d12/d25/d7a/d7e/da0/fa9 0 2023-12-12T11:51:50.363 INFO:tasks.workunit.client.0.smithi063.stdout:8/344: unlink d4/f1d 0 2023-12-12T11:51:50.364 INFO:tasks.workunit.client.1.smithi093.stdout:1/478: creat d4/dc/f9f x:0 0 0 2023-12-12T11:51:50.372 INFO:tasks.workunit.client.1.smithi093.stdout:7/431: dread da/de/d46/d4f/f62 [0,4194304] 0 2023-12-12T11:51:50.372 INFO:tasks.workunit.client.1.smithi093.stdout:7/432: fsync da/d15/d2d/d2f/f61 0 2023-12-12T11:51:50.372 INFO:tasks.workunit.client.1.smithi093.stdout:7/433: write da/d15/f16 [421197,42719] 0 2023-12-12T11:51:50.375 INFO:tasks.workunit.client.0.smithi063.stdout:7/220: truncate de/f21 536140 0 2023-12-12T11:51:50.375 INFO:tasks.workunit.client.1.smithi093.stdout:4/650: mkdir d0/d87/d79/d7f/dcb 0 2023-12-12T11:51:50.377 INFO:tasks.workunit.client.0.smithi063.stdout:5/251: symlink d7/de/l44 0 2023-12-12T11:51:50.378 INFO:tasks.workunit.client.1.smithi093.stdout:5/381: mkdir d0/d7/d36/d38/d83 0 2023-12-12T11:51:50.378 INFO:tasks.workunit.client.1.smithi093.stdout:5/382: creat d0/d7/d8/f84 x:0 0 0 2023-12-12T11:51:50.382 INFO:tasks.workunit.client.0.smithi063.stdout:3/212: creat d4/df/d1a/d1c/f43 x:0 0 0 2023-12-12T11:51:50.384 INFO:tasks.workunit.client.0.smithi063.stdout:2/216: dwrite d0/ff [0,4194304] 0 2023-12-12T11:51:50.384 INFO:tasks.workunit.client.0.smithi063.stdout:2/217: readlink d0/d1a/d48/l42 0 2023-12-12T11:51:50.384 INFO:tasks.workunit.client.1.smithi093.stdout:0/482: link d5/dd/d33/l68 d5/dd/d14/l93 0 2023-12-12T11:51:50.388 INFO:tasks.workunit.client.1.smithi093.stdout:6/613: sync 2023-12-12T11:51:50.388 INFO:tasks.workunit.client.1.smithi093.stdout:6/614: creat d0/d52/dbc/fe8 x:0 0 0 2023-12-12T11:51:50.389 INFO:tasks.workunit.client.0.smithi063.stdout:6/282: link d9/d2c/c3a d9/d10/c5d 0 2023-12-12T11:51:50.393 INFO:tasks.workunit.client.1.smithi093.stdout:2/494: truncate d5/d14/d2d/f1e 486839 0 2023-12-12T11:51:50.394 INFO:tasks.workunit.client.0.smithi063.stdout:9/235: unlink d7/d11/f2d 0 2023-12-12T11:51:50.399 INFO:tasks.workunit.client.1.smithi093.stdout:3/470: sync 2023-12-12T11:51:50.399 INFO:tasks.workunit.client.0.smithi063.stdout:8/345: dread d4/de/d3b/d62/d36/f3a [0,4194304] 0 2023-12-12T11:51:50.399 INFO:tasks.workunit.client.0.smithi063.stdout:8/346: chown d4/de/f19 1037269865 1 2023-12-12T11:51:50.400 INFO:tasks.workunit.client.0.smithi063.stdout:1/212: dwrite d3/db/d16/f2b [0,4194304] 0 2023-12-12T11:51:50.400 INFO:tasks.workunit.client.0.smithi063.stdout:1/213: readlink d3/db/d16/l43 0 2023-12-12T11:51:50.403 INFO:tasks.workunit.client.0.smithi063.stdout:7/221: creat de/d3f/f59 x:0 0 0 2023-12-12T11:51:50.403 INFO:tasks.workunit.client.1.smithi093.stdout:8/483: sync 2023-12-12T11:51:50.404 INFO:tasks.workunit.client.0.smithi063.stdout:9/236: dread d7/d20/f29 [0,4194304] 0 2023-12-12T11:51:50.404 INFO:tasks.workunit.client.0.smithi063.stdout:9/237: readlink d7/lb 0 2023-12-12T11:51:50.406 INFO:tasks.workunit.client.0.smithi063.stdout:5/252: dread d7/d10/f1b [0,4194304] 0 2023-12-12T11:51:50.407 INFO:tasks.workunit.client.0.smithi063.stdout:4/293: dread d2/d17/f59 [0,4194304] 0 2023-12-12T11:51:50.407 INFO:tasks.workunit.client.0.smithi063.stdout:4/294: fdatasync d2/d17/d4e/f51 0 2023-12-12T11:51:50.407 INFO:tasks.workunit.client.0.smithi063.stdout:4/295: truncate d2/d17/d41/f5b 908499 0 2023-12-12T11:51:50.407 INFO:tasks.workunit.client.0.smithi063.stdout:2/218: dread d0/f20 [0,4194304] 0 2023-12-12T11:51:50.407 INFO:tasks.workunit.client.1.smithi093.stdout:7/434: symlink da/d15/d59/d80/l99 0 2023-12-12T11:51:50.407 INFO:tasks.workunit.client.1.smithi093.stdout:7/435: fsync da/d15/d59/f66 0 2023-12-12T11:51:50.409 INFO:tasks.workunit.client.1.smithi093.stdout:3/471: dread df/d25/f44 [0,4194304] 0 2023-12-12T11:51:50.409 INFO:tasks.workunit.client.0.smithi063.stdout:6/283: write f4 [313055,5734] 0 2023-12-12T11:51:50.409 INFO:tasks.workunit.client.0.smithi063.stdout:6/284: fsync d9/d10/f58 0 2023-12-12T11:51:50.414 INFO:tasks.workunit.client.1.smithi093.stdout:6/615: mkdir d0/da/d32/d9e/d4d/de9 0 2023-12-12T11:51:50.420 INFO:tasks.workunit.client.1.smithi093.stdout:2/495: creat d5/d46/faa x:0 0 0 2023-12-12T11:51:50.420 INFO:tasks.workunit.client.1.smithi093.stdout:4/651: write d0/d31/d9d/fc1 [1249762,125302] 0 2023-12-12T11:51:50.421 INFO:tasks.workunit.client.1.smithi093.stdout:0/483: dwrite d5/fa [4194304,4194304] 0 2023-12-12T11:51:50.423 INFO:tasks.workunit.client.0.smithi063.stdout:7/222: read f8 [576866,15934] 0 2023-12-12T11:51:50.423 INFO:tasks.workunit.client.0.smithi063.stdout:7/223: stat de/d3f/f59 0 2023-12-12T11:51:50.426 INFO:tasks.workunit.client.1.smithi093.stdout:9/444: sync 2023-12-12T11:51:50.426 INFO:tasks.workunit.client.1.smithi093.stdout:9/445: dread - d1/d12/d1f/d3d/d5c/f7b zero size 2023-12-12T11:51:50.426 INFO:tasks.workunit.client.1.smithi093.stdout:9/446: write d1/d12/d1f/d3d/d5c/f7b [909980,75133] 0 2023-12-12T11:51:50.429 INFO:tasks.workunit.client.0.smithi063.stdout:4/296: dread d2/d17/f59 [0,4194304] 0 2023-12-12T11:51:50.430 INFO:tasks.workunit.client.1.smithi093.stdout:8/484: unlink d3/c3c 0 2023-12-12T11:51:50.432 INFO:tasks.workunit.client.0.smithi063.stdout:1/214: link d3/db/d16/d17/l39 d3/db/d16/l44 0 2023-12-12T11:51:50.432 INFO:tasks.workunit.client.0.smithi063.stdout:1/215: write d3/db/d16/f3c [651963,84704] 0 2023-12-12T11:51:50.432 INFO:tasks.workunit.client.0.smithi063.stdout:1/216: dread - d3/db/d16/d24/d30/f3d zero size 2023-12-12T11:51:50.432 INFO:tasks.workunit.client.0.smithi063.stdout:1/217: write d3/f1a [4528382,61013] 0 2023-12-12T11:51:50.432 INFO:tasks.workunit.client.0.smithi063.stdout:1/218: write d3/db/fe [270912,30138] 0 2023-12-12T11:51:50.433 INFO:tasks.workunit.client.1.smithi093.stdout:7/436: symlink da/d15/d19/d4c/d6d/l9a 0 2023-12-12T11:51:50.434 INFO:tasks.workunit.client.1.smithi093.stdout:2/496: write d5/d14/d2d/f1c [1205552,93638] 0 2023-12-12T11:51:50.434 INFO:tasks.workunit.client.0.smithi063.stdout:9/238: mkdir d7/d20/d45/d46 0 2023-12-12T11:51:50.435 INFO:tasks.workunit.client.1.smithi093.stdout:6/616: symlink d0/da/d32/lea 0 2023-12-12T11:51:50.436 INFO:tasks.workunit.client.1.smithi093.stdout:4/652: write d0/f18 [640437,34570] 0 2023-12-12T11:51:50.439 INFO:tasks.workunit.client.0.smithi063.stdout:2/219: creat d0/d1a/d48/f4a x:0 0 0 2023-12-12T11:51:50.439 INFO:tasks.workunit.client.0.smithi063.stdout:2/220: dread - d0/d1a/d26/f44 zero size 2023-12-12T11:51:50.444 INFO:tasks.workunit.client.0.smithi063.stdout:6/285: mkdir d9/d10/d5c/d5e 0 2023-12-12T11:51:50.450 INFO:tasks.workunit.client.1.smithi093.stdout:7/437: write f0 [1758592,125153] 0 2023-12-12T11:51:50.454 INFO:tasks.workunit.client.1.smithi093.stdout:0/484: symlink d5/d21/d2f/d54/l94 0 2023-12-12T11:51:50.454 INFO:tasks.workunit.client.1.smithi093.stdout:0/485: stat d5/dd/d14/c1f 0 2023-12-12T11:51:50.454 INFO:tasks.workunit.client.1.smithi093.stdout:0/486: read - d5/d41/d77/f86 zero size 2023-12-12T11:51:50.455 INFO:tasks.workunit.client.0.smithi063.stdout:7/224: mknod de/d22/d2b/c5a 0 2023-12-12T11:51:50.457 INFO:tasks.workunit.client.1.smithi093.stdout:9/447: creat d1/d12/d3e/f99 x:0 0 0 2023-12-12T11:51:50.457 INFO:tasks.workunit.client.1.smithi093.stdout:9/448: creat d1/d12/d1f/d3d/d57/d63/f9a x:0 0 0 2023-12-12T11:51:50.459 INFO:tasks.workunit.client.0.smithi063.stdout:1/219: mknod d3/db/c45 0 2023-12-12T11:51:50.460 INFO:tasks.workunit.client.0.smithi063.stdout:0/225: sync 2023-12-12T11:51:50.460 INFO:tasks.workunit.client.0.smithi063.stdout:0/226: fdatasync d0/d7/d27/f3b 0 2023-12-12T11:51:50.462 INFO:tasks.workunit.client.0.smithi063.stdout:8/347: mknod d4/de/c66 0 2023-12-12T11:51:50.462 INFO:tasks.workunit.client.0.smithi063.stdout:8/348: chown d4/d24/c2f 512659 1 2023-12-12T11:51:50.462 INFO:tasks.workunit.client.0.smithi063.stdout:8/349: readlink d4/de/d3b/d62/d36/l49 0 2023-12-12T11:51:50.462 INFO:tasks.workunit.client.0.smithi063.stdout:8/350: truncate d4/f4e 803421 0 2023-12-12T11:51:50.462 INFO:tasks.workunit.client.0.smithi063.stdout:8/351: write d4/f23 [918158,120259] 0 2023-12-12T11:51:50.466 INFO:tasks.workunit.client.1.smithi093.stdout:8/485: creat d3/d1a/f97 x:0 0 0 2023-12-12T11:51:50.469 INFO:tasks.workunit.client.1.smithi093.stdout:1/479: write d4/d1a/d73/f4a [666381,93955] 0 2023-12-12T11:51:50.469 INFO:tasks.workunit.client.0.smithi063.stdout:9/239: fsync d7/d15/f17 0 2023-12-12T11:51:50.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:49 smithi093 ceph-mon[115914]: pgmap v9: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 154 MiB/s rd, 194 MiB/s wr, 293 op/s 2023-12-12T11:51:50.471 INFO:tasks.workunit.client.1.smithi093.stdout:2/497: rename d5/d14/d47/c7b to d5/d14/d2d/d12/d44/cab 0 2023-12-12T11:51:50.472 INFO:tasks.workunit.client.0.smithi063.stdout:5/253: rmdir d7/d10/d35 39 2023-12-12T11:51:50.473 INFO:tasks.workunit.client.0.smithi063.stdout:5/254: creat d7/d10/f45 x:0 0 0 2023-12-12T11:51:50.473 INFO:tasks.workunit.client.0.smithi063.stdout:5/255: fsync d7/d28/f3f 0 2023-12-12T11:51:50.476 INFO:tasks.workunit.client.0.smithi063.stdout:5/256: creat d7/d10/f46 x:0 0 0 2023-12-12T11:51:50.476 INFO:tasks.workunit.client.0.smithi063.stdout:5/257: readlink d7/lc 0 2023-12-12T11:51:50.476 INFO:tasks.workunit.client.0.smithi063.stdout:5/258: write d7/d10/f45 [928732,53011] 0 2023-12-12T11:51:50.480 INFO:tasks.workunit.client.1.smithi093.stdout:3/472: dwrite df/f54 [0,4194304] 0 2023-12-12T11:51:50.481 INFO:tasks.workunit.client.0.smithi063.stdout:7/225: write de/f13 [670268,119972] 0 2023-12-12T11:51:50.481 INFO:tasks.workunit.client.0.smithi063.stdout:7/226: stat f4 0 2023-12-12T11:51:50.485 INFO:tasks.workunit.client.1.smithi093.stdout:4/653: mkdir d0/d87/d79/d96/dcc 0 2023-12-12T11:51:50.485 INFO:tasks.workunit.client.1.smithi093.stdout:4/654: stat d0/d36/f59 0 2023-12-12T11:51:50.489 INFO:tasks.workunit.client.0.smithi063.stdout:1/220: dread d3/db/d16/d24/f29 [0,4194304] 0 2023-12-12T11:51:50.489 INFO:tasks.workunit.client.0.smithi063.stdout:1/221: fdatasync d3/db/d16/f36 0 2023-12-12T11:51:50.491 INFO:tasks.workunit.client.0.smithi063.stdout:0/227: getdents d0/d1a 0 2023-12-12T11:51:50.491 INFO:tasks.workunit.client.0.smithi063.stdout:0/228: creat d0/d7/d27/d1f/f48 x:0 0 0 2023-12-12T11:51:50.491 INFO:tasks.workunit.client.0.smithi063.stdout:0/229: creat d0/d7/d27/d19/d2d/f49 x:0 0 0 2023-12-12T11:51:50.491 INFO:tasks.workunit.client.0.smithi063.stdout:4/297: dwrite d2/f56 [0,4194304] 0 2023-12-12T11:51:50.492 INFO:tasks.workunit.client.0.smithi063.stdout:5/259: dread d7/d10/f23 [0,4194304] 0 2023-12-12T11:51:50.492 INFO:tasks.workunit.client.0.smithi063.stdout:5/260: fdatasync d7/d10/f14 0 2023-12-12T11:51:50.497 INFO:tasks.workunit.client.0.smithi063.stdout:8/352: mknod d4/d24/d38/d45/c67 0 2023-12-12T11:51:50.497 INFO:tasks.workunit.client.0.smithi063.stdout:8/353: chown d4/d24/d3e 815702997 1 2023-12-12T11:51:50.498 INFO:tasks.workunit.client.1.smithi093.stdout:7/438: getdents da/d15/d19/d90/d7d 0 2023-12-12T11:51:50.499 INFO:tasks.workunit.client.0.smithi063.stdout:6/286: dwrite d9/d10/f52 [0,4194304] 0 2023-12-12T11:51:50.502 INFO:tasks.workunit.client.1.smithi093.stdout:6/617: dwrite d0/da/d14/d21/f83 [0,4194304] 0 2023-12-12T11:51:50.502 INFO:tasks.workunit.client.1.smithi093.stdout:6/618: readlink d0/da/d14/l1e 0 2023-12-12T11:51:50.502 INFO:tasks.workunit.client.1.smithi093.stdout:6/619: truncate d0/d52/d6b/fe0 54169 0 2023-12-12T11:51:50.502 INFO:tasks.workunit.client.1.smithi093.stdout:0/487: mkdir d5/dd/d14/d95 0 2023-12-12T11:51:50.508 INFO:tasks.workunit.client.0.smithi063.stdout:2/221: rmdir d0/d1a/d26 39 2023-12-12T11:51:50.512 INFO:tasks.workunit.client.1.smithi093.stdout:9/449: truncate d1/d23/d24/d29/d43/f48 1650417 0 2023-12-12T11:51:50.515 INFO:tasks.workunit.client.1.smithi093.stdout:8/486: rename d3/f36 to d3/d73/f98 0 2023-12-12T11:51:50.515 INFO:tasks.workunit.client.1.smithi093.stdout:8/487: chown d3/d73/l7b 1904 1 2023-12-12T11:51:50.518 INFO:tasks.workunit.client.0.smithi063.stdout:7/227: mknod de/c5b 0 2023-12-12T11:51:50.519 INFO:tasks.workunit.client.0.smithi063.stdout:7/228: creat de/d33/f5c x:0 0 0 2023-12-12T11:51:50.520 INFO:tasks.workunit.client.1.smithi093.stdout:2/498: rmdir d5/d14/d2d/d4c/d54/da8 0 2023-12-12T11:51:50.520 INFO:tasks.workunit.client.1.smithi093.stdout:2/499: write d5/d14/d2d/d12/d25/d7a/f81 [791588,48071] 0 2023-12-12T11:51:50.520 INFO:tasks.workunit.client.1.smithi093.stdout:2/500: write d5/d14/d2d/d12/f22 [1612965,94651] 0 2023-12-12T11:51:50.523 INFO:tasks.workunit.client.0.smithi063.stdout:1/222: creat d3/db/d12/f46 x:0 0 0 2023-12-12T11:51:50.527 INFO:tasks.workunit.client.1.smithi093.stdout:3/473: creat df/d25/d2c/f9b x:0 0 0 2023-12-12T11:51:50.527 INFO:tasks.workunit.client.1.smithi093.stdout:3/474: stat df/f54 0 2023-12-12T11:51:50.531 INFO:tasks.workunit.client.0.smithi063.stdout:4/298: mknod d2/d47/c5c 0 2023-12-12T11:51:50.531 INFO:tasks.workunit.client.0.smithi063.stdout:4/299: readlink d2/d47/l2b 0 2023-12-12T11:51:50.532 INFO:tasks.workunit.client.1.smithi093.stdout:4/655: mkdir d0/d31/d89/da1/dcd 0 2023-12-12T11:51:50.534 INFO:tasks.workunit.client.0.smithi063.stdout:8/354: symlink d4/d24/d38/l68 0 2023-12-12T11:51:50.538 INFO:tasks.workunit.client.0.smithi063.stdout:6/287: link d9/d10/d2a/f34 d9/d10/d5c/f5f 0 2023-12-12T11:51:50.539 INFO:tasks.workunit.client.1.smithi093.stdout:7/439: unlink da/d15/d19/f21 0 2023-12-12T11:51:50.541 INFO:tasks.workunit.client.1.smithi093.stdout:0/488: write d5/dd/f53 [2107260,79959] 0 2023-12-12T11:51:50.542 INFO:tasks.workunit.client.0.smithi063.stdout:2/222: creat d0/d1a/d1e/f4b x:0 0 0 2023-12-12T11:51:50.542 INFO:tasks.workunit.client.0.smithi063.stdout:2/223: chown d0/d1a/l2d 2 1 2023-12-12T11:51:50.542 INFO:tasks.workunit.client.0.smithi063.stdout:2/224: getdents d0/d41 0 2023-12-12T11:51:50.545 INFO:tasks.workunit.client.0.smithi063.stdout:7/229: dread de/f13 [0,4194304] 0 2023-12-12T11:51:50.546 INFO:tasks.workunit.client.0.smithi063.stdout:4/300: symlink d2/d17/d4e/l5d 0 2023-12-12T11:51:50.546 INFO:tasks.workunit.client.0.smithi063.stdout:4/301: fsync d2/f58 0 2023-12-12T11:51:50.547 INFO:tasks.workunit.client.0.smithi063.stdout:2/225: write d0/f15 [201367,47459] 0 2023-12-12T11:51:50.547 INFO:tasks.workunit.client.0.smithi063.stdout:2/226: readlink d0/d1a/d48/l42 0 2023-12-12T11:51:50.547 INFO:tasks.workunit.client.0.smithi063.stdout:2/227: creat d0/f4c x:0 0 0 2023-12-12T11:51:50.548 INFO:tasks.workunit.client.1.smithi093.stdout:9/450: unlink d1/d12/d1f/d32/d42/c6f 0 2023-12-12T11:51:50.549 INFO:tasks.workunit.client.0.smithi063.stdout:5/261: rename d7/d10/f45 to d7/d28/f47 0 2023-12-12T11:51:50.549 INFO:tasks.workunit.client.0.smithi063.stdout:5/262: dread - d7/d10/d2b/d3c/f36 zero size 2023-12-12T11:51:50.554 INFO:tasks.workunit.client.1.smithi093.stdout:8/488: symlink d3/d1a/d1f/d29/d30/d58/l99 0 2023-12-12T11:51:50.554 INFO:tasks.workunit.client.1.smithi093.stdout:3/475: mkdir df/d36/d3d/d59/d9c 0 2023-12-12T11:51:50.555 INFO:tasks.workunit.client.1.smithi093.stdout:3/476: write df/d25/d2c/d85/f8f [1605312,114024] 0 2023-12-12T11:51:50.559 INFO:tasks.workunit.client.1.smithi093.stdout:4/656: link d0/d36/d40/f57 d0/d87/d79/d86/fce 0 2023-12-12T11:51:50.565 INFO:tasks.workunit.client.0.smithi063.stdout:0/230: dwrite d0/d7/d27/f33 [4194304,4194304] 0 2023-12-12T11:51:50.566 INFO:tasks.workunit.client.0.smithi063.stdout:1/223: rmdir d3/d3a 39 2023-12-12T11:51:50.566 INFO:tasks.workunit.client.0.smithi063.stdout:1/224: dread - d3/d3a/f40 zero size 2023-12-12T11:51:50.567 INFO:tasks.workunit.client.1.smithi093.stdout:0/489: creat d5/dd/d33/d87/f96 x:0 0 0 2023-12-12T11:51:50.567 INFO:tasks.workunit.client.0.smithi063.stdout:1/225: write d3/db/f1d [4967161,74247] 0 2023-12-12T11:51:50.567 INFO:tasks.workunit.client.0.smithi063.stdout:1/226: readlink d3/l11 0 2023-12-12T11:51:50.569 INFO:tasks.workunit.client.0.smithi063.stdout:4/302: creat d2/d48/d4f/f5e x:0 0 0 2023-12-12T11:51:50.569 INFO:tasks.workunit.client.0.smithi063.stdout:4/303: write d2/d47/f2d [487819,32872] 0 2023-12-12T11:51:50.569 INFO:tasks.workunit.client.0.smithi063.stdout:9/240: dwrite f5 [0,4194304] 0 2023-12-12T11:51:50.569 INFO:tasks.workunit.client.0.smithi063.stdout:6/288: dread d9/f3b [0,4194304] 0 2023-12-12T11:51:50.574 INFO:tasks.workunit.client.1.smithi093.stdout:2/501: dwrite d5/d31/f64 [0,4194304] 0 2023-12-12T11:51:50.574 INFO:tasks.workunit.client.1.smithi093.stdout:2/502: stat d5/d14/d2d/d12/d25/l66 0 2023-12-12T11:51:50.575 INFO:tasks.workunit.client.1.smithi093.stdout:8/489: link d3/d8/l14 d3/d1a/d1f/d29/d3a/d68/l9a 0 2023-12-12T11:51:50.578 INFO:tasks.workunit.client.0.smithi063.stdout:5/263: unlink d7/d10/f33 0 2023-12-12T11:51:50.578 INFO:tasks.workunit.client.0.smithi063.stdout:5/264: creat d7/d10/f48 x:0 0 0 2023-12-12T11:51:50.584 INFO:tasks.workunit.client.1.smithi093.stdout:3/477: mkdir df/d36/d3d/d42/d9d 0 2023-12-12T11:51:50.584 INFO:tasks.workunit.client.1.smithi093.stdout:9/451: dread d1/d23/f41 [0,4194304] 0 2023-12-12T11:51:50.589 INFO:tasks.workunit.client.0.smithi063.stdout:0/231: mknod d0/d1a/d23/d2e/c4a 0 2023-12-12T11:51:50.593 INFO:tasks.workunit.client.1.smithi093.stdout:4/657: symlink d0/d31/d5c/d6c/lcf 0 2023-12-12T11:51:50.595 INFO:tasks.workunit.client.1.smithi093.stdout:7/440: dwrite da/d15/d19/d90/f87 [0,4194304] 0 2023-12-12T11:51:50.600 INFO:tasks.workunit.client.1.smithi093.stdout:3/478: dread df/d22/d49/d69/d78/f7d [0,4194304] 0 2023-12-12T11:51:50.600 INFO:tasks.workunit.client.1.smithi093.stdout:3/479: fsync df/f54 0 2023-12-12T11:51:50.601 INFO:tasks.workunit.client.0.smithi063.stdout:1/227: creat d3/db/d16/d24/f47 x:0 0 0 2023-12-12T11:51:50.605 INFO:tasks.workunit.client.1.smithi093.stdout:0/490: creat d5/dd/d14/d26/d58/d64/f97 x:0 0 0 2023-12-12T11:51:50.614 INFO:tasks.workunit.client.1.smithi093.stdout:5/383: sync 2023-12-12T11:51:50.617 INFO:tasks.workunit.client.0.smithi063.stdout:1/228: dread d3/db/d16/f21 [0,4194304] 0 2023-12-12T11:51:50.621 INFO:tasks.workunit.client.0.smithi063.stdout:4/304: symlink d2/d17/d41/l5f 0 2023-12-12T11:51:50.621 INFO:tasks.workunit.client.0.smithi063.stdout:4/305: write d2/d17/f3c [590302,74794] 0 2023-12-12T11:51:50.624 INFO:tasks.workunit.client.1.smithi093.stdout:8/490: mkdir d3/d1a/d1f/d29/d3a/d9b 0 2023-12-12T11:51:50.624 INFO:tasks.workunit.client.0.smithi063.stdout:7/230: dwrite de/d22/f24 [4194304,4194304] 0 2023-12-12T11:51:50.624 INFO:tasks.workunit.client.0.smithi063.stdout:7/231: fdatasync de/f4c 0 2023-12-12T11:51:50.631 INFO:tasks.workunit.client.1.smithi093.stdout:2/503: dread d5/d14/d2d/d4c/d54/d67/d69/d6c/f5a [0,4194304] 0 2023-12-12T11:51:50.631 INFO:tasks.workunit.client.1.smithi093.stdout:4/658: dwrite d0/d36/d40/f57 [0,4194304] 0 2023-12-12T11:51:50.634 INFO:tasks.workunit.client.1.smithi093.stdout:5/384: write d0/d3b/f63 [3347568,94453] 0 2023-12-12T11:51:50.640 INFO:tasks.workunit.client.1.smithi093.stdout:9/452: link d1/d12/d1f/d32/c47 d1/d23/d24/d29/d43/c9b 0 2023-12-12T11:51:50.640 INFO:tasks.workunit.client.1.smithi093.stdout:9/453: dread - d1/d12/d1f/d3d/d57/f5d zero size 2023-12-12T11:51:50.642 INFO:tasks.workunit.client.0.smithi063.stdout:6/289: creat d9/d10/d5c/f60 x:0 0 0 2023-12-12T11:51:50.648 INFO:tasks.workunit.client.0.smithi063.stdout:8/355: rename d4/de/f2e to d4/d24/d38/d45/f69 0 2023-12-12T11:51:50.653 INFO:tasks.workunit.client.1.smithi093.stdout:3/480: mknod df/d22/c9e 0 2023-12-12T11:51:50.656 INFO:tasks.workunit.client.1.smithi093.stdout:0/491: mknod d5/dd/d33/c98 0 2023-12-12T11:51:50.656 INFO:tasks.workunit.client.0.smithi063.stdout:5/265: mkdir d7/d28/d43/d49 0 2023-12-12T11:51:50.656 INFO:tasks.workunit.client.0.smithi063.stdout:5/266: truncate d7/d10/f46 314740 0 2023-12-12T11:51:50.659 INFO:tasks.workunit.client.0.smithi063.stdout:0/232: mknod d0/d7/d27/d19/d2d/c4b 0 2023-12-12T11:51:50.660 INFO:tasks.workunit.client.0.smithi063.stdout:0/233: creat d0/d7/d27/d1f/f4c x:0 0 0 2023-12-12T11:51:50.664 INFO:tasks.workunit.client.1.smithi093.stdout:2/504: symlink d5/d14/d2d/d4c/d76/lac 0 2023-12-12T11:51:50.667 INFO:tasks.workunit.client.0.smithi063.stdout:1/229: mkdir d3/db/d16/d24/d48 0 2023-12-12T11:51:50.667 INFO:tasks.workunit.client.0.smithi063.stdout:1/230: creat d3/db/d12/f49 x:0 0 0 2023-12-12T11:51:50.667 INFO:tasks.workunit.client.0.smithi063.stdout:1/231: write d3/db/d16/d24/d30/f3d [721610,119867] 0 2023-12-12T11:51:50.668 INFO:tasks.workunit.client.1.smithi093.stdout:5/385: truncate d0/d7/d36/d38/f43 2795066 0 2023-12-12T11:51:50.668 INFO:tasks.workunit.client.1.smithi093.stdout:5/386: write d0/d7/d59/d48/f6c [533551,55687] 0 2023-12-12T11:51:50.671 INFO:tasks.workunit.client.0.smithi063.stdout:4/306: truncate d2/f40 1184206 0 2023-12-12T11:51:50.671 INFO:tasks.workunit.client.0.smithi063.stdout:4/307: dread - d2/d17/d41/f52 zero size 2023-12-12T11:51:50.672 INFO:tasks.workunit.client.1.smithi093.stdout:9/454: creat d1/d23/f9c x:0 0 0 2023-12-12T11:51:50.672 INFO:tasks.workunit.client.0.smithi063.stdout:5/267: dread d7/de/f30 [0,4194304] 0 2023-12-12T11:51:50.683 INFO:tasks.workunit.client.1.smithi093.stdout:6/620: sync 2023-12-12T11:51:50.683 INFO:tasks.workunit.client.1.smithi093.stdout:1/480: sync 2023-12-12T11:51:50.684 INFO:tasks.workunit.client.1.smithi093.stdout:8/491: dwrite d3/f6 [0,4194304] 0 2023-12-12T11:51:50.684 INFO:tasks.workunit.client.1.smithi093.stdout:8/492: fdatasync d3/d1a/f2b 0 2023-12-12T11:51:50.688 INFO:tasks.workunit.client.1.smithi093.stdout:4/659: dwrite d0/d36/fbb [0,4194304] 0 2023-12-12T11:51:50.689 INFO:tasks.workunit.client.1.smithi093.stdout:4/660: write d0/d36/d61/f62 [5070854,16641] 0 2023-12-12T11:51:50.689 INFO:tasks.workunit.client.1.smithi093.stdout:4/661: fsync d0/d36/d49/f7e 0 2023-12-12T11:51:50.689 INFO:tasks.workunit.client.1.smithi093.stdout:4/662: fdatasync d0/d31/d5c/d6c/da4/fbd 0 2023-12-12T11:51:50.695 INFO:tasks.workunit.client.0.smithi063.stdout:7/232: creat de/d34/d43/d45/d4e/f5d x:0 0 0 2023-12-12T11:51:50.695 INFO:tasks.workunit.client.0.smithi063.stdout:7/233: chown de/d33/l51 938308647 1 2023-12-12T11:51:50.696 INFO:tasks.workunit.client.1.smithi093.stdout:3/481: creat df/d36/d3d/d59/d9c/f9f x:0 0 0 2023-12-12T11:51:50.697 INFO:tasks.workunit.client.0.smithi063.stdout:9/241: getdents d7 0 2023-12-12T11:51:50.702 INFO:tasks.workunit.client.0.smithi063.stdout:9/242: chown d7/d11/f21 56 1 2023-12-12T11:51:50.709 INFO:tasks.workunit.client.1.smithi093.stdout:0/492: mkdir d5/dd/d14/d99 0 2023-12-12T11:51:50.709 INFO:tasks.workunit.client.1.smithi093.stdout:0/493: truncate d5/dd/d14/d26/f8e 71082 0 2023-12-12T11:51:50.709 INFO:tasks.workunit.client.1.smithi093.stdout:6/621: dread d0/da/d14/d3a/f6a [0,4194304] 0 2023-12-12T11:51:50.711 INFO:tasks.workunit.client.1.smithi093.stdout:2/505: mkdir d5/d14/d2d/d96/dad 0 2023-12-12T11:51:50.713 INFO:tasks.workunit.client.1.smithi093.stdout:1/481: mknod d4/d1a/d1b/d26/ca0 0 2023-12-12T11:51:50.717 INFO:tasks.workunit.client.0.smithi063.stdout:2/228: rename d0/d1a/d48/c23 to d0/d1a/d3a/c4d 0 2023-12-12T11:51:50.719 INFO:tasks.workunit.client.1.smithi093.stdout:2/506: dread d5/d31/f3f [0,4194304] 0 2023-12-12T11:51:50.719 INFO:tasks.workunit.client.1.smithi093.stdout:2/507: write d5/d14/d2d/d12/d44/f4d [454095,6231] 0 2023-12-12T11:51:50.725 INFO:tasks.workunit.client.1.smithi093.stdout:7/441: sync 2023-12-12T11:51:50.725 INFO:tasks.workunit.client.1.smithi093.stdout:8/493: symlink d3/d1a/d1f/d29/d30/l9c 0 2023-12-12T11:51:50.727 INFO:tasks.workunit.client.0.smithi063.stdout:0/234: symlink d0/d7/d27/d19/d2d/l4d 0 2023-12-12T11:51:50.727 INFO:tasks.workunit.client.0.smithi063.stdout:0/235: truncate d0/d7/d27/fb 1486618 0 2023-12-12T11:51:50.727 INFO:tasks.workunit.client.0.smithi063.stdout:1/232: dwrite f2 [4194304,4194304] 0 2023-12-12T11:51:50.727 INFO:tasks.workunit.client.0.smithi063.stdout:1/233: chown d3/db/d16 638 1 2023-12-12T11:51:50.727 INFO:tasks.workunit.client.0.smithi063.stdout:0/236: write d0/d7/d27/d1f/f4c [84573,60360] 0 2023-12-12T11:51:50.727 INFO:tasks.workunit.client.0.smithi063.stdout:0/237: rename d0 to d0/d4e 22 2023-12-12T11:51:50.728 INFO:tasks.workunit.client.0.smithi063.stdout:0/238: write d0/d1a/f1c [143296,37170] 0 2023-12-12T11:51:50.729 INFO:tasks.workunit.client.0.smithi063.stdout:0/239: chown d0/d1a/d23/d2e 4 1 2023-12-12T11:51:50.729 INFO:tasks.workunit.client.0.smithi063.stdout:0/240: chown d0/d7/d27/f3b 0 1 2023-12-12T11:51:50.729 INFO:tasks.workunit.client.0.smithi063.stdout:4/308: mknod d2/d47/c60 0 2023-12-12T11:51:50.731 INFO:tasks.workunit.client.1.smithi093.stdout:5/387: dwrite d0/d3b/d66/f7d [0,4194304] 0 2023-12-12T11:51:50.733 INFO:tasks.workunit.client.0.smithi063.stdout:0/241: creat d0/d7/d27/d19/f4f x:0 0 0 2023-12-12T11:51:50.733 INFO:tasks.workunit.client.0.smithi063.stdout:6/290: rmdir d9/d10/d5c 39 2023-12-12T11:51:50.733 INFO:tasks.workunit.client.0.smithi063.stdout:2/229: mknod d0/c4e 0 2023-12-12T11:51:50.735 INFO:tasks.workunit.client.1.smithi093.stdout:4/663: unlink d0/d36/l80 0 2023-12-12T11:51:50.735 INFO:tasks.workunit.client.1.smithi093.stdout:3/482: mknod df/d30/d33/d66/ca0 0 2023-12-12T11:51:50.736 INFO:tasks.workunit.client.1.smithi093.stdout:6/622: mkdir d0/da/d32/d9e/d4d/deb 0 2023-12-12T11:51:50.738 INFO:tasks.workunit.client.0.smithi063.stdout:6/291: dread - d9/d10/d2a/f53 zero size 2023-12-12T11:51:50.739 INFO:tasks.workunit.client.1.smithi093.stdout:1/482: unlink d4/dc/f10 0 2023-12-12T11:51:50.741 INFO:tasks.workunit.client.1.smithi093.stdout:2/508: mkdir d5/d14/d47/d4e/dae 0 2023-12-12T11:51:50.742 INFO:tasks.workunit.client.1.smithi093.stdout:8/494: mknod d3/d1a/d1f/d59/c9d 0 2023-12-12T11:51:50.744 INFO:tasks.workunit.client.0.smithi063.stdout:2/230: truncate d0/d1a/d48/f34 3362748 0 2023-12-12T11:51:50.744 INFO:tasks.workunit.client.0.smithi063.stdout:2/231: creat d0/f4f x:0 0 0 2023-12-12T11:51:50.749 INFO:tasks.workunit.client.1.smithi093.stdout:9/455: dwrite d1/d12/d1f/d3d/d5c/f88 [0,4194304] 0 2023-12-12T11:51:50.749 INFO:tasks.workunit.client.1.smithi093.stdout:9/456: truncate d1/d12/d1f/d3d/f91 111673 0 2023-12-12T11:51:50.749 INFO:tasks.workunit.client.1.smithi093.stdout:3/483: rename df/d36/d3d/d42/f93 to df/d30/d33/d66/fa1 0 2023-12-12T11:51:50.749 INFO:tasks.workunit.client.1.smithi093.stdout:3/484: chown df/d36/d3d/d6f/l71 127020 1 2023-12-12T11:51:50.749 INFO:tasks.workunit.client.1.smithi093.stdout:3/485: creat df/d36/d3d/d59/d9c/fa2 x:0 0 0 2023-12-12T11:51:50.749 INFO:tasks.workunit.client.1.smithi093.stdout:3/486: readlink df/d22/d49/d69/d6e/l95 0 2023-12-12T11:51:50.754 INFO:tasks.workunit.client.1.smithi093.stdout:2/509: getdents d5/d14/d2d/d12/d44 0 2023-12-12T11:51:50.755 INFO:tasks.workunit.client.1.smithi093.stdout:8/495: truncate d3/d1a/f2b 1194574 0 2023-12-12T11:51:50.759 INFO:tasks.workunit.client.1.smithi093.stdout:7/442: write da/d15/d19/d90/f87 [3216927,119425] 0 2023-12-12T11:51:50.762 INFO:tasks.workunit.client.1.smithi093.stdout:6/623: getdents d0/da 0 2023-12-12T11:51:50.762 INFO:tasks.workunit.client.1.smithi093.stdout:6/624: readlink d0/da/d32/d9e/l4c 0 2023-12-12T11:51:50.763 INFO:tasks.workunit.client.1.smithi093.stdout:2/510: truncate d5/d14/f4f 5671357 0 2023-12-12T11:51:50.764 INFO:tasks.workunit.client.0.smithi063.stdout:3/213: sync 2023-12-12T11:51:50.765 INFO:tasks.workunit.client.1.smithi093.stdout:8/496: mknod d3/d1a/d1f/d29/d30/d58/d76/c9e 0 2023-12-12T11:51:50.765 INFO:tasks.workunit.client.1.smithi093.stdout:8/497: chown d3/l5e 38861139 1 2023-12-12T11:51:50.765 INFO:tasks.workunit.client.0.smithi063.stdout:3/214: write d4/df/d1a/d1c/f43 [708586,122546] 0 2023-12-12T11:51:50.767 INFO:tasks.workunit.client.1.smithi093.stdout:9/457: rmdir d1/d12/d1f/d3d/d5c 39 2023-12-12T11:51:50.767 INFO:tasks.workunit.client.1.smithi093.stdout:9/458: fsync d1/d12/d1f/d73/f76 0 2023-12-12T11:51:50.767 INFO:tasks.workunit.client.1.smithi093.stdout:3/487: dread df/d22/d49/d69/d78/f7d [0,4194304] 0 2023-12-12T11:51:50.769 INFO:tasks.workunit.client.1.smithi093.stdout:0/494: dwrite d5/d21/d2f/d54/f7b [0,4194304] 0 2023-12-12T11:51:50.770 INFO:tasks.workunit.client.1.smithi093.stdout:6/625: symlink d0/da/d14/lec 0 2023-12-12T11:51:50.772 INFO:tasks.workunit.client.0.smithi063.stdout:2/232: write d0/d1a/d1e/f2e [5625350,25266] 0 2023-12-12T11:51:50.774 INFO:tasks.workunit.client.0.smithi063.stdout:3/215: getdents d4/df/d1a/d1c/d3b 0 2023-12-12T11:51:50.780 INFO:tasks.workunit.client.1.smithi093.stdout:2/511: mknod d5/d14/d2d/d12/d25/d7a/d7e/da0/caf 0 2023-12-12T11:51:50.780 INFO:tasks.workunit.client.1.smithi093.stdout:8/498: rename d3/d1a/d1f/f2a to d3/d1a/d1f/d75/f9f 0 2023-12-12T11:51:50.780 INFO:tasks.workunit.client.1.smithi093.stdout:8/499: chown d3/f80 3812 1 2023-12-12T11:51:50.784 INFO:tasks.workunit.client.1.smithi093.stdout:0/495: truncate d5/dd/d33/f46 1189485 0 2023-12-12T11:51:50.788 INFO:tasks.workunit.client.0.smithi063.stdout:8/356: read f1 [1357915,61246] 0 2023-12-12T11:51:50.788 INFO:tasks.workunit.client.0.smithi063.stdout:8/357: dread - d4/de/f19 zero size 2023-12-12T11:51:50.788 INFO:tasks.workunit.client.1.smithi093.stdout:7/443: getdents da/d15/d59/d80 0 2023-12-12T11:51:50.788 INFO:tasks.workunit.client.1.smithi093.stdout:7/444: dread - da/d15/d59/d80/f8d zero size 2023-12-12T11:51:50.788 INFO:tasks.workunit.client.1.smithi093.stdout:7/445: truncate da/f8a 941528 0 2023-12-12T11:51:50.792 INFO:tasks.workunit.client.0.smithi063.stdout:4/309: dread d2/d17/f22 [0,4194304] 0 2023-12-12T11:51:50.792 INFO:tasks.workunit.client.1.smithi093.stdout:6/626: creat d0/da/d32/d9e/d4d/de9/fed x:0 0 0 2023-12-12T11:51:50.792 INFO:tasks.workunit.client.1.smithi093.stdout:6/627: chown d0/da/d14/f72 31 1 2023-12-12T11:51:50.794 INFO:tasks.workunit.client.0.smithi063.stdout:2/233: write d0/f17 [3451750,94232] 0 2023-12-12T11:51:50.794 INFO:tasks.workunit.client.0.smithi063.stdout:2/234: chown d0/d1a/d48/f30 55700264 1 2023-12-12T11:51:50.795 INFO:tasks.workunit.client.1.smithi093.stdout:2/512: creat d5/d14/d47/d56/d6f/fb0 x:0 0 0 2023-12-12T11:51:50.797 INFO:tasks.workunit.client.0.smithi063.stdout:8/358: creat d4/d24/d38/d45/f6a x:0 0 0 2023-12-12T11:51:50.800 INFO:tasks.workunit.client.1.smithi093.stdout:0/496: write d5/dd/f75 [933042,122191] 0 2023-12-12T11:51:50.802 INFO:tasks.workunit.client.1.smithi093.stdout:3/488: getdents df/d25/d2c 0 2023-12-12T11:51:50.803 INFO:tasks.workunit.client.0.smithi063.stdout:0/242: dread d0/d7/d27/d1f/f2c [0,4194304] 0 2023-12-12T11:51:50.803 INFO:tasks.workunit.client.0.smithi063.stdout:0/243: write d0/d7/d27/d19/d2d/f43 [1118978,34620] 0 2023-12-12T11:51:50.806 INFO:tasks.workunit.client.1.smithi093.stdout:9/459: truncate d1/d12/d1f/d3d/d57/f67 1067614 0 2023-12-12T11:51:50.806 INFO:tasks.workunit.client.1.smithi093.stdout:9/460: truncate d1/d12/d1f/d32/f3b 1717516 0 2023-12-12T11:51:50.806 INFO:tasks.workunit.client.1.smithi093.stdout:9/461: creat d1/d12/d1f/d3d/f9d x:0 0 0 2023-12-12T11:51:50.808 INFO:tasks.workunit.client.1.smithi093.stdout:8/500: unlink d3/d1a/d1f/f47 0 2023-12-12T11:51:50.811 INFO:tasks.workunit.client.0.smithi063.stdout:4/310: unlink d2/d17/c1b 0 2023-12-12T11:51:50.811 INFO:tasks.workunit.client.0.smithi063.stdout:4/311: write d2/d48/d4f/f5e [652944,111440] 0 2023-12-12T11:51:50.811 INFO:tasks.workunit.client.0.smithi063.stdout:4/312: chown d2/d8/f49 7877558 1 2023-12-12T11:51:50.811 INFO:tasks.workunit.client.1.smithi093.stdout:7/446: symlink da/d15/d19/d90/d7d/l9b 0 2023-12-12T11:51:50.816 INFO:tasks.workunit.client.1.smithi093.stdout:4/664: dread d0/d87/d79/d86/f8a [0,4194304] 0 2023-12-12T11:51:50.818 INFO:tasks.workunit.client.1.smithi093.stdout:2/513: truncate d5/d14/d2d/d12/d25/f30 2360213 0 2023-12-12T11:51:50.821 INFO:tasks.workunit.client.0.smithi063.stdout:3/216: dread d4/df/d1a/d1c/f43 [0,4194304] 0 2023-12-12T11:51:50.826 INFO:tasks.workunit.client.0.smithi063.stdout:8/359: rename d4/d55/c2a to d4/d55/c6b 0 2023-12-12T11:51:50.826 INFO:tasks.workunit.client.0.smithi063.stdout:8/360: creat d4/d24/d3e/f6c x:0 0 0 2023-12-12T11:51:50.827 INFO:tasks.workunit.client.0.smithi063.stdout:8/361: write d4/de/d1e/f5c [290104,108084] 0 2023-12-12T11:51:50.829 INFO:tasks.workunit.client.1.smithi093.stdout:3/489: symlink df/d36/d3d/d59/d72/d79/la3 0 2023-12-12T11:51:50.829 INFO:tasks.workunit.client.1.smithi093.stdout:3/490: write df/d36/f41 [4498783,39431] 0 2023-12-12T11:51:50.829 INFO:tasks.workunit.client.1.smithi093.stdout:3/491: fsync df/f10 0 2023-12-12T11:51:50.831 INFO:tasks.workunit.client.0.smithi063.stdout:5/268: dwrite d7/d10/d2b/d3c/f36 [0,4194304] 0 2023-12-12T11:51:50.833 INFO:tasks.workunit.client.1.smithi093.stdout:8/501: dread d3/d8/f7d [0,4194304] 0 2023-12-12T11:51:50.834 INFO:tasks.workunit.client.0.smithi063.stdout:8/362: dread d4/f4e [0,4194304] 0 2023-12-12T11:51:50.835 INFO:tasks.workunit.client.0.smithi063.stdout:0/244: creat d0/f50 x:0 0 0 2023-12-12T11:51:50.835 INFO:tasks.workunit.client.0.smithi063.stdout:0/245: creat d0/d7/d27/d19/f51 x:0 0 0 2023-12-12T11:51:50.836 INFO:tasks.workunit.client.0.smithi063.stdout:0/246: read d0/d7/d27/d19/d2d/f43 [385787,27466] 0 2023-12-12T11:51:50.838 INFO:tasks.workunit.client.1.smithi093.stdout:0/497: dread d5/d21/d27/d3a/f56 [0,4194304] 0 2023-12-12T11:51:50.839 INFO:tasks.workunit.client.0.smithi063.stdout:4/313: unlink d2/d47/l38 0 2023-12-12T11:51:50.840 INFO:tasks.workunit.client.1.smithi093.stdout:9/462: mkdir d1/d12/d1f/d3d/d57/d9e 0 2023-12-12T11:51:50.841 INFO:tasks.workunit.client.1.smithi093.stdout:1/483: dwrite d4/dc/f9f [0,4194304] 0 2023-12-12T11:51:50.842 INFO:tasks.workunit.client.0.smithi063.stdout:1/234: dwrite d3/db/d16/d24/f47 [0,4194304] 0 2023-12-12T11:51:50.842 INFO:tasks.workunit.client.0.smithi063.stdout:1/235: readlink d3/d3a/l3b 0 2023-12-12T11:51:50.842 INFO:tasks.workunit.client.1.smithi093.stdout:5/388: dwrite d0/d7/d36/d38/f43 [0,4194304] 0 2023-12-12T11:51:50.843 INFO:tasks.workunit.client.0.smithi063.stdout:7/234: dwrite de/f4c [0,4194304] 0 2023-12-12T11:51:50.843 INFO:tasks.workunit.client.0.smithi063.stdout:7/235: chown de/d22/d2b/c5a 516962704 1 2023-12-12T11:51:50.847 INFO:tasks.workunit.client.1.smithi093.stdout:7/447: rename da/d15/d19/d4c/l7f to da/d8e/l9c 0 2023-12-12T11:51:50.850 INFO:tasks.workunit.client.0.smithi063.stdout:3/217: getdents d4/df/d1a 0 2023-12-12T11:51:50.853 INFO:tasks.workunit.client.0.smithi063.stdout:5/269: write d7/de/f1e [2444658,75289] 0 2023-12-12T11:51:50.853 INFO:tasks.workunit.client.0.smithi063.stdout:5/270: write d7/de/f25 [4847674,6035] 0 2023-12-12T11:51:50.857 INFO:tasks.workunit.client.1.smithi093.stdout:4/665: unlink d0/d31/l3a 0 2023-12-12T11:51:50.857 INFO:tasks.workunit.client.1.smithi093.stdout:8/502: write d3/d8/f7d [2151766,93896] 0 2023-12-12T11:51:50.858 INFO:tasks.workunit.client.0.smithi063.stdout:1/236: write d3/db/f1d [1419136,116926] 0 2023-12-12T11:51:50.858 INFO:tasks.workunit.client.0.smithi063.stdout:1/237: dread - d3/db/d12/f27 zero size 2023-12-12T11:51:50.861 INFO:tasks.workunit.client.1.smithi093.stdout:2/514: truncate d5/d31/f64 601750 0 2023-12-12T11:51:50.862 INFO:tasks.workunit.client.0.smithi063.stdout:2/235: rmdir d0/d1a/d48 39 2023-12-12T11:51:50.863 INFO:tasks.workunit.client.1.smithi093.stdout:8/503: write d3/d1a/d1f/d29/d30/d58/f67 [634168,77281] 0 2023-12-12T11:51:50.867 INFO:tasks.workunit.client.1.smithi093.stdout:2/515: dread d5/d14/d2d/d12/d44/f4d [0,4194304] 0 2023-12-12T11:51:50.867 INFO:tasks.workunit.client.1.smithi093.stdout:2/516: fsync d5/d14/d5e/f70 0 2023-12-12T11:51:50.868 INFO:tasks.workunit.client.0.smithi063.stdout:8/363: mkdir d4/de/d1e/d6d 0 2023-12-12T11:51:50.869 INFO:tasks.workunit.client.1.smithi093.stdout:3/492: truncate df/d22/f23 2473400 0 2023-12-12T11:51:50.869 INFO:tasks.workunit.client.1.smithi093.stdout:3/493: write df/d36/d3d/d59/f98 [648684,108016] 0 2023-12-12T11:51:50.869 INFO:tasks.workunit.client.1.smithi093.stdout:3/494: readlink df/d36/d3d/d59/d72/d79/l8b 0 2023-12-12T11:51:50.869 INFO:tasks.workunit.client.1.smithi093.stdout:3/495: getdents df/d36/d3d/d42/d8e 0 2023-12-12T11:51:50.872 INFO:tasks.workunit.client.1.smithi093.stdout:0/498: dwrite d5/dd/d33/d87/f96 [0,4194304] 0 2023-12-12T11:51:50.877 INFO:tasks.workunit.client.0.smithi063.stdout:0/247: link d0/d7/d27/f33 d0/d1a/d23/d34/f52 0 2023-12-12T11:51:50.879 INFO:tasks.workunit.client.0.smithi063.stdout:4/314: mkdir d2/d17/d61 0 2023-12-12T11:51:50.880 INFO:tasks.workunit.client.0.smithi063.stdout:4/315: fsync d2/d47/f46 0 2023-12-12T11:51:50.886 INFO:tasks.workunit.client.1.smithi093.stdout:2/517: dread d5/d31/f77 [0,4194304] 0 2023-12-12T11:51:50.888 INFO:tasks.workunit.client.1.smithi093.stdout:2/518: write d5/d31/f3f [558253,9076] 0 2023-12-12T11:51:50.897 INFO:tasks.workunit.client.0.smithi063.stdout:7/236: creat de/d39/f5e x:0 0 0 2023-12-12T11:51:50.900 INFO:tasks.workunit.client.0.smithi063.stdout:3/218: creat d4/f44 x:0 0 0 2023-12-12T11:51:50.903 INFO:tasks.workunit.client.0.smithi063.stdout:5/271: unlink d7/d10/d2b/d3c/d27/f3e 0 2023-12-12T11:51:50.905 INFO:tasks.workunit.client.0.smithi063.stdout:1/238: mknod d3/db/d16/d24/d30/c4a 0 2023-12-12T11:51:50.905 INFO:tasks.workunit.client.0.smithi063.stdout:1/239: chown d3/db/c45 3775 1 2023-12-12T11:51:50.907 INFO:tasks.workunit.client.0.smithi063.stdout:2/236: rename d0/c8 to d0/c50 0 2023-12-12T11:51:50.909 INFO:tasks.workunit.client.1.smithi093.stdout:9/463: rename d1/d12/d1f/d32/d42/d97 to d1/d23/d6b/d92/d9f 0 2023-12-12T11:51:50.913 INFO:tasks.workunit.client.0.smithi063.stdout:1/240: dread d3/db/d16/d24/d30/f3d [0,4194304] 0 2023-12-12T11:51:50.913 INFO:tasks.workunit.client.0.smithi063.stdout:1/241: readlink d3/db/d12/l38 0 2023-12-12T11:51:50.914 INFO:tasks.workunit.client.0.smithi063.stdout:1/242: fdatasync d3/db/fd 0 2023-12-12T11:51:50.914 INFO:tasks.workunit.client.1.smithi093.stdout:4/666: creat d0/fd0 x:0 0 0 2023-12-12T11:51:50.919 INFO:tasks.workunit.client.1.smithi093.stdout:8/504: mkdir d3/d1a/d1f/d29/d3a/da0 0 2023-12-12T11:51:50.920 INFO:tasks.workunit.client.1.smithi093.stdout:8/505: write d3/f80 [611653,33629] 0 2023-12-12T11:51:50.920 INFO:tasks.workunit.client.1.smithi093.stdout:8/506: fdatasync d3/f74 0 2023-12-12T11:51:50.920 INFO:tasks.workunit.client.1.smithi093.stdout:1/484: dread d4/f3e [0,4194304] 0 2023-12-12T11:51:50.925 INFO:tasks.workunit.client.1.smithi093.stdout:1/485: dread d4/d1a/d73/f50 [0,4194304] 0 2023-12-12T11:51:50.930 INFO:tasks.workunit.client.1.smithi093.stdout:0/499: unlink d5/dd/d14/d26/d58/d64/d7c/f89 0 2023-12-12T11:51:50.932 INFO:tasks.workunit.client.0.smithi063.stdout:7/237: getdents de/d34/d43 0 2023-12-12T11:51:50.934 INFO:tasks.workunit.client.1.smithi093.stdout:2/519: mknod d5/d14/d2d/d12/d25/d7a/d7e/da0/cb1 0 2023-12-12T11:51:50.935 INFO:tasks.workunit.client.0.smithi063.stdout:3/219: mknod d4/df/d1a/d1c/d3b/c45 0 2023-12-12T11:51:50.935 INFO:tasks.workunit.client.0.smithi063.stdout:3/220: dread - d4/df/d1a/d1c/d3b/f3e zero size 2023-12-12T11:51:50.938 INFO:tasks.workunit.client.0.smithi063.stdout:5/272: creat d7/d28/d43/d49/f4a x:0 0 0 2023-12-12T11:51:50.939 INFO:tasks.workunit.client.1.smithi093.stdout:3/496: truncate df/d22/f23 2869489 0 2023-12-12T11:51:50.947 INFO:tasks.workunit.client.1.smithi093.stdout:0/500: dread d5/dd/d33/f5e [0,4194304] 0 2023-12-12T11:51:50.952 INFO:tasks.workunit.client.1.smithi093.stdout:9/464: creat d1/d23/d24/d29/fa0 x:0 0 0 2023-12-12T11:51:50.955 INFO:tasks.workunit.client.1.smithi093.stdout:4/667: rename d0/f54 to d0/fd1 0 2023-12-12T11:51:50.955 INFO:tasks.workunit.client.1.smithi093.stdout:4/668: truncate d0/d87/d79/d86/fce 4202009 0 2023-12-12T11:51:50.958 INFO:tasks.workunit.client.1.smithi093.stdout:8/507: link d3/d8/l41 d3/d1a/d1f/d29/d3a/d68/d8a/la1 0 2023-12-12T11:51:50.960 INFO:tasks.workunit.client.0.smithi063.stdout:1/243: mkdir d3/db/d16/d17/d4b 0 2023-12-12T11:51:50.963 INFO:tasks.workunit.client.0.smithi063.stdout:3/221: mknod d4/d23/c46 0 2023-12-12T11:51:50.965 INFO:tasks.workunit.client.0.smithi063.stdout:5/273: creat d7/d10/d2b/f4b x:0 0 0 2023-12-12T11:51:50.965 INFO:tasks.workunit.client.0.smithi063.stdout:5/274: truncate d7/f29 671351 0 2023-12-12T11:51:50.967 INFO:tasks.workunit.client.1.smithi093.stdout:2/520: creat d5/d14/d2d/d12/d25/fb2 x:0 0 0 2023-12-12T11:51:50.969 INFO:tasks.workunit.client.0.smithi063.stdout:8/364: rename d4/d24/d3e to d4/de/d3b/d62/d6e 0 2023-12-12T11:51:50.971 INFO:tasks.workunit.client.0.smithi063.stdout:1/244: mknod d3/db/c4c 0 2023-12-12T11:51:50.972 INFO:tasks.workunit.client.1.smithi093.stdout:9/465: getdents d1/d12/d1f/d3d/d5c 0 2023-12-12T11:51:50.974 INFO:tasks.workunit.client.0.smithi063.stdout:7/238: mknod de/d22/c5f 0 2023-12-12T11:51:50.979 INFO:tasks.workunit.client.0.smithi063.stdout:5/275: rmdir d7/d10/d35 39 2023-12-12T11:51:50.980 INFO:tasks.workunit.client.0.smithi063.stdout:5/276: write d7/d28/d43/d49/f4a [930523,103514] 0 2023-12-12T11:51:50.981 INFO:tasks.workunit.client.1.smithi093.stdout:4/669: rename d0/d31/c2f to d0/d36/d61/cd2 0 2023-12-12T11:51:50.982 INFO:tasks.workunit.client.1.smithi093.stdout:4/670: write d0/d31/d9d/fc1 [975392,46059] 0 2023-12-12T11:51:50.983 INFO:tasks.workunit.client.1.smithi093.stdout:4/671: dread - d0/d31/d9d/da0/fa5 zero size 2023-12-12T11:51:50.983 INFO:tasks.workunit.client.1.smithi093.stdout:4/672: fdatasync d0/d31/d89/f9c 0 2023-12-12T11:51:50.983 INFO:tasks.workunit.client.1.smithi093.stdout:4/673: readlink d0/d31/l4d 0 2023-12-12T11:51:50.984 INFO:tasks.workunit.client.0.smithi063.stdout:0/248: rename d0/d7/d27/d19/f4f to d0/d1a/d23/d34/d42/f53 0 2023-12-12T11:51:50.984 INFO:tasks.workunit.client.0.smithi063.stdout:0/249: stat d0/d1a/d23/l2a 0 2023-12-12T11:51:50.986 INFO:tasks.workunit.client.1.smithi093.stdout:8/508: write d3/d8/f7a [2882139,69632] 0 2023-12-12T11:51:50.986 INFO:tasks.workunit.client.1.smithi093.stdout:8/509: read - d3/d1a/d1f/d29/d3a/d68/f92 zero size 2023-12-12T11:51:50.991 INFO:tasks.workunit.client.0.smithi063.stdout:8/365: unlink d4/de/f4a 0 2023-12-12T11:51:50.995 INFO:tasks.workunit.client.0.smithi063.stdout:5/277: link d7/d28/f2f d7/d10/d35/f4c 0 2023-12-12T11:51:50.996 INFO:tasks.workunit.client.1.smithi093.stdout:4/674: rename d0/d87/d79/d86/da9/lbc to d0/d31/d5c/d6c/da4/dc2/ld3 0 2023-12-12T11:51:50.997 INFO:tasks.workunit.client.0.smithi063.stdout:1/245: write f2 [816976,75943] 0 2023-12-12T11:51:50.997 INFO:tasks.workunit.client.0.smithi063.stdout:3/222: rename d4/df/d1a/d1c/d3b/c40 to d4/d23/c47 0 2023-12-12T11:51:51.000 INFO:tasks.workunit.client.0.smithi063.stdout:0/250: creat d0/d1a/d23/f54 x:0 0 0 2023-12-12T11:51:51.000 INFO:tasks.workunit.client.0.smithi063.stdout:0/251: chown d0/d7/d27/d1f/f4c 195277279 1 2023-12-12T11:51:51.002 INFO:tasks.workunit.client.1.smithi093.stdout:0/501: dwrite d5/dd/f35 [0,4194304] 0 2023-12-12T11:51:51.006 INFO:tasks.workunit.client.1.smithi093.stdout:8/510: symlink d3/d1a/d1f/d29/d3a/d68/la2 0 2023-12-12T11:51:51.009 INFO:tasks.workunit.client.0.smithi063.stdout:8/366: creat d4/de/d3b/d62/f6f x:0 0 0 2023-12-12T11:51:51.009 INFO:tasks.workunit.client.0.smithi063.stdout:8/367: write f1 [1074814,37610] 0 2023-12-12T11:51:51.009 INFO:tasks.workunit.client.1.smithi093.stdout:1/486: dwrite d4/dc/f9f [4194304,4194304] 0 2023-12-12T11:51:51.013 INFO:tasks.workunit.client.0.smithi063.stdout:7/239: rename de/d3f/d56 to de/d39/d60 0 2023-12-12T11:51:51.015 INFO:tasks.workunit.client.1.smithi093.stdout:4/675: link d0/d31/laa d0/d87/d79/d7f/ld4 0 2023-12-12T11:51:51.015 INFO:tasks.workunit.client.1.smithi093.stdout:4/676: chown d0/d36/d49/f7e 15 1 2023-12-12T11:51:51.016 INFO:tasks.workunit.client.0.smithi063.stdout:7/240: stat de/d33/c35 0 2023-12-12T11:51:51.016 INFO:tasks.workunit.client.0.smithi063.stdout:7/241: read de/f13 [2109370,99906] 0 2023-12-12T11:51:51.016 INFO:tasks.workunit.client.0.smithi063.stdout:1/246: write d3/f9 [3676335,14617] 0 2023-12-12T11:51:51.017 INFO:tasks.workunit.client.0.smithi063.stdout:0/252: link d0/d7/d27/d19/f51 d0/d7/f55 0 2023-12-12T11:51:51.019 INFO:tasks.workunit.client.1.smithi093.stdout:6/628: sync 2023-12-12T11:51:51.019 INFO:tasks.workunit.client.1.smithi093.stdout:9/466: dwrite d1/d23/d6b/f8c [0,4194304] 0 2023-12-12T11:51:51.021 INFO:tasks.workunit.client.0.smithi063.stdout:8/368: mknod d4/de/d1e/c70 0 2023-12-12T11:51:51.026 INFO:tasks.workunit.client.1.smithi093.stdout:8/511: truncate d3/d73/f77 3286160 0 2023-12-12T11:51:51.037 INFO:tasks.workunit.client.0.smithi063.stdout:5/278: rename d7/d10/d2b/l32 to d7/d28/d43/d49/l4d 0 2023-12-12T11:51:51.038 INFO:tasks.workunit.client.1.smithi093.stdout:5/389: sync 2023-12-12T11:51:51.038 INFO:tasks.workunit.client.1.smithi093.stdout:5/390: chown d0/d7/d59/d35/d6a/f72 3 1 2023-12-12T11:51:51.040 INFO:tasks.workunit.client.1.smithi093.stdout:0/502: dwrite d5/dd/d14/d26/d58/d64/f97 [0,4194304] 0 2023-12-12T11:51:51.042 INFO:tasks.workunit.client.1.smithi093.stdout:4/677: symlink d0/d36/d40/ld5 0 2023-12-12T11:51:51.042 INFO:tasks.workunit.client.1.smithi093.stdout:7/448: sync 2023-12-12T11:51:51.066 INFO:tasks.workunit.client.0.smithi063.stdout:0/253: creat d0/d7/d27/d44/f56 x:0 0 0 2023-12-12T11:51:51.066 INFO:tasks.workunit.client.0.smithi063.stdout:0/254: fsync d0/d7/f47 0 2023-12-12T11:51:51.072 INFO:tasks.workunit.client.0.smithi063.stdout:8/369: creat d4/d55/d52/f71 x:0 0 0 2023-12-12T11:51:51.072 INFO:tasks.workunit.client.0.smithi063.stdout:8/370: write d4/de/d1e/f5c [882991,11430] 0 2023-12-12T11:51:51.073 INFO:tasks.workunit.client.0.smithi063.stdout:8/371: stat d4/d55/f34 0 2023-12-12T11:51:51.074 INFO:tasks.workunit.client.0.smithi063.stdout:7/242: write de/f4c [139081,102373] 0 2023-12-12T11:51:51.075 INFO:tasks.workunit.client.1.smithi093.stdout:8/512: dwrite d3/d1a/d1f/d29/d30/d58/f85 [0,4194304] 0 2023-12-12T11:51:51.076 INFO:tasks.workunit.client.0.smithi063.stdout:5/279: symlink d7/d10/d2b/d3c/d42/l4e 0 2023-12-12T11:51:51.076 INFO:tasks.workunit.client.0.smithi063.stdout:5/280: stat d7/f1a 0 2023-12-12T11:51:51.078 INFO:tasks.workunit.client.1.smithi093.stdout:6/629: mkdir d0/da/d14/d3a/dee 0 2023-12-12T11:51:51.078 INFO:tasks.workunit.client.1.smithi093.stdout:6/630: creat d0/da/d14/d9c/fef x:0 0 0 2023-12-12T11:51:51.078 INFO:tasks.workunit.client.1.smithi093.stdout:6/631: chown d0/da/f89 231125 1 2023-12-12T11:51:51.080 INFO:tasks.workunit.client.0.smithi063.stdout:0/255: symlink d0/d7/d27/d1f/l57 0 2023-12-12T11:51:51.080 INFO:tasks.workunit.client.1.smithi093.stdout:2/521: write d5/d14/f4f [864056,120534] 0 2023-12-12T11:51:51.081 INFO:tasks.workunit.client.1.smithi093.stdout:9/467: creat d1/d23/d24/fa1 x:0 0 0 2023-12-12T11:51:51.083 INFO:tasks.workunit.client.0.smithi063.stdout:8/372: symlink d4/de/d3b/l72 0 2023-12-12T11:51:51.083 INFO:tasks.workunit.client.0.smithi063.stdout:8/373: chown f3 1843054 1 2023-12-12T11:51:51.085 INFO:tasks.workunit.client.1.smithi093.stdout:5/391: mkdir d0/d7/d85 0 2023-12-12T11:51:51.085 INFO:tasks.workunit.client.1.smithi093.stdout:5/392: stat d0/d7/d59/d35/d6a/l71 0 2023-12-12T11:51:51.086 INFO:tasks.workunit.client.0.smithi063.stdout:1/247: dwrite d3/db/d16/d24/d30/f3d [0,4194304] 0 2023-12-12T11:51:51.086 INFO:tasks.workunit.client.1.smithi093.stdout:4/678: dwrite d0/f32 [0,4194304] 0 2023-12-12T11:51:51.087 INFO:tasks.workunit.client.0.smithi063.stdout:3/223: dwrite d4/df/f19 [0,4194304] 0 2023-12-12T11:51:51.089 INFO:tasks.workunit.client.1.smithi093.stdout:1/487: unlink d4/f52 0 2023-12-12T11:51:51.091 INFO:tasks.workunit.client.1.smithi093.stdout:2/522: dread d5/d14/d5e/f70 [0,4194304] 0 2023-12-12T11:51:51.091 INFO:tasks.workunit.client.1.smithi093.stdout:2/523: readlink d5/l5c 0 2023-12-12T11:51:51.091 INFO:tasks.workunit.client.1.smithi093.stdout:2/524: truncate d5/d46/d55/f8e 4629619 0 2023-12-12T11:51:51.092 INFO:tasks.workunit.client.0.smithi063.stdout:7/243: truncate de/f3c 1613145 0 2023-12-12T11:51:51.095 INFO:tasks.workunit.client.0.smithi063.stdout:5/281: rename d7/d28/f2f to d7/d28/f4f 0 2023-12-12T11:51:51.099 INFO:tasks.workunit.client.0.smithi063.stdout:0/256: unlink d0/d1a/f1c 0 2023-12-12T11:51:51.101 INFO:tasks.workunit.client.1.smithi093.stdout:0/503: mkdir d5/d21/d27/d3a/d9a 0 2023-12-12T11:51:51.101 INFO:tasks.workunit.client.1.smithi093.stdout:0/504: fsync d5/d21/f6b 0 2023-12-12T11:51:51.105 INFO:tasks.workunit.client.0.smithi063.stdout:1/248: dread d3/db/d12/f42 [0,4194304] 0 2023-12-12T11:51:51.112 INFO:tasks.workunit.client.1.smithi093.stdout:3/497: sync 2023-12-12T11:51:51.112 INFO:tasks.workunit.client.1.smithi093.stdout:3/498: write df/d36/d3d/d6f/f4b [1702308,48681] 0 2023-12-12T11:51:51.114 INFO:tasks.workunit.client.0.smithi063.stdout:3/224: mkdir d4/df/d1a/d48 0 2023-12-12T11:51:51.126 INFO:tasks.workunit.client.1.smithi093.stdout:5/393: dwrite d0/d7/d8/f5d [0,4194304] 0 2023-12-12T11:51:51.126 INFO:tasks.workunit.client.1.smithi093.stdout:8/513: symlink d3/d1a/d1f/d29/d30/d58/la3 0 2023-12-12T11:51:51.126 INFO:tasks.workunit.client.1.smithi093.stdout:8/514: chown d3/d1a/d1f/d29/d3a/d8f 3495 1 2023-12-12T11:51:51.131 INFO:tasks.workunit.client.1.smithi093.stdout:3/499: read df/d22/f23 [857332,114979] 0 2023-12-12T11:51:51.131 INFO:tasks.workunit.client.1.smithi093.stdout:3/500: readlink df/l20 0 2023-12-12T11:51:51.143 INFO:tasks.workunit.client.0.smithi063.stdout:5/282: mknod d7/d28/d43/d49/c50 0 2023-12-12T11:51:51.153 INFO:tasks.workunit.client.1.smithi093.stdout:1/488: dwrite d4/fa [0,4194304] 0 2023-12-12T11:51:51.154 INFO:tasks.workunit.client.0.smithi063.stdout:0/257: creat d0/d1a/d23/d34/f58 x:0 0 0 2023-12-12T11:51:51.154 INFO:tasks.workunit.client.0.smithi063.stdout:0/258: creat d0/d7/d27/d1f/f59 x:0 0 0 2023-12-12T11:51:51.160 INFO:tasks.workunit.client.0.smithi063.stdout:7/244: dwrite de/f1d [0,4194304] 0 2023-12-12T11:51:51.160 INFO:tasks.workunit.client.0.smithi063.stdout:7/245: read f8 [4155037,117043] 0 2023-12-12T11:51:51.160 INFO:tasks.workunit.client.0.smithi063.stdout:7/246: chown de/d33/l3d 3032 1 2023-12-12T11:51:51.161 INFO:tasks.workunit.client.0.smithi063.stdout:5/283: mknod d7/d28/c51 0 2023-12-12T11:51:51.161 INFO:tasks.workunit.client.0.smithi063.stdout:5/284: stat d7/d10/d2b/d3c 0 2023-12-12T11:51:51.161 INFO:tasks.workunit.client.0.smithi063.stdout:8/374: dwrite d4/d24/d38/d45/f6a [0,4194304] 0 2023-12-12T11:51:51.162 INFO:tasks.workunit.client.0.smithi063.stdout:8/375: fsync f3 0 2023-12-12T11:51:51.162 INFO:tasks.workunit.client.0.smithi063.stdout:8/376: write d4/de/d3b/d62/d6e/f6c [217028,33430] 0 2023-12-12T11:51:51.163 INFO:tasks.workunit.client.1.smithi093.stdout:9/468: fsync d1/d23/f80 0 2023-12-12T11:51:51.171 INFO:tasks.workunit.client.0.smithi063.stdout:0/259: creat d0/d1a/d23/d2e/f5a x:0 0 0 2023-12-12T11:51:51.181 INFO:tasks.workunit.client.0.smithi063.stdout:7/247: mkdir de/d22/d2b/d61 0 2023-12-12T11:51:51.185 INFO:tasks.workunit.client.1.smithi093.stdout:5/394: dwrite d0/d7/d59/d35/f58 [4194304,4194304] 0 2023-12-12T11:51:51.188 INFO:tasks.workunit.client.1.smithi093.stdout:2/525: mknod d5/d14/d2d/d96/dad/cb3 0 2023-12-12T11:51:51.188 INFO:tasks.workunit.client.1.smithi093.stdout:2/526: write d5/d14/d2d/d12/d44/f57 [269139,126951] 0 2023-12-12T11:51:51.194 INFO:tasks.workunit.client.0.smithi063.stdout:3/225: dwrite d4/df/f2c [0,4194304] 0 2023-12-12T11:51:51.194 INFO:tasks.workunit.client.0.smithi063.stdout:3/226: creat d4/d23/f49 x:0 0 0 2023-12-12T11:51:51.194 INFO:tasks.workunit.client.0.smithi063.stdout:1/249: dwrite d3/db/d12/f27 [0,4194304] 0 2023-12-12T11:51:51.203 INFO:tasks.workunit.client.1.smithi093.stdout:0/505: unlink d5/dd/c22 0 2023-12-12T11:51:51.209 INFO:tasks.workunit.client.0.smithi063.stdout:5/285: mknod d7/d10/c52 0 2023-12-12T11:51:51.209 INFO:tasks.workunit.client.0.smithi063.stdout:5/286: write d7/d10/f48 [189718,23834] 0 2023-12-12T11:51:51.218 INFO:tasks.workunit.client.0.smithi063.stdout:9/243: sync 2023-12-12T11:51:51.236 INFO:tasks.workunit.client.1.smithi093.stdout:7/449: rmdir da/d15/d19 39 2023-12-12T11:51:51.254 INFO:tasks.workunit.client.1.smithi093.stdout:2/527: dwrite d5/d14/d2d/d4c/d54/d67/f90 [0,4194304] 0 2023-12-12T11:51:51.266 INFO:tasks.workunit.client.0.smithi063.stdout:0/260: dwrite d0/d1a/d23/f54 [0,4194304] 0 2023-12-12T11:51:51.267 INFO:tasks.workunit.client.0.smithi063.stdout:7/248: dwrite de/d22/d2b/f2d [0,4194304] 0 2023-12-12T11:51:51.267 INFO:tasks.workunit.client.0.smithi063.stdout:7/249: fdatasync de/f19 0 2023-12-12T11:51:51.267 INFO:tasks.workunit.client.1.smithi093.stdout:6/632: getdents d0/d52/d6b 0 2023-12-12T11:51:51.268 INFO:tasks.workunit.client.0.smithi063.stdout:8/377: dwrite d4/de/d1e/f5c [0,4194304] 0 2023-12-12T11:51:51.270 INFO:tasks.workunit.client.0.smithi063.stdout:1/250: dwrite d3/db/d16/f2d [0,4194304] 0 2023-12-12T11:51:51.270 INFO:tasks.workunit.client.0.smithi063.stdout:1/251: truncate d3/f1a 5425935 0 2023-12-12T11:51:51.272 INFO:tasks.workunit.client.0.smithi063.stdout:5/287: truncate d7/d28/f3f 1056414 0 2023-12-12T11:51:51.278 INFO:tasks.workunit.client.0.smithi063.stdout:3/227: symlink d4/df/d1a/d1c/d34/l4a 0 2023-12-12T11:51:51.296 INFO:tasks.workunit.client.0.smithi063.stdout:7/250: creat de/d22/d2b/d61/f62 x:0 0 0 2023-12-12T11:51:51.296 INFO:tasks.workunit.client.0.smithi063.stdout:7/251: write de/d3f/f59 [509261,18325] 0 2023-12-12T11:51:51.296 INFO:tasks.workunit.client.0.smithi063.stdout:7/252: chown de/d39/d4b/l52 53 1 2023-12-12T11:51:51.297 INFO:tasks.workunit.client.0.smithi063.stdout:4/316: sync 2023-12-12T11:51:51.297 INFO:tasks.workunit.client.0.smithi063.stdout:6/292: sync 2023-12-12T11:51:51.298 INFO:tasks.workunit.client.1.smithi093.stdout:6/633: dwrite d0/da/d32/d39/d5b/f5d [0,4194304] 0 2023-12-12T11:51:51.298 INFO:tasks.workunit.client.0.smithi063.stdout:2/237: sync 2023-12-12T11:51:51.300 INFO:tasks.workunit.client.1.smithi093.stdout:9/469: dread d1/f4f [0,4194304] 0 2023-12-12T11:51:51.300 INFO:tasks.workunit.client.1.smithi093.stdout:9/470: truncate d1/d12/d1f/d32/f6a 485663 0 2023-12-12T11:51:51.301 INFO:tasks.workunit.client.0.smithi063.stdout:4/317: read d2/d48/d4f/f5e [309863,69164] 0 2023-12-12T11:51:51.301 INFO:tasks.workunit.client.0.smithi063.stdout:4/318: chown d2/d17/d41/c5a 935009 1 2023-12-12T11:51:51.301 INFO:tasks.workunit.client.0.smithi063.stdout:4/319: write d2/f10 [1804597,55668] 0 2023-12-12T11:51:51.301 INFO:tasks.workunit.client.0.smithi063.stdout:4/320: write d2/f56 [4773850,52370] 0 2023-12-12T11:51:51.302 INFO:tasks.workunit.client.1.smithi093.stdout:0/506: mkdir d5/d41/d77/d79/d9b 0 2023-12-12T11:51:51.308 INFO:tasks.workunit.client.1.smithi093.stdout:7/450: rename da/d15/f24 to da/d15/d19/f9d 0 2023-12-12T11:51:51.314 INFO:tasks.workunit.client.0.smithi063.stdout:8/378: truncate d4/de/d3b/d62/d36/f3a 692031 0 2023-12-12T11:51:51.314 INFO:tasks.workunit.client.0.smithi063.stdout:8/379: readlink d4/d24/d38/l47 0 2023-12-12T11:51:51.317 INFO:tasks.workunit.client.1.smithi093.stdout:2/528: mkdir d5/d14/d2d/d12/db4 0 2023-12-12T11:51:51.319 INFO:tasks.workunit.client.0.smithi063.stdout:6/293: write d9/f40 [3684299,61397] 0 2023-12-12T11:51:51.325 INFO:tasks.workunit.client.0.smithi063.stdout:0/261: dwrite d0/d7/f47 [4194304,4194304] 0 2023-12-12T11:51:51.327 INFO:tasks.workunit.client.0.smithi063.stdout:5/288: mknod d7/d10/c53 0 2023-12-12T11:51:51.329 INFO:tasks.workunit.client.1.smithi093.stdout:9/471: read d1/d12/d1f/d3d/d57/f5b [83286,83420] 0 2023-12-12T11:51:51.330 INFO:tasks.workunit.client.0.smithi063.stdout:9/244: creat d7/d15/d39/f47 x:0 0 0 2023-12-12T11:51:51.331 INFO:tasks.workunit.client.1.smithi093.stdout:8/515: rmdir d3/d1a/d1f/d29/d3a 39 2023-12-12T11:51:51.333 INFO:tasks.workunit.client.0.smithi063.stdout:8/380: read d4/d24/f31 [7311349,112846] 0 2023-12-12T11:51:51.337 INFO:tasks.workunit.client.1.smithi093.stdout:8/516: read d3/d8/fc [1141367,107201] 0 2023-12-12T11:51:51.338 INFO:tasks.workunit.client.1.smithi093.stdout:5/395: rmdir d0/d7/d36/d29/d44 39 2023-12-12T11:51:51.347 INFO:tasks.workunit.client.0.smithi063.stdout:2/238: rename d0/c2b to d0/c51 0 2023-12-12T11:51:51.348 INFO:tasks.workunit.client.0.smithi063.stdout:2/239: fsync d0/d1a/f1d 0 2023-12-12T11:51:51.350 INFO:tasks.workunit.client.0.smithi063.stdout:4/321: link d2/d8/l33 d2/l62 0 2023-12-12T11:51:51.350 INFO:tasks.workunit.client.0.smithi063.stdout:4/322: write d2/d47/f2d [2602923,74135] 0 2023-12-12T11:51:51.350 INFO:tasks.workunit.client.0.smithi063.stdout:4/323: stat d2/d17/d4e/l5d 0 2023-12-12T11:51:51.350 INFO:tasks.workunit.client.0.smithi063.stdout:4/324: readlink d2/d48/l55 0 2023-12-12T11:51:51.352 INFO:tasks.workunit.client.1.smithi093.stdout:7/451: dwrite da/d15/d19/f1e [0,4194304] 0 2023-12-12T11:51:51.352 INFO:tasks.workunit.client.1.smithi093.stdout:7/452: fsync da/d15/d2d/f51 0 2023-12-12T11:51:51.360 INFO:tasks.workunit.client.1.smithi093.stdout:0/507: creat d5/dd/d14/d8c/f9c x:0 0 0 2023-12-12T11:51:51.360 INFO:tasks.workunit.client.1.smithi093.stdout:0/508: fsync d5/dd/d14/d26/f8e 0 2023-12-12T11:51:51.360 INFO:tasks.workunit.client.1.smithi093.stdout:0/509: readlink d5/d21/l25 0 2023-12-12T11:51:51.360 INFO:tasks.workunit.client.1.smithi093.stdout:2/529: mkdir d5/d31/d86/db5 0 2023-12-12T11:51:51.361 INFO:tasks.workunit.client.1.smithi093.stdout:9/472: rmdir d1/d23/d24/d29/d43/d56 39 2023-12-12T11:51:51.361 INFO:tasks.workunit.client.1.smithi093.stdout:6/634: rename d0/da/d14/d3a/d95/fb4 to d0/d52/ff0 0 2023-12-12T11:51:51.361 INFO:tasks.workunit.client.1.smithi093.stdout:9/473: truncate d1/d12/d1f/d32/f6d 545591 0 2023-12-12T11:51:51.362 INFO:tasks.workunit.client.0.smithi063.stdout:4/325: dread d2/d17/d41/f5b [0,4194304] 0 2023-12-12T11:51:51.363 INFO:tasks.workunit.client.0.smithi063.stdout:4/326: write d2/f10 [4741309,71173] 0 2023-12-12T11:51:51.363 INFO:tasks.workunit.client.0.smithi063.stdout:0/262: symlink d0/d7/d27/d1f/l5b 0 2023-12-12T11:51:51.363 INFO:tasks.workunit.client.0.smithi063.stdout:0/263: write d0/d7/d27/d1f/f48 [747456,116668] 0 2023-12-12T11:51:51.364 INFO:tasks.workunit.client.1.smithi093.stdout:8/517: symlink d3/d1a/d1f/d29/la4 0 2023-12-12T11:51:51.364 INFO:tasks.workunit.client.1.smithi093.stdout:1/489: rmdir d4/d1a/d1b/d26/d82/d94 0 2023-12-12T11:51:51.365 INFO:tasks.workunit.client.1.smithi093.stdout:8/518: chown d3/d1a/d1f/d59/d69/f7f 1 1 2023-12-12T11:51:51.365 INFO:tasks.workunit.client.1.smithi093.stdout:8/519: write d3/d1a/d1f/d29/d3a/d40/f61 [1311145,35750] 0 2023-12-12T11:51:51.365 INFO:tasks.workunit.client.1.smithi093.stdout:8/520: readlink d3/lf 0 2023-12-12T11:51:51.365 INFO:tasks.workunit.client.0.smithi063.stdout:7/253: rmdir de/d34 39 2023-12-12T11:51:51.365 INFO:tasks.workunit.client.0.smithi063.stdout:7/254: truncate de/d34/f4f 60405 0 2023-12-12T11:51:51.365 INFO:tasks.workunit.client.0.smithi063.stdout:7/255: truncate de/f21 746873 0 2023-12-12T11:51:51.366 INFO:tasks.workunit.client.1.smithi093.stdout:5/396: creat d0/d7/d8/de/f86 x:0 0 0 2023-12-12T11:51:51.369 INFO:tasks.workunit.client.0.smithi063.stdout:4/327: mknod d2/d17/d41/c63 0 2023-12-12T11:51:51.370 INFO:tasks.workunit.client.1.smithi093.stdout:7/453: creat da/d8e/f9e x:0 0 0 2023-12-12T11:51:51.374 INFO:tasks.workunit.client.0.smithi063.stdout:6/294: getdents d9/d10/d2a 0 2023-12-12T11:51:51.374 INFO:tasks.workunit.client.0.smithi063.stdout:6/295: dread - d9/d10/f58 zero size 2023-12-12T11:51:51.375 INFO:tasks.workunit.client.0.smithi063.stdout:1/252: rename d3/db/d16/d17/d19 to d3/db/d16/d24/d4d 0 2023-12-12T11:51:51.376 INFO:tasks.workunit.client.1.smithi093.stdout:0/510: creat d5/d41/d77/d79/d9b/f9d x:0 0 0 2023-12-12T11:51:51.380 INFO:tasks.workunit.client.1.smithi093.stdout:2/530: symlink d5/d14/d2d/d12/d25/d7a/d7e/lb6 0 2023-12-12T11:51:51.380 INFO:tasks.workunit.client.0.smithi063.stdout:4/328: dread d2/d8/f37 [0,4194304] 0 2023-12-12T11:51:51.384 INFO:tasks.workunit.client.0.smithi063.stdout:0/264: link d0/l5 d0/d1a/d23/l5c 0 2023-12-12T11:51:51.387 INFO:tasks.workunit.client.1.smithi093.stdout:9/474: symlink d1/d12/d1f/d3d/d5c/la2 0 2023-12-12T11:51:51.389 INFO:tasks.workunit.client.0.smithi063.stdout:7/256: symlink de/d22/d2b/d4a/l63 0 2023-12-12T11:51:51.389 INFO:tasks.workunit.client.0.smithi063.stdout:7/257: creat de/d22/d2b/f64 x:0 0 0 2023-12-12T11:51:51.390 INFO:tasks.workunit.client.0.smithi063.stdout:7/258: write de/d34/d43/d45/d4e/f5d [176888,85573] 0 2023-12-12T11:51:51.394 INFO:tasks.workunit.client.1.smithi093.stdout:1/490: readlink d4/l5 0 2023-12-12T11:51:51.394 INFO:tasks.workunit.client.1.smithi093.stdout:1/491: truncate d4/d1c/d2a/f4b 4548892 0 2023-12-12T11:51:51.399 INFO:tasks.workunit.client.0.smithi063.stdout:6/296: mkdir d9/d2c/d61 0 2023-12-12T11:51:51.399 INFO:tasks.workunit.client.0.smithi063.stdout:6/297: chown f4 23556 1 2023-12-12T11:51:51.401 INFO:tasks.workunit.client.1.smithi093.stdout:7/454: link f0 da/d15/d2d/f9f 0 2023-12-12T11:51:51.407 INFO:tasks.workunit.client.1.smithi093.stdout:9/475: write d1/d12/f1c [934049,27520] 0 2023-12-12T11:51:51.411 INFO:tasks.workunit.client.0.smithi063.stdout:5/289: rename d7/d10/d35/f4c to d7/d10/d2b/d3c/d27/f54 0 2023-12-12T11:51:51.411 INFO:tasks.workunit.client.1.smithi093.stdout:1/492: mknod d4/d1a/d83/d9a/ca1 0 2023-12-12T11:51:51.411 INFO:tasks.workunit.client.1.smithi093.stdout:1/493: write d4/d1a/f5f [824221,45537] 0 2023-12-12T11:51:51.411 INFO:tasks.workunit.client.1.smithi093.stdout:1/494: chown d4/dc/f5c 74 1 2023-12-12T11:51:51.411 INFO:tasks.workunit.client.1.smithi093.stdout:1/495: write d4/d1a/d73/f97 [1521633,111359] 0 2023-12-12T11:51:51.413 INFO:tasks.workunit.client.1.smithi093.stdout:6/635: dwrite d0/da/d14/d38/fc3 [0,4194304] 0 2023-12-12T11:51:51.413 INFO:tasks.workunit.client.1.smithi093.stdout:6/636: dread - d0/da/d32/d39/d5b/fa2 zero size 2023-12-12T11:51:51.418 INFO:tasks.workunit.client.0.smithi063.stdout:1/253: dread f2 [4194304,4194304] 0 2023-12-12T11:51:51.420 INFO:tasks.workunit.client.1.smithi093.stdout:7/455: rename da/d15/d19/f5a to da/d8e/fa0 0 2023-12-12T11:51:51.420 INFO:tasks.workunit.client.1.smithi093.stdout:7/456: stat f0 0 2023-12-12T11:51:51.420 INFO:tasks.workunit.client.1.smithi093.stdout:7/457: read da/fb [2384889,101045] 0 2023-12-12T11:51:51.420 INFO:tasks.workunit.client.1.smithi093.stdout:7/458: getdents da/de/d81 0 2023-12-12T11:51:51.425 INFO:tasks.workunit.client.0.smithi063.stdout:0/265: rmdir d0/d1a/d23/d34/d42 39 2023-12-12T11:51:51.425 INFO:tasks.workunit.client.0.smithi063.stdout:5/290: dread d7/d28/f4f [0,4194304] 0 2023-12-12T11:51:51.433 INFO:tasks.workunit.client.1.smithi093.stdout:9/476: mkdir d1/d23/d24/d29/da3 0 2023-12-12T11:51:51.433 INFO:tasks.workunit.client.1.smithi093.stdout:9/477: stat d1/d12/d1f/d3d/d57/f67 0 2023-12-12T11:51:51.434 INFO:tasks.workunit.client.1.smithi093.stdout:5/397: dwrite d0/d7/d59/d48/f81 [0,4194304] 0 2023-12-12T11:51:51.435 INFO:tasks.workunit.client.0.smithi063.stdout:8/381: dwrite d4/d24/f31 [4194304,4194304] 0 2023-12-12T11:51:51.435 INFO:tasks.workunit.client.0.smithi063.stdout:8/382: readlink d4/de/d1e/l1f 0 2023-12-12T11:51:51.435 INFO:tasks.workunit.client.0.smithi063.stdout:7/259: rename de/d22/d2b/d4a/d58 to de/d22/d2b/d4a/d65 0 2023-12-12T11:51:51.435 INFO:tasks.workunit.client.0.smithi063.stdout:7/260: read - de/d33/f5c zero size 2023-12-12T11:51:51.446 INFO:tasks.workunit.client.0.smithi063.stdout:5/291: dread d7/d28/f4f [0,4194304] 0 2023-12-12T11:51:51.448 INFO:tasks.workunit.client.1.smithi093.stdout:1/496: creat d4/dc/d7a/d9c/fa2 x:0 0 0 2023-12-12T11:51:51.449 INFO:tasks.workunit.client.0.smithi063.stdout:4/329: dwrite d2/d17/d4e/f51 [0,4194304] 0 2023-12-12T11:51:51.455 INFO:tasks.workunit.client.0.smithi063.stdout:1/254: write d3/db/d16/f2b [2680232,122237] 0 2023-12-12T11:51:51.456 INFO:tasks.workunit.client.0.smithi063.stdout:2/240: dwrite d0/d1a/d48/f30 [0,4194304] 0 2023-12-12T11:51:51.457 INFO:tasks.workunit.client.1.smithi093.stdout:8/521: dwrite d3/d8/fc [0,4194304] 0 2023-12-12T11:51:51.457 INFO:tasks.workunit.client.1.smithi093.stdout:8/522: creat d3/d1a/d1f/d59/d69/fa5 x:0 0 0 2023-12-12T11:51:51.457 INFO:tasks.workunit.client.1.smithi093.stdout:8/523: truncate d3/d1a/d1f/f5a 636159 0 2023-12-12T11:51:51.458 INFO:tasks.workunit.client.1.smithi093.stdout:8/524: getdents d3/d1a/d1f/d50 0 2023-12-12T11:51:51.461 INFO:tasks.workunit.client.1.smithi093.stdout:3/501: sync 2023-12-12T11:51:51.461 INFO:tasks.workunit.client.1.smithi093.stdout:4/679: sync 2023-12-12T11:51:51.464 INFO:tasks.workunit.client.1.smithi093.stdout:2/531: dwrite d5/d14/d2d/d12/f99 [4194304,4194304] 0 2023-12-12T11:51:51.464 INFO:tasks.workunit.client.1.smithi093.stdout:2/532: readlink d5/d14/d27/l50 0 2023-12-12T11:51:51.465 INFO:tasks.workunit.client.1.smithi093.stdout:2/533: write d5/d14/d2d/d4c/d54/d67/d69/f97 [407240,30671] 0 2023-12-12T11:51:51.469 INFO:tasks.workunit.client.1.smithi093.stdout:1/497: dread d4/fa [0,4194304] 0 2023-12-12T11:51:51.469 INFO:tasks.workunit.client.1.smithi093.stdout:1/498: write d4/d1a/d73/f95 [259202,30067] 0 2023-12-12T11:51:51.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:51 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:51:51.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:51 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:51:51.476 INFO:tasks.workunit.client.0.smithi063.stdout:6/298: link d9/d2c/c49 d9/d10/d25/c62 0 2023-12-12T11:51:51.477 INFO:tasks.workunit.client.0.smithi063.stdout:6/299: fsync d9/d2c/f54 0 2023-12-12T11:51:51.477 INFO:tasks.workunit.client.0.smithi063.stdout:6/300: fdatasync d9/f40 0 2023-12-12T11:51:51.481 INFO:tasks.workunit.client.0.smithi063.stdout:7/261: dread de/f19 [0,4194304] 0 2023-12-12T11:51:51.481 INFO:tasks.workunit.client.0.smithi063.stdout:7/262: write de/f21 [830040,75700] 0 2023-12-12T11:51:51.481 INFO:tasks.workunit.client.0.smithi063.stdout:7/263: write de/f3c [2146109,118367] 0 2023-12-12T11:51:51.482 INFO:tasks.workunit.client.0.smithi063.stdout:9/245: rename d7/d15/f43 to d7/d11/d12/d30/f48 0 2023-12-12T11:51:51.489 INFO:tasks.workunit.client.0.smithi063.stdout:8/383: creat d4/de/d3b/d62/d36/f73 x:0 0 0 2023-12-12T11:51:51.495 INFO:tasks.workunit.client.0.smithi063.stdout:4/330: mknod d2/d47/c64 0 2023-12-12T11:51:51.497 INFO:tasks.workunit.client.1.smithi093.stdout:6/637: mkdir d0/df1 0 2023-12-12T11:51:51.502 INFO:tasks.workunit.client.1.smithi093.stdout:4/680: dwrite d0/d87/fc6 [0,4194304] 0 2023-12-12T11:51:51.505 INFO:tasks.workunit.client.1.smithi093.stdout:7/459: rename l2 to da/la1 0 2023-12-12T11:51:51.505 INFO:tasks.workunit.client.0.smithi063.stdout:1/255: symlink d3/db/d16/d17/d4b/l4e 0 2023-12-12T11:51:51.505 INFO:tasks.workunit.client.0.smithi063.stdout:5/292: dwrite d7/f29 [0,4194304] 0 2023-12-12T11:51:51.506 INFO:tasks.workunit.client.0.smithi063.stdout:8/384: dread f1 [0,4194304] 0 2023-12-12T11:51:51.508 INFO:tasks.workunit.client.1.smithi093.stdout:9/478: symlink d1/d12/d1f/d32/d42/la4 0 2023-12-12T11:51:51.510 INFO:tasks.workunit.client.0.smithi063.stdout:2/241: link d0/d1a/d1e/l36 d0/d1a/d26/l52 0 2023-12-12T11:51:51.510 INFO:tasks.workunit.client.0.smithi063.stdout:2/242: dread - d0/d1a/d48/f3d zero size 2023-12-12T11:51:51.511 INFO:tasks.workunit.client.1.smithi093.stdout:2/534: dwrite d5/d14/d2d/d12/d44/f57 [0,4194304] 0 2023-12-12T11:51:51.516 INFO:tasks.workunit.client.1.smithi093.stdout:6/638: dread d0/da/f89 [4194304,4194304] 0 2023-12-12T11:51:51.525 INFO:tasks.workunit.client.1.smithi093.stdout:8/525: unlink d3/d1a/d1f/f5a 0 2023-12-12T11:51:51.525 INFO:tasks.workunit.client.1.smithi093.stdout:8/526: read d3/d1a/d1f/d29/d3a/d68/d8a/f94 [2850639,122570] 0 2023-12-12T11:51:51.532 INFO:tasks.workunit.client.0.smithi063.stdout:6/301: rename d9/f32 to d9/d10/d5c/d5e/f63 0 2023-12-12T11:51:51.533 INFO:tasks.workunit.client.0.smithi063.stdout:6/302: chown d9/f3b 34 1 2023-12-12T11:51:51.533 INFO:tasks.workunit.client.1.smithi093.stdout:3/502: creat df/d36/d3d/d42/d9d/fa4 x:0 0 0 2023-12-12T11:51:51.537 INFO:tasks.workunit.client.0.smithi063.stdout:9/246: mknod d7/d11/c49 0 2023-12-12T11:51:51.537 INFO:tasks.workunit.client.0.smithi063.stdout:9/247: stat f6 0 2023-12-12T11:51:51.537 INFO:tasks.workunit.client.0.smithi063.stdout:9/248: chown d7/d20/d45/d46 139358828 1 2023-12-12T11:51:51.541 INFO:tasks.workunit.client.0.smithi063.stdout:4/331: rename d2/d17/d4e/l5d to d2/d17/d4e/l65 0 2023-12-12T11:51:51.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:51 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:51:51.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:51 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:51:51.545 INFO:tasks.workunit.client.1.smithi093.stdout:1/499: symlink d4/d1c/d2a/la3 0 2023-12-12T11:51:51.547 INFO:tasks.workunit.client.0.smithi063.stdout:5/293: write d7/f15 [3345250,109613] 0 2023-12-12T11:51:51.547 INFO:tasks.workunit.client.0.smithi063.stdout:5/294: stat d7/d10/f1b 0 2023-12-12T11:51:51.550 INFO:tasks.workunit.client.0.smithi063.stdout:8/385: link d4/de/c54 d4/de/d3b/d62/d6e/c74 0 2023-12-12T11:51:51.556 INFO:tasks.workunit.client.0.smithi063.stdout:2/243: link d0/ld d0/d1a/d26/l53 0 2023-12-12T11:51:51.556 INFO:tasks.workunit.client.0.smithi063.stdout:2/244: stat d0/f33 0 2023-12-12T11:51:51.558 INFO:tasks.workunit.client.1.smithi093.stdout:4/681: creat d0/d36/d61/fd6 x:0 0 0 2023-12-12T11:51:51.559 INFO:tasks.workunit.client.1.smithi093.stdout:4/682: fdatasync d0/d36/f60 0 2023-12-12T11:51:51.560 INFO:tasks.workunit.client.0.smithi063.stdout:7/264: mkdir de/d22/d66 0 2023-12-12T11:51:51.565 INFO:tasks.workunit.client.1.smithi093.stdout:5/398: rename d0/d7/d59/d62/d77 to d0/d7/d36/d87 0 2023-12-12T11:51:51.566 INFO:tasks.workunit.client.1.smithi093.stdout:7/460: symlink da/de/d46/d4f/la2 0 2023-12-12T11:51:51.570 INFO:tasks.workunit.client.0.smithi063.stdout:9/249: chown d7/d15/c1b 162943 1 2023-12-12T11:51:51.571 INFO:tasks.workunit.client.0.smithi063.stdout:1/256: dwrite d3/db/fe [0,4194304] 0 2023-12-12T11:51:51.574 INFO:tasks.workunit.client.0.smithi063.stdout:4/332: creat d2/d47/f66 x:0 0 0 2023-12-12T11:51:51.574 INFO:tasks.workunit.client.1.smithi093.stdout:0/511: sync 2023-12-12T11:51:51.576 INFO:tasks.workunit.client.1.smithi093.stdout:2/535: creat d5/d14/d2d/d8b/da2/fb7 x:0 0 0 2023-12-12T11:51:51.579 INFO:tasks.workunit.client.0.smithi063.stdout:5/295: link d7/d10/d2b/d3c/d27/f54 d7/d10/d2b/f55 0 2023-12-12T11:51:51.580 INFO:tasks.workunit.client.1.smithi093.stdout:6/639: symlink d0/da/d32/d39/d5b/lf2 0 2023-12-12T11:51:51.580 INFO:tasks.workunit.client.0.smithi063.stdout:2/245: truncate d0/d1a/d1e/f35 841768 0 2023-12-12T11:51:51.582 INFO:tasks.workunit.client.0.smithi063.stdout:7/265: unlink de/d3f/c50 0 2023-12-12T11:51:51.584 INFO:tasks.workunit.client.1.smithi093.stdout:0/512: dread d5/dd/d14/d26/d58/f8a [0,4194304] 0 2023-12-12T11:51:51.585 INFO:tasks.workunit.client.0.smithi063.stdout:9/250: creat d7/d11/d12/f4a x:0 0 0 2023-12-12T11:51:51.586 INFO:tasks.workunit.client.1.smithi093.stdout:4/683: link d0/d36/d49/c65 d0/d31/d89/da1/cd7 0 2023-12-12T11:51:51.587 INFO:tasks.workunit.client.1.smithi093.stdout:8/527: rename d3/c4f to d3/d1a/d1f/d59/d6c/ca6 0 2023-12-12T11:51:51.591 INFO:tasks.workunit.client.1.smithi093.stdout:5/399: mknod d0/d7/d36/d87/c88 0 2023-12-12T11:51:51.592 INFO:tasks.workunit.client.1.smithi093.stdout:5/400: creat d0/d7/d59/d48/f89 x:0 0 0 2023-12-12T11:51:51.592 INFO:tasks.workunit.client.1.smithi093.stdout:1/500: dwrite d4/dc/f5c [0,4194304] 0 2023-12-12T11:51:51.593 INFO:tasks.workunit.client.1.smithi093.stdout:7/461: symlink da/d2e/d89/la3 0 2023-12-12T11:51:51.594 INFO:tasks.workunit.client.0.smithi063.stdout:1/257: mkdir d3/db/d16/d4f 0 2023-12-12T11:51:51.594 INFO:tasks.workunit.client.1.smithi093.stdout:2/536: getdents d5/d14/d2d/d96/dad 0 2023-12-12T11:51:51.594 INFO:tasks.workunit.client.1.smithi093.stdout:9/479: read d1/d23/f40 [136550,37248] 0 2023-12-12T11:51:51.598 INFO:tasks.workunit.client.1.smithi093.stdout:6/640: mkdir d0/da/d32/d39/df3 0 2023-12-12T11:51:51.598 INFO:tasks.workunit.client.1.smithi093.stdout:6/641: dread - d0/da/d32/dd3/fcc zero size 2023-12-12T11:51:51.598 INFO:tasks.workunit.client.1.smithi093.stdout:6/642: readlink d0/da/d14/d21/lb1 0 2023-12-12T11:51:51.602 INFO:tasks.workunit.client.1.smithi093.stdout:0/513: dread d5/d21/d27/f5a [0,4194304] 0 2023-12-12T11:51:51.605 INFO:tasks.workunit.client.0.smithi063.stdout:5/296: getdents d7/d10/d2b/d3c 0 2023-12-12T11:51:51.605 INFO:tasks.workunit.client.0.smithi063.stdout:5/297: fdatasync d7/d28/f47 0 2023-12-12T11:51:51.606 INFO:tasks.workunit.client.0.smithi063.stdout:7/266: symlink de/d22/d2b/l67 0 2023-12-12T11:51:51.606 INFO:tasks.workunit.client.0.smithi063.stdout:7/267: chown de/l36 3 1 2023-12-12T11:51:51.610 INFO:tasks.workunit.client.1.smithi093.stdout:8/528: rename d3/d1a/d1f/d29/d3a/d40/l49 to d3/d1a/d1f/d29/d3a/la7 0 2023-12-12T11:51:51.610 INFO:tasks.workunit.client.0.smithi063.stdout:9/251: mkdir d7/d11/d4b 0 2023-12-12T11:51:51.610 INFO:tasks.workunit.client.1.smithi093.stdout:8/529: write d3/d1a/d1f/d29/d30/d58/f67 [676684,80020] 0 2023-12-12T11:51:51.612 INFO:tasks.workunit.client.1.smithi093.stdout:5/401: symlink d0/d7/d36/l8a 0 2023-12-12T11:51:51.616 INFO:tasks.workunit.client.0.smithi063.stdout:3/228: sync 2023-12-12T11:51:51.616 INFO:tasks.workunit.client.0.smithi063.stdout:3/229: readlink d4/df/d1a/l36 0 2023-12-12T11:51:51.616 INFO:tasks.workunit.client.0.smithi063.stdout:3/230: readlink d4/la 0 2023-12-12T11:51:51.616 INFO:tasks.workunit.client.0.smithi063.stdout:3/231: stat d4/df/f19 0 2023-12-12T11:51:51.616 INFO:tasks.workunit.client.0.smithi063.stdout:3/232: creat d4/d23/f4b x:0 0 0 2023-12-12T11:51:51.618 INFO:tasks.workunit.client.0.smithi063.stdout:8/386: dwrite d4/de/d11/f14 [0,4194304] 0 2023-12-12T11:51:51.618 INFO:tasks.workunit.client.0.smithi063.stdout:8/387: stat d4/de/f41 0 2023-12-12T11:51:51.618 INFO:tasks.workunit.client.0.smithi063.stdout:6/303: dwrite d9/d10/f52 [0,4194304] 0 2023-12-12T11:51:51.618 INFO:tasks.workunit.client.0.smithi063.stdout:6/304: chown d9/d10/f58 928282617 1 2023-12-12T11:51:51.618 INFO:tasks.workunit.client.0.smithi063.stdout:7/268: mkdir de/d34/d68 0 2023-12-12T11:51:51.621 INFO:tasks.workunit.client.1.smithi093.stdout:1/501: symlink d4/d1c/la4 0 2023-12-12T11:51:51.621 INFO:tasks.workunit.client.1.smithi093.stdout:1/502: readlink d4/d1a/d1b/d26/d82/l93 0 2023-12-12T11:51:51.624 INFO:tasks.workunit.client.0.smithi063.stdout:4/333: dread d2/d17/d4e/f51 [0,4194304] 0 2023-12-12T11:51:51.625 INFO:tasks.workunit.client.0.smithi063.stdout:9/252: read d7/d15/f2e [1197051,111404] 0 2023-12-12T11:51:51.629 INFO:tasks.workunit.client.1.smithi093.stdout:2/537: truncate d5/f6e 740048 0 2023-12-12T11:51:51.632 INFO:tasks.workunit.client.1.smithi093.stdout:4/684: dwrite d0/d87/d79/d7f/fb1 [0,4194304] 0 2023-12-12T11:51:51.638 INFO:tasks.workunit.client.1.smithi093.stdout:5/402: dread d0/f5 [0,4194304] 0 2023-12-12T11:51:51.644 INFO:tasks.workunit.client.1.smithi093.stdout:9/480: creat d1/d23/d24/d29/d43/d56/d85/fa5 x:0 0 0 2023-12-12T11:51:51.649 INFO:tasks.workunit.client.0.smithi063.stdout:3/233: mkdir d4/df/d1a/d3d/d4c 0 2023-12-12T11:51:51.649 INFO:tasks.workunit.client.1.smithi093.stdout:7/462: dwrite da/de/f3b [0,4194304] 0 2023-12-12T11:51:51.653 INFO:tasks.workunit.client.1.smithi093.stdout:6/643: link d0/d52/d7e/d42/f45 d0/da/d14/d38/d69/ff4 0 2023-12-12T11:51:51.653 INFO:tasks.workunit.client.1.smithi093.stdout:6/644: stat d0/da/d32/d9e/d4d/de9/fed 0 2023-12-12T11:51:51.656 INFO:tasks.workunit.client.1.smithi093.stdout:0/514: rename d5/d41/f6d to d5/d41/d77/d79/d9b/f9e 0 2023-12-12T11:51:51.658 INFO:tasks.workunit.client.1.smithi093.stdout:3/503: write df/d36/d3d/d59/f64 [235394,17555] 0 2023-12-12T11:51:51.658 INFO:tasks.workunit.client.1.smithi093.stdout:8/530: mknod d3/d8/d88/ca8 0 2023-12-12T11:51:51.659 INFO:tasks.workunit.client.0.smithi063.stdout:8/388: symlink d4/de/d3b/d62/d36/d57/l75 0 2023-12-12T11:51:51.660 INFO:tasks.workunit.client.0.smithi063.stdout:2/246: dwrite d0/f6 [4194304,4194304] 0 2023-12-12T11:51:51.660 INFO:tasks.workunit.client.0.smithi063.stdout:2/247: chown d0/l47 19021 1 2023-12-12T11:51:51.660 INFO:tasks.workunit.client.0.smithi063.stdout:2/248: stat d0/d41 0 2023-12-12T11:51:51.661 INFO:tasks.workunit.client.1.smithi093.stdout:9/481: write d1/f94 [3656446,110138] 0 2023-12-12T11:51:51.661 INFO:tasks.workunit.client.1.smithi093.stdout:9/482: chown d1/c3c 211704889 1 2023-12-12T11:51:51.661 INFO:tasks.workunit.client.1.smithi093.stdout:9/483: creat d1/d23/d6b/fa6 x:0 0 0 2023-12-12T11:51:51.663 INFO:tasks.workunit.client.0.smithi063.stdout:6/305: truncate d9/d10/f1e 166101 0 2023-12-12T11:51:51.664 INFO:tasks.workunit.client.1.smithi093.stdout:5/403: dread d0/d7/d8/f5d [0,4194304] 0 2023-12-12T11:51:51.667 INFO:tasks.workunit.client.1.smithi093.stdout:2/538: creat d5/d46/d61/fb8 x:0 0 0 2023-12-12T11:51:51.668 INFO:tasks.workunit.client.1.smithi093.stdout:6/645: dread d0/d52/d7e/f58 [0,4194304] 0 2023-12-12T11:51:51.668 INFO:tasks.workunit.client.0.smithi063.stdout:7/269: symlink de/d33/d41/d44/l69 0 2023-12-12T11:51:51.678 INFO:tasks.workunit.client.0.smithi063.stdout:4/334: link l1 d2/d48/d4f/l67 0 2023-12-12T11:51:51.682 INFO:tasks.workunit.client.1.smithi093.stdout:0/515: dread d5/d21/d27/d3a/f48 [0,4194304] 0 2023-12-12T11:51:51.683 INFO:tasks.workunit.client.0.smithi063.stdout:9/253: write d7/f14 [3675375,65119] 0 2023-12-12T11:51:51.683 INFO:tasks.workunit.client.0.smithi063.stdout:9/254: creat d7/d11/f4c x:0 0 0 2023-12-12T11:51:51.683 INFO:tasks.workunit.client.0.smithi063.stdout:9/255: stat d7/d20/d45 0 2023-12-12T11:51:51.684 INFO:tasks.workunit.client.0.smithi063.stdout:9/256: fdatasync f0 0 2023-12-12T11:51:51.684 INFO:tasks.workunit.client.0.smithi063.stdout:0/266: sync 2023-12-12T11:51:51.687 INFO:tasks.workunit.client.1.smithi093.stdout:3/504: dread df/d36/f41 [0,4194304] 0 2023-12-12T11:51:51.688 INFO:tasks.workunit.client.0.smithi063.stdout:3/234: symlink d4/df/d1a/d48/l4d 0 2023-12-12T11:51:51.689 INFO:tasks.workunit.client.0.smithi063.stdout:4/335: dread d2/d8/f43 [0,4194304] 0 2023-12-12T11:51:51.689 INFO:tasks.workunit.client.0.smithi063.stdout:4/336: chown d2/d17 649608 1 2023-12-12T11:51:51.689 INFO:tasks.workunit.client.0.smithi063.stdout:4/337: readlink d2/d17/d41/l42 0 2023-12-12T11:51:51.689 INFO:tasks.workunit.client.0.smithi063.stdout:4/338: creat d2/d48/d4f/f68 x:0 0 0 2023-12-12T11:51:51.693 INFO:tasks.workunit.client.1.smithi093.stdout:4/685: creat d0/d87/d79/d96/fd8 x:0 0 0 2023-12-12T11:51:51.693 INFO:tasks.workunit.client.1.smithi093.stdout:4/686: read - d0/fa3 zero size 2023-12-12T11:51:51.693 INFO:tasks.workunit.client.1.smithi093.stdout:4/687: write d0/d87/f8f [46404,27181] 0 2023-12-12T11:51:51.698 INFO:tasks.workunit.client.1.smithi093.stdout:3/505: dread df/d22/d49/d69/f6a [0,4194304] 0 2023-12-12T11:51:51.708 INFO:tasks.workunit.client.1.smithi093.stdout:7/463: link da/d15/d19/f1e da/d15/d19/d4c/d6d/fa4 0 2023-12-12T11:51:51.708 INFO:tasks.workunit.client.1.smithi093.stdout:7/464: stat da/de/d81 0 2023-12-12T11:51:51.711 INFO:tasks.workunit.client.0.smithi063.stdout:8/389: unlink d4/de/d3b/d62/d6e/f6c 0 2023-12-12T11:51:51.711 INFO:tasks.workunit.client.0.smithi063.stdout:2/249: symlink d0/d41/l54 0 2023-12-12T11:51:51.711 INFO:tasks.workunit.client.0.smithi063.stdout:2/250: dread - d0/f43 zero size 2023-12-12T11:51:51.711 INFO:tasks.workunit.client.0.smithi063.stdout:8/390: getdents d4/de/d11/d58/d65 0 2023-12-12T11:51:51.711 INFO:tasks.workunit.client.0.smithi063.stdout:8/391: readlink d4/d24/d38/l50 0 2023-12-12T11:51:51.712 INFO:tasks.workunit.client.0.smithi063.stdout:7/270: rmdir de/d39/d4b 39 2023-12-12T11:51:51.713 INFO:tasks.workunit.client.0.smithi063.stdout:6/306: creat d9/d2c/d61/f64 x:0 0 0 2023-12-12T11:51:51.714 INFO:tasks.workunit.client.0.smithi063.stdout:1/258: dwrite d3/db/d12/f42 [0,4194304] 0 2023-12-12T11:51:51.714 INFO:tasks.workunit.client.0.smithi063.stdout:1/259: truncate d3/db/d16/f2d 5089540 0 2023-12-12T11:51:51.721 INFO:tasks.workunit.client.0.smithi063.stdout:4/339: dread d2/f40 [0,4194304] 0 2023-12-12T11:51:51.721 INFO:tasks.workunit.client.0.smithi063.stdout:4/340: truncate d2/d17/d41/f52 442276 0 2023-12-12T11:51:51.725 INFO:tasks.workunit.client.0.smithi063.stdout:5/298: dwrite d7/d10/d2b/f55 [0,4194304] 0 2023-12-12T11:51:51.725 INFO:tasks.workunit.client.0.smithi063.stdout:5/299: readlink d7/d10/d2b/d3c/l37 0 2023-12-12T11:51:51.725 INFO:tasks.workunit.client.0.smithi063.stdout:9/257: symlink d7/d11/d12/d30/d3e/l4d 0 2023-12-12T11:51:51.743 INFO:tasks.workunit.client.1.smithi093.stdout:8/531: dwrite d3/f91 [4194304,4194304] 0 2023-12-12T11:51:51.746 INFO:tasks.workunit.client.0.smithi063.stdout:0/267: creat d0/d1a/d23/d34/d42/f5d x:0 0 0 2023-12-12T11:51:51.773 INFO:tasks.workunit.client.0.smithi063.stdout:4/341: dwrite d2/d47/f2d [4194304,4194304] 0 2023-12-12T11:51:51.777 INFO:tasks.workunit.client.0.smithi063.stdout:2/251: creat d0/d1a/d1e/f55 x:0 0 0 2023-12-12T11:51:51.778 INFO:tasks.workunit.client.0.smithi063.stdout:3/235: dwrite d4/f25 [0,4194304] 0 2023-12-12T11:51:51.779 INFO:tasks.workunit.client.1.smithi093.stdout:9/484: dread - d1/d23/f52 zero size 2023-12-12T11:51:51.786 INFO:tasks.workunit.client.0.smithi063.stdout:8/392: mkdir d4/de/d3b/d62/d6e/d76 0 2023-12-12T11:51:51.789 INFO:tasks.workunit.client.1.smithi093.stdout:5/404: unlink d0/d7/d8/de/ld 0 2023-12-12T11:51:51.789 INFO:tasks.workunit.client.1.smithi093.stdout:5/405: write d0/d7/d59/f60 [4313663,13719] 0 2023-12-12T11:51:51.790 INFO:tasks.workunit.client.1.smithi093.stdout:5/406: chown d0/d7/d59/d48/f89 314 1 2023-12-12T11:51:51.794 INFO:tasks.workunit.client.0.smithi063.stdout:7/271: unlink l6 0 2023-12-12T11:51:51.795 INFO:tasks.workunit.client.1.smithi093.stdout:2/539: mkdir d5/d14/d2d/d4c/d54/db9 0 2023-12-12T11:51:51.796 INFO:tasks.workunit.client.1.smithi093.stdout:2/540: chown d5/d14/d2d/d8b/l9f 4641844 1 2023-12-12T11:51:51.797 INFO:tasks.workunit.client.1.smithi093.stdout:5/407: dread d0/d7/d8/f5d [0,4194304] 0 2023-12-12T11:51:51.798 INFO:tasks.workunit.client.1.smithi093.stdout:5/408: fdatasync d0/d7/d36/d68/f7a 0 2023-12-12T11:51:51.798 INFO:tasks.workunit.client.1.smithi093.stdout:5/409: chown d0/d7/d36/d29/f30 113 1 2023-12-12T11:51:51.798 INFO:tasks.workunit.client.1.smithi093.stdout:5/410: creat d0/d7/d8/f8b x:0 0 0 2023-12-12T11:51:51.799 INFO:tasks.workunit.client.0.smithi063.stdout:6/307: dwrite d9/f3b [0,4194304] 0 2023-12-12T11:51:51.799 INFO:tasks.workunit.client.0.smithi063.stdout:6/308: fdatasync d9/d10/d5c/d5e/f63 0 2023-12-12T11:51:51.799 INFO:tasks.workunit.client.0.smithi063.stdout:6/309: chown d9/f40 1 1 2023-12-12T11:51:51.799 INFO:tasks.workunit.client.0.smithi063.stdout:6/310: fdatasync d9/d10/f1b 0 2023-12-12T11:51:51.802 INFO:tasks.workunit.client.1.smithi093.stdout:6/646: rename d0/da/d14/d9c/f77 to d0/da/d32/d9e/ff5 0 2023-12-12T11:51:51.802 INFO:tasks.workunit.client.1.smithi093.stdout:6/647: read - d0/d52/ff0 zero size 2023-12-12T11:51:51.803 INFO:tasks.workunit.client.1.smithi093.stdout:1/503: dwrite d4/fd [0,4194304] 0 2023-12-12T11:51:51.808 INFO:tasks.workunit.client.0.smithi063.stdout:1/260: link d3/db/d16/d24/d4d/f2c d3/db/d12/f50 0 2023-12-12T11:51:51.808 INFO:tasks.workunit.client.0.smithi063.stdout:1/261: chown d3/db/f20 613080 1 2023-12-12T11:51:51.810 INFO:tasks.workunit.client.0.smithi063.stdout:5/300: dwrite d7/de/f30 [0,4194304] 0 2023-12-12T11:51:51.811 INFO:tasks.workunit.client.0.smithi063.stdout:5/301: write d7/d10/d2b/d3c/f2d [949846,126508] 0 2023-12-12T11:51:51.815 INFO:tasks.workunit.client.1.smithi093.stdout:0/516: symlink d5/d21/d27/l9f 0 2023-12-12T11:51:51.816 INFO:tasks.workunit.client.1.smithi093.stdout:1/504: dread d4/d1a/d73/f60 [0,4194304] 0 2023-12-12T11:51:51.816 INFO:tasks.workunit.client.1.smithi093.stdout:1/505: write d4/d1c/d2a/f6e [789807,22680] 0 2023-12-12T11:51:51.817 INFO:tasks.workunit.client.1.smithi093.stdout:4/688: mknod d0/d87/d79/d96/dcc/cd9 0 2023-12-12T11:51:51.817 INFO:tasks.workunit.client.1.smithi093.stdout:4/689: chown d0/d31/f3b 60 1 2023-12-12T11:51:51.818 INFO:tasks.workunit.client.1.smithi093.stdout:4/690: fdatasync d0/f91 0 2023-12-12T11:51:51.825 INFO:tasks.workunit.client.1.smithi093.stdout:3/506: mkdir df/d36/d3d/d42/d8e/da5 0 2023-12-12T11:51:51.825 INFO:tasks.workunit.client.1.smithi093.stdout:3/507: truncate df/d22/d49/d69/d6e/f94 616959 0 2023-12-12T11:51:51.829 INFO:tasks.workunit.client.0.smithi063.stdout:9/258: mkdir d7/d20/d3f/d40/d4e 0 2023-12-12T11:51:51.830 INFO:tasks.workunit.client.1.smithi093.stdout:7/465: link da/d2e/f79 da/d15/d2d/d2f/fa5 0 2023-12-12T11:51:51.840 INFO:tasks.workunit.client.1.smithi093.stdout:3/508: write df/d36/f41 [2677439,76667] 0 2023-12-12T11:51:51.842 INFO:tasks.workunit.client.1.smithi093.stdout:7/466: dread f0 [0,4194304] 0 2023-12-12T11:51:51.843 INFO:tasks.workunit.client.1.smithi093.stdout:9/485: creat d1/d12/d1f/d32/d42/fa7 x:0 0 0 2023-12-12T11:51:51.843 INFO:tasks.workunit.client.1.smithi093.stdout:9/486: write d1/d12/f1c [5154880,125495] 0 2023-12-12T11:51:51.845 INFO:tasks.workunit.client.0.smithi063.stdout:4/342: truncate d2/d17/f3e 102466 0 2023-12-12T11:51:51.855 INFO:tasks.workunit.client.0.smithi063.stdout:2/252: dwrite d0/d1a/d1e/f35 [0,4194304] 0 2023-12-12T11:51:51.858 INFO:tasks.workunit.client.0.smithi063.stdout:8/393: symlink d4/d24/d38/d45/d5b/l77 0 2023-12-12T11:51:51.858 INFO:tasks.workunit.client.0.smithi063.stdout:8/394: truncate d4/de/f53 580304 0 2023-12-12T11:51:51.858 INFO:tasks.workunit.client.0.smithi063.stdout:8/395: chown d4/d24/f5f 48967963 1 2023-12-12T11:51:51.868 INFO:tasks.workunit.client.1.smithi093.stdout:8/532: rename d3/d1a/d1f/d29/l87 to d3/d1a/d1f/d29/d3a/da0/la9 0 2023-12-12T11:51:51.868 INFO:tasks.workunit.client.1.smithi093.stdout:8/533: write d3/d73/f77 [1913043,127431] 0 2023-12-12T11:51:51.870 INFO:tasks.workunit.client.0.smithi063.stdout:6/311: creat d9/d10/d5c/f65 x:0 0 0 2023-12-12T11:51:51.871 INFO:tasks.workunit.client.1.smithi093.stdout:5/411: dwrite d0/d7/d59/d48/f81 [0,4194304] 0 2023-12-12T11:51:51.871 INFO:tasks.workunit.client.1.smithi093.stdout:5/412: chown d0/d7/d59/d48/f89 60319210 1 2023-12-12T11:51:51.878 INFO:tasks.workunit.client.1.smithi093.stdout:6/648: mkdir d0/da/d14/d21/df6 0 2023-12-12T11:51:51.878 INFO:tasks.workunit.client.1.smithi093.stdout:6/649: write d0/da/d14/d38/f4f [849965,57265] 0 2023-12-12T11:51:51.882 INFO:tasks.workunit.client.1.smithi093.stdout:0/517: truncate d5/dd/f53 31701 0 2023-12-12T11:51:51.887 INFO:tasks.workunit.client.0.smithi063.stdout:7/272: dwrite de/d22/f24 [4194304,4194304] 0 2023-12-12T11:51:51.887 INFO:tasks.workunit.client.0.smithi063.stdout:7/273: truncate de/d22/f29 2945295 0 2023-12-12T11:51:51.887 INFO:tasks.workunit.client.0.smithi063.stdout:7/274: write de/f13 [3397825,60156] 0 2023-12-12T11:51:51.887 INFO:tasks.workunit.client.0.smithi063.stdout:7/275: write f4 [4521936,46618] 0 2023-12-12T11:51:51.891 INFO:tasks.workunit.client.0.smithi063.stdout:6/312: dread d9/fd [4194304,4194304] 0 2023-12-12T11:51:51.891 INFO:tasks.workunit.client.0.smithi063.stdout:6/313: truncate d9/d10/f22 731333 0 2023-12-12T11:51:51.891 INFO:tasks.workunit.client.0.smithi063.stdout:6/314: write d9/f40 [4814842,116006] 0 2023-12-12T11:51:51.891 INFO:tasks.workunit.client.0.smithi063.stdout:6/315: fsync d9/d2c/f39 0 2023-12-12T11:51:51.891 INFO:tasks.workunit.client.0.smithi063.stdout:6/316: readlink d9/l38 0 2023-12-12T11:51:51.894 INFO:tasks.workunit.client.1.smithi093.stdout:4/691: creat d0/d31/d5c/d6c/da4/dc2/fda x:0 0 0 2023-12-12T11:51:51.904 INFO:tasks.workunit.client.1.smithi093.stdout:1/506: write d4/f8 [4581350,110556] 0 2023-12-12T11:51:51.904 INFO:tasks.workunit.client.1.smithi093.stdout:1/507: fsync d4/d1a/d1b/d26/d65/f7b 0 2023-12-12T11:51:51.904 INFO:tasks.workunit.client.1.smithi093.stdout:1/508: readlink d4/d1a/d1b/d26/d31/l68 0 2023-12-12T11:51:51.904 INFO:tasks.workunit.client.1.smithi093.stdout:1/509: fsync d4/dc/f41 0 2023-12-12T11:51:51.904 INFO:tasks.workunit.client.1.smithi093.stdout:9/487: mknod d1/d12/d1f/d3d/d57/ca8 0 2023-12-12T11:51:51.905 INFO:tasks.workunit.client.0.smithi063.stdout:2/253: dwrite d0/f20 [4194304,4194304] 0 2023-12-12T11:51:51.905 INFO:tasks.workunit.client.0.smithi063.stdout:2/254: fsync d0/f45 0 2023-12-12T11:51:51.909 INFO:tasks.workunit.client.1.smithi093.stdout:0/518: dread d5/dd/d14/d26/f3f [4194304,4194304] 0 2023-12-12T11:51:51.909 INFO:tasks.workunit.client.1.smithi093.stdout:0/519: readlink d5/dd/d14/l29 0 2023-12-12T11:51:51.909 INFO:tasks.workunit.client.1.smithi093.stdout:0/520: chown d5/dd/d14/d95 0 1 2023-12-12T11:51:51.913 INFO:tasks.workunit.client.0.smithi063.stdout:9/259: write d7/d15/f23 [4660570,87939] 0 2023-12-12T11:51:51.913 INFO:tasks.workunit.client.0.smithi063.stdout:9/260: truncate d7/d11/d12/f1a 782392 0 2023-12-12T11:51:51.914 INFO:tasks.workunit.client.1.smithi093.stdout:8/534: dwrite d3/d8/f39 [0,4194304] 0 2023-12-12T11:51:51.915 INFO:tasks.workunit.client.0.smithi063.stdout:0/268: getdents d0/d1a/d23/d34/d42 0 2023-12-12T11:51:51.915 INFO:tasks.workunit.client.0.smithi063.stdout:0/269: truncate d0/d7/d27/d19/f51 819591 0 2023-12-12T11:51:51.918 INFO:tasks.workunit.client.0.smithi063.stdout:9/261: dread d7/d20/f29 [0,4194304] 0 2023-12-12T11:51:51.920 INFO:tasks.workunit.client.0.smithi063.stdout:4/343: mkdir d2/d48/d69 0 2023-12-12T11:51:51.923 INFO:tasks.workunit.client.1.smithi093.stdout:3/509: dwrite df/d36/d3d/d59/d72/f87 [0,4194304] 0 2023-12-12T11:51:51.929 INFO:tasks.workunit.client.0.smithi063.stdout:3/236: link d4/c11 d4/d23/c4e 0 2023-12-12T11:51:51.932 INFO:tasks.workunit.client.0.smithi063.stdout:2/255: dread d0/ff [4194304,4194304] 0 2023-12-12T11:51:51.937 INFO:tasks.workunit.client.1.smithi093.stdout:2/541: rename d5/d46/d55/f6a to d5/d14/d2d/d4c/fba 0 2023-12-12T11:51:51.942 INFO:tasks.workunit.client.0.smithi063.stdout:1/262: getdents d3/db/d16/d24/d30 0 2023-12-12T11:51:51.944 INFO:tasks.workunit.client.0.smithi063.stdout:9/262: dread d7/f14 [0,4194304] 0 2023-12-12T11:51:51.945 INFO:tasks.workunit.client.1.smithi093.stdout:5/413: unlink d0/d7/d8/de/l1b 0 2023-12-12T11:51:51.945 INFO:tasks.workunit.client.1.smithi093.stdout:5/414: write d0/d7/d8/f84 [981643,32726] 0 2023-12-12T11:51:51.952 INFO:tasks.workunit.client.1.smithi093.stdout:2/542: dread d5/d14/d2d/d12/d44/f4d [0,4194304] 0 2023-12-12T11:51:51.960 INFO:tasks.workunit.client.0.smithi063.stdout:7/276: symlink de/d39/d4b/l6a 0 2023-12-12T11:51:51.960 INFO:tasks.workunit.client.0.smithi063.stdout:5/302: rename d7/d28/f4f to d7/f56 0 2023-12-12T11:51:51.960 INFO:tasks.workunit.client.1.smithi093.stdout:6/650: mkdir d0/da/d32/df7 0 2023-12-12T11:51:51.961 INFO:tasks.workunit.client.1.smithi093.stdout:6/651: chown d0/d52/dbc/fca 922 1 2023-12-12T11:51:51.961 INFO:tasks.workunit.client.0.smithi063.stdout:6/317: mknod d9/d10/d25/c66 0 2023-12-12T11:51:51.961 INFO:tasks.workunit.client.0.smithi063.stdout:6/318: stat d9/d10/d25/f3d 0 2023-12-12T11:51:51.968 INFO:tasks.workunit.client.0.smithi063.stdout:3/237: mknod d4/df/c4f 0 2023-12-12T11:51:51.968 INFO:tasks.workunit.client.0.smithi063.stdout:3/238: fsync d4/d23/f49 0 2023-12-12T11:51:51.968 INFO:tasks.workunit.client.0.smithi063.stdout:3/239: fdatasync d4/df/d1a/d1c/f43 0 2023-12-12T11:51:51.968 INFO:tasks.workunit.client.0.smithi063.stdout:3/240: stat d4/df/d1a/d48 0 2023-12-12T11:51:51.972 INFO:tasks.workunit.client.0.smithi063.stdout:1/263: link f2 d3/db/d16/d24/d4d/d35/f51 0 2023-12-12T11:51:51.972 INFO:tasks.workunit.client.0.smithi063.stdout:1/264: dread - d3/db/d12/f46 zero size 2023-12-12T11:51:51.973 INFO:tasks.workunit.client.0.smithi063.stdout:5/303: symlink d7/d28/d43/d49/l57 0 2023-12-12T11:51:51.974 INFO:tasks.workunit.client.0.smithi063.stdout:5/304: dread - d7/d10/d35/f39 zero size 2023-12-12T11:51:51.974 INFO:tasks.workunit.client.0.smithi063.stdout:5/305: creat d7/d10/d2b/f58 x:0 0 0 2023-12-12T11:51:51.974 INFO:tasks.workunit.client.0.smithi063.stdout:5/306: creat d7/de/f59 x:0 0 0 2023-12-12T11:51:51.976 INFO:tasks.workunit.client.0.smithi063.stdout:8/396: rename d4/de/d3b/d62/f4b to d4/de/d3b/d62/d36/d57/f78 0 2023-12-12T11:51:51.980 INFO:tasks.workunit.client.0.smithi063.stdout:6/319: creat d9/d10/d2a/f67 x:0 0 0 2023-12-12T11:51:51.981 INFO:tasks.workunit.client.0.smithi063.stdout:2/256: mkdir d0/d1a/d48/d56 0 2023-12-12T11:51:51.981 INFO:tasks.workunit.client.0.smithi063.stdout:2/257: write d0/d1a/d26/f29 [1044899,10240] 0 2023-12-12T11:51:51.981 INFO:tasks.workunit.client.0.smithi063.stdout:2/258: chown d0/f22 4072252 1 2023-12-12T11:51:51.982 INFO:tasks.workunit.client.1.smithi093.stdout:4/692: link d0/d31/c4f d0/d31/cdb 0 2023-12-12T11:51:51.982 INFO:tasks.workunit.client.1.smithi093.stdout:4/693: stat d0/d87/d79/d86/fce 0 2023-12-12T11:51:51.982 INFO:tasks.workunit.client.1.smithi093.stdout:4/694: truncate d0/d36/d61/fd6 704155 0 2023-12-12T11:51:51.983 INFO:tasks.workunit.client.1.smithi093.stdout:0/521: dwrite d5/d21/d27/f5d [0,4194304] 0 2023-12-12T11:51:51.983 INFO:tasks.workunit.client.1.smithi093.stdout:0/522: fsync d5/dd/d33/f3c 0 2023-12-12T11:51:51.983 INFO:tasks.workunit.client.1.smithi093.stdout:0/523: fdatasync d5/f13 0 2023-12-12T11:51:51.985 INFO:tasks.workunit.client.0.smithi063.stdout:1/265: unlink d3/db/d16/d24/f47 0 2023-12-12T11:51:51.985 INFO:tasks.workunit.client.0.smithi063.stdout:1/266: fsync d3/db/d16/f2d 0 2023-12-12T11:51:51.985 INFO:tasks.workunit.client.0.smithi063.stdout:1/267: chown d3/db/d16/d17/d4b/l4e 416469984 1 2023-12-12T11:51:51.986 INFO:tasks.workunit.client.0.smithi063.stdout:6/320: read d9/d10/f47 [458133,105018] 0 2023-12-12T11:51:51.987 INFO:tasks.workunit.client.1.smithi093.stdout:5/415: dread d0/d7/d36/d38/f40 [0,4194304] 0 2023-12-12T11:51:51.992 INFO:tasks.workunit.client.0.smithi063.stdout:4/344: dwrite d2/d8/f49 [4194304,4194304] 0 2023-12-12T11:51:51.998 INFO:tasks.workunit.client.1.smithi093.stdout:8/535: symlink d3/d1a/d1f/d29/d3a/da0/laa 0 2023-12-12T11:51:51.998 INFO:tasks.workunit.client.1.smithi093.stdout:8/536: creat d3/d1a/fab x:0 0 0 2023-12-12T11:51:52.010 INFO:tasks.workunit.client.0.smithi063.stdout:7/277: dread de/f1e [0,4194304] 0 2023-12-12T11:51:52.025 INFO:tasks.workunit.client.1.smithi093.stdout:2/543: dwrite d5/d31/f45 [0,4194304] 0 2023-12-12T11:51:52.046 INFO:tasks.workunit.client.1.smithi093.stdout:0/524: dwrite d5/d21/d2f/d54/f7b [0,4194304] 0 2023-12-12T11:51:52.076 INFO:tasks.workunit.client.0.smithi063.stdout:2/259: dwrite d0/d1a/d48/f3f [0,4194304] 0 2023-12-12T11:51:52.085 INFO:tasks.workunit.client.0.smithi063.stdout:7/278: dwrite de/d22/f31 [0,4194304] 0 2023-12-12T11:51:52.089 INFO:tasks.workunit.client.0.smithi063.stdout:5/307: mkdir d7/d10/d2b/d3c/d5a 0 2023-12-12T11:51:52.094 INFO:tasks.workunit.client.1.smithi093.stdout:3/510: symlink df/d36/d7f/la6 0 2023-12-12T11:51:52.099 INFO:tasks.workunit.client.0.smithi063.stdout:0/270: rename d0/d7/d27/d19/f45 to d0/d1a/d23/d2e/f5e 0 2023-12-12T11:51:52.099 INFO:tasks.workunit.client.0.smithi063.stdout:0/271: chown d0/d7/d27/d1f/f40 0 1 2023-12-12T11:51:52.099 INFO:tasks.workunit.client.0.smithi063.stdout:0/272: write d0/f21 [4073521,86370] 0 2023-12-12T11:51:52.099 INFO:tasks.workunit.client.0.smithi063.stdout:0/273: stat d0/d7/d27/d1f/f30 0 2023-12-12T11:51:52.099 INFO:tasks.workunit.client.0.smithi063.stdout:0/274: write d0/f21 [4834374,30553] 0 2023-12-12T11:51:52.107 INFO:tasks.workunit.client.1.smithi093.stdout:1/510: rename d4/d1c/c69 to d4/d1a/d1b/d26/d82/ca5 0 2023-12-12T11:51:52.108 INFO:tasks.workunit.client.1.smithi093.stdout:1/511: chown d4/dc/d7a/d9c/fa2 65668550 1 2023-12-12T11:51:52.108 INFO:tasks.workunit.client.1.smithi093.stdout:1/512: chown d4/d1a/l4f 68703 1 2023-12-12T11:51:52.114 INFO:tasks.workunit.client.0.smithi063.stdout:1/268: mkdir d3/d3a/d52 0 2023-12-12T11:51:52.117 INFO:tasks.workunit.client.1.smithi093.stdout:4/695: rmdir d0/d87/d79/d7f/dcb 0 2023-12-12T11:51:52.123 INFO:tasks.workunit.client.0.smithi063.stdout:5/308: dwrite d7/d10/d2b/f55 [0,4194304] 0 2023-12-12T11:51:52.132 INFO:tasks.workunit.client.0.smithi063.stdout:4/345: symlink d2/d17/d41/l6a 0 2023-12-12T11:51:52.141 INFO:tasks.workunit.client.1.smithi093.stdout:5/416: mknod d0/d3b/c8c 0 2023-12-12T11:51:52.155 INFO:tasks.workunit.client.0.smithi063.stdout:0/275: dwrite d0/f21 [0,4194304] 0 2023-12-12T11:51:52.155 INFO:tasks.workunit.client.0.smithi063.stdout:0/276: truncate d0/d7/d27/d1f/f59 695464 0 2023-12-12T11:51:52.164 INFO:tasks.workunit.client.1.smithi093.stdout:2/544: link d5/d14/d2d/c94 d5/d14/d47/da7/cbb 0 2023-12-12T11:51:52.174 INFO:tasks.workunit.client.1.smithi093.stdout:0/525: unlink d5/dd/f53 0 2023-12-12T11:51:52.178 INFO:tasks.workunit.client.0.smithi063.stdout:4/346: dwrite d2/d8/f49 [4194304,4194304] 0 2023-12-12T11:51:52.212 INFO:tasks.workunit.client.1.smithi093.stdout:2/545: dwrite d5/d14/d2d/d12/d25/fb2 [0,4194304] 0 2023-12-12T11:51:52.220 INFO:tasks.workunit.client.1.smithi093.stdout:6/652: creat d0/da/d14/d3a/ff8 x:0 0 0 2023-12-12T11:51:52.220 INFO:tasks.workunit.client.1.smithi093.stdout:6/653: readlink d0/da/l27 0 2023-12-12T11:51:52.259 INFO:tasks.workunit.client.1.smithi093.stdout:1/513: mkdir d4/d1a/da6 0 2023-12-12T11:51:52.262 INFO:tasks.workunit.client.1.smithi093.stdout:4/696: rmdir d0/d31/d89/da1 39 2023-12-12T11:51:52.264 INFO:tasks.workunit.client.1.smithi093.stdout:5/417: symlink d0/l8d 0 2023-12-12T11:51:52.273 INFO:tasks.workunit.client.1.smithi093.stdout:0/526: creat d5/dd/d14/d26/d58/d64/d6f/d90/fa0 x:0 0 0 2023-12-12T11:51:52.273 INFO:tasks.workunit.client.1.smithi093.stdout:0/527: chown d5/dd/d14/d26/d58 11 1 2023-12-12T11:51:52.273 INFO:tasks.workunit.client.1.smithi093.stdout:0/528: write d5/dd/f16 [2074742,36491] 0 2023-12-12T11:51:52.281 INFO:tasks.workunit.client.1.smithi093.stdout:2/546: truncate d5/d14/d2d/d12/d44/f4d 351359 0 2023-12-12T11:51:52.288 INFO:tasks.workunit.client.1.smithi093.stdout:6/654: link d0/d52/d7e/f58 d0/da/d32/d9e/d4d/de9/ff9 0 2023-12-12T11:51:52.290 INFO:tasks.workunit.client.1.smithi093.stdout:1/514: mkdir d4/dc/d7a/d9c/da7 0 2023-12-12T11:51:52.292 INFO:tasks.workunit.client.1.smithi093.stdout:5/418: link d0/d7/d8/c2c d0/d7/d59/c8e 0 2023-12-12T11:51:52.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:52 smithi063 ceph-mon[107117]: pgmap v10: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 140 MiB/s rd, 177 MiB/s wr, 267 op/s 2023-12-12T11:51:52.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:52 smithi063 ceph-mon[107117]: Standby manager daemon smithi063.zjnfdi started 2023-12-12T11:51:52.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:52 smithi063 ceph-mon[107117]: from='mgr.? 172.21.15.63:0/100513954' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi063.zjnfdi/crt"}]: dispatch 2023-12-12T11:51:52.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:52 smithi063 ceph-mon[107117]: from='mgr.? 172.21.15.63:0/100513954' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-12T11:51:52.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:52 smithi063 ceph-mon[107117]: from='mgr.? 172.21.15.63:0/100513954' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi063.zjnfdi/key"}]: dispatch 2023-12-12T11:51:52.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:52 smithi063 ceph-mon[107117]: from='mgr.? 172.21.15.63:0/100513954' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-12T11:51:52.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:52 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:51:52.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:52 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:51:52.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:52 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:51:52.295 INFO:tasks.workunit.client.1.smithi093.stdout:8/537: rmdir d3/d1a/d1f/d29/d3a/d9b 0 2023-12-12T11:51:52.298 INFO:tasks.workunit.client.1.smithi093.stdout:4/697: dwrite d0/d36/fbb [0,4194304] 0 2023-12-12T11:51:52.299 INFO:tasks.workunit.client.0.smithi063.stdout:7/279: creat de/d33/d41/d44/f6b x:0 0 0 2023-12-12T11:51:52.303 INFO:tasks.workunit.client.1.smithi093.stdout:0/529: unlink d5/d21/l25 0 2023-12-12T11:51:52.304 INFO:tasks.workunit.client.1.smithi093.stdout:0/530: chown d5/f7d 2556103 1 2023-12-12T11:51:52.315 INFO:tasks.workunit.client.1.smithi093.stdout:2/547: getdents d5/d14/d47/d4e 0 2023-12-12T11:51:52.322 INFO:tasks.workunit.client.1.smithi093.stdout:1/515: mknod d4/d1a/d1b/d26/d82/ca8 0 2023-12-12T11:51:52.322 INFO:tasks.workunit.client.1.smithi093.stdout:1/516: truncate d4/d1a/d1b/d26/d31/f7e 569529 0 2023-12-12T11:51:52.322 INFO:tasks.workunit.client.1.smithi093.stdout:5/419: dwrite d0/d7/d59/d48/f50 [0,4194304] 0 2023-12-12T11:51:52.323 INFO:tasks.workunit.client.1.smithi093.stdout:5/420: chown d0/d7/d36/d29/d44/f74 85820 1 2023-12-12T11:51:52.323 INFO:tasks.workunit.client.1.smithi093.stdout:5/421: fdatasync d0/d7/d59/f60 0 2023-12-12T11:51:52.325 INFO:tasks.workunit.client.1.smithi093.stdout:8/538: symlink d3/lac 0 2023-12-12T11:51:52.325 INFO:tasks.workunit.client.1.smithi093.stdout:8/539: truncate d3/d1a/d1f/d29/d30/d58/d76/f86 4642843 0 2023-12-12T11:51:52.325 INFO:tasks.workunit.client.1.smithi093.stdout:8/540: write d3/d1a/d1f/d29/d3a/d68/d8a/f90 [856834,4874] 0 2023-12-12T11:51:52.325 INFO:tasks.workunit.client.1.smithi093.stdout:8/541: truncate d3/d8/f96 148254 0 2023-12-12T11:51:52.325 INFO:tasks.workunit.client.1.smithi093.stdout:8/542: write d3/d8/f23 [8456823,110563] 0 2023-12-12T11:51:52.327 INFO:tasks.workunit.client.1.smithi093.stdout:1/517: dread d4/d1a/d1b/f8f [0,4194304] 0 2023-12-12T11:51:52.328 INFO:tasks.workunit.client.1.smithi093.stdout:4/698: creat d0/d87/d79/d96/dcc/fdc x:0 0 0 2023-12-12T11:51:52.329 INFO:tasks.workunit.client.1.smithi093.stdout:4/699: chown d0/d36/d61/la6 228614 1 2023-12-12T11:51:52.329 INFO:tasks.workunit.client.1.smithi093.stdout:4/700: chown d0/d87/d79/d86/da9 24 1 2023-12-12T11:51:52.329 INFO:tasks.workunit.client.1.smithi093.stdout:4/701: chown d0/d87/d79/l9a 2 1 2023-12-12T11:51:52.332 INFO:tasks.workunit.client.0.smithi063.stdout:3/241: rename d4/df/d1a/d48 to d4/df/d1a/d1c/d3b/d50 0 2023-12-12T11:51:52.332 INFO:tasks.workunit.client.0.smithi063.stdout:3/242: chown d4/la 5 1 2023-12-12T11:51:52.335 INFO:tasks.workunit.client.1.smithi093.stdout:1/518: dread d4/f8 [4194304,4194304] 0 2023-12-12T11:51:52.335 INFO:tasks.workunit.client.1.smithi093.stdout:1/519: chown d4/dc/c16 2 1 2023-12-12T11:51:52.336 INFO:tasks.workunit.client.0.smithi063.stdout:1/269: mknod d3/db/d12/c53 0 2023-12-12T11:51:52.336 INFO:tasks.workunit.client.0.smithi063.stdout:5/309: creat d7/d10/d2b/d3c/f5b x:0 0 0 2023-12-12T11:51:52.336 INFO:tasks.workunit.client.0.smithi063.stdout:5/310: write d7/d10/f23 [926443,33590] 0 2023-12-12T11:51:52.342 INFO:tasks.workunit.client.1.smithi093.stdout:0/531: getdents d5/dd/d14/d26/d58/d64 0 2023-12-12T11:51:52.342 INFO:tasks.workunit.client.1.smithi093.stdout:2/548: rmdir d5/d14/d47 39 2023-12-12T11:51:52.342 INFO:tasks.workunit.client.1.smithi093.stdout:7/467: sync 2023-12-12T11:51:52.343 INFO:tasks.workunit.client.1.smithi093.stdout:5/422: mkdir d0/d7/d8/d8f 0 2023-12-12T11:51:52.345 INFO:tasks.workunit.client.1.smithi093.stdout:4/702: mkdir d0/d87/d79/d96/db5/ddd 0 2023-12-12T11:51:52.350 INFO:tasks.workunit.client.1.smithi093.stdout:1/520: mkdir d4/d1a/d83/d9a/da9 0 2023-12-12T11:51:52.352 INFO:tasks.workunit.client.1.smithi093.stdout:3/511: creat df/d22/d49/d69/fa7 x:0 0 0 2023-12-12T11:51:52.357 INFO:tasks.workunit.client.1.smithi093.stdout:0/532: link d5/dd/l51 d5/d4d/la1 0 2023-12-12T11:51:52.359 INFO:tasks.workunit.client.1.smithi093.stdout:2/549: mkdir d5/d31/dbc 0 2023-12-12T11:51:52.361 INFO:tasks.workunit.client.0.smithi063.stdout:4/347: rmdir d2/d48 39 2023-12-12T11:51:52.361 INFO:tasks.workunit.client.0.smithi063.stdout:4/348: creat d2/d47/f6b x:0 0 0 2023-12-12T11:51:52.361 INFO:tasks.workunit.client.0.smithi063.stdout:4/349: chown d2/d48/d4f/f5e 320 1 2023-12-12T11:51:52.362 INFO:tasks.workunit.client.1.smithi093.stdout:5/423: creat d0/d7/d36/f90 x:0 0 0 2023-12-12T11:51:52.366 INFO:tasks.workunit.client.1.smithi093.stdout:7/468: dread da/d15/f16 [0,4194304] 0 2023-12-12T11:51:52.366 INFO:tasks.workunit.client.1.smithi093.stdout:7/469: fsync da/d15/d59/d80/f8b 0 2023-12-12T11:51:52.366 INFO:tasks.workunit.client.1.smithi093.stdout:7/470: dread - da/de/d46/f47 zero size 2023-12-12T11:51:52.366 INFO:tasks.workunit.client.1.smithi093.stdout:3/512: rename df/d30/d33/d66/ca0 to df/d36/d3d/d42/ca8 0 2023-12-12T11:51:52.367 INFO:tasks.workunit.client.1.smithi093.stdout:8/543: dwrite d3/d1a/d1f/d29/d30/d58/f67 [0,4194304] 0 2023-12-12T11:51:52.368 INFO:tasks.workunit.client.0.smithi063.stdout:7/280: creat de/d22/d66/f6c x:0 0 0 2023-12-12T11:51:52.370 INFO:tasks.workunit.client.0.smithi063.stdout:1/270: mkdir d3/d3a/d54 0 2023-12-12T11:51:52.373 INFO:tasks.workunit.client.1.smithi093.stdout:0/533: mknod d5/dd/d14/d26/d58/d64/d6f/d90/ca2 0 2023-12-12T11:51:52.383 INFO:tasks.workunit.client.1.smithi093.stdout:2/550: mkdir d5/d14/d2d/d12/d25/d7a/d7e/da5/dbd 0 2023-12-12T11:51:52.383 INFO:tasks.workunit.client.1.smithi093.stdout:5/424: write d0/d7/d59/d35/f1f [2718760,50020] 0 2023-12-12T11:51:52.383 INFO:tasks.workunit.client.1.smithi093.stdout:2/551: write d5/d46/faa [471973,16874] 0 2023-12-12T11:51:52.383 INFO:tasks.workunit.client.1.smithi093.stdout:2/552: stat d5/d14/d2d/d8b/da2 0 2023-12-12T11:51:52.383 INFO:tasks.workunit.client.1.smithi093.stdout:5/425: write d0/d7/d59/d35/f31 [127217,14916] 0 2023-12-12T11:51:52.384 INFO:tasks.workunit.client.0.smithi063.stdout:5/311: unlink d7/d10/c52 0 2023-12-12T11:51:52.384 INFO:tasks.workunit.client.1.smithi093.stdout:8/544: dread d3/d1a/d1f/d75/f9f [0,4194304] 0 2023-12-12T11:51:52.384 INFO:tasks.workunit.client.1.smithi093.stdout:8/545: write d3/d1a/d1f/d29/d3a/f8e [939358,7047] 0 2023-12-12T11:51:52.384 INFO:tasks.workunit.client.1.smithi093.stdout:8/546: truncate d3/d73/f77 3359461 0 2023-12-12T11:51:52.385 INFO:tasks.workunit.client.1.smithi093.stdout:2/553: write d5/d14/d2d/d4c/d54/d67/d69/f97 [73075,84036] 0 2023-12-12T11:51:52.385 INFO:tasks.workunit.client.0.smithi063.stdout:7/281: write de/f19 [1543615,107806] 0 2023-12-12T11:51:52.397 INFO:tasks.workunit.client.0.smithi063.stdout:8/397: rmdir d4/de/d3b 39 2023-12-12T11:51:52.398 INFO:tasks.workunit.client.1.smithi093.stdout:4/703: write d0/d31/d5c/d66/f84 [4061071,111072] 0 2023-12-12T11:51:52.400 INFO:tasks.workunit.client.0.smithi063.stdout:1/271: write d3/db/fe [489786,8436] 0 2023-12-12T11:51:52.400 INFO:tasks.workunit.client.0.smithi063.stdout:1/272: chown d3/f9 3964 1 2023-12-12T11:51:52.401 INFO:tasks.workunit.client.1.smithi093.stdout:2/554: dread d5/d14/d2d/d12/d25/f2a [4194304,4194304] 0 2023-12-12T11:51:52.404 INFO:tasks.workunit.client.0.smithi063.stdout:3/243: dwrite d4/f7 [0,4194304] 0 2023-12-12T11:51:52.404 INFO:tasks.workunit.client.0.smithi063.stdout:3/244: dread - d4/d23/f4b zero size 2023-12-12T11:51:52.407 INFO:tasks.workunit.client.0.smithi063.stdout:7/282: truncate de/f3c 743717 0 2023-12-12T11:51:52.414 INFO:tasks.workunit.client.0.smithi063.stdout:8/398: symlink d4/d24/d38/d45/d5b/l79 0 2023-12-12T11:51:52.415 INFO:tasks.workunit.client.1.smithi093.stdout:0/534: read d5/f24 [2772479,4737] 0 2023-12-12T11:51:52.415 INFO:tasks.workunit.client.1.smithi093.stdout:0/535: write d5/d21/d27/d3a/f48 [5236927,69258] 0 2023-12-12T11:51:52.416 INFO:tasks.workunit.client.0.smithi063.stdout:1/273: rename d3/db/d12/f46 to d3/db/d16/d17/f55 0 2023-12-12T11:51:52.416 INFO:tasks.workunit.client.1.smithi093.stdout:4/704: dread d0/d31/d5c/f6b [0,4194304] 0 2023-12-12T11:51:52.417 INFO:tasks.workunit.client.1.smithi093.stdout:4/705: chown d0/d36/l6f 1 1 2023-12-12T11:51:52.417 INFO:tasks.workunit.client.1.smithi093.stdout:4/706: chown d0/d36/d49/c92 0 1 2023-12-12T11:51:52.420 INFO:tasks.workunit.client.0.smithi063.stdout:3/245: rmdir d4/df/d1a/d1c/d41 39 2023-12-12T11:51:52.423 INFO:tasks.workunit.client.0.smithi063.stdout:6/321: mkdir d9/d68 0 2023-12-12T11:51:52.423 INFO:tasks.workunit.client.0.smithi063.stdout:6/322: getdents d9/d68 0 2023-12-12T11:51:52.428 INFO:tasks.workunit.client.0.smithi063.stdout:1/274: truncate d3/db/d16/d24/f2a 2853831 0 2023-12-12T11:51:52.429 INFO:tasks.workunit.client.1.smithi093.stdout:8/547: dwrite d3/d73/f77 [0,4194304] 0 2023-12-12T11:51:52.433 INFO:tasks.workunit.client.1.smithi093.stdout:9/488: sync 2023-12-12T11:51:52.434 INFO:tasks.workunit.client.0.smithi063.stdout:3/246: rmdir d4/df/d1a/d1c/d3b 39 2023-12-12T11:51:52.445 INFO:tasks.workunit.client.1.smithi093.stdout:2/555: unlink d5/d14/d5e/ca6 0 2023-12-12T11:51:52.445 INFO:tasks.workunit.client.1.smithi093.stdout:2/556: stat d5/d14/d2d/d4c/d76/l7c 0 2023-12-12T11:51:52.447 INFO:tasks.workunit.client.1.smithi093.stdout:2/557: write d5/d14/d2d/d12/d25/d7a/f81 [57014,21807] 0 2023-12-12T11:51:52.449 INFO:tasks.workunit.client.1.smithi093.stdout:5/426: getdents d0/d7/d59/d48 0 2023-12-12T11:51:52.453 INFO:tasks.workunit.client.1.smithi093.stdout:9/489: dread d1/d12/d1f/f38 [0,4194304] 0 2023-12-12T11:51:52.453 INFO:tasks.workunit.client.1.smithi093.stdout:4/707: truncate d0/f32 2205243 0 2023-12-12T11:51:52.455 INFO:tasks.workunit.client.0.smithi063.stdout:5/312: dwrite d7/f56 [0,4194304] 0 2023-12-12T11:51:52.459 INFO:tasks.workunit.client.1.smithi093.stdout:8/548: unlink d3/d1a/d1f/d29/d3a/la7 0 2023-12-12T11:51:52.461 INFO:tasks.workunit.client.1.smithi093.stdout:2/558: truncate d5/d14/d2d/d12/d25/f29 90770 0 2023-12-12T11:51:52.461 INFO:tasks.workunit.client.1.smithi093.stdout:2/559: write d5/d14/d47/d4e/f8a [589896,13299] 0 2023-12-12T11:51:52.463 INFO:tasks.workunit.client.1.smithi093.stdout:5/427: mknod d0/d7/d36/d87/c91 0 2023-12-12T11:51:52.467 INFO:tasks.workunit.client.1.smithi093.stdout:4/708: rename d0/l9 to d0/d36/d49/lde 0 2023-12-12T11:51:52.468 INFO:tasks.workunit.client.1.smithi093.stdout:0/536: dwrite d5/dd/d14/d26/f3f [0,4194304] 0 2023-12-12T11:51:52.468 INFO:tasks.workunit.client.1.smithi093.stdout:0/537: write d5/dd/d14/d8c/f9c [515926,40201] 0 2023-12-12T11:51:52.470 INFO:tasks.workunit.client.1.smithi093.stdout:8/549: creat d3/d1a/d1f/d29/d30/d58/fad x:0 0 0 2023-12-12T11:51:52.470 INFO:tasks.workunit.client.0.smithi063.stdout:3/247: read d4/df/d1a/d1c/f29 [1962504,1853] 0 2023-12-12T11:51:52.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:52 smithi093 ceph-mon[115914]: pgmap v10: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 140 MiB/s rd, 177 MiB/s wr, 267 op/s 2023-12-12T11:51:52.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:52 smithi093 ceph-mon[115914]: Standby manager daemon smithi063.zjnfdi started 2023-12-12T11:51:52.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:52 smithi093 ceph-mon[115914]: from='mgr.? 172.21.15.63:0/100513954' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi063.zjnfdi/crt"}]: dispatch 2023-12-12T11:51:52.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:52 smithi093 ceph-mon[115914]: from='mgr.? 172.21.15.63:0/100513954' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-12T11:51:52.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:52 smithi093 ceph-mon[115914]: from='mgr.? 172.21.15.63:0/100513954' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi063.zjnfdi/key"}]: dispatch 2023-12-12T11:51:52.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:52 smithi093 ceph-mon[115914]: from='mgr.? 172.21.15.63:0/100513954' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-12T11:51:52.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:52 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:51:52.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:52 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:51:52.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:52 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:51:52.472 INFO:tasks.workunit.client.1.smithi093.stdout:9/490: dread d1/d12/d1f/d32/f49 [0,4194304] 0 2023-12-12T11:51:52.472 INFO:tasks.workunit.client.1.smithi093.stdout:9/491: fdatasync d1/d23/d24/fa1 0 2023-12-12T11:51:52.472 INFO:tasks.workunit.client.1.smithi093.stdout:9/492: truncate d1/d12/d1f/d3d/d57/f5d 199996 0 2023-12-12T11:51:52.473 INFO:tasks.workunit.client.0.smithi063.stdout:1/275: dwrite d3/db/f1d [0,4194304] 0 2023-12-12T11:51:52.474 INFO:tasks.workunit.client.1.smithi093.stdout:2/560: unlink d5/d46/d61/fb8 0 2023-12-12T11:51:52.474 INFO:tasks.workunit.client.1.smithi093.stdout:9/493: write d1/d23/f41 [881125,109343] 0 2023-12-12T11:51:52.477 INFO:tasks.workunit.client.0.smithi063.stdout:3/248: creat d4/df/d1a/d1c/d41/f51 x:0 0 0 2023-12-12T11:51:52.477 INFO:tasks.workunit.client.0.smithi063.stdout:3/249: chown d4/f2a 9514 1 2023-12-12T11:51:52.477 INFO:tasks.workunit.client.1.smithi093.stdout:5/428: mknod d0/d7/d36/d68/c92 0 2023-12-12T11:51:52.478 INFO:tasks.workunit.client.1.smithi093.stdout:5/429: write d0/d7/d59/d48/f56 [8561267,61472] 0 2023-12-12T11:51:52.479 INFO:tasks.workunit.client.0.smithi063.stdout:1/276: creat d3/f56 x:0 0 0 2023-12-12T11:51:52.480 INFO:tasks.workunit.client.1.smithi093.stdout:0/538: dread d5/dd/d33/f46 [0,4194304] 0 2023-12-12T11:51:52.484 INFO:tasks.workunit.client.0.smithi063.stdout:1/277: link d3/f1a d3/db/d16/d24/d48/f57 0 2023-12-12T11:51:52.489 INFO:tasks.workunit.client.0.smithi063.stdout:6/323: dwrite d9/d10/d25/f3d [0,4194304] 0 2023-12-12T11:51:52.489 INFO:tasks.workunit.client.0.smithi063.stdout:0/277: mknod d0/c5f 0 2023-12-12T11:51:52.489 INFO:tasks.workunit.client.0.smithi063.stdout:6/324: write d9/f1a [4691388,71463] 0 2023-12-12T11:51:52.493 INFO:tasks.workunit.client.0.smithi063.stdout:1/278: symlink d3/db/l58 0 2023-12-12T11:51:52.496 INFO:tasks.workunit.client.1.smithi093.stdout:9/494: dread d1/d23/d24/d29/d43/d58/f78 [0,4194304] 0 2023-12-12T11:51:52.497 INFO:tasks.workunit.client.1.smithi093.stdout:8/550: symlink d3/d1a/d1f/d59/lae 0 2023-12-12T11:51:52.497 INFO:tasks.workunit.client.1.smithi093.stdout:8/551: truncate d3/d1a/d1f/d29/d3a/d68/d8a/f90 915728 0 2023-12-12T11:51:52.498 INFO:tasks.workunit.client.0.smithi063.stdout:6/325: mknod d9/d10/d5c/c69 0 2023-12-12T11:51:52.498 INFO:tasks.workunit.client.0.smithi063.stdout:6/326: readlink d9/d10/l26 0 2023-12-12T11:51:52.498 INFO:tasks.workunit.client.0.smithi063.stdout:6/327: chown d9/d10/c21 3 1 2023-12-12T11:51:52.500 INFO:tasks.workunit.client.1.smithi093.stdout:2/561: unlink d5/d14/d2d/d12/d25/d7a/d7e/lb6 0 2023-12-12T11:51:52.501 INFO:tasks.workunit.client.1.smithi093.stdout:5/430: stat d0/d7/d36/d29/d44/c5e 0 2023-12-12T11:51:52.503 INFO:tasks.workunit.client.1.smithi093.stdout:0/539: rename d5/d78/l80 to d5/dd/d14/d8c/la3 0 2023-12-12T11:51:52.505 INFO:tasks.workunit.client.0.smithi063.stdout:6/328: getdents d9/d2c/d61 0 2023-12-12T11:51:52.508 INFO:tasks.workunit.client.1.smithi093.stdout:9/495: truncate d1/d12/d1f/d3d/d5c/f7b 287135 0 2023-12-12T11:51:52.508 INFO:tasks.workunit.client.1.smithi093.stdout:9/496: stat d1/d23/d24/d29/d43/d56/d68/f87 0 2023-12-12T11:51:52.509 INFO:tasks.workunit.client.0.smithi063.stdout:6/329: truncate d9/d10/f20 3748167 0 2023-12-12T11:51:52.511 INFO:tasks.workunit.client.0.smithi063.stdout:1/279: dread d3/db/d16/d24/d30/f3d [0,4194304] 0 2023-12-12T11:51:52.515 INFO:tasks.workunit.client.1.smithi093.stdout:8/552: mkdir d3/d1a/d1f/daf 0 2023-12-12T11:51:52.515 INFO:tasks.workunit.client.1.smithi093.stdout:8/553: readlink d3/d1a/d1f/d29/d3a/d68/l9a 0 2023-12-12T11:51:52.515 INFO:tasks.workunit.client.1.smithi093.stdout:8/554: fdatasync d3/d1a/f2b 0 2023-12-12T11:51:52.515 INFO:tasks.workunit.client.1.smithi093.stdout:8/555: truncate d3/d1a/d1f/d29/d3a/d68/d8a/f90 1213226 0 2023-12-12T11:51:52.517 INFO:tasks.workunit.client.1.smithi093.stdout:2/562: unlink d5/d14/d2d/cd 0 2023-12-12T11:51:52.520 INFO:tasks.workunit.client.0.smithi063.stdout:1/280: link d3/db/d16/d17/l2e d3/db/d16/d17/l59 0 2023-12-12T11:51:52.524 INFO:tasks.workunit.client.1.smithi093.stdout:0/540: rename d5/dd/d14/d95 to d5/d78/da4 0 2023-12-12T11:51:52.531 INFO:tasks.workunit.client.1.smithi093.stdout:0/541: dread d5/d21/d27/d3a/f67 [0,4194304] 0 2023-12-12T11:51:52.532 INFO:tasks.workunit.client.0.smithi063.stdout:3/250: dwrite d4/d23/f49 [0,4194304] 0 2023-12-12T11:51:52.533 INFO:tasks.workunit.client.1.smithi093.stdout:8/556: unlink d3/d1a/f33 0 2023-12-12T11:51:52.534 INFO:tasks.workunit.client.1.smithi093.stdout:8/557: fdatasync d3/d73/f98 0 2023-12-12T11:51:52.535 INFO:tasks.workunit.client.0.smithi063.stdout:2/260: mkdir d0/d1a/d57 0 2023-12-12T11:51:52.538 INFO:tasks.workunit.client.1.smithi093.stdout:0/542: read d5/dd/d33/f3c [844534,2048] 0 2023-12-12T11:51:52.540 INFO:tasks.workunit.client.1.smithi093.stdout:2/563: rename d5/d14/d2d/d4c/d54/d67/f90 to d5/d14/d2d/d4c/fbe 0 2023-12-12T11:51:52.547 INFO:tasks.workunit.client.0.smithi063.stdout:8/399: getdents d4/d24/d38/d45/d5b 0 2023-12-12T11:51:52.553 INFO:tasks.workunit.client.0.smithi063.stdout:2/261: truncate d0/f17 391592 0 2023-12-12T11:51:52.556 INFO:tasks.workunit.client.1.smithi093.stdout:0/543: mknod d5/dd/d14/d26/ca5 0 2023-12-12T11:51:52.556 INFO:tasks.workunit.client.1.smithi093.stdout:0/544: fdatasync d5/dd/d33/f3c 0 2023-12-12T11:51:52.560 INFO:tasks.workunit.client.1.smithi093.stdout:5/431: dwrite d0/d7/d36/d29/f30 [4194304,4194304] 0 2023-12-12T11:51:52.561 INFO:tasks.workunit.client.1.smithi093.stdout:5/432: chown d0/d7/d59/d48/f4c 1 1 2023-12-12T11:51:52.562 INFO:tasks.workunit.client.1.smithi093.stdout:9/497: dwrite d1/d23/d24/d29/d43/f51 [0,4194304] 0 2023-12-12T11:51:52.562 INFO:tasks.workunit.client.0.smithi063.stdout:8/400: unlink d4/d24/d38/l68 0 2023-12-12T11:51:52.563 INFO:tasks.workunit.client.0.smithi063.stdout:6/330: dwrite d9/d10/f15 [4194304,4194304] 0 2023-12-12T11:51:52.570 INFO:tasks.workunit.client.0.smithi063.stdout:2/262: creat d0/d1a/d48/d56/f58 x:0 0 0 2023-12-12T11:51:52.573 INFO:tasks.workunit.client.1.smithi093.stdout:2/564: chown d5/l3d 231726 1 2023-12-12T11:51:52.574 INFO:tasks.workunit.client.1.smithi093.stdout:6/655: sync 2023-12-12T11:51:52.575 INFO:tasks.workunit.client.0.smithi063.stdout:6/331: creat d9/d10/d5c/d5e/f6a x:0 0 0 2023-12-12T11:51:52.582 INFO:tasks.workunit.client.0.smithi063.stdout:8/401: write d4/d24/d38/d45/f6a [719215,21516] 0 2023-12-12T11:51:52.584 INFO:tasks.workunit.client.1.smithi093.stdout:0/545: rename d5/dd/d33/d87/f96 to d5/d41/fa6 0 2023-12-12T11:51:52.584 INFO:tasks.workunit.client.0.smithi063.stdout:1/281: dwrite d3/db/d16/d24/d30/f3d [0,4194304] 0 2023-12-12T11:51:52.589 INFO:tasks.workunit.client.1.smithi093.stdout:0/546: read d5/dd/d14/d26/d58/f8a [513215,41682] 0 2023-12-12T11:51:52.590 INFO:tasks.workunit.client.0.smithi063.stdout:2/263: mkdir d0/d1a/d3a/d59 0 2023-12-12T11:51:52.590 INFO:tasks.workunit.client.0.smithi063.stdout:2/264: stat d0/f33 0 2023-12-12T11:51:52.592 INFO:tasks.workunit.client.0.smithi063.stdout:7/283: rename de/d22/f29 to de/d3f/f6d 0 2023-12-12T11:51:52.596 INFO:tasks.workunit.client.0.smithi063.stdout:4/350: symlink d2/d17/l6c 0 2023-12-12T11:51:52.597 INFO:tasks.workunit.client.0.smithi063.stdout:6/332: mkdir d9/d2c/d6b 0 2023-12-12T11:51:52.599 INFO:tasks.workunit.client.0.smithi063.stdout:3/251: dwrite d4/f7 [4194304,4194304] 0 2023-12-12T11:51:52.599 INFO:tasks.workunit.client.0.smithi063.stdout:3/252: fsync d4/f7 0 2023-12-12T11:51:52.601 INFO:tasks.workunit.client.0.smithi063.stdout:8/402: link d4/de/d3b/d62/d36/d57/f78 d4/de/d3b/d62/d6e/d76/f7a 0 2023-12-12T11:51:52.601 INFO:tasks.workunit.client.0.smithi063.stdout:8/403: write f1 [1723882,90604] 0 2023-12-12T11:51:52.602 INFO:tasks.workunit.client.1.smithi093.stdout:8/558: getdents d3/d1a/d1f/d29/d3a 0 2023-12-12T11:51:52.607 INFO:tasks.workunit.client.0.smithi063.stdout:2/265: mknod d0/d41/c5a 0 2023-12-12T11:51:52.607 INFO:tasks.workunit.client.0.smithi063.stdout:2/266: dread - d0/f4c zero size 2023-12-12T11:51:52.609 INFO:tasks.workunit.client.0.smithi063.stdout:1/282: dread d3/db/d16/d24/f29 [0,4194304] 0 2023-12-12T11:51:52.610 INFO:tasks.workunit.client.1.smithi093.stdout:4/709: getdents d0 0 2023-12-12T11:51:52.614 INFO:tasks.workunit.client.0.smithi063.stdout:5/313: rename d7/c19 to d7/d10/d2b/d3c/c5c 0 2023-12-12T11:51:52.614 INFO:tasks.workunit.client.0.smithi063.stdout:5/314: chown d7/f15 144 1 2023-12-12T11:51:52.616 INFO:tasks.workunit.client.0.smithi063.stdout:7/284: truncate de/f1d 2179451 0 2023-12-12T11:51:52.618 INFO:tasks.workunit.client.0.smithi063.stdout:4/351: mkdir d2/d47/d6d 0 2023-12-12T11:51:52.623 INFO:tasks.workunit.client.0.smithi063.stdout:6/333: symlink d9/l6c 0 2023-12-12T11:51:52.623 INFO:tasks.workunit.client.0.smithi063.stdout:6/334: fsync d9/f18 0 2023-12-12T11:51:52.626 INFO:tasks.workunit.client.1.smithi093.stdout:5/433: unlink d0/d7/d59/d62/c82 0 2023-12-12T11:51:52.626 INFO:tasks.workunit.client.1.smithi093.stdout:5/434: write d0/f15 [4648175,41631] 0 2023-12-12T11:51:52.627 INFO:tasks.workunit.client.1.smithi093.stdout:5/435: chown d0/d3b/d66/d7c 0 1 2023-12-12T11:51:52.627 INFO:tasks.workunit.client.1.smithi093.stdout:5/436: readlink d0/d7/d59/d35/d6a/l71 0 2023-12-12T11:51:52.627 INFO:tasks.workunit.client.1.smithi093.stdout:9/498: rmdir d1/d23/d24/d29 39 2023-12-12T11:51:52.627 INFO:tasks.workunit.client.1.smithi093.stdout:9/499: creat d1/d23/d24/fa9 x:0 0 0 2023-12-12T11:51:52.632 INFO:tasks.workunit.client.0.smithi063.stdout:3/253: mkdir d4/df/d1a/d1c/d3b/d52 0 2023-12-12T11:51:52.632 INFO:tasks.workunit.client.0.smithi063.stdout:3/254: creat d4/df/d1a/d1c/d41/f53 x:0 0 0 2023-12-12T11:51:52.635 INFO:tasks.workunit.client.1.smithi093.stdout:6/656: link d0/c6c d0/da/d14/d38/d43/cfa 0 2023-12-12T11:51:52.637 INFO:tasks.workunit.client.0.smithi063.stdout:3/255: write d4/df/d1a/f2b [775234,86735] 0 2023-12-12T11:51:52.640 INFO:tasks.workunit.client.1.smithi093.stdout:1/521: sync 2023-12-12T11:51:52.641 INFO:tasks.workunit.client.1.smithi093.stdout:0/547: creat d5/d21/d27/d3a/d9a/fa7 x:0 0 0 2023-12-12T11:51:52.642 INFO:tasks.workunit.client.1.smithi093.stdout:8/559: dwrite d3/d1a/d1f/f27 [0,4194304] 0 2023-12-12T11:51:52.643 INFO:tasks.workunit.client.1.smithi093.stdout:2/565: dwrite d5/d14/d47/f5b [0,4194304] 0 2023-12-12T11:51:52.645 INFO:tasks.workunit.client.0.smithi063.stdout:2/267: symlink d0/l5b 0 2023-12-12T11:51:52.646 INFO:tasks.workunit.client.1.smithi093.stdout:4/710: mknod d0/d31/d9d/cdf 0 2023-12-12T11:51:52.646 INFO:tasks.workunit.client.1.smithi093.stdout:4/711: readlink d0/d87/d79/d7f/ld4 0 2023-12-12T11:51:52.646 INFO:tasks.workunit.client.1.smithi093.stdout:4/712: readlink d0/d31/l4d 0 2023-12-12T11:51:52.650 INFO:tasks.workunit.client.0.smithi063.stdout:1/283: mkdir d3/db/d16/d24/d4d/d35/d5a 0 2023-12-12T11:51:52.653 INFO:tasks.workunit.client.1.smithi093.stdout:5/437: mknod d0/d7/d36/d29/d76/c93 0 2023-12-12T11:51:52.654 INFO:tasks.workunit.client.0.smithi063.stdout:5/315: symlink d7/d28/l5d 0 2023-12-12T11:51:52.659 INFO:tasks.workunit.client.1.smithi093.stdout:8/560: dread d3/d8/f7d [0,4194304] 0 2023-12-12T11:51:52.660 INFO:tasks.workunit.client.0.smithi063.stdout:0/278: rename d0/d7/d27/fb to d0/d1a/d23/d34/d42/f60 0 2023-12-12T11:51:52.664 INFO:tasks.workunit.client.1.smithi093.stdout:1/522: link d4/d1c/d2a/f4b d4/d1a/da6/faa 0 2023-12-12T11:51:52.665 INFO:tasks.workunit.client.0.smithi063.stdout:5/316: write d7/f26 [42655,23871] 0 2023-12-12T11:51:52.666 INFO:tasks.workunit.client.0.smithi063.stdout:5/317: write d7/d10/f14 [4992618,58920] 0 2023-12-12T11:51:52.666 INFO:tasks.workunit.client.0.smithi063.stdout:5/318: readlink d7/de/l44 0 2023-12-12T11:51:52.666 INFO:tasks.workunit.client.0.smithi063.stdout:7/285: unlink de/d33/l38 0 2023-12-12T11:51:52.669 INFO:tasks.workunit.client.1.smithi093.stdout:0/548: creat d5/dd/d14/d99/fa8 x:0 0 0 2023-12-12T11:51:52.669 INFO:tasks.workunit.client.1.smithi093.stdout:0/549: dread - d5/d21/d27/d3a/d9a/fa7 zero size 2023-12-12T11:51:52.672 INFO:tasks.workunit.client.0.smithi063.stdout:6/335: mknod d9/d10/d2a/c6d 0 2023-12-12T11:51:52.678 INFO:tasks.workunit.client.0.smithi063.stdout:9/263: sync 2023-12-12T11:51:52.679 INFO:tasks.workunit.client.0.smithi063.stdout:3/256: mkdir d4/df/d1a/d1c/d34/d54 0 2023-12-12T11:51:52.679 INFO:tasks.workunit.client.0.smithi063.stdout:3/257: fsync d4/d23/f24 0 2023-12-12T11:51:52.679 INFO:tasks.workunit.client.0.smithi063.stdout:3/258: truncate d4/df/f37 404720 0 2023-12-12T11:51:52.679 INFO:tasks.workunit.client.0.smithi063.stdout:3/259: fsync d4/d23/f4b 0 2023-12-12T11:51:52.682 INFO:tasks.workunit.client.0.smithi063.stdout:1/284: mkdir d3/db/d16/d24/d4d/d35/d5a/d5b 0 2023-12-12T11:51:52.692 INFO:tasks.workunit.client.0.smithi063.stdout:4/352: dwrite d2/f10 [4194304,4194304] 0 2023-12-12T11:51:52.697 INFO:tasks.workunit.client.0.smithi063.stdout:0/279: link d0/d1a/d23/d2e/c4a d0/c61 0 2023-12-12T11:51:52.698 INFO:tasks.workunit.client.0.smithi063.stdout:8/404: rename d4/de/f19 to d4/de/d1e/f7b 0 2023-12-12T11:51:52.702 INFO:tasks.workunit.client.1.smithi093.stdout:3/513: sync 2023-12-12T11:51:52.702 INFO:tasks.workunit.client.1.smithi093.stdout:7/471: sync 2023-12-12T11:51:52.702 INFO:tasks.workunit.client.1.smithi093.stdout:7/472: write da/f70 [336396,106705] 0 2023-12-12T11:51:52.720 INFO:tasks.workunit.client.0.smithi063.stdout:0/280: dread d0/d7/d27/d1f/f3f [0,4194304] 0 2023-12-12T11:51:52.720 INFO:tasks.workunit.client.0.smithi063.stdout:5/319: mknod d7/d28/d43/c5e 0 2023-12-12T11:51:52.721 INFO:tasks.workunit.client.1.smithi093.stdout:2/566: stat d5/d14/d2d/d4c/d54/d67/c74 0 2023-12-12T11:51:52.723 INFO:tasks.workunit.client.0.smithi063.stdout:6/336: symlink d9/l6e 0 2023-12-12T11:51:52.723 INFO:tasks.workunit.client.0.smithi063.stdout:6/337: fdatasync d9/d10/d5c/f65 0 2023-12-12T11:51:52.723 INFO:tasks.workunit.client.0.smithi063.stdout:6/338: write d9/d10/d2a/f67 [77072,41407] 0 2023-12-12T11:51:52.724 INFO:tasks.workunit.client.0.smithi063.stdout:6/339: chown d9/d10/f4c 164337500 1 2023-12-12T11:51:52.724 INFO:tasks.workunit.client.0.smithi063.stdout:6/340: write d9/f43 [1109450,120542] 0 2023-12-12T11:51:52.726 INFO:tasks.workunit.client.1.smithi093.stdout:4/713: link d0/d31/d5c/d6c/da4/fbd d0/d87/d79/d86/fe0 0 2023-12-12T11:51:52.726 INFO:tasks.workunit.client.1.smithi093.stdout:4/714: fsync d0/ff 0 2023-12-12T11:51:52.726 INFO:tasks.workunit.client.1.smithi093.stdout:4/715: chown d0/d87/c8d 317 1 2023-12-12T11:51:52.727 INFO:tasks.workunit.client.0.smithi063.stdout:3/260: stat d4/df/d1a/d1c/f28 0 2023-12-12T11:51:52.733 INFO:tasks.workunit.client.1.smithi093.stdout:8/561: symlink d3/d1a/d1f/daf/lb0 0 2023-12-12T11:51:52.733 INFO:tasks.workunit.client.1.smithi093.stdout:8/562: readlink d3/d1a/d1f/d29/d30/l9c 0 2023-12-12T11:51:52.733 INFO:tasks.workunit.client.1.smithi093.stdout:8/563: stat d3/d1a/l5d 0 2023-12-12T11:51:52.736 INFO:tasks.workunit.client.0.smithi063.stdout:8/405: creat d4/de/d3b/d62/d36/d57/f7c x:0 0 0 2023-12-12T11:51:52.739 INFO:tasks.workunit.client.1.smithi093.stdout:0/550: creat d5/dd/d14/d26/d58/d72/fa9 x:0 0 0 2023-12-12T11:51:52.746 INFO:tasks.workunit.client.1.smithi093.stdout:8/564: dread d3/d73/f77 [0,4194304] 0 2023-12-12T11:51:52.746 INFO:tasks.workunit.client.0.smithi063.stdout:1/285: rename d3/db/d12/f42 to d3/db/d16/f5c 0 2023-12-12T11:51:52.746 INFO:tasks.workunit.client.1.smithi093.stdout:3/514: creat df/d36/d7f/fa9 x:0 0 0 2023-12-12T11:51:52.747 INFO:tasks.workunit.client.1.smithi093.stdout:3/515: stat df/d36/d3d/d42/d9d 0 2023-12-12T11:51:52.748 INFO:tasks.workunit.client.0.smithi063.stdout:5/320: creat d7/d28/f5f x:0 0 0 2023-12-12T11:51:52.749 INFO:tasks.workunit.client.1.smithi093.stdout:7/473: mkdir da/de/d78/da6 0 2023-12-12T11:51:52.749 INFO:tasks.workunit.client.1.smithi093.stdout:7/474: creat da/d2e/fa7 x:0 0 0 2023-12-12T11:51:52.756 INFO:tasks.workunit.client.1.smithi093.stdout:3/516: dread df/d25/d2c/d85/f8f [0,4194304] 0 2023-12-12T11:51:52.759 INFO:tasks.workunit.client.1.smithi093.stdout:2/567: creat d5/fbf x:0 0 0 2023-12-12T11:51:52.760 INFO:tasks.workunit.client.1.smithi093.stdout:2/568: stat d5/d14/d2d/d4c/d76/l7c 0 2023-12-12T11:51:52.760 INFO:tasks.workunit.client.1.smithi093.stdout:2/569: fdatasync d5/d14/d2d/d12/d25/fb2 0 2023-12-12T11:51:52.760 INFO:tasks.workunit.client.1.smithi093.stdout:2/570: chown d5/d31/f64 0 1 2023-12-12T11:51:52.760 INFO:tasks.workunit.client.0.smithi063.stdout:6/341: rename d9/ca to d9/c6f 0 2023-12-12T11:51:52.760 INFO:tasks.workunit.client.0.smithi063.stdout:3/261: mknod d4/df/d1a/d1c/d41/c55 0 2023-12-12T11:51:52.760 INFO:tasks.workunit.client.0.smithi063.stdout:0/281: stat d0/d1a/d23/c25 0 2023-12-12T11:51:52.762 INFO:tasks.workunit.client.0.smithi063.stdout:1/286: creat d3/db/d16/d24/d4d/d35/f5d x:0 0 0 2023-12-12T11:51:52.765 INFO:tasks.workunit.client.0.smithi063.stdout:5/321: mknod d7/d10/d2b/d3c/d27/c60 0 2023-12-12T11:51:52.774 INFO:tasks.workunit.client.0.smithi063.stdout:6/342: unlink d9/d10/f20 0 2023-12-12T11:51:52.774 INFO:tasks.workunit.client.0.smithi063.stdout:5/322: dread d7/de/f25 [4194304,4194304] 0 2023-12-12T11:51:52.775 INFO:tasks.workunit.client.1.smithi093.stdout:4/716: link d0/d87/c90 d0/d36/d61/d97/ce1 0 2023-12-12T11:51:52.775 INFO:tasks.workunit.client.0.smithi063.stdout:6/343: rename d9/d2c/d61 to d9/d2c/d61/d70 22 2023-12-12T11:51:52.776 INFO:tasks.workunit.client.0.smithi063.stdout:6/344: chown d9/f27 169376 1 2023-12-12T11:51:52.776 INFO:tasks.workunit.client.0.smithi063.stdout:6/345: readlink d9/l6c 0 2023-12-12T11:51:52.776 INFO:tasks.workunit.client.0.smithi063.stdout:6/346: fsync d9/d10/f4c 0 2023-12-12T11:51:52.776 INFO:tasks.workunit.client.0.smithi063.stdout:6/347: truncate d9/f55 588007 0 2023-12-12T11:51:52.776 INFO:tasks.workunit.client.0.smithi063.stdout:6/348: fdatasync d9/d10/d5c/d5e/f6a 0 2023-12-12T11:51:52.776 INFO:tasks.workunit.client.0.smithi063.stdout:6/349: write d9/f24 [1104073,94144] 0 2023-12-12T11:51:52.776 INFO:tasks.workunit.client.0.smithi063.stdout:6/350: read - d9/d10/f41 zero size 2023-12-12T11:51:52.780 INFO:tasks.workunit.client.1.smithi093.stdout:7/475: dwrite da/d15/d59/d80/f8d [0,4194304] 0 2023-12-12T11:51:52.780 INFO:tasks.workunit.client.0.smithi063.stdout:3/262: mkdir d4/df/d1a/d3d/d4c/d56 0 2023-12-12T11:51:52.788 INFO:tasks.workunit.client.0.smithi063.stdout:2/268: dwrite d0/d1a/d48/f3d [0,4194304] 0 2023-12-12T11:51:52.788 INFO:tasks.workunit.client.0.smithi063.stdout:2/269: truncate d0/d1a/d48/d56/f58 438735 0 2023-12-12T11:51:52.789 INFO:tasks.workunit.client.0.smithi063.stdout:1/287: mkdir d3/d3a/d5e 0 2023-12-12T11:51:52.789 INFO:tasks.workunit.client.0.smithi063.stdout:0/282: write d0/d1a/d23/d34/f52 [3304459,109153] 0 2023-12-12T11:51:52.789 INFO:tasks.workunit.client.0.smithi063.stdout:0/283: write d0/d7/d27/f3b [922194,60039] 0 2023-12-12T11:51:52.790 INFO:tasks.workunit.client.0.smithi063.stdout:4/353: write d2/d17/f22 [956884,74460] 0 2023-12-12T11:51:52.795 INFO:tasks.workunit.client.0.smithi063.stdout:7/286: dwrite de/d33/d41/d44/f6b [0,4194304] 0 2023-12-12T11:51:52.796 INFO:tasks.workunit.client.0.smithi063.stdout:9/264: dwrite d7/d11/f21 [0,4194304] 0 2023-12-12T11:51:52.807 INFO:tasks.workunit.client.0.smithi063.stdout:5/323: write d7/d10/d2b/d3c/f36 [354171,94835] 0 2023-12-12T11:51:52.808 INFO:tasks.workunit.client.0.smithi063.stdout:1/288: write d3/db/f1d [2002807,125034] 0 2023-12-12T11:51:52.809 INFO:tasks.workunit.client.0.smithi063.stdout:1/289: dread - d3/db/d12/f50 zero size 2023-12-12T11:51:52.810 INFO:tasks.workunit.client.1.smithi093.stdout:1/523: rmdir d4/dc 39 2023-12-12T11:51:52.811 INFO:tasks.workunit.client.1.smithi093.stdout:1/524: creat d4/d1a/d1b/fab x:0 0 0 2023-12-12T11:51:52.811 INFO:tasks.workunit.client.0.smithi063.stdout:4/354: dread d2/d8/f49 [4194304,4194304] 0 2023-12-12T11:51:52.817 INFO:tasks.workunit.client.1.smithi093.stdout:1/525: dread d4/d1a/d73/f50 [0,4194304] 0 2023-12-12T11:51:52.817 INFO:tasks.workunit.client.0.smithi063.stdout:0/284: dread d0/d7/f31 [0,4194304] 0 2023-12-12T11:51:52.817 INFO:tasks.workunit.client.0.smithi063.stdout:8/406: dwrite d4/de/d1e/f7b [0,4194304] 0 2023-12-12T11:51:52.817 INFO:tasks.workunit.client.1.smithi093.stdout:0/551: mknod d5/dd/d14/d26/d58/d64/d6f/caa 0 2023-12-12T11:51:52.821 INFO:tasks.workunit.client.1.smithi093.stdout:8/565: mkdir d3/d1a/d1f/d29/d3a/db1 0 2023-12-12T11:51:52.825 INFO:tasks.workunit.client.0.smithi063.stdout:2/270: getdents d0/d1a 0 2023-12-12T11:51:52.827 INFO:tasks.workunit.client.1.smithi093.stdout:3/517: symlink df/laa 0 2023-12-12T11:51:52.828 INFO:tasks.workunit.client.0.smithi063.stdout:8/407: dread d4/f42 [0,4194304] 0 2023-12-12T11:51:52.828 INFO:tasks.workunit.client.0.smithi063.stdout:8/408: dread - d4/de/d3b/d62/f6f zero size 2023-12-12T11:51:52.830 INFO:tasks.workunit.client.1.smithi093.stdout:2/571: link d5/d14/d2d/d12/d25/f29 d5/d14/d47/d56/d6f/d73/fc0 0 2023-12-12T11:51:52.830 INFO:tasks.workunit.client.1.smithi093.stdout:2/572: chown d5/d14/d47/d56/d6f/d73 3847 1 2023-12-12T11:51:52.831 INFO:tasks.workunit.client.0.smithi063.stdout:1/290: dread d3/db/d12/f27 [0,4194304] 0 2023-12-12T11:51:52.834 INFO:tasks.workunit.client.1.smithi093.stdout:4/717: mkdir d0/d31/d5c/d6c/de2 0 2023-12-12T11:51:52.834 INFO:tasks.workunit.client.1.smithi093.stdout:4/718: write d0/d87/d79/d86/f8a [5094848,91800] 0 2023-12-12T11:51:52.834 INFO:tasks.workunit.client.1.smithi093.stdout:4/719: truncate d0/f14 5237422 0 2023-12-12T11:51:52.834 INFO:tasks.workunit.client.1.smithi093.stdout:4/720: stat d0/d36/d49/f8c 0 2023-12-12T11:51:52.839 INFO:tasks.workunit.client.0.smithi063.stdout:0/285: fsync d0/d7/d27/f33 0 2023-12-12T11:51:52.840 INFO:tasks.workunit.client.1.smithi093.stdout:7/476: getdents da/d15/d19/d90/d7d 0 2023-12-12T11:51:52.845 INFO:tasks.workunit.client.0.smithi063.stdout:9/265: rmdir d7/d20/d35 0 2023-12-12T11:51:52.847 INFO:tasks.workunit.client.1.smithi093.stdout:6/657: sync 2023-12-12T11:51:52.847 INFO:tasks.workunit.client.1.smithi093.stdout:9/500: sync 2023-12-12T11:51:52.847 INFO:tasks.workunit.client.1.smithi093.stdout:6/658: fdatasync d0/d52/d6b/fe0 0 2023-12-12T11:51:52.847 INFO:tasks.workunit.client.1.smithi093.stdout:6/659: fdatasync d0/da/d14/d9c/fad 0 2023-12-12T11:51:52.849 INFO:tasks.workunit.client.0.smithi063.stdout:1/291: dread f2 [0,4194304] 0 2023-12-12T11:51:52.854 INFO:tasks.workunit.client.1.smithi093.stdout:1/526: symlink d4/dc/lac 0 2023-12-12T11:51:52.854 INFO:tasks.workunit.client.1.smithi093.stdout:5/438: sync 2023-12-12T11:51:52.854 INFO:tasks.workunit.client.1.smithi093.stdout:5/439: chown d0/d7 80421 1 2023-12-12T11:51:52.859 INFO:tasks.workunit.client.0.smithi063.stdout:5/324: symlink d7/l61 0 2023-12-12T11:51:52.860 INFO:tasks.workunit.client.0.smithi063.stdout:5/325: stat d7/d10/d2b/d3c/f2d 0 2023-12-12T11:51:52.860 INFO:tasks.workunit.client.0.smithi063.stdout:4/355: unlink d2/d47/f3f 0 2023-12-12T11:51:52.860 INFO:tasks.workunit.client.1.smithi093.stdout:2/573: mknod d5/d14/d2d/d4c/d54/d67/cc1 0 2023-12-12T11:51:52.860 INFO:tasks.workunit.client.1.smithi093.stdout:2/574: dread - d5/d14/d2d/d8b/da2/fb7 zero size 2023-12-12T11:51:52.862 INFO:tasks.workunit.client.0.smithi063.stdout:3/263: mkdir d4/df/d1a/d1c/d57 0 2023-12-12T11:51:52.869 INFO:tasks.workunit.client.1.smithi093.stdout:4/721: unlink d0/d36/d61/fd6 0 2023-12-12T11:51:52.875 INFO:tasks.workunit.client.0.smithi063.stdout:6/351: write d9/d10/f22 [1059461,127238] 0 2023-12-12T11:51:52.875 INFO:tasks.workunit.client.0.smithi063.stdout:6/352: getdents d9/d2c/d6b 0 2023-12-12T11:51:52.875 INFO:tasks.workunit.client.0.smithi063.stdout:6/353: chown d9/d10/f47 3453393 1 2023-12-12T11:51:52.876 INFO:tasks.workunit.client.1.smithi093.stdout:7/477: creat da/de/d46/d4f/fa8 x:0 0 0 2023-12-12T11:51:52.883 INFO:tasks.workunit.client.1.smithi093.stdout:9/501: symlink d1/d23/d24/d29/d43/d56/laa 0 2023-12-12T11:51:52.885 INFO:tasks.workunit.client.0.smithi063.stdout:7/287: mkdir de/d22/d6e 0 2023-12-12T11:51:52.885 INFO:tasks.workunit.client.1.smithi093.stdout:4/722: dread d0/d36/f59 [0,4194304] 0 2023-12-12T11:51:52.891 INFO:tasks.workunit.client.0.smithi063.stdout:0/286: rename d0/c5f to d0/c62 0 2023-12-12T11:51:52.891 INFO:tasks.workunit.client.0.smithi063.stdout:0/287: fsync d0/d7/f55 0 2023-12-12T11:51:52.892 INFO:tasks.workunit.client.1.smithi093.stdout:5/440: creat d0/d7/d36/d29/d44/f94 x:0 0 0 2023-12-12T11:51:52.902 INFO:tasks.workunit.client.0.smithi063.stdout:1/292: creat d3/d3a/d5e/f5f x:0 0 0 2023-12-12T11:51:52.902 INFO:tasks.workunit.client.1.smithi093.stdout:8/566: dwrite d3/d1a/d1f/d29/d3a/d68/d8a/f94 [4194304,4194304] 0 2023-12-12T11:51:52.903 INFO:tasks.workunit.client.0.smithi063.stdout:5/326: mkdir d7/d10/d2b/d3c/d42/d62 0 2023-12-12T11:51:52.904 INFO:tasks.workunit.client.0.smithi063.stdout:5/327: write d7/f12 [2411401,101170] 0 2023-12-12T11:51:52.905 INFO:tasks.workunit.client.1.smithi093.stdout:4/723: dread d0/d87/fc6 [0,4194304] 0 2023-12-12T11:51:52.906 INFO:tasks.workunit.client.1.smithi093.stdout:4/724: creat d0/d36/d61/fe3 x:0 0 0 2023-12-12T11:51:52.906 INFO:tasks.workunit.client.1.smithi093.stdout:4/725: creat d0/d31/d5c/d66/fe4 x:0 0 0 2023-12-12T11:51:52.906 INFO:tasks.workunit.client.1.smithi093.stdout:3/518: getdents df/d22/d49/d69/d78 0 2023-12-12T11:51:52.907 INFO:tasks.workunit.client.1.smithi093.stdout:2/575: link d5/d14/d47/d56/d6f/d73/l87 d5/d14/d2d/d12/db4/lc2 0 2023-12-12T11:51:52.910 INFO:tasks.workunit.client.1.smithi093.stdout:7/478: mkdir da/d8e/da9 0 2023-12-12T11:51:52.912 INFO:tasks.workunit.client.0.smithi063.stdout:2/271: rmdir d0/d1a/d48/d56 39 2023-12-12T11:51:52.913 INFO:tasks.workunit.client.0.smithi063.stdout:2/272: truncate d0/d1a/d26/f44 369152 0 2023-12-12T11:51:52.913 INFO:tasks.workunit.client.0.smithi063.stdout:2/273: read - d0/f49 zero size 2023-12-12T11:51:52.914 INFO:tasks.workunit.client.0.smithi063.stdout:9/266: dwrite d7/f1e [0,4194304] 0 2023-12-12T11:51:52.914 INFO:tasks.workunit.client.0.smithi063.stdout:9/267: getdents d7/d11/d4b 0 2023-12-12T11:51:52.914 INFO:tasks.workunit.client.0.smithi063.stdout:9/268: fdatasync d7/d11/d12/d30/f48 0 2023-12-12T11:51:52.915 INFO:tasks.workunit.client.1.smithi093.stdout:6/660: dwrite d0/da/d32/d39/d5b/fa2 [0,4194304] 0 2023-12-12T11:51:52.916 INFO:tasks.workunit.client.0.smithi063.stdout:8/409: dwrite d4/de/f43 [0,4194304] 0 2023-12-12T11:51:52.917 INFO:tasks.workunit.client.1.smithi093.stdout:9/502: unlink d1/d12/d1f/d32/c95 0 2023-12-12T11:51:52.917 INFO:tasks.workunit.client.1.smithi093.stdout:9/503: creat d1/d12/d1f/d73/fab x:0 0 0 2023-12-12T11:51:52.922 INFO:tasks.workunit.client.1.smithi093.stdout:1/527: mknod d4/d81/cad 0 2023-12-12T11:51:52.922 INFO:tasks.workunit.client.1.smithi093.stdout:1/528: chown d4/d1a/d1b/l90 448227 1 2023-12-12T11:51:52.922 INFO:tasks.workunit.client.1.smithi093.stdout:1/529: chown d4/dc/f9f 0 1 2023-12-12T11:51:52.926 INFO:tasks.workunit.client.0.smithi063.stdout:0/288: symlink d0/d1a/d23/l63 0 2023-12-12T11:51:52.929 INFO:tasks.workunit.client.1.smithi093.stdout:5/441: creat d0/d7/d8/d8f/f95 x:0 0 0 2023-12-12T11:51:52.932 INFO:tasks.workunit.client.1.smithi093.stdout:8/567: truncate d3/d8/f39 1305995 0 2023-12-12T11:51:52.936 INFO:tasks.workunit.client.0.smithi063.stdout:3/264: dwrite d4/f25 [4194304,4194304] 0 2023-12-12T11:51:52.936 INFO:tasks.workunit.client.0.smithi063.stdout:5/328: mkdir d7/d10/d2b/d3c/d63 0 2023-12-12T11:51:52.936 INFO:tasks.workunit.client.0.smithi063.stdout:5/329: chown d7/d10/d2b/d3c/d42/d62 6 1 2023-12-12T11:51:52.936 INFO:tasks.workunit.client.0.smithi063.stdout:5/330: dread - d7/d10/d2b/f4b zero size 2023-12-12T11:51:52.936 INFO:tasks.workunit.client.0.smithi063.stdout:4/356: getdents d2/d48/d4f 0 2023-12-12T11:51:52.936 INFO:tasks.workunit.client.0.smithi063.stdout:1/293: dread d3/db/d16/d24/f2a [0,4194304] 0 2023-12-12T11:51:52.938 INFO:tasks.workunit.client.1.smithi093.stdout:0/552: rename d5/dd/d14/d8c to d5/dd/d14/d26/d58/dab 0 2023-12-12T11:51:52.945 INFO:tasks.workunit.client.1.smithi093.stdout:4/726: link d0/d36/f60 d0/d31/d9d/da0/fe5 0 2023-12-12T11:51:52.947 INFO:tasks.workunit.client.0.smithi063.stdout:9/269: rename d7/f9 to d7/d11/f4f 0 2023-12-12T11:51:52.948 INFO:tasks.workunit.client.1.smithi093.stdout:3/519: mknod df/d36/d3d/d42/cab 0 2023-12-12T11:51:52.950 INFO:tasks.workunit.client.0.smithi063.stdout:8/410: symlink d4/de/d3b/d62/d6e/l7d 0 2023-12-12T11:51:52.951 INFO:tasks.workunit.client.0.smithi063.stdout:8/411: write d4/de/d3b/d62/d6e/f60 [62649,113183] 0 2023-12-12T11:51:52.951 INFO:tasks.workunit.client.0.smithi063.stdout:7/288: mkdir de/d22/d6f 0 2023-12-12T11:51:52.954 INFO:tasks.workunit.client.1.smithi093.stdout:4/727: dread d0/d31/f3b [4194304,4194304] 0 2023-12-12T11:51:52.954 INFO:tasks.workunit.client.1.smithi093.stdout:2/576: mkdir d5/d46/d61/dc3 0 2023-12-12T11:51:52.967 INFO:tasks.workunit.client.0.smithi063.stdout:9/270: mknod d7/d11/c50 0 2023-12-12T11:51:52.967 INFO:tasks.workunit.client.1.smithi093.stdout:6/661: symlink d0/da/d32/d9e/d4d/de9/lfb 0 2023-12-12T11:51:52.968 INFO:tasks.workunit.client.0.smithi063.stdout:3/265: rename d4/f7 to d4/df/d1a/d1c/d41/f58 0 2023-12-12T11:51:52.975 INFO:tasks.workunit.client.1.smithi093.stdout:9/504: chown d1/d23/f2a 309514 1 2023-12-12T11:51:52.975 INFO:tasks.workunit.client.1.smithi093.stdout:9/505: creat d1/d23/d24/d29/d43/d58/fac x:0 0 0 2023-12-12T11:51:52.975 INFO:tasks.workunit.client.1.smithi093.stdout:9/506: write d1/d12/f1c [1824290,100510] 0 2023-12-12T11:51:52.976 INFO:tasks.workunit.client.0.smithi063.stdout:7/289: creat de/d39/d4b/f70 x:0 0 0 2023-12-12T11:51:52.976 INFO:tasks.workunit.client.0.smithi063.stdout:7/290: chown de/c2a 4443118 1 2023-12-12T11:51:52.980 INFO:tasks.workunit.client.0.smithi063.stdout:9/271: mkdir d7/d20/d45/d46/d51 0 2023-12-12T11:51:52.983 INFO:tasks.workunit.client.1.smithi093.stdout:5/442: mknod d0/d3b/c96 0 2023-12-12T11:51:52.985 INFO:tasks.workunit.client.0.smithi063.stdout:5/331: dread d7/d10/d2b/d3c/d27/f54 [0,4194304] 0 2023-12-12T11:51:52.986 INFO:tasks.workunit.client.0.smithi063.stdout:5/332: creat d7/d10/f64 x:0 0 0 2023-12-12T11:51:52.990 INFO:tasks.workunit.client.0.smithi063.stdout:9/272: rename d7/d11/f21 to d7/d11/d12/d30/f52 0 2023-12-12T11:51:52.994 INFO:tasks.workunit.client.1.smithi093.stdout:8/568: mknod d3/d1a/d1f/d50/cb2 0 2023-12-12T11:51:52.994 INFO:tasks.workunit.client.1.smithi093.stdout:0/553: rmdir d5/dd/d14/d26/d58/d64 39 2023-12-12T11:51:53.007 INFO:tasks.workunit.client.0.smithi063.stdout:2/274: dread d0/d1a/d1e/f27 [0,4194304] 0 2023-12-12T11:51:53.010 INFO:tasks.workunit.client.0.smithi063.stdout:9/273: truncate d7/ff 1365477 0 2023-12-12T11:51:53.011 INFO:tasks.workunit.client.0.smithi063.stdout:9/274: write d7/d11/d12/f4a [686194,4767] 0 2023-12-12T11:51:53.011 INFO:tasks.workunit.client.0.smithi063.stdout:9/275: chown d7/d20/d3f 36739 1 2023-12-12T11:51:53.011 INFO:tasks.workunit.client.0.smithi063.stdout:9/276: truncate d7/fd 247875 0 2023-12-12T11:51:53.015 INFO:tasks.workunit.client.1.smithi093.stdout:4/728: symlink d0/d31/le6 0 2023-12-12T11:51:53.015 INFO:tasks.workunit.client.1.smithi093.stdout:2/577: link d5/d14/d2d/d4c/d54/d67/d69/f8f d5/d14/d2d/d12/d25/d7a/d7e/da0/fc4 0 2023-12-12T11:51:53.015 INFO:tasks.workunit.client.1.smithi093.stdout:4/729: chown d0/d31/d5c/d66/fbf 2631 1 2023-12-12T11:51:53.015 INFO:tasks.workunit.client.1.smithi093.stdout:4/730: truncate d0/d87/d79/d86/fe0 1364411 0 2023-12-12T11:51:53.015 INFO:tasks.workunit.client.1.smithi093.stdout:4/731: creat d0/d31/d5c/d66/fe7 x:0 0 0 2023-12-12T11:51:53.016 INFO:tasks.workunit.client.0.smithi063.stdout:6/354: dwrite d9/f4b [0,4194304] 0 2023-12-12T11:51:53.020 INFO:tasks.workunit.client.1.smithi093.stdout:6/662: getdents d0/da/d32/d9e 0 2023-12-12T11:51:53.023 INFO:tasks.workunit.client.1.smithi093.stdout:7/479: dwrite da/de/f30 [0,4194304] 0 2023-12-12T11:51:53.023 INFO:tasks.workunit.client.0.smithi063.stdout:9/277: unlink d7/f19 0 2023-12-12T11:51:53.023 INFO:tasks.workunit.client.0.smithi063.stdout:9/278: stat d7/d20/d3f/d40 0 2023-12-12T11:51:53.024 INFO:tasks.workunit.client.0.smithi063.stdout:8/412: dread d4/de/d1e/f7b [0,4194304] 0 2023-12-12T11:51:53.031 INFO:tasks.workunit.client.0.smithi063.stdout:2/275: link d0/d1a/d48/l2f d0/d1a/d57/l5c 0 2023-12-12T11:51:53.033 INFO:tasks.workunit.client.0.smithi063.stdout:4/357: dwrite d2/d48/d4f/f5e [0,4194304] 0 2023-12-12T11:51:53.040 INFO:tasks.workunit.client.1.smithi093.stdout:2/578: write d5/d31/f45 [572715,99261] 0 2023-12-12T11:51:53.044 INFO:tasks.workunit.client.1.smithi093.stdout:8/569: mknod d3/d1a/d1f/d29/d3a/d40/cb3 0 2023-12-12T11:51:53.053 INFO:tasks.workunit.client.1.smithi093.stdout:0/554: symlink d5/dd/d14/d26/d58/d64/d6f/d90/lac 0 2023-12-12T11:51:53.060 INFO:tasks.workunit.client.1.smithi093.stdout:1/530: rename d4/l58 to d4/d1a/d83/d9a/lae 0 2023-12-12T11:51:53.060 INFO:tasks.workunit.client.1.smithi093.stdout:1/531: fdatasync d4/d1a/d1b/d26/f7d 0 2023-12-12T11:51:53.065 INFO:tasks.workunit.client.1.smithi093.stdout:5/443: dwrite d0/d7/d36/f90 [0,4194304] 0 2023-12-12T11:51:53.065 INFO:tasks.workunit.client.1.smithi093.stdout:5/444: dread - d0/d7/d59/f7e zero size 2023-12-12T11:51:53.069 INFO:tasks.workunit.client.0.smithi063.stdout:9/279: creat d7/d11/f53 x:0 0 0 2023-12-12T11:51:53.069 INFO:tasks.workunit.client.0.smithi063.stdout:7/291: fsync de/d39/d4b/f70 0 2023-12-12T11:51:53.071 INFO:tasks.workunit.client.0.smithi063.stdout:2/276: mknod d0/c5d 0 2023-12-12T11:51:53.071 INFO:tasks.workunit.client.0.smithi063.stdout:2/277: dread - d0/f4c zero size 2023-12-12T11:51:53.071 INFO:tasks.workunit.client.0.smithi063.stdout:2/278: write d0/d1a/d48/f4a [947769,60904] 0 2023-12-12T11:51:53.071 INFO:tasks.workunit.client.0.smithi063.stdout:2/279: fsync d0/d1a/d48/f3d 0 2023-12-12T11:51:53.072 INFO:tasks.workunit.client.1.smithi093.stdout:3/520: dwrite df/d36/f63 [0,4194304] 0 2023-12-12T11:51:53.074 INFO:tasks.workunit.client.0.smithi063.stdout:6/355: dread d9/f27 [0,4194304] 0 2023-12-12T11:51:53.074 INFO:tasks.workunit.client.0.smithi063.stdout:3/266: dwrite d4/df/d1a/f2e [0,4194304] 0 2023-12-12T11:51:53.074 INFO:tasks.workunit.client.0.smithi063.stdout:3/267: fsync d4/d23/f4b 0 2023-12-12T11:51:53.076 INFO:tasks.workunit.client.1.smithi093.stdout:6/663: mkdir d0/d52/d6b/ddb/dfc 0 2023-12-12T11:51:53.076 INFO:tasks.workunit.client.1.smithi093.stdout:6/664: creat d0/da/d14/d21/ffd x:0 0 0 2023-12-12T11:51:53.087 INFO:tasks.workunit.client.1.smithi093.stdout:8/570: creat d3/d8/d88/fb4 x:0 0 0 2023-12-12T11:51:53.087 INFO:tasks.workunit.client.1.smithi093.stdout:8/571: dread - d3/d1a/d1f/d29/d3a/d68/f92 zero size 2023-12-12T11:51:53.088 INFO:tasks.workunit.client.0.smithi063.stdout:5/333: dwrite d7/d10/d35/f39 [0,4194304] 0 2023-12-12T11:51:53.091 INFO:tasks.workunit.client.1.smithi093.stdout:7/480: write da/d15/d19/f1e [3134882,52420] 0 2023-12-12T11:51:53.093 INFO:tasks.workunit.client.0.smithi063.stdout:0/289: dwrite d0/d7/d27/d19/d2d/f49 [0,4194304] 0 2023-12-12T11:51:53.093 INFO:tasks.workunit.client.0.smithi063.stdout:0/290: fdatasync d0/d1a/d23/f54 0 2023-12-12T11:51:53.093 INFO:tasks.workunit.client.0.smithi063.stdout:0/291: stat d0/d1a/d23/d34/d42/f3e 0 2023-12-12T11:51:53.093 INFO:tasks.workunit.client.0.smithi063.stdout:0/292: fdatasync d0/d7/d27/d1f/f3f 0 2023-12-12T11:51:53.093 INFO:tasks.workunit.client.0.smithi063.stdout:0/293: creat d0/d1a/d23/d2e/f64 x:0 0 0 2023-12-12T11:51:53.093 INFO:tasks.workunit.client.0.smithi063.stdout:0/294: truncate d0/d7/d27/d19/f51 1611170 0 2023-12-12T11:51:53.095 INFO:tasks.workunit.client.1.smithi093.stdout:9/507: rename d1/d23/f80 to d1/d12/d1f/d3d/d57/d63/fad 0 2023-12-12T11:51:53.097 INFO:tasks.workunit.client.0.smithi063.stdout:7/292: mkdir de/d33/d71 0 2023-12-12T11:51:53.098 INFO:tasks.workunit.client.0.smithi063.stdout:1/294: dwrite d3/db/d16/f5c [0,4194304] 0 2023-12-12T11:51:53.098 INFO:tasks.workunit.client.0.smithi063.stdout:7/293: fsync de/d34/f4f 0 2023-12-12T11:51:53.098 INFO:tasks.workunit.client.0.smithi063.stdout:7/294: chown de/d22 84078 1 2023-12-12T11:51:53.098 INFO:tasks.workunit.client.1.smithi093.stdout:2/579: dread d5/d14/d2d/d12/f99 [4194304,4194304] 0 2023-12-12T11:51:53.106 INFO:tasks.workunit.client.1.smithi093.stdout:9/508: dread d1/d12/d1f/d32/f49 [0,4194304] 0 2023-12-12T11:51:53.112 INFO:tasks.workunit.client.0.smithi063.stdout:2/280: symlink d0/d1a/l5e 0 2023-12-12T11:51:53.113 INFO:tasks.workunit.client.0.smithi063.stdout:2/281: write d0/d1a/d48/f3f [5231301,21515] 0 2023-12-12T11:51:53.116 INFO:tasks.workunit.client.1.smithi093.stdout:7/481: read da/d2e/f79 [1428249,107443] 0 2023-12-12T11:51:53.116 INFO:tasks.workunit.client.1.smithi093.stdout:7/482: truncate da/d2e/f8f 459952 0 2023-12-12T11:51:53.130 INFO:tasks.workunit.client.0.smithi063.stdout:1/295: write d3/db/d16/d24/d30/f3d [2817462,13025] 0 2023-12-12T11:51:53.132 INFO:tasks.workunit.client.0.smithi063.stdout:6/356: creat d9/d10/f71 x:0 0 0 2023-12-12T11:51:53.142 INFO:tasks.workunit.client.1.smithi093.stdout:2/580: write d5/d46/d55/f8e [4148179,118752] 0 2023-12-12T11:51:53.142 INFO:tasks.workunit.client.1.smithi093.stdout:3/521: dread df/f68 [0,4194304] 0 2023-12-12T11:51:53.146 INFO:tasks.workunit.client.1.smithi093.stdout:4/732: rename d0/d36/d61/l72 to d0/d87/d79/d7f/le8 0 2023-12-12T11:51:53.152 INFO:tasks.workunit.client.1.smithi093.stdout:9/509: mkdir d1/d12/d1f/d3d/dae 0 2023-12-12T11:51:53.154 INFO:tasks.workunit.client.1.smithi093.stdout:7/483: unlink da/d15/c40 0 2023-12-12T11:51:53.158 INFO:tasks.workunit.client.1.smithi093.stdout:5/445: rmdir d0/d7/d59/d35/d6a 39 2023-12-12T11:51:53.158 INFO:tasks.workunit.client.1.smithi093.stdout:5/446: write d0/d3b/f75 [410895,122747] 0 2023-12-12T11:51:53.158 INFO:tasks.workunit.client.1.smithi093.stdout:5/447: chown d0/d7/d59/c54 1773 1 2023-12-12T11:51:53.162 INFO:tasks.workunit.client.1.smithi093.stdout:8/572: rename d3/d1a/d1f/d59/d69/l72 to d3/d1a/d1f/d29/d3a/db1/lb5 0 2023-12-12T11:51:53.162 INFO:tasks.workunit.client.1.smithi093.stdout:8/573: write d3/f91 [9229588,41398] 0 2023-12-12T11:51:53.162 INFO:tasks.workunit.client.1.smithi093.stdout:8/574: chown d3/d1a/d1f/d29/d3a 1567 1 2023-12-12T11:51:53.163 INFO:tasks.workunit.client.0.smithi063.stdout:5/334: dread d7/f29 [0,4194304] 0 2023-12-12T11:51:53.163 INFO:tasks.workunit.client.1.smithi093.stdout:4/733: symlink d0/d31/d5c/le9 0 2023-12-12T11:51:53.165 INFO:tasks.workunit.client.1.smithi093.stdout:7/484: mkdir da/d8e/daa 0 2023-12-12T11:51:53.165 INFO:tasks.workunit.client.1.smithi093.stdout:7/485: read - da/de/f38 zero size 2023-12-12T11:51:53.166 INFO:tasks.workunit.client.1.smithi093.stdout:7/486: write da/d15/d2d/f34 [1763028,118938] 0 2023-12-12T11:51:53.166 INFO:tasks.workunit.client.0.smithi063.stdout:8/413: dwrite d4/f42 [0,4194304] 0 2023-12-12T11:51:53.166 INFO:tasks.workunit.client.1.smithi093.stdout:3/522: dread df/d36/d3d/d42/f53 [0,4194304] 0 2023-12-12T11:51:53.167 INFO:tasks.workunit.client.0.smithi063.stdout:2/282: write d0/d1a/d1e/f35 [3313383,49530] 0 2023-12-12T11:51:53.167 INFO:tasks.workunit.client.0.smithi063.stdout:2/283: stat d0/l5b 0 2023-12-12T11:51:53.168 INFO:tasks.workunit.client.1.smithi093.stdout:1/532: dwrite d4/f25 [0,4194304] 0 2023-12-12T11:51:53.168 INFO:tasks.workunit.client.1.smithi093.stdout:7/487: write da/d15/d2d/f6e [555981,42439] 0 2023-12-12T11:51:53.168 INFO:tasks.workunit.client.1.smithi093.stdout:7/488: chown da/d15/f1c 4700190 1 2023-12-12T11:51:53.168 INFO:tasks.workunit.client.1.smithi093.stdout:7/489: truncate da/de/f72 1925066 0 2023-12-12T11:51:53.169 INFO:tasks.workunit.client.0.smithi063.stdout:7/295: dwrite de/d33/f42 [0,4194304] 0 2023-12-12T11:51:53.169 INFO:tasks.workunit.client.0.smithi063.stdout:7/296: creat de/d3f/f72 x:0 0 0 2023-12-12T11:51:53.170 INFO:tasks.workunit.client.1.smithi093.stdout:8/575: creat d3/d73/fb6 x:0 0 0 2023-12-12T11:51:53.172 INFO:tasks.workunit.client.0.smithi063.stdout:3/268: dwrite d4/df/d1a/d1c/f29 [0,4194304] 0 2023-12-12T11:51:53.172 INFO:tasks.workunit.client.1.smithi093.stdout:9/510: dread d1/fa [0,4194304] 0 2023-12-12T11:51:53.172 INFO:tasks.workunit.client.1.smithi093.stdout:6/665: dwrite d0/da/d14/d38/fc3 [0,4194304] 0 2023-12-12T11:51:53.173 INFO:tasks.workunit.client.0.smithi063.stdout:0/295: creat d0/f65 x:0 0 0 2023-12-12T11:51:53.173 INFO:tasks.workunit.client.0.smithi063.stdout:0/296: readlink d0/d7/d27/d1f/l57 0 2023-12-12T11:51:53.173 INFO:tasks.workunit.client.0.smithi063.stdout:0/297: write d0/d1a/d23/d34/d42/f3e [599295,28065] 0 2023-12-12T11:51:53.173 INFO:tasks.workunit.client.1.smithi093.stdout:1/533: creat d4/d1a/d83/d9a/faf x:0 0 0 2023-12-12T11:51:53.174 INFO:tasks.workunit.client.1.smithi093.stdout:1/534: chown d4/fd 46 1 2023-12-12T11:51:53.175 INFO:tasks.workunit.client.0.smithi063.stdout:9/280: rename d7/d15/f33 to d7/f54 0 2023-12-12T11:51:53.176 INFO:tasks.workunit.client.1.smithi093.stdout:7/490: symlink da/d2e/d89/lab 0 2023-12-12T11:51:53.180 INFO:tasks.workunit.client.0.smithi063.stdout:1/296: creat d3/d3a/f60 x:0 0 0 2023-12-12T11:51:53.180 INFO:tasks.workunit.client.0.smithi063.stdout:1/297: getdents d3/db/d16/d24/d4d/d35/d5a/d5b 0 2023-12-12T11:51:53.182 INFO:tasks.workunit.client.1.smithi093.stdout:6/666: dread d0/da/d14/f72 [0,4194304] 0 2023-12-12T11:51:53.183 INFO:tasks.workunit.client.0.smithi063.stdout:6/357: link d9/d10/f41 d9/d2c/d6b/f72 0 2023-12-12T11:51:53.184 INFO:tasks.workunit.client.0.smithi063.stdout:2/284: dread d0/f17 [0,4194304] 0 2023-12-12T11:51:53.184 INFO:tasks.workunit.client.0.smithi063.stdout:2/285: chown d0/d1a/d1e 11718569 1 2023-12-12T11:51:53.197 INFO:tasks.workunit.client.0.smithi063.stdout:3/269: mknod d4/df/d1a/d1c/d3b/d52/c59 0 2023-12-12T11:51:53.199 INFO:tasks.workunit.client.0.smithi063.stdout:7/297: dread de/d3f/f6d [0,4194304] 0 2023-12-12T11:51:53.199 INFO:tasks.workunit.client.0.smithi063.stdout:0/298: mkdir d0/d1a/d66 0 2023-12-12T11:51:53.200 INFO:tasks.workunit.client.0.smithi063.stdout:7/298: creat de/d22/d2b/d61/f73 x:0 0 0 2023-12-12T11:51:53.200 INFO:tasks.workunit.client.0.smithi063.stdout:7/299: chown de/f4c 0 1 2023-12-12T11:51:53.200 INFO:tasks.workunit.client.0.smithi063.stdout:7/300: read fb [2851705,2544] 0 2023-12-12T11:51:53.200 INFO:tasks.workunit.client.0.smithi063.stdout:7/301: write fb [4665184,12274] 0 2023-12-12T11:51:53.209 INFO:tasks.workunit.client.0.smithi063.stdout:8/414: rename d4/de/d3b/d62/l5a to d4/d24/d38/l7e 0 2023-12-12T11:51:53.217 INFO:tasks.workunit.client.1.smithi093.stdout:3/523: mkdir df/d25/d2c/d85/dac 0 2023-12-12T11:51:53.217 INFO:tasks.workunit.client.0.smithi063.stdout:6/358: unlink d9/d10/d25/c62 0 2023-12-12T11:51:53.219 INFO:tasks.workunit.client.1.smithi093.stdout:9/511: symlink d1/d12/d3e/laf 0 2023-12-12T11:51:53.219 INFO:tasks.workunit.client.1.smithi093.stdout:9/512: truncate d1/d23/d24/d29/fa0 108359 0 2023-12-12T11:51:53.224 INFO:tasks.workunit.client.0.smithi063.stdout:2/286: rename d0/f33 to d0/f5f 0 2023-12-12T11:51:53.227 INFO:tasks.workunit.client.0.smithi063.stdout:0/299: read d0/d1a/d23/f54 [2360603,57527] 0 2023-12-12T11:51:53.229 INFO:tasks.workunit.client.0.smithi063.stdout:0/300: write d0/d1a/d23/d34/d42/f3e [999706,92020] 0 2023-12-12T11:51:53.229 INFO:tasks.workunit.client.0.smithi063.stdout:0/301: dread - d0/f65 zero size 2023-12-12T11:51:53.230 INFO:tasks.workunit.client.1.smithi093.stdout:9/513: dread d1/d12/d1f/d3d/d57/f67 [0,4194304] 0 2023-12-12T11:51:53.231 INFO:tasks.workunit.client.1.smithi093.stdout:9/514: stat d1/f54 0 2023-12-12T11:51:53.231 INFO:tasks.workunit.client.1.smithi093.stdout:7/491: mknod da/d15/d2d/d2f/cac 0 2023-12-12T11:51:53.231 INFO:tasks.workunit.client.0.smithi063.stdout:9/281: dread f6 [0,4194304] 0 2023-12-12T11:51:53.232 INFO:tasks.workunit.client.0.smithi063.stdout:9/282: chown d7/d20/d3f/d40/d4e 56 1 2023-12-12T11:51:53.232 INFO:tasks.workunit.client.0.smithi063.stdout:3/270: creat d4/df/d1a/d1c/d3b/d50/f5a x:0 0 0 2023-12-12T11:51:53.235 INFO:tasks.workunit.client.1.smithi093.stdout:8/576: dwrite d3/d1a/d1f/d29/d30/f8d [0,4194304] 0 2023-12-12T11:51:53.235 INFO:tasks.workunit.client.1.smithi093.stdout:8/577: fdatasync d3/f42 0 2023-12-12T11:51:53.236 INFO:tasks.workunit.client.0.smithi063.stdout:5/335: dwrite d7/d10/f46 [0,4194304] 0 2023-12-12T11:51:53.236 INFO:tasks.workunit.client.1.smithi093.stdout:6/667: dwrite d0/da/d32/dd3/f94 [0,4194304] 0 2023-12-12T11:51:53.236 INFO:tasks.workunit.client.1.smithi093.stdout:6/668: write d0/d52/d7e/f67 [93055,87727] 0 2023-12-12T11:51:53.238 INFO:tasks.workunit.client.1.smithi093.stdout:2/581: rename d5/d46 to d5/d14/d2d/d4c/d54/dc5 0 2023-12-12T11:51:53.241 INFO:tasks.workunit.client.1.smithi093.stdout:9/515: dread d1/d23/d24/d29/d43/f48 [0,4194304] 0 2023-12-12T11:51:53.248 INFO:tasks.workunit.client.1.smithi093.stdout:7/492: read da/de/f30 [3509143,42986] 0 2023-12-12T11:51:53.249 INFO:tasks.workunit.client.1.smithi093.stdout:1/535: symlink d4/lb0 0 2023-12-12T11:51:53.251 INFO:tasks.workunit.client.0.smithi063.stdout:1/298: rename d3/db/d16/c18 to d3/db/d16/d24/c61 0 2023-12-12T11:51:53.251 INFO:tasks.workunit.client.0.smithi063.stdout:1/299: write d3/db/d16/d17/f55 [208,73093] 0 2023-12-12T11:51:53.254 INFO:tasks.workunit.client.0.smithi063.stdout:8/415: mkdir d4/de/d3b/d62/d36/d7f 0 2023-12-12T11:51:53.254 INFO:tasks.workunit.client.0.smithi063.stdout:8/416: readlink d4/d24/d38/l7e 0 2023-12-12T11:51:53.254 INFO:tasks.workunit.client.0.smithi063.stdout:8/417: truncate d4/f17 4995462 0 2023-12-12T11:51:53.274 INFO:tasks.workunit.client.1.smithi093.stdout:5/448: rename d0/d7/d36/d87/c88 to d0/d7/d8/d8f/c97 0 2023-12-12T11:51:53.278 INFO:tasks.workunit.client.0.smithi063.stdout:3/271: dwrite d4/df/d1a/d1c/d3b/f3e [0,4194304] 0 2023-12-12T11:51:53.278 INFO:tasks.workunit.client.0.smithi063.stdout:3/272: stat d4/df/d1a/d1c 0 2023-12-12T11:51:53.281 INFO:tasks.workunit.client.0.smithi063.stdout:6/359: mkdir d9/d10/d73 0 2023-12-12T11:51:53.284 INFO:tasks.workunit.client.1.smithi093.stdout:7/493: dread da/d15/d2d/f34 [0,4194304] 0 2023-12-12T11:51:53.286 INFO:tasks.workunit.client.1.smithi093.stdout:2/582: rmdir d5/d14/d2d/d63 0 2023-12-12T11:51:53.286 INFO:tasks.workunit.client.1.smithi093.stdout:9/516: symlink d1/d12/d1f/d3d/d57/d63/lb0 0 2023-12-12T11:51:53.286 INFO:tasks.workunit.client.1.smithi093.stdout:2/583: truncate d5/d14/d47/d56/d6f/fb0 775981 0 2023-12-12T11:51:53.286 INFO:tasks.workunit.client.1.smithi093.stdout:2/584: write d5/d14/d47/d56/f83 [868754,73077] 0 2023-12-12T11:51:53.286 INFO:tasks.workunit.client.1.smithi093.stdout:2/585: fsync d5/d14/d2d/f1f 0 2023-12-12T11:51:53.286 INFO:tasks.workunit.client.1.smithi093.stdout:9/517: write d1/f94 [4713813,85394] 0 2023-12-12T11:51:53.287 INFO:tasks.workunit.client.0.smithi063.stdout:1/300: read d3/db/d12/f27 [1987661,60148] 0 2023-12-12T11:51:53.289 INFO:tasks.workunit.client.1.smithi093.stdout:3/524: getdents df/d36/d7f 0 2023-12-12T11:51:53.291 INFO:tasks.workunit.client.0.smithi063.stdout:6/360: write d9/f43 [792891,19683] 0 2023-12-12T11:51:53.292 INFO:tasks.workunit.client.0.smithi063.stdout:5/336: mknod d7/d10/c65 0 2023-12-12T11:51:53.294 INFO:tasks.workunit.client.1.smithi093.stdout:1/536: creat d4/d81/fb1 x:0 0 0 2023-12-12T11:51:53.294 INFO:tasks.workunit.client.1.smithi093.stdout:1/537: stat d4/d1a/d1b/d26/l62 0 2023-12-12T11:51:53.306 INFO:tasks.workunit.client.1.smithi093.stdout:9/518: dread d1/f59 [0,4194304] 0 2023-12-12T11:51:53.310 INFO:tasks.workunit.client.0.smithi063.stdout:0/302: dwrite d0/d7/d27/d19/f51 [0,4194304] 0 2023-12-12T11:51:53.311 INFO:tasks.workunit.client.0.smithi063.stdout:0/303: stat d0/d7/f55 0 2023-12-12T11:51:53.311 INFO:tasks.workunit.client.1.smithi093.stdout:8/578: rmdir d3/d8/d88 39 2023-12-12T11:51:53.311 INFO:tasks.workunit.client.1.smithi093.stdout:7/494: dread da/de/f3b [0,4194304] 0 2023-12-12T11:51:53.311 INFO:tasks.workunit.client.1.smithi093.stdout:4/734: rename d0/d31/d9d/da0/fa5 to d0/d87/d79/d96/db5/fea 0 2023-12-12T11:51:53.311 INFO:tasks.workunit.client.1.smithi093.stdout:4/735: chown d0/d87/d79/d96/db5 1407797075 1 2023-12-12T11:51:53.311 INFO:tasks.workunit.client.0.smithi063.stdout:2/287: dwrite d0/d1a/d48/f3f [0,4194304] 0 2023-12-12T11:51:53.315 INFO:tasks.workunit.client.1.smithi093.stdout:3/525: unlink df/d22/d49/l6c 0 2023-12-12T11:51:53.318 INFO:tasks.workunit.client.0.smithi063.stdout:1/301: creat d3/d3a/d54/f62 x:0 0 0 2023-12-12T11:51:53.318 INFO:tasks.workunit.client.0.smithi063.stdout:6/361: unlink d9/d2c/d61/f64 0 2023-12-12T11:51:53.319 INFO:tasks.workunit.client.1.smithi093.stdout:1/538: symlink d4/d1a/da6/lb2 0 2023-12-12T11:51:53.319 INFO:tasks.workunit.client.1.smithi093.stdout:1/539: truncate d4/d1c/d2a/f6e 1583212 0 2023-12-12T11:51:53.324 INFO:tasks.workunit.client.0.smithi063.stdout:5/337: symlink d7/d10/d35/l66 0 2023-12-12T11:51:53.333 INFO:tasks.workunit.client.0.smithi063.stdout:0/304: mkdir d0/d7/d27/d19/d2d/d67 0 2023-12-12T11:51:53.333 INFO:tasks.workunit.client.0.smithi063.stdout:0/305: creat d0/f68 x:0 0 0 2023-12-12T11:51:53.337 INFO:tasks.workunit.client.0.smithi063.stdout:1/302: rename d3/c6 to d3/db/d16/d24/d4d/d35/d5a/c63 0 2023-12-12T11:51:53.339 INFO:tasks.workunit.client.0.smithi063.stdout:6/362: creat d9/f74 x:0 0 0 2023-12-12T11:51:53.339 INFO:tasks.workunit.client.0.smithi063.stdout:6/363: fdatasync d9/d10/f22 0 2023-12-12T11:51:53.340 INFO:tasks.workunit.client.0.smithi063.stdout:5/338: mkdir d7/d28/d67 0 2023-12-12T11:51:53.340 INFO:tasks.workunit.client.0.smithi063.stdout:5/339: chown d7/de/f30 267174290 1 2023-12-12T11:51:53.340 INFO:tasks.workunit.client.0.smithi063.stdout:5/340: chown d7/d28/f5f 1 1 2023-12-12T11:51:53.340 INFO:tasks.workunit.client.0.smithi063.stdout:5/341: stat d7/de/c40 0 2023-12-12T11:51:53.341 INFO:tasks.workunit.client.1.smithi093.stdout:9/519: mkdir d1/d12/d1f/d3d/db1 0 2023-12-12T11:51:53.341 INFO:tasks.workunit.client.1.smithi093.stdout:8/579: creat d3/d1a/d1f/fb7 x:0 0 0 2023-12-12T11:51:53.341 INFO:tasks.workunit.client.1.smithi093.stdout:8/580: fsync d3/d1a/d1f/d29/f79 0 2023-12-12T11:51:53.341 INFO:tasks.workunit.client.1.smithi093.stdout:1/540: mkdir d4/d1a/d1b/d26/d65/d6f/db3 0 2023-12-12T11:51:53.342 INFO:tasks.workunit.client.0.smithi063.stdout:0/306: mknod d0/d7/d27/d19/d2d/d67/c69 0 2023-12-12T11:51:53.342 INFO:tasks.workunit.client.1.smithi093.stdout:1/541: fsync d4/d1a/d1b/f48 0 2023-12-12T11:51:53.342 INFO:tasks.workunit.client.1.smithi093.stdout:2/586: dwrite d5/d14/d2d/d12/d25/fb2 [0,4194304] 0 2023-12-12T11:51:53.342 INFO:tasks.workunit.client.1.smithi093.stdout:2/587: read - d5/fbf zero size 2023-12-12T11:51:53.343 INFO:tasks.workunit.client.1.smithi093.stdout:4/736: symlink d0/d31/d5c/d6c/da4/dc2/leb 0 2023-12-12T11:51:53.343 INFO:tasks.workunit.client.1.smithi093.stdout:4/737: dread - d0/d31/d5c/d66/fe7 zero size 2023-12-12T11:51:53.343 INFO:tasks.workunit.client.1.smithi093.stdout:4/738: truncate d0/d36/d49/f4a 1633667 0 2023-12-12T11:51:53.343 INFO:tasks.workunit.client.1.smithi093.stdout:4/739: dread - d0/d31/d5c/d66/fbf zero size 2023-12-12T11:51:53.346 INFO:tasks.workunit.client.1.smithi093.stdout:9/520: unlink d1/d12/d1f/d73/l8f 0 2023-12-12T11:51:53.346 INFO:tasks.workunit.client.1.smithi093.stdout:0/555: sync 2023-12-12T11:51:53.348 INFO:tasks.workunit.client.0.smithi063.stdout:6/364: link d9/d10/f37 d9/d2c/d6b/f75 0 2023-12-12T11:51:53.357 INFO:tasks.workunit.client.0.smithi063.stdout:5/342: creat d7/d28/d43/f68 x:0 0 0 2023-12-12T11:51:53.358 INFO:tasks.workunit.client.0.smithi063.stdout:5/343: write d7/d10/d2b/d3c/f36 [2048339,26442] 0 2023-12-12T11:51:53.360 INFO:tasks.workunit.client.0.smithi063.stdout:3/273: dwrite d4/f25 [0,4194304] 0 2023-12-12T11:51:53.360 INFO:tasks.workunit.client.0.smithi063.stdout:3/274: readlink d4/df/d1a/d1c/d3b/d50/l4d 0 2023-12-12T11:51:53.361 INFO:tasks.workunit.client.1.smithi093.stdout:8/581: creat d3/d1a/d1f/d75/fb8 x:0 0 0 2023-12-12T11:51:53.364 INFO:tasks.workunit.client.1.smithi093.stdout:3/526: dwrite df/d36/d3d/d42/d9d/fa4 [0,4194304] 0 2023-12-12T11:51:53.372 INFO:tasks.workunit.client.0.smithi063.stdout:0/307: write d0/d7/d27/d19/f51 [530639,11860] 0 2023-12-12T11:51:53.372 INFO:tasks.workunit.client.0.smithi063.stdout:6/365: mknod d9/d10/d5c/d5e/c76 0 2023-12-12T11:51:53.373 INFO:tasks.workunit.client.0.smithi063.stdout:0/308: readlink d0/d7/d27/d1f/l57 0 2023-12-12T11:51:53.373 INFO:tasks.workunit.client.0.smithi063.stdout:5/344: dread d7/f29 [0,4194304] 0 2023-12-12T11:51:53.373 INFO:tasks.workunit.client.0.smithi063.stdout:5/345: chown d7/d10/f1b 205 1 2023-12-12T11:51:53.373 INFO:tasks.workunit.client.1.smithi093.stdout:2/588: mkdir d5/d14/d2d/d4c/d76/dc6 0 2023-12-12T11:51:53.375 INFO:tasks.workunit.client.1.smithi093.stdout:9/521: mkdir d1/d23/d6b/d92/db2 0 2023-12-12T11:51:53.375 INFO:tasks.workunit.client.1.smithi093.stdout:9/522: readlink d1/d12/d1f/d3d/d57/d63/lb0 0 2023-12-12T11:51:53.378 INFO:tasks.workunit.client.0.smithi063.stdout:3/275: creat d4/df/d1a/d1c/d3b/f5b x:0 0 0 2023-12-12T11:51:53.378 INFO:tasks.workunit.client.0.smithi063.stdout:3/276: chown d4/df/d1a/d1c/d3b/f5b 2928 1 2023-12-12T11:51:53.380 INFO:tasks.workunit.client.1.smithi093.stdout:6/669: rename d0/da/d14/d9c to d0/d52/d6b/ddb/dfe 0 2023-12-12T11:51:53.383 INFO:tasks.workunit.client.1.smithi093.stdout:8/582: mknod d3/d1a/d1f/d29/d30/d58/cb9 0 2023-12-12T11:51:53.383 INFO:tasks.workunit.client.1.smithi093.stdout:8/583: readlink d3/d1a/d1f/d29/d30/d58/la3 0 2023-12-12T11:51:53.383 INFO:tasks.workunit.client.1.smithi093.stdout:8/584: chown d3/d1a/d1f/fb7 651 1 2023-12-12T11:51:53.383 INFO:tasks.workunit.client.1.smithi093.stdout:8/585: fdatasync d3/d8/f23 0 2023-12-12T11:51:53.385 INFO:tasks.workunit.client.0.smithi063.stdout:6/366: truncate d9/f4b 3875509 0 2023-12-12T11:51:53.385 INFO:tasks.workunit.client.0.smithi063.stdout:8/418: truncate d4/de/d3b/d62/d6e/d76/f7a 3430106 0 2023-12-12T11:51:53.385 INFO:tasks.workunit.client.1.smithi093.stdout:7/495: dwrite da/d8e/f9e [0,4194304] 0 2023-12-12T11:51:53.386 INFO:tasks.workunit.client.1.smithi093.stdout:9/523: dread d1/d12/d1f/d3d/d5c/f7b [0,4194304] 0 2023-12-12T11:51:53.386 INFO:tasks.workunit.client.1.smithi093.stdout:9/524: write d1/d23/d6b/fa6 [24869,71914] 0 2023-12-12T11:51:53.390 INFO:tasks.workunit.client.1.smithi093.stdout:4/740: write d0/d36/d61/f62 [3700115,113756] 0 2023-12-12T11:51:53.390 INFO:tasks.workunit.client.1.smithi093.stdout:4/741: fdatasync d0/d31/d5c/d66/f84 0 2023-12-12T11:51:53.390 INFO:tasks.workunit.client.0.smithi063.stdout:5/346: mkdir d7/d10/d2b/d3c/d42/d62/d69 0 2023-12-12T11:51:53.391 INFO:tasks.workunit.client.0.smithi063.stdout:2/288: dwrite d0/ff [0,4194304] 0 2023-12-12T11:51:53.391 INFO:tasks.workunit.client.0.smithi063.stdout:3/277: rename d4/df/d1a/d1c/d3b/d52/c59 to d4/df/d1a/d3d/d4c/c5c 0 2023-12-12T11:51:53.392 INFO:tasks.workunit.client.1.smithi093.stdout:1/542: dwrite d4/d1a/d1b/fab [0,4194304] 0 2023-12-12T11:51:53.393 INFO:tasks.workunit.client.1.smithi093.stdout:1/543: chown d4/d1c/d2a/f4b 4 1 2023-12-12T11:51:53.394 INFO:tasks.workunit.client.0.smithi063.stdout:6/367: symlink d9/d10/l77 0 2023-12-12T11:51:53.395 INFO:tasks.workunit.client.1.smithi093.stdout:5/449: rename d0/d7/d8/f84 to d0/d7/d36/d29/f98 0 2023-12-12T11:51:53.396 INFO:tasks.workunit.client.1.smithi093.stdout:6/670: symlink d0/da/d32/d9e/d4d/deb/lff 0 2023-12-12T11:51:53.396 INFO:tasks.workunit.client.1.smithi093.stdout:6/671: write d0/da/d14/d3a/d95/fab [25597,4632] 0 2023-12-12T11:51:53.398 INFO:tasks.workunit.client.0.smithi063.stdout:1/303: getdents d3/db/d16/d24/d4d/d35/d5a 0 2023-12-12T11:51:53.400 INFO:tasks.workunit.client.1.smithi093.stdout:7/496: truncate da/d15/d19/f1e 2859083 0 2023-12-12T11:51:53.400 INFO:tasks.workunit.client.1.smithi093.stdout:7/497: chown da/d15/d59/f66 15 1 2023-12-12T11:51:53.403 INFO:tasks.workunit.client.1.smithi093.stdout:9/525: write d1/d23/f31 [1841507,125468] 0 2023-12-12T11:51:53.403 INFO:tasks.workunit.client.1.smithi093.stdout:9/526: write d1/f4f [875728,124104] 0 2023-12-12T11:51:53.403 INFO:tasks.workunit.client.1.smithi093.stdout:9/527: write d1/d12/d1f/d32/d42/fa7 [6505,16218] 0 2023-12-12T11:51:53.404 INFO:tasks.workunit.client.0.smithi063.stdout:5/347: rename d7/d10/f23 to d7/d10/d2b/d3c/d5a/f6a 0 2023-12-12T11:51:53.404 INFO:tasks.workunit.client.0.smithi063.stdout:5/348: fsync d7/d10/d2b/d3c/f5b 0 2023-12-12T11:51:53.409 INFO:tasks.workunit.client.1.smithi093.stdout:4/742: link d0/d31/d9d/da0/fe5 d0/d36/fec 0 2023-12-12T11:51:53.409 INFO:tasks.workunit.client.1.smithi093.stdout:4/743: write d0/d31/f7c [2495527,19739] 0 2023-12-12T11:51:53.410 INFO:tasks.workunit.client.1.smithi093.stdout:1/544: write d4/d1c/d2a/f2b [1333403,35855] 0 2023-12-12T11:51:53.410 INFO:tasks.workunit.client.1.smithi093.stdout:1/545: chown d4/d1c/d2a/f4b 992605 1 2023-12-12T11:51:53.410 INFO:tasks.workunit.client.1.smithi093.stdout:1/546: read d4/d1a/d73/f4a [2247098,6211] 0 2023-12-12T11:51:53.412 INFO:tasks.workunit.client.0.smithi063.stdout:2/289: creat d0/d1a/d1e/f60 x:0 0 0 2023-12-12T11:51:53.420 INFO:tasks.workunit.client.0.smithi063.stdout:5/349: dread d7/d28/f3f [0,4194304] 0 2023-12-12T11:51:53.425 INFO:tasks.workunit.client.1.smithi093.stdout:5/450: creat d0/d7/f99 x:0 0 0 2023-12-12T11:51:53.425 INFO:tasks.workunit.client.1.smithi093.stdout:5/451: creat d0/d3b/d66/f9a x:0 0 0 2023-12-12T11:51:53.425 INFO:tasks.workunit.client.1.smithi093.stdout:5/452: truncate d0/d7/d59/d48/f50 5086526 0 2023-12-12T11:51:53.428 INFO:tasks.workunit.client.1.smithi093.stdout:7/498: creat da/d15/d19/d4c/fad x:0 0 0 2023-12-12T11:51:53.436 INFO:tasks.workunit.client.1.smithi093.stdout:9/528: creat d1/d23/fb3 x:0 0 0 2023-12-12T11:51:53.439 INFO:tasks.workunit.client.0.smithi063.stdout:6/368: creat d9/d68/f78 x:0 0 0 2023-12-12T11:51:53.444 INFO:tasks.workunit.client.1.smithi093.stdout:0/556: rename d5/c9 to d5/dd/d14/d26/d58/cad 0 2023-12-12T11:51:53.444 INFO:tasks.workunit.client.1.smithi093.stdout:0/557: chown d5/dd/d14/c1f 127428 1 2023-12-12T11:51:53.446 INFO:tasks.workunit.client.0.smithi063.stdout:5/350: dread d7/f12 [0,4194304] 0 2023-12-12T11:51:53.446 INFO:tasks.workunit.client.0.smithi063.stdout:5/351: write d7/de/f1e [3896328,49496] 0 2023-12-12T11:51:53.446 INFO:tasks.workunit.client.0.smithi063.stdout:5/352: chown d7/de/l44 112387 1 2023-12-12T11:51:53.447 INFO:tasks.workunit.client.0.smithi063.stdout:3/278: rename d4/df/d1a/d3d to d4/d23/d5d 0 2023-12-12T11:51:53.450 INFO:tasks.workunit.client.1.smithi093.stdout:7/499: mkdir da/d15/d19/d90/d7d/dae 0 2023-12-12T11:51:53.450 INFO:tasks.workunit.client.1.smithi093.stdout:7/500: chown da/de/f38 364118 1 2023-12-12T11:51:53.452 INFO:tasks.workunit.client.0.smithi063.stdout:6/369: truncate d9/f3b 3114269 0 2023-12-12T11:51:53.457 INFO:tasks.workunit.client.0.smithi063.stdout:8/419: dwrite d4/d55/f59 [0,4194304] 0 2023-12-12T11:51:53.459 INFO:tasks.workunit.client.1.smithi093.stdout:9/529: creat d1/d12/fb4 x:0 0 0 2023-12-12T11:51:53.459 INFO:tasks.workunit.client.1.smithi093.stdout:9/530: truncate d1/d12/d1f/d73/f76 833961 0 2023-12-12T11:51:53.459 INFO:tasks.workunit.client.1.smithi093.stdout:9/531: dread - d1/f54 zero size 2023-12-12T11:51:53.459 INFO:tasks.workunit.client.1.smithi093.stdout:9/532: chown d1/d23/d24/d89/l96 433004 1 2023-12-12T11:51:53.459 INFO:tasks.workunit.client.1.smithi093.stdout:9/533: chown d1/d12/d1f/d32/c47 62106 1 2023-12-12T11:51:53.460 INFO:tasks.workunit.client.1.smithi093.stdout:1/547: dwrite d4/dc/d7a/f8d [0,4194304] 0 2023-12-12T11:51:53.463 INFO:tasks.workunit.client.0.smithi063.stdout:1/304: getdents d3/db/d16/d24 0 2023-12-12T11:51:53.463 INFO:tasks.workunit.client.0.smithi063.stdout:1/305: write d3/db/d12/f50 [1009622,12791] 0 2023-12-12T11:51:53.466 INFO:tasks.workunit.client.0.smithi063.stdout:5/353: mknod d7/de/c6b 0 2023-12-12T11:51:53.469 INFO:tasks.workunit.client.1.smithi093.stdout:0/558: rmdir d5/d21/d27/d3a 39 2023-12-12T11:51:53.469 INFO:tasks.workunit.client.1.smithi093.stdout:0/559: write d5/d21/d27/f5d [4759006,107933] 0 2023-12-12T11:51:53.475 INFO:tasks.workunit.client.1.smithi093.stdout:2/589: rename d5/d14/d2d/d4c/d76/lac to d5/d14/d2d/d4c/lc7 0 2023-12-12T11:51:53.475 INFO:tasks.workunit.client.1.smithi093.stdout:2/590: chown d5/d14/d47/f5b 253532976 1 2023-12-12T11:51:53.476 INFO:tasks.workunit.client.0.smithi063.stdout:5/354: dread d7/d10/f48 [0,4194304] 0 2023-12-12T11:51:53.484 INFO:tasks.workunit.client.0.smithi063.stdout:8/420: symlink d4/d24/d38/d45/d5b/l80 0 2023-12-12T11:51:53.487 INFO:tasks.workunit.client.0.smithi063.stdout:1/306: truncate d3/db/d16/d24/d48/f57 2024824 0 2023-12-12T11:51:53.489 INFO:tasks.workunit.client.1.smithi093.stdout:4/744: dwrite d0/d31/d5c/d66/fbf [0,4194304] 0 2023-12-12T11:51:53.489 INFO:tasks.workunit.client.1.smithi093.stdout:4/745: chown d0/d31/d89/f9c 5993 1 2023-12-12T11:51:53.489 INFO:tasks.workunit.client.1.smithi093.stdout:4/746: fsync d0/f1d 0 2023-12-12T11:51:53.497 INFO:tasks.workunit.client.1.smithi093.stdout:4/747: dread d0/d31/d5c/f6b [0,4194304] 0 2023-12-12T11:51:53.499 INFO:tasks.workunit.client.0.smithi063.stdout:2/290: rename d0/d1a/d3a/c4d to d0/d1a/d48/c61 0 2023-12-12T11:51:53.499 INFO:tasks.workunit.client.0.smithi063.stdout:2/291: chown d0/d1a/d48/l2f 345 1 2023-12-12T11:51:53.502 INFO:tasks.workunit.client.0.smithi063.stdout:3/279: dwrite d4/df/d1a/d1c/d3b/d50/f5a [0,4194304] 0 2023-12-12T11:51:53.504 INFO:tasks.workunit.client.0.smithi063.stdout:5/355: unlink d7/ca 0 2023-12-12T11:51:53.508 INFO:tasks.workunit.client.1.smithi093.stdout:5/453: dwrite d0/f15 [0,4194304] 0 2023-12-12T11:51:53.512 INFO:tasks.workunit.client.0.smithi063.stdout:1/307: creat d3/db/d16/d24/d4d/d35/d5a/d5b/f64 x:0 0 0 2023-12-12T11:51:53.513 INFO:tasks.workunit.client.0.smithi063.stdout:1/308: readlink d3/db/d16/d17/l33 0 2023-12-12T11:51:53.515 INFO:tasks.workunit.client.0.smithi063.stdout:1/309: creat d3/db/d16/d24/d4d/d35/d5a/d5b/f65 x:0 0 0 2023-12-12T11:51:53.515 INFO:tasks.workunit.client.0.smithi063.stdout:1/310: chown d3/db/d16/d24/d30/c4a 2083934 1 2023-12-12T11:51:53.515 INFO:tasks.workunit.client.0.smithi063.stdout:1/311: dread - d3/d3a/d54/f62 zero size 2023-12-12T11:51:53.515 INFO:tasks.workunit.client.0.smithi063.stdout:1/312: stat d3/db/d16/d24/f29 0 2023-12-12T11:51:53.515 INFO:tasks.workunit.client.0.smithi063.stdout:6/370: dwrite d9/d10/f41 [0,4194304] 0 2023-12-12T11:51:53.522 INFO:tasks.workunit.client.0.smithi063.stdout:3/280: creat d4/df/d1a/f5e x:0 0 0 2023-12-12T11:51:53.526 INFO:tasks.workunit.client.0.smithi063.stdout:5/356: creat d7/d10/d2b/d3c/d42/d62/f6c x:0 0 0 2023-12-12T11:51:53.526 INFO:tasks.workunit.client.1.smithi093.stdout:4/748: dwrite d0/d36/d49/faf [0,4194304] 0 2023-12-12T11:51:53.531 INFO:tasks.workunit.client.1.smithi093.stdout:1/548: mkdir d4/d1a/d1b/d26/d65/d6f/db3/db4 0 2023-12-12T11:51:53.531 INFO:tasks.workunit.client.1.smithi093.stdout:0/560: mkdir d5/d21/d2f/dae 0 2023-12-12T11:51:53.531 INFO:tasks.workunit.client.1.smithi093.stdout:0/561: write d5/dd/f75 [3950765,65772] 0 2023-12-12T11:51:53.531 INFO:tasks.workunit.client.1.smithi093.stdout:0/562: write d5/d21/d27/d3a/f67 [1219279,12769] 0 2023-12-12T11:51:53.535 INFO:tasks.workunit.client.1.smithi093.stdout:8/586: rename d3/d1a/d1f/d29/d30/c51 to d3/cba 0 2023-12-12T11:51:53.535 INFO:tasks.workunit.client.1.smithi093.stdout:8/587: fdatasync d3/f6 0 2023-12-12T11:51:53.535 INFO:tasks.workunit.client.1.smithi093.stdout:8/588: fsync d3/d1a/d1f/d29/f43 0 2023-12-12T11:51:53.543 INFO:tasks.workunit.client.0.smithi063.stdout:8/421: dwrite d4/de/d1e/f3c [0,4194304] 0 2023-12-12T11:51:53.543 INFO:tasks.workunit.client.1.smithi093.stdout:5/454: mknod d0/d7/d8/d8f/c9b 0 2023-12-12T11:51:53.544 INFO:tasks.workunit.client.0.smithi063.stdout:5/357: rmdir d7/d28/d43 39 2023-12-12T11:51:53.545 INFO:tasks.workunit.client.0.smithi063.stdout:5/358: write d7/de/f59 [208656,56678] 0 2023-12-12T11:51:53.553 INFO:tasks.workunit.client.0.smithi063.stdout:8/422: dread d4/d55/f35 [0,4194304] 0 2023-12-12T11:51:53.557 INFO:tasks.workunit.client.1.smithi093.stdout:0/563: mknod d5/dd/d14/caf 0 2023-12-12T11:51:53.557 INFO:tasks.workunit.client.1.smithi093.stdout:0/564: read - d5/f7d zero size 2023-12-12T11:51:53.567 INFO:tasks.workunit.client.1.smithi093.stdout:8/589: dread d3/d1a/d1f/d29/d63/f65 [0,4194304] 0 2023-12-12T11:51:53.567 INFO:tasks.workunit.client.1.smithi093.stdout:7/501: rename da/d15/d19/d90/d7d/dae to da/d8e/daf 0 2023-12-12T11:51:53.567 INFO:tasks.workunit.client.1.smithi093.stdout:2/591: symlink d5/lc8 0 2023-12-12T11:51:53.575 INFO:tasks.workunit.client.1.smithi093.stdout:0/565: link d5/d41/l76 d5/dd/d14/d26/d58/d64/d7c/lb0 0 2023-12-12T11:51:53.575 INFO:tasks.workunit.client.1.smithi093.stdout:0/566: truncate d5/f7d 747795 0 2023-12-12T11:51:53.581 INFO:tasks.workunit.client.1.smithi093.stdout:7/502: mknod da/d15/d19/d90/cb0 0 2023-12-12T11:51:53.582 INFO:tasks.workunit.client.1.smithi093.stdout:0/567: creat d5/d21/fb1 x:0 0 0 2023-12-12T11:51:53.586 INFO:tasks.workunit.client.1.smithi093.stdout:9/534: rename d1/d12/d1f/d3d/d57/d63/f9a to d1/d23/fb5 0 2023-12-12T11:51:53.587 INFO:tasks.workunit.client.1.smithi093.stdout:7/503: link da/d15/d59/d80/f8b da/de/fb1 0 2023-12-12T11:51:53.588 INFO:tasks.workunit.client.1.smithi093.stdout:2/592: dread d5/d14/d2d/f1c [0,4194304] 0 2023-12-12T11:51:53.589 INFO:tasks.workunit.client.1.smithi093.stdout:2/593: write d5/d14/d2d/d4c/d54/d67/d69/d6c/f89 [518039,13972] 0 2023-12-12T11:51:53.589 INFO:tasks.workunit.client.1.smithi093.stdout:5/455: rename d0/d7/d36/d29/d44/l61 to d0/d7/d36/l9c 0 2023-12-12T11:51:53.594 INFO:tasks.workunit.client.1.smithi093.stdout:7/504: mknod da/d15/d19/d4c/cb2 0 2023-12-12T11:51:53.594 INFO:tasks.workunit.client.1.smithi093.stdout:7/505: truncate da/d15/d2d/d2f/f6c 1251595 0 2023-12-12T11:51:53.594 INFO:tasks.workunit.client.1.smithi093.stdout:7/506: chown da/d15/d59/d80 3 1 2023-12-12T11:51:53.594 INFO:tasks.workunit.client.1.smithi093.stdout:8/590: rename d3/d1a/d1f/d29/d30/d58/fad to d3/d1a/d1f/fbb 0 2023-12-12T11:51:53.595 INFO:tasks.workunit.client.1.smithi093.stdout:8/591: mkdir d3/d1a/d1f/d59/d69/dbc 0 2023-12-12T11:51:53.596 INFO:tasks.workunit.client.1.smithi093.stdout:5/456: getdents d0/d7/d8/de 0 2023-12-12T11:51:53.598 INFO:tasks.workunit.client.1.smithi093.stdout:3/527: sync 2023-12-12T11:51:53.601 INFO:tasks.workunit.client.1.smithi093.stdout:3/528: rename df/d36/d7f to df/d22/d49/d69/d78/dad 0 2023-12-12T11:51:53.601 INFO:tasks.workunit.client.1.smithi093.stdout:3/529: stat df/f43 0 2023-12-12T11:51:53.601 INFO:tasks.workunit.client.1.smithi093.stdout:3/530: chown df/d36/d3d/d6f/c48 158745 1 2023-12-12T11:51:53.601 INFO:tasks.workunit.client.1.smithi093.stdout:0/568: read d5/dd/f4f [1458859,107743] 0 2023-12-12T11:51:53.601 INFO:tasks.workunit.client.1.smithi093.stdout:0/569: readlink d5/dd/l57 0 2023-12-12T11:51:53.602 INFO:tasks.workunit.client.1.smithi093.stdout:1/549: dwrite d4/d1c/f88 [8388608,4194304] 0 2023-12-12T11:51:53.602 INFO:tasks.workunit.client.1.smithi093.stdout:0/570: unlink d5/f7d 0 2023-12-12T11:51:53.605 INFO:tasks.workunit.client.1.smithi093.stdout:1/550: symlink d4/d1a/lb5 0 2023-12-12T11:51:53.606 INFO:tasks.workunit.client.1.smithi093.stdout:7/507: dread da/d15/d19/d4c/d6d/f7e [0,4194304] 0 2023-12-12T11:51:53.606 INFO:tasks.workunit.client.1.smithi093.stdout:4/749: dwrite d0/d87/d79/db2/fae [0,4194304] 0 2023-12-12T11:51:53.607 INFO:tasks.workunit.client.1.smithi093.stdout:7/508: read da/d15/d19/f45 [101283,127421] 0 2023-12-12T11:51:53.607 INFO:tasks.workunit.client.0.smithi063.stdout:3/281: dwrite d4/df/d1a/d1c/d41/f51 [0,4194304] 0 2023-12-12T11:51:53.607 INFO:tasks.workunit.client.1.smithi093.stdout:0/571: mkdir d5/db2 0 2023-12-12T11:51:53.609 INFO:tasks.workunit.client.0.smithi063.stdout:1/313: dwrite d3/db/f1d [0,4194304] 0 2023-12-12T11:51:53.611 INFO:tasks.workunit.client.0.smithi063.stdout:8/423: dwrite d4/de/d1e/f4f [0,4194304] 0 2023-12-12T11:51:53.611 INFO:tasks.workunit.client.0.smithi063.stdout:8/424: fdatasync d4/f4e 0 2023-12-12T11:51:53.612 INFO:tasks.workunit.client.1.smithi093.stdout:4/750: write d0/d36/d49/f7e [5079198,102990] 0 2023-12-12T11:51:53.615 INFO:tasks.workunit.client.1.smithi093.stdout:0/572: symlink d5/d21/d2f/d54/d7e/lb3 0 2023-12-12T11:51:53.618 INFO:tasks.workunit.client.0.smithi063.stdout:3/282: rename d4/df/c13 to d4/df/d1a/d1c/d3b/c5f 0 2023-12-12T11:51:53.618 INFO:tasks.workunit.client.0.smithi063.stdout:3/283: chown d4/l38 13 1 2023-12-12T11:51:53.621 INFO:tasks.workunit.client.0.smithi063.stdout:1/314: unlink d3/db/d16/d24/d30/f3d 0 2023-12-12T11:51:53.621 INFO:tasks.workunit.client.0.smithi063.stdout:1/315: write d3/db/d16/d17/f55 [771170,119682] 0 2023-12-12T11:51:53.621 INFO:tasks.workunit.client.0.smithi063.stdout:1/316: write d3/db/d16/f2b [2719055,41374] 0 2023-12-12T11:51:53.621 INFO:tasks.workunit.client.1.smithi093.stdout:7/509: dread da/de/f72 [0,4194304] 0 2023-12-12T11:51:53.625 INFO:tasks.workunit.client.1.smithi093.stdout:3/531: dread df/d22/d49/d69/d78/f7d [0,4194304] 0 2023-12-12T11:51:53.638 INFO:tasks.workunit.client.1.smithi093.stdout:4/751: write d0/d87/d79/d86/fce [3712826,128168] 0 2023-12-12T11:51:53.638 INFO:tasks.workunit.client.1.smithi093.stdout:4/752: write d0/fa3 [893375,40751] 0 2023-12-12T11:51:53.640 INFO:tasks.workunit.client.1.smithi093.stdout:0/573: dread d5/dd/d14/d26/d58/d64/f97 [0,4194304] 0 2023-12-12T11:51:53.641 INFO:tasks.workunit.client.0.smithi063.stdout:3/284: mknod d4/df/d1a/d1c/d34/c60 0 2023-12-12T11:51:53.646 INFO:tasks.workunit.client.0.smithi063.stdout:1/317: rename d3/db/d16/d24/d30/c4a to d3/db/d16/d24/d4d/d35/c66 0 2023-12-12T11:51:53.647 INFO:tasks.workunit.client.1.smithi093.stdout:7/510: mkdir da/d8e/daa/db3 0 2023-12-12T11:51:53.650 INFO:tasks.workunit.client.0.smithi063.stdout:3/285: mkdir d4/df/d1a/d1c/d3b/d50/d61 0 2023-12-12T11:51:53.650 INFO:tasks.workunit.client.0.smithi063.stdout:3/286: write d4/df/d1a/f31 [521227,18075] 0 2023-12-12T11:51:53.654 INFO:tasks.workunit.client.1.smithi093.stdout:3/532: unlink df/d36/d3d/d59/d72/d79/f91 0 2023-12-12T11:51:53.654 INFO:tasks.workunit.client.1.smithi093.stdout:9/535: dwrite d1/d12/d1f/d3d/d57/f5b [0,4194304] 0 2023-12-12T11:51:53.654 INFO:tasks.workunit.client.1.smithi093.stdout:8/592: dwrite d3/d1a/d1f/d29/d3a/f5c [0,4194304] 0 2023-12-12T11:51:53.655 INFO:tasks.workunit.client.1.smithi093.stdout:8/593: fdatasync d3/d73/f77 0 2023-12-12T11:51:53.657 INFO:tasks.workunit.client.0.smithi063.stdout:3/287: mkdir d4/d23/d5d/d62 0 2023-12-12T11:51:53.658 INFO:tasks.workunit.client.1.smithi093.stdout:4/753: truncate d0/d87/d79/d86/fe0 483163 0 2023-12-12T11:51:53.660 INFO:tasks.workunit.client.0.smithi063.stdout:1/318: getdents d3/db/d16/d24/d4d/d35/d5a/d5b 0 2023-12-12T11:51:53.663 INFO:tasks.workunit.client.1.smithi093.stdout:0/574: unlink d5/d41/c44 0 2023-12-12T11:51:53.663 INFO:tasks.workunit.client.1.smithi093.stdout:0/575: stat d5/f66 0 2023-12-12T11:51:53.666 INFO:tasks.workunit.client.0.smithi063.stdout:8/425: dwrite d4/de/d3b/d62/d36/f73 [0,4194304] 0 2023-12-12T11:51:53.666 INFO:tasks.workunit.client.1.smithi093.stdout:7/511: dread da/de/f3b [0,4194304] 0 2023-12-12T11:51:53.667 INFO:tasks.workunit.client.0.smithi063.stdout:1/319: dread d3/db/d16/f2d [4194304,4194304] 0 2023-12-12T11:51:53.670 INFO:tasks.workunit.client.1.smithi093.stdout:3/533: write df/d22/f6d [1566263,117619] 0 2023-12-12T11:51:53.672 INFO:tasks.workunit.client.0.smithi063.stdout:3/288: mknod d4/df/d1a/d1c/c63 0 2023-12-12T11:51:53.674 INFO:tasks.workunit.client.1.smithi093.stdout:9/536: read d1/d12/d1f/f3a [3077675,78180] 0 2023-12-12T11:51:53.675 INFO:tasks.workunit.client.1.smithi093.stdout:8/594: truncate d3/d1a/d1f/d29/f32 28229 0 2023-12-12T11:51:53.677 INFO:tasks.workunit.client.1.smithi093.stdout:0/576: mkdir d5/d21/d2f/d54/d7e/db4 0 2023-12-12T11:51:53.679 INFO:tasks.workunit.client.1.smithi093.stdout:6/672: sync 2023-12-12T11:51:53.679 INFO:tasks.workunit.client.1.smithi093.stdout:6/673: chown d0/d52/d7e/l81 493 1 2023-12-12T11:51:53.680 INFO:tasks.workunit.client.1.smithi093.stdout:3/534: creat df/d22/d49/d69/d8c/fae x:0 0 0 2023-12-12T11:51:53.681 INFO:tasks.workunit.client.1.smithi093.stdout:5/457: dwrite d0/d7/d36/f4a [0,4194304] 0 2023-12-12T11:51:53.681 INFO:tasks.workunit.client.0.smithi063.stdout:8/426: symlink d4/de/d3b/d62/d36/l81 0 2023-12-12T11:51:53.682 INFO:tasks.workunit.client.1.smithi093.stdout:8/595: symlink d3/d1a/d1f/d29/lbd 0 2023-12-12T11:51:53.683 INFO:tasks.workunit.client.1.smithi093.stdout:8/596: dread - d3/d1a/d1f/d59/d69/f95 zero size 2023-12-12T11:51:53.683 INFO:tasks.workunit.client.1.smithi093.stdout:9/537: dread d1/d12/d1f/d3d/d57/f67 [0,4194304] 0 2023-12-12T11:51:53.685 INFO:tasks.workunit.client.0.smithi063.stdout:1/320: creat d3/d3a/d52/f67 x:0 0 0 2023-12-12T11:51:53.689 INFO:tasks.workunit.client.1.smithi093.stdout:0/577: unlink d5/d41/l76 0 2023-12-12T11:51:53.697 INFO:tasks.workunit.client.0.smithi063.stdout:3/289: write d4/df/d1a/d1c/d41/f51 [2115581,116784] 0 2023-12-12T11:51:53.698 INFO:tasks.workunit.client.1.smithi093.stdout:6/674: dread d0/da/d14/d3a/f6a [0,4194304] 0 2023-12-12T11:51:53.698 INFO:tasks.workunit.client.1.smithi093.stdout:6/675: stat d0/d52/d7e/d42/dd5/fda 0 2023-12-12T11:51:53.698 INFO:tasks.workunit.client.1.smithi093.stdout:6/676: write d0/d52/d6b/ddb/dfe/fef [73186,67086] 0 2023-12-12T11:51:53.698 INFO:tasks.workunit.client.1.smithi093.stdout:8/597: symlink d3/d1a/d1f/d59/d6c/lbe 0 2023-12-12T11:51:53.704 INFO:tasks.workunit.client.1.smithi093.stdout:9/538: creat d1/d23/d6b/d92/db2/fb6 x:0 0 0 2023-12-12T11:51:53.708 INFO:tasks.workunit.client.0.smithi063.stdout:8/427: symlink d4/l82 0 2023-12-12T11:51:53.713 INFO:tasks.workunit.client.0.smithi063.stdout:1/321: write d3/db/f1d [1769547,44662] 0 2023-12-12T11:51:53.713 INFO:tasks.workunit.client.0.smithi063.stdout:1/322: chown d3/db/d16/d24/c28 12289 1 2023-12-12T11:51:53.714 INFO:tasks.workunit.client.0.smithi063.stdout:1/323: dread - d3/db/d16/d24/d4d/d35/f5d zero size 2023-12-12T11:51:53.718 INFO:tasks.workunit.client.1.smithi093.stdout:3/535: rename df/d36 to df/d22/d49/d69/d78/daf 0 2023-12-12T11:51:53.719 INFO:tasks.workunit.client.0.smithi063.stdout:3/290: mknod d4/df/d1a/c64 0 2023-12-12T11:51:53.724 INFO:tasks.workunit.client.1.smithi093.stdout:5/458: dread d0/d7/d59/f60 [0,4194304] 0 2023-12-12T11:51:53.724 INFO:tasks.workunit.client.1.smithi093.stdout:5/459: fsync d0/f5 0 2023-12-12T11:51:53.724 INFO:tasks.workunit.client.1.smithi093.stdout:5/460: read - d0/d7/d59/f7e zero size 2023-12-12T11:51:53.724 INFO:tasks.workunit.client.1.smithi093.stdout:5/461: dread - d0/d7/d36/d68/f7a zero size 2023-12-12T11:51:53.724 INFO:tasks.workunit.client.1.smithi093.stdout:5/462: readlink d0/l8d 0 2023-12-12T11:51:53.724 INFO:tasks.workunit.client.1.smithi093.stdout:4/754: dwrite d0/d36/f4c [4194304,4194304] 0 2023-12-12T11:51:53.724 INFO:tasks.workunit.client.1.smithi093.stdout:9/539: write d1/d12/d1f/d3d/d5c/f7b [131741,54901] 0 2023-12-12T11:51:53.725 INFO:tasks.workunit.client.1.smithi093.stdout:4/755: chown d0/d31/f51 66432882 1 2023-12-12T11:51:53.728 INFO:tasks.workunit.client.0.smithi063.stdout:1/324: creat d3/db/d16/d24/d4d/f68 x:0 0 0 2023-12-12T11:51:53.728 INFO:tasks.workunit.client.0.smithi063.stdout:9/283: sync 2023-12-12T11:51:53.729 INFO:tasks.workunit.client.0.smithi063.stdout:9/284: dread - d7/d11/f53 zero size 2023-12-12T11:51:53.729 INFO:tasks.workunit.client.1.smithi093.stdout:5/463: creat d0/d7/d36/d29/f9d x:0 0 0 2023-12-12T11:51:53.729 INFO:tasks.workunit.client.1.smithi093.stdout:8/598: dread d3/d1a/d1f/d29/d3a/f55 [0,4194304] 0 2023-12-12T11:51:53.730 INFO:tasks.workunit.client.1.smithi093.stdout:6/677: dread d0/da/d14/d38/d43/f5a [0,4194304] 0 2023-12-12T11:51:53.730 INFO:tasks.workunit.client.1.smithi093.stdout:6/678: write d0/f29 [1682611,25573] 0 2023-12-12T11:51:53.730 INFO:tasks.workunit.client.1.smithi093.stdout:6/679: getdents d0/d52/d6b/db0 0 2023-12-12T11:51:53.731 INFO:tasks.workunit.client.0.smithi063.stdout:0/309: sync 2023-12-12T11:51:53.731 INFO:tasks.workunit.client.0.smithi063.stdout:0/310: stat d0/d7/ff 0 2023-12-12T11:51:53.731 INFO:tasks.workunit.client.0.smithi063.stdout:4/358: sync 2023-12-12T11:51:53.731 INFO:tasks.workunit.client.0.smithi063.stdout:7/302: sync 2023-12-12T11:51:53.731 INFO:tasks.workunit.client.0.smithi063.stdout:8/428: dread d4/de/f43 [0,4194304] 0 2023-12-12T11:51:53.733 INFO:tasks.workunit.client.0.smithi063.stdout:0/311: creat d0/d1a/d23/d34/d42/f6a x:0 0 0 2023-12-12T11:51:53.736 INFO:tasks.workunit.client.0.smithi063.stdout:4/359: creat d2/d48/f6e x:0 0 0 2023-12-12T11:51:53.736 INFO:tasks.workunit.client.0.smithi063.stdout:4/360: readlink d2/d17/d41/l42 0 2023-12-12T11:51:53.743 INFO:tasks.workunit.client.0.smithi063.stdout:0/312: rename d0/l1e to d0/d1a/d23/d2e/l6b 0 2023-12-12T11:51:53.744 INFO:tasks.workunit.client.1.smithi093.stdout:5/464: rmdir d0/d7/d59/d35 39 2023-12-12T11:51:53.744 INFO:tasks.workunit.client.1.smithi093.stdout:5/465: write d0/d3b/d66/f7d [5051326,3348] 0 2023-12-12T11:51:53.745 INFO:tasks.workunit.client.0.smithi063.stdout:2/292: sync 2023-12-12T11:51:53.745 INFO:tasks.workunit.client.0.smithi063.stdout:2/293: chown d0/c4e 69927285 1 2023-12-12T11:51:53.745 INFO:tasks.workunit.client.0.smithi063.stdout:5/359: sync 2023-12-12T11:51:53.745 INFO:tasks.workunit.client.0.smithi063.stdout:5/360: dread - d7/d28/d43/f68 zero size 2023-12-12T11:51:53.745 INFO:tasks.workunit.client.0.smithi063.stdout:5/361: chown d7/d10/d2b/d3c/d27 18869340 1 2023-12-12T11:51:53.745 INFO:tasks.workunit.client.0.smithi063.stdout:5/362: chown d7/cd 34544125 1 2023-12-12T11:51:53.745 INFO:tasks.workunit.client.0.smithi063.stdout:6/371: sync 2023-12-12T11:51:53.745 INFO:tasks.workunit.client.0.smithi063.stdout:6/372: truncate d9/d10/d25/f3d 4620415 0 2023-12-12T11:51:53.748 INFO:tasks.workunit.client.0.smithi063.stdout:9/285: write f5 [7943379,70752] 0 2023-12-12T11:51:53.751 INFO:tasks.workunit.client.1.smithi093.stdout:9/540: dread d1/d23/f2a [0,4194304] 0 2023-12-12T11:51:53.751 INFO:tasks.workunit.client.0.smithi063.stdout:4/361: write d2/d8/f32 [1021472,72649] 0 2023-12-12T11:51:53.752 INFO:tasks.workunit.client.1.smithi093.stdout:8/599: mkdir d3/d1a/d1f/d29/d3a/d40/dbf 0 2023-12-12T11:51:53.753 INFO:tasks.workunit.client.0.smithi063.stdout:7/303: dread de/d22/f31 [0,4194304] 0 2023-12-12T11:51:53.753 INFO:tasks.workunit.client.0.smithi063.stdout:7/304: write de/d34/d43/d45/d4e/f5d [571215,125773] 0 2023-12-12T11:51:53.753 INFO:tasks.workunit.client.0.smithi063.stdout:7/305: chown de/d33 3517 1 2023-12-12T11:51:53.754 INFO:tasks.workunit.client.0.smithi063.stdout:7/306: write de/f13 [318501,12101] 0 2023-12-12T11:51:53.754 INFO:tasks.workunit.client.0.smithi063.stdout:1/325: write d3/db/d16/d24/d48/f57 [395789,2192] 0 2023-12-12T11:51:53.754 INFO:tasks.workunit.client.0.smithi063.stdout:5/363: write d7/d10/d2b/d3c/f2d [79336,8492] 0 2023-12-12T11:51:53.755 INFO:tasks.workunit.client.0.smithi063.stdout:0/313: unlink d0/d7/d27/d1f/l35 0 2023-12-12T11:51:53.755 INFO:tasks.workunit.client.0.smithi063.stdout:0/314: truncate d0/d1a/d23/d34/d42/f60 2276221 0 2023-12-12T11:51:53.757 INFO:tasks.workunit.client.0.smithi063.stdout:2/294: unlink d0/c5d 0 2023-12-12T11:51:53.759 INFO:tasks.workunit.client.1.smithi093.stdout:0/578: dwrite d5/dd/f75 [0,4194304] 0 2023-12-12T11:51:53.759 INFO:tasks.workunit.client.1.smithi093.stdout:0/579: fsync d5/d21/d27/f5d 0 2023-12-12T11:51:53.760 INFO:tasks.workunit.client.1.smithi093.stdout:0/580: write d5/dd/d14/d26/f34 [4181733,32878] 0 2023-12-12T11:51:53.760 INFO:tasks.workunit.client.1.smithi093.stdout:0/581: write d5/dd/d14/d99/fa8 [9500,14043] 0 2023-12-12T11:51:53.762 INFO:tasks.workunit.client.0.smithi063.stdout:3/291: dread f0 [0,4194304] 0 2023-12-12T11:51:53.766 INFO:tasks.workunit.client.0.smithi063.stdout:8/429: dread d4/f22 [0,4194304] 0 2023-12-12T11:51:53.767 INFO:tasks.workunit.client.0.smithi063.stdout:6/373: unlink d9/d10/d2a/l57 0 2023-12-12T11:51:53.771 INFO:tasks.workunit.client.0.smithi063.stdout:9/286: unlink d7/d11/c50 0 2023-12-12T11:51:53.772 INFO:tasks.workunit.client.0.smithi063.stdout:4/362: link d2/d47/c60 d2/d17/d4e/c6f 0 2023-12-12T11:51:53.776 INFO:tasks.workunit.client.1.smithi093.stdout:0/582: dread d5/d21/d2f/d54/f73 [0,4194304] 0 2023-12-12T11:51:53.781 INFO:tasks.workunit.client.1.smithi093.stdout:5/466: rename d0/d7/d59/d35 to d0/d7/d8/d9e 0 2023-12-12T11:51:53.781 INFO:tasks.workunit.client.1.smithi093.stdout:5/467: read - d0/d7/d36/d29/d44/f94 zero size 2023-12-12T11:51:53.782 INFO:tasks.workunit.client.1.smithi093.stdout:5/468: fdatasync d0/d7/f1c 0 2023-12-12T11:51:53.786 INFO:tasks.workunit.client.0.smithi063.stdout:1/326: rename d3/db/d16/d24/d4d/d35/c66 to d3/db/d16/d24/d4d/d35/d5a/d5b/c69 0 2023-12-12T11:51:53.788 INFO:tasks.workunit.client.0.smithi063.stdout:4/363: dread d2/d17/f3c [0,4194304] 0 2023-12-12T11:51:53.790 INFO:tasks.workunit.client.0.smithi063.stdout:6/374: write d9/f4b [2057714,82769] 0 2023-12-12T11:51:53.792 INFO:tasks.workunit.client.1.smithi093.stdout:4/756: dwrite d0/f1f [4194304,4194304] 0 2023-12-12T11:51:53.792 INFO:tasks.workunit.client.1.smithi093.stdout:4/757: read - d0/d31/fc5 zero size 2023-12-12T11:51:53.792 INFO:tasks.workunit.client.1.smithi093.stdout:4/758: chown d0/c85 41 1 2023-12-12T11:51:53.793 INFO:tasks.workunit.client.0.smithi063.stdout:5/364: creat d7/d28/d43/d49/f6d x:0 0 0 2023-12-12T11:51:53.793 INFO:tasks.workunit.client.0.smithi063.stdout:3/292: creat d4/df/d1a/d1c/d3b/d50/d61/f65 x:0 0 0 2023-12-12T11:51:53.795 INFO:tasks.workunit.client.1.smithi093.stdout:9/541: rename d1/l46 to d1/d23/d6b/d92/d9f/lb7 0 2023-12-12T11:51:53.796 INFO:tasks.workunit.client.0.smithi063.stdout:9/287: readlink d7/d15/l3c 0 2023-12-12T11:51:53.796 INFO:tasks.workunit.client.0.smithi063.stdout:9/288: write d7/f2b [3286523,67952] 0 2023-12-12T11:51:53.796 INFO:tasks.workunit.client.0.smithi063.stdout:9/289: fsync d7/d11/d12/d30/f48 0 2023-12-12T11:51:53.796 INFO:tasks.workunit.client.0.smithi063.stdout:9/290: write d7/d15/f17 [3431296,123663] 0 2023-12-12T11:51:53.800 INFO:tasks.workunit.client.0.smithi063.stdout:1/327: creat d3/db/d16/d24/d48/f6a x:0 0 0 2023-12-12T11:51:53.800 INFO:tasks.workunit.client.1.smithi093.stdout:3/536: dwrite df/d25/d2c/d85/f8f [0,4194304] 0 2023-12-12T11:51:53.800 INFO:tasks.workunit.client.1.smithi093.stdout:3/537: write df/d22/d49/d69/d78/daf/d3d/d59/f64 [76988,81274] 0 2023-12-12T11:51:53.800 INFO:tasks.workunit.client.1.smithi093.stdout:3/538: write df/d22/d49/d69/d78/daf/d3d/d59/d9c/f9f [575179,92543] 0 2023-12-12T11:51:53.802 INFO:tasks.workunit.client.0.smithi063.stdout:4/364: link d2/l24 d2/d47/l70 0 2023-12-12T11:51:53.805 INFO:tasks.workunit.client.1.smithi093.stdout:4/759: creat d0/d87/d79/fed x:0 0 0 2023-12-12T11:51:53.811 INFO:tasks.workunit.client.0.smithi063.stdout:6/375: link d9/d10/l2e d9/d10/l79 0 2023-12-12T11:51:53.818 INFO:tasks.workunit.client.1.smithi093.stdout:8/600: rename d3/d1a/d1f/d29/d3a/l46 to d3/d1a/d1f/daf/lc0 0 2023-12-12T11:51:53.819 INFO:tasks.workunit.client.1.smithi093.stdout:8/601: write d3/d1a/d1f/d29/d30/d58/d76/f86 [1304336,79264] 0 2023-12-12T11:51:53.819 INFO:tasks.workunit.client.1.smithi093.stdout:8/602: write d3/d1a/d1f/d29/d3a/d68/d8a/f90 [2207607,91899] 0 2023-12-12T11:51:53.826 INFO:tasks.workunit.client.1.smithi093.stdout:0/583: dread d5/d21/d2f/d54/f5c [0,4194304] 0 2023-12-12T11:51:53.828 INFO:tasks.workunit.client.0.smithi063.stdout:3/293: read d4/df/d1a/d1c/d3b/f3e [1285774,116976] 0 2023-12-12T11:51:53.829 INFO:tasks.workunit.client.0.smithi063.stdout:9/291: mkdir d7/d11/d12/d30/d3e/d55 0 2023-12-12T11:51:53.836 INFO:tasks.workunit.client.0.smithi063.stdout:1/328: mkdir d3/db/d16/d24/d4d/d35/d5a/d5b/d6b 0 2023-12-12T11:51:53.836 INFO:tasks.workunit.client.0.smithi063.stdout:1/329: truncate d3/d3a/d54/f62 139150 0 2023-12-12T11:51:53.836 INFO:tasks.workunit.client.0.smithi063.stdout:1/330: fsync d3/db/d16/f3c 0 2023-12-12T11:51:53.841 INFO:tasks.workunit.client.0.smithi063.stdout:4/365: creat d2/d17/d61/f71 x:0 0 0 2023-12-12T11:51:53.841 INFO:tasks.workunit.client.0.smithi063.stdout:2/295: dwrite d0/f20 [0,4194304] 0 2023-12-12T11:51:53.841 INFO:tasks.workunit.client.0.smithi063.stdout:2/296: fdatasync d0/d1a/d1e/f2e 0 2023-12-12T11:51:53.841 INFO:tasks.workunit.client.0.smithi063.stdout:2/297: write d0/f15 [1882205,212] 0 2023-12-12T11:51:53.841 INFO:tasks.workunit.client.0.smithi063.stdout:2/298: fdatasync d0/d1a/d48/f34 0 2023-12-12T11:51:53.841 INFO:tasks.workunit.client.0.smithi063.stdout:2/299: chown d0/l12 359590841 1 2023-12-12T11:51:53.847 INFO:tasks.workunit.client.0.smithi063.stdout:6/376: mkdir d9/d10/d7a 0 2023-12-12T11:51:53.847 INFO:tasks.workunit.client.0.smithi063.stdout:6/377: creat d9/d10/d25/f7b x:0 0 0 2023-12-12T11:51:53.850 INFO:tasks.workunit.client.1.smithi093.stdout:4/760: unlink d0/d36/l6f 0 2023-12-12T11:51:53.859 INFO:tasks.workunit.client.1.smithi093.stdout:8/603: creat d3/d1a/d1f/d29/d3a/d40/dbf/fc1 x:0 0 0 2023-12-12T11:51:53.859 INFO:tasks.workunit.client.1.smithi093.stdout:8/604: truncate d3/f42 5148565 0 2023-12-12T11:51:53.859 INFO:tasks.workunit.client.1.smithi093.stdout:8/605: chown d3/d1a/d1f/d29/l38 52396 1 2023-12-12T11:51:53.859 INFO:tasks.workunit.client.1.smithi093.stdout:8/606: write d3/d8/f96 [998193,36624] 0 2023-12-12T11:51:53.870 INFO:tasks.workunit.client.0.smithi063.stdout:7/307: dwrite de/f1e [0,4194304] 0 2023-12-12T11:51:53.879 INFO:tasks.workunit.client.0.smithi063.stdout:9/292: mknod d7/d11/c56 0 2023-12-12T11:51:53.880 INFO:tasks.workunit.client.0.smithi063.stdout:1/331: symlink d3/db/d16/d24/d4d/d35/l6c 0 2023-12-12T11:51:53.880 INFO:tasks.workunit.client.0.smithi063.stdout:4/366: mknod d2/d17/d61/c72 0 2023-12-12T11:51:53.881 INFO:tasks.workunit.client.0.smithi063.stdout:5/365: dwrite d7/d10/d2b/d3c/f5b [0,4194304] 0 2023-12-12T11:51:53.881 INFO:tasks.workunit.client.0.smithi063.stdout:5/366: read - d7/d28/d43/f68 zero size 2023-12-12T11:51:53.885 INFO:tasks.workunit.client.0.smithi063.stdout:7/308: rename de/c18 to de/d34/d43/c74 0 2023-12-12T11:51:53.885 INFO:tasks.workunit.client.0.smithi063.stdout:7/309: chown de/d33/c35 25869902 1 2023-12-12T11:51:53.887 INFO:tasks.workunit.client.0.smithi063.stdout:9/293: creat d7/d20/d45/f57 x:0 0 0 2023-12-12T11:51:53.889 INFO:tasks.workunit.client.0.smithi063.stdout:1/332: mkdir d3/db/d16/d24/d4d/d35/d5a/d5b/d6b/d6d 0 2023-12-12T11:51:53.890 INFO:tasks.workunit.client.0.smithi063.stdout:1/333: readlink d3/db/d16/d17/l39 0 2023-12-12T11:51:53.890 INFO:tasks.workunit.client.0.smithi063.stdout:1/334: chown d3/f9 2734 1 2023-12-12T11:51:53.890 INFO:tasks.workunit.client.0.smithi063.stdout:1/335: chown d3/db/d16/d24/d4d/f3e 1965116 1 2023-12-12T11:51:53.895 INFO:tasks.workunit.client.0.smithi063.stdout:3/294: dwrite d4/df/d1a/d1c/f29 [0,4194304] 0 2023-12-12T11:51:53.895 INFO:tasks.workunit.client.0.smithi063.stdout:5/367: rename d7/d10/d35 to d7/d28/d6e 0 2023-12-12T11:51:53.897 INFO:tasks.workunit.client.0.smithi063.stdout:2/300: dread d0/f20 [0,4194304] 0 2023-12-12T11:51:53.899 INFO:tasks.workunit.client.0.smithi063.stdout:8/430: dwrite d4/de/d1e/f5c [4194304,4194304] 0 2023-12-12T11:51:53.899 INFO:tasks.workunit.client.0.smithi063.stdout:8/431: dread - d4/de/d3b/d62/f6f zero size 2023-12-12T11:51:53.900 INFO:tasks.workunit.client.0.smithi063.stdout:7/310: symlink de/d33/d41/d44/l75 0 2023-12-12T11:51:53.900 INFO:tasks.workunit.client.0.smithi063.stdout:7/311: fdatasync de/f28 0 2023-12-12T11:51:53.900 INFO:tasks.workunit.client.0.smithi063.stdout:9/294: unlink d7/d11/f4f 0 2023-12-12T11:51:53.900 INFO:tasks.workunit.client.0.smithi063.stdout:9/295: write d7/d11/d12/f1a [1675672,99189] 0 2023-12-12T11:51:53.901 INFO:tasks.workunit.client.0.smithi063.stdout:4/367: getdents d2/d17/d41 0 2023-12-12T11:51:53.907 INFO:tasks.workunit.client.0.smithi063.stdout:4/368: dread d2/d17/d41/f52 [0,4194304] 0 2023-12-12T11:51:53.907 INFO:tasks.workunit.client.0.smithi063.stdout:4/369: chown d2/d17/d61/c72 3644283 1 2023-12-12T11:51:53.908 INFO:tasks.workunit.client.1.smithi093.stdout:9/542: dwrite d1/f1e [0,4194304] 0 2023-12-12T11:51:53.908 INFO:tasks.workunit.client.1.smithi093.stdout:9/543: creat d1/d23/d6b/fb8 x:0 0 0 2023-12-12T11:51:53.908 INFO:tasks.workunit.client.1.smithi093.stdout:9/544: write d1/d12/d1f/d73/fab [331670,88564] 0 2023-12-12T11:51:53.908 INFO:tasks.workunit.client.0.smithi063.stdout:5/368: truncate d7/d10/f14 2229384 0 2023-12-12T11:51:53.913 INFO:tasks.workunit.client.0.smithi063.stdout:2/301: mknod d0/d1a/c62 0 2023-12-12T11:51:53.916 INFO:tasks.workunit.client.0.smithi063.stdout:1/336: dread d3/db/d16/d17/f55 [0,4194304] 0 2023-12-12T11:51:53.921 INFO:tasks.workunit.client.0.smithi063.stdout:3/295: dread d4/df/d1a/f20 [0,4194304] 0 2023-12-12T11:51:53.921 INFO:tasks.workunit.client.1.smithi093.stdout:9/545: rename d1/d23/d6b/fb8 to d1/d23/d6b/d92/fb9 0 2023-12-12T11:51:53.921 INFO:tasks.workunit.client.1.smithi093.stdout:3/539: dwrite df/d22/d49/d69/d78/daf/d3d/d59/d9c/fa2 [0,4194304] 0 2023-12-12T11:51:53.927 INFO:tasks.workunit.client.1.smithi093.stdout:2/594: sync 2023-12-12T11:51:53.927 INFO:tasks.workunit.client.1.smithi093.stdout:1/551: sync 2023-12-12T11:51:53.927 INFO:tasks.workunit.client.0.smithi063.stdout:6/378: dwrite d9/d10/d5c/d5e/f63 [0,4194304] 0 2023-12-12T11:51:53.929 INFO:tasks.workunit.client.1.smithi093.stdout:8/607: dwrite d3/d8/f23 [4194304,4194304] 0 2023-12-12T11:51:53.930 INFO:tasks.workunit.client.1.smithi093.stdout:9/546: creat d1/d23/d24/d29/d43/d56/fba x:0 0 0 2023-12-12T11:51:53.930 INFO:tasks.workunit.client.1.smithi093.stdout:9/547: truncate d1/d23/d24/d29/d43/d58/f6c 979769 0 2023-12-12T11:51:53.930 INFO:tasks.workunit.client.1.smithi093.stdout:9/548: fsync d1/d12/d1f/d3d/f9d 0 2023-12-12T11:51:53.930 INFO:tasks.workunit.client.1.smithi093.stdout:9/549: fsync d1/d12/d1f/d73/f76 0 2023-12-12T11:51:53.935 INFO:tasks.workunit.client.1.smithi093.stdout:4/761: dwrite d0/d31/d89/f9c [0,4194304] 0 2023-12-12T11:51:53.935 INFO:tasks.workunit.client.0.smithi063.stdout:8/432: rename d4/l82 to d4/d24/d38/d45/d5b/l83 0 2023-12-12T11:51:53.935 INFO:tasks.workunit.client.0.smithi063.stdout:8/433: chown d4/de/d3b/d62/d36/d57 965 1 2023-12-12T11:51:53.936 INFO:tasks.workunit.client.1.smithi093.stdout:2/595: getdents d5/d14/d2d/d4c/d54/dc5 0 2023-12-12T11:51:53.936 INFO:tasks.workunit.client.1.smithi093.stdout:0/584: dwrite d5/f13 [0,4194304] 0 2023-12-12T11:51:53.939 INFO:tasks.workunit.client.1.smithi093.stdout:1/552: mknod d4/d1a/d73/cb6 0 2023-12-12T11:51:53.940 INFO:tasks.workunit.client.0.smithi063.stdout:7/312: symlink de/d39/d60/l76 0 2023-12-12T11:51:53.942 INFO:tasks.workunit.client.0.smithi063.stdout:9/296: symlink d7/d11/d12/d30/d3e/d55/l58 0 2023-12-12T11:51:53.944 INFO:tasks.workunit.client.1.smithi093.stdout:7/512: sync 2023-12-12T11:51:53.944 INFO:tasks.workunit.client.1.smithi093.stdout:8/608: mkdir d3/d1a/d1f/d59/d69/dbc/dc2 0 2023-12-12T11:51:53.945 INFO:tasks.workunit.client.0.smithi063.stdout:4/370: write d2/d8/f43 [499869,28334] 0 2023-12-12T11:51:53.953 INFO:tasks.workunit.client.0.smithi063.stdout:1/337: symlink d3/db/d16/d24/d4d/d35/l6e 0 2023-12-12T11:51:53.953 INFO:tasks.workunit.client.0.smithi063.stdout:1/338: write d3/db/d16/d24/d4d/d35/d5a/d5b/f65 [55990,51140] 0 2023-12-12T11:51:53.956 INFO:tasks.workunit.client.1.smithi093.stdout:9/550: rename d1/c2 to d1/d23/d24/d29/d43/d56/cbb 0 2023-12-12T11:51:53.959 INFO:tasks.workunit.client.1.smithi093.stdout:4/762: unlink d0/d31/d5c/lc0 0 2023-12-12T11:51:53.959 INFO:tasks.workunit.client.1.smithi093.stdout:4/763: stat d0/c2e 0 2023-12-12T11:51:53.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:53 smithi093 ceph-mon[115914]: mgrmap e24: smithi093.nbtltu(active, since 15s), standbys: smithi063.zjnfdi 2023-12-12T11:51:53.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:53 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "mgr metadata", "who": "smithi063.zjnfdi", "id": "smithi063.zjnfdi"}]: dispatch 2023-12-12T11:51:53.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:53 smithi093 ceph-mon[115914]: pgmap v11: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 144 MiB/s rd, 183 MiB/s wr, 273 op/s 2023-12-12T11:51:53.972 INFO:tasks.workunit.client.0.smithi063.stdout:8/434: mkdir d4/de/d3b/d62/d36/d57/d84 0 2023-12-12T11:51:53.972 INFO:tasks.workunit.client.0.smithi063.stdout:7/313: rename de/l10 to de/d34/l77 0 2023-12-12T11:51:53.972 INFO:tasks.workunit.client.0.smithi063.stdout:7/314: write de/d22/d2b/f46 [234257,38805] 0 2023-12-12T11:51:53.973 INFO:tasks.workunit.client.1.smithi093.stdout:3/540: dwrite df/d25/f44 [0,4194304] 0 2023-12-12T11:51:53.974 INFO:tasks.workunit.client.0.smithi063.stdout:9/297: unlink d7/d20/l2f 0 2023-12-12T11:51:53.980 INFO:tasks.workunit.client.0.smithi063.stdout:4/371: truncate d2/d47/f2d 809474 0 2023-12-12T11:51:53.983 INFO:tasks.workunit.client.0.smithi063.stdout:5/369: rmdir d7/d10/d2b/d3c/d42/d62 39 2023-12-12T11:51:53.983 INFO:tasks.workunit.client.0.smithi063.stdout:5/370: chown d7/f29 440 1 2023-12-12T11:51:53.988 INFO:tasks.workunit.client.0.smithi063.stdout:1/339: mkdir d3/d3a/d5e/d6f 0 2023-12-12T11:51:53.988 INFO:tasks.workunit.client.0.smithi063.stdout:1/340: read - d3/db/d16/d24/d4d/d35/d5a/d5b/f64 zero size 2023-12-12T11:51:53.990 INFO:tasks.workunit.client.0.smithi063.stdout:8/435: write d4/de/f30 [2224550,98998] 0 2023-12-12T11:51:53.993 INFO:tasks.workunit.client.1.smithi093.stdout:2/596: mkdir d5/d14/d2d/d12/d25/d7a/d7e/dc9 0 2023-12-12T11:51:53.998 INFO:tasks.workunit.client.1.smithi093.stdout:1/553: mknod d4/d1a/d1b/d26/d31/cb7 0 2023-12-12T11:51:53.998 INFO:tasks.workunit.client.1.smithi093.stdout:9/551: dwrite d1/f59 [0,4194304] 0 2023-12-12T11:51:54.001 INFO:tasks.workunit.client.1.smithi093.stdout:7/513: symlink da/d8e/daa/db3/lb4 0 2023-12-12T11:51:54.001 INFO:tasks.workunit.client.1.smithi093.stdout:0/585: dwrite d5/dd/f75 [0,4194304] 0 2023-12-12T11:51:54.003 INFO:tasks.workunit.client.1.smithi093.stdout:8/609: getdents d3/d1a/d1f/daf 0 2023-12-12T11:51:54.005 INFO:tasks.workunit.client.0.smithi063.stdout:7/315: creat de/d22/d6e/f78 x:0 0 0 2023-12-12T11:51:54.006 INFO:tasks.workunit.client.1.smithi093.stdout:4/764: rmdir d0/d87/d79/d86/da9 39 2023-12-12T11:51:54.008 INFO:tasks.workunit.client.0.smithi063.stdout:9/298: rmdir d7/d15 39 2023-12-12T11:51:54.012 INFO:tasks.workunit.client.0.smithi063.stdout:5/371: symlink d7/d10/d2b/d3c/d42/l6f 0 2023-12-12T11:51:54.013 INFO:tasks.workunit.client.0.smithi063.stdout:5/372: fsync d7/d28/d43/d49/f6d 0 2023-12-12T11:51:54.015 INFO:tasks.workunit.client.1.smithi093.stdout:3/541: creat df/d22/d49/d69/d78/daf/d3d/d42/d8e/da5/fb0 x:0 0 0 2023-12-12T11:51:54.016 INFO:tasks.workunit.client.0.smithi063.stdout:1/341: symlink d3/d3a/d52/l70 0 2023-12-12T11:51:54.017 INFO:tasks.workunit.client.0.smithi063.stdout:1/342: write d3/db/d16/d17/f55 [1635944,20472] 0 2023-12-12T11:51:54.017 INFO:tasks.workunit.client.0.smithi063.stdout:1/343: truncate d3/db/d16/d24/f2a 3085309 0 2023-12-12T11:51:54.017 INFO:tasks.workunit.client.0.smithi063.stdout:1/344: truncate d3/db/d16/d24/d4d/d35/d5a/d5b/f65 844131 0 2023-12-12T11:51:54.017 INFO:tasks.workunit.client.0.smithi063.stdout:1/345: dread - d3/db/d12/f49 zero size 2023-12-12T11:51:54.017 INFO:tasks.workunit.client.0.smithi063.stdout:1/346: write d3/db/d16/f2b [3195219,119871] 0 2023-12-12T11:51:54.017 INFO:tasks.workunit.client.0.smithi063.stdout:1/347: creat d3/db/d16/d24/d4d/f71 x:0 0 0 2023-12-12T11:51:54.019 INFO:tasks.workunit.client.1.smithi093.stdout:2/597: mkdir d5/d14/d2d/d96/dca 0 2023-12-12T11:51:54.024 INFO:tasks.workunit.client.1.smithi093.stdout:5/469: sync 2023-12-12T11:51:54.024 INFO:tasks.workunit.client.1.smithi093.stdout:6/680: sync 2023-12-12T11:51:54.024 INFO:tasks.workunit.client.1.smithi093.stdout:5/470: chown d0/d7/d8/cc 63217 1 2023-12-12T11:51:54.024 INFO:tasks.workunit.client.1.smithi093.stdout:6/681: chown d0/d52/d6b/ddb/dfe/f90 1048383047 1 2023-12-12T11:51:54.024 INFO:tasks.workunit.client.1.smithi093.stdout:6/682: truncate d0/da/d14/d21/ffd 821325 0 2023-12-12T11:51:54.025 INFO:tasks.workunit.client.1.smithi093.stdout:6/683: dread - d0/da/fcb zero size 2023-12-12T11:51:54.025 INFO:tasks.workunit.client.1.smithi093.stdout:1/554: symlink d4/d1a/lb8 0 2023-12-12T11:51:54.025 INFO:tasks.workunit.client.0.smithi063.stdout:7/316: dread f8 [0,4194304] 0 2023-12-12T11:51:54.025 INFO:tasks.workunit.client.0.smithi063.stdout:9/299: rmdir d7/d15 39 2023-12-12T11:51:54.025 INFO:tasks.workunit.client.0.smithi063.stdout:9/300: fsync f6 0 2023-12-12T11:51:54.025 INFO:tasks.workunit.client.0.smithi063.stdout:7/317: write de/d22/d6e/f78 [112516,120043] 0 2023-12-12T11:51:54.028 INFO:tasks.workunit.client.1.smithi093.stdout:9/552: mkdir d1/d12/d1f/d3d/db1/dbc 0 2023-12-12T11:51:54.028 INFO:tasks.workunit.client.0.smithi063.stdout:5/373: unlink d7/de/c1f 0 2023-12-12T11:51:54.028 INFO:tasks.workunit.client.0.smithi063.stdout:5/374: fsync d7/de/f1e 0 2023-12-12T11:51:54.030 INFO:tasks.workunit.client.1.smithi093.stdout:3/542: write df/d30/d33/d66/fa1 [1410344,16788] 0 2023-12-12T11:51:54.035 INFO:tasks.workunit.client.1.smithi093.stdout:2/598: write d5/d14/d2d/f1f [1739891,83250] 0 2023-12-12T11:51:54.038 INFO:tasks.workunit.client.1.smithi093.stdout:2/599: write d5/d14/d47/d56/f83 [399089,65189] 0 2023-12-12T11:51:54.039 INFO:tasks.workunit.client.0.smithi063.stdout:1/348: rename d3/d3a/d52/f67 to d3/db/d16/d24/d4d/d35/d5a/d5b/d6b/f72 0 2023-12-12T11:51:54.039 INFO:tasks.workunit.client.0.smithi063.stdout:0/315: sync 2023-12-12T11:51:54.039 INFO:tasks.workunit.client.0.smithi063.stdout:0/316: truncate d0/d7/ff 2729490 0 2023-12-12T11:51:54.043 INFO:tasks.workunit.client.1.smithi093.stdout:0/586: mkdir d5/d21/d27/d3a/d9a/db5 0 2023-12-12T11:51:54.044 INFO:tasks.workunit.client.0.smithi063.stdout:3/296: dwrite d4/df/f19 [0,4194304] 0 2023-12-12T11:51:54.044 INFO:tasks.workunit.client.0.smithi063.stdout:9/301: symlink d7/d15/d39/l59 0 2023-12-12T11:51:54.044 INFO:tasks.workunit.client.0.smithi063.stdout:9/302: chown d7/d11/d12/d30/f48 1474481 1 2023-12-12T11:51:54.044 INFO:tasks.workunit.client.0.smithi063.stdout:9/303: stat d7/d11/d12/f1a 0 2023-12-12T11:51:54.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:53 smithi063 ceph-mon[107117]: mgrmap e24: smithi093.nbtltu(active, since 15s), standbys: smithi063.zjnfdi 2023-12-12T11:51:54.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:53 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "mgr metadata", "who": "smithi063.zjnfdi", "id": "smithi063.zjnfdi"}]: dispatch 2023-12-12T11:51:54.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:53 smithi063 ceph-mon[107117]: pgmap v11: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 144 MiB/s rd, 183 MiB/s wr, 273 op/s 2023-12-12T11:51:54.045 INFO:tasks.workunit.client.1.smithi093.stdout:8/610: creat d3/d1a/d1f/d29/d3a/fc3 x:0 0 0 2023-12-12T11:51:54.046 INFO:tasks.workunit.client.0.smithi063.stdout:7/318: mknod de/d22/d6e/c79 0 2023-12-12T11:51:54.046 INFO:tasks.workunit.client.0.smithi063.stdout:7/319: write de/f4c [1050349,24138] 0 2023-12-12T11:51:54.049 INFO:tasks.workunit.client.1.smithi093.stdout:4/765: creat d0/d87/d79/d96/db5/ddd/fee x:0 0 0 2023-12-12T11:51:54.050 INFO:tasks.workunit.client.0.smithi063.stdout:5/375: unlink d7/d10/d2b/d3c/f2d 0 2023-12-12T11:51:54.051 INFO:tasks.workunit.client.1.smithi093.stdout:6/684: stat d0/d52/d6b/c93 0 2023-12-12T11:51:54.052 INFO:tasks.workunit.client.1.smithi093.stdout:2/600: dread d5/d14/d2d/d12/d25/fb2 [0,4194304] 0 2023-12-12T11:51:54.053 INFO:tasks.workunit.client.0.smithi063.stdout:1/349: creat d3/db/d16/d24/f73 x:0 0 0 2023-12-12T11:51:54.053 INFO:tasks.workunit.client.1.smithi093.stdout:3/543: dread df/d22/d49/d69/d78/daf/d3d/d59/f64 [0,4194304] 0 2023-12-12T11:51:54.057 INFO:tasks.workunit.client.1.smithi093.stdout:1/555: mkdir d4/d1a/d83/d9a/da9/db9 0 2023-12-12T11:51:54.057 INFO:tasks.workunit.client.1.smithi093.stdout:1/556: chown d4/d1a/d1b/d26/d65/f7b 12359030 1 2023-12-12T11:51:54.057 INFO:tasks.workunit.client.1.smithi093.stdout:1/557: write d4/d1c/f6d [1322877,98262] 0 2023-12-12T11:51:54.057 INFO:tasks.workunit.client.1.smithi093.stdout:1/558: fdatasync d4/d1a/d1b/d26/f27 0 2023-12-12T11:51:54.058 INFO:tasks.workunit.client.0.smithi063.stdout:0/317: dread - d0/d1a/d23/d34/f58 zero size 2023-12-12T11:51:54.060 INFO:tasks.workunit.client.1.smithi093.stdout:7/514: symlink da/d15/lb5 0 2023-12-12T11:51:54.061 INFO:tasks.workunit.client.1.smithi093.stdout:7/515: truncate da/de/d46/f52 2447537 0 2023-12-12T11:51:54.063 INFO:tasks.workunit.client.0.smithi063.stdout:4/372: dwrite d2/d17/f59 [0,4194304] 0 2023-12-12T11:51:54.066 INFO:tasks.workunit.client.0.smithi063.stdout:3/297: link d4/df/d1a/f31 d4/d23/d5d/d4c/f66 0 2023-12-12T11:51:54.067 INFO:tasks.workunit.client.1.smithi093.stdout:0/587: creat d5/dd/d14/d26/d58/dab/fb6 x:0 0 0 2023-12-12T11:51:54.070 INFO:tasks.workunit.client.0.smithi063.stdout:9/304: truncate f0 1093006 0 2023-12-12T11:51:54.070 INFO:tasks.workunit.client.1.smithi093.stdout:8/611: symlink d3/d1a/d1f/d29/d3a/d68/d8a/lc4 0 2023-12-12T11:51:54.073 INFO:tasks.workunit.client.1.smithi093.stdout:4/766: mkdir d0/d31/d5c/def 0 2023-12-12T11:51:54.076 INFO:tasks.workunit.client.0.smithi063.stdout:5/376: rename d7/d10/c65 to d7/d10/d2b/d3c/d27/c70 0 2023-12-12T11:51:54.078 INFO:tasks.workunit.client.1.smithi093.stdout:9/553: dwrite d1/d12/d1f/d3d/d57/d63/fad [0,4194304] 0 2023-12-12T11:51:54.078 INFO:tasks.workunit.client.1.smithi093.stdout:9/554: truncate d1/d23/d24/d29/d43/f5e 4340900 0 2023-12-12T11:51:54.079 INFO:tasks.workunit.client.0.smithi063.stdout:1/350: symlink d3/db/d16/d24/l74 0 2023-12-12T11:51:54.080 INFO:tasks.workunit.client.1.smithi093.stdout:2/601: creat d5/d14/d2d/fcb x:0 0 0 2023-12-12T11:51:54.081 INFO:tasks.workunit.client.1.smithi093.stdout:1/559: read d4/d1c/d2a/f2c [746441,31920] 0 2023-12-12T11:51:54.081 INFO:tasks.workunit.client.1.smithi093.stdout:1/560: creat d4/d1a/d1b/d26/d31/fba x:0 0 0 2023-12-12T11:51:54.083 INFO:tasks.workunit.client.1.smithi093.stdout:3/544: mkdir df/d22/d49/d69/d78/daf/d3d/d6f/db1 0 2023-12-12T11:51:54.085 INFO:tasks.workunit.client.0.smithi063.stdout:0/318: mknod d0/d1a/d23/d34/d42/c6c 0 2023-12-12T11:51:54.096 INFO:tasks.workunit.client.0.smithi063.stdout:4/373: symlink d2/d48/l73 0 2023-12-12T11:51:54.096 INFO:tasks.workunit.client.0.smithi063.stdout:4/374: truncate d2/d17/d61/f71 105723 0 2023-12-12T11:51:54.097 INFO:tasks.workunit.client.1.smithi093.stdout:4/767: dread d0/d87/d79/d86/f8a [0,4194304] 0 2023-12-12T11:51:54.097 INFO:tasks.workunit.client.1.smithi093.stdout:4/768: fsync d0/d87/d79/d7f/fb1 0 2023-12-12T11:51:54.098 INFO:tasks.workunit.client.0.smithi063.stdout:7/320: rmdir de/d3f 39 2023-12-12T11:51:54.103 INFO:tasks.workunit.client.0.smithi063.stdout:9/305: rename d7/d11/d12/d30/c3a to d7/d11/d12/d30/d3e/c5a 0 2023-12-12T11:51:54.108 INFO:tasks.workunit.client.0.smithi063.stdout:7/321: mknod de/d22/d66/c7a 0 2023-12-12T11:51:54.109 INFO:tasks.workunit.client.0.smithi063.stdout:0/319: getdents d0/d7/d27/d19/d2d 0 2023-12-12T11:51:54.110 INFO:tasks.workunit.client.1.smithi093.stdout:9/555: symlink d1/d12/d1f/d3d/lbd 0 2023-12-12T11:51:54.113 INFO:tasks.workunit.client.1.smithi093.stdout:2/602: creat d5/d14/d47/d4e/fcc x:0 0 0 2023-12-12T11:51:54.113 INFO:tasks.workunit.client.0.smithi063.stdout:7/322: mkdir de/d39/d4b/d7b 0 2023-12-12T11:51:54.115 INFO:tasks.workunit.client.0.smithi063.stdout:7/323: rename de/d22/f24 to de/d33/d41/f7c 0 2023-12-12T11:51:54.117 INFO:tasks.workunit.client.1.smithi093.stdout:3/545: symlink df/d22/d49/d69/d6e/lb2 0 2023-12-12T11:51:54.119 INFO:tasks.workunit.client.0.smithi063.stdout:7/324: creat de/d34/d43/d45/f7d x:0 0 0 2023-12-12T11:51:54.119 INFO:tasks.workunit.client.1.smithi093.stdout:7/516: rename da/d2e/l32 to da/d15/lb6 0 2023-12-12T11:51:54.121 INFO:tasks.workunit.client.1.smithi093.stdout:1/561: mknod d4/d85/cbb 0 2023-12-12T11:51:54.121 INFO:tasks.workunit.client.0.smithi063.stdout:7/325: symlink de/d33/d41/l7e 0 2023-12-12T11:51:54.129 INFO:tasks.workunit.client.0.smithi063.stdout:9/306: dread d7/d20/f29 [0,4194304] 0 2023-12-12T11:51:54.129 INFO:tasks.workunit.client.1.smithi093.stdout:3/546: symlink df/d22/d49/d69/d78/daf/d3d/d6f/db1/lb3 0 2023-12-12T11:51:54.129 INFO:tasks.workunit.client.1.smithi093.stdout:3/547: write df/f19 [6081176,18091] 0 2023-12-12T11:51:54.129 INFO:tasks.workunit.client.1.smithi093.stdout:3/548: truncate df/d22/f31 541123 0 2023-12-12T11:51:54.129 INFO:tasks.workunit.client.1.smithi093.stdout:3/549: truncate df/d25/d2c/f9b 75847 0 2023-12-12T11:51:54.129 INFO:tasks.workunit.client.1.smithi093.stdout:4/769: getdents d0/d31 0 2023-12-12T11:51:54.129 INFO:tasks.workunit.client.1.smithi093.stdout:4/770: chown d0/d31/d5c/d66/l64 2 1 2023-12-12T11:51:54.129 INFO:tasks.workunit.client.1.smithi093.stdout:4/771: chown d0/f20 146959522 1 2023-12-12T11:51:54.129 INFO:tasks.workunit.client.1.smithi093.stdout:4/772: write d0/f17 [1842110,23749] 0 2023-12-12T11:51:54.129 INFO:tasks.workunit.client.1.smithi093.stdout:4/773: fdatasync d0/d36/f4c 0 2023-12-12T11:51:54.131 INFO:tasks.workunit.client.0.smithi063.stdout:7/326: write de/d3f/f59 [471799,6757] 0 2023-12-12T11:51:54.131 INFO:tasks.workunit.client.0.smithi063.stdout:1/351: dread d3/db/d16/f36 [0,4194304] 0 2023-12-12T11:51:54.131 INFO:tasks.workunit.client.0.smithi063.stdout:1/352: dread - d3/db/d16/d24/f73 zero size 2023-12-12T11:51:54.135 INFO:tasks.workunit.client.0.smithi063.stdout:7/327: rmdir de/d22/d2b/d4a 39 2023-12-12T11:51:54.135 INFO:tasks.workunit.client.0.smithi063.stdout:7/328: truncate de/d22/d2b/d61/f73 221020 0 2023-12-12T11:51:54.136 INFO:tasks.workunit.client.1.smithi093.stdout:7/517: rename da/d15/d2d/l54 to da/d2e/lb7 0 2023-12-12T11:51:54.136 INFO:tasks.workunit.client.1.smithi093.stdout:1/562: rmdir d4/d1a/d1b/d26/d65/d6f/db3/db4 0 2023-12-12T11:51:54.138 INFO:tasks.workunit.client.1.smithi093.stdout:2/603: dread d5/d14/d2d/ff [0,4194304] 0 2023-12-12T11:51:54.145 INFO:tasks.workunit.client.0.smithi063.stdout:4/375: write d2/d17/d41/f4d [3817625,81395] 0 2023-12-12T11:51:54.148 INFO:tasks.workunit.client.0.smithi063.stdout:3/298: dwrite d4/d23/d5d/d4c/f66 [0,4194304] 0 2023-12-12T11:51:54.148 INFO:tasks.workunit.client.0.smithi063.stdout:3/299: readlink d4/df/d1a/d1c/d41/l42 0 2023-12-12T11:51:54.150 INFO:tasks.workunit.client.1.smithi093.stdout:3/550: write df/f21 [2407028,100096] 0 2023-12-12T11:51:54.151 INFO:tasks.workunit.client.1.smithi093.stdout:6/685: dwrite d0/da/d14/d38/d43/f9d [0,4194304] 0 2023-12-12T11:51:54.151 INFO:tasks.workunit.client.1.smithi093.stdout:6/686: chown d0/da/d32/d9e/d4d/de9/ff9 174 1 2023-12-12T11:51:54.151 INFO:tasks.workunit.client.1.smithi093.stdout:6/687: read - d0/da/d32/dd3/fcc zero size 2023-12-12T11:51:54.151 INFO:tasks.workunit.client.1.smithi093.stdout:6/688: creat d0/d52/dbc/f100 x:0 0 0 2023-12-12T11:51:54.151 INFO:tasks.workunit.client.1.smithi093.stdout:6/689: creat d0/da/d32/d39/d5b/f101 x:0 0 0 2023-12-12T11:51:54.151 INFO:tasks.workunit.client.1.smithi093.stdout:6/690: chown d0/da/d32/d9e/d4d/deb 31862077 1 2023-12-12T11:51:54.152 INFO:tasks.workunit.client.1.smithi093.stdout:2/604: dread d5/d14/d2d/d4c/fba [0,4194304] 0 2023-12-12T11:51:54.152 INFO:tasks.workunit.client.0.smithi063.stdout:3/300: write d4/df/d1a/d1c/f43 [194285,79122] 0 2023-12-12T11:51:54.159 INFO:tasks.workunit.client.0.smithi063.stdout:9/307: write d7/d11/f25 [1851307,113921] 0 2023-12-12T11:51:54.169 INFO:tasks.workunit.client.1.smithi093.stdout:3/551: write df/d22/d49/d69/d78/daf/d3d/d42/d9d/fa4 [3510956,23862] 0 2023-12-12T11:51:54.169 INFO:tasks.workunit.client.1.smithi093.stdout:8/612: dwrite d3/d1a/d1f/d29/d3a/d68/d8a/f90 [0,4194304] 0 2023-12-12T11:51:54.169 INFO:tasks.workunit.client.1.smithi093.stdout:3/552: creat df/d25/fb4 x:0 0 0 2023-12-12T11:51:54.169 INFO:tasks.workunit.client.1.smithi093.stdout:3/553: creat df/d22/d49/d69/fb5 x:0 0 0 2023-12-12T11:51:54.170 INFO:tasks.workunit.client.1.smithi093.stdout:3/554: stat df/d22/d49/d69/d78/daf/d3d/d42/d8e 0 2023-12-12T11:51:54.175 INFO:tasks.workunit.client.1.smithi093.stdout:4/774: dread d0/d36/d49/faf [0,4194304] 0 2023-12-12T11:51:54.178 INFO:tasks.workunit.client.1.smithi093.stdout:1/563: dwrite d4/dc/d7a/d9c/fa2 [0,4194304] 0 2023-12-12T11:51:54.180 INFO:tasks.workunit.client.0.smithi063.stdout:0/320: dwrite d0/d1a/d23/d34/d42/f3e [0,4194304] 0 2023-12-12T11:51:54.180 INFO:tasks.workunit.client.1.smithi093.stdout:6/691: mkdir d0/d52/d7e/d102 0 2023-12-12T11:51:54.186 INFO:tasks.workunit.client.1.smithi093.stdout:2/605: symlink d5/d31/dbc/lcd 0 2023-12-12T11:51:54.187 INFO:tasks.workunit.client.0.smithi063.stdout:7/329: dwrite de/d34/d43/d45/d4e/f5d [0,4194304] 0 2023-12-12T11:51:54.192 INFO:tasks.workunit.client.0.smithi063.stdout:3/301: truncate d4/d23/f49 3613335 0 2023-12-12T11:51:54.196 INFO:tasks.workunit.client.1.smithi093.stdout:8/613: read d3/f1c [3831633,68516] 0 2023-12-12T11:51:54.202 INFO:tasks.workunit.client.1.smithi093.stdout:6/692: write d0/d52/d7e/d42/f8b [3906680,123256] 0 2023-12-12T11:51:54.202 INFO:tasks.workunit.client.1.smithi093.stdout:6/693: write d0/da/d32/fa9 [651349,75512] 0 2023-12-12T11:51:54.205 INFO:tasks.workunit.client.0.smithi063.stdout:1/353: dwrite d3/db/d16/f5c [4194304,4194304] 0 2023-12-12T11:51:54.207 INFO:tasks.workunit.client.1.smithi093.stdout:4/775: dwrite d0/d31/d5c/d66/f6a [0,4194304] 0 2023-12-12T11:51:54.211 INFO:tasks.workunit.client.1.smithi093.stdout:3/555: unlink df/d22/l2a 0 2023-12-12T11:51:54.211 INFO:tasks.workunit.client.1.smithi093.stdout:3/556: truncate df/f86 679852 0 2023-12-12T11:51:54.214 INFO:tasks.workunit.client.1.smithi093.stdout:6/694: write d0/d52/f6e [777599,8172] 0 2023-12-12T11:51:54.214 INFO:tasks.workunit.client.1.smithi093.stdout:6/695: chown d0/da/d32/d39/d5b/fa2 14810777 1 2023-12-12T11:51:54.217 INFO:tasks.workunit.client.1.smithi093.stdout:7/518: rmdir da/d15 39 2023-12-12T11:51:54.217 INFO:tasks.workunit.client.1.smithi093.stdout:7/519: fdatasync da/d15/d2d/d2f/fa5 0 2023-12-12T11:51:54.217 INFO:tasks.workunit.client.1.smithi093.stdout:7/520: write da/d2e/f8f [1091397,102140] 0 2023-12-12T11:51:54.220 INFO:tasks.workunit.client.1.smithi093.stdout:1/564: creat d4/d1a/d83/d92/fbc x:0 0 0 2023-12-12T11:51:54.221 INFO:tasks.workunit.client.0.smithi063.stdout:0/321: mknod d0/c6d 0 2023-12-12T11:51:54.221 INFO:tasks.workunit.client.0.smithi063.stdout:0/322: write d0/d1a/d23/d2e/f64 [1041815,125076] 0 2023-12-12T11:51:54.221 INFO:tasks.workunit.client.0.smithi063.stdout:0/323: stat d0/d7/ff 0 2023-12-12T11:51:54.222 INFO:tasks.workunit.client.1.smithi093.stdout:2/606: symlink d5/d14/d2d/d4c/d54/dc5/d61/lce 0 2023-12-12T11:51:54.222 INFO:tasks.workunit.client.1.smithi093.stdout:2/607: write d5/d14/d2d/ff [2243375,6380] 0 2023-12-12T11:51:54.224 INFO:tasks.workunit.client.0.smithi063.stdout:4/376: truncate d2/d8/f12 492796 0 2023-12-12T11:51:54.231 INFO:tasks.workunit.client.0.smithi063.stdout:7/330: mkdir de/d39/d4b/d7b/d7f 0 2023-12-12T11:51:54.234 INFO:tasks.workunit.client.0.smithi063.stdout:3/302: link d4/df/c1b d4/df/d1a/d1c/d34/d54/c67 0 2023-12-12T11:51:54.240 INFO:tasks.workunit.client.0.smithi063.stdout:1/354: unlink d3/db/d16/f36 0 2023-12-12T11:51:54.250 INFO:tasks.workunit.client.1.smithi093.stdout:3/557: symlink df/d30/d33/d66/lb6 0 2023-12-12T11:51:54.252 INFO:tasks.workunit.client.1.smithi093.stdout:6/696: mkdir d0/d52/d7e/d42/dd5/ddc/d103 0 2023-12-12T11:51:54.252 INFO:tasks.workunit.client.1.smithi093.stdout:7/521: creat da/de/d78/fb8 x:0 0 0 2023-12-12T11:51:54.252 INFO:tasks.workunit.client.1.smithi093.stdout:7/522: read - da/d2e/f93 zero size 2023-12-12T11:51:54.252 INFO:tasks.workunit.client.1.smithi093.stdout:7/523: chown da/d15/d19/l85 1 1 2023-12-12T11:51:54.253 INFO:tasks.workunit.client.0.smithi063.stdout:4/377: symlink d2/d48/d69/l74 0 2023-12-12T11:51:54.254 INFO:tasks.workunit.client.1.smithi093.stdout:7/524: truncate da/de/f72 2903158 0 2023-12-12T11:51:54.256 INFO:tasks.workunit.client.1.smithi093.stdout:8/614: rmdir d3/d1a/d1f/d29/d3a/d40/dbf 39 2023-12-12T11:51:54.258 INFO:tasks.workunit.client.0.smithi063.stdout:2/302: sync 2023-12-12T11:51:54.259 INFO:tasks.workunit.client.1.smithi093.stdout:1/565: dwrite d4/d1c/d2a/f2b [0,4194304] 0 2023-12-12T11:51:54.259 INFO:tasks.workunit.client.1.smithi093.stdout:1/566: creat d4/d81/fbd x:0 0 0 2023-12-12T11:51:54.260 INFO:tasks.workunit.client.0.smithi063.stdout:1/355: mkdir d3/db/d16/d24/d48/d75 0 2023-12-12T11:51:54.260 INFO:tasks.workunit.client.0.smithi063.stdout:1/356: fsync d3/db/d12/f49 0 2023-12-12T11:51:54.260 INFO:tasks.workunit.client.1.smithi093.stdout:7/525: dread da/d15/d2d/d2f/f61 [0,4194304] 0 2023-12-12T11:51:54.261 INFO:tasks.workunit.client.1.smithi093.stdout:5/471: sync 2023-12-12T11:51:54.262 INFO:tasks.workunit.client.0.smithi063.stdout:0/324: creat d0/d1a/d66/f6e x:0 0 0 2023-12-12T11:51:54.264 INFO:tasks.workunit.client.1.smithi093.stdout:5/472: write d0/d7/d59/d48/f6c [1073289,59572] 0 2023-12-12T11:51:54.268 INFO:tasks.workunit.client.1.smithi093.stdout:4/776: rmdir d0/d87 39 2023-12-12T11:51:54.268 INFO:tasks.workunit.client.1.smithi093.stdout:4/777: chown d0/d31/d5c/c76 7369 1 2023-12-12T11:51:54.270 INFO:tasks.workunit.client.0.smithi063.stdout:4/378: creat d2/d17/d41/f75 x:0 0 0 2023-12-12T11:51:54.272 INFO:tasks.workunit.client.1.smithi093.stdout:0/588: sync 2023-12-12T11:51:54.272 INFO:tasks.workunit.client.1.smithi093.stdout:9/556: sync 2023-12-12T11:51:54.272 INFO:tasks.workunit.client.1.smithi093.stdout:2/608: dwrite d5/d14/d5e/f70 [0,4194304] 0 2023-12-12T11:51:54.272 INFO:tasks.workunit.client.1.smithi093.stdout:2/609: chown d5/d14/d2d/d4c/d54/dc5/d55 8737 1 2023-12-12T11:51:54.272 INFO:tasks.workunit.client.1.smithi093.stdout:9/557: creat d1/d23/d24/d29/d43/d56/d68/fbe x:0 0 0 2023-12-12T11:51:54.272 INFO:tasks.workunit.client.1.smithi093.stdout:9/558: chown d1/d12/d1f/f70 1499 1 2023-12-12T11:51:54.274 INFO:tasks.workunit.client.0.smithi063.stdout:7/331: rmdir de/d39/d4b 39 2023-12-12T11:51:54.275 INFO:tasks.workunit.client.1.smithi093.stdout:8/615: dread d3/d73/f77 [0,4194304] 0 2023-12-12T11:51:54.276 INFO:tasks.workunit.client.1.smithi093.stdout:7/526: rename da/de/d78/da6 to da/de/d46/db9 0 2023-12-12T11:51:54.277 INFO:tasks.workunit.client.1.smithi093.stdout:7/527: read da/d15/d19/f1e [333248,64600] 0 2023-12-12T11:51:54.279 INFO:tasks.workunit.client.0.smithi063.stdout:3/303: symlink d4/l68 0 2023-12-12T11:51:54.280 INFO:tasks.workunit.client.1.smithi093.stdout:5/473: write d0/d7/d59/d48/f5f [2407303,21933] 0 2023-12-12T11:51:54.281 INFO:tasks.workunit.client.1.smithi093.stdout:1/567: dread d4/d1a/d1b/d26/d65/d6f/f89 [0,4194304] 0 2023-12-12T11:51:54.281 INFO:tasks.workunit.client.1.smithi093.stdout:1/568: dread - d4/d1a/d83/f8b zero size 2023-12-12T11:51:54.282 INFO:tasks.workunit.client.0.smithi063.stdout:2/303: creat d0/f63 x:0 0 0 2023-12-12T11:51:54.282 INFO:tasks.workunit.client.0.smithi063.stdout:2/304: chown d0/d1a/c24 26739 1 2023-12-12T11:51:54.286 INFO:tasks.workunit.client.0.smithi063.stdout:1/357: rename d3/db/d16/d24/d4d/d35/l6c to d3/db/d16/d24/d4d/d35/l76 0 2023-12-12T11:51:54.286 INFO:tasks.workunit.client.0.smithi063.stdout:1/358: stat d3/db/d16/d24/d4d/f71 0 2023-12-12T11:51:54.288 INFO:tasks.workunit.client.1.smithi093.stdout:3/558: dread df/f1a [0,4194304] 0 2023-12-12T11:51:54.289 INFO:tasks.workunit.client.1.smithi093.stdout:4/778: mknod d0/d31/d89/da1/cf0 0 2023-12-12T11:51:54.295 INFO:tasks.workunit.client.1.smithi093.stdout:0/589: truncate d5/d21/d27/d3a/f4a 1812547 0 2023-12-12T11:51:54.295 INFO:tasks.workunit.client.0.smithi063.stdout:3/304: mkdir d4/d23/d5d/d4c/d69 0 2023-12-12T11:51:54.297 INFO:tasks.workunit.client.0.smithi063.stdout:4/379: mkdir d2/d8/d76 0 2023-12-12T11:51:54.299 INFO:tasks.workunit.client.0.smithi063.stdout:7/332: write de/d22/f31 [3259517,104210] 0 2023-12-12T11:51:54.299 INFO:tasks.workunit.client.0.smithi063.stdout:7/333: write de/d34/d43/d45/f7d [40344,76433] 0 2023-12-12T11:51:54.299 INFO:tasks.workunit.client.1.smithi093.stdout:7/528: dread da/d15/d19/f9d [0,4194304] 0 2023-12-12T11:51:54.300 INFO:tasks.workunit.client.1.smithi093.stdout:7/529: readlink da/d2e/d89/la3 0 2023-12-12T11:51:54.300 INFO:tasks.workunit.client.1.smithi093.stdout:7/530: fsync da/d15/d59/f66 0 2023-12-12T11:51:54.300 INFO:tasks.workunit.client.1.smithi093.stdout:9/559: dread d1/d23/d24/d29/d43/d56/d68/f90 [0,4194304] 0 2023-12-12T11:51:54.300 INFO:tasks.workunit.client.1.smithi093.stdout:8/616: mkdir d3/d8/d88/dc5 0 2023-12-12T11:51:54.304 INFO:tasks.workunit.client.0.smithi063.stdout:4/380: mkdir d2/d47/d77 0 2023-12-12T11:51:54.304 INFO:tasks.workunit.client.0.smithi063.stdout:4/381: stat d2/d47/f30 0 2023-12-12T11:51:54.308 INFO:tasks.workunit.client.0.smithi063.stdout:7/334: mkdir de/d39/d60/d80 0 2023-12-12T11:51:54.316 INFO:tasks.workunit.client.0.smithi063.stdout:1/359: dread d3/db/f1d [0,4194304] 0 2023-12-12T11:51:54.318 INFO:tasks.workunit.client.1.smithi093.stdout:3/559: mknod df/d22/d49/d69/d78/daf/d3d/d42/cb7 0 2023-12-12T11:51:54.319 INFO:tasks.workunit.client.0.smithi063.stdout:4/382: creat d2/d8/f78 x:0 0 0 2023-12-12T11:51:54.319 INFO:tasks.workunit.client.0.smithi063.stdout:4/383: creat d2/d47/f79 x:0 0 0 2023-12-12T11:51:54.321 INFO:tasks.workunit.client.1.smithi093.stdout:4/779: symlink d0/d36/d61/d97/lf1 0 2023-12-12T11:51:54.322 INFO:tasks.workunit.client.0.smithi063.stdout:7/335: creat de/d39/d4b/f81 x:0 0 0 2023-12-12T11:51:54.322 INFO:tasks.workunit.client.0.smithi063.stdout:7/336: chown de/d33 286698 1 2023-12-12T11:51:54.325 INFO:tasks.workunit.client.1.smithi093.stdout:6/697: dwrite d0/da/d14/d3a/d95/fab [0,4194304] 0 2023-12-12T11:51:54.327 INFO:tasks.workunit.client.0.smithi063.stdout:4/384: creat d2/d8/d76/f7a x:0 0 0 2023-12-12T11:51:54.328 INFO:tasks.workunit.client.1.smithi093.stdout:1/569: dread d4/d1a/d1b/d26/d31/f7e [0,4194304] 0 2023-12-12T11:51:54.328 INFO:tasks.workunit.client.0.smithi063.stdout:0/325: dwrite d0/d1a/d23/d34/f58 [0,4194304] 0 2023-12-12T11:51:54.329 INFO:tasks.workunit.client.1.smithi093.stdout:0/590: creat d5/dd/d62/fb7 x:0 0 0 2023-12-12T11:51:54.334 INFO:tasks.workunit.client.0.smithi063.stdout:7/337: truncate de/d34/d43/d45/d4e/f5d 3493989 0 2023-12-12T11:51:54.334 INFO:tasks.workunit.client.0.smithi063.stdout:7/338: write de/f21 [1354781,109433] 0 2023-12-12T11:51:54.334 INFO:tasks.workunit.client.0.smithi063.stdout:7/339: chown de/d22/d2b/d61/f62 38 1 2023-12-12T11:51:54.334 INFO:tasks.workunit.client.0.smithi063.stdout:7/340: fdatasync fb 0 2023-12-12T11:51:54.334 INFO:tasks.workunit.client.0.smithi063.stdout:7/341: write de/d39/d4b/f70 [27656,126539] 0 2023-12-12T11:51:54.341 INFO:tasks.workunit.client.0.smithi063.stdout:4/385: dread d2/d17/d61/f71 [0,4194304] 0 2023-12-12T11:51:54.345 INFO:tasks.workunit.client.0.smithi063.stdout:0/326: unlink d0/d1a/d23/d2e/l6b 0 2023-12-12T11:51:54.347 INFO:tasks.workunit.client.0.smithi063.stdout:0/327: unlink d0/d1a/d23/f54 0 2023-12-12T11:51:54.352 INFO:tasks.workunit.client.0.smithi063.stdout:0/328: truncate d0/d7/d27/d1f/f2c 614557 0 2023-12-12T11:51:54.353 INFO:tasks.workunit.client.1.smithi093.stdout:4/780: dread d0/f27 [0,4194304] 0 2023-12-12T11:51:54.355 INFO:tasks.workunit.client.1.smithi093.stdout:0/591: write d5/dd/f35 [3499087,98211] 0 2023-12-12T11:51:54.356 INFO:tasks.workunit.client.0.smithi063.stdout:0/329: creat d0/d1a/d66/f6f x:0 0 0 2023-12-12T11:51:54.356 INFO:tasks.workunit.client.0.smithi063.stdout:0/330: write d0/d1a/d23/d2e/f5e [327811,62509] 0 2023-12-12T11:51:54.356 INFO:tasks.workunit.client.0.smithi063.stdout:3/305: dread d4/df/d1a/d1c/d3b/d50/f5a [0,4194304] 0 2023-12-12T11:51:54.370 INFO:tasks.workunit.client.0.smithi063.stdout:2/305: dwrite d0/d1a/d1e/f4b [0,4194304] 0 2023-12-12T11:51:54.377 INFO:tasks.workunit.client.1.smithi093.stdout:2/610: dwrite d5/d14/d2d/d4c/d54/dc5/faa [0,4194304] 0 2023-12-12T11:51:54.377 INFO:tasks.workunit.client.1.smithi093.stdout:2/611: chown d5/d14/d2d/d4c/l88 607213230 1 2023-12-12T11:51:54.377 INFO:tasks.workunit.client.1.smithi093.stdout:1/570: dread d4/d1a/d73/f97 [0,4194304] 0 2023-12-12T11:51:54.377 INFO:tasks.workunit.client.1.smithi093.stdout:0/592: rename d5/d4d to d5/d21/d27/d3a/d9a/db5/db8 0 2023-12-12T11:51:54.377 INFO:tasks.workunit.client.1.smithi093.stdout:0/593: creat d5/d21/d2f/d54/fb9 x:0 0 0 2023-12-12T11:51:54.378 INFO:tasks.workunit.client.1.smithi093.stdout:5/474: dwrite d0/d7/d8/d8f/f95 [0,4194304] 0 2023-12-12T11:51:54.379 INFO:tasks.workunit.client.1.smithi093.stdout:6/698: dwrite d0/da/d32/d39/f91 [0,4194304] 0 2023-12-12T11:51:54.379 INFO:tasks.workunit.client.1.smithi093.stdout:6/699: fdatasync d0/d52/d7e/f58 0 2023-12-12T11:51:54.379 INFO:tasks.workunit.client.1.smithi093.stdout:6/700: chown d0/d52/d6b/ddb/dfe/f7d 163 1 2023-12-12T11:51:54.387 INFO:tasks.workunit.client.0.smithi063.stdout:2/306: mkdir d0/d1a/d1e/d64 0 2023-12-12T11:51:54.387 INFO:tasks.workunit.client.0.smithi063.stdout:2/307: readlink d0/d1a/d48/l38 0 2023-12-12T11:51:54.390 INFO:tasks.workunit.client.1.smithi093.stdout:8/617: dwrite d3/d1a/d1f/fbb [0,4194304] 0 2023-12-12T11:51:54.391 INFO:tasks.workunit.client.0.smithi063.stdout:1/360: rmdir d3/db/d16/d24 39 2023-12-12T11:51:54.393 INFO:tasks.workunit.client.1.smithi093.stdout:7/531: dwrite da/de/d46/f4e [0,4194304] 0 2023-12-12T11:51:54.396 INFO:tasks.workunit.client.1.smithi093.stdout:1/571: link d4/d81/c84 d4/dc/cbe 0 2023-12-12T11:51:54.398 INFO:tasks.workunit.client.0.smithi063.stdout:1/361: write d3/db/d12/f50 [468240,103030] 0 2023-12-12T11:51:54.398 INFO:tasks.workunit.client.0.smithi063.stdout:2/308: rename d0/f4f to d0/d1a/d48/d56/f65 0 2023-12-12T11:51:54.401 INFO:tasks.workunit.client.1.smithi093.stdout:6/701: dread d0/d52/dbc/fc2 [0,4194304] 0 2023-12-12T11:51:54.404 INFO:tasks.workunit.client.1.smithi093.stdout:0/594: symlink d5/d21/d27/d3a/d9a/lba 0 2023-12-12T11:51:54.404 INFO:tasks.workunit.client.1.smithi093.stdout:0/595: truncate d5/dd/d14/d26/d58/d72/fa9 208726 0 2023-12-12T11:51:54.404 INFO:tasks.workunit.client.1.smithi093.stdout:0/596: chown d5/d21/d27/d3a/d9a/fa7 49598 1 2023-12-12T11:51:54.404 INFO:tasks.workunit.client.1.smithi093.stdout:0/597: truncate d5/dd/d14/d26/d58/f8a 832896 0 2023-12-12T11:51:54.405 INFO:tasks.workunit.client.1.smithi093.stdout:0/598: write d5/dd/d14/d26/f3f [2845295,88899] 0 2023-12-12T11:51:54.405 INFO:tasks.workunit.client.0.smithi063.stdout:1/362: mknod d3/d3a/d52/c77 0 2023-12-12T11:51:54.410 INFO:tasks.workunit.client.0.smithi063.stdout:2/309: rename d0/f63 to d0/d41/f66 0 2023-12-12T11:51:54.410 INFO:tasks.workunit.client.1.smithi093.stdout:4/781: dwrite d0/d36/d49/fc9 [0,4194304] 0 2023-12-12T11:51:54.410 INFO:tasks.workunit.client.1.smithi093.stdout:4/782: write d0/d36/d40/fb3 [405456,34340] 0 2023-12-12T11:51:54.411 INFO:tasks.workunit.client.0.smithi063.stdout:4/386: dwrite d2/d17/d41/f44 [0,4194304] 0 2023-12-12T11:51:54.411 INFO:tasks.workunit.client.0.smithi063.stdout:3/306: dwrite d4/df/d1a/d1c/d41/f51 [0,4194304] 0 2023-12-12T11:51:54.411 INFO:tasks.workunit.client.0.smithi063.stdout:4/387: fsync d2/d47/f2d 0 2023-12-12T11:51:54.413 INFO:tasks.workunit.client.1.smithi093.stdout:5/475: symlink d0/d3b/d66/l9f 0 2023-12-12T11:51:54.414 INFO:tasks.workunit.client.1.smithi093.stdout:3/560: dwrite fc [0,4194304] 0 2023-12-12T11:51:54.415 INFO:tasks.workunit.client.0.smithi063.stdout:1/363: creat d3/db/d16/d24/f78 x:0 0 0 2023-12-12T11:51:54.420 INFO:tasks.workunit.client.1.smithi093.stdout:2/612: rmdir d5/d14/d2d/d4c/d54/d67/d69/d6c 39 2023-12-12T11:51:54.427 INFO:tasks.workunit.client.1.smithi093.stdout:8/618: rmdir d3/d1a/d1f/d29/d3a/d40/dbf 39 2023-12-12T11:51:54.428 INFO:tasks.workunit.client.0.smithi063.stdout:4/388: dread d2/f10 [0,4194304] 0 2023-12-12T11:51:54.431 INFO:tasks.workunit.client.1.smithi093.stdout:7/532: symlink da/d15/d59/d80/lba 0 2023-12-12T11:51:54.432 INFO:tasks.workunit.client.0.smithi063.stdout:1/364: dread d3/db/d16/f2b [0,4194304] 0 2023-12-12T11:51:54.434 INFO:tasks.workunit.client.1.smithi093.stdout:6/702: link d0/d52/l7c d0/d52/d7e/d42/dd5/l104 0 2023-12-12T11:51:54.435 INFO:tasks.workunit.client.1.smithi093.stdout:5/476: write d0/d7/d8/d9e/f58 [2665657,81671] 0 2023-12-12T11:51:54.435 INFO:tasks.workunit.client.1.smithi093.stdout:5/477: truncate d0/d7/d59/d48/f56 9088985 0 2023-12-12T11:51:54.436 INFO:tasks.workunit.client.0.smithi063.stdout:3/307: dread d4/df/f2c [0,4194304] 0 2023-12-12T11:51:54.436 INFO:tasks.workunit.client.0.smithi063.stdout:3/308: fsync d4/df/d1a/d1c/f29 0 2023-12-12T11:51:54.436 INFO:tasks.workunit.client.0.smithi063.stdout:3/309: fsync d4/df/d1a/d1c/d41/f58 0 2023-12-12T11:51:54.436 INFO:tasks.workunit.client.0.smithi063.stdout:1/365: dread d3/db/d16/f21 [0,4194304] 0 2023-12-12T11:51:54.437 INFO:tasks.workunit.client.0.smithi063.stdout:1/366: write d3/db/d12/f49 [1039913,116129] 0 2023-12-12T11:51:54.437 INFO:tasks.workunit.client.0.smithi063.stdout:6/379: sync 2023-12-12T11:51:54.439 INFO:tasks.workunit.client.0.smithi063.stdout:4/389: dread d2/d17/f3c [0,4194304] 0 2023-12-12T11:51:54.439 INFO:tasks.workunit.client.0.smithi063.stdout:4/390: readlink d2/d47/l70 0 2023-12-12T11:51:54.439 INFO:tasks.workunit.client.0.smithi063.stdout:4/391: creat d2/d47/f7b x:0 0 0 2023-12-12T11:51:54.440 INFO:tasks.workunit.client.1.smithi093.stdout:5/478: dread d0/d7/d8/f37 [0,4194304] 0 2023-12-12T11:51:54.440 INFO:tasks.workunit.client.1.smithi093.stdout:0/599: getdents d5/dd/d14 0 2023-12-12T11:51:54.443 INFO:tasks.workunit.client.0.smithi063.stdout:3/310: rename d4/df/d1a/d1c/d41/f53 to d4/df/d1a/d1c/d34/f6a 0 2023-12-12T11:51:54.453 INFO:tasks.workunit.client.0.smithi063.stdout:6/380: dread d9/d10/d5c/d5e/f63 [0,4194304] 0 2023-12-12T11:51:54.453 INFO:tasks.workunit.client.0.smithi063.stdout:1/367: creat d3/db/d16/d4f/f79 x:0 0 0 2023-12-12T11:51:54.453 INFO:tasks.workunit.client.0.smithi063.stdout:1/368: write d3/db/f1d [2641794,117370] 0 2023-12-12T11:51:54.453 INFO:tasks.workunit.client.0.smithi063.stdout:1/369: readlink d3/l3f 0 2023-12-12T11:51:54.455 INFO:tasks.workunit.client.0.smithi063.stdout:1/370: truncate d3/db/d16/d24/d4d/d35/d5a/d5b/f64 895640 0 2023-12-12T11:51:54.455 INFO:tasks.workunit.client.0.smithi063.stdout:1/371: chown d3/db/d16/d24/f2a 7373778 1 2023-12-12T11:51:54.455 INFO:tasks.workunit.client.0.smithi063.stdout:1/372: dread - d3/db/d16/d24/d48/f6a zero size 2023-12-12T11:51:54.455 INFO:tasks.workunit.client.0.smithi063.stdout:1/373: dread - d3/db/d16/d4f/f79 zero size 2023-12-12T11:51:54.456 INFO:tasks.workunit.client.1.smithi093.stdout:4/783: rmdir d0/d36/d61/d97 39 2023-12-12T11:51:54.456 INFO:tasks.workunit.client.0.smithi063.stdout:4/392: chown d2/d8/l54 18364 1 2023-12-12T11:51:54.457 INFO:tasks.workunit.client.0.smithi063.stdout:1/374: truncate d3/db/d16/d24/d4d/d35/d5a/d5b/f65 633599 0 2023-12-12T11:51:54.460 INFO:tasks.workunit.client.0.smithi063.stdout:4/393: mknod d2/d17/d4e/c7c 0 2023-12-12T11:51:54.465 INFO:tasks.workunit.client.0.smithi063.stdout:4/394: write d2/f10 [8404048,102680] 0 2023-12-12T11:51:54.466 INFO:tasks.workunit.client.0.smithi063.stdout:3/311: read d4/d23/d5d/d4c/f66 [2688645,92781] 0 2023-12-12T11:51:54.466 INFO:tasks.workunit.client.0.smithi063.stdout:1/375: truncate d3/db/d16/d17/f55 1568101 0 2023-12-12T11:51:54.466 INFO:tasks.workunit.client.0.smithi063.stdout:1/376: chown d3/d3a/f40 66481930 1 2023-12-12T11:51:54.470 INFO:tasks.workunit.client.0.smithi063.stdout:3/312: mkdir d4/d23/d6b 0 2023-12-12T11:51:54.472 INFO:tasks.workunit.client.0.smithi063.stdout:6/381: write d9/f27 [3833677,89518] 0 2023-12-12T11:51:54.472 INFO:tasks.workunit.client.0.smithi063.stdout:6/382: dread - d9/d2c/f39 zero size 2023-12-12T11:51:54.472 INFO:tasks.workunit.client.0.smithi063.stdout:6/383: chown d9/d2c/f39 1244329 1 2023-12-12T11:51:54.474 INFO:tasks.workunit.client.0.smithi063.stdout:1/377: creat d3/db/d16/d24/d4d/d35/d5a/d5b/d6b/d6d/f7a x:0 0 0 2023-12-12T11:51:54.475 INFO:tasks.workunit.client.0.smithi063.stdout:1/378: truncate d3/db/d16/d24/d4d/f71 211463 0 2023-12-12T11:51:54.475 INFO:tasks.workunit.client.0.smithi063.stdout:1/379: truncate d3/db/d16/d24/d4d/d35/d5a/d5b/f64 1344114 0 2023-12-12T11:51:54.479 INFO:tasks.workunit.client.1.smithi093.stdout:3/561: creat df/d22/d49/d69/d78/daf/d3d/d42/d8e/fb8 x:0 0 0 2023-12-12T11:51:54.479 INFO:tasks.workunit.client.1.smithi093.stdout:3/562: fdatasync df/d22/d49/d69/d78/daf/f63 0 2023-12-12T11:51:54.479 INFO:tasks.workunit.client.0.smithi063.stdout:3/313: creat d4/df/d1a/d1c/d57/f6c x:0 0 0 2023-12-12T11:51:54.479 INFO:tasks.workunit.client.0.smithi063.stdout:3/314: write d4/d23/f4b [282358,102001] 0 2023-12-12T11:51:54.480 INFO:tasks.workunit.client.1.smithi093.stdout:4/784: dread d0/d36/f60 [0,4194304] 0 2023-12-12T11:51:54.482 INFO:tasks.workunit.client.1.smithi093.stdout:2/613: creat d5/d14/d2d/d4c/d76/dc6/fcf x:0 0 0 2023-12-12T11:51:54.488 INFO:tasks.workunit.client.0.smithi063.stdout:6/384: mknod d9/d10/d5c/c7c 0 2023-12-12T11:51:54.488 INFO:tasks.workunit.client.0.smithi063.stdout:1/380: symlink d3/db/d16/d24/d4d/d35/d5a/l7b 0 2023-12-12T11:51:54.494 INFO:tasks.workunit.client.1.smithi093.stdout:7/533: truncate da/de/f10 985007 0 2023-12-12T11:51:54.494 INFO:tasks.workunit.client.1.smithi093.stdout:6/703: rmdir d0/d52/d6b 39 2023-12-12T11:51:54.496 INFO:tasks.workunit.client.0.smithi063.stdout:3/315: unlink d4/df/d1a/d1c/c63 0 2023-12-12T11:51:54.498 INFO:tasks.workunit.client.0.smithi063.stdout:3/316: read d4/df/f37 [285308,49965] 0 2023-12-12T11:51:54.499 INFO:tasks.workunit.client.0.smithi063.stdout:0/331: dwrite d0/d7/d27/d1f/f2c [0,4194304] 0 2023-12-12T11:51:54.504 INFO:tasks.workunit.client.0.smithi063.stdout:3/317: fsync d4/df/d1a/d1c/f2d 0 2023-12-12T11:51:54.508 INFO:tasks.workunit.client.0.smithi063.stdout:1/381: dread d3/db/fd [0,4194304] 0 2023-12-12T11:51:54.509 INFO:tasks.workunit.client.1.smithi093.stdout:5/479: mkdir d0/d7/d85/da0 0 2023-12-12T11:51:54.509 INFO:tasks.workunit.client.1.smithi093.stdout:0/600: mkdir d5/dd/dbb 0 2023-12-12T11:51:54.511 INFO:tasks.workunit.client.1.smithi093.stdout:3/563: mkdir df/d22/d49/d69/d78/db9 0 2023-12-12T11:51:54.515 INFO:tasks.workunit.client.1.smithi093.stdout:4/785: mknod d0/d31/cf2 0 2023-12-12T11:51:54.515 INFO:tasks.workunit.client.1.smithi093.stdout:9/560: sync 2023-12-12T11:51:54.515 INFO:tasks.workunit.client.1.smithi093.stdout:4/786: write d0/fd0 [337602,5142] 0 2023-12-12T11:51:54.515 INFO:tasks.workunit.client.1.smithi093.stdout:4/787: readlink d0/d36/d49/lde 0 2023-12-12T11:51:54.515 INFO:tasks.workunit.client.1.smithi093.stdout:4/788: write d0/d87/d79/fed [707578,65079] 0 2023-12-12T11:51:54.515 INFO:tasks.workunit.client.1.smithi093.stdout:4/789: chown d0/d36/d40 0 1 2023-12-12T11:51:54.515 INFO:tasks.workunit.client.1.smithi093.stdout:2/614: mkdir d5/d31/dbc/dd0 0 2023-12-12T11:51:54.516 INFO:tasks.workunit.client.0.smithi063.stdout:6/385: write d9/d2c/d6b/f72 [1857564,70383] 0 2023-12-12T11:51:54.524 INFO:tasks.workunit.client.1.smithi093.stdout:9/561: dread d1/d12/d1f/d3d/f91 [0,4194304] 0 2023-12-12T11:51:54.524 INFO:tasks.workunit.client.1.smithi093.stdout:9/562: dread - d1/d23/d24/d29/d43/d58/fac zero size 2023-12-12T11:51:54.524 INFO:tasks.workunit.client.1.smithi093.stdout:9/563: read - d1/d12/d1f/d32/d42/f6e zero size 2023-12-12T11:51:54.529 INFO:tasks.workunit.client.1.smithi093.stdout:9/564: dread d1/f65 [0,4194304] 0 2023-12-12T11:51:54.530 INFO:tasks.workunit.client.0.smithi063.stdout:4/395: dwrite d2/d17/d41/f4d [0,4194304] 0 2023-12-12T11:51:54.530 INFO:tasks.workunit.client.0.smithi063.stdout:4/396: creat d2/d47/f7d x:0 0 0 2023-12-12T11:51:54.534 INFO:tasks.workunit.client.1.smithi093.stdout:8/619: rmdir d3/d1a/d1f/d29 39 2023-12-12T11:51:54.534 INFO:tasks.workunit.client.1.smithi093.stdout:7/534: rename da/l28 to da/de/d78/lbb 0 2023-12-12T11:51:54.534 INFO:tasks.workunit.client.1.smithi093.stdout:2/615: creat d5/d14/d2d/d4c/d54/db9/fd1 x:0 0 0 2023-12-12T11:51:54.534 INFO:tasks.workunit.client.1.smithi093.stdout:6/704: dwrite d0/d52/d7e/f67 [0,4194304] 0 2023-12-12T11:51:54.535 INFO:tasks.workunit.client.0.smithi063.stdout:1/382: creat d3/db/d16/d24/d4d/f7c x:0 0 0 2023-12-12T11:51:54.535 INFO:tasks.workunit.client.0.smithi063.stdout:1/383: fdatasync d3/db/d16/f2b 0 2023-12-12T11:51:54.537 INFO:tasks.workunit.client.1.smithi093.stdout:9/565: symlink d1/d23/d24/d29/d43/d56/d85/lbf 0 2023-12-12T11:51:54.542 INFO:tasks.workunit.client.0.smithi063.stdout:6/386: creat d9/d2c/d61/f7d x:0 0 0 2023-12-12T11:51:54.542 INFO:tasks.workunit.client.0.smithi063.stdout:6/387: fsync d9/d10/f58 0 2023-12-12T11:51:54.542 INFO:tasks.workunit.client.0.smithi063.stdout:6/388: getdents d9/d10/d73 0 2023-12-12T11:51:54.543 INFO:tasks.workunit.client.1.smithi093.stdout:9/566: dread d1/d12/d1f/d3d/f91 [0,4194304] 0 2023-12-12T11:51:54.543 INFO:tasks.workunit.client.1.smithi093.stdout:9/567: dread - d1/d23/d24/d29/d43/d56/d85/fa5 zero size 2023-12-12T11:51:54.543 INFO:tasks.workunit.client.1.smithi093.stdout:9/568: fdatasync d1/d23/d24/d29/d43/d56/d68/f87 0 2023-12-12T11:51:54.546 INFO:tasks.workunit.client.1.smithi093.stdout:5/480: rename d0/d3b/f75 to d0/d7/d59/fa1 0 2023-12-12T11:51:54.546 INFO:tasks.workunit.client.1.smithi093.stdout:5/481: write d0/d7/d59/f7e [251530,64248] 0 2023-12-12T11:51:54.546 INFO:tasks.workunit.client.0.smithi063.stdout:0/332: dread d0/d1a/f32 [0,4194304] 0 2023-12-12T11:51:54.547 INFO:tasks.workunit.client.0.smithi063.stdout:0/333: dread - d0/d7/d27/d1f/f40 zero size 2023-12-12T11:51:54.547 INFO:tasks.workunit.client.0.smithi063.stdout:0/334: creat d0/d1a/d23/d34/f70 x:0 0 0 2023-12-12T11:51:54.547 INFO:tasks.workunit.client.0.smithi063.stdout:0/335: creat d0/d1a/d23/d34/f71 x:0 0 0 2023-12-12T11:51:54.547 INFO:tasks.workunit.client.0.smithi063.stdout:0/336: truncate d0/d7/d27/d1f/f48 1676557 0 2023-12-12T11:51:54.549 INFO:tasks.workunit.client.1.smithi093.stdout:7/535: mkdir da/d8e/dbc 0 2023-12-12T11:51:54.549 INFO:tasks.workunit.client.1.smithi093.stdout:7/536: fsync f0 0 2023-12-12T11:51:54.553 INFO:tasks.workunit.client.1.smithi093.stdout:2/616: mknod d5/d14/d47/d56/d6f/d73/cd2 0 2023-12-12T11:51:54.557 INFO:tasks.workunit.client.1.smithi093.stdout:8/620: link d3/d1a/d1f/d29/d3a/d40/f61 d3/d1a/d1f/d59/d69/fc6 0 2023-12-12T11:51:54.564 INFO:tasks.workunit.client.0.smithi063.stdout:3/318: rmdir d4/df/d1a/d1c/d57 39 2023-12-12T11:51:54.569 INFO:tasks.workunit.client.0.smithi063.stdout:1/384: mknod d3/db/d16/d24/d4d/d35/c7d 0 2023-12-12T11:51:54.571 INFO:tasks.workunit.client.1.smithi093.stdout:5/482: read d0/f15 [840011,107219] 0 2023-12-12T11:51:54.571 INFO:tasks.workunit.client.1.smithi093.stdout:5/483: chown d0/d7/d36/l9c 5670 1 2023-12-12T11:51:54.572 INFO:tasks.workunit.client.1.smithi093.stdout:4/790: dwrite d0/f27 [0,4194304] 0 2023-12-12T11:51:54.572 INFO:tasks.workunit.client.1.smithi093.stdout:9/569: mkdir d1/d12/d1f/dc0 0 2023-12-12T11:51:54.574 INFO:tasks.workunit.client.0.smithi063.stdout:6/389: truncate d9/d10/d2a/f3e 3381758 0 2023-12-12T11:51:54.574 INFO:tasks.workunit.client.0.smithi063.stdout:6/390: stat d9/d2c/d61/f7d 0 2023-12-12T11:51:54.578 INFO:tasks.workunit.client.0.smithi063.stdout:8/436: sync 2023-12-12T11:51:54.578 INFO:tasks.workunit.client.0.smithi063.stdout:8/437: chown d4/de/d3b/d62/d36/d57/f63 4 1 2023-12-12T11:51:54.579 INFO:tasks.workunit.client.1.smithi093.stdout:7/537: rmdir da/d15/d59/d80 39 2023-12-12T11:51:54.582 INFO:tasks.workunit.client.1.smithi093.stdout:0/601: dwrite d5/d21/d27/d3a/d9a/fa7 [0,4194304] 0 2023-12-12T11:51:54.582 INFO:tasks.workunit.client.1.smithi093.stdout:0/602: write d5/dd/d14/d26/f8e [556030,77922] 0 2023-12-12T11:51:54.582 INFO:tasks.workunit.client.1.smithi093.stdout:0/603: fsync d5/dd/f1a 0 2023-12-12T11:51:54.582 INFO:tasks.workunit.client.1.smithi093.stdout:0/604: creat d5/dd/d14/d99/fbc x:0 0 0 2023-12-12T11:51:54.582 INFO:tasks.workunit.client.1.smithi093.stdout:2/617: symlink d5/d14/d2d/d4c/d54/dc5/ld3 0 2023-12-12T11:51:54.583 INFO:tasks.workunit.client.0.smithi063.stdout:4/397: dread d2/d8/f26 [0,4194304] 0 2023-12-12T11:51:54.584 INFO:tasks.workunit.client.1.smithi093.stdout:3/564: dwrite df/d22/d49/d69/d78/daf/f70 [0,4194304] 0 2023-12-12T11:51:54.585 INFO:tasks.workunit.client.1.smithi093.stdout:8/621: mknod d3/d1a/d1f/d59/d69/dbc/dc2/cc7 0 2023-12-12T11:51:54.585 INFO:tasks.workunit.client.1.smithi093.stdout:8/622: fdatasync d3/d1a/d1f/d75/fb8 0 2023-12-12T11:51:54.585 INFO:tasks.workunit.client.1.smithi093.stdout:8/623: write d3/f81 [400244,78680] 0 2023-12-12T11:51:54.586 INFO:tasks.workunit.client.0.smithi063.stdout:0/337: mknod d0/d7/c72 0 2023-12-12T11:51:54.586 INFO:tasks.workunit.client.0.smithi063.stdout:0/338: chown d0/d1a/d23/d2e/c4a 247 1 2023-12-12T11:51:54.587 INFO:tasks.workunit.client.0.smithi063.stdout:3/319: write d4/d23/f24 [4029708,27107] 0 2023-12-12T11:51:54.587 INFO:tasks.workunit.client.0.smithi063.stdout:0/339: creat d0/d1a/d23/d34/d42/f73 x:0 0 0 2023-12-12T11:51:54.587 INFO:tasks.workunit.client.0.smithi063.stdout:3/320: write d4/df/d1a/d1c/d3b/d50/d61/f65 [792493,99241] 0 2023-12-12T11:51:54.587 INFO:tasks.workunit.client.0.smithi063.stdout:0/340: fsync d0/d7/d27/d1f/f2c 0 2023-12-12T11:51:54.587 INFO:tasks.workunit.client.0.smithi063.stdout:0/341: chown d0/d7/d27/l20 1358799273 1 2023-12-12T11:51:54.594 INFO:tasks.workunit.client.1.smithi093.stdout:6/705: getdents d0/da/d14/d21/dd0 0 2023-12-12T11:51:54.594 INFO:tasks.workunit.client.0.smithi063.stdout:4/398: dread d2/d17/d41/f45 [0,4194304] 0 2023-12-12T11:51:54.595 INFO:tasks.workunit.client.0.smithi063.stdout:4/399: readlink d2/d47/l34 0 2023-12-12T11:51:54.595 INFO:tasks.workunit.client.0.smithi063.stdout:9/308: sync 2023-12-12T11:51:54.595 INFO:tasks.workunit.client.0.smithi063.stdout:4/400: dread - d2/d47/f53 zero size 2023-12-12T11:51:54.595 INFO:tasks.workunit.client.0.smithi063.stdout:7/342: sync 2023-12-12T11:51:54.595 INFO:tasks.workunit.client.0.smithi063.stdout:5/377: sync 2023-12-12T11:51:54.595 INFO:tasks.workunit.client.1.smithi093.stdout:5/484: mknod d0/d7/d85/ca2 0 2023-12-12T11:51:54.595 INFO:tasks.workunit.client.1.smithi093.stdout:5/485: fdatasync d0/d7/d8/d9e/f78 0 2023-12-12T11:51:54.596 INFO:tasks.workunit.client.0.smithi063.stdout:1/385: mkdir d3/db/d16/d24/d4d/d35/d5a/d5b/d6b/d6d/d7e 0 2023-12-12T11:51:54.598 INFO:tasks.workunit.client.1.smithi093.stdout:4/791: link d0/l41 d0/d31/d5c/d6c/lf3 0 2023-12-12T11:51:54.604 INFO:tasks.workunit.client.0.smithi063.stdout:6/391: mknod d9/d10/d5c/c7e 0 2023-12-12T11:51:54.604 INFO:tasks.workunit.client.1.smithi093.stdout:7/538: stat da/de/d78/lbb 0 2023-12-12T11:51:54.606 INFO:tasks.workunit.client.1.smithi093.stdout:3/565: dread df/d22/d49/d69/d78/daf/f63 [0,4194304] 0 2023-12-12T11:51:54.607 INFO:tasks.workunit.client.0.smithi063.stdout:8/438: dread d4/f17 [0,4194304] 0 2023-12-12T11:51:54.609 INFO:tasks.workunit.client.1.smithi093.stdout:7/539: dread da/d15/d19/f45 [0,4194304] 0 2023-12-12T11:51:54.612 INFO:tasks.workunit.client.1.smithi093.stdout:9/570: dwrite d1/fa [4194304,4194304] 0 2023-12-12T11:51:54.612 INFO:tasks.workunit.client.1.smithi093.stdout:9/571: readlink d1/l2d 0 2023-12-12T11:51:54.616 INFO:tasks.workunit.client.0.smithi063.stdout:4/401: symlink d2/d48/d4f/l7e 0 2023-12-12T11:51:54.617 INFO:tasks.workunit.client.0.smithi063.stdout:9/309: creat d7/d11/d12/d30/d3e/f5b x:0 0 0 2023-12-12T11:51:54.618 INFO:tasks.workunit.client.0.smithi063.stdout:9/310: write d7/d11/f53 [766912,43050] 0 2023-12-12T11:51:54.618 INFO:tasks.workunit.client.0.smithi063.stdout:8/439: dread d4/de/d1e/f64 [0,4194304] 0 2023-12-12T11:51:54.618 INFO:tasks.workunit.client.0.smithi063.stdout:8/440: rename d4/d24/d38/d45/d5b to d4/d24/d38/d45/d5b/d85 22 2023-12-12T11:51:54.620 INFO:tasks.workunit.client.1.smithi093.stdout:0/605: unlink d5/d41/f61 0 2023-12-12T11:51:54.620 INFO:tasks.workunit.client.1.smithi093.stdout:0/606: write d5/dd/d14/d26/f8e [1279638,130916] 0 2023-12-12T11:51:54.621 INFO:tasks.workunit.client.0.smithi063.stdout:7/343: symlink de/d34/d43/d45/d4e/l82 0 2023-12-12T11:51:54.621 INFO:tasks.workunit.client.0.smithi063.stdout:7/344: readlink de/l20 0 2023-12-12T11:51:54.621 INFO:tasks.workunit.client.0.smithi063.stdout:7/345: chown de/d33 261 1 2023-12-12T11:51:54.621 INFO:tasks.workunit.client.0.smithi063.stdout:7/346: creat de/d22/d6e/f83 x:0 0 0 2023-12-12T11:51:54.622 INFO:tasks.workunit.client.1.smithi093.stdout:2/618: creat d5/d31/dbc/fd4 x:0 0 0 2023-12-12T11:51:54.622 INFO:tasks.workunit.client.1.smithi093.stdout:2/619: readlink d5/d14/d2d/d4c/d54/d67/l71 0 2023-12-12T11:51:54.622 INFO:tasks.workunit.client.1.smithi093.stdout:2/620: write d5/d14/f4f [1041353,56198] 0 2023-12-12T11:51:54.622 INFO:tasks.workunit.client.1.smithi093.stdout:2/621: write d5/d14/d2d/d12/d25/f29 [680044,13887] 0 2023-12-12T11:51:54.625 INFO:tasks.workunit.client.1.smithi093.stdout:0/607: write d5/d21/d27/d3a/f48 [4713894,110139] 0 2023-12-12T11:51:54.625 INFO:tasks.workunit.client.1.smithi093.stdout:0/608: chown d5/dd/d14/d26/d58/f8a 51986 1 2023-12-12T11:51:54.629 INFO:tasks.workunit.client.0.smithi063.stdout:5/378: symlink d7/l71 0 2023-12-12T11:51:54.629 INFO:tasks.workunit.client.0.smithi063.stdout:5/379: chown d7/d10/f14 1 1 2023-12-12T11:51:54.629 INFO:tasks.workunit.client.0.smithi063.stdout:3/321: dwrite d4/df/d1a/f31 [0,4194304] 0 2023-12-12T11:51:54.629 INFO:tasks.workunit.client.0.smithi063.stdout:2/310: sync 2023-12-12T11:51:54.629 INFO:tasks.workunit.client.0.smithi063.stdout:6/392: symlink d9/d10/l7f 0 2023-12-12T11:51:54.632 INFO:tasks.workunit.client.1.smithi093.stdout:0/609: dread d5/dd/d14/d26/d58/dab/f9c [0,4194304] 0 2023-12-12T11:51:54.634 INFO:tasks.workunit.client.0.smithi063.stdout:1/386: link d3/db/d16/f2b d3/db/d16/d24/d4d/d35/d5a/d5b/d6b/f7f 0 2023-12-12T11:51:54.634 INFO:tasks.workunit.client.0.smithi063.stdout:1/387: chown d3/db/d16/c31 439 1 2023-12-12T11:51:54.634 INFO:tasks.workunit.client.0.smithi063.stdout:1/388: readlink d3/db/d16/d17/l2e 0 2023-12-12T11:51:54.635 INFO:tasks.workunit.client.0.smithi063.stdout:9/311: mknod d7/d11/d12/c5c 0 2023-12-12T11:51:54.635 INFO:tasks.workunit.client.0.smithi063.stdout:9/312: dread - d7/d15/d39/f47 zero size 2023-12-12T11:51:54.636 INFO:tasks.workunit.client.0.smithi063.stdout:8/441: creat d4/de/d3b/d62/f86 x:0 0 0 2023-12-12T11:51:54.636 INFO:tasks.workunit.client.0.smithi063.stdout:8/442: stat d4/de/f13 0 2023-12-12T11:51:54.641 INFO:tasks.workunit.client.0.smithi063.stdout:2/311: link d0/d1a/d1e/l36 d0/l67 0 2023-12-12T11:51:54.641 INFO:tasks.workunit.client.0.smithi063.stdout:2/312: dread - d0/f4c zero size 2023-12-12T11:51:54.642 INFO:tasks.workunit.client.1.smithi093.stdout:8/624: symlink d3/d1a/d1f/d59/d69/dbc/dc2/lc8 0 2023-12-12T11:51:54.643 INFO:tasks.workunit.client.0.smithi063.stdout:6/393: symlink d9/d2c/d6b/l80 0 2023-12-12T11:51:54.643 INFO:tasks.workunit.client.0.smithi063.stdout:1/389: mknod d3/db/d16/d24/d4d/d35/c80 0 2023-12-12T11:51:54.643 INFO:tasks.workunit.client.0.smithi063.stdout:1/390: dread - d3/db/d16/d24/d4d/f7c zero size 2023-12-12T11:51:54.644 INFO:tasks.workunit.client.1.smithi093.stdout:6/706: creat d0/d52/d7e/d102/f105 x:0 0 0 2023-12-12T11:51:54.645 INFO:tasks.workunit.client.0.smithi063.stdout:9/313: truncate d7/d15/f17 2910640 0 2023-12-12T11:51:54.646 INFO:tasks.workunit.client.1.smithi093.stdout:5/486: unlink d0/d7/d36/l8a 0 2023-12-12T11:51:54.648 INFO:tasks.workunit.client.1.smithi093.stdout:4/792: getdents d0/d31/d89 0 2023-12-12T11:51:54.648 INFO:tasks.workunit.client.1.smithi093.stdout:4/793: stat d0/d31/d89/da1/dcd 0 2023-12-12T11:51:54.650 INFO:tasks.workunit.client.0.smithi063.stdout:8/443: rename d4/f23 to d4/de/d3b/d62/d36/d7f/f87 0 2023-12-12T11:51:54.651 INFO:tasks.workunit.client.0.smithi063.stdout:6/394: symlink d9/d10/d7a/l81 0 2023-12-12T11:51:54.651 INFO:tasks.workunit.client.0.smithi063.stdout:6/395: chown d9/d10/d7a 14912009 1 2023-12-12T11:51:54.651 INFO:tasks.workunit.client.1.smithi093.stdout:3/566: rmdir df/d25/d2c 39 2023-12-12T11:51:54.655 INFO:tasks.workunit.client.1.smithi093.stdout:7/540: unlink da/d15/d19/d4c/d6d/fa4 0 2023-12-12T11:51:54.655 INFO:tasks.workunit.client.1.smithi093.stdout:7/541: truncate da/d15/d19/d4c/f7a 336151 0 2023-12-12T11:51:54.655 INFO:tasks.workunit.client.0.smithi063.stdout:7/347: dread de/f1d [0,4194304] 0 2023-12-12T11:51:54.655 INFO:tasks.workunit.client.0.smithi063.stdout:1/391: mkdir d3/db/d16/d24/d4d/d35/d5a/d81 0 2023-12-12T11:51:54.657 INFO:tasks.workunit.client.0.smithi063.stdout:7/348: chown de/d22/d2b/f46 35 1 2023-12-12T11:51:54.659 INFO:tasks.workunit.client.0.smithi063.stdout:6/396: mknod d9/d2c/d61/c82 0 2023-12-12T11:51:54.659 INFO:tasks.workunit.client.0.smithi063.stdout:6/397: write d9/f3b [3596567,77432] 0 2023-12-12T11:51:54.663 INFO:tasks.workunit.client.1.smithi093.stdout:2/622: rename d5/d31/f4a to d5/d31/d86/fd5 0 2023-12-12T11:51:54.663 INFO:tasks.workunit.client.1.smithi093.stdout:2/623: write d5/d14/d47/d4e/fcc [32309,98364] 0 2023-12-12T11:51:54.667 INFO:tasks.workunit.client.1.smithi093.stdout:0/610: creat d5/d78/fbd x:0 0 0 2023-12-12T11:51:54.670 INFO:tasks.workunit.client.1.smithi093.stdout:9/572: dwrite d1/d23/d6b/d92/fb9 [0,4194304] 0 2023-12-12T11:51:54.670 INFO:tasks.workunit.client.1.smithi093.stdout:9/573: write d1/d23/d24/fa9 [688284,17941] 0 2023-12-12T11:51:54.671 INFO:tasks.workunit.client.0.smithi063.stdout:5/380: write d7/ff [3998691,3187] 0 2023-12-12T11:51:54.675 INFO:tasks.workunit.client.1.smithi093.stdout:6/707: mkdir d0/da/d14/d3a/d106 0 2023-12-12T11:51:54.675 INFO:tasks.workunit.client.1.smithi093.stdout:6/708: fsync d0/da/d14/f80 0 2023-12-12T11:51:54.676 INFO:tasks.workunit.client.1.smithi093.stdout:3/567: mknod df/d92/cba 0 2023-12-12T11:51:54.677 INFO:tasks.workunit.client.0.smithi063.stdout:8/444: read d4/de/d1e/f4f [4016712,94328] 0 2023-12-12T11:51:54.677 INFO:tasks.workunit.client.0.smithi063.stdout:8/445: chown d4/d24/d38/d45/f69 18 1 2023-12-12T11:51:54.677 INFO:tasks.workunit.client.0.smithi063.stdout:5/381: rename d7/d10/d2b/d3c/f5b to d7/d10/d2b/d3c/d5a/f72 0 2023-12-12T11:51:54.681 INFO:tasks.workunit.client.1.smithi093.stdout:7/542: truncate da/d15/d19/f9d 3070335 0 2023-12-12T11:51:54.681 INFO:tasks.workunit.client.1.smithi093.stdout:7/543: truncate da/de/d46/d4f/fa8 745865 0 2023-12-12T11:51:54.685 INFO:tasks.workunit.client.1.smithi093.stdout:8/625: rename d3/d1a/d1f/d29/d3a/f8e to d3/d1a/d1f/d29/d3a/d40/fc9 0 2023-12-12T11:51:54.688 INFO:tasks.workunit.client.1.smithi093.stdout:2/624: mknod d5/d31/cd6 0 2023-12-12T11:51:54.694 INFO:tasks.workunit.client.1.smithi093.stdout:0/611: write d5/d21/d27/f5f [294681,100806] 0 2023-12-12T11:51:54.695 INFO:tasks.workunit.client.0.smithi063.stdout:7/349: dread fb [0,4194304] 0 2023-12-12T11:51:54.695 INFO:tasks.workunit.client.0.smithi063.stdout:1/392: write d3/db/d16/f32 [2839433,85038] 0 2023-12-12T11:51:54.695 INFO:tasks.workunit.client.0.smithi063.stdout:4/402: dwrite d2/d8/f43 [0,4194304] 0 2023-12-12T11:51:54.697 INFO:tasks.workunit.client.1.smithi093.stdout:9/574: mknod d1/d23/d6b/d92/d9f/cc1 0 2023-12-12T11:51:54.701 INFO:tasks.workunit.client.0.smithi063.stdout:8/446: creat d4/d24/d38/f88 x:0 0 0 2023-12-12T11:51:54.701 INFO:tasks.workunit.client.0.smithi063.stdout:8/447: creat d4/de/d3b/d62/d36/d57/f89 x:0 0 0 2023-12-12T11:51:54.702 INFO:tasks.workunit.client.1.smithi093.stdout:6/709: symlink d0/da/d32/d9e/d4d/deb/l107 0 2023-12-12T11:51:54.702 INFO:tasks.workunit.client.1.smithi093.stdout:6/710: read - d0/d52/dbc/fca zero size 2023-12-12T11:51:54.702 INFO:tasks.workunit.client.0.smithi063.stdout:9/314: dwrite d7/d11/d12/f3d [0,4194304] 0 2023-12-12T11:51:54.703 INFO:tasks.workunit.client.0.smithi063.stdout:9/315: chown d7/d15/f23 11 1 2023-12-12T11:51:54.703 INFO:tasks.workunit.client.0.smithi063.stdout:5/382: creat d7/d10/d2b/d3c/d42/d62/d69/f73 x:0 0 0 2023-12-12T11:51:54.709 INFO:tasks.workunit.client.1.smithi093.stdout:5/487: rename d0/d7/d8/d9e/c26 to d0/d7/d8/d8f/ca3 0 2023-12-12T11:51:54.711 INFO:tasks.workunit.client.0.smithi063.stdout:1/393: link d3/db/d16/d17/l2e d3/db/d16/d24/d4d/d35/d5a/d5b/d6b/d6d/l82 0 2023-12-12T11:51:54.713 INFO:tasks.workunit.client.1.smithi093.stdout:8/626: mknod d3/d73/cca 0 2023-12-12T11:51:54.713 INFO:tasks.workunit.client.1.smithi093.stdout:1/572: sync 2023-12-12T11:51:54.716 INFO:tasks.workunit.client.1.smithi093.stdout:2/625: symlink d5/d14/ld7 0 2023-12-12T11:51:54.727 INFO:tasks.workunit.client.0.smithi063.stdout:8/448: symlink d4/d55/l8a 0 2023-12-12T11:51:54.733 INFO:tasks.workunit.client.0.smithi063.stdout:9/316: creat d7/d20/d45/d46/d51/f5d x:0 0 0 2023-12-12T11:51:54.739 INFO:tasks.workunit.client.0.smithi063.stdout:5/383: dread d7/d28/f3f [0,4194304] 0 2023-12-12T11:51:54.742 INFO:tasks.workunit.client.0.smithi063.stdout:6/398: rmdir d9/d10 39 2023-12-12T11:51:54.745 INFO:tasks.workunit.client.0.smithi063.stdout:8/449: write d4/de/d3b/d62/d36/f73 [3943240,129036] 0 2023-12-12T11:51:54.748 INFO:tasks.workunit.client.0.smithi063.stdout:5/384: rmdir d7/d10/d2b/d3c/d42 39 2023-12-12T11:51:54.749 INFO:tasks.workunit.client.0.smithi063.stdout:6/399: mknod d9/d10/d5c/c83 0 2023-12-12T11:51:54.749 INFO:tasks.workunit.client.0.smithi063.stdout:6/400: truncate d9/f1f 6009486 0 2023-12-12T11:51:54.762 INFO:tasks.workunit.client.0.smithi063.stdout:8/450: creat d4/de/d3b/d62/d6e/d76/f8b x:0 0 0 2023-12-12T11:51:54.762 INFO:tasks.workunit.client.0.smithi063.stdout:8/451: dread - d4/de/d3b/d62/f86 zero size 2023-12-12T11:51:54.764 INFO:tasks.workunit.client.0.smithi063.stdout:5/385: link d7/d28/d43/c5e d7/d10/d2b/d3c/d42/d62/d69/c74 0 2023-12-12T11:51:54.765 INFO:tasks.workunit.client.1.smithi093.stdout:7/544: mknod da/d15/cbd 0 2023-12-12T11:51:54.767 INFO:tasks.workunit.client.0.smithi063.stdout:6/401: unlink d9/d10/d2a/f53 0 2023-12-12T11:51:54.767 INFO:tasks.workunit.client.0.smithi063.stdout:6/402: dread - d9/d10/f71 zero size 2023-12-12T11:51:54.770 INFO:tasks.workunit.client.0.smithi063.stdout:8/452: link d4/de/d11/f14 d4/d24/d38/d45/d5b/f8c 0 2023-12-12T11:51:54.770 INFO:tasks.workunit.client.1.smithi093.stdout:3/568: rename df/f19 to df/d22/d49/d69/d78/daf/d3d/d42/d8e/da5/fbb 0 2023-12-12T11:51:54.771 INFO:tasks.workunit.client.1.smithi093.stdout:6/711: dwrite d0/da/d14/d38/d69/ff4 [0,4194304] 0 2023-12-12T11:51:54.772 INFO:tasks.workunit.client.1.smithi093.stdout:6/712: chown d0/d52/d7e/d42/f8b 159298 1 2023-12-12T11:51:54.772 INFO:tasks.workunit.client.0.smithi063.stdout:5/386: symlink d7/d10/d2b/d3c/l75 0 2023-12-12T11:51:54.774 INFO:tasks.workunit.client.1.smithi093.stdout:5/488: symlink d0/d7/d36/d68/la4 0 2023-12-12T11:51:54.774 INFO:tasks.workunit.client.1.smithi093.stdout:5/489: chown d0/d7/d36/d29/c41 34362 1 2023-12-12T11:51:54.774 INFO:tasks.workunit.client.1.smithi093.stdout:8/627: mkdir d3/d1a/d1f/d29/d3a/da0/dcb 0 2023-12-12T11:51:54.775 INFO:tasks.workunit.client.0.smithi063.stdout:6/403: symlink d9/d2c/d61/l84 0 2023-12-12T11:51:54.775 INFO:tasks.workunit.client.0.smithi063.stdout:6/404: fsync d9/d10/d2a/f67 0 2023-12-12T11:51:54.775 INFO:tasks.workunit.client.0.smithi063.stdout:6/405: readlink d9/d10/l11 0 2023-12-12T11:51:54.778 INFO:tasks.workunit.client.0.smithi063.stdout:1/394: dwrite d3/db/d16/f2b [0,4194304] 0 2023-12-12T11:51:54.780 INFO:tasks.workunit.client.0.smithi063.stdout:8/453: creat d4/de/d11/d58/d65/f8d x:0 0 0 2023-12-12T11:51:54.780 INFO:tasks.workunit.client.0.smithi063.stdout:8/454: chown d4/de/d11/d58/d65 1 1 2023-12-12T11:51:54.780 INFO:tasks.workunit.client.0.smithi063.stdout:8/455: fsync f1 0 2023-12-12T11:51:54.783 INFO:tasks.workunit.client.1.smithi093.stdout:1/573: dwrite d4/d1a/d1b/d26/d40/f6a [0,4194304] 0 2023-12-12T11:51:54.783 INFO:tasks.workunit.client.0.smithi063.stdout:5/387: mkdir d7/d10/d2b/d3c/d42/d76 0 2023-12-12T11:51:54.783 INFO:tasks.workunit.client.0.smithi063.stdout:5/388: chown d7/d10/f48 368 1 2023-12-12T11:51:54.783 INFO:tasks.workunit.client.0.smithi063.stdout:5/389: truncate d7/d10/d2b/f58 255066 0 2023-12-12T11:51:54.786 INFO:tasks.workunit.client.0.smithi063.stdout:6/406: link d9/d10/f1b d9/d68/f85 0 2023-12-12T11:51:54.786 INFO:tasks.workunit.client.1.smithi093.stdout:9/575: rename d1/d12/d1f/d32/d42/f82 to d1/d23/d24/d29/d43/d56/d85/fc2 0 2023-12-12T11:51:54.786 INFO:tasks.workunit.client.1.smithi093.stdout:7/545: creat da/de/d46/fbe x:0 0 0 2023-12-12T11:51:54.787 INFO:tasks.workunit.client.1.smithi093.stdout:8/628: creat d3/d1a/d1f/d29/d3a/d8f/fcc x:0 0 0 2023-12-12T11:51:54.787 INFO:tasks.workunit.client.1.smithi093.stdout:7/546: stat da/d2e/f8f 0 2023-12-12T11:51:54.787 INFO:tasks.workunit.client.1.smithi093.stdout:9/576: stat d1/d23/d24/d29/d43/d56/d85/l86 0 2023-12-12T11:51:54.791 INFO:tasks.workunit.client.0.smithi063.stdout:4/403: dwrite d2/d17/d41/f75 [0,4194304] 0 2023-12-12T11:51:54.791 INFO:tasks.workunit.client.0.smithi063.stdout:4/404: stat d2/d17/l1e 0 2023-12-12T11:51:54.793 INFO:tasks.workunit.client.1.smithi093.stdout:1/574: read d4/d1a/d1b/d26/d31/f7e [129188,77222] 0 2023-12-12T11:51:54.793 INFO:tasks.workunit.client.1.smithi093.stdout:1/575: stat d4/dc/f28 0 2023-12-12T11:51:54.793 INFO:tasks.workunit.client.1.smithi093.stdout:1/576: fdatasync d4/dc/f17 0 2023-12-12T11:51:54.793 INFO:tasks.workunit.client.1.smithi093.stdout:2/626: dwrite d5/d14/d47/d56/d6f/d73/fc0 [0,4194304] 0 2023-12-12T11:51:54.795 INFO:tasks.workunit.client.1.smithi093.stdout:6/713: rename d0/da/d14/d38/d43/f76 to d0/d52/d6b/ddb/dfe/f108 0 2023-12-12T11:51:54.795 INFO:tasks.workunit.client.1.smithi093.stdout:6/714: read - d0/da/d32/d39/d5b/fcd zero size 2023-12-12T11:51:54.799 INFO:tasks.workunit.client.0.smithi063.stdout:5/390: mknod d7/d10/d2b/d3c/c77 0 2023-12-12T11:51:54.802 INFO:tasks.workunit.client.0.smithi063.stdout:1/395: rename d3/db/d16/d24/d4d/d35/d5a to d3/db/d16/d24/d48/d75/d83 0 2023-12-12T11:51:54.803 INFO:tasks.workunit.client.1.smithi093.stdout:9/577: mkdir d1/d23/d24/d29/d43/d56/d85/dc3 0 2023-12-12T11:51:54.803 INFO:tasks.workunit.client.1.smithi093.stdout:9/578: readlink d1/d12/d1f/d32/l45 0 2023-12-12T11:51:54.803 INFO:tasks.workunit.client.1.smithi093.stdout:7/547: creat da/d2e/d89/fbf x:0 0 0 2023-12-12T11:51:54.803 INFO:tasks.workunit.client.1.smithi093.stdout:1/577: mkdir d4/d1a/d1b/dbf 0 2023-12-12T11:51:54.803 INFO:tasks.workunit.client.1.smithi093.stdout:8/629: creat d3/d1a/d1f/d59/fcd x:0 0 0 2023-12-12T11:51:54.804 INFO:tasks.workunit.client.1.smithi093.stdout:8/630: write d3/d1a/f83 [1415212,82019] 0 2023-12-12T11:51:54.804 INFO:tasks.workunit.client.1.smithi093.stdout:8/631: read d3/d8/f7d [3822190,107763] 0 2023-12-12T11:51:54.808 INFO:tasks.workunit.client.0.smithi063.stdout:1/396: creat d3/db/d16/d24/d48/f84 x:0 0 0 2023-12-12T11:51:54.808 INFO:tasks.workunit.client.0.smithi063.stdout:1/397: truncate d3/db/d12/f50 1541332 0 2023-12-12T11:51:54.811 INFO:tasks.workunit.client.0.smithi063.stdout:1/398: getdents d3/db/d16/d24/d48/d75/d83/d5b/d6b 0 2023-12-12T11:51:54.812 INFO:tasks.workunit.client.0.smithi063.stdout:1/399: fsync d3/db/d16/d24/f2a 0 2023-12-12T11:51:54.813 INFO:tasks.workunit.client.1.smithi093.stdout:6/715: link d0/d52/d7e/fbb d0/d52/d7e/d42/dd5/f109 0 2023-12-12T11:51:54.814 INFO:tasks.workunit.client.1.smithi093.stdout:9/579: getdents d1/d12/d1f 0 2023-12-12T11:51:54.814 INFO:tasks.workunit.client.1.smithi093.stdout:1/578: truncate d4/d1a/d73/f50 583744 0 2023-12-12T11:51:54.814 INFO:tasks.workunit.client.1.smithi093.stdout:7/548: symlink da/d15/d19/d4c/d6d/lc0 0 2023-12-12T11:51:54.814 INFO:tasks.workunit.client.1.smithi093.stdout:1/579: stat d4/d1a/da6/lb2 0 2023-12-12T11:51:54.814 INFO:tasks.workunit.client.1.smithi093.stdout:1/580: chown d4/d1a/d83/d92 30 1 2023-12-12T11:51:54.820 INFO:tasks.workunit.client.0.smithi063.stdout:1/400: creat d3/db/d16/d24/d48/d75/d83/d5b/d6b/f85 x:0 0 0 2023-12-12T11:51:54.821 INFO:tasks.workunit.client.0.smithi063.stdout:7/350: dwrite de/f28 [0,4194304] 0 2023-12-12T11:51:54.822 INFO:tasks.workunit.client.0.smithi063.stdout:5/391: write d7/d10/f46 [1627240,70422] 0 2023-12-12T11:51:54.822 INFO:tasks.workunit.client.0.smithi063.stdout:5/392: write d7/d10/f1b [555761,75075] 0 2023-12-12T11:51:54.827 INFO:tasks.workunit.client.1.smithi093.stdout:3/569: dwrite df/d22/d49/d69/d78/f7d [4194304,4194304] 0 2023-12-12T11:51:54.827 INFO:tasks.workunit.client.1.smithi093.stdout:5/490: dwrite d0/d7/f99 [0,4194304] 0 2023-12-12T11:51:54.830 INFO:tasks.workunit.client.1.smithi093.stdout:8/632: rename d3/d73/f77 to d3/d1a/d1f/d29/d3a/d8f/fce 0 2023-12-12T11:51:54.830 INFO:tasks.workunit.client.1.smithi093.stdout:8/633: fdatasync d3/f91 0 2023-12-12T11:51:54.830 INFO:tasks.workunit.client.1.smithi093.stdout:8/634: chown d3/f91 1405810 1 2023-12-12T11:51:54.833 INFO:tasks.workunit.client.1.smithi093.stdout:6/716: symlink d0/da/d32/d39/l10a 0 2023-12-12T11:51:54.834 INFO:tasks.workunit.client.0.smithi063.stdout:6/407: dwrite d9/d10/f1b [0,4194304] 0 2023-12-12T11:51:54.835 INFO:tasks.workunit.client.0.smithi063.stdout:4/405: write d2/d8/f49 [6451394,40693] 0 2023-12-12T11:51:54.835 INFO:tasks.workunit.client.0.smithi063.stdout:4/406: dread - d2/d47/f53 zero size 2023-12-12T11:51:54.840 INFO:tasks.workunit.client.0.smithi063.stdout:1/401: dread d3/db/d12/f50 [0,4194304] 0 2023-12-12T11:51:54.843 INFO:tasks.workunit.client.0.smithi063.stdout:4/407: dread d2/d17/d41/f45 [0,4194304] 0 2023-12-12T11:51:54.843 INFO:tasks.workunit.client.0.smithi063.stdout:6/408: dread d9/f55 [0,4194304] 0 2023-12-12T11:51:54.857 INFO:tasks.workunit.client.0.smithi063.stdout:6/409: dread d9/f24 [0,4194304] 0 2023-12-12T11:51:54.857 INFO:tasks.workunit.client.0.smithi063.stdout:6/410: chown d9/d10 1 1 2023-12-12T11:51:54.858 INFO:tasks.workunit.client.1.smithi093.stdout:2/627: dwrite d5/d14/d2d/d12/d44/f57 [4194304,4194304] 0 2023-12-12T11:51:54.862 INFO:tasks.workunit.client.0.smithi063.stdout:5/393: creat d7/d10/d2b/d3c/d42/d76/f78 x:0 0 0 2023-12-12T11:51:54.862 INFO:tasks.workunit.client.0.smithi063.stdout:5/394: chown d7/d10/d2b/d3c/d42/d76 357293533 1 2023-12-12T11:51:54.864 INFO:tasks.workunit.client.0.smithi063.stdout:5/395: truncate d7/d10/d2b/d3c/d42/d62/d69/f73 383623 0 2023-12-12T11:51:54.864 INFO:tasks.workunit.client.1.smithi093.stdout:5/491: stat d0/d7/d36/l9c 0 2023-12-12T11:51:54.864 INFO:tasks.workunit.client.1.smithi093.stdout:5/492: fdatasync d0/d7/d36/d38/f40 0 2023-12-12T11:51:54.864 INFO:tasks.workunit.client.1.smithi093.stdout:5/493: fdatasync d0/d7/d59/f60 0 2023-12-12T11:51:54.865 INFO:tasks.workunit.client.1.smithi093.stdout:5/494: stat d0/d7/d59/d48/l51 0 2023-12-12T11:51:54.867 INFO:tasks.workunit.client.1.smithi093.stdout:8/635: link d3/d1a/d1f/d29/d3a/d40/dbf/fc1 d3/d1a/d1f/d29/d3a/db1/fcf 0 2023-12-12T11:51:54.869 INFO:tasks.workunit.client.0.smithi063.stdout:1/402: link d3/db/d16/f2b d3/db/d16/d24/d48/d75/f86 0 2023-12-12T11:51:54.869 INFO:tasks.workunit.client.0.smithi063.stdout:1/403: write d3/db/d16/f2d [5843128,19043] 0 2023-12-12T11:51:54.873 INFO:tasks.workunit.client.0.smithi063.stdout:1/404: creat d3/d3a/d5e/f87 x:0 0 0 2023-12-12T11:51:54.875 INFO:tasks.workunit.client.1.smithi093.stdout:6/717: rename d0/c1d to d0/da/d32/d39/df3/c10b 0 2023-12-12T11:51:54.878 INFO:tasks.workunit.client.0.smithi063.stdout:6/411: mkdir d9/d2c/d6b/d86 0 2023-12-12T11:51:54.887 INFO:tasks.workunit.client.0.smithi063.stdout:6/412: rmdir d9/d10/d25 39 2023-12-12T11:51:54.890 INFO:tasks.workunit.client.1.smithi093.stdout:2/628: rmdir d5/d14/d2d/d4c/d54/dc5/d61/dc3 0 2023-12-12T11:51:54.893 INFO:tasks.workunit.client.0.smithi063.stdout:6/413: creat d9/d10/d5c/d5e/f87 x:0 0 0 2023-12-12T11:51:54.894 INFO:tasks.workunit.client.1.smithi093.stdout:9/580: dwrite d1/d23/f40 [0,4194304] 0 2023-12-12T11:51:54.896 INFO:tasks.workunit.client.0.smithi063.stdout:6/414: mknod d9/d10/d2a/c88 0 2023-12-12T11:51:54.896 INFO:tasks.workunit.client.1.smithi093.stdout:5/495: dread d0/d7/d8/d8f/f95 [0,4194304] 0 2023-12-12T11:51:54.896 INFO:tasks.workunit.client.1.smithi093.stdout:5/496: chown d0/d3b/d66/l9f 185 1 2023-12-12T11:51:54.897 INFO:tasks.workunit.client.1.smithi093.stdout:6/718: truncate d0/da/d32/dd3/fb5 1529432 0 2023-12-12T11:51:54.899 INFO:tasks.workunit.client.1.smithi093.stdout:2/629: truncate d5/d14/d2d/d12/f2c 1365260 0 2023-12-12T11:51:54.902 INFO:tasks.workunit.client.0.smithi063.stdout:6/415: truncate d9/f27 2267683 0 2023-12-12T11:51:54.905 INFO:tasks.workunit.client.1.smithi093.stdout:8/636: getdents d3/d8 0 2023-12-12T11:51:54.905 INFO:tasks.workunit.client.1.smithi093.stdout:8/637: dread - d3/d1a/d1f/d59/fcd zero size 2023-12-12T11:51:54.907 INFO:tasks.workunit.client.0.smithi063.stdout:6/416: symlink d9/d2c/l89 0 2023-12-12T11:51:54.908 INFO:tasks.workunit.client.0.smithi063.stdout:4/408: dwrite d2/d17/d61/f71 [0,4194304] 0 2023-12-12T11:51:54.911 INFO:tasks.workunit.client.1.smithi093.stdout:9/581: mknod d1/d23/d24/d29/d43/d56/d85/dc3/cc4 0 2023-12-12T11:51:54.911 INFO:tasks.workunit.client.1.smithi093.stdout:9/582: chown d1/d23/d6b/d92/d9f/cc1 8944 1 2023-12-12T11:51:54.913 INFO:tasks.workunit.client.1.smithi093.stdout:5/497: creat d0/d7/d59/d62/fa5 x:0 0 0 2023-12-12T11:51:54.913 INFO:tasks.workunit.client.1.smithi093.stdout:5/498: write d0/d7/d8/d9e/d6a/f72 [1387398,111923] 0 2023-12-12T11:51:54.913 INFO:tasks.workunit.client.1.smithi093.stdout:5/499: write d0/d7/d36/d68/f7a [486966,92850] 0 2023-12-12T11:51:54.913 INFO:tasks.workunit.client.1.smithi093.stdout:0/612: sync 2023-12-12T11:51:54.913 INFO:tasks.workunit.client.1.smithi093.stdout:4/794: sync 2023-12-12T11:51:54.913 INFO:tasks.workunit.client.1.smithi093.stdout:0/613: chown d5/d21/d27/f5a 40974763 1 2023-12-12T11:51:54.919 INFO:tasks.workunit.client.0.smithi063.stdout:7/351: dwrite de/f21 [0,4194304] 0 2023-12-12T11:51:54.919 INFO:tasks.workunit.client.1.smithi093.stdout:8/638: read d3/f81 [30166,14418] 0 2023-12-12T11:51:54.919 INFO:tasks.workunit.client.1.smithi093.stdout:8/639: creat d3/d1a/d1f/d75/fd0 x:0 0 0 2023-12-12T11:51:54.922 INFO:tasks.workunit.client.1.smithi093.stdout:2/630: link d5/d31/f64 d5/d14/d2d/d4c/fd8 0 2023-12-12T11:51:54.924 INFO:tasks.workunit.client.0.smithi063.stdout:4/409: mkdir d2/d17/d7f 0 2023-12-12T11:51:54.924 INFO:tasks.workunit.client.0.smithi063.stdout:4/410: write d2/d8/f49 [6500558,68776] 0 2023-12-12T11:51:54.928 INFO:tasks.workunit.client.1.smithi093.stdout:9/583: symlink d1/d23/d6b/d92/db2/lc5 0 2023-12-12T11:51:54.931 INFO:tasks.workunit.client.1.smithi093.stdout:0/614: creat d5/d41/d77/d79/fbe x:0 0 0 2023-12-12T11:51:54.931 INFO:tasks.workunit.client.1.smithi093.stdout:0/615: fdatasync d5/d21/d27/f5f 0 2023-12-12T11:51:54.931 INFO:tasks.workunit.client.0.smithi063.stdout:5/396: write d7/de/f30 [2866349,70644] 0 2023-12-12T11:51:54.933 INFO:tasks.workunit.client.0.smithi063.stdout:8/456: dwrite d4/f17 [0,4194304] 0 2023-12-12T11:51:54.933 INFO:tasks.workunit.client.0.smithi063.stdout:8/457: write d4/d24/d38/d45/f69 [560190,127086] 0 2023-12-12T11:51:54.940 INFO:tasks.workunit.client.0.smithi063.stdout:4/411: unlink d2/d47/f79 0 2023-12-12T11:51:54.941 INFO:tasks.workunit.client.1.smithi093.stdout:6/719: dwrite d0/da/d32/fa9 [0,4194304] 0 2023-12-12T11:51:54.946 INFO:tasks.workunit.client.1.smithi093.stdout:9/584: mknod d1/d12/d1f/dc0/cc6 0 2023-12-12T11:51:54.946 INFO:tasks.workunit.client.1.smithi093.stdout:8/640: dread d3/d1a/d1f/d29/d3a/d68/d8a/f90 [0,4194304] 0 2023-12-12T11:51:54.946 INFO:tasks.workunit.client.1.smithi093.stdout:9/585: truncate d1/d12/d1f/f35 4611699 0 2023-12-12T11:51:54.947 INFO:tasks.workunit.client.1.smithi093.stdout:9/586: fdatasync d1/d23/d24/d29/d43/d58/f78 0 2023-12-12T11:51:54.947 INFO:tasks.workunit.client.1.smithi093.stdout:0/616: rename d5/dd/d14/d26/d58/d64/c8d to d5/dd/d62/cbf 0 2023-12-12T11:51:54.956 INFO:tasks.workunit.client.1.smithi093.stdout:7/549: dwrite da/de/f3b [0,4194304] 0 2023-12-12T11:51:54.956 INFO:tasks.workunit.client.1.smithi093.stdout:7/550: chown da/de/f44 31 1 2023-12-12T11:51:54.962 INFO:tasks.workunit.client.1.smithi093.stdout:8/641: symlink d3/d8/d88/dc5/ld1 0 2023-12-12T11:51:54.963 INFO:tasks.workunit.client.1.smithi093.stdout:8/642: fsync d3/d1a/d1f/d29/d3a/d8f/fcc 0 2023-12-12T11:51:54.970 INFO:tasks.workunit.client.1.smithi093.stdout:9/587: creat d1/d23/d24/d29/da3/fc7 x:0 0 0 2023-12-12T11:51:54.970 INFO:tasks.workunit.client.1.smithi093.stdout:9/588: creat d1/d12/d1f/d3d/d57/d63/fc8 x:0 0 0 2023-12-12T11:51:54.973 INFO:tasks.workunit.client.0.smithi063.stdout:5/397: truncate d7/d10/d2b/d3c/d5a/f72 920146 0 2023-12-12T11:51:54.977 INFO:tasks.workunit.client.1.smithi093.stdout:7/551: mkdir da/d15/d19/d4c/dc1 0 2023-12-12T11:51:54.981 INFO:tasks.workunit.client.1.smithi093.stdout:4/795: dwrite d0/d36/d49/f78 [0,4194304] 0 2023-12-12T11:51:54.982 INFO:tasks.workunit.client.1.smithi093.stdout:8/643: creat d3/d1a/d1f/d29/d30/fd2 x:0 0 0 2023-12-12T11:51:54.982 INFO:tasks.workunit.client.1.smithi093.stdout:8/644: write d3/d1a/d1f/d29/d30/f4e [599584,73993] 0 2023-12-12T11:51:54.987 INFO:tasks.workunit.client.0.smithi063.stdout:8/458: getdents d4/de/d3b/d62/d36/d7f 0 2023-12-12T11:51:54.994 INFO:tasks.workunit.client.0.smithi063.stdout:6/417: dwrite d9/d10/f1b [0,4194304] 0 2023-12-12T11:51:55.005 INFO:tasks.workunit.client.1.smithi093.stdout:4/796: mkdir d0/d31/d9d/da0/df4 0 2023-12-12T11:51:55.009 INFO:tasks.workunit.client.0.smithi063.stdout:1/405: dwrite d3/db/d12/f27 [0,4194304] 0 2023-12-12T11:51:55.011 INFO:tasks.workunit.client.1.smithi093.stdout:8/645: creat d3/d1a/d1f/d29/d3a/fd3 x:0 0 0 2023-12-12T11:51:55.011 INFO:tasks.workunit.client.1.smithi093.stdout:8/646: truncate d3/f81 980206 0 2023-12-12T11:51:55.011 INFO:tasks.workunit.client.1.smithi093.stdout:8/647: chown d3/d1a/d1f/d29/l38 1165885 1 2023-12-12T11:51:55.013 INFO:tasks.workunit.client.1.smithi093.stdout:5/500: dwrite d0/d7/d8/f5d [4194304,4194304] 0 2023-12-12T11:51:55.019 INFO:tasks.workunit.client.0.smithi063.stdout:8/459: mkdir d4/d55/d52/d8e 0 2023-12-12T11:51:55.019 INFO:tasks.workunit.client.0.smithi063.stdout:6/418: mkdir d9/d2c/d6b/d8a 0 2023-12-12T11:51:55.022 INFO:tasks.workunit.client.0.smithi063.stdout:1/406: read d3/db/fd [2825185,127435] 0 2023-12-12T11:51:55.030 INFO:tasks.workunit.client.1.smithi093.stdout:1/581: dwrite d4/d1a/d1b/d26/d31/f7e [0,4194304] 0 2023-12-12T11:51:55.033 INFO:tasks.workunit.client.0.smithi063.stdout:4/412: dwrite d2/f10 [0,4194304] 0 2023-12-12T11:51:55.036 INFO:tasks.workunit.client.1.smithi093.stdout:6/720: dwrite d0/da/d32/d9e/d4d/f82 [0,4194304] 0 2023-12-12T11:51:55.037 INFO:tasks.workunit.client.1.smithi093.stdout:3/570: dwrite df/d22/f31 [0,4194304] 0 2023-12-12T11:51:55.037 INFO:tasks.workunit.client.0.smithi063.stdout:7/352: dwrite de/d22/f31 [0,4194304] 0 2023-12-12T11:51:55.037 INFO:tasks.workunit.client.0.smithi063.stdout:7/353: readlink de/d39/d4b/l6a 0 2023-12-12T11:51:55.038 INFO:tasks.workunit.client.1.smithi093.stdout:3/571: read df/d22/d49/d69/f6a [891152,123038] 0 2023-12-12T11:51:55.038 INFO:tasks.workunit.client.0.smithi063.stdout:3/322: sync 2023-12-12T11:51:55.038 INFO:tasks.workunit.client.0.smithi063.stdout:3/323: chown d4/d23/d5d/d4c/d56 1259460 1 2023-12-12T11:51:55.038 INFO:tasks.workunit.client.0.smithi063.stdout:3/324: truncate d4/df/d1a/f2b 1131995 0 2023-12-12T11:51:55.039 INFO:tasks.workunit.client.1.smithi093.stdout:7/552: dwrite da/de/f4d [0,4194304] 0 2023-12-12T11:51:55.052 INFO:tasks.workunit.client.1.smithi093.stdout:4/797: creat d0/d31/d5c/d6c/ff5 x:0 0 0 2023-12-12T11:51:55.057 INFO:tasks.workunit.client.1.smithi093.stdout:5/501: symlink d0/d7/d85/da0/la6 0 2023-12-12T11:51:55.057 INFO:tasks.workunit.client.0.smithi063.stdout:5/398: rmdir d7/d10 39 2023-12-12T11:51:55.059 INFO:tasks.workunit.client.1.smithi093.stdout:1/582: write d4/d1c/d2a/f2b [2935837,104333] 0 2023-12-12T11:51:55.059 INFO:tasks.workunit.client.1.smithi093.stdout:0/617: dwrite d5/f40 [0,4194304] 0 2023-12-12T11:51:55.059 INFO:tasks.workunit.client.1.smithi093.stdout:0/618: truncate d5/dd/d33/f46 1719090 0 2023-12-12T11:51:55.060 INFO:tasks.workunit.client.0.smithi063.stdout:1/407: getdents d3/db/d16/d24/d48/d75/d83/d5b/d6b/d6d 0 2023-12-12T11:51:55.060 INFO:tasks.workunit.client.0.smithi063.stdout:1/408: truncate d3/db/d16/d24/d4d/f68 646818 0 2023-12-12T11:51:55.060 INFO:tasks.workunit.client.0.smithi063.stdout:1/409: fdatasync d3/db/f1d 0 2023-12-12T11:51:55.060 INFO:tasks.workunit.client.0.smithi063.stdout:1/410: fsync d3/db/f20 0 2023-12-12T11:51:55.064 INFO:tasks.workunit.client.0.smithi063.stdout:9/317: sync 2023-12-12T11:51:55.064 INFO:tasks.workunit.client.0.smithi063.stdout:0/342: sync 2023-12-12T11:51:55.064 INFO:tasks.workunit.client.0.smithi063.stdout:9/318: chown d7/f2b 81183 1 2023-12-12T11:51:55.064 INFO:tasks.workunit.client.0.smithi063.stdout:9/319: chown d7/d11 79092 1 2023-12-12T11:51:55.065 INFO:tasks.workunit.client.0.smithi063.stdout:2/313: sync 2023-12-12T11:51:55.065 INFO:tasks.workunit.client.0.smithi063.stdout:2/314: dread - d0/d1a/d48/d56/f65 zero size 2023-12-12T11:51:55.065 INFO:tasks.workunit.client.0.smithi063.stdout:2/315: chown d0 1500999 1 2023-12-12T11:51:55.065 INFO:tasks.workunit.client.0.smithi063.stdout:9/320: creat d7/d20/d45/d46/d51/f5e x:0 0 0 2023-12-12T11:51:55.070 INFO:tasks.workunit.client.0.smithi063.stdout:3/325: link d4/la d4/d23/d5d/d4c/d56/l6d 0 2023-12-12T11:51:55.072 INFO:tasks.workunit.client.0.smithi063.stdout:5/399: mknod d7/d10/d2b/d3c/c79 0 2023-12-12T11:51:55.072 INFO:tasks.workunit.client.0.smithi063.stdout:5/400: truncate d7/d10/f14 2456079 0 2023-12-12T11:51:55.076 INFO:tasks.workunit.client.0.smithi063.stdout:1/411: unlink d3/db/d16/d17/d4b/l4e 0 2023-12-12T11:51:55.076 INFO:tasks.workunit.client.0.smithi063.stdout:1/412: chown d3/db/d16/d17/l59 30603557 1 2023-12-12T11:51:55.081 INFO:tasks.workunit.client.0.smithi063.stdout:0/343: rename d0/f68 to d0/d1a/d23/f74 0 2023-12-12T11:51:55.081 INFO:tasks.workunit.client.0.smithi063.stdout:0/344: write d0/d1a/d23/d34/d42/f53 [967099,120798] 0 2023-12-12T11:51:55.082 INFO:tasks.workunit.client.1.smithi093.stdout:8/648: dwrite d3/f6 [0,4194304] 0 2023-12-12T11:51:55.084 INFO:tasks.workunit.client.1.smithi093.stdout:6/721: creat d0/da/f10c x:0 0 0 2023-12-12T11:51:55.084 INFO:tasks.workunit.client.1.smithi093.stdout:6/722: stat d0/d52/d7e/d102 0 2023-12-12T11:51:55.084 INFO:tasks.workunit.client.1.smithi093.stdout:6/723: fdatasync d0/da/d32/fa1 0 2023-12-12T11:51:55.088 INFO:tasks.workunit.client.0.smithi063.stdout:9/321: mknod d7/d11/c5f 0 2023-12-12T11:51:55.092 INFO:tasks.workunit.client.1.smithi093.stdout:7/553: link da/d2e/d89/lab da/d15/d19/d4c/d6d/lc2 0 2023-12-12T11:51:55.092 INFO:tasks.workunit.client.1.smithi093.stdout:7/554: write da/f8a [1244106,110338] 0 2023-12-12T11:51:55.092 INFO:tasks.workunit.client.1.smithi093.stdout:7/555: write da/de/d78/fb8 [287227,37167] 0 2023-12-12T11:51:55.092 INFO:tasks.workunit.client.1.smithi093.stdout:7/556: creat da/d2e/fc3 x:0 0 0 2023-12-12T11:51:55.093 INFO:tasks.workunit.client.1.smithi093.stdout:7/557: write da/de/fb1 [492321,85830] 0 2023-12-12T11:51:55.093 INFO:tasks.workunit.client.0.smithi063.stdout:4/413: mknod d2/d8/c80 0 2023-12-12T11:51:55.094 INFO:tasks.workunit.client.1.smithi093.stdout:4/798: getdents d0/d87/d79/d96/dcc 0 2023-12-12T11:51:55.095 INFO:tasks.workunit.client.0.smithi063.stdout:6/419: dwrite d9/fb [4194304,4194304] 0 2023-12-12T11:51:55.095 INFO:tasks.workunit.client.0.smithi063.stdout:2/316: dread d0/d1a/d48/f34 [0,4194304] 0 2023-12-12T11:51:55.095 INFO:tasks.workunit.client.0.smithi063.stdout:2/317: fsync d0/d1a/d26/f29 0 2023-12-12T11:51:55.096 INFO:tasks.workunit.client.0.smithi063.stdout:3/326: mknod d4/d23/d5d/c6e 0 2023-12-12T11:51:55.098 INFO:tasks.workunit.client.1.smithi093.stdout:5/502: mkdir d0/d7/d85/da0/da7 0 2023-12-12T11:51:55.098 INFO:tasks.workunit.client.1.smithi093.stdout:5/503: chown d0/l8d 364307 1 2023-12-12T11:51:55.100 INFO:tasks.workunit.client.0.smithi063.stdout:5/401: creat d7/d10/d2b/d3c/d63/f7a x:0 0 0 2023-12-12T11:51:55.107 INFO:tasks.workunit.client.0.smithi063.stdout:1/413: mknod d3/db/d16/d24/d48/c88 0 2023-12-12T11:51:55.108 INFO:tasks.workunit.client.0.smithi063.stdout:6/420: dread d9/f43 [0,4194304] 0 2023-12-12T11:51:55.111 INFO:tasks.workunit.client.0.smithi063.stdout:0/345: rename d0/d7/d27/d1f/f4c to d0/d1a/d23/f75 0 2023-12-12T11:51:55.121 INFO:tasks.workunit.client.0.smithi063.stdout:4/414: mkdir d2/d17/d81 0 2023-12-12T11:51:55.122 INFO:tasks.workunit.client.0.smithi063.stdout:9/322: creat d7/d11/d12/f60 x:0 0 0 2023-12-12T11:51:55.124 INFO:tasks.workunit.client.0.smithi063.stdout:2/318: creat d0/d1a/d1e/d64/f68 x:0 0 0 2023-12-12T11:51:55.125 INFO:tasks.workunit.client.0.smithi063.stdout:6/421: dread d9/f43 [0,4194304] 0 2023-12-12T11:51:55.133 INFO:tasks.workunit.client.0.smithi063.stdout:0/346: dread d0/d7/d27/d19/d2d/f43 [0,4194304] 0 2023-12-12T11:51:55.133 INFO:tasks.workunit.client.0.smithi063.stdout:3/327: mkdir d4/df/d1a/d1c/d57/d6f 0 2023-12-12T11:51:55.137 INFO:tasks.workunit.client.0.smithi063.stdout:9/323: read d7/ff [331388,106637] 0 2023-12-12T11:51:55.138 INFO:tasks.workunit.client.0.smithi063.stdout:5/402: symlink d7/de/l7b 0 2023-12-12T11:51:55.138 INFO:tasks.workunit.client.0.smithi063.stdout:1/414: getdents d3/db/d16/d24/d48/d75/d83 0 2023-12-12T11:51:55.139 INFO:tasks.workunit.client.0.smithi063.stdout:4/415: creat d2/d48/d69/f82 x:0 0 0 2023-12-12T11:51:55.140 INFO:tasks.workunit.client.1.smithi093.stdout:6/724: creat d0/da/d32/f10d x:0 0 0 2023-12-12T11:51:55.141 INFO:tasks.workunit.client.0.smithi063.stdout:6/422: getdents d9/d2c 0 2023-12-12T11:51:55.144 INFO:tasks.workunit.client.0.smithi063.stdout:0/347: creat d0/d1a/f76 x:0 0 0 2023-12-12T11:51:55.147 INFO:tasks.workunit.client.1.smithi093.stdout:7/558: symlink da/de/d46/d4f/lc4 0 2023-12-12T11:51:55.154 INFO:tasks.workunit.client.0.smithi063.stdout:3/328: symlink d4/df/d1a/d1c/d57/l70 0 2023-12-12T11:51:55.154 INFO:tasks.workunit.client.0.smithi063.stdout:3/329: dread - d4/df/d1a/d1c/d34/f6a zero size 2023-12-12T11:51:55.154 INFO:tasks.workunit.client.0.smithi063.stdout:3/330: readlink d4/la 0 2023-12-12T11:51:55.154 INFO:tasks.workunit.client.0.smithi063.stdout:5/403: link d7/d10/d2b/d3c/d42/d76/f78 d7/d28/d6e/f7c 0 2023-12-12T11:51:55.154 INFO:tasks.workunit.client.0.smithi063.stdout:5/404: truncate d7/d28/d43/d49/f6d 354124 0 2023-12-12T11:51:55.154 INFO:tasks.workunit.client.0.smithi063.stdout:5/405: write d7/d28/f3f [1195029,43562] 0 2023-12-12T11:51:55.155 INFO:tasks.workunit.client.0.smithi063.stdout:8/460: dwrite d4/de/d1e/f4f [0,4194304] 0 2023-12-12T11:51:55.155 INFO:tasks.workunit.client.0.smithi063.stdout:1/415: symlink d3/d3a/d5e/l89 0 2023-12-12T11:51:55.155 INFO:tasks.workunit.client.1.smithi093.stdout:4/799: dwrite d0/d36/d40/f8e [0,4194304] 0 2023-12-12T11:51:55.156 INFO:tasks.workunit.client.1.smithi093.stdout:4/800: chown d0/c2b 276 1 2023-12-12T11:51:55.156 INFO:tasks.workunit.client.1.smithi093.stdout:5/504: creat d0/d7/d8/de/fa8 x:0 0 0 2023-12-12T11:51:55.158 INFO:tasks.workunit.client.0.smithi063.stdout:4/416: chown d2/d8/f37 2013 1 2023-12-12T11:51:55.158 INFO:tasks.workunit.client.0.smithi063.stdout:4/417: chown d2/d8/c80 290 1 2023-12-12T11:51:55.158 INFO:tasks.workunit.client.0.smithi063.stdout:4/418: dread - d2/d47/f53 zero size 2023-12-12T11:51:55.160 INFO:tasks.workunit.client.1.smithi093.stdout:8/649: rmdir d3/d1a/d1f/d29/d3a/d8f 39 2023-12-12T11:51:55.160 INFO:tasks.workunit.client.1.smithi093.stdout:6/725: truncate d0/da/d14/d38/f4f 652361 0 2023-12-12T11:51:55.160 INFO:tasks.workunit.client.1.smithi093.stdout:6/726: stat d0/df1 0 2023-12-12T11:51:55.160 INFO:tasks.workunit.client.1.smithi093.stdout:6/727: write d0/da/d14/d38/d43/f86 [642920,98858] 0 2023-12-12T11:51:55.161 INFO:tasks.workunit.client.0.smithi063.stdout:0/348: mkdir d0/d77 0 2023-12-12T11:51:55.161 INFO:tasks.workunit.client.0.smithi063.stdout:0/349: write d0/d7/f55 [2221445,37459] 0 2023-12-12T11:51:55.163 INFO:tasks.workunit.client.0.smithi063.stdout:6/423: dread d9/fd [0,4194304] 0 2023-12-12T11:51:55.167 INFO:tasks.workunit.client.1.smithi093.stdout:1/583: dwrite d4/d1c/d2a/f2b [4194304,4194304] 0 2023-12-12T11:51:55.168 INFO:tasks.workunit.client.0.smithi063.stdout:2/319: dwrite d0/ff [4194304,4194304] 0 2023-12-12T11:51:55.169 INFO:tasks.workunit.client.1.smithi093.stdout:5/505: symlink d0/d7/d85/da0/da7/la9 0 2023-12-12T11:51:55.169 INFO:tasks.workunit.client.1.smithi093.stdout:4/801: read d0/d87/d79/d7f/fb1 [1772799,5698] 0 2023-12-12T11:51:55.169 INFO:tasks.workunit.client.1.smithi093.stdout:4/802: fsync d0/d31/d89/f9c 0 2023-12-12T11:51:55.169 INFO:tasks.workunit.client.1.smithi093.stdout:4/803: write d0/d87/d79/d86/fc4 [160646,99478] 0 2023-12-12T11:51:55.171 INFO:tasks.workunit.client.0.smithi063.stdout:7/354: dwrite de/d34/f4f [0,4194304] 0 2023-12-12T11:51:55.172 INFO:tasks.workunit.client.1.smithi093.stdout:6/728: getdents d0/d52/d7e/d42/dd5/ddc 0 2023-12-12T11:51:55.172 INFO:tasks.workunit.client.0.smithi063.stdout:3/331: write d4/df/d1a/f31 [1125173,91806] 0 2023-12-12T11:51:55.173 INFO:tasks.workunit.client.0.smithi063.stdout:3/332: chown d4/df/d1a/d1c/d34/d54 302557 1 2023-12-12T11:51:55.177 INFO:tasks.workunit.client.0.smithi063.stdout:5/406: creat d7/d10/d2b/d3c/d42/f7d x:0 0 0 2023-12-12T11:51:55.182 INFO:tasks.workunit.client.0.smithi063.stdout:8/461: rename d4/d55/f59 to d4/de/d3b/d62/d6e/f8f 0 2023-12-12T11:51:55.196 INFO:tasks.workunit.client.0.smithi063.stdout:3/333: write d4/df/d1a/d1c/f2d [4086368,92090] 0 2023-12-12T11:51:55.197 INFO:tasks.workunit.client.0.smithi063.stdout:0/350: unlink d0/d1a/d23/l63 0 2023-12-12T11:51:55.197 INFO:tasks.workunit.client.0.smithi063.stdout:2/320: mkdir d0/d69 0 2023-12-12T11:51:55.198 INFO:tasks.workunit.client.0.smithi063.stdout:2/321: write d0/f5f [8619434,41465] 0 2023-12-12T11:51:55.198 INFO:tasks.workunit.client.1.smithi093.stdout:2/631: sync 2023-12-12T11:51:55.199 INFO:tasks.workunit.client.1.smithi093.stdout:9/589: sync 2023-12-12T11:51:55.199 INFO:tasks.workunit.client.1.smithi093.stdout:9/590: chown d1/d12/d1f/d3d/lbd 7998 1 2023-12-12T11:51:55.199 INFO:tasks.workunit.client.1.smithi093.stdout:9/591: fsync d1/d23/d24/d29/d43/d56/d68/fbe 0 2023-12-12T11:51:55.199 INFO:tasks.workunit.client.1.smithi093.stdout:1/584: mknod d4/d1a/da6/cc0 0 2023-12-12T11:51:55.206 INFO:tasks.workunit.client.0.smithi063.stdout:5/407: read d7/d28/d6e/f39 [3988083,120342] 0 2023-12-12T11:51:55.206 INFO:tasks.workunit.client.0.smithi063.stdout:9/324: dwrite d7/d11/d12/f3d [0,4194304] 0 2023-12-12T11:51:55.209 INFO:tasks.workunit.client.1.smithi093.stdout:9/592: dread d1/d12/d1f/d3d/d57/f67 [0,4194304] 0 2023-12-12T11:51:55.209 INFO:tasks.workunit.client.1.smithi093.stdout:4/804: creat d0/d87/d79/d96/dcc/ff6 x:0 0 0 2023-12-12T11:51:55.210 INFO:tasks.workunit.client.1.smithi093.stdout:7/559: dwrite da/d15/d59/f66 [0,4194304] 0 2023-12-12T11:51:55.210 INFO:tasks.workunit.client.1.smithi093.stdout:7/560: fsync da/d15/d59/f66 0 2023-12-12T11:51:55.210 INFO:tasks.workunit.client.1.smithi093.stdout:7/561: write da/f7b [874315,118389] 0 2023-12-12T11:51:55.213 INFO:tasks.workunit.client.0.smithi063.stdout:8/462: symlink d4/d24/d38/d45/l90 0 2023-12-12T11:51:55.215 INFO:tasks.workunit.client.1.smithi093.stdout:6/729: mkdir d0/da/d14/d38/d43/d10e 0 2023-12-12T11:51:55.218 INFO:tasks.workunit.client.1.smithi093.stdout:8/650: dwrite d3/d1a/d1f/d29/f43 [0,4194304] 0 2023-12-12T11:51:55.219 INFO:tasks.workunit.client.0.smithi063.stdout:7/355: rename de/d22/d2b/l2e to de/d22/d66/l84 0 2023-12-12T11:51:55.219 INFO:tasks.workunit.client.0.smithi063.stdout:7/356: write de/d22/d2b/f46 [681492,31520] 0 2023-12-12T11:51:55.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:54 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:51:55.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:54 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:51:55.221 INFO:tasks.workunit.client.0.smithi063.stdout:6/424: dwrite d9/d10/d25/f3d [0,4194304] 0 2023-12-12T11:51:55.222 INFO:tasks.workunit.client.0.smithi063.stdout:6/425: readlink d9/d10/l2e 0 2023-12-12T11:51:55.224 INFO:tasks.workunit.client.0.smithi063.stdout:1/416: rmdir d3/db/d12 39 2023-12-12T11:51:55.224 INFO:tasks.workunit.client.1.smithi093.stdout:2/632: getdents d5/d14/d2d/d4c/d54/dc5/d55 0 2023-12-12T11:51:55.227 INFO:tasks.workunit.client.1.smithi093.stdout:1/585: symlink d4/dc/d7a/d9c/lc1 0 2023-12-12T11:51:55.228 INFO:tasks.workunit.client.0.smithi063.stdout:4/419: getdents d2/d47 0 2023-12-12T11:51:55.235 INFO:tasks.workunit.client.1.smithi093.stdout:5/506: mknod d0/d7/d36/d38/caa 0 2023-12-12T11:51:55.235 INFO:tasks.workunit.client.1.smithi093.stdout:5/507: fsync d0/d3b/d66/f9a 0 2023-12-12T11:51:55.238 INFO:tasks.workunit.client.0.smithi063.stdout:0/351: mknod d0/d7/d27/d19/d2d/c78 0 2023-12-12T11:51:55.240 INFO:tasks.workunit.client.1.smithi093.stdout:3/572: sync 2023-12-12T11:51:55.240 INFO:tasks.workunit.client.1.smithi093.stdout:0/619: sync 2023-12-12T11:51:55.240 INFO:tasks.workunit.client.1.smithi093.stdout:3/573: readlink df/d30/d33/d66/l7e 0 2023-12-12T11:51:55.242 INFO:tasks.workunit.client.0.smithi063.stdout:3/334: dwrite d4/f6 [12582912,4194304] 0 2023-12-12T11:51:55.243 INFO:tasks.workunit.client.0.smithi063.stdout:5/408: unlink d7/c2c 0 2023-12-12T11:51:55.247 INFO:tasks.workunit.client.1.smithi093.stdout:9/593: symlink d1/d12/d1f/d3d/lc9 0 2023-12-12T11:51:55.248 INFO:tasks.workunit.client.0.smithi063.stdout:9/325: link d7/d11/d12/c2c d7/d20/d45/c61 0 2023-12-12T11:51:55.249 INFO:tasks.workunit.client.0.smithi063.stdout:1/417: dread d3/db/d12/f27 [0,4194304] 0 2023-12-12T11:51:55.250 INFO:tasks.workunit.client.1.smithi093.stdout:3/574: dread df/d22/d49/d69/d78/daf/d3d/d59/d9c/f9f [0,4194304] 0 2023-12-12T11:51:55.250 INFO:tasks.workunit.client.0.smithi063.stdout:1/418: fdatasync d3/db/d16/d24/d48/d75/d83/d5b/f65 0 2023-12-12T11:51:55.250 INFO:tasks.workunit.client.0.smithi063.stdout:8/463: mkdir d4/de/d3b/d62/d91 0 2023-12-12T11:51:55.250 INFO:tasks.workunit.client.0.smithi063.stdout:1/419: creat d3/db/d16/d24/d48/f8a x:0 0 0 2023-12-12T11:51:55.251 INFO:tasks.workunit.client.1.smithi093.stdout:6/730: rmdir d0 39 2023-12-12T11:51:55.253 INFO:tasks.workunit.client.1.smithi093.stdout:8/651: dwrite d3/d1a/fab [0,4194304] 0 2023-12-12T11:51:55.255 INFO:tasks.workunit.client.0.smithi063.stdout:7/357: link de/d39/d4b/l54 de/d39/l85 0 2023-12-12T11:51:55.255 INFO:tasks.workunit.client.0.smithi063.stdout:7/358: write de/d22/d2b/f64 [893769,56239] 0 2023-12-12T11:51:55.255 INFO:tasks.workunit.client.1.smithi093.stdout:0/620: symlink d5/dd/d14/d26/lc0 0 2023-12-12T11:51:55.255 INFO:tasks.workunit.client.1.smithi093.stdout:5/508: write d0/d7/f1c [312132,94026] 0 2023-12-12T11:51:55.255 INFO:tasks.workunit.client.1.smithi093.stdout:5/509: fdatasync d0/d7/f99 0 2023-12-12T11:51:55.258 INFO:tasks.workunit.client.1.smithi093.stdout:4/805: dwrite d0/d31/d5c/fb9 [0,4194304] 0 2023-12-12T11:51:55.259 INFO:tasks.workunit.client.1.smithi093.stdout:4/806: getdents d0/d31/d5c/d6c/de2 0 2023-12-12T11:51:55.259 INFO:tasks.workunit.client.0.smithi063.stdout:6/426: creat d9/d2c/d6b/f8b x:0 0 0 2023-12-12T11:51:55.259 INFO:tasks.workunit.client.0.smithi063.stdout:4/420: symlink d2/d47/d6d/l83 0 2023-12-12T11:51:55.262 INFO:tasks.workunit.client.1.smithi093.stdout:7/562: rename da/d15/d19/d90/d7d/l98 to da/d15/lc5 0 2023-12-12T11:51:55.263 INFO:tasks.workunit.client.0.smithi063.stdout:2/322: symlink d0/d1a/d1e/l6a 0 2023-12-12T11:51:55.266 INFO:tasks.workunit.client.1.smithi093.stdout:3/575: symlink df/d25/d6b/lbc 0 2023-12-12T11:51:55.267 INFO:tasks.workunit.client.0.smithi063.stdout:3/335: getdents d4/df/d1a/d1c/d34/d54 0 2023-12-12T11:51:55.267 INFO:tasks.workunit.client.0.smithi063.stdout:3/336: stat d4/df/d1a/d1c/d3b 0 2023-12-12T11:51:55.270 INFO:tasks.workunit.client.1.smithi093.stdout:6/731: creat d0/da/d14/d3a/d106/f10f x:0 0 0 2023-12-12T11:51:55.273 INFO:tasks.workunit.client.0.smithi063.stdout:9/326: mknod d7/d11/d4b/c62 0 2023-12-12T11:51:55.273 INFO:tasks.workunit.client.0.smithi063.stdout:9/327: chown d7/d15/c1b 261608092 1 2023-12-12T11:51:55.273 INFO:tasks.workunit.client.1.smithi093.stdout:0/621: dread d5/d21/d27/d3a/f56 [0,4194304] 0 2023-12-12T11:51:55.276 INFO:tasks.workunit.client.1.smithi093.stdout:9/594: dread d1/d23/d24/d29/d43/f5e [0,4194304] 0 2023-12-12T11:51:55.281 INFO:tasks.workunit.client.0.smithi063.stdout:1/420: truncate d3/db/d16/d24/d48/d75/d83/d5b/d6b/f7f 2520221 0 2023-12-12T11:51:55.281 INFO:tasks.workunit.client.0.smithi063.stdout:1/421: write d3/db/d16/d24/d4d/f68 [1531411,78601] 0 2023-12-12T11:51:55.282 INFO:tasks.workunit.client.1.smithi093.stdout:8/652: creat d3/d8/d88/dc5/fd4 x:0 0 0 2023-12-12T11:51:55.282 INFO:tasks.workunit.client.1.smithi093.stdout:8/653: write d3/d1a/d1f/d29/d3a/fd3 [727253,44099] 0 2023-12-12T11:51:55.286 INFO:tasks.workunit.client.0.smithi063.stdout:0/352: dread d0/d7/d27/f33 [0,4194304] 0 2023-12-12T11:51:55.286 INFO:tasks.workunit.client.0.smithi063.stdout:7/359: link de/d33/d41/d44/f6b de/d22/d2b/d61/f86 0 2023-12-12T11:51:55.288 INFO:tasks.workunit.client.0.smithi063.stdout:6/427: rename d9/d68/f85 to d9/d10/f8c 0 2023-12-12T11:51:55.289 INFO:tasks.workunit.client.0.smithi063.stdout:2/323: mknod d0/d1a/d3a/d59/c6b 0 2023-12-12T11:51:55.289 INFO:tasks.workunit.client.0.smithi063.stdout:2/324: chown d0/d1a/d48/f3f 229245 1 2023-12-12T11:51:55.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:54 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:51:55.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:54 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:51:55.297 INFO:tasks.workunit.client.0.smithi063.stdout:7/360: link de/d33/d41/d44/l69 de/d34/d68/l87 0 2023-12-12T11:51:55.300 INFO:tasks.workunit.client.0.smithi063.stdout:3/337: mkdir d4/df/d1a/d1c/d3b/d50/d71 0 2023-12-12T11:51:55.303 INFO:tasks.workunit.client.0.smithi063.stdout:6/428: rename d9/d10/f52 to d9/f8d 0 2023-12-12T11:51:55.304 INFO:tasks.workunit.client.1.smithi093.stdout:4/807: symlink d0/d31/d89/da1/lf7 0 2023-12-12T11:51:55.304 INFO:tasks.workunit.client.1.smithi093.stdout:2/633: rename d5/d14/d2d/d4c/d54/d67/d69/d6c/c62 to d5/d14/d2d/cd9 0 2023-12-12T11:51:55.304 INFO:tasks.workunit.client.1.smithi093.stdout:4/808: readlink d0/d31/l23 0 2023-12-12T11:51:55.304 INFO:tasks.workunit.client.0.smithi063.stdout:6/429: write d9/d2c/f4d [153435,121573] 0 2023-12-12T11:51:55.304 INFO:tasks.workunit.client.0.smithi063.stdout:6/430: readlink d9/d10/l2e 0 2023-12-12T11:51:55.304 INFO:tasks.workunit.client.0.smithi063.stdout:6/431: chown d9/d2c/d6b/f8b 3911256 1 2023-12-12T11:51:55.305 INFO:tasks.workunit.client.0.smithi063.stdout:4/421: read d2/d17/f3c [513636,69394] 0 2023-12-12T11:51:55.314 INFO:tasks.workunit.client.1.smithi093.stdout:6/732: unlink d0/l7 0 2023-12-12T11:51:55.314 INFO:tasks.workunit.client.1.smithi093.stdout:6/733: creat d0/da/d14/d21/f110 x:0 0 0 2023-12-12T11:51:55.314 INFO:tasks.workunit.client.1.smithi093.stdout:6/734: creat d0/da/d14/d3a/f111 x:0 0 0 2023-12-12T11:51:55.314 INFO:tasks.workunit.client.1.smithi093.stdout:6/735: creat d0/da/d14/d38/d43/f112 x:0 0 0 2023-12-12T11:51:55.317 INFO:tasks.workunit.client.0.smithi063.stdout:5/409: dwrite d7/d10/d2b/d3c/d5a/f6a [0,4194304] 0 2023-12-12T11:51:55.317 INFO:tasks.workunit.client.1.smithi093.stdout:0/622: mkdir d5/d21/d27/d3a/dc1 0 2023-12-12T11:51:55.329 INFO:tasks.workunit.client.1.smithi093.stdout:4/809: creat d0/d31/d5c/d6c/de2/ff8 x:0 0 0 2023-12-12T11:51:55.329 INFO:tasks.workunit.client.1.smithi093.stdout:4/810: chown d0/d87/d79/d96/db5 1063 1 2023-12-12T11:51:55.330 INFO:tasks.workunit.client.0.smithi063.stdout:4/422: creat d2/d17/d7f/f84 x:0 0 0 2023-12-12T11:51:55.330 INFO:tasks.workunit.client.0.smithi063.stdout:7/361: rmdir de/d22/d6e 39 2023-12-12T11:51:55.334 INFO:tasks.workunit.client.1.smithi093.stdout:7/563: dwrite f0 [8388608,4194304] 0 2023-12-12T11:51:55.334 INFO:tasks.workunit.client.1.smithi093.stdout:7/564: truncate da/d2e/f93 117349 0 2023-12-12T11:51:55.335 INFO:tasks.workunit.client.1.smithi093.stdout:5/510: rename d0/d7/d36/d38/d83 to d0/d7/d8/de/dab 0 2023-12-12T11:51:55.339 INFO:tasks.workunit.client.1.smithi093.stdout:2/634: dread d5/d14/d2d/d4c/d54/d67/d69/d6c/f93 [0,4194304] 0 2023-12-12T11:51:55.344 INFO:tasks.workunit.client.0.smithi063.stdout:5/410: symlink d7/d10/d2b/d3c/d42/d62/d69/l7e 0 2023-12-12T11:51:55.344 INFO:tasks.workunit.client.0.smithi063.stdout:5/411: dread - d7/d28/d6e/f7c zero size 2023-12-12T11:51:55.344 INFO:tasks.workunit.client.0.smithi063.stdout:5/412: write d7/d10/d2b/d3c/d42/d62/d69/f73 [1295699,38356] 0 2023-12-12T11:51:55.344 INFO:tasks.workunit.client.0.smithi063.stdout:5/413: truncate d7/d10/d2b/d3c/d42/d62/f6c 355760 0 2023-12-12T11:51:55.344 INFO:tasks.workunit.client.0.smithi063.stdout:5/414: write d7/d10/d2b/d3c/f36 [1711840,22159] 0 2023-12-12T11:51:55.348 INFO:tasks.workunit.client.1.smithi093.stdout:6/736: dread d0/da/d32/d39/d5b/f5d [0,4194304] 0 2023-12-12T11:51:55.349 INFO:tasks.workunit.client.0.smithi063.stdout:4/423: mkdir d2/d47/d77/d85 0 2023-12-12T11:51:55.349 INFO:tasks.workunit.client.0.smithi063.stdout:4/424: write d2/f58 [943835,110507] 0 2023-12-12T11:51:55.350 INFO:tasks.workunit.client.0.smithi063.stdout:7/362: mkdir de/d39/d88 0 2023-12-12T11:51:55.352 INFO:tasks.workunit.client.1.smithi093.stdout:0/623: creat d5/d41/fc2 x:0 0 0 2023-12-12T11:51:55.352 INFO:tasks.workunit.client.0.smithi063.stdout:5/415: rmdir d7/d10/d2b/d3c/d42/d76 39 2023-12-12T11:51:55.352 INFO:tasks.workunit.client.0.smithi063.stdout:5/416: readlink d7/l71 0 2023-12-12T11:51:55.352 INFO:tasks.workunit.client.0.smithi063.stdout:5/417: fsync d7/d10/f14 0 2023-12-12T11:51:55.353 INFO:tasks.workunit.client.0.smithi063.stdout:5/418: chown d7/d10/f48 7049068 1 2023-12-12T11:51:55.354 INFO:tasks.workunit.client.1.smithi093.stdout:7/565: mkdir da/d15/d2d/d2f/dc6 0 2023-12-12T11:51:55.356 INFO:tasks.workunit.client.1.smithi093.stdout:8/654: dwrite d3/d1a/d1f/d29/d3a/f55 [0,4194304] 0 2023-12-12T11:51:55.357 INFO:tasks.workunit.client.0.smithi063.stdout:2/325: write d0/ff [2594525,91073] 0 2023-12-12T11:51:55.361 INFO:tasks.workunit.client.0.smithi063.stdout:6/432: dread d9/f1a [0,4194304] 0 2023-12-12T11:51:55.362 INFO:tasks.workunit.client.1.smithi093.stdout:3/576: dwrite df/d22/f89 [0,4194304] 0 2023-12-12T11:51:55.363 INFO:tasks.workunit.client.1.smithi093.stdout:9/595: dwrite d1/d12/d1f/d3d/d57/f67 [0,4194304] 0 2023-12-12T11:51:55.364 INFO:tasks.workunit.client.1.smithi093.stdout:6/737: dread d0/f44 [0,4194304] 0 2023-12-12T11:51:55.365 INFO:tasks.workunit.client.0.smithi063.stdout:4/425: stat d2/l62 0 2023-12-12T11:51:55.365 INFO:tasks.workunit.client.0.smithi063.stdout:4/426: chown d2/f58 5183 1 2023-12-12T11:51:55.369 INFO:tasks.workunit.client.0.smithi063.stdout:0/353: dwrite d0/d1a/d23/d2e/f64 [0,4194304] 0 2023-12-12T11:51:55.375 INFO:tasks.workunit.client.1.smithi093.stdout:4/811: rename d0/d87/d79/d86/da9/cac to d0/d87/d79/d7f/cf9 0 2023-12-12T11:51:55.375 INFO:tasks.workunit.client.1.smithi093.stdout:4/812: write d0/d87/d79/db2/fae [5052642,49970] 0 2023-12-12T11:51:55.375 INFO:tasks.workunit.client.1.smithi093.stdout:4/813: truncate d0/d31/d5c/d6c/da4/fbd 1500938 0 2023-12-12T11:51:55.376 INFO:tasks.workunit.client.0.smithi063.stdout:3/338: dread f0 [0,4194304] 0 2023-12-12T11:51:55.376 INFO:tasks.workunit.client.0.smithi063.stdout:8/464: dwrite d4/de/d1e/f5c [8388608,4194304] 0 2023-12-12T11:51:55.380 INFO:tasks.workunit.client.1.smithi093.stdout:2/635: creat d5/d14/d2d/d12/db4/fda x:0 0 0 2023-12-12T11:51:55.384 INFO:tasks.workunit.client.0.smithi063.stdout:4/427: mkdir d2/d17/d7f/d86 0 2023-12-12T11:51:55.388 INFO:tasks.workunit.client.0.smithi063.stdout:9/328: dwrite d7/f27 [0,4194304] 0 2023-12-12T11:51:55.388 INFO:tasks.workunit.client.0.smithi063.stdout:1/422: dwrite d3/db/d12/f49 [0,4194304] 0 2023-12-12T11:51:55.389 INFO:tasks.workunit.client.1.smithi093.stdout:0/624: unlink d5/d21/f4c 0 2023-12-12T11:51:55.391 INFO:tasks.workunit.client.1.smithi093.stdout:0/625: read d5/dd/d14/d26/d58/dab/f9c [306091,74776] 0 2023-12-12T11:51:55.392 INFO:tasks.workunit.client.1.smithi093.stdout:0/626: creat d5/d21/d27/d3a/d9a/fc3 x:0 0 0 2023-12-12T11:51:55.401 INFO:tasks.workunit.client.0.smithi063.stdout:7/363: truncate de/d22/d2b/f46 257500 0 2023-12-12T11:51:55.401 INFO:tasks.workunit.client.0.smithi063.stdout:7/364: dread - de/d39/d4b/f81 zero size 2023-12-12T11:51:55.403 INFO:tasks.workunit.client.1.smithi093.stdout:7/566: link da/d15/lb6 da/d8e/da9/lc7 0 2023-12-12T11:51:55.408 INFO:tasks.workunit.client.0.smithi063.stdout:4/428: dread d2/d47/f30 [0,4194304] 0 2023-12-12T11:51:55.419 INFO:tasks.workunit.client.1.smithi093.stdout:3/577: dwrite df/d22/f6d [0,4194304] 0 2023-12-12T11:51:55.419 INFO:tasks.workunit.client.0.smithi063.stdout:6/433: dread d9/fc [4194304,4194304] 0 2023-12-12T11:51:55.424 INFO:tasks.workunit.client.1.smithi093.stdout:9/596: creat d1/d12/d1f/dc0/fca x:0 0 0 2023-12-12T11:51:55.424 INFO:tasks.workunit.client.1.smithi093.stdout:9/597: chown d1/f59 19976 1 2023-12-12T11:51:55.424 INFO:tasks.workunit.client.1.smithi093.stdout:9/598: readlink d1/d12/d1f/d32/d42/l69 0 2023-12-12T11:51:55.426 INFO:tasks.workunit.client.0.smithi063.stdout:6/434: dread d9/d10/f1e [0,4194304] 0 2023-12-12T11:51:55.426 INFO:tasks.workunit.client.0.smithi063.stdout:6/435: chown d9/d10/d5c/d5e/f6a 483340284 1 2023-12-12T11:51:55.426 INFO:tasks.workunit.client.0.smithi063.stdout:6/436: getdents d9/d2c 0 2023-12-12T11:51:55.426 INFO:tasks.workunit.client.0.smithi063.stdout:6/437: creat d9/d10/d5c/d5e/f8e x:0 0 0 2023-12-12T11:51:55.427 INFO:tasks.workunit.client.0.smithi063.stdout:9/329: creat d7/d15/f63 x:0 0 0 2023-12-12T11:51:55.428 INFO:tasks.workunit.client.1.smithi093.stdout:2/636: mknod d5/d31/d86/cdb 0 2023-12-12T11:51:55.431 INFO:tasks.workunit.client.1.smithi093.stdout:8/655: dwrite d3/d8/d88/dc5/fd4 [0,4194304] 0 2023-12-12T11:51:55.431 INFO:tasks.workunit.client.1.smithi093.stdout:8/656: chown d3/d1a/d1f/d29/l4a 24766 1 2023-12-12T11:51:55.433 INFO:tasks.workunit.client.1.smithi093.stdout:6/738: dwrite d0/da/d32/d39/d5b/fe4 [0,4194304] 0 2023-12-12T11:51:55.434 INFO:tasks.workunit.client.0.smithi063.stdout:5/419: dwrite d7/d28/d43/d49/f4a [0,4194304] 0 2023-12-12T11:51:55.435 INFO:tasks.workunit.client.1.smithi093.stdout:4/814: dwrite d0/d36/d49/f81 [0,4194304] 0 2023-12-12T11:51:55.435 INFO:tasks.workunit.client.1.smithi093.stdout:4/815: write d0/d31/d5c/d66/fbf [4755971,29037] 0 2023-12-12T11:51:55.436 INFO:tasks.workunit.client.1.smithi093.stdout:0/627: mknod d5/d21/d27/d3a/dc1/cc4 0 2023-12-12T11:51:55.439 INFO:tasks.workunit.client.1.smithi093.stdout:7/567: symlink da/d8e/lc8 0 2023-12-12T11:51:55.442 INFO:tasks.workunit.client.0.smithi063.stdout:1/423: link d3/l11 d3/db/d16/d24/d48/d75/d83/d5b/l8b 0 2023-12-12T11:51:55.442 INFO:tasks.workunit.client.0.smithi063.stdout:1/424: dread - d3/db/d16/d24/d48/d75/d83/d5b/d6b/d6d/f7a zero size 2023-12-12T11:51:55.447 INFO:tasks.workunit.client.1.smithi093.stdout:3/578: unlink df/d22/d49/d69/d78/daf/d3d/d42/cab 0 2023-12-12T11:51:55.447 INFO:tasks.workunit.client.1.smithi093.stdout:3/579: stat df/d25/l40 0 2023-12-12T11:51:55.447 INFO:tasks.workunit.client.1.smithi093.stdout:3/580: readlink df/d22/l35 0 2023-12-12T11:51:55.451 INFO:tasks.workunit.client.1.smithi093.stdout:9/599: symlink d1/d12/d1f/d32/d42/lcb 0 2023-12-12T11:51:55.451 INFO:tasks.workunit.client.1.smithi093.stdout:9/600: creat d1/d23/d24/d29/d43/d56/d85/fcc x:0 0 0 2023-12-12T11:51:55.451 INFO:tasks.workunit.client.1.smithi093.stdout:9/601: stat d1/f2f 0 2023-12-12T11:51:55.459 INFO:tasks.workunit.client.1.smithi093.stdout:1/586: sync 2023-12-12T11:51:55.459 INFO:tasks.workunit.client.1.smithi093.stdout:1/587: chown d4/d1a/d1b/dbf 3 1 2023-12-12T11:51:55.459 INFO:tasks.workunit.client.1.smithi093.stdout:1/588: dread - d4/d81/fbd zero size 2023-12-12T11:51:55.459 INFO:tasks.workunit.client.1.smithi093.stdout:1/589: readlink d4/d1c/l5d 0 2023-12-12T11:51:55.460 INFO:tasks.workunit.client.1.smithi093.stdout:8/657: creat d3/d1a/d1f/d29/d3a/da0/dcb/fd5 x:0 0 0 2023-12-12T11:51:55.460 INFO:tasks.workunit.client.1.smithi093.stdout:8/658: chown d3/d1a/d1f/d29/d3a/d40/fc9 2119902 1 2023-12-12T11:51:55.463 INFO:tasks.workunit.client.0.smithi063.stdout:0/354: rmdir d0/d1a/d23/d34/d42 39 2023-12-12T11:51:55.463 INFO:tasks.workunit.client.0.smithi063.stdout:7/365: mkdir de/d34/d68/d89 0 2023-12-12T11:51:55.464 INFO:tasks.workunit.client.0.smithi063.stdout:7/366: write de/d3f/f72 [713975,127471] 0 2023-12-12T11:51:55.467 INFO:tasks.workunit.client.0.smithi063.stdout:4/429: truncate d2/d17/d41/f5b 49481 0 2023-12-12T11:51:55.467 INFO:tasks.workunit.client.0.smithi063.stdout:4/430: readlink d2/d47/l70 0 2023-12-12T11:51:55.469 INFO:tasks.workunit.client.0.smithi063.stdout:8/465: rename d4/de/d11/d58 to d4/d24/d38/d45/d5b/d92 0 2023-12-12T11:51:55.478 INFO:tasks.workunit.client.1.smithi093.stdout:6/739: mkdir d0/da/d32/d9e/d113 0 2023-12-12T11:51:55.488 INFO:tasks.workunit.client.0.smithi063.stdout:6/438: unlink d9/d10/l46 0 2023-12-12T11:51:55.488 INFO:tasks.workunit.client.0.smithi063.stdout:6/439: truncate d9/d2c/f4d 855192 0 2023-12-12T11:51:55.488 INFO:tasks.workunit.client.1.smithi093.stdout:3/581: dwrite df/d25/d2c/f9b [0,4194304] 0 2023-12-12T11:51:55.488 INFO:tasks.workunit.client.1.smithi093.stdout:3/582: fdatasync df/d25/d2c/f9b 0 2023-12-12T11:51:55.494 INFO:tasks.workunit.client.1.smithi093.stdout:1/590: dread d4/dc/f5c [0,4194304] 0 2023-12-12T11:51:55.494 INFO:tasks.workunit.client.1.smithi093.stdout:2/637: dwrite d5/d14/d2d/d8b/da2/fb7 [0,4194304] 0 2023-12-12T11:51:55.494 INFO:tasks.workunit.client.0.smithi063.stdout:0/355: dread d0/d7/f55 [0,4194304] 0 2023-12-12T11:51:55.494 INFO:tasks.workunit.client.0.smithi063.stdout:9/330: unlink d7/d11/d12/d30/d3e/l4d 0 2023-12-12T11:51:55.494 INFO:tasks.workunit.client.0.smithi063.stdout:0/356: dread - d0/d1a/d23/f74 zero size 2023-12-12T11:51:55.494 INFO:tasks.workunit.client.0.smithi063.stdout:0/357: chown d0/d1a 62 1 2023-12-12T11:51:55.494 INFO:tasks.workunit.client.0.smithi063.stdout:0/358: creat d0/d1a/d23/d2e/f79 x:0 0 0 2023-12-12T11:51:55.499 INFO:tasks.workunit.client.0.smithi063.stdout:0/359: write d0/d1a/d23/d34/d42/f53 [170712,33500] 0 2023-12-12T11:51:55.503 INFO:tasks.workunit.client.1.smithi093.stdout:4/816: symlink d0/d31/lfa 0 2023-12-12T11:51:55.504 INFO:tasks.workunit.client.0.smithi063.stdout:1/425: mkdir d3/db/d16/d17/d4b/d8c 0 2023-12-12T11:51:55.512 INFO:tasks.workunit.client.1.smithi093.stdout:0/628: creat d5/dd/d14/d26/d58/d64/fc5 x:0 0 0 2023-12-12T11:51:55.512 INFO:tasks.workunit.client.1.smithi093.stdout:0/629: dread - d5/dd/d14/d99/fbc zero size 2023-12-12T11:51:55.513 INFO:tasks.workunit.client.0.smithi063.stdout:7/367: mkdir de/d22/d6e/d8a 0 2023-12-12T11:51:55.513 INFO:tasks.workunit.client.0.smithi063.stdout:7/368: readlink de/l25 0 2023-12-12T11:51:55.514 INFO:tasks.workunit.client.0.smithi063.stdout:7/369: write de/d34/f55 [561036,25236] 0 2023-12-12T11:51:55.516 INFO:tasks.workunit.client.0.smithi063.stdout:4/431: readlink d2/d8/l36 0 2023-12-12T11:51:55.516 INFO:tasks.workunit.client.0.smithi063.stdout:4/432: readlink d2/d17/d41/l6a 0 2023-12-12T11:51:55.517 INFO:tasks.workunit.client.1.smithi093.stdout:7/568: mknod da/cc9 0 2023-12-12T11:51:55.517 INFO:tasks.workunit.client.1.smithi093.stdout:7/569: fsync da/de/f30 0 2023-12-12T11:51:55.517 INFO:tasks.workunit.client.1.smithi093.stdout:4/817: write d0/d87/fc6 [2257189,32967] 0 2023-12-12T11:51:55.518 INFO:tasks.workunit.client.1.smithi093.stdout:8/659: mknod d3/d1a/d1f/d29/d3a/d40/cd6 0 2023-12-12T11:51:55.518 INFO:tasks.workunit.client.1.smithi093.stdout:8/660: readlink d3/d1a/d1f/d59/d69/dbc/dc2/lc8 0 2023-12-12T11:51:55.521 INFO:tasks.workunit.client.0.smithi063.stdout:9/331: mkdir d7/d20/d45/d46/d51/d64 0 2023-12-12T11:51:55.524 INFO:tasks.workunit.client.1.smithi093.stdout:2/638: write d5/d14/d2d/d12/f99 [8334375,83929] 0 2023-12-12T11:51:55.527 INFO:tasks.workunit.client.1.smithi093.stdout:6/740: mkdir d0/da/d32/d9e/d114 0 2023-12-12T11:51:55.533 INFO:tasks.workunit.client.0.smithi063.stdout:0/360: mknod d0/d7/d27/d19/c7a 0 2023-12-12T11:51:55.533 INFO:tasks.workunit.client.0.smithi063.stdout:6/440: dwrite d9/d10/d5c/f5f [0,4194304] 0 2023-12-12T11:51:55.536 INFO:tasks.workunit.client.1.smithi093.stdout:5/511: sync 2023-12-12T11:51:55.536 INFO:tasks.workunit.client.1.smithi093.stdout:5/512: write d0/d7/d36/d38/f40 [4813607,124081] 0 2023-12-12T11:51:55.538 INFO:tasks.workunit.client.0.smithi063.stdout:1/426: rename d3/db/f1d to d3/db/d16/d24/d48/d75/d83/f8d 0 2023-12-12T11:51:55.541 INFO:tasks.workunit.client.1.smithi093.stdout:3/583: creat df/d22/d49/d69/d78/daf/d3d/d6f/db1/fbd x:0 0 0 2023-12-12T11:51:55.543 INFO:tasks.workunit.client.0.smithi063.stdout:5/420: dwrite d7/de/f1e [0,4194304] 0 2023-12-12T11:51:55.543 INFO:tasks.workunit.client.0.smithi063.stdout:5/421: chown d7/d10/d2b/d3c/d42/d62/f6c 18005 1 2023-12-12T11:51:55.551 INFO:tasks.workunit.client.0.smithi063.stdout:7/370: mkdir de/d33/d41/d44/d8b 0 2023-12-12T11:51:55.551 INFO:tasks.workunit.client.0.smithi063.stdout:4/433: link d2/d17/d61/c72 d2/d17/d7f/c87 0 2023-12-12T11:51:55.558 INFO:tasks.workunit.client.0.smithi063.stdout:9/332: mkdir d7/d20/d65 0 2023-12-12T11:51:55.560 INFO:tasks.workunit.client.1.smithi093.stdout:1/591: mkdir d4/d1a/dc2 0 2023-12-12T11:51:55.561 INFO:tasks.workunit.client.0.smithi063.stdout:6/441: mkdir d9/d68/d8f 0 2023-12-12T11:51:55.562 INFO:tasks.workunit.client.0.smithi063.stdout:6/442: creat d9/d68/f90 x:0 0 0 2023-12-12T11:51:55.566 INFO:tasks.workunit.client.1.smithi093.stdout:0/630: truncate d5/d21/d27/d3a/f56 2392689 0 2023-12-12T11:51:55.566 INFO:tasks.workunit.client.1.smithi093.stdout:0/631: read - d5/d21/d27/f6a zero size 2023-12-12T11:51:55.567 INFO:tasks.workunit.client.0.smithi063.stdout:0/361: dread d0/d7/f31 [0,4194304] 0 2023-12-12T11:51:55.572 INFO:tasks.workunit.client.1.smithi093.stdout:4/818: symlink d0/d87/d79/d86/da9/lfb 0 2023-12-12T11:51:55.572 INFO:tasks.workunit.client.1.smithi093.stdout:4/819: write d0/d31/d5c/d66/fbf [5004863,33180] 0 2023-12-12T11:51:55.572 INFO:tasks.workunit.client.1.smithi093.stdout:4/820: chown d0/fd1 265731 1 2023-12-12T11:51:55.575 INFO:tasks.workunit.client.0.smithi063.stdout:5/422: unlink d7/d10/d2b/d3c/d42/d62/d69/l7e 0 2023-12-12T11:51:55.577 INFO:tasks.workunit.client.0.smithi063.stdout:9/333: rmdir d7/d20/d3f 39 2023-12-12T11:51:55.578 INFO:tasks.workunit.client.0.smithi063.stdout:9/334: stat d7/d15/f2e 0 2023-12-12T11:51:55.583 INFO:tasks.workunit.client.1.smithi093.stdout:1/592: write d4/d1a/d1b/d26/d65/d6f/f89 [196682,119357] 0 2023-12-12T11:51:55.583 INFO:tasks.workunit.client.1.smithi093.stdout:1/593: chown d4/d1a/d83/d9a/ca1 388 1 2023-12-12T11:51:55.586 INFO:tasks.workunit.client.1.smithi093.stdout:8/661: creat d3/d1a/d1f/d29/d30/d58/fd7 x:0 0 0 2023-12-12T11:51:55.586 INFO:tasks.workunit.client.1.smithi093.stdout:8/662: creat d3/d1a/d1f/d59/fd8 x:0 0 0 2023-12-12T11:51:55.586 INFO:tasks.workunit.client.1.smithi093.stdout:8/663: creat d3/d73/fd9 x:0 0 0 2023-12-12T11:51:55.591 INFO:tasks.workunit.client.1.smithi093.stdout:1/594: read d4/d1a/d1b/d26/f4d [526115,10198] 0 2023-12-12T11:51:55.591 INFO:tasks.workunit.client.1.smithi093.stdout:0/632: dread d5/d21/d27/f5d [0,4194304] 0 2023-12-12T11:51:55.596 INFO:tasks.workunit.client.0.smithi063.stdout:6/443: creat d9/d10/d7a/f91 x:0 0 0 2023-12-12T11:51:55.597 INFO:tasks.workunit.client.0.smithi063.stdout:4/434: dread d2/d48/d4f/f5e [0,4194304] 0 2023-12-12T11:51:55.599 INFO:tasks.workunit.client.1.smithi093.stdout:6/741: dwrite d0/d52/d6b/fa4 [0,4194304] 0 2023-12-12T11:51:55.599 INFO:tasks.workunit.client.1.smithi093.stdout:6/742: write d0/d52/dbc/f100 [959723,65621] 0 2023-12-12T11:51:55.599 INFO:tasks.workunit.client.1.smithi093.stdout:6/743: chown d0/da/d32/d39/d5b/cb8 56 1 2023-12-12T11:51:55.600 INFO:tasks.workunit.client.1.smithi093.stdout:2/639: creat d5/d14/d2d/d12/d25/d7a/d7e/da5/fdc x:0 0 0 2023-12-12T11:51:55.605 INFO:tasks.workunit.client.0.smithi063.stdout:0/362: stat d0/d1a/d23/l5c 0 2023-12-12T11:51:55.607 INFO:tasks.workunit.client.1.smithi093.stdout:5/513: rename d0/d3b/d66/l9f to d0/d7/d8/de/dab/lac 0 2023-12-12T11:51:55.609 INFO:tasks.workunit.client.0.smithi063.stdout:7/371: dread de/f4c [0,4194304] 0 2023-12-12T11:51:55.609 INFO:tasks.workunit.client.0.smithi063.stdout:7/372: read de/f19 [844211,125851] 0 2023-12-12T11:51:55.612 INFO:tasks.workunit.client.0.smithi063.stdout:6/444: creat d9/d10/f92 x:0 0 0 2023-12-12T11:51:55.613 INFO:tasks.workunit.client.1.smithi093.stdout:3/584: mkdir df/d22/d49/d69/d78/db9/dbe 0 2023-12-12T11:51:55.613 INFO:tasks.workunit.client.0.smithi063.stdout:4/435: mkdir d2/d47/d6d/d88 0 2023-12-12T11:51:55.615 INFO:tasks.workunit.client.1.smithi093.stdout:9/602: sync 2023-12-12T11:51:55.615 INFO:tasks.workunit.client.1.smithi093.stdout:9/603: chown d1/d12/d1f/f3a 11 1 2023-12-12T11:51:55.615 INFO:tasks.workunit.client.1.smithi093.stdout:7/570: dwrite da/d15/d19/d4c/f7a [0,4194304] 0 2023-12-12T11:51:55.616 INFO:tasks.workunit.client.0.smithi063.stdout:8/466: dwrite d4/de/d3b/d62/d36/f3a [0,4194304] 0 2023-12-12T11:51:55.616 INFO:tasks.workunit.client.0.smithi063.stdout:1/427: dwrite d3/db/d16/d24/f73 [0,4194304] 0 2023-12-12T11:51:55.617 INFO:tasks.workunit.client.0.smithi063.stdout:0/363: link d0/f21 d0/d1a/d23/f7b 0 2023-12-12T11:51:55.619 INFO:tasks.workunit.client.1.smithi093.stdout:4/821: mknod d0/d31/d5c/d66/cfc 0 2023-12-12T11:51:55.619 INFO:tasks.workunit.client.1.smithi093.stdout:4/822: truncate d0/d87/d79/d96/fd8 732284 0 2023-12-12T11:51:55.619 INFO:tasks.workunit.client.1.smithi093.stdout:4/823: chown d0/d31/d5c/d6c/lcf 41 1 2023-12-12T11:51:55.619 INFO:tasks.workunit.client.1.smithi093.stdout:4/824: creat d0/d31/d9d/da0/ffd x:0 0 0 2023-12-12T11:51:55.622 INFO:tasks.workunit.client.0.smithi063.stdout:9/335: dread d7/fd [0,4194304] 0 2023-12-12T11:51:55.623 INFO:tasks.workunit.client.0.smithi063.stdout:9/336: creat d7/d20/d45/f66 x:0 0 0 2023-12-12T11:51:55.624 INFO:tasks.workunit.client.0.smithi063.stdout:4/436: rename d2/d17/d4e/c6f to d2/d48/c89 0 2023-12-12T11:51:55.625 INFO:tasks.workunit.client.1.smithi093.stdout:0/633: write d5/dd/f35 [841140,87982] 0 2023-12-12T11:51:55.633 INFO:tasks.workunit.client.1.smithi093.stdout:8/664: rename d3/d1a/d1f/d29/d30/f4e to d3/d8/fda 0 2023-12-12T11:51:55.637 INFO:tasks.workunit.client.0.smithi063.stdout:5/423: dwrite d7/d10/d2b/d3c/d42/d76/f78 [0,4194304] 0 2023-12-12T11:51:55.639 INFO:tasks.workunit.client.1.smithi093.stdout:9/604: mkdir d1/d23/d6b/d92/db2/dcd 0 2023-12-12T11:51:55.642 INFO:tasks.workunit.client.1.smithi093.stdout:5/514: dread d0/f5 [0,4194304] 0 2023-12-12T11:51:55.643 INFO:tasks.workunit.client.1.smithi093.stdout:4/825: mknod d0/d87/d79/db2/cfe 0 2023-12-12T11:51:55.644 INFO:tasks.workunit.client.1.smithi093.stdout:7/571: creat da/d15/d2d/d2f/dc6/fca x:0 0 0 2023-12-12T11:51:55.647 INFO:tasks.workunit.client.0.smithi063.stdout:8/467: dread d4/de/d3b/d62/d6e/d76/f7a [0,4194304] 0 2023-12-12T11:51:55.647 INFO:tasks.workunit.client.1.smithi093.stdout:0/634: creat d5/d21/d2f/fc6 x:0 0 0 2023-12-12T11:51:55.652 INFO:tasks.workunit.client.1.smithi093.stdout:2/640: getdents d5/d14/d2d/d4c/d54/db9 0 2023-12-12T11:51:55.652 INFO:tasks.workunit.client.1.smithi093.stdout:1/595: dwrite d4/fa [0,4194304] 0 2023-12-12T11:51:55.653 INFO:tasks.workunit.client.1.smithi093.stdout:8/665: mkdir d3/d1a/d1f/d59/ddb 0 2023-12-12T11:51:55.653 INFO:tasks.workunit.client.1.smithi093.stdout:8/666: write d3/d1a/d1f/d29/d3a/d8f/fcc [210106,49505] 0 2023-12-12T11:51:55.658 INFO:tasks.workunit.client.0.smithi063.stdout:1/428: truncate d3/db/d16/f2d 2616447 0 2023-12-12T11:51:55.658 INFO:tasks.workunit.client.0.smithi063.stdout:1/429: readlink d3/db/d16/d24/d4d/d35/l6e 0 2023-12-12T11:51:55.661 INFO:tasks.workunit.client.1.smithi093.stdout:5/515: mkdir d0/d7/d8/d9e/dad 0 2023-12-12T11:51:55.662 INFO:tasks.workunit.client.1.smithi093.stdout:3/585: dwrite df/d22/d49/d69/d78/dad/fa9 [0,4194304] 0 2023-12-12T11:51:55.663 INFO:tasks.workunit.client.0.smithi063.stdout:0/364: rmdir d0/d77 0 2023-12-12T11:51:55.663 INFO:tasks.workunit.client.0.smithi063.stdout:0/365: stat d0/d1a/d23/c3d 0 2023-12-12T11:51:55.663 INFO:tasks.workunit.client.0.smithi063.stdout:0/366: chown d0/f65 17866956 1 2023-12-12T11:51:55.663 INFO:tasks.workunit.client.0.smithi063.stdout:0/367: dread - d0/d1a/d23/f74 zero size 2023-12-12T11:51:55.663 INFO:tasks.workunit.client.0.smithi063.stdout:0/368: creat d0/d1a/d23/f7c x:0 0 0 2023-12-12T11:51:55.663 INFO:tasks.workunit.client.1.smithi093.stdout:9/605: dread d1/f94 [0,4194304] 0 2023-12-12T11:51:55.664 INFO:tasks.workunit.client.0.smithi063.stdout:7/373: dwrite de/d39/d4b/f70 [0,4194304] 0 2023-12-12T11:51:55.666 INFO:tasks.workunit.client.1.smithi093.stdout:4/826: mkdir d0/d87/d79/dff 0 2023-12-12T11:51:55.669 INFO:tasks.workunit.client.1.smithi093.stdout:7/572: unlink da/d8e/l9c 0 2023-12-12T11:51:55.669 INFO:tasks.workunit.client.1.smithi093.stdout:7/573: truncate da/f8a 2160283 0 2023-12-12T11:51:55.670 INFO:tasks.workunit.client.1.smithi093.stdout:5/516: dread d0/f5 [0,4194304] 0 2023-12-12T11:51:55.671 INFO:tasks.workunit.client.0.smithi063.stdout:9/337: creat d7/d20/d3f/d40/d4e/f67 x:0 0 0 2023-12-12T11:51:55.673 INFO:tasks.workunit.client.0.smithi063.stdout:4/437: creat d2/d17/d81/f8a x:0 0 0 2023-12-12T11:51:55.673 INFO:tasks.workunit.client.0.smithi063.stdout:6/445: dwrite d9/d10/d2a/f67 [0,4194304] 0 2023-12-12T11:51:55.684 INFO:tasks.workunit.client.0.smithi063.stdout:5/424: creat d7/d28/d67/f7f x:0 0 0 2023-12-12T11:51:55.685 INFO:tasks.workunit.client.1.smithi093.stdout:0/635: mknod d5/dd/cc7 0 2023-12-12T11:51:55.685 INFO:tasks.workunit.client.1.smithi093.stdout:2/641: creat d5/d14/d2d/d4c/d54/dc5/d61/fdd x:0 0 0 2023-12-12T11:51:55.687 INFO:tasks.workunit.client.1.smithi093.stdout:1/596: creat d4/dc/d7a/d9c/da7/fc3 x:0 0 0 2023-12-12T11:51:55.694 INFO:tasks.workunit.client.0.smithi063.stdout:8/468: mkdir d4/de/d3b/d62/d6e/d76/d93 0 2023-12-12T11:51:55.694 INFO:tasks.workunit.client.0.smithi063.stdout:1/430: mknod d3/db/d16/d17/d4b/d8c/c8e 0 2023-12-12T11:51:55.701 INFO:tasks.workunit.client.1.smithi093.stdout:3/586: link df/d25/d6b/lbc df/d92/lbf 0 2023-12-12T11:51:55.706 INFO:tasks.workunit.client.1.smithi093.stdout:4/827: creat d0/d87/d79/d7f/f100 x:0 0 0 2023-12-12T11:51:55.717 INFO:tasks.workunit.client.0.smithi063.stdout:9/338: creat d7/d11/d4b/f68 x:0 0 0 2023-12-12T11:51:55.718 INFO:tasks.workunit.client.1.smithi093.stdout:5/517: rename d0/d7/d36/d29/f98 to d0/d7/d36/d29/d44/fae 0 2023-12-12T11:51:55.718 INFO:tasks.workunit.client.1.smithi093.stdout:5/518: readlink d0/d7/d8/l53 0 2023-12-12T11:51:55.718 INFO:tasks.workunit.client.1.smithi093.stdout:5/519: write d0/d7/d59/d48/f56 [274036,89041] 0 2023-12-12T11:51:55.718 INFO:tasks.workunit.client.0.smithi063.stdout:1/431: write d3/db/d16/d24/f29 [660505,8400] 0 2023-12-12T11:51:55.725 INFO:tasks.workunit.client.1.smithi093.stdout:0/636: mkdir d5/d21/d27/d3a/d9a/dc8 0 2023-12-12T11:51:55.725 INFO:tasks.workunit.client.1.smithi093.stdout:4/828: write d0/f33 [2175669,105226] 0 2023-12-12T11:51:55.725 INFO:tasks.workunit.client.1.smithi093.stdout:4/829: write d0/f1c [2737766,116829] 0 2023-12-12T11:51:55.727 INFO:tasks.workunit.client.1.smithi093.stdout:9/606: dwrite d1/d12/d1f/d32/d42/fa7 [0,4194304] 0 2023-12-12T11:51:55.728 INFO:tasks.workunit.client.1.smithi093.stdout:1/597: symlink d4/d1a/d1b/d26/d40/lc4 0 2023-12-12T11:51:55.734 INFO:tasks.workunit.client.1.smithi093.stdout:3/587: creat df/d22/d49/d69/d78/fc0 x:0 0 0 2023-12-12T11:51:55.735 INFO:tasks.workunit.client.1.smithi093.stdout:3/588: chown df/d22/d49/d69/d78/daf/d3d/d59/f5c 823 1 2023-12-12T11:51:55.747 INFO:tasks.workunit.client.1.smithi093.stdout:8/667: dwrite d3/d1a/d1f/d29/d3a/f5c [0,4194304] 0 2023-12-12T11:51:55.747 INFO:tasks.workunit.client.1.smithi093.stdout:8/668: creat d3/d1a/d1f/d75/fdc x:0 0 0 2023-12-12T11:51:55.747 INFO:tasks.workunit.client.1.smithi093.stdout:7/574: dwrite da/d15/d2d/f9f [8388608,4194304] 0 2023-12-12T11:51:55.747 INFO:tasks.workunit.client.1.smithi093.stdout:7/575: getdents da/d8e/daf 0 2023-12-12T11:51:55.748 INFO:tasks.workunit.client.1.smithi093.stdout:7/576: write da/d15/d59/f66 [4593252,112154] 0 2023-12-12T11:51:55.749 INFO:tasks.workunit.client.0.smithi063.stdout:6/446: dwrite d9/d10/f15 [0,4194304] 0 2023-12-12T11:51:55.749 INFO:tasks.workunit.client.0.smithi063.stdout:6/447: creat d9/d10/f93 x:0 0 0 2023-12-12T11:51:55.749 INFO:tasks.workunit.client.0.smithi063.stdout:6/448: truncate d9/d10/d25/f7b 88667 0 2023-12-12T11:51:55.749 INFO:tasks.workunit.client.0.smithi063.stdout:6/449: write d9/d10/f93 [77317,114723] 0 2023-12-12T11:51:55.749 INFO:tasks.workunit.client.0.smithi063.stdout:1/432: write d3/db/d16/d24/f73 [3782102,97959] 0 2023-12-12T11:51:55.749 INFO:tasks.workunit.client.0.smithi063.stdout:6/450: chown d9/d10/c21 14157976 1 2023-12-12T11:51:55.753 INFO:tasks.workunit.client.0.smithi063.stdout:4/438: mknod d2/d17/d81/c8b 0 2023-12-12T11:51:55.753 INFO:tasks.workunit.client.1.smithi093.stdout:4/830: unlink d0/d31/cdb 0 2023-12-12T11:51:55.753 INFO:tasks.workunit.client.1.smithi093.stdout:0/637: write d5/d21/f2e [481199,79851] 0 2023-12-12T11:51:55.756 INFO:tasks.workunit.client.0.smithi063.stdout:1/433: write d3/db/d16/d17/f55 [705706,87055] 0 2023-12-12T11:51:55.759 INFO:tasks.workunit.client.1.smithi093.stdout:1/598: write d4/d1a/d1b/d26/d65/d6f/f96 [3783442,102719] 0 2023-12-12T11:51:55.760 INFO:tasks.workunit.client.0.smithi063.stdout:5/425: link d7/d10/c11 d7/d10/c80 0 2023-12-12T11:51:55.765 INFO:tasks.workunit.client.0.smithi063.stdout:7/374: dwrite de/f4c [0,4194304] 0 2023-12-12T11:51:55.770 INFO:tasks.workunit.client.1.smithi093.stdout:5/520: dwrite d0/d7/d59/d48/f50 [0,4194304] 0 2023-12-12T11:51:55.770 INFO:tasks.workunit.client.1.smithi093.stdout:2/642: dwrite d5/d14/d2d/d12/d25/f29 [0,4194304] 0 2023-12-12T11:51:55.770 INFO:tasks.workunit.client.1.smithi093.stdout:2/643: stat d5/d14/d2d/f42 0 2023-12-12T11:51:55.774 INFO:tasks.workunit.client.0.smithi063.stdout:9/339: rename f5 to d7/d20/d3f/d40/d4e/f69 0 2023-12-12T11:51:55.779 INFO:tasks.workunit.client.0.smithi063.stdout:8/469: dwrite d4/de/f53 [0,4194304] 0 2023-12-12T11:51:55.787 INFO:tasks.workunit.client.1.smithi093.stdout:3/589: mknod df/d22/d49/d69/d78/daf/d3d/d59/d9c/cc1 0 2023-12-12T11:51:55.795 INFO:tasks.workunit.client.0.smithi063.stdout:7/375: read de/d33/f42 [2399418,17807] 0 2023-12-12T11:51:55.797 INFO:tasks.workunit.client.0.smithi063.stdout:8/470: write d4/de/d3b/d62/d36/d57/f78 [3670179,3849] 0 2023-12-12T11:51:55.797 INFO:tasks.workunit.client.0.smithi063.stdout:1/434: unlink d3/db/d16/d24/d4d/d35/c7d 0 2023-12-12T11:51:55.798 INFO:tasks.workunit.client.0.smithi063.stdout:5/426: rmdir d7/d10/d2b/d3c/d5a 39 2023-12-12T11:51:55.798 INFO:tasks.workunit.client.0.smithi063.stdout:5/427: fdatasync d7/de/f30 0 2023-12-12T11:51:55.799 INFO:tasks.workunit.client.0.smithi063.stdout:5/428: fdatasync d7/f12 0 2023-12-12T11:51:55.799 INFO:tasks.workunit.client.0.smithi063.stdout:5/429: write d7/d10/d2b/d3c/d63/f7a [154325,48350] 0 2023-12-12T11:51:55.804 INFO:tasks.workunit.client.0.smithi063.stdout:6/451: dwrite d9/d10/f92 [0,4194304] 0 2023-12-12T11:51:55.810 INFO:tasks.workunit.client.0.smithi063.stdout:2/326: sync 2023-12-12T11:51:55.811 INFO:tasks.workunit.client.0.smithi063.stdout:2/327: fdatasync d0/d1a/d3a/f46 0 2023-12-12T11:51:55.811 INFO:tasks.workunit.client.1.smithi093.stdout:2/644: dwrite d5/d14/d2d/d12/f59 [4194304,4194304] 0 2023-12-12T11:51:55.811 INFO:tasks.workunit.client.1.smithi093.stdout:2/645: stat d5/d14/d2d/d12/d44/l78 0 2023-12-12T11:51:55.812 INFO:tasks.workunit.client.1.smithi093.stdout:2/646: chown d5/d14/d47/d4e/dae 396162005 1 2023-12-12T11:51:55.812 INFO:tasks.workunit.client.1.smithi093.stdout:2/647: write d5/d14/d2d/d4c/d54/db9/fd1 [813479,71021] 0 2023-12-12T11:51:55.815 INFO:tasks.workunit.client.0.smithi063.stdout:7/376: rename lc to de/d34/d43/d45/l8c 0 2023-12-12T11:51:55.817 INFO:tasks.workunit.client.0.smithi063.stdout:3/339: sync 2023-12-12T11:51:55.819 INFO:tasks.workunit.client.0.smithi063.stdout:8/471: mknod d4/d24/d38/d45/d5b/d92/d65/c94 0 2023-12-12T11:51:55.820 INFO:tasks.workunit.client.1.smithi093.stdout:2/648: write d5/d14/d2d/d12/f2c [380358,40178] 0 2023-12-12T11:51:55.820 INFO:tasks.workunit.client.1.smithi093.stdout:2/649: fsync d5/fbf 0 2023-12-12T11:51:55.820 INFO:tasks.workunit.client.0.smithi063.stdout:6/452: dread d9/f18 [0,4194304] 0 2023-12-12T11:51:55.820 INFO:tasks.workunit.client.0.smithi063.stdout:6/453: chown d9/d10/f15 12 1 2023-12-12T11:51:55.821 INFO:tasks.workunit.client.0.smithi063.stdout:6/454: dread - d9/d10/d5c/d5e/f6a zero size 2023-12-12T11:51:55.821 INFO:tasks.workunit.client.0.smithi063.stdout:5/430: dread d7/f15 [0,4194304] 0 2023-12-12T11:51:55.822 INFO:tasks.workunit.client.0.smithi063.stdout:1/435: link d3/db/fd d3/db/d16/d24/d48/f8f 0 2023-12-12T11:51:55.823 INFO:tasks.workunit.client.0.smithi063.stdout:1/436: dread - d3/db/d16/d24/d48/f8a zero size 2023-12-12T11:51:55.823 INFO:tasks.workunit.client.0.smithi063.stdout:4/439: dwrite d2/d48/d69/f82 [0,4194304] 0 2023-12-12T11:51:55.823 INFO:tasks.workunit.client.0.smithi063.stdout:4/440: readlink d2/d47/l70 0 2023-12-12T11:51:55.824 INFO:tasks.workunit.client.0.smithi063.stdout:4/441: creat d2/d17/d81/f8c x:0 0 0 2023-12-12T11:51:55.824 INFO:tasks.workunit.client.0.smithi063.stdout:4/442: write d2/f6 [4816210,40698] 0 2023-12-12T11:51:55.824 INFO:tasks.workunit.client.0.smithi063.stdout:4/443: chown d2/d47/l70 358716016 1 2023-12-12T11:51:55.824 INFO:tasks.workunit.client.0.smithi063.stdout:4/444: dread - d2/d17/d7f/f84 zero size 2023-12-12T11:51:55.824 INFO:tasks.workunit.client.1.smithi093.stdout:3/590: dwrite df/d22/f23 [0,4194304] 0 2023-12-12T11:51:55.824 INFO:tasks.workunit.client.1.smithi093.stdout:3/591: stat df/d25/l34 0 2023-12-12T11:51:55.831 INFO:tasks.workunit.client.1.smithi093.stdout:7/577: rmdir da/de/d46/db9 0 2023-12-12T11:51:55.837 INFO:tasks.workunit.client.1.smithi093.stdout:4/831: rename d0/d31/d5c/d6c/da4/dc2/fda to d0/d36/d61/d97/f101 0 2023-12-12T11:51:55.840 INFO:tasks.workunit.client.0.smithi063.stdout:9/340: rmdir d7/d20 39 2023-12-12T11:51:55.840 INFO:tasks.workunit.client.0.smithi063.stdout:9/341: chown d7/d11/d12/f3d 678 1 2023-12-12T11:51:55.842 INFO:tasks.workunit.client.0.smithi063.stdout:7/377: getdents de/d22/d2b/d4a 0 2023-12-12T11:51:55.842 INFO:tasks.workunit.client.0.smithi063.stdout:7/378: stat de/d22/d2b 0 2023-12-12T11:51:55.843 INFO:tasks.workunit.client.1.smithi093.stdout:4/832: dread d0/d87/f8f [0,4194304] 0 2023-12-12T11:51:55.845 INFO:tasks.workunit.client.1.smithi093.stdout:1/599: creat d4/dc/d7a/fc5 x:0 0 0 2023-12-12T11:51:55.849 INFO:tasks.workunit.client.1.smithi093.stdout:5/521: unlink d0/d7/d59/d48/l51 0 2023-12-12T11:51:55.849 INFO:tasks.workunit.client.1.smithi093.stdout:5/522: write d0/d7/d8/d9e/f58 [229460,70840] 0 2023-12-12T11:51:55.849 INFO:tasks.workunit.client.0.smithi063.stdout:8/472: mkdir d4/d24/d38/d45/d5b/d92/d95 0 2023-12-12T11:51:55.850 INFO:tasks.workunit.client.0.smithi063.stdout:8/473: chown d4/de/l2d 9507 1 2023-12-12T11:51:55.853 INFO:tasks.workunit.client.0.smithi063.stdout:6/455: unlink d9/d10/d25/c66 0 2023-12-12T11:51:55.857 INFO:tasks.workunit.client.0.smithi063.stdout:5/431: creat d7/d10/d2b/d3c/d27/f81 x:0 0 0 2023-12-12T11:51:55.865 INFO:tasks.workunit.client.0.smithi063.stdout:3/340: dwrite d4/d23/f24 [0,4194304] 0 2023-12-12T11:51:55.865 INFO:tasks.workunit.client.0.smithi063.stdout:3/341: chown d4/df/d1a/d1c/d3b/d50/d61 816 1 2023-12-12T11:51:55.869 INFO:tasks.workunit.client.1.smithi093.stdout:1/600: dread d4/f25 [0,4194304] 0 2023-12-12T11:51:55.872 INFO:tasks.workunit.client.1.smithi093.stdout:9/607: rmdir d1/d23/d24 39 2023-12-12T11:51:55.872 INFO:tasks.workunit.client.1.smithi093.stdout:9/608: chown d1/d12/d1f/d32/c64 790393554 1 2023-12-12T11:51:55.872 INFO:tasks.workunit.client.1.smithi093.stdout:9/609: write d1/d12/d1f/d32/d42/f6e [514378,78427] 0 2023-12-12T11:51:55.873 INFO:tasks.workunit.client.1.smithi093.stdout:6/744: sync 2023-12-12T11:51:55.875 INFO:tasks.workunit.client.0.smithi063.stdout:9/342: symlink d7/d11/d4b/l6a 0 2023-12-12T11:51:55.876 INFO:tasks.workunit.client.0.smithi063.stdout:7/379: creat de/d34/d68/d89/f8d x:0 0 0 2023-12-12T11:51:55.877 INFO:tasks.workunit.client.0.smithi063.stdout:7/380: creat de/d34/d68/d89/f8e x:0 0 0 2023-12-12T11:51:55.877 INFO:tasks.workunit.client.0.smithi063.stdout:7/381: truncate de/d22/d6e/f83 132451 0 2023-12-12T11:51:55.878 INFO:tasks.workunit.client.1.smithi093.stdout:8/669: getdents d3/d1a/d1f 0 2023-12-12T11:51:55.882 INFO:tasks.workunit.client.1.smithi093.stdout:6/745: dread d0/da/d14/f55 [0,4194304] 0 2023-12-12T11:51:55.885 INFO:tasks.workunit.client.0.smithi063.stdout:2/328: rename d0/d1a/d48/l21 to d0/d1a/d3a/l6c 0 2023-12-12T11:51:55.888 INFO:tasks.workunit.client.1.smithi093.stdout:3/592: mkdir df/d25/d2c/d85/dac/dc2 0 2023-12-12T11:51:55.888 INFO:tasks.workunit.client.0.smithi063.stdout:4/445: dwrite d2/d17/f59 [0,4194304] 0 2023-12-12T11:51:55.889 INFO:tasks.workunit.client.0.smithi063.stdout:4/446: creat d2/d48/d69/f8d x:0 0 0 2023-12-12T11:51:55.889 INFO:tasks.workunit.client.0.smithi063.stdout:4/447: fdatasync d2/d47/f7d 0 2023-12-12T11:51:55.892 INFO:tasks.workunit.client.0.smithi063.stdout:6/456: unlink d9/f18 0 2023-12-12T11:51:55.892 INFO:tasks.workunit.client.0.smithi063.stdout:6/457: truncate d9/d10/d5c/d5e/f6a 304056 0 2023-12-12T11:51:55.894 INFO:tasks.workunit.client.1.smithi093.stdout:2/650: rename d5/d14/d2d/d4c/d54/db9 to d5/d14/d2d/d4c/d54/d67/d69/dde 0 2023-12-12T11:51:55.897 INFO:tasks.workunit.client.0.smithi063.stdout:5/432: symlink d7/d10/d2b/d3c/d27/l82 0 2023-12-12T11:51:55.899 INFO:tasks.workunit.client.1.smithi093.stdout:0/638: rmdir d5/d21/d2f 39 2023-12-12T11:51:55.904 INFO:tasks.workunit.client.0.smithi063.stdout:1/437: rmdir d3/db/d16/d24/d48 39 2023-12-12T11:51:55.907 INFO:tasks.workunit.client.1.smithi093.stdout:4/833: mkdir d0/d31/d5c/d66/d102 0 2023-12-12T11:51:55.910 INFO:tasks.workunit.client.0.smithi063.stdout:3/342: getdents d4/d23/d5d/d4c/d56 0 2023-12-12T11:51:55.915 INFO:tasks.workunit.client.1.smithi093.stdout:5/523: truncate d0/d3b/f63 3671574 0 2023-12-12T11:51:55.921 INFO:tasks.workunit.client.1.smithi093.stdout:1/601: link d4/dc/d7a/d9c/c9d d4/d1a/d73/cc6 0 2023-12-12T11:51:55.922 INFO:tasks.workunit.client.1.smithi093.stdout:1/602: truncate d4/d81/fb1 808669 0 2023-12-12T11:51:55.929 INFO:tasks.workunit.client.1.smithi093.stdout:8/670: mknod d3/d1a/d1f/d29/d3a/d68/cdd 0 2023-12-12T11:51:55.929 INFO:tasks.workunit.client.1.smithi093.stdout:8/671: write d3/d1a/d1f/d59/f6a [133078,73630] 0 2023-12-12T11:51:55.929 INFO:tasks.workunit.client.1.smithi093.stdout:8/672: chown d3/d73/f98 375191 1 2023-12-12T11:51:55.929 INFO:tasks.workunit.client.1.smithi093.stdout:8/673: chown d3/d1a/c78 34110903 1 2023-12-12T11:51:55.929 INFO:tasks.workunit.client.1.smithi093.stdout:8/674: creat d3/d1a/fde x:0 0 0 2023-12-12T11:51:55.930 INFO:tasks.workunit.client.1.smithi093.stdout:3/593: mknod df/d22/d49/d69/d78/daf/d3d/d6f/db1/cc3 0 2023-12-12T11:51:55.932 INFO:tasks.workunit.client.1.smithi093.stdout:1/603: dread d4/d1a/d73/f95 [0,4194304] 0 2023-12-12T11:51:55.934 INFO:tasks.workunit.client.1.smithi093.stdout:7/578: rename da/de/c3a to da/de/d81/ccb 0 2023-12-12T11:51:55.936 INFO:tasks.workunit.client.1.smithi093.stdout:2/651: unlink d5/d14/d2d/d4c/d54/d67/c74 0 2023-12-12T11:51:55.938 INFO:tasks.workunit.client.1.smithi093.stdout:0/639: unlink d5/dd/f35 0 2023-12-12T11:51:55.942 INFO:tasks.workunit.client.1.smithi093.stdout:4/834: rmdir d0/d31/d9d/da0/df4 0 2023-12-12T11:51:55.945 INFO:tasks.workunit.client.0.smithi063.stdout:7/382: creat de/d33/d41/d44/d8b/f8f x:0 0 0 2023-12-12T11:51:55.945 INFO:tasks.workunit.client.0.smithi063.stdout:9/343: dwrite d7/d15/f31 [0,4194304] 0 2023-12-12T11:51:55.947 INFO:tasks.workunit.client.0.smithi063.stdout:2/329: creat d0/d1a/d57/f6d x:0 0 0 2023-12-12T11:51:55.950 INFO:tasks.workunit.client.1.smithi093.stdout:3/594: write df/d30/d33/f3a [4177286,48809] 0 2023-12-12T11:51:55.954 INFO:tasks.workunit.client.1.smithi093.stdout:5/524: creat d0/d7/d59/faf x:0 0 0 2023-12-12T11:51:55.954 INFO:tasks.workunit.client.1.smithi093.stdout:5/525: creat d0/d7/d59/d62/fb0 x:0 0 0 2023-12-12T11:51:55.954 INFO:tasks.workunit.client.1.smithi093.stdout:5/526: readlink d0/d3b/l6f 0 2023-12-12T11:51:55.956 INFO:tasks.workunit.client.0.smithi063.stdout:4/448: dwrite d2/f10 [8388608,4194304] 0 2023-12-12T11:51:55.962 INFO:tasks.workunit.client.0.smithi063.stdout:6/458: unlink d9/d2c/f4d 0 2023-12-12T11:51:55.964 INFO:tasks.workunit.client.1.smithi093.stdout:8/675: mkdir d3/ddf 0 2023-12-12T11:51:55.964 INFO:tasks.workunit.client.1.smithi093.stdout:5/527: dread d0/d7/d36/f2a [0,4194304] 0 2023-12-12T11:51:55.966 INFO:tasks.workunit.client.1.smithi093.stdout:1/604: rmdir d4/d1a 39 2023-12-12T11:51:55.967 INFO:tasks.workunit.client.0.smithi063.stdout:5/433: truncate d7/f12 2899707 0 2023-12-12T11:51:55.969 INFO:tasks.workunit.client.0.smithi063.stdout:9/344: dread d7/d20/f29 [0,4194304] 0 2023-12-12T11:51:55.969 INFO:tasks.workunit.client.0.smithi063.stdout:9/345: stat d7/d20/f29 0 2023-12-12T11:51:55.969 INFO:tasks.workunit.client.0.smithi063.stdout:1/438: creat d3/db/d16/d17/f90 x:0 0 0 2023-12-12T11:51:55.974 INFO:tasks.workunit.client.0.smithi063.stdout:3/343: dwrite d4/df/d1a/f20 [0,4194304] 0 2023-12-12T11:51:55.974 INFO:tasks.workunit.client.0.smithi063.stdout:5/434: dread d7/d10/d2b/d3c/d42/d62/f6c [0,4194304] 0 2023-12-12T11:51:55.976 INFO:tasks.workunit.client.1.smithi093.stdout:8/676: dread d3/d1a/d1f/d29/d3a/d68/d8a/f90 [0,4194304] 0 2023-12-12T11:51:55.979 INFO:tasks.workunit.client.1.smithi093.stdout:6/746: rename d0/da/d32/fa9 to d0/da/d14/f115 0 2023-12-12T11:51:55.984 INFO:tasks.workunit.client.1.smithi093.stdout:7/579: symlink da/de/d46/d4f/lcc 0 2023-12-12T11:51:55.984 INFO:tasks.workunit.client.1.smithi093.stdout:7/580: read da/d2e/f79 [3797501,63953] 0 2023-12-12T11:51:55.984 INFO:tasks.workunit.client.1.smithi093.stdout:7/581: write da/d2e/fa7 [1035682,65050] 0 2023-12-12T11:51:55.985 INFO:tasks.workunit.client.0.smithi063.stdout:2/330: rename d0/d1a/d1e/f55 to d0/d69/f6e 0 2023-12-12T11:51:55.991 INFO:tasks.workunit.client.1.smithi093.stdout:2/652: unlink d5/f6e 0 2023-12-12T11:51:55.992 INFO:tasks.workunit.client.0.smithi063.stdout:4/449: creat d2/d47/d6d/f8e x:0 0 0 2023-12-12T11:51:55.992 INFO:tasks.workunit.client.0.smithi063.stdout:4/450: creat d2/d47/d6d/f8f x:0 0 0 2023-12-12T11:51:55.994 INFO:tasks.workunit.client.1.smithi093.stdout:0/640: link d5/d21/d27/f5d d5/d41/d77/d79/d9b/fc9 0 2023-12-12T11:51:55.994 INFO:tasks.workunit.client.1.smithi093.stdout:0/641: fdatasync d5/dd/d14/d26/d58/d64/f97 0 2023-12-12T11:51:55.995 INFO:tasks.workunit.client.0.smithi063.stdout:0/369: sync 2023-12-12T11:51:55.996 INFO:tasks.workunit.client.0.smithi063.stdout:6/459: mkdir d9/d68/d94 0 2023-12-12T11:51:55.999 INFO:tasks.workunit.client.1.smithi093.stdout:4/835: unlink d0/c6e 0 2023-12-12T11:51:55.999 INFO:tasks.workunit.client.1.smithi093.stdout:4/836: chown d0/d36/f59 1828039 1 2023-12-12T11:51:56.001 INFO:tasks.workunit.client.0.smithi063.stdout:9/346: unlink d7/l24 0 2023-12-12T11:51:56.001 INFO:tasks.workunit.client.0.smithi063.stdout:9/347: chown d7/d11/d12 1734 1 2023-12-12T11:51:56.002 INFO:tasks.workunit.client.1.smithi093.stdout:7/582: dread da/de/d46/f4e [0,4194304] 0 2023-12-12T11:51:56.002 INFO:tasks.workunit.client.1.smithi093.stdout:7/583: chown da/d8e/daa/db3/lb4 0 1 2023-12-12T11:51:56.004 INFO:tasks.workunit.client.0.smithi063.stdout:3/344: getdents d4/df/d1a/d1c/d3b/d52 0 2023-12-12T11:51:56.005 INFO:tasks.workunit.client.1.smithi093.stdout:5/528: dwrite d0/d7/d59/d62/f6e [4194304,4194304] 0 2023-12-12T11:51:56.009 INFO:tasks.workunit.client.0.smithi063.stdout:5/435: unlink d7/d28/d67/f7f 0 2023-12-12T11:51:56.013 INFO:tasks.workunit.client.0.smithi063.stdout:1/439: rename d3/db/d16/d24/d4d/f71 to d3/db/d16/d24/d48/d75/d83/d5b/d6b/f91 0 2023-12-12T11:51:56.015 INFO:tasks.workunit.client.1.smithi093.stdout:0/642: write d5/f13 [2213624,54537] 0 2023-12-12T11:51:56.015 INFO:tasks.workunit.client.1.smithi093.stdout:9/610: write d1/d23/d24/d29/d43/d58/f6c [151447,102906] 0 2023-12-12T11:51:56.015 INFO:tasks.workunit.client.1.smithi093.stdout:5/529: dread d0/d7/f1c [0,4194304] 0 2023-12-12T11:51:56.016 INFO:tasks.workunit.client.1.smithi093.stdout:5/530: dread - d0/d7/d36/d29/d44/f74 zero size 2023-12-12T11:51:56.016 INFO:tasks.workunit.client.1.smithi093.stdout:1/605: mknod d4/d85/cc7 0 2023-12-12T11:51:56.018 INFO:tasks.workunit.client.1.smithi093.stdout:8/677: mkdir d3/d1a/d1f/d50/de0 0 2023-12-12T11:51:56.019 INFO:tasks.workunit.client.0.smithi063.stdout:4/451: truncate d2/d17/d41/f4d 1233811 0 2023-12-12T11:51:56.019 INFO:tasks.workunit.client.0.smithi063.stdout:4/452: readlink d2/d47/l2b 0 2023-12-12T11:51:56.019 INFO:tasks.workunit.client.0.smithi063.stdout:4/453: getdents d2/d47 0 2023-12-12T11:51:56.019 INFO:tasks.workunit.client.0.smithi063.stdout:4/454: stat d2/d17/d81/c8b 0 2023-12-12T11:51:56.019 INFO:tasks.workunit.client.0.smithi063.stdout:4/455: write d2/d8/fa [5638059,121756] 0 2023-12-12T11:51:56.020 INFO:tasks.workunit.client.0.smithi063.stdout:0/370: symlink d0/d7/d27/d19/d2d/d67/l7d 0 2023-12-12T11:51:56.020 INFO:tasks.workunit.client.0.smithi063.stdout:0/371: creat d0/d1a/d23/f7e x:0 0 0 2023-12-12T11:51:56.021 INFO:tasks.workunit.client.1.smithi093.stdout:6/747: symlink d0/da/d32/d9e/l116 0 2023-12-12T11:51:56.022 INFO:tasks.workunit.client.1.smithi093.stdout:6/748: write d0/d52/d7e/f68 [660921,105586] 0 2023-12-12T11:51:56.022 INFO:tasks.workunit.client.1.smithi093.stdout:6/749: fsync d0/d52/d7e/d42/dd5/f109 0 2023-12-12T11:51:56.023 INFO:tasks.workunit.client.0.smithi063.stdout:3/345: unlink d4/df/d1a/d1c/d3b/f3e 0 2023-12-12T11:51:56.024 INFO:tasks.workunit.client.0.smithi063.stdout:3/346: write d4/df/d1a/f2b [1809563,17923] 0 2023-12-12T11:51:56.024 INFO:tasks.workunit.client.0.smithi063.stdout:3/347: stat d4/f2a 0 2023-12-12T11:51:56.026 INFO:tasks.workunit.client.1.smithi093.stdout:2/653: link d5/d14/d47/d4e/c58 d5/d14/d2d/d12/d25/d7a/cdf 0 2023-12-12T11:51:56.028 INFO:tasks.workunit.client.0.smithi063.stdout:5/436: mknod d7/d10/d2b/d3c/d63/c83 0 2023-12-12T11:51:56.028 INFO:tasks.workunit.client.0.smithi063.stdout:5/437: creat d7/de/f84 x:0 0 0 2023-12-12T11:51:56.033 INFO:tasks.workunit.client.0.smithi063.stdout:6/460: rename l3 to d9/d2c/d61/l95 0 2023-12-12T11:51:56.034 INFO:tasks.workunit.client.1.smithi093.stdout:4/837: unlink d0/d87/d79/db2/cfe 0 2023-12-12T11:51:56.034 INFO:tasks.workunit.client.1.smithi093.stdout:4/838: truncate d0/d87/d79/d7f/f100 776876 0 2023-12-12T11:51:56.034 INFO:tasks.workunit.client.1.smithi093.stdout:5/531: dread d0/d7/d59/f2d [0,4194304] 0 2023-12-12T11:51:56.034 INFO:tasks.workunit.client.1.smithi093.stdout:4/839: write d0/d36/d61/d97/f101 [74681,29304] 0 2023-12-12T11:51:56.038 INFO:tasks.workunit.client.0.smithi063.stdout:4/456: mkdir d2/d8/d76/d90 0 2023-12-12T11:51:56.038 INFO:tasks.workunit.client.0.smithi063.stdout:4/457: dread - d2/d17/d81/f8a zero size 2023-12-12T11:51:56.042 INFO:tasks.workunit.client.1.smithi093.stdout:3/595: getdents df/d30/d33 0 2023-12-12T11:51:56.043 INFO:tasks.workunit.client.1.smithi093.stdout:5/532: dread d0/d3b/d66/f7d [4194304,4194304] 0 2023-12-12T11:51:56.043 INFO:tasks.workunit.client.1.smithi093.stdout:5/533: chown d0/d7/d8/f37 2206554 1 2023-12-12T11:51:56.049 INFO:tasks.workunit.client.1.smithi093.stdout:0/643: mkdir d5/d21/d27/dca 0 2023-12-12T11:51:56.051 INFO:tasks.workunit.client.0.smithi063.stdout:1/440: write d3/db/d16/d24/d48/d75/f86 [452563,32608] 0 2023-12-12T11:51:56.055 INFO:tasks.workunit.client.0.smithi063.stdout:3/348: mknod d4/d23/d5d/d4c/d69/c72 0 2023-12-12T11:51:56.061 INFO:tasks.workunit.client.1.smithi093.stdout:1/606: mkdir d4/d1a/d1b/d26/d65/dc8 0 2023-12-12T11:51:56.061 INFO:tasks.workunit.client.1.smithi093.stdout:1/607: dread - d4/d1a/f24 zero size 2023-12-12T11:51:56.061 INFO:tasks.workunit.client.0.smithi063.stdout:9/348: write d7/d11/d12/d30/f52 [3764798,102018] 0 2023-12-12T11:51:56.067 INFO:tasks.workunit.client.1.smithi093.stdout:8/678: creat d3/d1a/d1f/d29/d3a/da0/fe1 x:0 0 0 2023-12-12T11:51:56.071 INFO:tasks.workunit.client.0.smithi063.stdout:5/438: getdents d7/d28/d43 0 2023-12-12T11:51:56.073 INFO:tasks.workunit.client.0.smithi063.stdout:6/461: stat d9/d10/l2e 0 2023-12-12T11:51:56.077 INFO:tasks.workunit.client.0.smithi063.stdout:0/372: dwrite d0/d1a/d23/d34/f52 [4194304,4194304] 0 2023-12-12T11:51:56.078 INFO:tasks.workunit.client.0.smithi063.stdout:0/373: write d0/d1a/d23/d2e/f5a [98357,126838] 0 2023-12-12T11:51:56.078 INFO:tasks.workunit.client.1.smithi093.stdout:7/584: rename da/d15/c63 to da/d15/d19/d4c/dc1/ccd 0 2023-12-12T11:51:56.078 INFO:tasks.workunit.client.1.smithi093.stdout:7/585: chown da/de/d46/d4f/lc4 454 1 2023-12-12T11:51:56.080 INFO:tasks.workunit.client.0.smithi063.stdout:2/331: dwrite d0/d1a/d48/f3d [0,4194304] 0 2023-12-12T11:51:56.080 INFO:tasks.workunit.client.0.smithi063.stdout:2/332: readlink d0/d1a/l5e 0 2023-12-12T11:51:56.082 INFO:tasks.workunit.client.0.smithi063.stdout:4/458: creat d2/d17/d4e/f91 x:0 0 0 2023-12-12T11:51:56.083 INFO:tasks.workunit.client.1.smithi093.stdout:3/596: getdents df/d25/d2c/d85/dac 0 2023-12-12T11:51:56.083 INFO:tasks.workunit.client.1.smithi093.stdout:3/597: truncate df/d22/d49/d69/d78/f7d 9028501 0 2023-12-12T11:51:56.083 INFO:tasks.workunit.client.1.smithi093.stdout:3/598: chown df/f10 7 1 2023-12-12T11:51:56.083 INFO:tasks.workunit.client.1.smithi093.stdout:6/750: dwrite d0/d52/fd9 [0,4194304] 0 2023-12-12T11:51:56.083 INFO:tasks.workunit.client.1.smithi093.stdout:6/751: read - d0/da/fcb zero size 2023-12-12T11:51:56.085 INFO:tasks.workunit.client.0.smithi063.stdout:1/441: link d3/db/d16/d17/l14 d3/d3a/d54/l92 0 2023-12-12T11:51:56.085 INFO:tasks.workunit.client.0.smithi063.stdout:1/442: readlink d3/db/d16/d17/l59 0 2023-12-12T11:51:56.088 INFO:tasks.workunit.client.1.smithi093.stdout:5/534: creat d0/d7/d8/d9e/dad/fb1 x:0 0 0 2023-12-12T11:51:56.088 INFO:tasks.workunit.client.0.smithi063.stdout:9/349: read d7/d11/d12/d30/f48 [3779879,32416] 0 2023-12-12T11:51:56.090 INFO:tasks.workunit.client.0.smithi063.stdout:3/349: symlink d4/df/d1a/d1c/d3b/d50/d61/l73 0 2023-12-12T11:51:56.090 INFO:tasks.workunit.client.1.smithi093.stdout:7/586: dread da/f8a [0,4194304] 0 2023-12-12T11:51:56.090 INFO:tasks.workunit.client.0.smithi063.stdout:3/350: write f0 [7381819,85576] 0 2023-12-12T11:51:56.091 INFO:tasks.workunit.client.0.smithi063.stdout:1/443: write d3/db/d16/d24/d48/d75/d83/d5b/f64 [1072540,84858] 0 2023-12-12T11:51:56.092 INFO:tasks.workunit.client.0.smithi063.stdout:1/444: read - d3/db/d16/d24/d48/f6a zero size 2023-12-12T11:51:56.093 INFO:tasks.workunit.client.1.smithi093.stdout:0/644: mknod d5/dd/d14/d26/d58/d64/ccb 0 2023-12-12T11:51:56.093 INFO:tasks.workunit.client.1.smithi093.stdout:0/645: chown d5/d78 217 1 2023-12-12T11:51:56.093 INFO:tasks.workunit.client.1.smithi093.stdout:0/646: chown d5/dd/d33/f46 2008883 1 2023-12-12T11:51:56.093 INFO:tasks.workunit.client.1.smithi093.stdout:0/647: chown d5/d21/d27 4691918 1 2023-12-12T11:51:56.096 INFO:tasks.workunit.client.0.smithi063.stdout:5/439: creat d7/d10/d2b/f85 x:0 0 0 2023-12-12T11:51:56.100 INFO:tasks.workunit.client.1.smithi093.stdout:2/654: dwrite d5/d14/d2d/d12/d25/f29 [0,4194304] 0 2023-12-12T11:51:56.100 INFO:tasks.workunit.client.1.smithi093.stdout:2/655: chown d5/d31/f64 544339 1 2023-12-12T11:51:56.100 INFO:tasks.workunit.client.1.smithi093.stdout:8/679: creat d3/d1a/d1f/d29/d3a/d40/dbf/fe2 x:0 0 0 2023-12-12T11:51:56.100 INFO:tasks.workunit.client.1.smithi093.stdout:8/680: chown d3/d1a/f83 233386831 1 2023-12-12T11:51:56.100 INFO:tasks.workunit.client.1.smithi093.stdout:8/681: fsync d3/d1a/d1f/d29/d3a/d40/f62 0 2023-12-12T11:51:56.101 INFO:tasks.workunit.client.0.smithi063.stdout:6/462: truncate f4 3418905 0 2023-12-12T11:51:56.101 INFO:tasks.workunit.client.0.smithi063.stdout:6/463: fsync d9/fc 0 2023-12-12T11:51:56.101 INFO:tasks.workunit.client.0.smithi063.stdout:6/464: creat d9/d10/f96 x:0 0 0 2023-12-12T11:51:56.101 INFO:tasks.workunit.client.0.smithi063.stdout:6/465: creat d9/d2c/d61/f97 x:0 0 0 2023-12-12T11:51:56.101 INFO:tasks.workunit.client.0.smithi063.stdout:0/374: mknod d0/d7/d27/d1f/c7f 0 2023-12-12T11:51:56.103 INFO:tasks.workunit.client.0.smithi063.stdout:2/333: getdents d0/d69 0 2023-12-12T11:51:56.104 INFO:tasks.workunit.client.0.smithi063.stdout:2/334: write d0/d1a/d48/f3f [6219928,74070] 0 2023-12-12T11:51:56.104 INFO:tasks.workunit.client.0.smithi063.stdout:2/335: creat d0/d1a/d57/f6f x:0 0 0 2023-12-12T11:51:56.105 INFO:tasks.workunit.client.0.smithi063.stdout:4/459: rename d2/d17/d41/l6a to d2/d17/l92 0 2023-12-12T11:51:56.106 INFO:tasks.workunit.client.0.smithi063.stdout:4/460: chown d2/c4c 149 1 2023-12-12T11:51:56.106 INFO:tasks.workunit.client.1.smithi093.stdout:4/840: dwrite d0/d36/f39 [0,4194304] 0 2023-12-12T11:51:56.106 INFO:tasks.workunit.client.1.smithi093.stdout:4/841: fsync d0/d31/d5c/d66/f84 0 2023-12-12T11:51:56.108 INFO:tasks.workunit.client.0.smithi063.stdout:9/350: creat d7/d20/d3f/d40/d4e/f6b x:0 0 0 2023-12-12T11:51:56.109 INFO:tasks.workunit.client.1.smithi093.stdout:1/608: dwrite d4/dc/d7a/d9c/da7/fc3 [0,4194304] 0 2023-12-12T11:51:56.109 INFO:tasks.workunit.client.1.smithi093.stdout:3/599: truncate df/d22/d49/d69/d78/daf/d3d/d59/d72/f87 1421388 0 2023-12-12T11:51:56.113 INFO:tasks.workunit.client.1.smithi093.stdout:6/752: creat d0/da/d14/d38/d69/f117 x:0 0 0 2023-12-12T11:51:56.113 INFO:tasks.workunit.client.1.smithi093.stdout:5/535: dread d0/d7/d59/d48/f81 [0,4194304] 0 2023-12-12T11:51:56.113 INFO:tasks.workunit.client.1.smithi093.stdout:5/536: chown d0/d3b/d66 801 1 2023-12-12T11:51:56.113 INFO:tasks.workunit.client.0.smithi063.stdout:5/440: creat d7/d10/d2b/d3c/f86 x:0 0 0 2023-12-12T11:51:56.114 INFO:tasks.workunit.client.1.smithi093.stdout:7/587: mkdir da/d15/d19/d4c/dc1/dce 0 2023-12-12T11:51:56.119 INFO:tasks.workunit.client.1.smithi093.stdout:0/648: unlink d5/f66 0 2023-12-12T11:51:56.119 INFO:tasks.workunit.client.1.smithi093.stdout:0/649: write d5/dd/d62/f83 [4773703,16076] 0 2023-12-12T11:51:56.120 INFO:tasks.workunit.client.1.smithi093.stdout:2/656: symlink d5/d14/d2d/d4c/d54/dc5/d61/le0 0 2023-12-12T11:51:56.125 INFO:tasks.workunit.client.1.smithi093.stdout:8/682: mkdir d3/d1a/d1f/d75/de3 0 2023-12-12T11:51:56.132 INFO:tasks.workunit.client.0.smithi063.stdout:6/466: creat d9/d10/d73/f98 x:0 0 0 2023-12-12T11:51:56.136 INFO:tasks.workunit.client.0.smithi063.stdout:0/375: link d0/d7/d27/f29 d0/d1a/d23/d34/d42/f80 0 2023-12-12T11:51:56.143 INFO:tasks.workunit.client.0.smithi063.stdout:2/336: creat d0/d1a/d1e/f70 x:0 0 0 2023-12-12T11:51:56.145 INFO:tasks.workunit.client.0.smithi063.stdout:4/461: rmdir d2/d17 39 2023-12-12T11:51:56.154 INFO:tasks.workunit.client.0.smithi063.stdout:4/462: dread d2/d17/d41/f52 [0,4194304] 0 2023-12-12T11:51:56.154 INFO:tasks.workunit.client.0.smithi063.stdout:4/463: truncate d2/f56 5239987 0 2023-12-12T11:51:56.161 INFO:tasks.workunit.client.1.smithi093.stdout:4/842: mkdir d0/d36/d61/d97/d103 0 2023-12-12T11:51:56.162 INFO:tasks.workunit.client.0.smithi063.stdout:2/337: dread d0/d1a/d48/f34 [0,4194304] 0 2023-12-12T11:51:56.167 INFO:tasks.workunit.client.0.smithi063.stdout:9/351: mknod d7/d20/d3f/d40/d4e/c6c 0 2023-12-12T11:51:56.168 INFO:tasks.workunit.client.1.smithi093.stdout:1/609: creat d4/d1a/d1b/d26/fc9 x:0 0 0 2023-12-12T11:51:56.169 INFO:tasks.workunit.client.1.smithi093.stdout:6/753: dwrite d0/da/d14/d3a/ff8 [0,4194304] 0 2023-12-12T11:51:56.172 INFO:tasks.workunit.client.1.smithi093.stdout:3/600: symlink df/d22/d49/d69/d78/db9/dbe/lc4 0 2023-12-12T11:51:56.174 INFO:tasks.workunit.client.1.smithi093.stdout:2/657: dwrite d5/d14/f4f [0,4194304] 0 2023-12-12T11:51:56.175 INFO:tasks.workunit.client.1.smithi093.stdout:5/537: creat d0/d7/d85/fb2 x:0 0 0 2023-12-12T11:51:56.178 INFO:tasks.workunit.client.0.smithi063.stdout:3/351: rmdir d4/df/d1a/d1c/d3b 39 2023-12-12T11:51:56.179 INFO:tasks.workunit.client.1.smithi093.stdout:0/650: creat d5/d78/da4/fcc x:0 0 0 2023-12-12T11:51:56.179 INFO:tasks.workunit.client.1.smithi093.stdout:0/651: chown d5/dd/d62/c7f 2512 1 2023-12-12T11:51:56.179 INFO:tasks.workunit.client.1.smithi093.stdout:0/652: creat d5/d41/fcd x:0 0 0 2023-12-12T11:51:56.179 INFO:tasks.workunit.client.1.smithi093.stdout:0/653: getdents d5/d21/d2f/d54/d7e/db4 0 2023-12-12T11:51:56.180 INFO:tasks.workunit.client.1.smithi093.stdout:8/683: creat d3/d8/fe4 x:0 0 0 2023-12-12T11:51:56.187 INFO:tasks.workunit.client.0.smithi063.stdout:6/467: link d9/d10/d5c/c7c d9/d10/d25/c99 0 2023-12-12T11:51:56.197 INFO:tasks.workunit.client.0.smithi063.stdout:0/376: creat d0/d7/d27/f81 x:0 0 0 2023-12-12T11:51:56.215 INFO:tasks.workunit.client.1.smithi093.stdout:4/843: dwrite d0/d36/f70 [0,4194304] 0 2023-12-12T11:51:56.215 INFO:tasks.workunit.client.1.smithi093.stdout:4/844: fdatasync d0/d87/d79/d96/db5/ddd/fee 0 2023-12-12T11:51:56.215 INFO:tasks.workunit.client.1.smithi093.stdout:4/845: creat d0/d31/d5c/d6c/da4/dc2/f104 x:0 0 0 2023-12-12T11:51:56.220 INFO:tasks.workunit.client.0.smithi063.stdout:4/464: mknod d2/d48/d4f/c93 0 2023-12-12T11:51:56.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:55 smithi093 ceph-mon[115914]: pgmap v12: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 202 MiB/s rd, 256 MiB/s wr, 388 op/s 2023-12-12T11:51:56.223 INFO:tasks.workunit.client.0.smithi063.stdout:2/338: getdents d0/d1a/d48/d56 0 2023-12-12T11:51:56.223 INFO:tasks.workunit.client.1.smithi093.stdout:4/846: dread d0/f91 [0,4194304] 0 2023-12-12T11:51:56.227 INFO:tasks.workunit.client.0.smithi063.stdout:3/352: mkdir d4/df/d1a/d1c/d3b/d52/d74 0 2023-12-12T11:51:56.227 INFO:tasks.workunit.client.0.smithi063.stdout:3/353: write d4/df/d1a/d1c/d34/f6a [802365,83610] 0 2023-12-12T11:51:56.229 INFO:tasks.workunit.client.1.smithi093.stdout:1/610: dwrite d4/d1a/d1b/d26/f4d [0,4194304] 0 2023-12-12T11:51:56.233 INFO:tasks.workunit.client.0.smithi063.stdout:9/352: dwrite d7/d20/d45/d46/d51/f5d [0,4194304] 0 2023-12-12T11:51:56.236 INFO:tasks.workunit.client.0.smithi063.stdout:5/441: rmdir d7/d10/d2b/d3c/d63 39 2023-12-12T11:51:56.237 INFO:tasks.workunit.client.0.smithi063.stdout:8/474: sync 2023-12-12T11:51:56.237 INFO:tasks.workunit.client.0.smithi063.stdout:8/475: truncate d4/d24/f5f 829100 0 2023-12-12T11:51:56.241 INFO:tasks.workunit.client.1.smithi093.stdout:2/658: dwrite d5/d31/f77 [0,4194304] 0 2023-12-12T11:51:56.241 INFO:tasks.workunit.client.1.smithi093.stdout:2/659: write d5/d14/d2d/d4c/d54/d67/d69/f8f [493035,72046] 0 2023-12-12T11:51:56.241 INFO:tasks.workunit.client.1.smithi093.stdout:2/660: readlink d5/d14/d2d/d12/d44/l4b 0 2023-12-12T11:51:56.241 INFO:tasks.workunit.client.1.smithi093.stdout:2/661: readlink d5/d14/d2d/l24 0 2023-12-12T11:51:56.250 INFO:tasks.workunit.client.0.smithi063.stdout:6/468: creat d9/d2c/d6b/d8a/f9a x:0 0 0 2023-12-12T11:51:56.250 INFO:tasks.workunit.client.0.smithi063.stdout:4/465: mknod d2/d17/c94 0 2023-12-12T11:51:56.250 INFO:tasks.workunit.client.0.smithi063.stdout:4/466: creat d2/d48/d69/f95 x:0 0 0 2023-12-12T11:51:56.250 INFO:tasks.workunit.client.0.smithi063.stdout:4/467: write d2/d47/f53 [243932,61381] 0 2023-12-12T11:51:56.251 INFO:tasks.workunit.client.1.smithi093.stdout:9/611: rename d1/d12 to d1/d23/d24/d29/d43/d56/d85/dc3/dce 0 2023-12-12T11:51:56.261 INFO:tasks.workunit.client.1.smithi093.stdout:3/601: creat df/d22/d49/d69/d78/daf/d3d/fc5 x:0 0 0 2023-12-12T11:51:56.262 INFO:tasks.workunit.client.0.smithi063.stdout:0/377: dwrite d0/d1a/d23/d34/f58 [0,4194304] 0 2023-12-12T11:51:56.264 INFO:tasks.workunit.client.1.smithi093.stdout:5/538: creat d0/d7/d8/d9e/d6a/fb3 x:0 0 0 2023-12-12T11:51:56.264 INFO:tasks.workunit.client.0.smithi063.stdout:0/378: write d0/f65 [229560,93813] 0 2023-12-12T11:51:56.265 INFO:tasks.workunit.client.0.smithi063.stdout:4/468: symlink d2/d17/d7f/l96 0 2023-12-12T11:51:56.265 INFO:tasks.workunit.client.0.smithi063.stdout:4/469: write d2/d8/f49 [6346876,16933] 0 2023-12-12T11:51:56.265 INFO:tasks.workunit.client.1.smithi093.stdout:8/684: dwrite d3/d1a/d1f/d59/f6a [0,4194304] 0 2023-12-12T11:51:56.276 INFO:tasks.workunit.client.1.smithi093.stdout:0/654: truncate d5/dd/d14/d26/f8e 940003 0 2023-12-12T11:51:56.282 INFO:tasks.workunit.client.0.smithi063.stdout:2/339: rename d0/d41/l54 to d0/d1a/d1e/l71 0 2023-12-12T11:51:56.282 INFO:tasks.workunit.client.0.smithi063.stdout:8/476: dread d4/de/f43 [0,4194304] 0 2023-12-12T11:51:56.283 INFO:tasks.workunit.client.0.smithi063.stdout:0/379: creat d0/d7/d27/d19/d2d/f82 x:0 0 0 2023-12-12T11:51:56.283 INFO:tasks.workunit.client.0.smithi063.stdout:0/380: stat d0/d7/d27/f81 0 2023-12-12T11:51:56.283 INFO:tasks.workunit.client.0.smithi063.stdout:8/477: chown d4/d24/d38/d45/c67 1866124 1 2023-12-12T11:51:56.284 INFO:tasks.workunit.client.1.smithi093.stdout:4/847: creat d0/d31/d5c/f105 x:0 0 0 2023-12-12T11:51:56.284 INFO:tasks.workunit.client.1.smithi093.stdout:4/848: readlink d0/d31/l73 0 2023-12-12T11:51:56.284 INFO:tasks.workunit.client.1.smithi093.stdout:4/849: stat d0/l71 0 2023-12-12T11:51:56.292 INFO:tasks.workunit.client.0.smithi063.stdout:3/354: dread d4/f15 [0,4194304] 0 2023-12-12T11:51:56.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:55 smithi063 ceph-mon[107117]: pgmap v12: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 202 MiB/s rd, 256 MiB/s wr, 388 op/s 2023-12-12T11:51:56.301 INFO:tasks.workunit.client.0.smithi063.stdout:4/470: write d2/d8/f49 [679751,17584] 0 2023-12-12T11:51:56.301 INFO:tasks.workunit.client.0.smithi063.stdout:4/471: write d2/d17/d41/f52 [1200732,16697] 0 2023-12-12T11:51:56.301 INFO:tasks.workunit.client.0.smithi063.stdout:4/472: truncate d2/d47/f7d 559246 0 2023-12-12T11:51:56.301 INFO:tasks.workunit.client.0.smithi063.stdout:4/473: write d2/f40 [1380500,21337] 0 2023-12-12T11:51:56.305 INFO:tasks.workunit.client.0.smithi063.stdout:8/478: dread d4/d24/f5f [0,4194304] 0 2023-12-12T11:51:56.307 INFO:tasks.workunit.client.0.smithi063.stdout:9/353: rename d7/d20/d45/d46/d51/f5e to d7/d11/d4b/f6d 0 2023-12-12T11:51:56.311 INFO:tasks.workunit.client.0.smithi063.stdout:5/442: dwrite d7/f26 [0,4194304] 0 2023-12-12T11:51:56.317 INFO:tasks.workunit.client.1.smithi093.stdout:3/602: dwrite df/d22/d49/d69/d78/daf/d3d/d6f/f4b [0,4194304] 0 2023-12-12T11:51:56.319 INFO:tasks.workunit.client.1.smithi093.stdout:1/611: symlink d4/d1a/d83/d9a/da9/lca 0 2023-12-12T11:51:56.323 INFO:tasks.workunit.client.1.smithi093.stdout:2/662: symlink d5/d14/d2d/le1 0 2023-12-12T11:51:56.324 INFO:tasks.workunit.client.0.smithi063.stdout:4/474: rmdir d2/d48/d4f 39 2023-12-12T11:51:56.326 INFO:tasks.workunit.client.1.smithi093.stdout:8/685: dwrite d3/d1a/d1f/d29/d30/fd2 [0,4194304] 0 2023-12-12T11:51:56.328 INFO:tasks.workunit.client.0.smithi063.stdout:4/475: write d2/f58 [1079238,40183] 0 2023-12-12T11:51:56.328 INFO:tasks.workunit.client.0.smithi063.stdout:3/355: dread d4/df/d1a/f20 [0,4194304] 0 2023-12-12T11:51:56.337 INFO:tasks.workunit.client.1.smithi093.stdout:9/612: creat d1/d23/d24/d29/d43/fcf x:0 0 0 2023-12-12T11:51:56.342 INFO:tasks.workunit.client.0.smithi063.stdout:9/354: mknod d7/d20/c6e 0 2023-12-12T11:51:56.343 INFO:tasks.workunit.client.1.smithi093.stdout:4/850: dwrite d0/d36/fbb [0,4194304] 0 2023-12-12T11:51:56.350 INFO:tasks.workunit.client.0.smithi063.stdout:4/476: dread d2/d17/d41/f4d [0,4194304] 0 2023-12-12T11:51:56.354 INFO:tasks.workunit.client.0.smithi063.stdout:8/479: dread f1 [0,4194304] 0 2023-12-12T11:51:56.358 INFO:tasks.workunit.client.1.smithi093.stdout:6/754: rmdir d0/da/d14/d38 39 2023-12-12T11:51:56.358 INFO:tasks.workunit.client.1.smithi093.stdout:6/755: stat d0/da/d14/d21/c78 0 2023-12-12T11:51:56.361 INFO:tasks.workunit.client.0.smithi063.stdout:6/469: dwrite d9/f4b [0,4194304] 0 2023-12-12T11:51:56.361 INFO:tasks.workunit.client.0.smithi063.stdout:6/470: write d9/d2c/f39 [70402,109712] 0 2023-12-12T11:51:56.361 INFO:tasks.workunit.client.0.smithi063.stdout:6/471: creat d9/d2c/d6b/f9b x:0 0 0 2023-12-12T11:51:56.361 INFO:tasks.workunit.client.0.smithi063.stdout:6/472: stat d9/d10/d5c/d5e/c76 0 2023-12-12T11:51:56.361 INFO:tasks.workunit.client.0.smithi063.stdout:6/473: chown d9/d2c/c3a 1 1 2023-12-12T11:51:56.364 INFO:tasks.workunit.client.1.smithi093.stdout:7/588: sync 2023-12-12T11:51:56.364 INFO:tasks.workunit.client.1.smithi093.stdout:5/539: rename d0/d7/d8/d9e/f58 to d0/d7/d59/d48/fb4 0 2023-12-12T11:51:56.368 INFO:tasks.workunit.client.0.smithi063.stdout:3/356: rename d4/d23/c4e to d4/d23/d5d/d62/c75 0 2023-12-12T11:51:56.373 INFO:tasks.workunit.client.0.smithi063.stdout:4/477: truncate d2/d8/f26 2513135 0 2023-12-12T11:51:56.374 INFO:tasks.workunit.client.1.smithi093.stdout:0/655: symlink d5/d21/d2f/lce 0 2023-12-12T11:51:56.378 INFO:tasks.workunit.client.1.smithi093.stdout:1/612: mknod d4/d1a/d1b/d26/d65/d6f/db3/ccb 0 2023-12-12T11:51:56.379 INFO:tasks.workunit.client.1.smithi093.stdout:1/613: write d4/f25 [4202541,42666] 0 2023-12-12T11:51:56.379 INFO:tasks.workunit.client.1.smithi093.stdout:1/614: write d4/d1a/f5f [834913,127956] 0 2023-12-12T11:51:56.380 INFO:tasks.workunit.client.0.smithi063.stdout:2/340: dwrite d0/d1a/d1e/f70 [0,4194304] 0 2023-12-12T11:51:56.380 INFO:tasks.workunit.client.0.smithi063.stdout:0/381: dwrite d0/d1a/d66/f6f [0,4194304] 0 2023-12-12T11:51:56.380 INFO:tasks.workunit.client.1.smithi093.stdout:2/663: mkdir d5/d14/d47/de2 0 2023-12-12T11:51:56.381 INFO:tasks.workunit.client.1.smithi093.stdout:3/603: dwrite df/f2e [0,4194304] 0 2023-12-12T11:51:56.381 INFO:tasks.workunit.client.0.smithi063.stdout:5/443: dwrite d7/ff [0,4194304] 0 2023-12-12T11:51:56.381 INFO:tasks.workunit.client.0.smithi063.stdout:5/444: truncate d7/d10/d2b/f4b 112561 0 2023-12-12T11:51:56.381 INFO:tasks.workunit.client.0.smithi063.stdout:5/445: creat d7/d28/d67/f87 x:0 0 0 2023-12-12T11:51:56.382 INFO:tasks.workunit.client.1.smithi093.stdout:7/589: read da/d8e/f9e [1337116,88792] 0 2023-12-12T11:51:56.383 INFO:tasks.workunit.client.1.smithi093.stdout:7/590: truncate da/de/fb1 1337681 0 2023-12-12T11:51:56.383 INFO:tasks.workunit.client.1.smithi093.stdout:7/591: write da/d15/d19/d90/f87 [3342255,19794] 0 2023-12-12T11:51:56.388 INFO:tasks.workunit.client.1.smithi093.stdout:8/686: mknod d3/d1a/d1f/d75/ce5 0 2023-12-12T11:51:56.388 INFO:tasks.workunit.client.1.smithi093.stdout:8/687: chown d3/d1a/d1f/d29/d3a/d68/cdd 55101492 1 2023-12-12T11:51:56.389 INFO:tasks.workunit.client.1.smithi093.stdout:8/688: creat d3/d8/d88/dc5/fe6 x:0 0 0 2023-12-12T11:51:56.395 INFO:tasks.workunit.client.0.smithi063.stdout:4/478: fsync d2/d8/f26 0 2023-12-12T11:51:56.395 INFO:tasks.workunit.client.0.smithi063.stdout:4/479: chown d2/d47/f46 1 1 2023-12-12T11:51:56.395 INFO:tasks.workunit.client.0.smithi063.stdout:4/480: chown d2/d47 237272477 1 2023-12-12T11:51:56.395 INFO:tasks.workunit.client.0.smithi063.stdout:4/481: dread - d2/d48/f6e zero size 2023-12-12T11:51:56.397 INFO:tasks.workunit.client.1.smithi093.stdout:2/664: write d5/d14/d2d/d12/d25/f29 [4053474,36651] 0 2023-12-12T11:51:56.397 INFO:tasks.workunit.client.1.smithi093.stdout:4/851: mknod d0/d31/d9d/c106 0 2023-12-12T11:51:56.401 INFO:tasks.workunit.client.1.smithi093.stdout:5/540: mkdir d0/d3b/d66/d7c/db5 0 2023-12-12T11:51:56.401 INFO:tasks.workunit.client.1.smithi093.stdout:5/541: write d0/d7/d8/d9e/d6a/fb3 [605534,31939] 0 2023-12-12T11:51:56.402 INFO:tasks.workunit.client.1.smithi093.stdout:6/756: dwrite d0/da/d14/f115 [0,4194304] 0 2023-12-12T11:51:56.406 INFO:tasks.workunit.client.1.smithi093.stdout:9/613: rename d1/c17 to d1/d23/d24/d29/d43/d56/d85/dc3/cd0 0 2023-12-12T11:51:56.406 INFO:tasks.workunit.client.1.smithi093.stdout:9/614: write d1/f65 [673621,77951] 0 2023-12-12T11:51:56.406 INFO:tasks.workunit.client.1.smithi093.stdout:0/656: truncate d5/d41/d77/d79/d9b/f9e 889348 0 2023-12-12T11:51:56.406 INFO:tasks.workunit.client.1.smithi093.stdout:9/615: write d1/d23/d24/d29/d43/d56/d68/fbe [472698,103587] 0 2023-12-12T11:51:56.407 INFO:tasks.workunit.client.1.smithi093.stdout:9/616: chown d1/d23/f40 3520 1 2023-12-12T11:51:56.408 INFO:tasks.workunit.client.1.smithi093.stdout:3/604: mkdir df/dc6 0 2023-12-12T11:51:56.412 INFO:tasks.workunit.client.1.smithi093.stdout:7/592: creat da/d8e/daa/fcf x:0 0 0 2023-12-12T11:51:56.412 INFO:tasks.workunit.client.1.smithi093.stdout:7/593: rename da/d15/d19 to da/d15/d19/d4c/d6d/dd0 22 2023-12-12T11:51:56.414 INFO:tasks.workunit.client.0.smithi063.stdout:8/480: rename d4/de/d3b/d62/d6e/f60 to d4/d24/f96 0 2023-12-12T11:51:56.414 INFO:tasks.workunit.client.0.smithi063.stdout:8/481: stat d4/de/d3b/d62/d36/d57/d84 0 2023-12-12T11:51:56.414 INFO:tasks.workunit.client.0.smithi063.stdout:8/482: stat d4/de/d3b/d62/f86 0 2023-12-12T11:51:56.417 INFO:tasks.workunit.client.0.smithi063.stdout:3/357: creat d4/f76 x:0 0 0 2023-12-12T11:51:56.417 INFO:tasks.workunit.client.1.smithi093.stdout:5/542: write d0/d7/f99 [2863262,120024] 0 2023-12-12T11:51:56.418 INFO:tasks.workunit.client.1.smithi093.stdout:8/689: mknod d3/d8/d88/dc5/ce7 0 2023-12-12T11:51:56.420 INFO:tasks.workunit.client.0.smithi063.stdout:9/355: getdents d7/d20/d3f/d40/d4e 0 2023-12-12T11:51:56.424 INFO:tasks.workunit.client.1.smithi093.stdout:6/757: dread d0/d52/d7e/faf [0,4194304] 0 2023-12-12T11:51:56.426 INFO:tasks.workunit.client.1.smithi093.stdout:8/690: write d3/f80 [501553,78249] 0 2023-12-12T11:51:56.426 INFO:tasks.workunit.client.1.smithi093.stdout:3/605: dread df/d22/d49/d69/d78/daf/f63 [0,4194304] 0 2023-12-12T11:51:56.426 INFO:tasks.workunit.client.1.smithi093.stdout:3/606: chown df/d22 0 1 2023-12-12T11:51:56.426 INFO:tasks.workunit.client.1.smithi093.stdout:3/607: write df/f43 [1577339,111844] 0 2023-12-12T11:51:56.429 INFO:tasks.workunit.client.1.smithi093.stdout:2/665: mknod d5/d14/d2d/d12/d25/d7a/d7e/ce3 0 2023-12-12T11:51:56.431 INFO:tasks.workunit.client.0.smithi063.stdout:1/445: sync 2023-12-12T11:51:56.431 INFO:tasks.workunit.client.0.smithi063.stdout:7/383: sync 2023-12-12T11:51:56.431 INFO:tasks.workunit.client.1.smithi093.stdout:4/852: creat d0/d36/d40/f107 x:0 0 0 2023-12-12T11:51:56.433 INFO:tasks.workunit.client.0.smithi063.stdout:1/446: read d3/db/d16/d17/f55 [1233741,102089] 0 2023-12-12T11:51:56.433 INFO:tasks.workunit.client.0.smithi063.stdout:5/446: dwrite d7/d10/f1b [0,4194304] 0 2023-12-12T11:51:56.439 INFO:tasks.workunit.client.1.smithi093.stdout:0/657: symlink d5/d21/d2f/d54/d7e/lcf 0 2023-12-12T11:51:56.439 INFO:tasks.workunit.client.1.smithi093.stdout:0/658: readlink d5/dd/l11 0 2023-12-12T11:51:56.440 INFO:tasks.workunit.client.1.smithi093.stdout:0/659: truncate d5/dd/d14/d26/d58/d72/fa9 595184 0 2023-12-12T11:51:56.441 INFO:tasks.workunit.client.1.smithi093.stdout:9/617: creat d1/d23/d24/d29/d43/d56/d68/fd1 x:0 0 0 2023-12-12T11:51:56.447 INFO:tasks.workunit.client.1.smithi093.stdout:5/543: symlink d0/d3b/lb6 0 2023-12-12T11:51:56.447 INFO:tasks.workunit.client.1.smithi093.stdout:6/758: dread d0/da/d14/d21/ffd [0,4194304] 0 2023-12-12T11:51:56.450 INFO:tasks.workunit.client.1.smithi093.stdout:8/691: write d3/f81 [812890,53714] 0 2023-12-12T11:51:56.451 INFO:tasks.workunit.client.1.smithi093.stdout:3/608: rmdir df/d92 39 2023-12-12T11:51:56.451 INFO:tasks.workunit.client.1.smithi093.stdout:3/609: dread - df/d22/d49/d69/d8c/fae zero size 2023-12-12T11:51:56.452 INFO:tasks.workunit.client.0.smithi063.stdout:6/474: getdents d9 0 2023-12-12T11:51:56.452 INFO:tasks.workunit.client.0.smithi063.stdout:6/475: write d9/d10/d5c/d5e/f87 [798329,79020] 0 2023-12-12T11:51:56.453 INFO:tasks.workunit.client.0.smithi063.stdout:2/341: rename d0/d1a/d48/l38 to d0/d1a/d1e/d64/l72 0 2023-12-12T11:51:56.453 INFO:tasks.workunit.client.0.smithi063.stdout:2/342: chown d0/d1a/d3a 2691625 1 2023-12-12T11:51:56.453 INFO:tasks.workunit.client.0.smithi063.stdout:2/343: readlink d0/ld 0 2023-12-12T11:51:56.455 INFO:tasks.workunit.client.1.smithi093.stdout:2/666: unlink d5/d14/d2d/d12/d25/d7a/d7e/da0/fc4 0 2023-12-12T11:51:56.455 INFO:tasks.workunit.client.1.smithi093.stdout:2/667: write d5/d14/d2d/d4c/fd8 [1105196,129595] 0 2023-12-12T11:51:56.455 INFO:tasks.workunit.client.1.smithi093.stdout:2/668: readlink d5/d14/d2d/d8b/l9f 0 2023-12-12T11:51:56.455 INFO:tasks.workunit.client.1.smithi093.stdout:2/669: read - d5/fbf zero size 2023-12-12T11:51:56.456 INFO:tasks.workunit.client.1.smithi093.stdout:2/670: dread - d5/d14/d2d/d4c/d76/dc6/fcf zero size 2023-12-12T11:51:56.457 INFO:tasks.workunit.client.1.smithi093.stdout:4/853: creat d0/d36/d61/d97/f108 x:0 0 0 2023-12-12T11:51:56.457 INFO:tasks.workunit.client.1.smithi093.stdout:4/854: write d0/d36/f59 [4866429,62470] 0 2023-12-12T11:51:56.458 INFO:tasks.workunit.client.0.smithi063.stdout:3/358: symlink d4/df/l77 0 2023-12-12T11:51:56.459 INFO:tasks.workunit.client.1.smithi093.stdout:0/660: unlink d5/f13 0 2023-12-12T11:51:56.461 INFO:tasks.workunit.client.1.smithi093.stdout:3/610: dread df/d22/d49/d69/d78/daf/d3d/d59/d72/f87 [0,4194304] 0 2023-12-12T11:51:56.462 INFO:tasks.workunit.client.1.smithi093.stdout:7/594: dwrite da/d15/d19/d4c/fad [0,4194304] 0 2023-12-12T11:51:56.462 INFO:tasks.workunit.client.1.smithi093.stdout:7/595: fsync da/de/d46/d4f/f56 0 2023-12-12T11:51:56.463 INFO:tasks.workunit.client.1.smithi093.stdout:7/596: chown da/l18 1859420 1 2023-12-12T11:51:56.463 INFO:tasks.workunit.client.0.smithi063.stdout:7/384: symlink de/d33/d41/d44/d8b/l90 0 2023-12-12T11:51:56.463 INFO:tasks.workunit.client.0.smithi063.stdout:7/385: write de/d33/d41/d44/d8b/f8f [1012890,1736] 0 2023-12-12T11:51:56.470 INFO:tasks.workunit.client.0.smithi063.stdout:1/447: unlink d3/d3a/d5e/l89 0 2023-12-12T11:51:56.471 INFO:tasks.workunit.client.0.smithi063.stdout:0/382: mknod d0/d1a/c83 0 2023-12-12T11:51:56.474 INFO:tasks.workunit.client.1.smithi093.stdout:5/544: symlink d0/d7/d8/d9e/lb7 0 2023-12-12T11:51:56.474 INFO:tasks.workunit.client.1.smithi093.stdout:6/759: write d0/da/f20 [3163669,82548] 0 2023-12-12T11:51:56.475 INFO:tasks.workunit.client.1.smithi093.stdout:9/618: truncate d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/f38 497326 0 2023-12-12T11:51:56.475 INFO:tasks.workunit.client.1.smithi093.stdout:0/661: dread d5/dd/f75 [0,4194304] 0 2023-12-12T11:51:56.477 INFO:tasks.workunit.client.1.smithi093.stdout:2/671: mkdir d5/d14/d2d/d4c/da1/de4 0 2023-12-12T11:51:56.478 INFO:tasks.workunit.client.0.smithi063.stdout:4/482: rmdir d2/d48/d69 39 2023-12-12T11:51:56.483 INFO:tasks.workunit.client.0.smithi063.stdout:6/476: unlink d9/d10/d5c/f5f 0 2023-12-12T11:51:56.484 INFO:tasks.workunit.client.0.smithi063.stdout:6/477: fdatasync d9/d2c/d6b/d8a/f9a 0 2023-12-12T11:51:56.484 INFO:tasks.workunit.client.0.smithi063.stdout:4/483: dread d2/d47/f53 [0,4194304] 0 2023-12-12T11:51:56.486 INFO:tasks.workunit.client.0.smithi063.stdout:2/344: truncate d0/d1a/d48/f30 3245992 0 2023-12-12T11:51:56.487 INFO:tasks.workunit.client.1.smithi093.stdout:4/855: symlink d0/d36/d61/l109 0 2023-12-12T11:51:56.488 INFO:tasks.workunit.client.0.smithi063.stdout:3/359: mkdir d4/df/d1a/d1c/d3b/d52/d78 0 2023-12-12T11:51:56.491 INFO:tasks.workunit.client.1.smithi093.stdout:3/611: symlink df/lc7 0 2023-12-12T11:51:56.492 INFO:tasks.workunit.client.0.smithi063.stdout:7/386: creat de/d22/d4d/f91 x:0 0 0 2023-12-12T11:51:56.492 INFO:tasks.workunit.client.0.smithi063.stdout:7/387: chown de/d34/d43 90 1 2023-12-12T11:51:56.494 INFO:tasks.workunit.client.0.smithi063.stdout:0/383: mkdir d0/d1a/d23/d2e/d84 0 2023-12-12T11:51:56.494 INFO:tasks.workunit.client.0.smithi063.stdout:0/384: creat d0/d7/d27/d44/f85 x:0 0 0 2023-12-12T11:51:56.496 INFO:tasks.workunit.client.1.smithi093.stdout:2/672: dread d5/d14/d47/d4e/f8a [0,4194304] 0 2023-12-12T11:51:56.503 INFO:tasks.workunit.client.0.smithi063.stdout:4/484: link d2/d17/d41/f44 d2/d47/d6d/f97 0 2023-12-12T11:51:56.507 INFO:tasks.workunit.client.1.smithi093.stdout:8/692: dwrite d3/d1a/d1f/d59/fcd [0,4194304] 0 2023-12-12T11:51:56.512 INFO:tasks.workunit.client.0.smithi063.stdout:2/345: symlink d0/d1a/d57/l73 0 2023-12-12T11:51:56.512 INFO:tasks.workunit.client.0.smithi063.stdout:2/346: write d0/f43 [662872,75072] 0 2023-12-12T11:51:56.512 INFO:tasks.workunit.client.0.smithi063.stdout:2/347: chown d0/d1a/d1e/d64/f68 13959 1 2023-12-12T11:51:56.512 INFO:tasks.workunit.client.0.smithi063.stdout:2/348: write d0/d1a/d48/f4a [1025203,95574] 0 2023-12-12T11:51:56.512 INFO:tasks.workunit.client.0.smithi063.stdout:2/349: write d0/d41/f66 [938654,11244] 0 2023-12-12T11:51:56.514 INFO:tasks.workunit.client.1.smithi093.stdout:4/856: dread d0/d36/d49/f78 [0,4194304] 0 2023-12-12T11:51:56.517 INFO:tasks.workunit.client.1.smithi093.stdout:2/673: write d5/d14/d2d/d12/d25/f30 [2127594,121245] 0 2023-12-12T11:51:56.517 INFO:tasks.workunit.client.0.smithi063.stdout:3/360: mkdir d4/d23/d5d/d4c/d56/d79 0 2023-12-12T11:51:56.524 INFO:tasks.workunit.client.0.smithi063.stdout:0/385: dread d0/d7/d27/f33 [0,4194304] 0 2023-12-12T11:51:56.524 INFO:tasks.workunit.client.0.smithi063.stdout:0/386: chown d0/d1a/d66/f6f 23 1 2023-12-12T11:51:56.527 INFO:tasks.workunit.client.0.smithi063.stdout:4/485: rename d2/d8/d76/d90 to d2/d48/d69/d98 0 2023-12-12T11:51:56.531 INFO:tasks.workunit.client.0.smithi063.stdout:3/361: mknod d4/df/d1a/d1c/d3b/c7a 0 2023-12-12T11:51:56.532 INFO:tasks.workunit.client.1.smithi093.stdout:5/545: symlink d0/d7/d59/lb8 0 2023-12-12T11:51:56.533 INFO:tasks.workunit.client.1.smithi093.stdout:6/760: truncate d0/d52/d7e/d42/f8e 942010 0 2023-12-12T11:51:56.533 INFO:tasks.workunit.client.1.smithi093.stdout:6/761: write d0/d52/d7e/d42/f45 [4826801,24248] 0 2023-12-12T11:51:56.536 INFO:tasks.workunit.client.1.smithi093.stdout:3/612: truncate df/d22/d49/d69/d78/daf/d3d/d59/f98 709899 0 2023-12-12T11:51:56.537 INFO:tasks.workunit.client.1.smithi093.stdout:8/693: creat d3/d1a/d1f/d59/d69/dbc/fe8 x:0 0 0 2023-12-12T11:51:56.537 INFO:tasks.workunit.client.1.smithi093.stdout:8/694: creat d3/d1a/d1f/d29/d3a/d40/dbf/fe9 x:0 0 0 2023-12-12T11:51:56.538 INFO:tasks.workunit.client.1.smithi093.stdout:8/695: chown d3/d8/d88 11739131 1 2023-12-12T11:51:56.538 INFO:tasks.workunit.client.1.smithi093.stdout:8/696: fdatasync d3/d1a/d1f/d29/d30/d58/d76/f86 0 2023-12-12T11:51:56.538 INFO:tasks.workunit.client.1.smithi093.stdout:8/697: creat d3/d1a/fea x:0 0 0 2023-12-12T11:51:56.538 INFO:tasks.workunit.client.1.smithi093.stdout:8/698: fsync d3/d1a/d1f/d29/d3a/da0/dcb/fd5 0 2023-12-12T11:51:56.538 INFO:tasks.workunit.client.0.smithi063.stdout:0/387: dread d0/d1a/d23/d34/d42/f53 [0,4194304] 0 2023-12-12T11:51:56.538 INFO:tasks.workunit.client.0.smithi063.stdout:0/388: chown d0/d1a/d23/d34/f70 11618228 1 2023-12-12T11:51:56.538 INFO:tasks.workunit.client.0.smithi063.stdout:4/486: link d2/d48/d4f/f68 d2/d47/d77/f99 0 2023-12-12T11:51:56.538 INFO:tasks.workunit.client.0.smithi063.stdout:4/487: chown d2/f10 650792888 1 2023-12-12T11:51:56.539 INFO:tasks.workunit.client.0.smithi063.stdout:0/389: creat d0/d7/d27/d19/f86 x:0 0 0 2023-12-12T11:51:56.539 INFO:tasks.workunit.client.0.smithi063.stdout:3/362: mkdir d4/d23/d7b 0 2023-12-12T11:51:56.539 INFO:tasks.workunit.client.0.smithi063.stdout:4/488: creat d2/d47/d6d/f9a x:0 0 0 2023-12-12T11:51:56.539 INFO:tasks.workunit.client.0.smithi063.stdout:1/448: dwrite d3/db/d12/f27 [4194304,4194304] 0 2023-12-12T11:51:56.544 INFO:tasks.workunit.client.0.smithi063.stdout:3/363: getdents d4/d23/d5d 0 2023-12-12T11:51:56.544 INFO:tasks.workunit.client.0.smithi063.stdout:3/364: write d4/d23/d5d/d4c/f66 [4051002,130154] 0 2023-12-12T11:51:56.554 INFO:tasks.workunit.client.1.smithi093.stdout:6/762: symlink d0/da/d14/d38/l118 0 2023-12-12T11:51:56.562 INFO:tasks.workunit.client.0.smithi063.stdout:0/390: dread d0/d7/f47 [0,4194304] 0 2023-12-12T11:51:56.562 INFO:tasks.workunit.client.0.smithi063.stdout:0/391: creat d0/d1a/d66/f87 x:0 0 0 2023-12-12T11:51:56.562 INFO:tasks.workunit.client.0.smithi063.stdout:0/392: read d0/d1a/d23/d34/d42/f80 [171426,21418] 0 2023-12-12T11:51:56.568 INFO:tasks.workunit.client.1.smithi093.stdout:5/546: rename d0/d3b to d0/d7/d36/db9 0 2023-12-12T11:51:56.572 INFO:tasks.workunit.client.1.smithi093.stdout:6/763: truncate d0/da/d14/d21/ffd 210883 0 2023-12-12T11:51:56.572 INFO:tasks.workunit.client.1.smithi093.stdout:6/764: write d0/d52/d7e/f3f [3754155,1950] 0 2023-12-12T11:51:56.574 INFO:tasks.workunit.client.0.smithi063.stdout:4/489: rename d2/d8/c20 to d2/d47/c9b 0 2023-12-12T11:51:56.576 INFO:tasks.workunit.client.0.smithi063.stdout:3/365: dread d4/f25 [0,4194304] 0 2023-12-12T11:51:56.576 INFO:tasks.workunit.client.0.smithi063.stdout:4/490: link d2/d48/c4a d2/d47/d77/d85/c9c 0 2023-12-12T11:51:56.577 INFO:tasks.workunit.client.0.smithi063.stdout:1/449: dread d3/db/d12/f27 [4194304,4194304] 0 2023-12-12T11:51:56.577 INFO:tasks.workunit.client.0.smithi063.stdout:1/450: fdatasync d3/db/d16/d24/d4d/d35/f5d 0 2023-12-12T11:51:56.578 INFO:tasks.workunit.client.0.smithi063.stdout:1/451: truncate d3/f56 1028942 0 2023-12-12T11:51:56.580 INFO:tasks.workunit.client.0.smithi063.stdout:0/393: write d0/d7/f31 [312741,115714] 0 2023-12-12T11:51:56.581 INFO:tasks.workunit.client.1.smithi093.stdout:4/857: write d0/d36/f4c [1413765,29728] 0 2023-12-12T11:51:56.581 INFO:tasks.workunit.client.1.smithi093.stdout:8/699: write d3/d1a/d1f/d29/d63/f65 [3244614,12858] 0 2023-12-12T11:51:56.582 INFO:tasks.workunit.client.0.smithi063.stdout:3/366: symlink d4/d23/l7c 0 2023-12-12T11:51:56.586 INFO:tasks.workunit.client.0.smithi063.stdout:1/452: symlink d3/db/d16/d17/d4b/l93 0 2023-12-12T11:51:56.586 INFO:tasks.workunit.client.0.smithi063.stdout:8/483: dwrite f3 [0,4194304] 0 2023-12-12T11:51:56.586 INFO:tasks.workunit.client.0.smithi063.stdout:1/453: write d3/db/d16/d17/f55 [1887295,126822] 0 2023-12-12T11:51:56.590 INFO:tasks.workunit.client.0.smithi063.stdout:7/388: dwrite de/d34/d43/d45/f7d [0,4194304] 0 2023-12-12T11:51:56.590 INFO:tasks.workunit.client.1.smithi093.stdout:3/613: dread df/d22/d49/d69/d78/daf/f70 [0,4194304] 0 2023-12-12T11:51:56.590 INFO:tasks.workunit.client.1.smithi093.stdout:0/662: dwrite d5/dd/d14/d26/d58/dab/fb6 [0,4194304] 0 2023-12-12T11:51:56.590 INFO:tasks.workunit.client.1.smithi093.stdout:9/619: dwrite d1/d23/d24/d29/d43/d56/d68/fbe [0,4194304] 0 2023-12-12T11:51:56.595 INFO:tasks.workunit.client.0.smithi063.stdout:0/394: creat d0/d7/d27/f88 x:0 0 0 2023-12-12T11:51:56.597 INFO:tasks.workunit.client.1.smithi093.stdout:6/765: write d0/d52/d7e/d42/f45 [1895706,62806] 0 2023-12-12T11:51:56.597 INFO:tasks.workunit.client.1.smithi093.stdout:6/766: chown d0/d52/c6d 4014 1 2023-12-12T11:51:56.597 INFO:tasks.workunit.client.1.smithi093.stdout:8/700: write d3/d1a/d1f/d29/d3a/d68/d8a/f90 [1702397,2089] 0 2023-12-12T11:51:56.600 INFO:tasks.workunit.client.1.smithi093.stdout:4/858: write d0/d31/d5c/d66/fbf [621907,92852] 0 2023-12-12T11:51:56.600 INFO:tasks.workunit.client.1.smithi093.stdout:4/859: fsync d0/d87/d79/d86/fc4 0 2023-12-12T11:51:56.601 INFO:tasks.workunit.client.1.smithi093.stdout:4/860: write d0/d87/d79/d96/dcc/ff6 [774436,88120] 0 2023-12-12T11:51:56.604 INFO:tasks.workunit.client.0.smithi063.stdout:7/389: symlink de/d22/d2b/d61/l92 0 2023-12-12T11:51:56.604 INFO:tasks.workunit.client.0.smithi063.stdout:1/454: read d3/db/d16/f2d [2397173,34556] 0 2023-12-12T11:51:56.604 INFO:tasks.workunit.client.0.smithi063.stdout:7/390: chown de/d33/l3d 692 1 2023-12-12T11:51:56.604 INFO:tasks.workunit.client.0.smithi063.stdout:1/455: fdatasync d3/db/d16/d4f/f79 0 2023-12-12T11:51:56.605 INFO:tasks.workunit.client.0.smithi063.stdout:2/350: dwrite d0/d1a/d26/f37 [0,4194304] 0 2023-12-12T11:51:56.605 INFO:tasks.workunit.client.0.smithi063.stdout:2/351: readlink d0/d1a/d57/l73 0 2023-12-12T11:51:56.606 INFO:tasks.workunit.client.1.smithi093.stdout:2/674: dwrite d5/d14/d2d/d4c/d54/dc5/d55/f95 [0,4194304] 0 2023-12-12T11:51:56.612 INFO:tasks.workunit.client.0.smithi063.stdout:3/367: dread f0 [0,4194304] 0 2023-12-12T11:51:56.612 INFO:tasks.workunit.client.0.smithi063.stdout:3/368: dread - d4/f44 zero size 2023-12-12T11:51:56.616 INFO:tasks.workunit.client.1.smithi093.stdout:3/614: unlink df/d22/d49/l5a 0 2023-12-12T11:51:56.616 INFO:tasks.workunit.client.0.smithi063.stdout:0/395: symlink d0/d1a/d23/d2e/d84/l89 0 2023-12-12T11:51:56.617 INFO:tasks.workunit.client.1.smithi093.stdout:0/663: dread d5/d21/d27/d3a/d9a/fa7 [0,4194304] 0 2023-12-12T11:51:56.617 INFO:tasks.workunit.client.1.smithi093.stdout:0/664: write d5/dd/d14/d26/d58/d64/d6f/d90/fa0 [928593,103015] 0 2023-12-12T11:51:56.619 INFO:tasks.workunit.client.0.smithi063.stdout:8/484: rmdir d4/d55/d52 39 2023-12-12T11:51:56.622 INFO:tasks.workunit.client.1.smithi093.stdout:9/620: creat d1/d23/d6b/d92/fd2 x:0 0 0 2023-12-12T11:51:56.622 INFO:tasks.workunit.client.1.smithi093.stdout:9/621: chown d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/lc9 1269490 1 2023-12-12T11:51:56.627 INFO:tasks.workunit.client.1.smithi093.stdout:8/701: rename d3/d1a/d1f/l28 to d3/d1a/d1f/d75/leb 0 2023-12-12T11:51:56.633 INFO:tasks.workunit.client.1.smithi093.stdout:4/861: creat d0/d87/d79/f10a x:0 0 0 2023-12-12T11:51:56.635 INFO:tasks.workunit.client.0.smithi063.stdout:3/369: write d4/df/d1a/f20 [808568,75970] 0 2023-12-12T11:51:56.636 INFO:tasks.workunit.client.0.smithi063.stdout:1/456: dread d3/db/d16/d24/d48/f8f [0,4194304] 0 2023-12-12T11:51:56.636 INFO:tasks.workunit.client.0.smithi063.stdout:1/457: fsync d3/d3a/d5e/f87 0 2023-12-12T11:51:56.636 INFO:tasks.workunit.client.0.smithi063.stdout:7/391: symlink de/d22/l93 0 2023-12-12T11:51:56.636 INFO:tasks.workunit.client.0.smithi063.stdout:7/392: dread - de/d22/d2b/d61/f62 zero size 2023-12-12T11:51:56.640 INFO:tasks.workunit.client.0.smithi063.stdout:3/370: rmdir d4/df/d1a/d1c/d57/d6f 0 2023-12-12T11:51:56.640 INFO:tasks.workunit.client.0.smithi063.stdout:2/352: dread d0/d1a/d1e/f2e [0,4194304] 0 2023-12-12T11:51:56.640 INFO:tasks.workunit.client.0.smithi063.stdout:3/371: stat d4/df/d1a/d1c/d57/f6c 0 2023-12-12T11:51:56.643 INFO:tasks.workunit.client.0.smithi063.stdout:1/458: truncate d3/db/d16/f3c 527741 0 2023-12-12T11:51:56.646 INFO:tasks.workunit.client.1.smithi093.stdout:6/767: dwrite d0/da/d32/d39/d5b/fa2 [0,4194304] 0 2023-12-12T11:51:56.652 INFO:tasks.workunit.client.0.smithi063.stdout:3/372: unlink d4/d23/l30 0 2023-12-12T11:51:56.652 INFO:tasks.workunit.client.0.smithi063.stdout:3/373: chown d4/df/l2f 22221 1 2023-12-12T11:51:56.659 INFO:tasks.workunit.client.1.smithi093.stdout:3/615: rmdir df/d22/d49/d69/d78/daf/d3d/d59 39 2023-12-12T11:51:56.659 INFO:tasks.workunit.client.1.smithi093.stdout:3/616: chown df/d22/d49/d69/d78/daf/f41 79 1 2023-12-12T11:51:56.659 INFO:tasks.workunit.client.1.smithi093.stdout:3/617: dread - df/d22/d49/d69/d78/daf/d3d/d42/d8e/da5/fb0 zero size 2023-12-12T11:51:56.659 INFO:tasks.workunit.client.1.smithi093.stdout:3/618: fsync df/f1a 0 2023-12-12T11:51:56.659 INFO:tasks.workunit.client.1.smithi093.stdout:3/619: creat df/d22/d49/d69/d78/daf/d3d/d42/d8e/da5/fc8 x:0 0 0 2023-12-12T11:51:56.659 INFO:tasks.workunit.client.1.smithi093.stdout:0/665: readlink d5/l10 0 2023-12-12T11:51:56.660 INFO:tasks.workunit.client.1.smithi093.stdout:0/666: chown d5/c92 23606436 1 2023-12-12T11:51:56.663 INFO:tasks.workunit.client.1.smithi093.stdout:2/675: dwrite d5/d14/d2d/d12/db4/fda [0,4194304] 0 2023-12-12T11:51:56.663 INFO:tasks.workunit.client.1.smithi093.stdout:9/622: mkdir d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/d42/dd3 0 2023-12-12T11:51:56.664 INFO:tasks.workunit.client.1.smithi093.stdout:9/623: write d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d57/d63/f79 [478868,68516] 0 2023-12-12T11:51:56.665 INFO:tasks.workunit.client.0.smithi063.stdout:1/459: write d3/f9 [278174,5629] 0 2023-12-12T11:51:56.665 INFO:tasks.workunit.client.0.smithi063.stdout:1/460: chown d3/db/d16/d24/d4d/d35/c80 33132983 1 2023-12-12T11:51:56.666 INFO:tasks.workunit.client.1.smithi093.stdout:8/702: rename d3/d1a/d1f/d59/f6a to d3/d1a/d1f/fec 0 2023-12-12T11:51:56.666 INFO:tasks.workunit.client.1.smithi093.stdout:3/620: write df/d22/d49/d69/d78/daf/d3d/d42/f57 [807806,105491] 0 2023-12-12T11:51:56.671 INFO:tasks.workunit.client.1.smithi093.stdout:4/862: link d0/l4 d0/d31/d9d/l10b 0 2023-12-12T11:51:56.673 INFO:tasks.workunit.client.0.smithi063.stdout:7/393: dread f4 [0,4194304] 0 2023-12-12T11:51:56.688 INFO:tasks.workunit.client.1.smithi093.stdout:2/676: mkdir d5/d14/d2d/d8b/da3/de5 0 2023-12-12T11:51:56.688 INFO:tasks.workunit.client.1.smithi093.stdout:2/677: fsync d5/d14/d47/d56/d6f/fb0 0 2023-12-12T11:51:56.689 INFO:tasks.workunit.client.0.smithi063.stdout:3/374: dread d4/f6 [4194304,4194304] 0 2023-12-12T11:51:56.689 INFO:tasks.workunit.client.0.smithi063.stdout:3/375: readlink d4/df/d1a/d1c/d57/l70 0 2023-12-12T11:51:56.689 INFO:tasks.workunit.client.0.smithi063.stdout:3/376: dread - d4/f76 zero size 2023-12-12T11:51:56.689 INFO:tasks.workunit.client.0.smithi063.stdout:3/377: chown d4/df/d1a/d1c/d3b/d52 4442377 1 2023-12-12T11:51:56.692 INFO:tasks.workunit.client.1.smithi093.stdout:9/624: link d1/d23/d6b/d92/d9f/lb7 d1/d23/d24/d29/d43/d58/ld4 0 2023-12-12T11:51:56.694 INFO:tasks.workunit.client.0.smithi063.stdout:8/485: dwrite d4/d24/f5f [0,4194304] 0 2023-12-12T11:51:56.695 INFO:tasks.workunit.client.0.smithi063.stdout:0/396: dwrite d0/d7/d27/f81 [0,4194304] 0 2023-12-12T11:51:56.696 INFO:tasks.workunit.client.1.smithi093.stdout:6/768: rename d0/d52/d7e/l81 to d0/da/d32/d9e/d113/l119 0 2023-12-12T11:51:56.697 INFO:tasks.workunit.client.1.smithi093.stdout:6/769: chown d0/da/d32/d39/d5b/fe4 994091 1 2023-12-12T11:51:56.697 INFO:tasks.workunit.client.1.smithi093.stdout:6/770: creat d0/da/f11a x:0 0 0 2023-12-12T11:51:56.697 INFO:tasks.workunit.client.1.smithi093.stdout:6/771: write d0/da/d32/d39/fb2 [1047380,108897] 0 2023-12-12T11:51:56.701 INFO:tasks.workunit.client.1.smithi093.stdout:3/621: unlink df/d22/d49/d69/d78/daf/d3d/d6f/f7a 0 2023-12-12T11:51:56.701 INFO:tasks.workunit.client.1.smithi093.stdout:3/622: readlink la 0 2023-12-12T11:51:56.703 INFO:tasks.workunit.client.1.smithi093.stdout:2/678: symlink d5/d14/d2d/d4c/d76/le6 0 2023-12-12T11:51:56.703 INFO:tasks.workunit.client.1.smithi093.stdout:2/679: chown d5/d14/d47/de2 23799692 1 2023-12-12T11:51:56.716 INFO:tasks.workunit.client.1.smithi093.stdout:8/703: rename d3/d73/cca to d3/d1a/d1f/d29/d3a/da0/dcb/ced 0 2023-12-12T11:51:56.717 INFO:tasks.workunit.client.0.smithi063.stdout:8/486: creat d4/de/d1e/d6d/f97 x:0 0 0 2023-12-12T11:51:56.720 INFO:tasks.workunit.client.1.smithi093.stdout:6/772: creat d0/d52/d6b/ddb/f11b x:0 0 0 2023-12-12T11:51:56.722 INFO:tasks.workunit.client.0.smithi063.stdout:0/397: link d0/d1a/d66/f6f d0/d1a/d66/f8a 0 2023-12-12T11:51:56.723 INFO:tasks.workunit.client.1.smithi093.stdout:3/623: creat df/d22/d49/d69/d78/dad/fc9 x:0 0 0 2023-12-12T11:51:56.723 INFO:tasks.workunit.client.1.smithi093.stdout:3/624: chown df/d30/d33/d66 1983934902 1 2023-12-12T11:51:56.724 INFO:tasks.workunit.client.0.smithi063.stdout:8/487: symlink d4/d24/d38/d45/d5b/l98 0 2023-12-12T11:51:56.724 INFO:tasks.workunit.client.0.smithi063.stdout:8/488: getdents d4/de/d3b/d62/d91 0 2023-12-12T11:51:56.726 INFO:tasks.workunit.client.1.smithi093.stdout:0/667: dwrite d5/d21/d27/f5a [0,4194304] 0 2023-12-12T11:51:56.726 INFO:tasks.workunit.client.1.smithi093.stdout:8/704: link d3/d1a/d1f/d59/d69/dbc/dc2/lc8 d3/d8/lee 0 2023-12-12T11:51:56.732 INFO:tasks.workunit.client.1.smithi093.stdout:6/773: getdents d0/da/d14 0 2023-12-12T11:51:56.732 INFO:tasks.workunit.client.1.smithi093.stdout:6/774: creat d0/da/d14/d3a/d106/f11c x:0 0 0 2023-12-12T11:51:56.732 INFO:tasks.workunit.client.1.smithi093.stdout:6/775: write d0/da/d14/d3a/f6a [4718651,113750] 0 2023-12-12T11:51:56.733 INFO:tasks.workunit.client.1.smithi093.stdout:1/615: sync 2023-12-12T11:51:56.736 INFO:tasks.workunit.client.0.smithi063.stdout:1/461: dwrite d3/db/d16/d24/d48/d75/d83/d5b/f65 [0,4194304] 0 2023-12-12T11:51:56.736 INFO:tasks.workunit.client.0.smithi063.stdout:1/462: readlink d3/l11 0 2023-12-12T11:51:56.736 INFO:tasks.workunit.client.0.smithi063.stdout:8/489: link d4/lc d4/de/d3b/d62/d91/l99 0 2023-12-12T11:51:56.736 INFO:tasks.workunit.client.0.smithi063.stdout:8/490: chown f1 89283732 1 2023-12-12T11:51:56.736 INFO:tasks.workunit.client.0.smithi063.stdout:8/491: chown d4/de/d3b/d62/d36 858 1 2023-12-12T11:51:56.737 INFO:tasks.workunit.client.0.smithi063.stdout:0/398: symlink d0/d1a/l8b 0 2023-12-12T11:51:56.747 INFO:tasks.workunit.client.1.smithi093.stdout:4/863: dwrite d0/fd0 [0,4194304] 0 2023-12-12T11:51:56.752 INFO:tasks.workunit.client.0.smithi063.stdout:2/353: dwrite d0/d1a/d57/f6f [0,4194304] 0 2023-12-12T11:51:56.753 INFO:tasks.workunit.client.0.smithi063.stdout:2/354: fsync d0/f15 0 2023-12-12T11:51:56.753 INFO:tasks.workunit.client.0.smithi063.stdout:3/378: dwrite d4/f76 [0,4194304] 0 2023-12-12T11:51:56.753 INFO:tasks.workunit.client.0.smithi063.stdout:3/379: chown d4/d23/d5d/d4c/d69 1267 1 2023-12-12T11:51:56.753 INFO:tasks.workunit.client.1.smithi093.stdout:9/625: dread d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d57/d63/f79 [0,4194304] 0 2023-12-12T11:51:56.755 INFO:tasks.workunit.client.1.smithi093.stdout:1/616: dread d4/f8 [4194304,4194304] 0 2023-12-12T11:51:56.756 INFO:tasks.workunit.client.1.smithi093.stdout:0/668: dread d5/dd/d14/d26/d58/d64/d6f/d90/fa0 [0,4194304] 0 2023-12-12T11:51:56.757 INFO:tasks.workunit.client.1.smithi093.stdout:0/669: stat d5/dd/d62/l71 0 2023-12-12T11:51:56.761 INFO:tasks.workunit.client.1.smithi093.stdout:6/776: write d0/da/d14/d3a/f6a [1321924,650] 0 2023-12-12T11:51:56.762 INFO:tasks.workunit.client.1.smithi093.stdout:6/777: write d0/d52/d7e/d42/dd5/fda [181808,76062] 0 2023-12-12T11:51:56.765 INFO:tasks.workunit.client.0.smithi063.stdout:7/394: dwrite de/d34/d68/d89/f8d [0,4194304] 0 2023-12-12T11:51:56.770 INFO:tasks.workunit.client.1.smithi093.stdout:4/864: mkdir d0/d31/d89/d10c 0 2023-12-12T11:51:56.776 INFO:tasks.workunit.client.1.smithi093.stdout:7/597: sync 2023-12-12T11:51:56.776 INFO:tasks.workunit.client.1.smithi093.stdout:7/598: chown da/de/d46/fbe 1 1 2023-12-12T11:51:56.776 INFO:tasks.workunit.client.1.smithi093.stdout:7/599: write da/f70 [1360403,104447] 0 2023-12-12T11:51:56.779 INFO:tasks.workunit.client.1.smithi093.stdout:9/626: dread d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/f3f [0,4194304] 0 2023-12-12T11:51:56.780 INFO:tasks.workunit.client.1.smithi093.stdout:9/627: chown d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d5c 115586395 1 2023-12-12T11:51:56.780 INFO:tasks.workunit.client.0.smithi063.stdout:2/355: write d0/f5 [1430462,21253] 0 2023-12-12T11:51:56.782 INFO:tasks.workunit.client.1.smithi093.stdout:0/670: link d5/dd/d14/c19 d5/dd/d62/cd0 0 2023-12-12T11:51:56.782 INFO:tasks.workunit.client.1.smithi093.stdout:0/671: fdatasync d5/dd/d14/d26/f59 0 2023-12-12T11:51:56.783 INFO:tasks.workunit.client.0.smithi063.stdout:3/380: rmdir d4/df/d1a/d1c/d34/d54 39 2023-12-12T11:51:56.787 INFO:tasks.workunit.client.1.smithi093.stdout:6/778: truncate d0/da/d14/d38/d43/f86 314018 0 2023-12-12T11:51:56.790 INFO:tasks.workunit.client.1.smithi093.stdout:4/865: mkdir d0/d31/d10d 0 2023-12-12T11:51:56.790 INFO:tasks.workunit.client.1.smithi093.stdout:4/866: chown d0/c2b 2 1 2023-12-12T11:51:56.794 INFO:tasks.workunit.client.0.smithi063.stdout:1/463: dwrite d3/f1a [0,4194304] 0 2023-12-12T11:51:56.795 INFO:tasks.workunit.client.1.smithi093.stdout:7/600: unlink da/d15/d2d/d2f/f6c 0 2023-12-12T11:51:56.797 INFO:tasks.workunit.client.1.smithi093.stdout:1/617: link d4/d1c/d2a/la3 d4/lcc 0 2023-12-12T11:51:56.800 INFO:tasks.workunit.client.1.smithi093.stdout:0/672: link d5/dd/l57 d5/dd/d33/d87/ld1 0 2023-12-12T11:51:56.802 INFO:tasks.workunit.client.0.smithi063.stdout:1/464: symlink d3/db/d16/d24/d48/d75/d83/l94 0 2023-12-12T11:51:56.802 INFO:tasks.workunit.client.0.smithi063.stdout:1/465: creat d3/d3a/d5e/f95 x:0 0 0 2023-12-12T11:51:56.803 INFO:tasks.workunit.client.1.smithi093.stdout:6/779: creat d0/da/d32/dd3/f11d x:0 0 0 2023-12-12T11:51:56.803 INFO:tasks.workunit.client.1.smithi093.stdout:6/780: chown d0/da/d14/d3a/d106 0 1 2023-12-12T11:51:56.805 INFO:tasks.workunit.client.0.smithi063.stdout:7/395: rmdir de/d22/d2b/d61 39 2023-12-12T11:51:56.806 INFO:tasks.workunit.client.1.smithi093.stdout:4/867: mkdir d0/d31/d5c/d6c/de2/d10e 0 2023-12-12T11:51:56.809 INFO:tasks.workunit.client.1.smithi093.stdout:7/601: mkdir da/d15/d19/d90/d7d/dd1 0 2023-12-12T11:51:56.810 INFO:tasks.workunit.client.0.smithi063.stdout:1/466: dread d3/db/d16/f3c [0,4194304] 0 2023-12-12T11:51:56.810 INFO:tasks.workunit.client.0.smithi063.stdout:1/467: dread - d3/db/d16/d24/d4d/f3e zero size 2023-12-12T11:51:56.813 INFO:tasks.workunit.client.1.smithi093.stdout:2/680: dwrite d5/fbf [0,4194304] 0 2023-12-12T11:51:56.813 INFO:tasks.workunit.client.1.smithi093.stdout:9/628: mkdir d1/d23/dd5 0 2023-12-12T11:51:56.814 INFO:tasks.workunit.client.0.smithi063.stdout:3/381: mknod d4/df/d1a/d1c/c7d 0 2023-12-12T11:51:56.815 INFO:tasks.workunit.client.1.smithi093.stdout:3/625: dwrite df/f1a [0,4194304] 0 2023-12-12T11:51:56.815 INFO:tasks.workunit.client.1.smithi093.stdout:3/626: fsync df/d22/d49/d69/d78/daf/d3d/d42/f53 0 2023-12-12T11:51:56.818 INFO:tasks.workunit.client.0.smithi063.stdout:1/468: mknod d3/db/d16/d24/d48/c96 0 2023-12-12T11:51:56.818 INFO:tasks.workunit.client.1.smithi093.stdout:4/868: unlink d0/d31/d5c/d6c/de2/ff8 0 2023-12-12T11:51:56.818 INFO:tasks.workunit.client.0.smithi063.stdout:0/399: dwrite d0/d1a/d23/d34/f58 [0,4194304] 0 2023-12-12T11:51:56.818 INFO:tasks.workunit.client.0.smithi063.stdout:0/400: fsync d0/d1a/d23/d2e/f5a 0 2023-12-12T11:51:56.821 INFO:tasks.workunit.client.1.smithi093.stdout:4/869: read d0/d36/d40/fb3 [280017,122742] 0 2023-12-12T11:51:56.821 INFO:tasks.workunit.client.1.smithi093.stdout:7/602: symlink da/d8e/daa/ld2 0 2023-12-12T11:51:56.822 INFO:tasks.workunit.client.0.smithi063.stdout:7/396: rename de/d34/l3e to de/d22/l94 0 2023-12-12T11:51:56.822 INFO:tasks.workunit.client.0.smithi063.stdout:2/356: fsync d0/f5 0 2023-12-12T11:51:56.823 INFO:tasks.workunit.client.0.smithi063.stdout:3/382: stat d4/df/d1a/f2e 0 2023-12-12T11:51:56.826 INFO:tasks.workunit.client.0.smithi063.stdout:1/469: mknod d3/db/d16/c97 0 2023-12-12T11:51:56.828 INFO:tasks.workunit.client.1.smithi093.stdout:2/681: mknod d5/d14/d2d/d12/d25/d7a/d7e/ce7 0 2023-12-12T11:51:56.830 INFO:tasks.workunit.client.1.smithi093.stdout:1/618: dwrite d4/f8 [8388608,4194304] 0 2023-12-12T11:51:56.830 INFO:tasks.workunit.client.1.smithi093.stdout:1/619: write d4/dc/f17 [1714690,127254] 0 2023-12-12T11:51:56.830 INFO:tasks.workunit.client.0.smithi063.stdout:8/492: getdents d4/de/d3b/d62/d91 0 2023-12-12T11:51:56.830 INFO:tasks.workunit.client.0.smithi063.stdout:8/493: chown d4/d24/d38/d45/d5b/l98 168136614 1 2023-12-12T11:51:56.830 INFO:tasks.workunit.client.0.smithi063.stdout:8/494: fdatasync d4/de/d1e/f64 0 2023-12-12T11:51:56.836 INFO:tasks.workunit.client.1.smithi093.stdout:7/603: mknod da/de/cd3 0 2023-12-12T11:51:56.838 INFO:tasks.workunit.client.1.smithi093.stdout:5/547: sync 2023-12-12T11:51:56.840 INFO:tasks.workunit.client.1.smithi093.stdout:3/627: write fc [1164200,112998] 0 2023-12-12T11:51:56.841 INFO:tasks.workunit.client.1.smithi093.stdout:2/682: link d5/d14/d2d/fcb d5/d14/d47/d56/fe8 0 2023-12-12T11:51:56.847 INFO:tasks.workunit.client.0.smithi063.stdout:9/356: sync 2023-12-12T11:51:56.848 INFO:tasks.workunit.client.1.smithi093.stdout:3/628: truncate df/f54 2166788 0 2023-12-12T11:51:56.848 INFO:tasks.workunit.client.1.smithi093.stdout:3/629: dread - df/d22/d49/d69/fa7 zero size 2023-12-12T11:51:56.848 INFO:tasks.workunit.client.1.smithi093.stdout:1/620: dread d4/d1c/d2a/f4b [0,4194304] 0 2023-12-12T11:51:56.852 INFO:tasks.workunit.client.0.smithi063.stdout:8/495: dread d4/d24/f5f [0,4194304] 0 2023-12-12T11:51:56.852 INFO:tasks.workunit.client.0.smithi063.stdout:3/383: unlink d4/df/d1a/d1c/d57/l70 0 2023-12-12T11:51:56.854 INFO:tasks.workunit.client.1.smithi093.stdout:2/683: mkdir d5/d14/d2d/d12/de9 0 2023-12-12T11:51:56.856 INFO:tasks.workunit.client.0.smithi063.stdout:1/470: mkdir d3/db/d16/d24/d4d/d35/d98 0 2023-12-12T11:51:56.856 INFO:tasks.workunit.client.0.smithi063.stdout:1/471: chown d3/db/fe 46 1 2023-12-12T11:51:56.856 INFO:tasks.workunit.client.0.smithi063.stdout:1/472: chown d3/db/d16/d24/d48/d75/f86 11925412 1 2023-12-12T11:51:56.857 INFO:tasks.workunit.client.1.smithi093.stdout:2/684: read d5/d31/f45 [2547731,28147] 0 2023-12-12T11:51:56.857 INFO:tasks.workunit.client.1.smithi093.stdout:2/685: stat d5/d14/d5e/f70 0 2023-12-12T11:51:56.858 INFO:tasks.workunit.client.1.smithi093.stdout:9/629: dread d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/f35 [0,4194304] 0 2023-12-12T11:51:56.858 INFO:tasks.workunit.client.1.smithi093.stdout:9/630: chown d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d57/f5b 0 1 2023-12-12T11:51:56.859 INFO:tasks.workunit.client.1.smithi093.stdout:4/870: dwrite d0/d36/f4c [0,4194304] 0 2023-12-12T11:51:56.859 INFO:tasks.workunit.client.0.smithi063.stdout:9/357: dread d7/d15/f2e [0,4194304] 0 2023-12-12T11:51:56.860 INFO:tasks.workunit.client.0.smithi063.stdout:0/401: rename d0/d7/d27/d19/d2d/c4b to d0/d1a/c8c 0 2023-12-12T11:51:56.860 INFO:tasks.workunit.client.0.smithi063.stdout:0/402: read d0/d7/d27/f29 [202176,38989] 0 2023-12-12T11:51:56.860 INFO:tasks.workunit.client.1.smithi093.stdout:0/673: dwrite d5/d41/fa6 [4194304,4194304] 0 2023-12-12T11:51:56.861 INFO:tasks.workunit.client.0.smithi063.stdout:7/397: rmdir de/d22/d4d 39 2023-12-12T11:51:56.862 INFO:tasks.workunit.client.0.smithi063.stdout:7/398: truncate de/d22/d2b/f46 1189960 0 2023-12-12T11:51:56.864 INFO:tasks.workunit.client.1.smithi093.stdout:3/630: unlink df/d22/d49/c67 0 2023-12-12T11:51:56.865 INFO:tasks.workunit.client.1.smithi093.stdout:3/631: readlink df/d25/l50 0 2023-12-12T11:51:56.866 INFO:tasks.workunit.client.0.smithi063.stdout:2/357: symlink d0/d1a/d1e/l74 0 2023-12-12T11:51:56.868 INFO:tasks.workunit.client.1.smithi093.stdout:6/781: truncate d0/da/d14/d3a/f6a 1718485 0 2023-12-12T11:51:56.871 INFO:tasks.workunit.client.1.smithi093.stdout:1/621: unlink d4/dc/d7a/fc5 0 2023-12-12T11:51:56.874 INFO:tasks.workunit.client.0.smithi063.stdout:1/473: unlink d3/d3a/d5e/f95 0 2023-12-12T11:51:56.877 INFO:tasks.workunit.client.1.smithi093.stdout:9/631: link d1/d23/d24/d29/d43/d56/d85/dc3/dce/d3e/c44 d1/d23/d24/d29/cd6 0 2023-12-12T11:51:56.879 INFO:tasks.workunit.client.0.smithi063.stdout:6/478: sync 2023-12-12T11:51:56.879 INFO:tasks.workunit.client.0.smithi063.stdout:5/447: sync 2023-12-12T11:51:56.882 INFO:tasks.workunit.client.0.smithi063.stdout:7/399: creat de/d39/d60/f95 x:0 0 0 2023-12-12T11:51:56.883 INFO:tasks.workunit.client.0.smithi063.stdout:7/400: chown de 2 1 2023-12-12T11:51:56.883 INFO:tasks.workunit.client.0.smithi063.stdout:7/401: fsync de/d22/d2b/d61/f62 0 2023-12-12T11:51:56.883 INFO:tasks.workunit.client.0.smithi063.stdout:7/402: getdents de/d33/d71 0 2023-12-12T11:51:56.887 INFO:tasks.workunit.client.0.smithi063.stdout:1/474: link d3/db/d12/f50 d3/db/d16/d24/d48/d75/d83/d5b/d6b/f99 0 2023-12-12T11:51:56.888 INFO:tasks.workunit.client.0.smithi063.stdout:1/475: write d3/db/d16/d24/d48/d75/d83/d5b/d6b/f72 [435887,25095] 0 2023-12-12T11:51:56.892 INFO:tasks.workunit.client.0.smithi063.stdout:9/358: unlink d7/d15/l22 0 2023-12-12T11:51:56.900 INFO:tasks.workunit.client.0.smithi063.stdout:6/479: rename d9/d10/c21 to d9/d68/d8f/c9c 0 2023-12-12T11:51:56.905 INFO:tasks.workunit.client.1.smithi093.stdout:5/548: dwrite d0/d7/d85/fb2 [0,4194304] 0 2023-12-12T11:51:56.908 INFO:tasks.workunit.client.1.smithi093.stdout:7/604: rmdir da/d8e/daa 39 2023-12-12T11:51:56.908 INFO:tasks.workunit.client.0.smithi063.stdout:5/448: creat d7/d28/d43/f88 x:0 0 0 2023-12-12T11:51:56.908 INFO:tasks.workunit.client.0.smithi063.stdout:1/476: mkdir d3/db/d16/d4f/d9a 0 2023-12-12T11:51:56.908 INFO:tasks.workunit.client.0.smithi063.stdout:5/449: fdatasync d7/d28/f3f 0 2023-12-12T11:51:56.908 INFO:tasks.workunit.client.0.smithi063.stdout:1/477: write d3/d3a/f40 [425908,29260] 0 2023-12-12T11:51:56.910 INFO:tasks.workunit.client.0.smithi063.stdout:9/359: mkdir d7/d20/d45/d46/d51/d64/d6f 0 2023-12-12T11:51:56.913 INFO:tasks.workunit.client.1.smithi093.stdout:6/782: creat d0/da/d32/d9e/d4d/f11e x:0 0 0 2023-12-12T11:51:56.915 INFO:tasks.workunit.client.1.smithi093.stdout:1/622: dwrite d4/d1a/d73/f50 [0,4194304] 0 2023-12-12T11:51:56.921 INFO:tasks.workunit.client.1.smithi093.stdout:9/632: rename d1/d23/d24/d29/cd6 to d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/db1/dbc/cd7 0 2023-12-12T11:51:56.921 INFO:tasks.workunit.client.1.smithi093.stdout:9/633: truncate d1/f1e 4304641 0 2023-12-12T11:51:56.925 INFO:tasks.workunit.client.0.smithi063.stdout:7/403: rename de/d22/d2b/f64 to de/d33/d71/f96 0 2023-12-12T11:51:56.926 INFO:tasks.workunit.client.1.smithi093.stdout:3/632: dread df/d22/d49/d69/d78/daf/d3d/d42/f53 [0,4194304] 0 2023-12-12T11:51:56.927 INFO:tasks.workunit.client.0.smithi063.stdout:5/450: symlink d7/d10/d2b/d3c/d27/l89 0 2023-12-12T11:51:56.927 INFO:tasks.workunit.client.0.smithi063.stdout:5/451: write d7/de/f1e [4685709,51309] 0 2023-12-12T11:51:56.930 INFO:tasks.workunit.client.0.smithi063.stdout:6/480: dread d9/d2c/d6b/f72 [0,4194304] 0 2023-12-12T11:51:56.934 INFO:tasks.workunit.client.1.smithi093.stdout:7/605: creat da/d15/d59/d80/fd4 x:0 0 0 2023-12-12T11:51:56.935 INFO:tasks.workunit.client.0.smithi063.stdout:3/384: dwrite d4/df/d1a/f2e [0,4194304] 0 2023-12-12T11:51:56.935 INFO:tasks.workunit.client.0.smithi063.stdout:9/360: fdatasync d7/d15/f1d 0 2023-12-12T11:51:56.935 INFO:tasks.workunit.client.0.smithi063.stdout:4/491: sync 2023-12-12T11:51:56.935 INFO:tasks.workunit.client.0.smithi063.stdout:4/492: stat d2/d47/d6d/f9a 0 2023-12-12T11:51:56.935 INFO:tasks.workunit.client.0.smithi063.stdout:4/493: fdatasync d2/d47/f31 0 2023-12-12T11:51:56.944 INFO:tasks.workunit.client.1.smithi093.stdout:9/634: write d1/f1e [358290,87555] 0 2023-12-12T11:51:56.945 INFO:tasks.workunit.client.1.smithi093.stdout:6/783: mkdir d0/da/d14/d3a/d95/d11f 0 2023-12-12T11:51:56.945 INFO:tasks.workunit.client.1.smithi093.stdout:6/784: truncate d0/d52/d7e/d102/f105 256180 0 2023-12-12T11:51:56.945 INFO:tasks.workunit.client.1.smithi093.stdout:6/785: truncate d0/da/d32/d9e/d4d/de9/ff9 1433612 0 2023-12-12T11:51:56.946 INFO:tasks.workunit.client.0.smithi063.stdout:9/361: truncate d7/fa 2137020 0 2023-12-12T11:51:56.946 INFO:tasks.workunit.client.0.smithi063.stdout:9/362: stat d7/f27 0 2023-12-12T11:51:56.946 INFO:tasks.workunit.client.0.smithi063.stdout:9/363: truncate d7/d20/d3f/d40/d4e/f69 10116311 0 2023-12-12T11:51:56.946 INFO:tasks.workunit.client.1.smithi093.stdout:1/623: mknod d4/d1a/d1b/dbf/ccd 0 2023-12-12T11:51:56.948 INFO:tasks.workunit.client.0.smithi063.stdout:5/452: rmdir d7/d28/d43/d49 39 2023-12-12T11:51:56.948 INFO:tasks.workunit.client.1.smithi093.stdout:9/635: read d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/f3b [1255168,82323] 0 2023-12-12T11:51:56.948 INFO:tasks.workunit.client.1.smithi093.stdout:9/636: fsync d1/d23/d6b/d92/db2/fb6 0 2023-12-12T11:51:56.948 INFO:tasks.workunit.client.1.smithi093.stdout:9/637: stat d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d57/d63/lb0 0 2023-12-12T11:51:56.951 INFO:tasks.workunit.client.1.smithi093.stdout:3/633: dread df/f43 [0,4194304] 0 2023-12-12T11:51:56.951 INFO:tasks.workunit.client.0.smithi063.stdout:6/481: getdents d9/d2c/d61 0 2023-12-12T11:51:56.958 INFO:tasks.workunit.client.0.smithi063.stdout:0/403: dwrite d0/d1a/d23/f7b [0,4194304] 0 2023-12-12T11:51:56.958 INFO:tasks.workunit.client.0.smithi063.stdout:7/404: dread de/d22/d2b/d61/f73 [0,4194304] 0 2023-12-12T11:51:56.959 INFO:tasks.workunit.client.1.smithi093.stdout:6/786: rename d0/d52/d7e/f67 to d0/da/d14/d21/f120 0 2023-12-12T11:51:56.961 INFO:tasks.workunit.client.1.smithi093.stdout:2/686: dwrite d5/d14/d2d/d4c/fd8 [0,4194304] 0 2023-12-12T11:51:56.963 INFO:tasks.workunit.client.1.smithi093.stdout:0/674: dwrite d5/dd/d14/d26/d58/dab/fb6 [0,4194304] 0 2023-12-12T11:51:56.963 INFO:tasks.workunit.client.1.smithi093.stdout:4/871: dwrite d0/d31/d5c/d66/f84 [0,4194304] 0 2023-12-12T11:51:56.964 INFO:tasks.workunit.client.0.smithi063.stdout:3/385: read d4/f6 [12313948,105643] 0 2023-12-12T11:51:56.965 INFO:tasks.workunit.client.1.smithi093.stdout:1/624: rename d4/dc/d7a/d9c/c9d to d4/d1a/d1b/d26/d65/d6f/cce 0 2023-12-12T11:51:56.966 INFO:tasks.workunit.client.1.smithi093.stdout:9/638: dread d1/f16 [0,4194304] 0 2023-12-12T11:51:56.967 INFO:tasks.workunit.client.0.smithi063.stdout:0/404: truncate d0/d1a/d23/d2e/f64 2974108 0 2023-12-12T11:51:56.970 INFO:tasks.workunit.client.1.smithi093.stdout:6/787: stat d0/da/d32/d39/d5b/ld6 0 2023-12-12T11:51:56.971 INFO:tasks.workunit.client.0.smithi063.stdout:7/405: mkdir de/d39/d60/d97 0 2023-12-12T11:51:56.972 INFO:tasks.workunit.client.1.smithi093.stdout:8/705: sync 2023-12-12T11:51:56.972 INFO:tasks.workunit.client.1.smithi093.stdout:8/706: dread - d3/d1a/d1f/d59/fd8 zero size 2023-12-12T11:51:56.973 INFO:tasks.workunit.client.0.smithi063.stdout:9/364: dread d7/ff [0,4194304] 0 2023-12-12T11:51:56.975 INFO:tasks.workunit.client.1.smithi093.stdout:2/687: mknod d5/d14/d2d/d12/cea 0 2023-12-12T11:51:56.977 INFO:tasks.workunit.client.0.smithi063.stdout:5/453: getdents d7/d28/d43 0 2023-12-12T11:51:56.979 INFO:tasks.workunit.client.1.smithi093.stdout:2/688: dread - d5/d14/d2d/d12/d25/d7a/d7e/da0/fa9 zero size 2023-12-12T11:51:56.979 INFO:tasks.workunit.client.0.smithi063.stdout:0/405: symlink d0/d1a/d23/d2e/d84/l8d 0 2023-12-12T11:51:56.981 INFO:tasks.workunit.client.1.smithi093.stdout:7/606: dwrite da/d15/d19/d4c/d6d/f7e [0,4194304] 0 2023-12-12T11:51:56.981 INFO:tasks.workunit.client.1.smithi093.stdout:7/607: chown da/d15/d19/d90/d7d 40 1 2023-12-12T11:51:56.981 INFO:tasks.workunit.client.1.smithi093.stdout:7/608: write da/de/f30 [1274408,61570] 0 2023-12-12T11:51:56.981 INFO:tasks.workunit.client.1.smithi093.stdout:5/549: dwrite d0/d7/d36/f2a [0,4194304] 0 2023-12-12T11:51:56.981 INFO:tasks.workunit.client.1.smithi093.stdout:5/550: read - d0/d7/d8/de/f86 zero size 2023-12-12T11:51:56.985 INFO:tasks.workunit.client.1.smithi093.stdout:4/872: creat d0/d87/d79/d96/f10f x:0 0 0 2023-12-12T11:51:56.986 INFO:tasks.workunit.client.0.smithi063.stdout:2/358: dwrite d0/d1a/d1e/f4b [0,4194304] 0 2023-12-12T11:51:56.988 INFO:tasks.workunit.client.1.smithi093.stdout:2/689: dread d5/d14/f40 [0,4194304] 0 2023-12-12T11:51:56.989 INFO:tasks.workunit.client.1.smithi093.stdout:3/634: rename df/d22/d49/d69/d78/daf/d3d/d59/d72/d79/l8b to df/d22/d49/d69/d78/daf/d3d/lca 0 2023-12-12T11:51:57.005 INFO:tasks.workunit.client.0.smithi063.stdout:9/365: symlink d7/d20/d3f/l70 0 2023-12-12T11:51:57.006 INFO:tasks.workunit.client.1.smithi093.stdout:1/625: write d4/d1a/d73/f50 [3629771,18371] 0 2023-12-12T11:51:57.006 INFO:tasks.workunit.client.1.smithi093.stdout:1/626: stat d4/d1a/d1b/d26/d65/d6f/f89 0 2023-12-12T11:51:57.015 INFO:tasks.workunit.client.1.smithi093.stdout:3/635: write df/f1c [4113323,107668] 0 2023-12-12T11:51:57.017 INFO:tasks.workunit.client.0.smithi063.stdout:4/494: dwrite d2/d17/f3e [0,4194304] 0 2023-12-12T11:51:57.023 INFO:tasks.workunit.client.1.smithi093.stdout:2/690: write d5/d14/d2d/d4c/fd8 [292788,122371] 0 2023-12-12T11:51:57.023 INFO:tasks.workunit.client.1.smithi093.stdout:0/675: dwrite d5/dd/f1a [0,4194304] 0 2023-12-12T11:51:57.024 INFO:tasks.workunit.client.0.smithi063.stdout:0/406: dread d0/d7/d27/d1f/f48 [0,4194304] 0 2023-12-12T11:51:57.025 INFO:tasks.workunit.client.1.smithi093.stdout:7/609: dwrite da/d15/d2d/f51 [0,4194304] 0 2023-12-12T11:51:57.025 INFO:tasks.workunit.client.1.smithi093.stdout:7/610: fsync da/d15/d19/f1e 0 2023-12-12T11:51:57.027 INFO:tasks.workunit.client.1.smithi093.stdout:2/691: dread d5/d14/d47/d4e/fcc [0,4194304] 0 2023-12-12T11:51:57.030 INFO:tasks.workunit.client.0.smithi063.stdout:4/495: dread d2/d47/f53 [0,4194304] 0 2023-12-12T11:51:57.030 INFO:tasks.workunit.client.0.smithi063.stdout:4/496: readlink d2/d8/l36 0 2023-12-12T11:51:57.037 INFO:tasks.workunit.client.0.smithi063.stdout:6/482: dwrite d9/d10/f15 [4194304,4194304] 0 2023-12-12T11:51:57.038 INFO:tasks.workunit.client.1.smithi093.stdout:9/639: dwrite d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d57/f66 [0,4194304] 0 2023-12-12T11:51:57.038 INFO:tasks.workunit.client.1.smithi093.stdout:9/640: readlink d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/d42/lcb 0 2023-12-12T11:51:57.048 INFO:tasks.workunit.client.1.smithi093.stdout:7/611: write da/de/f4d [3529633,27324] 0 2023-12-12T11:51:57.052 INFO:tasks.workunit.client.0.smithi063.stdout:3/386: dwrite d4/df/d1a/d1c/f28 [0,4194304] 0 2023-12-12T11:51:57.052 INFO:tasks.workunit.client.0.smithi063.stdout:3/387: chown d4/df/d1a/d1c/f43 879 1 2023-12-12T11:51:57.052 INFO:tasks.workunit.client.0.smithi063.stdout:5/454: mknod d7/d10/d2b/d3c/d27/c8a 0 2023-12-12T11:51:57.052 INFO:tasks.workunit.client.0.smithi063.stdout:5/455: dread - d7/d28/d43/f68 zero size 2023-12-12T11:51:57.053 INFO:tasks.workunit.client.0.smithi063.stdout:9/366: dwrite d7/ff [0,4194304] 0 2023-12-12T11:51:57.056 INFO:tasks.workunit.client.1.smithi093.stdout:8/707: creat d3/d8/d88/fef x:0 0 0 2023-12-12T11:51:57.070 INFO:tasks.workunit.client.1.smithi093.stdout:4/873: mkdir d0/d31/d5c/d66/d110 0 2023-12-12T11:51:57.070 INFO:tasks.workunit.client.1.smithi093.stdout:4/874: stat d0/d87/d79/d86/fce 0 2023-12-12T11:51:57.072 INFO:tasks.workunit.client.0.smithi063.stdout:9/367: dread d7/f2b [0,4194304] 0 2023-12-12T11:51:57.080 INFO:tasks.workunit.client.0.smithi063.stdout:7/406: rmdir de/d39 39 2023-12-12T11:51:57.081 INFO:tasks.workunit.client.0.smithi063.stdout:2/359: link d0/d1a/d26/l53 d0/d69/l75 0 2023-12-12T11:51:57.089 INFO:tasks.workunit.client.1.smithi093.stdout:1/627: truncate d4/dc/f9f 3171974 0 2023-12-12T11:51:57.102 INFO:tasks.workunit.client.0.smithi063.stdout:7/407: dread de/d22/d2b/f2d [0,4194304] 0 2023-12-12T11:51:57.102 INFO:tasks.workunit.client.1.smithi093.stdout:8/708: dwrite d3/d1a/d1f/d29/d3a/fd3 [0,4194304] 0 2023-12-12T11:51:57.117 INFO:tasks.workunit.client.0.smithi063.stdout:0/407: mkdir d0/d8e 0 2023-12-12T11:51:57.117 INFO:tasks.workunit.client.0.smithi063.stdout:0/408: dread - d0/d1a/d23/d34/d42/f5d zero size 2023-12-12T11:51:57.117 INFO:tasks.workunit.client.0.smithi063.stdout:0/409: read - d0/d1a/d66/f87 zero size 2023-12-12T11:51:57.123 INFO:tasks.workunit.client.0.smithi063.stdout:4/497: rename d2/d47/d77 to d2/d17/d9d 0 2023-12-12T11:51:57.139 INFO:tasks.workunit.client.1.smithi093.stdout:3/636: mknod df/d22/d49/d69/d78/daf/d3d/d59/d9c/ccb 0 2023-12-12T11:51:57.143 INFO:tasks.workunit.client.0.smithi063.stdout:0/410: dread d0/d7/f55 [0,4194304] 0 2023-12-12T11:51:57.153 INFO:tasks.workunit.client.1.smithi093.stdout:3/637: fsync df/f1c 0 2023-12-12T11:51:57.153 INFO:tasks.workunit.client.1.smithi093.stdout:3/638: write df/d25/d2c/d85/f8f [1929842,87891] 0 2023-12-12T11:51:57.172 INFO:tasks.workunit.client.0.smithi063.stdout:2/360: dwrite d0/d1a/d1e/f60 [0,4194304] 0 2023-12-12T11:51:57.187 INFO:tasks.workunit.client.0.smithi063.stdout:7/408: dwrite de/d22/d4d/f91 [0,4194304] 0 2023-12-12T11:51:57.187 INFO:tasks.workunit.client.0.smithi063.stdout:7/409: write de/d39/f5e [231232,88810] 0 2023-12-12T11:51:57.187 INFO:tasks.workunit.client.1.smithi093.stdout:0/676: mkdir d5/db2/dd2 0 2023-12-12T11:51:57.192 INFO:tasks.workunit.client.0.smithi063.stdout:3/388: symlink d4/df/d1a/d1c/d34/d54/l7e 0 2023-12-12T11:51:57.194 INFO:tasks.workunit.client.0.smithi063.stdout:5/456: creat d7/d28/d6e/f8b x:0 0 0 2023-12-12T11:51:57.198 INFO:tasks.workunit.client.0.smithi063.stdout:4/498: symlink d2/d17/d4e/l9e 0 2023-12-12T11:51:57.199 INFO:tasks.workunit.client.0.smithi063.stdout:6/483: getdents d9/d10/d2a 0 2023-12-12T11:51:57.199 INFO:tasks.workunit.client.0.smithi063.stdout:6/484: dread - d9/d10/f96 zero size 2023-12-12T11:51:57.199 INFO:tasks.workunit.client.0.smithi063.stdout:6/485: creat d9/d68/f9d x:0 0 0 2023-12-12T11:51:57.205 INFO:tasks.workunit.client.0.smithi063.stdout:0/411: truncate d0/d7/d27/d19/f51 3179007 0 2023-12-12T11:51:57.209 INFO:tasks.workunit.client.0.smithi063.stdout:3/389: dread d4/df/d1a/d1c/d41/f51 [0,4194304] 0 2023-12-12T11:51:57.209 INFO:tasks.workunit.client.1.smithi093.stdout:2/692: mknod d5/d14/d2d/d4c/da1/de4/ceb 0 2023-12-12T11:51:57.209 INFO:tasks.workunit.client.1.smithi093.stdout:2/693: chown d5/d14/d47 99 1 2023-12-12T11:51:57.217 INFO:tasks.workunit.client.0.smithi063.stdout:0/412: read d0/d7/d27/d1f/f30 [5896950,15496] 0 2023-12-12T11:51:57.224 INFO:tasks.workunit.client.0.smithi063.stdout:2/361: creat d0/d1a/d48/d56/f76 x:0 0 0 2023-12-12T11:51:57.224 INFO:tasks.workunit.client.0.smithi063.stdout:2/362: chown d0/d1a/d1e/d64/l72 1578118 1 2023-12-12T11:51:57.224 INFO:tasks.workunit.client.0.smithi063.stdout:2/363: fdatasync d0/f45 0 2023-12-12T11:51:57.225 INFO:tasks.workunit.client.1.smithi093.stdout:2/694: write d5/d14/d2d/d4c/d54/dc5/d55/f95 [3636218,108284] 0 2023-12-12T11:51:57.225 INFO:tasks.workunit.client.1.smithi093.stdout:2/695: read - d5/d14/d47/d56/fe8 zero size 2023-12-12T11:51:57.225 INFO:tasks.workunit.client.1.smithi093.stdout:9/641: mknod d1/d23/d24/d29/d43/d56/d85/dc3/dce/d3e/cd8 0 2023-12-12T11:51:57.233 INFO:tasks.workunit.client.0.smithi063.stdout:5/457: mknod d7/de/c8c 0 2023-12-12T11:51:57.240 INFO:tasks.workunit.client.0.smithi063.stdout:4/499: rename d2/d47/c64 to d2/d48/d69/c9f 0 2023-12-12T11:51:57.246 INFO:tasks.workunit.client.0.smithi063.stdout:6/486: symlink d9/d2c/d6b/l9e 0 2023-12-12T11:51:57.246 INFO:tasks.workunit.client.0.smithi063.stdout:6/487: write d9/f59 [1019074,82190] 0 2023-12-12T11:51:57.250 INFO:tasks.workunit.client.0.smithi063.stdout:3/390: symlink d4/df/d1a/d1c/d34/l7f 0 2023-12-12T11:51:57.255 INFO:tasks.workunit.client.0.smithi063.stdout:0/413: rmdir d0/d7 39 2023-12-12T11:51:57.259 INFO:tasks.workunit.client.0.smithi063.stdout:2/364: mkdir d0/d1a/d48/d56/d77 0 2023-12-12T11:51:57.262 INFO:tasks.workunit.client.1.smithi093.stdout:9/642: dwrite d1/d23/d24/d29/d43/d56/d68/fd1 [0,4194304] 0 2023-12-12T11:51:57.262 INFO:tasks.workunit.client.1.smithi093.stdout:9/643: write d1/d23/d24/d29/da3/fc7 [678059,64448] 0 2023-12-12T11:51:57.267 INFO:tasks.workunit.client.0.smithi063.stdout:7/410: unlink de/d22/l27 0 2023-12-12T11:51:57.267 INFO:tasks.workunit.client.0.smithi063.stdout:6/488: write d9/f3b [888796,109525] 0 2023-12-12T11:51:57.269 INFO:tasks.workunit.client.1.smithi093.stdout:7/612: mknod da/d8e/cd5 0 2023-12-12T11:51:57.271 INFO:tasks.workunit.client.0.smithi063.stdout:4/500: creat d2/d47/d6d/d88/fa0 x:0 0 0 2023-12-12T11:51:57.279 INFO:tasks.workunit.client.0.smithi063.stdout:2/365: creat d0/d1a/d3a/d59/f78 x:0 0 0 2023-12-12T11:51:57.280 INFO:tasks.workunit.client.0.smithi063.stdout:6/489: rename d9/d10/f92 to d9/d10/d5c/f9f 0 2023-12-12T11:51:57.281 INFO:tasks.workunit.client.0.smithi063.stdout:6/490: write d9/d10/f4c [560849,80200] 0 2023-12-12T11:51:57.281 INFO:tasks.workunit.client.0.smithi063.stdout:6/491: truncate d9/d10/f58 524601 0 2023-12-12T11:51:57.285 INFO:tasks.workunit.client.1.smithi093.stdout:7/613: dread da/de/f53 [0,4194304] 0 2023-12-12T11:51:57.287 INFO:tasks.workunit.client.1.smithi093.stdout:5/551: symlink d0/d7/d36/d38/lba 0 2023-12-12T11:51:57.291 INFO:tasks.workunit.client.0.smithi063.stdout:6/492: link d9/d10/f15 d9/d68/d94/fa0 0 2023-12-12T11:51:57.291 INFO:tasks.workunit.client.0.smithi063.stdout:6/493: chown c2 30952 1 2023-12-12T11:51:57.291 INFO:tasks.workunit.client.0.smithi063.stdout:6/494: write d9/d2c/d6b/d8a/f9a [684865,33496] 0 2023-12-12T11:51:57.292 INFO:tasks.workunit.client.0.smithi063.stdout:4/501: write d2/d8/fa [157402,37192] 0 2023-12-12T11:51:57.292 INFO:tasks.workunit.client.0.smithi063.stdout:4/502: fdatasync d2/f6 0 2023-12-12T11:51:57.293 INFO:tasks.workunit.client.0.smithi063.stdout:3/391: dwrite d4/d23/d5d/d4c/f66 [0,4194304] 0 2023-12-12T11:51:57.295 INFO:tasks.workunit.client.1.smithi093.stdout:4/875: mknod d0/d87/d79/c111 0 2023-12-12T11:51:57.295 INFO:tasks.workunit.client.1.smithi093.stdout:4/876: stat d0/d31/d5c/d6c/da4 0 2023-12-12T11:51:57.295 INFO:tasks.workunit.client.1.smithi093.stdout:4/877: fdatasync d0/d36/d49/f8c 0 2023-12-12T11:51:57.296 INFO:tasks.workunit.client.0.smithi063.stdout:2/366: rmdir d0/d1a/d1e/d64 39 2023-12-12T11:51:57.306 INFO:tasks.workunit.client.1.smithi093.stdout:1/628: rename d4/d1a/d1b/d26/d40/lc4 to d4/d1a/d1b/d26/d65/d6f/db3/lcf 0 2023-12-12T11:51:57.319 INFO:tasks.workunit.client.0.smithi063.stdout:3/392: creat d4/df/f80 x:0 0 0 2023-12-12T11:51:57.322 INFO:tasks.workunit.client.1.smithi093.stdout:8/709: link d3/d1a/d1f/d59/d6c/ca6 d3/d1a/d1f/daf/cf0 0 2023-12-12T11:51:57.325 INFO:tasks.workunit.client.0.smithi063.stdout:2/367: rename d0/d1a/d57/l5c to d0/d1a/d3a/d59/l79 0 2023-12-12T11:51:57.327 INFO:tasks.workunit.client.1.smithi093.stdout:3/639: mkdir df/d22/d49/d69/d78/daf/d3d/d59/d72/dcc 0 2023-12-12T11:51:57.337 INFO:tasks.workunit.client.1.smithi093.stdout:7/614: dwrite da/d15/d59/f66 [0,4194304] 0 2023-12-12T11:51:57.338 INFO:tasks.workunit.client.0.smithi063.stdout:0/414: dwrite d0/d1a/d23/d34/d42/f3e [4194304,4194304] 0 2023-12-12T11:51:57.338 INFO:tasks.workunit.client.0.smithi063.stdout:0/415: chown d0/d1a/d23/d34/d42/l18 287623 1 2023-12-12T11:51:57.339 INFO:tasks.workunit.client.1.smithi093.stdout:2/696: mknod d5/d14/d2d/d8b/da3/cec 0 2023-12-12T11:51:57.339 INFO:tasks.workunit.client.1.smithi093.stdout:2/697: readlink d5/d14/d47/d56/l5d 0 2023-12-12T11:51:57.347 INFO:tasks.workunit.client.0.smithi063.stdout:3/393: unlink d4/df/d1a/d1c/d34/l7f 0 2023-12-12T11:51:57.350 INFO:tasks.workunit.client.0.smithi063.stdout:2/368: truncate d0/f5f 2343616 0 2023-12-12T11:51:57.356 INFO:tasks.workunit.client.0.smithi063.stdout:7/411: dwrite de/d33/d41/d44/f6b [0,4194304] 0 2023-12-12T11:51:57.357 INFO:tasks.workunit.client.1.smithi093.stdout:9/644: symlink d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/dae/ld9 0 2023-12-12T11:51:57.360 INFO:tasks.workunit.client.0.smithi063.stdout:0/416: getdents d0/d1a/d23 0 2023-12-12T11:51:57.365 INFO:tasks.workunit.client.1.smithi093.stdout:5/552: mknod d0/d7/d85/da0/da7/cbb 0 2023-12-12T11:51:57.366 INFO:tasks.workunit.client.1.smithi093.stdout:4/878: getdents d0/d87/d79/d96/db5/ddd 0 2023-12-12T11:51:57.367 INFO:tasks.workunit.client.1.smithi093.stdout:4/879: readlink d0/d36/la7 0 2023-12-12T11:51:57.367 INFO:tasks.workunit.client.1.smithi093.stdout:4/880: truncate d0/f91 478104 0 2023-12-12T11:51:57.369 INFO:tasks.workunit.client.0.smithi063.stdout:3/394: rename d4/df/d1a/d1c/d3b/d50/d71 to d4/df/d1a/d1c/d3b/d81 0 2023-12-12T11:51:57.369 INFO:tasks.workunit.client.0.smithi063.stdout:3/395: write d4/df/d1a/d1c/d34/f6a [1847757,2295] 0 2023-12-12T11:51:57.369 INFO:tasks.workunit.client.0.smithi063.stdout:9/368: mknod d7/d15/c71 0 2023-12-12T11:51:57.369 INFO:tasks.workunit.client.0.smithi063.stdout:9/369: stat d7/d11/d12/d30/c36 0 2023-12-12T11:51:57.372 INFO:tasks.workunit.client.1.smithi093.stdout:1/629: rename d4/dc/d7a/d9c/fa2 to d4/d1a/d83/d9a/fd0 0 2023-12-12T11:51:57.373 INFO:tasks.workunit.client.1.smithi093.stdout:8/710: dwrite d3/d1a/d1f/fec [0,4194304] 0 2023-12-12T11:51:57.376 INFO:tasks.workunit.client.1.smithi093.stdout:3/640: creat df/d22/d49/d69/d78/daf/d3d/d59/d9c/fcd x:0 0 0 2023-12-12T11:51:57.378 INFO:tasks.workunit.client.0.smithi063.stdout:7/412: truncate de/f21 1422732 0 2023-12-12T11:51:57.385 INFO:tasks.workunit.client.1.smithi093.stdout:7/615: mkdir da/d8e/daa/dd6 0 2023-12-12T11:51:57.394 INFO:tasks.workunit.client.1.smithi093.stdout:9/645: creat d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d57/fda x:0 0 0 2023-12-12T11:51:57.396 INFO:tasks.workunit.client.0.smithi063.stdout:9/370: link d7/d11/d12/f3d d7/d20/d65/f72 0 2023-12-12T11:51:57.400 INFO:tasks.workunit.client.1.smithi093.stdout:4/881: dwrite d0/d87/d79/d86/fc4 [0,4194304] 0 2023-12-12T11:51:57.403 INFO:tasks.workunit.client.0.smithi063.stdout:2/369: symlink d0/d1a/d1e/l7a 0 2023-12-12T11:51:57.403 INFO:tasks.workunit.client.0.smithi063.stdout:2/370: chown d0/l12 32 1 2023-12-12T11:51:57.403 INFO:tasks.workunit.client.0.smithi063.stdout:2/371: chown d0/d1a/d48/d56/f76 587705691 1 2023-12-12T11:51:57.405 INFO:tasks.workunit.client.0.smithi063.stdout:0/417: symlink d0/d7/d27/l8f 0 2023-12-12T11:51:57.406 INFO:tasks.workunit.client.0.smithi063.stdout:7/413: dread fb [0,4194304] 0 2023-12-12T11:51:57.407 INFO:tasks.workunit.client.1.smithi093.stdout:5/553: creat d0/d7/d85/da0/da7/fbc x:0 0 0 2023-12-12T11:51:57.410 INFO:tasks.workunit.client.0.smithi063.stdout:3/396: link d4/df/d1a/f20 d4/d23/d5d/d62/f82 0 2023-12-12T11:51:57.410 INFO:tasks.workunit.client.0.smithi063.stdout:3/397: dread - d4/df/d1a/d1c/d3b/f5b zero size 2023-12-12T11:51:57.412 INFO:tasks.workunit.client.1.smithi093.stdout:1/630: creat d4/d1a/dc2/fd1 x:0 0 0 2023-12-12T11:51:57.418 INFO:tasks.workunit.client.1.smithi093.stdout:8/711: dwrite d3/d1a/d1f/d29/d3a/db1/fcf [0,4194304] 0 2023-12-12T11:51:57.418 INFO:tasks.workunit.client.1.smithi093.stdout:8/712: write d3/d1a/f2b [1416487,11423] 0 2023-12-12T11:51:57.418 INFO:tasks.workunit.client.1.smithi093.stdout:8/713: write d3/d73/fd9 [927210,123856] 0 2023-12-12T11:51:57.418 INFO:tasks.workunit.client.1.smithi093.stdout:8/714: write d3/d1a/d1f/d29/d3a/d68/d8a/f90 [1279223,124947] 0 2023-12-12T11:51:57.418 INFO:tasks.workunit.client.1.smithi093.stdout:3/641: mknod df/dc6/cce 0 2023-12-12T11:51:57.418 INFO:tasks.workunit.client.1.smithi093.stdout:3/642: fdatasync df/d22/d49/d69/d78/daf/d3d/d59/f5c 0 2023-12-12T11:51:57.420 INFO:tasks.workunit.client.0.smithi063.stdout:9/371: dread d7/d20/d45/d46/d51/f5d [0,4194304] 0 2023-12-12T11:51:57.420 INFO:tasks.workunit.client.1.smithi093.stdout:7/616: mknod da/d15/d59/cd7 0 2023-12-12T11:51:57.425 INFO:tasks.workunit.client.0.smithi063.stdout:1/478: sync 2023-12-12T11:51:57.425 INFO:tasks.workunit.client.0.smithi063.stdout:8/496: sync 2023-12-12T11:51:57.425 INFO:tasks.workunit.client.0.smithi063.stdout:8/497: fdatasync d4/de/d3b/d62/d36/d57/f89 0 2023-12-12T11:51:57.426 INFO:tasks.workunit.client.1.smithi093.stdout:9/646: creat d1/d23/d24/d89/fdb x:0 0 0 2023-12-12T11:51:57.426 INFO:tasks.workunit.client.1.smithi093.stdout:9/647: read d1/f4f [2457595,79724] 0 2023-12-12T11:51:57.426 INFO:tasks.workunit.client.1.smithi093.stdout:9/648: fdatasync d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/f9d 0 2023-12-12T11:51:57.429 INFO:tasks.workunit.client.0.smithi063.stdout:7/414: mknod de/d39/d4b/d7b/d7f/c98 0 2023-12-12T11:51:57.433 INFO:tasks.workunit.client.0.smithi063.stdout:9/372: symlink d7/l73 0 2023-12-12T11:51:57.435 INFO:tasks.workunit.client.0.smithi063.stdout:1/479: creat d3/db/d16/d24/d48/d75/d83/d5b/f9b x:0 0 0 2023-12-12T11:51:57.435 INFO:tasks.workunit.client.0.smithi063.stdout:1/480: stat d3/db/c45 0 2023-12-12T11:51:57.437 INFO:tasks.workunit.client.1.smithi093.stdout:6/788: creat d0/d52/d7e/f121 x:0 0 0 2023-12-12T11:51:57.440 INFO:tasks.workunit.client.0.smithi063.stdout:8/498: truncate d4/de/d1e/f33 1565460 0 2023-12-12T11:51:57.440 INFO:tasks.workunit.client.0.smithi063.stdout:8/499: chown d4/d24/d38/d45/d5b/d92/d65/f8d 122776 1 2023-12-12T11:51:57.440 INFO:tasks.workunit.client.0.smithi063.stdout:8/500: chown d4/l48 7 1 2023-12-12T11:51:57.440 INFO:tasks.workunit.client.0.smithi063.stdout:1/481: truncate d3/db/d16/d24/d4d/f68 1464706 0 2023-12-12T11:51:57.445 INFO:tasks.workunit.client.1.smithi093.stdout:6/789: dread d0/da/d14/d38/d43/f86 [0,4194304] 0 2023-12-12T11:51:57.451 INFO:tasks.workunit.client.0.smithi063.stdout:1/482: creat d3/db/d16/d24/d30/f9c x:0 0 0 2023-12-12T11:51:57.455 INFO:tasks.workunit.client.0.smithi063.stdout:1/483: creat d3/db/d16/d24/d48/d75/d83/d5b/d6b/d6d/d7e/f9d x:0 0 0 2023-12-12T11:51:57.462 INFO:tasks.workunit.client.0.smithi063.stdout:1/484: creat d3/db/d16/d24/d48/d75/d83/f9e x:0 0 0 2023-12-12T11:51:57.462 INFO:tasks.workunit.client.1.smithi093.stdout:7/617: dwrite da/d2e/d89/fbf [0,4194304] 0 2023-12-12T11:51:57.462 INFO:tasks.workunit.client.1.smithi093.stdout:7/618: chown da/de/d46/f52 2460471 1 2023-12-12T11:51:57.462 INFO:tasks.workunit.client.1.smithi093.stdout:7/619: write da/de/d46/fbe [562662,103293] 0 2023-12-12T11:51:57.462 INFO:tasks.workunit.client.1.smithi093.stdout:7/620: write da/de/fb1 [1911224,104519] 0 2023-12-12T11:51:57.465 INFO:tasks.workunit.client.1.smithi093.stdout:5/554: creat d0/d7/d36/db9/d66/d7c/db5/fbd x:0 0 0 2023-12-12T11:51:57.465 INFO:tasks.workunit.client.1.smithi093.stdout:5/555: chown d0/d7/d8/f37 74010210 1 2023-12-12T11:51:57.469 INFO:tasks.workunit.client.0.smithi063.stdout:3/398: dwrite d4/df/d1a/d1c/d3b/f5b [0,4194304] 0 2023-12-12T11:51:57.470 INFO:tasks.workunit.client.1.smithi093.stdout:6/790: write d0/d52/d7e/d42/f53 [14369,38210] 0 2023-12-12T11:51:57.476 INFO:tasks.workunit.client.1.smithi093.stdout:8/715: rename d3/d1a/d1f/d59/l7c to d3/d1a/d1f/d29/d3a/d40/lf1 0 2023-12-12T11:51:57.476 INFO:tasks.workunit.client.1.smithi093.stdout:8/716: creat d3/d1a/d1f/d59/d69/ff2 x:0 0 0 2023-12-12T11:51:57.476 INFO:tasks.workunit.client.1.smithi093.stdout:8/717: chown d3/d1a/d1f/d29/d3a/d68/l9a 17505 1 2023-12-12T11:51:57.480 INFO:tasks.workunit.client.0.smithi063.stdout:3/399: getdents d4/d23/d5d/d4c/d56 0 2023-12-12T11:51:57.481 INFO:tasks.workunit.client.1.smithi093.stdout:3/643: creat df/d25/d2c/d85/fcf x:0 0 0 2023-12-12T11:51:57.486 INFO:tasks.workunit.client.1.smithi093.stdout:7/621: rename da/de/f3e to da/de/fd8 0 2023-12-12T11:51:57.487 INFO:tasks.workunit.client.0.smithi063.stdout:0/418: unlink d0/d1a/d23/c3d 0 2023-12-12T11:51:57.488 INFO:tasks.workunit.client.1.smithi093.stdout:4/882: getdents d0/d87/d79/d7f 0 2023-12-12T11:51:57.493 INFO:tasks.workunit.client.1.smithi093.stdout:6/791: link d0/da/d14/d3a/d95/ce7 d0/d52/d7e/d42/c122 0 2023-12-12T11:51:57.496 INFO:tasks.workunit.client.1.smithi093.stdout:9/649: rename d1/d23/d24/d29/d43/f71 to d1/d23/d6b/d92/d9f/fdc 0 2023-12-12T11:51:57.496 INFO:tasks.workunit.client.1.smithi093.stdout:9/650: chown d1/d23/d24/d29/d43/d56/cbb 67305 1 2023-12-12T11:51:57.497 INFO:tasks.workunit.client.0.smithi063.stdout:5/458: mknod d7/d10/d2b/d3c/c8d 0 2023-12-12T11:51:57.497 INFO:tasks.workunit.client.0.smithi063.stdout:5/459: chown d7/l71 1539200 1 2023-12-12T11:51:57.497 INFO:tasks.workunit.client.0.smithi063.stdout:5/460: fsync d7/f12 0 2023-12-12T11:51:57.498 INFO:tasks.workunit.client.0.smithi063.stdout:5/461: creat d7/d10/d2b/d3c/d27/f8e x:0 0 0 2023-12-12T11:51:57.499 INFO:tasks.workunit.client.0.smithi063.stdout:0/419: rename d0/d7/d27/d19/d2d/f49 to d0/d7/d27/f90 0 2023-12-12T11:51:57.515 INFO:tasks.workunit.client.1.smithi093.stdout:4/883: creat d0/d31/d89/da1/dcd/f112 x:0 0 0 2023-12-12T11:51:57.515 INFO:tasks.workunit.client.1.smithi093.stdout:4/884: chown d0/d31/d89/lb0 2465 1 2023-12-12T11:51:57.517 INFO:tasks.workunit.client.1.smithi093.stdout:3/644: dwrite df/d22/d49/d69/d78/daf/d3d/d42/d8e/da5/fb0 [0,4194304] 0 2023-12-12T11:51:57.520 INFO:tasks.workunit.client.1.smithi093.stdout:7/622: rename da/de/d46/f47 to da/d8e/dbc/fd9 0 2023-12-12T11:51:57.522 INFO:tasks.workunit.client.1.smithi093.stdout:9/651: mkdir d1/d23/d6b/d92/ddd 0 2023-12-12T11:51:57.525 INFO:tasks.workunit.client.0.smithi063.stdout:8/501: read d4/d55/f34 [4286578,81455] 0 2023-12-12T11:51:57.530 INFO:tasks.workunit.client.0.smithi063.stdout:1/485: write d3/db/d16/f5c [5825142,24469] 0 2023-12-12T11:51:57.530 INFO:tasks.workunit.client.0.smithi063.stdout:1/486: chown d3/db/d16/d24/f2a 49562 1 2023-12-12T11:51:57.531 INFO:tasks.workunit.client.0.smithi063.stdout:1/487: write d3/db/d16/d24/f73 [1868628,36855] 0 2023-12-12T11:51:57.532 INFO:tasks.workunit.client.1.smithi093.stdout:4/885: truncate d0/d36/f75 3864530 0 2023-12-12T11:51:57.534 INFO:tasks.workunit.client.0.smithi063.stdout:9/373: dwrite d7/d11/d12/f3d [4194304,4194304] 0 2023-12-12T11:51:57.539 INFO:tasks.workunit.client.0.smithi063.stdout:3/400: dwrite d4/f3f [4194304,4194304] 0 2023-12-12T11:51:57.547 INFO:tasks.workunit.client.0.smithi063.stdout:3/401: rename d4/df/f2c to d4/df/d1a/d1c/d3b/d50/d61/f83 0 2023-12-12T11:51:57.551 INFO:tasks.workunit.client.0.smithi063.stdout:5/462: write d7/d10/f1b [3617478,33403] 0 2023-12-12T11:51:57.551 INFO:tasks.workunit.client.0.smithi063.stdout:5/463: write d7/de/f30 [4304816,117759] 0 2023-12-12T11:51:57.560 INFO:tasks.workunit.client.0.smithi063.stdout:5/464: rmdir d7/d28 39 2023-12-12T11:51:57.560 INFO:tasks.workunit.client.1.smithi093.stdout:0/677: write d5/d21/d27/d3a/f4a [2407411,111857] 0 2023-12-12T11:51:57.563 INFO:tasks.workunit.client.0.smithi063.stdout:3/402: link d4/df/d1a/f2b d4/df/d1a/d1c/d41/f84 0 2023-12-12T11:51:57.564 INFO:tasks.workunit.client.0.smithi063.stdout:5/465: rmdir d7/d10/d2b/d3c/d5a 39 2023-12-12T11:51:57.566 INFO:tasks.workunit.client.1.smithi093.stdout:7/623: rmdir da/de/d81 39 2023-12-12T11:51:57.566 INFO:tasks.workunit.client.1.smithi093.stdout:0/678: dread d5/d41/d77/d79/d9b/fc9 [4194304,4194304] 0 2023-12-12T11:51:57.566 INFO:tasks.workunit.client.1.smithi093.stdout:0/679: write d5/dd/f16 [2576943,82558] 0 2023-12-12T11:51:57.567 INFO:tasks.workunit.client.1.smithi093.stdout:0/680: write d5/d21/fb1 [1031142,124087] 0 2023-12-12T11:51:57.567 INFO:tasks.workunit.client.0.smithi063.stdout:3/403: creat d4/df/d1a/d1c/d34/f85 x:0 0 0 2023-12-12T11:51:57.569 INFO:tasks.workunit.client.1.smithi093.stdout:9/652: mknod d1/d23/d24/d29/d43/d58/cde 0 2023-12-12T11:51:57.572 INFO:tasks.workunit.client.0.smithi063.stdout:5/466: symlink d7/d10/d2b/d3c/d5a/l8f 0 2023-12-12T11:51:57.574 INFO:tasks.workunit.client.1.smithi093.stdout:4/886: truncate d0/d31/d5c/d6c/f95 542759 0 2023-12-12T11:51:57.576 INFO:tasks.workunit.client.0.smithi063.stdout:5/467: rename d7/d28/d43/d49/f6d to d7/d28/d67/f90 0 2023-12-12T11:51:57.577 INFO:tasks.workunit.client.0.smithi063.stdout:1/488: write d3/f1a [2200847,10741] 0 2023-12-12T11:51:57.578 INFO:tasks.workunit.client.0.smithi063.stdout:0/420: dwrite d0/d7/f47 [4194304,4194304] 0 2023-12-12T11:51:57.578 INFO:tasks.workunit.client.1.smithi093.stdout:3/645: getdents df/d22/d49/d69/d78/dad 0 2023-12-12T11:51:57.578 INFO:tasks.workunit.client.1.smithi093.stdout:3/646: readlink df/d25/d2c/l37 0 2023-12-12T11:51:57.579 INFO:tasks.workunit.client.1.smithi093.stdout:3/647: readlink df/l11 0 2023-12-12T11:51:57.580 INFO:tasks.workunit.client.1.smithi093.stdout:4/887: dread d0/d87/d79/fed [0,4194304] 0 2023-12-12T11:51:57.580 INFO:tasks.workunit.client.1.smithi093.stdout:5/556: link d0/d7/l17 d0/d7/d59/lbe 0 2023-12-12T11:51:57.581 INFO:tasks.workunit.client.0.smithi063.stdout:5/468: rmdir d7/d28/d43/d49 39 2023-12-12T11:51:57.582 INFO:tasks.workunit.client.1.smithi093.stdout:7/624: mkdir da/d8e/da9/dda 0 2023-12-12T11:51:57.583 INFO:tasks.workunit.client.1.smithi093.stdout:7/625: stat da/d15/d59 0 2023-12-12T11:51:57.583 INFO:tasks.workunit.client.1.smithi093.stdout:7/626: write da/d15/d19/d90/f87 [1393437,2003] 0 2023-12-12T11:51:57.585 INFO:tasks.workunit.client.1.smithi093.stdout:0/681: link d5/dd/d14/d26/d58/d64/ccb d5/d78/da4/cd3 0 2023-12-12T11:51:57.592 INFO:tasks.workunit.client.1.smithi093.stdout:7/627: dread da/de/f44 [4194304,4194304] 0 2023-12-12T11:51:57.592 INFO:tasks.workunit.client.0.smithi063.stdout:1/489: unlink d3/db/d16/d24/d48/d75/d83/d5b/l8b 0 2023-12-12T11:51:57.594 INFO:tasks.workunit.client.0.smithi063.stdout:0/421: mknod d0/d1a/d23/d34/c91 0 2023-12-12T11:51:57.597 INFO:tasks.workunit.client.0.smithi063.stdout:3/404: read d4/df/d1a/d1c/f29 [2336688,121452] 0 2023-12-12T11:51:57.597 INFO:tasks.workunit.client.0.smithi063.stdout:3/405: fdatasync d4/f44 0 2023-12-12T11:51:57.600 INFO:tasks.workunit.client.0.smithi063.stdout:5/469: link d7/d10/f14 d7/d10/d2b/f91 0 2023-12-12T11:51:57.600 INFO:tasks.workunit.client.0.smithi063.stdout:5/470: chown d7/f1a 2 1 2023-12-12T11:51:57.608 INFO:tasks.workunit.client.0.smithi063.stdout:1/490: creat d3/db/d16/d17/d4b/d8c/f9f x:0 0 0 2023-12-12T11:51:57.611 INFO:tasks.workunit.client.0.smithi063.stdout:3/406: rmdir d4/d23/d5d/d4c 39 2023-12-12T11:51:57.614 INFO:tasks.workunit.client.0.smithi063.stdout:5/471: creat d7/d10/f92 x:0 0 0 2023-12-12T11:51:57.617 INFO:tasks.workunit.client.0.smithi063.stdout:6/495: unlink d9/d2c/c49 0 2023-12-12T11:51:57.617 INFO:tasks.workunit.client.0.smithi063.stdout:6/496: write d9/d10/f96 [859161,18442] 0 2023-12-12T11:51:57.619 INFO:tasks.workunit.client.1.smithi093.stdout:5/557: dwrite d0/d7/d36/d38/f40 [0,4194304] 0 2023-12-12T11:51:57.619 INFO:tasks.workunit.client.0.smithi063.stdout:1/491: symlink d3/d3a/d5e/la0 0 2023-12-12T11:51:57.620 INFO:tasks.workunit.client.0.smithi063.stdout:1/492: chown d3/d3a/d5e/f87 2824 1 2023-12-12T11:51:57.624 INFO:tasks.workunit.client.1.smithi093.stdout:7/628: unlink da/d15/cbd 0 2023-12-12T11:51:57.626 INFO:tasks.workunit.client.0.smithi063.stdout:3/407: symlink d4/df/d1a/d1c/d3b/d52/d74/l86 0 2023-12-12T11:51:57.631 INFO:tasks.workunit.client.0.smithi063.stdout:1/493: symlink d3/d3a/d5e/la1 0 2023-12-12T11:51:57.635 INFO:tasks.workunit.client.0.smithi063.stdout:3/408: unlink d4/df/d1a/d1c/d3b/d52/d74/l86 0 2023-12-12T11:51:57.639 INFO:tasks.workunit.client.1.smithi093.stdout:5/558: symlink d0/d7/d36/db9/lbf 0 2023-12-12T11:51:57.639 INFO:tasks.workunit.client.0.smithi063.stdout:1/494: mknod d3/db/d12/ca2 0 2023-12-12T11:51:57.640 INFO:tasks.workunit.client.1.smithi093.stdout:7/629: dread da/de/d46/d4f/fa8 [0,4194304] 0 2023-12-12T11:51:57.643 INFO:tasks.workunit.client.0.smithi063.stdout:3/409: rename d4/df/d1a/d1c/d3b/c45 to d4/d23/d5d/d4c/d56/c87 0 2023-12-12T11:51:57.645 INFO:tasks.workunit.client.1.smithi093.stdout:7/630: symlink da/d8e/daa/db3/ldb 0 2023-12-12T11:51:57.645 INFO:tasks.workunit.client.1.smithi093.stdout:7/631: chown da/d15/d2d/f34 7 1 2023-12-12T11:51:57.646 INFO:tasks.workunit.client.1.smithi093.stdout:7/632: creat da/d8e/daf/fdc x:0 0 0 2023-12-12T11:51:57.650 INFO:tasks.workunit.client.1.smithi093.stdout:7/633: write da/de/d46/fbe [243086,87241] 0 2023-12-12T11:51:57.651 INFO:tasks.workunit.client.0.smithi063.stdout:0/422: dwrite d0/d7/d27/d19/f86 [0,4194304] 0 2023-12-12T11:51:57.660 INFO:tasks.workunit.client.0.smithi063.stdout:0/423: symlink d0/d8e/l92 0 2023-12-12T11:51:57.661 INFO:tasks.workunit.client.0.smithi063.stdout:0/424: write d0/d1a/d23/d2e/f5e [523579,40172] 0 2023-12-12T11:51:57.662 INFO:tasks.workunit.client.0.smithi063.stdout:0/425: write d0/d1a/d66/f87 [96583,107905] 0 2023-12-12T11:51:57.671 INFO:tasks.workunit.client.0.smithi063.stdout:3/410: dread d4/df/d1a/d1c/d3b/d50/d61/f83 [0,4194304] 0 2023-12-12T11:51:57.671 INFO:tasks.workunit.client.0.smithi063.stdout:0/426: link d0/d1a/d23/d2e/c38 d0/c93 0 2023-12-12T11:51:57.671 INFO:tasks.workunit.client.0.smithi063.stdout:0/427: truncate d0/d1a/f76 652599 0 2023-12-12T11:51:57.672 INFO:tasks.workunit.client.0.smithi063.stdout:0/428: chown d0/d1a/l41 399 1 2023-12-12T11:51:57.677 INFO:tasks.workunit.client.0.smithi063.stdout:0/429: unlink d0/d7/d27/d1f/f59 0 2023-12-12T11:51:57.677 INFO:tasks.workunit.client.0.smithi063.stdout:0/430: chown d0/d1a/d23/l5c 8023838 1 2023-12-12T11:51:57.688 INFO:tasks.workunit.client.0.smithi063.stdout:5/472: dwrite d7/de/f1e [0,4194304] 0 2023-12-12T11:51:57.704 INFO:tasks.workunit.client.0.smithi063.stdout:6/497: dwrite d9/d10/d2a/f34 [0,4194304] 0 2023-12-12T11:51:57.711 INFO:tasks.workunit.client.1.smithi093.stdout:1/631: write d4/dc/f9f [2314002,66121] 0 2023-12-12T11:51:57.711 INFO:tasks.workunit.client.1.smithi093.stdout:6/792: rmdir d0 39 2023-12-12T11:51:57.719 INFO:tasks.workunit.client.1.smithi093.stdout:1/632: mknod d4/d85/cd2 0 2023-12-12T11:51:57.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:57 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:51:57.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:57 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:51:57.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:57 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:51:57.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:57 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:51:57.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:57 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:51:57.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:57 smithi093 ceph-mon[115914]: Adjusting osd_memory_target on smithi063 to 1618M 2023-12-12T11:51:57.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:57 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:51:57.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:57 smithi093 ceph-mon[115914]: pgmap v13: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 142 MiB/s rd, 186 MiB/s wr, 264 op/s 2023-12-12T11:51:57.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:57 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:51:57.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:57 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:51:57.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:57 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:51:57.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:57 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:51:57.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:57 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:51:57.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:57 smithi093 ceph-mon[115914]: Adjusting osd_memory_target on smithi093 to 2642M 2023-12-12T11:51:57.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:57 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:51:57.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:57 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:51:57.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:57 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:51:57.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:57 smithi093 ceph-mon[115914]: Updating smithi063:/etc/ceph/ceph.conf 2023-12-12T11:51:57.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:57 smithi093 ceph-mon[115914]: Updating smithi093:/etc/ceph/ceph.conf 2023-12-12T11:51:57.723 INFO:tasks.workunit.client.0.smithi063.stdout:6/498: rmdir d9/d2c/d6b 39 2023-12-12T11:51:57.723 INFO:tasks.workunit.client.0.smithi063.stdout:6/499: read d9/d10/f41 [3542362,108518] 0 2023-12-12T11:51:57.725 INFO:tasks.workunit.client.1.smithi093.stdout:6/793: getdents d0/d52/d7e/d102 0 2023-12-12T11:51:57.737 INFO:tasks.workunit.client.1.smithi093.stdout:6/794: dread d0/da/d14/d3a/f47 [0,4194304] 0 2023-12-12T11:51:57.737 INFO:tasks.workunit.client.0.smithi063.stdout:3/411: dwrite d4/df/d1a/d1c/d41/f51 [0,4194304] 0 2023-12-12T11:51:57.740 INFO:tasks.workunit.client.1.smithi093.stdout:1/633: write d4/d1a/d1b/d26/d65/f8a [2952048,30952] 0 2023-12-12T11:51:57.740 INFO:tasks.workunit.client.1.smithi093.stdout:1/634: write d4/d1a/d73/f95 [438320,11345] 0 2023-12-12T11:51:57.743 INFO:tasks.workunit.client.1.smithi093.stdout:6/795: symlink d0/d52/dbc/l123 0 2023-12-12T11:51:57.750 INFO:tasks.workunit.client.0.smithi063.stdout:3/412: write d4/f25 [1104169,66600] 0 2023-12-12T11:51:57.754 INFO:tasks.workunit.client.1.smithi093.stdout:1/635: link d4/d1a/d1b/d26/d65/d6f/f96 d4/d1a/d1b/dbf/fd3 0 2023-12-12T11:51:57.757 INFO:tasks.workunit.client.0.smithi063.stdout:5/473: rmdir d7/d28/d67 39 2023-12-12T11:51:57.759 INFO:tasks.workunit.client.0.smithi063.stdout:0/431: dwrite d0/d1a/d23/f7e [0,4194304] 0 2023-12-12T11:51:57.763 INFO:tasks.workunit.client.1.smithi093.stdout:2/698: sync 2023-12-12T11:51:57.764 INFO:tasks.workunit.client.0.smithi063.stdout:6/500: dwrite d9/f4b [4194304,4194304] 0 2023-12-12T11:51:57.767 INFO:tasks.workunit.client.1.smithi093.stdout:2/699: symlink d5/d31/led 0 2023-12-12T11:51:57.767 INFO:tasks.workunit.client.1.smithi093.stdout:2/700: creat d5/d14/d47/d4e/fee x:0 0 0 2023-12-12T11:51:57.773 INFO:tasks.workunit.client.0.smithi063.stdout:6/501: truncate d9/d68/d94/fa0 6766871 0 2023-12-12T11:51:57.773 INFO:tasks.workunit.client.0.smithi063.stdout:6/502: fdatasync d9/f59 0 2023-12-12T11:51:57.773 INFO:tasks.workunit.client.0.smithi063.stdout:6/503: write d9/d10/d7a/f91 [589481,63007] 0 2023-12-12T11:51:57.778 INFO:tasks.workunit.client.1.smithi093.stdout:2/701: unlink d5/d14/d2d/d12/d25/d7a/cdf 0 2023-12-12T11:51:57.779 INFO:tasks.workunit.client.0.smithi063.stdout:6/504: creat d9/d10/d25/fa1 x:0 0 0 2023-12-12T11:51:57.779 INFO:tasks.workunit.client.0.smithi063.stdout:6/505: chown d9/c6f 19 1 2023-12-12T11:51:57.781 INFO:tasks.workunit.client.0.smithi063.stdout:5/474: dread d7/ff [0,4194304] 0 2023-12-12T11:51:57.782 INFO:tasks.workunit.client.1.smithi093.stdout:2/702: mknod d5/d14/d2d/d4c/d54/dc5/d55/cef 0 2023-12-12T11:51:57.782 INFO:tasks.workunit.client.1.smithi093.stdout:1/636: dread d4/d1a/d1b/dbf/fd3 [0,4194304] 0 2023-12-12T11:51:57.782 INFO:tasks.workunit.client.1.smithi093.stdout:1/637: stat d4/d1a/d1b/dbf/fd3 0 2023-12-12T11:51:57.782 INFO:tasks.workunit.client.1.smithi093.stdout:2/703: read d5/d14/d2d/d12/f99 [7181762,92632] 0 2023-12-12T11:51:57.782 INFO:tasks.workunit.client.1.smithi093.stdout:2/704: truncate d5/d14/d2d/d4c/d76/dc6/fcf 914144 0 2023-12-12T11:51:57.782 INFO:tasks.workunit.client.1.smithi093.stdout:2/705: chown d5/d14/d2d/d4c/d76/le6 3014883 1 2023-12-12T11:51:57.782 INFO:tasks.workunit.client.1.smithi093.stdout:1/638: write d4/d1c/d2a/f3d [61087,120271] 0 2023-12-12T11:51:57.783 INFO:tasks.workunit.client.1.smithi093.stdout:8/718: sync 2023-12-12T11:51:57.783 INFO:tasks.workunit.client.1.smithi093.stdout:8/719: stat d3/d1a/d1f/d29/d30/d58/f85 0 2023-12-12T11:51:57.784 INFO:tasks.workunit.client.0.smithi063.stdout:6/506: link d9/d2c/d61/l95 d9/d2c/d6b/d86/la2 0 2023-12-12T11:51:57.784 INFO:tasks.workunit.client.0.smithi063.stdout:6/507: chown d9/d10/d5c/f60 470760 1 2023-12-12T11:51:57.784 INFO:tasks.workunit.client.0.smithi063.stdout:6/508: stat d9/d10/d25/c29 0 2023-12-12T11:51:57.784 INFO:tasks.workunit.client.1.smithi093.stdout:0/682: truncate d5/dd/f16 1434363 0 2023-12-12T11:51:57.785 INFO:tasks.workunit.client.0.smithi063.stdout:0/432: dread d0/d7/d27/d19/f86 [0,4194304] 0 2023-12-12T11:51:57.785 INFO:tasks.workunit.client.0.smithi063.stdout:0/433: chown d0/d1a/d23/d2e 236 1 2023-12-12T11:51:57.785 INFO:tasks.workunit.client.0.smithi063.stdout:0/434: chown d0/d7/d27/d19/f86 252328328 1 2023-12-12T11:51:57.789 INFO:tasks.workunit.client.1.smithi093.stdout:2/706: mkdir d5/d14/df0 0 2023-12-12T11:51:57.790 INFO:tasks.workunit.client.1.smithi093.stdout:2/707: creat d5/d14/d2d/d4c/d54/dc5/d61/ff1 x:0 0 0 2023-12-12T11:51:57.794 INFO:tasks.workunit.client.1.smithi093.stdout:1/639: rmdir d4/dc/d7a/d9c 39 2023-12-12T11:51:57.794 INFO:tasks.workunit.client.1.smithi093.stdout:1/640: chown d4/d1c/c3b 57 1 2023-12-12T11:51:57.794 INFO:tasks.workunit.client.1.smithi093.stdout:3/648: write df/f68 [1002260,36957] 0 2023-12-12T11:51:57.794 INFO:tasks.workunit.client.1.smithi093.stdout:3/649: dread - df/d22/d49/d69/d78/dad/fc9 zero size 2023-12-12T11:51:57.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:57 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:51:57.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:57 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:51:57.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:57 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:51:57.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:57 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:51:57.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:57 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:51:57.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:57 smithi063 ceph-mon[107117]: Adjusting osd_memory_target on smithi063 to 1618M 2023-12-12T11:51:57.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:57 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:51:57.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:57 smithi063 ceph-mon[107117]: pgmap v13: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 142 MiB/s rd, 186 MiB/s wr, 264 op/s 2023-12-12T11:51:57.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:57 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:51:57.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:57 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:51:57.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:57 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:51:57.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:57 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:51:57.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:57 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-12T11:51:57.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:57 smithi063 ceph-mon[107117]: Adjusting osd_memory_target on smithi093 to 2642M 2023-12-12T11:51:57.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:57 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:51:57.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:57 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:51:57.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:57 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:51:57.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:57 smithi063 ceph-mon[107117]: Updating smithi063:/etc/ceph/ceph.conf 2023-12-12T11:51:57.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:57 smithi063 ceph-mon[107117]: Updating smithi093:/etc/ceph/ceph.conf 2023-12-12T11:51:57.797 INFO:tasks.workunit.client.0.smithi063.stdout:3/413: write d4/df/d1a/d1c/d41/f58 [6410319,18245] 0 2023-12-12T11:51:57.797 INFO:tasks.workunit.client.0.smithi063.stdout:6/509: rename d9/d2c/d61/l84 to d9/d10/d2a/la3 0 2023-12-12T11:51:57.797 INFO:tasks.workunit.client.0.smithi063.stdout:5/475: getdents d7/de 0 2023-12-12T11:51:57.797 INFO:tasks.workunit.client.0.smithi063.stdout:5/476: dread - d7/d10/d2b/d3c/f86 zero size 2023-12-12T11:51:57.798 INFO:tasks.workunit.client.0.smithi063.stdout:5/477: readlink d7/d28/d43/d49/l4d 0 2023-12-12T11:51:57.798 INFO:tasks.workunit.client.0.smithi063.stdout:5/478: fdatasync d7/d10/d2b/d3c/d63/f7a 0 2023-12-12T11:51:57.800 INFO:tasks.workunit.client.1.smithi093.stdout:3/650: rename df/d22/d49/d69/d78/daf/d3d/d6f/db1/lb3 to df/d22/d49/d69/d78/db9/ld0 0 2023-12-12T11:51:57.801 INFO:tasks.workunit.client.1.smithi093.stdout:0/683: write d5/f30 [143001,112891] 0 2023-12-12T11:51:57.803 INFO:tasks.workunit.client.1.smithi093.stdout:3/651: creat df/d22/d49/d69/d78/db9/fd1 x:0 0 0 2023-12-12T11:51:57.803 INFO:tasks.workunit.client.1.smithi093.stdout:3/652: dread - df/d22/d49/d69/d8c/fae zero size 2023-12-12T11:51:57.805 INFO:tasks.workunit.client.0.smithi063.stdout:6/510: symlink d9/d10/la4 0 2023-12-12T11:51:57.807 INFO:tasks.workunit.client.1.smithi093.stdout:3/653: rmdir df/d92 39 2023-12-12T11:51:57.807 INFO:tasks.workunit.client.1.smithi093.stdout:1/641: dread d4/d1a/d1b/f3a [0,4194304] 0 2023-12-12T11:51:57.809 INFO:tasks.workunit.client.0.smithi063.stdout:6/511: rename d9/d10/f1b to d9/d2c/d61/fa5 0 2023-12-12T11:51:57.812 INFO:tasks.workunit.client.1.smithi093.stdout:3/654: mkdir df/d25/dd2 0 2023-12-12T11:51:57.812 INFO:tasks.workunit.client.1.smithi093.stdout:3/655: dread - df/d25/d2c/f5f zero size 2023-12-12T11:51:57.814 INFO:tasks.workunit.client.1.smithi093.stdout:1/642: rename d4/d1a/d1b/d26/d65/d6f/db3 to d4/d1a/d73/dd4 0 2023-12-12T11:51:57.817 INFO:tasks.workunit.client.0.smithi063.stdout:6/512: symlink d9/d2c/la6 0 2023-12-12T11:51:57.818 INFO:tasks.workunit.client.1.smithi093.stdout:6/796: dwrite d0/d52/d7e/d42/dd5/f109 [0,4194304] 0 2023-12-12T11:51:57.820 INFO:tasks.workunit.client.0.smithi063.stdout:6/513: symlink d9/d68/d8f/la7 0 2023-12-12T11:51:57.821 INFO:tasks.workunit.client.0.smithi063.stdout:5/479: dread d7/de/f30 [0,4194304] 0 2023-12-12T11:51:57.826 INFO:tasks.workunit.client.0.smithi063.stdout:6/514: mknod d9/d10/ca8 0 2023-12-12T11:51:57.826 INFO:tasks.workunit.client.0.smithi063.stdout:6/515: chown d9/d10/d5c/d5e/f87 2 1 2023-12-12T11:51:57.826 INFO:tasks.workunit.client.0.smithi063.stdout:6/516: chown d9/d2c/d61/f97 27313 1 2023-12-12T11:51:57.834 INFO:tasks.workunit.client.0.smithi063.stdout:6/517: rename d9/c35 to d9/d2c/d61/ca9 0 2023-12-12T11:51:57.837 INFO:tasks.workunit.client.1.smithi093.stdout:6/797: getdents d0/da/d32/d39/df3 0 2023-12-12T11:51:57.845 INFO:tasks.workunit.client.0.smithi063.stdout:4/503: sync 2023-12-12T11:51:57.848 INFO:tasks.workunit.client.0.smithi063.stdout:2/372: sync 2023-12-12T11:51:57.851 INFO:tasks.workunit.client.0.smithi063.stdout:2/373: unlink d0/d1a/d3a/d59/c6b 0 2023-12-12T11:51:57.857 INFO:tasks.workunit.client.0.smithi063.stdout:7/415: sync 2023-12-12T11:51:57.859 INFO:tasks.workunit.client.0.smithi063.stdout:7/416: mknod de/d39/d4b/c99 0 2023-12-12T11:51:57.859 INFO:tasks.workunit.client.0.smithi063.stdout:7/417: chown de/d33/d41/c49 853 1 2023-12-12T11:51:57.859 INFO:tasks.workunit.client.0.smithi063.stdout:7/418: fdatasync de/d39/d4b/f81 0 2023-12-12T11:51:57.860 INFO:tasks.workunit.client.0.smithi063.stdout:7/419: creat de/d22/d6f/f9a x:0 0 0 2023-12-12T11:51:57.863 INFO:tasks.workunit.client.0.smithi063.stdout:7/420: unlink de/d39/d4b/f81 0 2023-12-12T11:51:57.863 INFO:tasks.workunit.client.0.smithi063.stdout:7/421: stat de/d34 0 2023-12-12T11:51:57.863 INFO:tasks.workunit.client.0.smithi063.stdout:7/422: chown de/d3f/f59 0 1 2023-12-12T11:51:57.864 INFO:tasks.workunit.client.1.smithi093.stdout:1/643: dwrite d4/f3e [0,4194304] 0 2023-12-12T11:51:57.864 INFO:tasks.workunit.client.0.smithi063.stdout:3/414: dwrite d4/df/d1a/f2b [0,4194304] 0 2023-12-12T11:51:57.866 INFO:tasks.workunit.client.1.smithi093.stdout:0/684: dwrite d5/d41/d77/d79/d9b/f9e [0,4194304] 0 2023-12-12T11:51:57.866 INFO:tasks.workunit.client.1.smithi093.stdout:0/685: fdatasync d5/dd/f1d 0 2023-12-12T11:51:57.866 INFO:tasks.workunit.client.1.smithi093.stdout:0/686: chown d5/dd/d14/d26/ca5 8 1 2023-12-12T11:51:57.866 INFO:tasks.workunit.client.0.smithi063.stdout:7/423: unlink de/d33/f42 0 2023-12-12T11:51:57.873 INFO:tasks.workunit.client.0.smithi063.stdout:8/502: sync 2023-12-12T11:51:57.873 INFO:tasks.workunit.client.0.smithi063.stdout:9/374: sync 2023-12-12T11:51:57.873 INFO:tasks.workunit.client.0.smithi063.stdout:1/495: sync 2023-12-12T11:51:57.874 INFO:tasks.workunit.client.0.smithi063.stdout:1/496: creat d3/d3a/fa3 x:0 0 0 2023-12-12T11:51:57.874 INFO:tasks.workunit.client.1.smithi093.stdout:1/644: mkdir d4/d1a/d73/dd4/dd5 0 2023-12-12T11:51:57.874 INFO:tasks.workunit.client.1.smithi093.stdout:1/645: chown d4/d1a/d73/f50 108 1 2023-12-12T11:51:57.874 INFO:tasks.workunit.client.1.smithi093.stdout:1/646: chown d4/d81 161640 1 2023-12-12T11:51:57.875 INFO:tasks.workunit.client.1.smithi093.stdout:2/708: write d5/d14/d2d/d4c/d54/d67/d69/d6c/f5a [1020027,50799] 0 2023-12-12T11:51:57.875 INFO:tasks.workunit.client.1.smithi093.stdout:6/798: dwrite d0/da/d14/d38/d43/f5a [0,4194304] 0 2023-12-12T11:51:57.875 INFO:tasks.workunit.client.1.smithi093.stdout:6/799: dread - d0/d52/d6b/ddb/dfe/fad zero size 2023-12-12T11:51:57.876 INFO:tasks.workunit.client.0.smithi063.stdout:7/424: creat de/d39/d4b/d7b/f9b x:0 0 0 2023-12-12T11:51:57.876 INFO:tasks.workunit.client.0.smithi063.stdout:7/425: readlink de/d33/l51 0 2023-12-12T11:51:57.879 INFO:tasks.workunit.client.0.smithi063.stdout:8/503: creat d4/f9a x:0 0 0 2023-12-12T11:51:57.881 INFO:tasks.workunit.client.1.smithi093.stdout:0/687: mkdir d5/d21/d27/d3a/d9a/db5/db8/dd4 0 2023-12-12T11:51:57.883 INFO:tasks.workunit.client.0.smithi063.stdout:9/375: symlink d7/d11/d12/d30/d3e/d55/l74 0 2023-12-12T11:51:57.883 INFO:tasks.workunit.client.1.smithi093.stdout:1/647: dread f1 [0,4194304] 0 2023-12-12T11:51:57.888 INFO:tasks.workunit.client.0.smithi063.stdout:3/415: write d4/df/d1a/d1c/d3b/d50/f5a [3721651,56776] 0 2023-12-12T11:51:57.889 INFO:tasks.workunit.client.0.smithi063.stdout:1/497: symlink d3/db/d16/d24/d48/d75/d83/d5b/la4 0 2023-12-12T11:51:57.890 INFO:tasks.workunit.client.0.smithi063.stdout:4/504: dwrite d2/f40 [0,4194304] 0 2023-12-12T11:51:57.890 INFO:tasks.workunit.client.0.smithi063.stdout:4/505: chown d2/d48/l73 2596 1 2023-12-12T11:51:57.891 INFO:tasks.workunit.client.1.smithi093.stdout:2/709: mkdir d5/d14/d2d/d4c/d54/d67/d69/d6c/df2 0 2023-12-12T11:51:57.891 INFO:tasks.workunit.client.1.smithi093.stdout:2/710: fsync d5/d14/d47/d4e/fcc 0 2023-12-12T11:51:57.894 INFO:tasks.workunit.client.1.smithi093.stdout:6/800: symlink d0/da/d32/d9e/d4d/deb/l124 0 2023-12-12T11:51:57.895 INFO:tasks.workunit.client.1.smithi093.stdout:6/801: truncate d0/fa6 4419068 0 2023-12-12T11:51:57.896 INFO:tasks.workunit.client.0.smithi063.stdout:9/376: mkdir d7/d11/d4b/d75 0 2023-12-12T11:51:57.898 INFO:tasks.workunit.client.1.smithi093.stdout:0/688: getdents d5/d21/d2f 0 2023-12-12T11:51:57.902 INFO:tasks.workunit.client.0.smithi063.stdout:3/416: truncate d4/df/d1a/d1c/f43 796801 0 2023-12-12T11:51:57.902 INFO:tasks.workunit.client.0.smithi063.stdout:3/417: readlink d4/df/d1a/d1c/d34/d54/l7e 0 2023-12-12T11:51:57.902 INFO:tasks.workunit.client.0.smithi063.stdout:3/418: chown d4/df/d1a/d1c/d3b/c7a 24135 1 2023-12-12T11:51:57.903 INFO:tasks.workunit.client.1.smithi093.stdout:0/689: getdents d5/dd/d14/d26/d58/d64/d6f 0 2023-12-12T11:51:57.905 INFO:tasks.workunit.client.0.smithi063.stdout:1/498: truncate d3/f9 2104585 0 2023-12-12T11:51:57.905 INFO:tasks.workunit.client.0.smithi063.stdout:4/506: rename d2/d47/f2d to d2/d48/d69/d98/fa1 0 2023-12-12T11:51:57.905 INFO:tasks.workunit.client.0.smithi063.stdout:4/507: chown d2/d17/d61/c72 25 1 2023-12-12T11:51:57.907 INFO:tasks.workunit.client.1.smithi093.stdout:1/648: truncate d4/d1a/d1b/d26/d65/f8a 614588 0 2023-12-12T11:51:57.907 INFO:tasks.workunit.client.1.smithi093.stdout:1/649: chown d4/d1a/d1b/d26/l62 3305 1 2023-12-12T11:51:57.907 INFO:tasks.workunit.client.1.smithi093.stdout:1/650: write f1 [666844,43696] 0 2023-12-12T11:51:57.907 INFO:tasks.workunit.client.1.smithi093.stdout:1/651: chown d4/d1c/d2a/f3d 1022956 1 2023-12-12T11:51:57.907 INFO:tasks.workunit.client.0.smithi063.stdout:8/504: rmdir d4/de/d3b/d62 39 2023-12-12T11:51:57.908 INFO:tasks.workunit.client.1.smithi093.stdout:1/652: creat d4/fd6 x:0 0 0 2023-12-12T11:51:57.908 INFO:tasks.workunit.client.1.smithi093.stdout:1/653: creat d4/d1a/d83/d9a/fd7 x:0 0 0 2023-12-12T11:51:57.909 INFO:tasks.workunit.client.0.smithi063.stdout:9/377: getdents d7/d11/d12/d30 0 2023-12-12T11:51:57.909 INFO:tasks.workunit.client.0.smithi063.stdout:9/378: write d7/d20/d3f/d40/f44 [342632,87807] 0 2023-12-12T11:51:57.910 INFO:tasks.workunit.client.0.smithi063.stdout:1/499: mknod d3/db/d16/d24/d4d/ca5 0 2023-12-12T11:51:57.911 INFO:tasks.workunit.client.0.smithi063.stdout:4/508: mkdir d2/d17/d7f/da2 0 2023-12-12T11:51:57.912 INFO:tasks.workunit.client.0.smithi063.stdout:3/419: symlink d4/df/d1a/l88 0 2023-12-12T11:51:57.913 INFO:tasks.workunit.client.0.smithi063.stdout:9/379: mkdir d7/d20/d3f/d40/d76 0 2023-12-12T11:51:57.918 INFO:tasks.workunit.client.0.smithi063.stdout:4/509: link d2/d47/f30 d2/d48/d4f/fa3 0 2023-12-12T11:51:57.919 INFO:tasks.workunit.client.1.smithi093.stdout:0/690: write d5/dd/f1a [1722046,36071] 0 2023-12-12T11:51:57.919 INFO:tasks.workunit.client.1.smithi093.stdout:0/691: fsync d5/d21/d27/d3a/d9a/fa7 0 2023-12-12T11:51:57.919 INFO:tasks.workunit.client.0.smithi063.stdout:3/420: truncate d4/df/f19 1175336 0 2023-12-12T11:51:57.920 INFO:tasks.workunit.client.0.smithi063.stdout:9/380: symlink d7/d20/d3f/d40/d4e/l77 0 2023-12-12T11:51:57.921 INFO:tasks.workunit.client.0.smithi063.stdout:8/505: read d4/de/d1e/f4f [1359255,1703] 0 2023-12-12T11:51:57.921 INFO:tasks.workunit.client.0.smithi063.stdout:8/506: chown d4/d24/d38 11534920 1 2023-12-12T11:51:57.923 INFO:tasks.workunit.client.1.smithi093.stdout:0/692: rename d5/d21/d27/d3a/d9a/db5/db8/la1 to d5/d21/d27/d3a/d9a/dc8/ld5 0 2023-12-12T11:51:57.927 INFO:tasks.workunit.client.1.smithi093.stdout:0/693: link d5/d21/d2f/f3d d5/d21/d2f/d54/d7e/db4/fd6 0 2023-12-12T11:51:57.928 INFO:tasks.workunit.client.0.smithi063.stdout:4/510: truncate d2/d8/f43 4049802 0 2023-12-12T11:51:57.928 INFO:tasks.workunit.client.0.smithi063.stdout:4/511: readlink d2/l62 0 2023-12-12T11:51:57.928 INFO:tasks.workunit.client.0.smithi063.stdout:3/421: rmdir d4/df/d1a/d1c/d3b/d50/d61 39 2023-12-12T11:51:57.928 INFO:tasks.workunit.client.0.smithi063.stdout:4/512: creat d2/d17/d7f/fa4 x:0 0 0 2023-12-12T11:51:57.928 INFO:tasks.workunit.client.0.smithi063.stdout:3/422: write d4/f76 [4590148,61937] 0 2023-12-12T11:51:57.929 INFO:tasks.workunit.client.0.smithi063.stdout:4/513: mkdir d2/d17/d9d/d85/da5 0 2023-12-12T11:51:57.935 INFO:tasks.workunit.client.1.smithi093.stdout:0/694: dread d5/d21/f6b [0,4194304] 0 2023-12-12T11:51:57.940 INFO:tasks.workunit.client.1.smithi093.stdout:0/695: creat d5/d21/d27/fd7 x:0 0 0 2023-12-12T11:51:57.940 INFO:tasks.workunit.client.1.smithi093.stdout:0/696: write d5/d41/fcd [912384,56643] 0 2023-12-12T11:51:57.940 INFO:tasks.workunit.client.1.smithi093.stdout:0/697: getdents d5/d21/d2f/dae 0 2023-12-12T11:51:57.952 INFO:tasks.workunit.client.1.smithi093.stdout:8/720: dwrite d3/d1a/d1f/f3f [0,4194304] 0 2023-12-12T11:51:57.967 INFO:tasks.workunit.client.1.smithi093.stdout:8/721: creat d3/d1a/d1f/d29/d30/d58/ff3 x:0 0 0 2023-12-12T11:51:57.977 INFO:tasks.workunit.client.0.smithi063.stdout:9/381: dread d7/ff [0,4194304] 0 2023-12-12T11:51:57.983 INFO:tasks.workunit.client.1.smithi093.stdout:4/888: sync 2023-12-12T11:51:57.983 INFO:tasks.workunit.client.1.smithi093.stdout:4/889: fsync d0/d87/d79/db2/fae 0 2023-12-12T11:51:57.983 INFO:tasks.workunit.client.1.smithi093.stdout:9/653: sync 2023-12-12T11:51:57.990 INFO:tasks.workunit.client.1.smithi093.stdout:8/722: symlink d3/d1a/d1f/daf/lf4 0 2023-12-12T11:51:57.990 INFO:tasks.workunit.client.1.smithi093.stdout:5/559: sync 2023-12-12T11:51:57.990 INFO:tasks.workunit.client.1.smithi093.stdout:5/560: chown d0/d7/d36/d29/d44/c5e 49 1 2023-12-12T11:51:57.990 INFO:tasks.workunit.client.1.smithi093.stdout:1/654: dwrite d4/d1a/d1b/dbf/fd3 [4194304,4194304] 0 2023-12-12T11:51:57.991 INFO:tasks.workunit.client.1.smithi093.stdout:1/655: stat d4/d1a/d83/d9a/fd0 0 2023-12-12T11:51:57.991 INFO:tasks.workunit.client.1.smithi093.stdout:1/656: fsync d4/d81/fb1 0 2023-12-12T11:51:57.991 INFO:tasks.workunit.client.1.smithi093.stdout:1/657: chown d4/dc 1135416074 1 2023-12-12T11:51:57.991 INFO:tasks.workunit.client.1.smithi093.stdout:9/654: creat d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/d42/fdf x:0 0 0 2023-12-12T11:51:57.998 INFO:tasks.workunit.client.1.smithi093.stdout:5/561: symlink d0/d7/d59/d62/lc0 0 2023-12-12T11:51:58.001 INFO:tasks.workunit.client.1.smithi093.stdout:6/802: dread d0/da/d32/d39/d5b/fa2 [0,4194304] 0 2023-12-12T11:51:58.009 INFO:tasks.workunit.client.0.smithi063.stdout:4/514: dwrite d2/d17/f22 [8388608,4194304] 0 2023-12-12T11:51:58.009 INFO:tasks.workunit.client.1.smithi093.stdout:1/658: symlink d4/d1a/d73/ld8 0 2023-12-12T11:51:58.013 INFO:tasks.workunit.client.0.smithi063.stdout:8/507: dread d4/de/d3b/d62/d36/f3a [0,4194304] 0 2023-12-12T11:51:58.015 INFO:tasks.workunit.client.1.smithi093.stdout:9/655: rename d1/d23/d24/d29/d43/l62 to d1/d23/d24/d29/le0 0 2023-12-12T11:51:58.015 INFO:tasks.workunit.client.0.smithi063.stdout:4/515: unlink d2/d8/f78 0 2023-12-12T11:51:58.016 INFO:tasks.workunit.client.0.smithi063.stdout:4/516: creat d2/d47/d6d/d88/fa6 x:0 0 0 2023-12-12T11:51:58.017 INFO:tasks.workunit.client.1.smithi093.stdout:9/656: read d1/d23/d24/d29/d43/d56/d68/f7e [88429,33459] 0 2023-12-12T11:51:58.017 INFO:tasks.workunit.client.1.smithi093.stdout:9/657: read - d1/d23/d24/d29/d43/d56/d85/dc3/dce/fb4 zero size 2023-12-12T11:51:58.017 INFO:tasks.workunit.client.1.smithi093.stdout:5/562: creat d0/d7/d36/d29/d76/fc1 x:0 0 0 2023-12-12T11:51:58.019 INFO:tasks.workunit.client.0.smithi063.stdout:8/508: symlink d4/d24/d38/d45/d5b/d92/d65/l9b 0 2023-12-12T11:51:58.019 INFO:tasks.workunit.client.0.smithi063.stdout:8/509: dread - d4/de/d3b/d62/d36/d57/f7c zero size 2023-12-12T11:51:58.020 INFO:tasks.workunit.client.1.smithi093.stdout:6/803: creat d0/da/d14/d38/f125 x:0 0 0 2023-12-12T11:51:58.020 INFO:tasks.workunit.client.1.smithi093.stdout:6/804: chown d0/d52/d7e/d42/dd5 592343 1 2023-12-12T11:51:58.022 INFO:tasks.workunit.client.1.smithi093.stdout:9/658: getdents d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/db1 0 2023-12-12T11:51:58.026 INFO:tasks.workunit.client.0.smithi063.stdout:1/500: dwrite d3/db/d16/d24/d48/d75/d83/d5b/f9b [0,4194304] 0 2023-12-12T11:51:58.026 INFO:tasks.workunit.client.0.smithi063.stdout:6/518: dwrite d9/d10/d5c/d5e/f8e [0,4194304] 0 2023-12-12T11:51:58.026 INFO:tasks.workunit.client.1.smithi093.stdout:3/656: dwrite df/f2f [0,4194304] 0 2023-12-12T11:51:58.026 INFO:tasks.workunit.client.1.smithi093.stdout:5/563: stat d0/d7/d8/c2c 0 2023-12-12T11:51:58.026 INFO:tasks.workunit.client.1.smithi093.stdout:5/564: write d0/d7/d8/d9e/f31 [1273854,84613] 0 2023-12-12T11:51:58.027 INFO:tasks.workunit.client.0.smithi063.stdout:3/423: dwrite d4/df/d1a/d1c/d41/f84 [0,4194304] 0 2023-12-12T11:51:58.027 INFO:tasks.workunit.client.0.smithi063.stdout:4/517: mknod d2/d17/d9d/ca7 0 2023-12-12T11:51:58.028 INFO:tasks.workunit.client.1.smithi093.stdout:6/805: mknod d0/da/d32/d9e/d4d/dd8/c126 0 2023-12-12T11:51:58.029 INFO:tasks.workunit.client.1.smithi093.stdout:6/806: write d0/da/d14/fb3 [10359,62884] 0 2023-12-12T11:51:58.029 INFO:tasks.workunit.client.1.smithi093.stdout:0/698: dwrite d5/dd/d33/f3c [0,4194304] 0 2023-12-12T11:51:58.030 INFO:tasks.workunit.client.1.smithi093.stdout:9/659: unlink d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/c77 0 2023-12-12T11:51:58.031 INFO:tasks.workunit.client.0.smithi063.stdout:2/374: dwrite d0/f22 [4194304,4194304] 0 2023-12-12T11:51:58.039 INFO:tasks.workunit.client.1.smithi093.stdout:4/890: dwrite d0/d31/d5c/d66/fbf [4194304,4194304] 0 2023-12-12T11:51:58.039 INFO:tasks.workunit.client.1.smithi093.stdout:4/891: dread - d0/d31/fc5 zero size 2023-12-12T11:51:58.052 INFO:tasks.workunit.client.0.smithi063.stdout:4/518: rename d2/d48/d69/f8d to d2/d17/d7f/da2/fa8 0 2023-12-12T11:51:58.055 INFO:tasks.workunit.client.1.smithi093.stdout:2/711: truncate d5/d14/d2d/d4c/d54/d67/d69/d6c/f5a 130192 0 2023-12-12T11:51:58.055 INFO:tasks.workunit.client.1.smithi093.stdout:2/712: chown d5/d14/d2d/d12/db4 23098294 1 2023-12-12T11:51:58.055 INFO:tasks.workunit.client.1.smithi093.stdout:6/807: write d0/da/d32/d39/d5b/f5d [1893233,73171] 0 2023-12-12T11:51:58.055 INFO:tasks.workunit.client.1.smithi093.stdout:6/808: dread - d0/d52/d6b/ddb/dfe/fad zero size 2023-12-12T11:51:58.062 INFO:tasks.workunit.client.1.smithi093.stdout:4/892: dread d0/fd0 [0,4194304] 0 2023-12-12T11:51:58.065 INFO:tasks.workunit.client.1.smithi093.stdout:1/659: dwrite d4/dc/f17 [0,4194304] 0 2023-12-12T11:51:58.065 INFO:tasks.workunit.client.1.smithi093.stdout:1/660: fsync d4/d1a/d1b/f3a 0 2023-12-12T11:51:58.065 INFO:tasks.workunit.client.1.smithi093.stdout:1/661: truncate d4/d1a/d83/d9a/fd7 450399 0 2023-12-12T11:51:58.071 INFO:tasks.workunit.client.1.smithi093.stdout:3/657: creat df/d22/d49/fd3 x:0 0 0 2023-12-12T11:51:58.074 INFO:tasks.workunit.client.0.smithi063.stdout:2/375: creat d0/d1a/d26/f7b x:0 0 0 2023-12-12T11:51:58.077 INFO:tasks.workunit.client.0.smithi063.stdout:4/519: dread d2/d48/d4f/f5e [0,4194304] 0 2023-12-12T11:51:58.078 INFO:tasks.workunit.client.1.smithi093.stdout:5/565: mknod d0/d7/cc2 0 2023-12-12T11:51:58.079 INFO:tasks.workunit.client.1.smithi093.stdout:6/809: read d0/da/d14/d21/f120 [3878786,89537] 0 2023-12-12T11:51:58.081 INFO:tasks.workunit.client.0.smithi063.stdout:2/376: mknod d0/c7c 0 2023-12-12T11:51:58.082 INFO:tasks.workunit.client.0.smithi063.stdout:3/424: dwrite d4/df/d1a/d1c/d41/f84 [0,4194304] 0 2023-12-12T11:51:58.085 INFO:tasks.workunit.client.0.smithi063.stdout:1/501: dwrite d3/f1a [0,4194304] 0 2023-12-12T11:51:58.089 INFO:tasks.workunit.client.1.smithi093.stdout:0/699: getdents d5/dd 0 2023-12-12T11:51:58.091 INFO:tasks.workunit.client.0.smithi063.stdout:2/377: link d0/d1a/d1e/l6a d0/d1a/d1e/d64/l7d 0 2023-12-12T11:51:58.092 INFO:tasks.workunit.client.1.smithi093.stdout:9/660: mkdir d1/d23/d24/d29/d43/d56/d85/dc3/dce/de1 0 2023-12-12T11:51:58.095 INFO:tasks.workunit.client.0.smithi063.stdout:1/502: creat d3/db/d16/d17/d4b/fa6 x:0 0 0 2023-12-12T11:51:58.095 INFO:tasks.workunit.client.0.smithi063.stdout:1/503: write d3/db/d16/f2d [2983610,110461] 0 2023-12-12T11:51:58.095 INFO:tasks.workunit.client.0.smithi063.stdout:1/504: fdatasync d3/db/d16/d17/f55 0 2023-12-12T11:51:58.097 INFO:tasks.workunit.client.1.smithi093.stdout:2/713: rmdir d5/d14/d2d/d4c/d54/d67/d69 39 2023-12-12T11:51:58.103 INFO:tasks.workunit.client.1.smithi093.stdout:4/893: truncate d0/d31/f2c 2764028 0 2023-12-12T11:51:58.105 INFO:tasks.workunit.client.0.smithi063.stdout:1/505: getdents d3/db/d16/d4f 0 2023-12-12T11:51:58.105 INFO:tasks.workunit.client.0.smithi063.stdout:1/506: readlink d3/db/d16/l43 0 2023-12-12T11:51:58.109 INFO:tasks.workunit.client.1.smithi093.stdout:1/662: creat d4/d1a/d1b/d26/d65/d6f/fd9 x:0 0 0 2023-12-12T11:51:58.112 INFO:tasks.workunit.client.1.smithi093.stdout:3/658: unlink df/d22/d49/d69/d78/daf/d3d/d6f/db1/fbd 0 2023-12-12T11:51:58.114 INFO:tasks.workunit.client.1.smithi093.stdout:6/810: rmdir d0/d52/d7e/d42/dd5/ddc 39 2023-12-12T11:51:58.116 INFO:tasks.workunit.client.1.smithi093.stdout:9/661: mknod d1/d23/d24/d29/d43/d56/ce2 0 2023-12-12T11:51:58.117 INFO:tasks.workunit.client.1.smithi093.stdout:9/662: stat d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/f25 0 2023-12-12T11:51:58.119 INFO:tasks.workunit.client.1.smithi093.stdout:4/894: mknod d0/d36/d61/d97/c113 0 2023-12-12T11:51:58.121 INFO:tasks.workunit.client.1.smithi093.stdout:1/663: rename d4/d1a/l20 to d4/d1a/d83/d9a/da9/lda 0 2023-12-12T11:51:58.123 INFO:tasks.workunit.client.0.smithi063.stdout:3/425: read f0 [842260,104390] 0 2023-12-12T11:51:58.123 INFO:tasks.workunit.client.1.smithi093.stdout:3/659: unlink df/d22/l7c 0 2023-12-12T11:51:58.124 INFO:tasks.workunit.client.1.smithi093.stdout:3/660: write df/d25/fb4 [308659,116097] 0 2023-12-12T11:51:58.124 INFO:tasks.workunit.client.1.smithi093.stdout:6/811: dread d0/da/d14/d21/f120 [0,4194304] 0 2023-12-12T11:51:58.125 INFO:tasks.workunit.client.1.smithi093.stdout:0/700: rmdir d5/dd/d14/d26/d58/d64 39 2023-12-12T11:51:58.125 INFO:tasks.workunit.client.1.smithi093.stdout:0/701: creat d5/dd/d14/d99/fd8 x:0 0 0 2023-12-12T11:51:58.128 INFO:tasks.workunit.client.0.smithi063.stdout:3/426: rename d4/d23/f4b to d4/d23/d5d/f89 0 2023-12-12T11:51:58.128 INFO:tasks.workunit.client.0.smithi063.stdout:3/427: fsync d4/f44 0 2023-12-12T11:51:58.130 INFO:tasks.workunit.client.1.smithi093.stdout:9/663: mknod d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/dc0/ce3 0 2023-12-12T11:51:58.131 INFO:tasks.workunit.client.1.smithi093.stdout:4/895: symlink d0/d87/d79/d86/da9/l114 0 2023-12-12T11:51:58.132 INFO:tasks.workunit.client.1.smithi093.stdout:1/664: mkdir d4/d1a/d1b/d26/d31/ddb 0 2023-12-12T11:51:58.134 INFO:tasks.workunit.client.1.smithi093.stdout:6/812: rename d0/da/d32/d9e/d4d/de9/lfb to d0/da/l127 0 2023-12-12T11:51:58.134 INFO:tasks.workunit.client.1.smithi093.stdout:6/813: chown d0/d52/dbc/fca 66504 1 2023-12-12T11:51:58.134 INFO:tasks.workunit.client.1.smithi093.stdout:6/814: fsync d0/d52/d7e/d102/f105 0 2023-12-12T11:51:58.134 INFO:tasks.workunit.client.1.smithi093.stdout:6/815: dread - d0/da/d32/d39/d5b/fce zero size 2023-12-12T11:51:58.138 INFO:tasks.workunit.client.1.smithi093.stdout:0/702: symlink d5/d21/d27/d3a/d9a/dc8/ld9 0 2023-12-12T11:51:58.139 INFO:tasks.workunit.client.1.smithi093.stdout:0/703: dread - d5/d21/d27/f6a zero size 2023-12-12T11:51:58.140 INFO:tasks.workunit.client.1.smithi093.stdout:5/566: dwrite d0/d7/d59/d48/fb4 [4194304,4194304] 0 2023-12-12T11:51:58.140 INFO:tasks.workunit.client.1.smithi093.stdout:5/567: fsync d0/d7/d36/d68/f7a 0 2023-12-12T11:51:58.143 INFO:tasks.workunit.client.1.smithi093.stdout:1/665: getdents d4/d1a/da6 0 2023-12-12T11:51:58.144 INFO:tasks.workunit.client.1.smithi093.stdout:6/816: rmdir d0/da/dbf 39 2023-12-12T11:51:58.144 INFO:tasks.workunit.client.1.smithi093.stdout:6/817: write d0/da/d32/dd3/f11d [740926,112834] 0 2023-12-12T11:51:58.144 INFO:tasks.workunit.client.1.smithi093.stdout:6/818: read - d0/d52/dbc/fe8 zero size 2023-12-12T11:51:58.144 INFO:tasks.workunit.client.1.smithi093.stdout:7/634: sync 2023-12-12T11:51:58.146 INFO:tasks.workunit.client.1.smithi093.stdout:0/704: creat d5/d41/d77/fda x:0 0 0 2023-12-12T11:51:58.148 INFO:tasks.workunit.client.1.smithi093.stdout:1/666: write d4/d1a/d1b/d26/d65/f7b [615469,118551] 0 2023-12-12T11:51:58.148 INFO:tasks.workunit.client.1.smithi093.stdout:5/568: creat d0/d7/d59/d48/fc3 x:0 0 0 2023-12-12T11:51:58.148 INFO:tasks.workunit.client.1.smithi093.stdout:5/569: fdatasync d0/d7/d59/d48/fc3 0 2023-12-12T11:51:58.148 INFO:tasks.workunit.client.0.smithi063.stdout:0/435: sync 2023-12-12T11:51:58.151 INFO:tasks.workunit.client.1.smithi093.stdout:6/819: mknod d0/da/d32/d9e/d4d/de9/c128 0 2023-12-12T11:51:58.151 INFO:tasks.workunit.client.1.smithi093.stdout:6/820: readlink d0/da/d32/d9e/d113/l119 0 2023-12-12T11:51:58.154 INFO:tasks.workunit.client.1.smithi093.stdout:1/667: mknod d4/d1a/d73/dd4/dd5/cdc 0 2023-12-12T11:51:58.154 INFO:tasks.workunit.client.1.smithi093.stdout:5/570: stat d0/d7/d36/d38/c4b 0 2023-12-12T11:51:58.154 INFO:tasks.workunit.client.1.smithi093.stdout:1/668: fsync d4/d1a/d1b/f3a 0 2023-12-12T11:51:58.154 INFO:tasks.workunit.client.1.smithi093.stdout:1/669: chown d4/dc/l19 14326988 1 2023-12-12T11:51:58.156 INFO:tasks.workunit.client.0.smithi063.stdout:0/436: symlink d0/d7/d27/d19/l94 0 2023-12-12T11:51:58.156 INFO:tasks.workunit.client.0.smithi063.stdout:0/437: chown d0/d7/d27/d19/d2d/d67 7167252 1 2023-12-12T11:51:58.156 INFO:tasks.workunit.client.0.smithi063.stdout:0/438: dread - d0/d7/d27/d44/f56 zero size 2023-12-12T11:51:58.156 INFO:tasks.workunit.client.0.smithi063.stdout:0/439: stat d0/f21 0 2023-12-12T11:51:58.157 INFO:tasks.workunit.client.1.smithi093.stdout:6/821: unlink d0/d52/d7e/f3f 0 2023-12-12T11:51:58.160 INFO:tasks.workunit.client.0.smithi063.stdout:3/428: write d4/df/d1a/f2b [177498,92332] 0 2023-12-12T11:51:58.161 INFO:tasks.workunit.client.0.smithi063.stdout:4/520: dwrite d2/d8/d76/f7a [0,4194304] 0 2023-12-12T11:51:58.161 INFO:tasks.workunit.client.0.smithi063.stdout:4/521: chown d2/d17/d7f/fa4 9 1 2023-12-12T11:51:58.164 INFO:tasks.workunit.client.1.smithi093.stdout:7/635: rename da/d15/d19/d4c/dc1/dce to da/d15/ddd 0 2023-12-12T11:51:58.164 INFO:tasks.workunit.client.0.smithi063.stdout:2/378: dwrite d0/f5f [0,4194304] 0 2023-12-12T11:51:58.168 INFO:tasks.workunit.client.1.smithi093.stdout:1/670: creat d4/d85/fdd x:0 0 0 2023-12-12T11:51:58.169 INFO:tasks.workunit.client.1.smithi093.stdout:1/671: chown d4/d1a/d1b/f99 2095 1 2023-12-12T11:51:58.169 INFO:tasks.workunit.client.1.smithi093.stdout:1/672: fdatasync d4/d1c/d2a/f6e 0 2023-12-12T11:51:58.174 INFO:tasks.workunit.client.1.smithi093.stdout:6/822: truncate d0/da/d32/d39/d5b/fa2 3273800 0 2023-12-12T11:51:58.179 INFO:tasks.workunit.client.1.smithi093.stdout:5/571: rename d0/d7/d59/d62/f6e to d0/d7/d36/fc4 0 2023-12-12T11:51:58.179 INFO:tasks.workunit.client.1.smithi093.stdout:5/572: chown d0/d7/d36/d29/f9d 310777327 1 2023-12-12T11:51:58.182 INFO:tasks.workunit.client.1.smithi093.stdout:5/573: chown d0/d7/d59/c8e 11263 1 2023-12-12T11:51:58.184 INFO:tasks.workunit.client.1.smithi093.stdout:1/673: getdents d4/d1a/d1b/dbf 0 2023-12-12T11:51:58.194 INFO:tasks.workunit.client.1.smithi093.stdout:1/674: link d4/d81/cad d4/d1a/d83/d9a/da9/cde 0 2023-12-12T11:51:58.199 INFO:tasks.workunit.client.0.smithi063.stdout:2/379: getdents d0/d1a/d48 0 2023-12-12T11:51:58.202 INFO:tasks.workunit.client.0.smithi063.stdout:2/380: write d0/d1a/f1d [4382285,43945] 0 2023-12-12T11:51:58.203 INFO:tasks.workunit.client.0.smithi063.stdout:2/381: truncate d0/f49 114696 0 2023-12-12T11:51:58.213 INFO:tasks.workunit.client.1.smithi093.stdout:1/675: dread d4/f8 [0,4194304] 0 2023-12-12T11:51:58.213 INFO:tasks.workunit.client.1.smithi093.stdout:1/676: chown d4/dc/lac 32787 1 2023-12-12T11:51:58.219 INFO:tasks.workunit.client.1.smithi093.stdout:9/664: getdents d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/dc0 0 2023-12-12T11:51:58.219 INFO:tasks.workunit.client.1.smithi093.stdout:1/677: creat d4/d1c/fdf x:0 0 0 2023-12-12T11:51:58.219 INFO:tasks.workunit.client.1.smithi093.stdout:2/714: dwrite d5/fbf [0,4194304] 0 2023-12-12T11:51:58.219 INFO:tasks.workunit.client.1.smithi093.stdout:2/715: chown l4 870732275 1 2023-12-12T11:51:58.220 INFO:tasks.workunit.client.1.smithi093.stdout:4/896: dread d0/d87/d79/d86/f8a [0,4194304] 0 2023-12-12T11:51:58.220 INFO:tasks.workunit.client.1.smithi093.stdout:4/897: fsync d0/d87/d79/d96/dcc/ff6 0 2023-12-12T11:51:58.220 INFO:tasks.workunit.client.0.smithi063.stdout:1/507: dwrite d3/db/d16/f32 [0,4194304] 0 2023-12-12T11:51:58.221 INFO:tasks.workunit.client.1.smithi093.stdout:1/678: link l0 d4/d1a/le0 0 2023-12-12T11:51:58.221 INFO:tasks.workunit.client.1.smithi093.stdout:7/636: write da/d15/d59/f66 [602216,27712] 0 2023-12-12T11:51:58.222 INFO:tasks.workunit.client.1.smithi093.stdout:7/637: truncate da/de/d46/f4e 4238615 0 2023-12-12T11:51:58.222 INFO:tasks.workunit.client.0.smithi063.stdout:0/440: write d0/d1a/d66/f8a [1802327,85334] 0 2023-12-12T11:51:58.222 INFO:tasks.workunit.client.0.smithi063.stdout:0/441: dread - d0/d1a/d23/d34/d42/f73 zero size 2023-12-12T11:51:58.226 INFO:tasks.workunit.client.0.smithi063.stdout:0/442: mkdir d0/d7/d27/d19/d2d/d95 0 2023-12-12T11:51:58.227 INFO:tasks.workunit.client.1.smithi093.stdout:0/705: dwrite d5/d41/fa6 [4194304,4194304] 0 2023-12-12T11:51:58.227 INFO:tasks.workunit.client.1.smithi093.stdout:3/661: dwrite df/d22/f31 [0,4194304] 0 2023-12-12T11:51:58.227 INFO:tasks.workunit.client.1.smithi093.stdout:4/898: creat d0/d87/d79/d86/da9/f115 x:0 0 0 2023-12-12T11:51:58.230 INFO:tasks.workunit.client.1.smithi093.stdout:1/679: link d4/d81/cad d4/d1a/d1b/d26/d82/ce1 0 2023-12-12T11:51:58.233 INFO:tasks.workunit.client.1.smithi093.stdout:7/638: rename da/d15/d59/d80/fd4 to da/d15/d19/fde 0 2023-12-12T11:51:58.233 INFO:tasks.workunit.client.1.smithi093.stdout:7/639: fsync da/d15/d19/d4c/fad 0 2023-12-12T11:51:58.235 INFO:tasks.workunit.client.0.smithi063.stdout:0/443: rmdir d0/d7/d27/d44 39 2023-12-12T11:51:58.239 INFO:tasks.workunit.client.0.smithi063.stdout:1/508: dread d3/db/d12/f27 [0,4194304] 0 2023-12-12T11:51:58.239 INFO:tasks.workunit.client.0.smithi063.stdout:1/509: write d3/db/d16/d24/d30/f9c [566163,53083] 0 2023-12-12T11:51:58.239 INFO:tasks.workunit.client.0.smithi063.stdout:1/510: truncate d3/db/d16/d24/d48/f8a 331596 0 2023-12-12T11:51:58.239 INFO:tasks.workunit.client.0.smithi063.stdout:1/511: write d3/f56 [1071479,120292] 0 2023-12-12T11:51:58.241 INFO:tasks.workunit.client.0.smithi063.stdout:0/444: mkdir d0/d1a/d23/d2e/d96 0 2023-12-12T11:51:58.241 INFO:tasks.workunit.client.0.smithi063.stdout:0/445: write d0/d7/f55 [1521122,6194] 0 2023-12-12T11:51:58.247 INFO:tasks.workunit.client.0.smithi063.stdout:3/429: dwrite d4/df/d1a/d1c/d41/f84 [0,4194304] 0 2023-12-12T11:51:58.247 INFO:tasks.workunit.client.0.smithi063.stdout:1/512: mkdir d3/db/d16/d4f/da7 0 2023-12-12T11:51:58.248 INFO:tasks.workunit.client.0.smithi063.stdout:4/522: dwrite d2/d48/d69/f82 [0,4194304] 0 2023-12-12T11:51:58.248 INFO:tasks.workunit.client.0.smithi063.stdout:4/523: readlink d2/d47/l3b 0 2023-12-12T11:51:58.260 INFO:tasks.workunit.client.0.smithi063.stdout:1/513: mkdir d3/d3a/d5e/d6f/da8 0 2023-12-12T11:51:58.263 INFO:tasks.workunit.client.1.smithi093.stdout:6/823: write d0/da/d32/dd3/fb5 [1167566,118982] 0 2023-12-12T11:51:58.265 INFO:tasks.workunit.client.1.smithi093.stdout:6/824: dread - d0/da/dbf/fc0 zero size 2023-12-12T11:51:58.267 INFO:tasks.workunit.client.1.smithi093.stdout:3/662: mkdir df/d92/dd4 0 2023-12-12T11:51:58.272 INFO:tasks.workunit.client.0.smithi063.stdout:3/430: getdents d4/df/d1a/d1c/d57 0 2023-12-12T11:51:58.275 INFO:tasks.workunit.client.0.smithi063.stdout:1/514: creat d3/db/d16/d24/d48/d75/d83/d5b/d6b/d6d/fa9 x:0 0 0 2023-12-12T11:51:58.281 INFO:tasks.workunit.client.1.smithi093.stdout:4/899: rmdir d0/d87/d79/d96 39 2023-12-12T11:51:58.281 INFO:tasks.workunit.client.1.smithi093.stdout:4/900: chown d0/d31/d9d/c106 38996529 1 2023-12-12T11:51:58.285 INFO:tasks.workunit.client.1.smithi093.stdout:2/716: dwrite d5/f19 [0,4194304] 0 2023-12-12T11:51:58.285 INFO:tasks.workunit.client.1.smithi093.stdout:1/680: mkdir d4/d1a/d1b/d26/d31/ddb/de2 0 2023-12-12T11:51:58.291 INFO:tasks.workunit.client.0.smithi063.stdout:3/431: dread d4/df/f19 [0,4194304] 0 2023-12-12T11:51:58.293 INFO:tasks.workunit.client.0.smithi063.stdout:1/515: truncate d3/db/d16/d24/d4d/d35/f51 5571637 0 2023-12-12T11:51:58.295 INFO:tasks.workunit.client.1.smithi093.stdout:7/640: mknod da/d8e/da9/cdf 0 2023-12-12T11:51:58.295 INFO:tasks.workunit.client.1.smithi093.stdout:7/641: write f0 [6926588,20600] 0 2023-12-12T11:51:58.296 INFO:tasks.workunit.client.1.smithi093.stdout:7/642: stat da/f7b 0 2023-12-12T11:51:58.298 INFO:tasks.workunit.client.0.smithi063.stdout:4/524: dwrite d2/d48/d4f/fa3 [0,4194304] 0 2023-12-12T11:51:58.300 INFO:tasks.workunit.client.0.smithi063.stdout:4/525: creat d2/d17/d7f/fa9 x:0 0 0 2023-12-12T11:51:58.303 INFO:tasks.workunit.client.1.smithi093.stdout:3/663: creat df/d22/d49/d69/d78/daf/d3d/d6f/fd5 x:0 0 0 2023-12-12T11:51:58.304 INFO:tasks.workunit.client.1.smithi093.stdout:2/717: symlink d5/d14/d2d/d4c/d54/d67/d69/d6c/df2/lf3 0 2023-12-12T11:51:58.306 INFO:tasks.workunit.client.0.smithi063.stdout:3/432: getdents d4/d23/d5d 0 2023-12-12T11:51:58.306 INFO:tasks.workunit.client.0.smithi063.stdout:3/433: chown d4/d23/d5d/c6e 766 1 2023-12-12T11:51:58.311 INFO:tasks.workunit.client.0.smithi063.stdout:1/516: creat d3/db/d16/d4f/da7/faa x:0 0 0 2023-12-12T11:51:58.318 INFO:tasks.workunit.client.0.smithi063.stdout:4/526: truncate d2/f40 1748361 0 2023-12-12T11:51:58.322 INFO:tasks.workunit.client.0.smithi063.stdout:3/434: rename d4/f6 to d4/df/d1a/d1c/d57/f8a 0 2023-12-12T11:51:58.324 INFO:tasks.workunit.client.1.smithi093.stdout:3/664: write df/d22/f89 [3374308,83224] 0 2023-12-12T11:51:58.324 INFO:tasks.workunit.client.1.smithi093.stdout:7/643: write da/d2e/d89/fbf [2803644,28260] 0 2023-12-12T11:51:58.326 INFO:tasks.workunit.client.1.smithi093.stdout:3/665: read df/d22/d49/d69/d6e/f94 [556124,109328] 0 2023-12-12T11:51:58.326 INFO:tasks.workunit.client.0.smithi063.stdout:1/517: unlink d3/db/d16/d24/d48/d75/d83/d5b/f65 0 2023-12-12T11:51:58.326 INFO:tasks.workunit.client.1.smithi093.stdout:0/706: dwrite d5/dd/d33/f46 [0,4194304] 0 2023-12-12T11:51:58.333 INFO:tasks.workunit.client.0.smithi063.stdout:1/518: creat d3/db/d16/d4f/d9a/fab x:0 0 0 2023-12-12T11:51:58.333 INFO:tasks.workunit.client.0.smithi063.stdout:1/519: stat d3/db/d12/f27 0 2023-12-12T11:51:58.333 INFO:tasks.workunit.client.1.smithi093.stdout:9/665: dwrite d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/d42/f6e [0,4194304] 0 2023-12-12T11:51:58.334 INFO:tasks.workunit.client.1.smithi093.stdout:8/723: sync 2023-12-12T11:51:58.334 INFO:tasks.workunit.client.1.smithi093.stdout:0/707: rmdir d5/d21 39 2023-12-12T11:51:58.334 INFO:tasks.workunit.client.1.smithi093.stdout:0/708: readlink d5/dd/d14/d26/l47 0 2023-12-12T11:51:58.336 INFO:tasks.workunit.client.0.smithi063.stdout:2/382: dwrite d0/d1a/f1d [0,4194304] 0 2023-12-12T11:51:58.339 INFO:tasks.workunit.client.1.smithi093.stdout:6/825: dwrite d0/da/d14/d38/d43/f86 [0,4194304] 0 2023-12-12T11:51:58.339 INFO:tasks.workunit.client.1.smithi093.stdout:8/724: getdents d3/d1a/d1f 0 2023-12-12T11:51:58.340 INFO:tasks.workunit.client.1.smithi093.stdout:4/901: dwrite d0/d87/d79/db2/fae [4194304,4194304] 0 2023-12-12T11:51:58.341 INFO:tasks.workunit.client.0.smithi063.stdout:0/446: dwrite d0/d7/f55 [0,4194304] 0 2023-12-12T11:51:58.341 INFO:tasks.workunit.client.0.smithi063.stdout:0/447: fdatasync d0/d7/d27/d44/f85 0 2023-12-12T11:51:58.341 INFO:tasks.workunit.client.0.smithi063.stdout:4/527: write d2/d48/d69/f82 [1468568,3382] 0 2023-12-12T11:51:58.341 INFO:tasks.workunit.client.0.smithi063.stdout:4/528: write d2/d47/d6d/f8e [171527,76533] 0 2023-12-12T11:51:58.343 INFO:tasks.workunit.client.1.smithi093.stdout:9/666: creat d1/d23/d24/d29/d43/d56/d85/dc3/dce/d3e/fe4 x:0 0 0 2023-12-12T11:51:58.344 INFO:tasks.workunit.client.1.smithi093.stdout:9/667: readlink d1/d23/d24/d29/d43/d56/d85/dc3/dce/l14 0 2023-12-12T11:51:58.344 INFO:tasks.workunit.client.1.smithi093.stdout:9/668: fdatasync d1/d23/d24/fa1 0 2023-12-12T11:51:58.345 INFO:tasks.workunit.client.1.smithi093.stdout:3/666: dread df/f43 [0,4194304] 0 2023-12-12T11:51:58.345 INFO:tasks.workunit.client.1.smithi093.stdout:3/667: chown df/d22/d49/d69/fa7 3 1 2023-12-12T11:51:58.346 INFO:tasks.workunit.client.1.smithi093.stdout:3/668: stat df/l18 0 2023-12-12T11:51:58.349 INFO:tasks.workunit.client.1.smithi093.stdout:7/644: rmdir da/d8e 39 2023-12-12T11:51:58.363 INFO:tasks.workunit.client.0.smithi063.stdout:0/448: link d0/d7/d27/f33 d0/d7/d27/d44/f97 0 2023-12-12T11:51:58.367 INFO:tasks.workunit.client.1.smithi093.stdout:6/826: truncate d0/da/d14/d3a/f6a 1428974 0 2023-12-12T11:51:58.367 INFO:tasks.workunit.client.1.smithi093.stdout:6/827: truncate d0/da/d32/d9e/d4d/de9/fed 623815 0 2023-12-12T11:51:58.368 INFO:tasks.workunit.client.1.smithi093.stdout:6/828: dread - d0/da/d32/d9e/d4d/f11e zero size 2023-12-12T11:51:58.371 INFO:tasks.workunit.client.1.smithi093.stdout:8/725: creat d3/d1a/d1f/d29/d63/ff5 x:0 0 0 2023-12-12T11:51:58.385 INFO:tasks.workunit.client.1.smithi093.stdout:4/902: creat d0/d31/d89/d10c/f116 x:0 0 0 2023-12-12T11:51:58.387 INFO:tasks.workunit.client.1.smithi093.stdout:3/669: mkdir df/d22/d49/d69/d78/daf/d3d/d42/dd6 0 2023-12-12T11:51:58.390 INFO:tasks.workunit.client.0.smithi063.stdout:4/529: mkdir d2/d47/daa 0 2023-12-12T11:51:58.390 INFO:tasks.workunit.client.0.smithi063.stdout:4/530: chown d2/d8/c80 0 1 2023-12-12T11:51:58.390 INFO:tasks.workunit.client.1.smithi093.stdout:2/718: dwrite d5/d14/d2d/d8b/da2/fb7 [0,4194304] 0 2023-12-12T11:51:58.390 INFO:tasks.workunit.client.1.smithi093.stdout:2/719: chown d5/d14/d2d/le1 1588513 1 2023-12-12T11:51:58.391 INFO:tasks.workunit.client.1.smithi093.stdout:0/709: getdents d5/d41 0 2023-12-12T11:51:58.391 INFO:tasks.workunit.client.0.smithi063.stdout:4/531: write d2/d47/f66 [1047175,95748] 0 2023-12-12T11:51:58.391 INFO:tasks.workunit.client.0.smithi063.stdout:4/532: chown d2/f58 23858906 1 2023-12-12T11:51:58.391 INFO:tasks.workunit.client.1.smithi093.stdout:8/726: symlink d3/d1a/d1f/d29/d63/lf6 0 2023-12-12T11:51:58.396 INFO:tasks.workunit.client.1.smithi093.stdout:4/903: truncate d0/d36/d49/fc9 1146148 0 2023-12-12T11:51:58.396 INFO:tasks.workunit.client.1.smithi093.stdout:4/904: dread - d0/d87/d79/d96/dcc/fdc zero size 2023-12-12T11:51:58.397 INFO:tasks.workunit.client.0.smithi063.stdout:0/449: creat d0/d7/f98 x:0 0 0 2023-12-12T11:51:58.402 INFO:tasks.workunit.client.1.smithi093.stdout:5/574: sync 2023-12-12T11:51:58.402 INFO:tasks.workunit.client.1.smithi093.stdout:5/575: dread - d0/d7/d59/d48/f89 zero size 2023-12-12T11:51:58.402 INFO:tasks.workunit.client.1.smithi093.stdout:5/576: fsync d0/d7/d59/d48/f56 0 2023-12-12T11:51:58.405 INFO:tasks.workunit.client.0.smithi063.stdout:3/435: dwrite d4/df/d1a/d1c/d3b/f5b [0,4194304] 0 2023-12-12T11:51:58.410 INFO:tasks.workunit.client.1.smithi093.stdout:4/905: link d0/fa3 d0/d31/d5c/d66/d110/f117 0 2023-12-12T11:51:58.410 INFO:tasks.workunit.client.1.smithi093.stdout:4/906: stat d0/d31/d5c/def 0 2023-12-12T11:51:58.410 INFO:tasks.workunit.client.1.smithi093.stdout:4/907: chown d0/d36/d61/d97/ce1 150885049 1 2023-12-12T11:51:58.410 INFO:tasks.workunit.client.0.smithi063.stdout:9/382: sync 2023-12-12T11:51:58.410 INFO:tasks.workunit.client.0.smithi063.stdout:7/426: sync 2023-12-12T11:51:58.410 INFO:tasks.workunit.client.0.smithi063.stdout:9/383: write d7/d20/d45/f57 [240959,30248] 0 2023-12-12T11:51:58.410 INFO:tasks.workunit.client.0.smithi063.stdout:5/480: sync 2023-12-12T11:51:58.414 INFO:tasks.workunit.client.0.smithi063.stdout:3/436: stat d4/df/d1a/d1c/d3b/c5f 0 2023-12-12T11:51:58.415 INFO:tasks.workunit.client.1.smithi093.stdout:8/727: rmdir d3/d1a/d1f/d75 39 2023-12-12T11:51:58.415 INFO:tasks.workunit.client.1.smithi093.stdout:5/577: mknod d0/d7/d8/d8f/cc5 0 2023-12-12T11:51:58.416 INFO:tasks.workunit.client.0.smithi063.stdout:4/533: dread d2/d17/d61/f71 [0,4194304] 0 2023-12-12T11:51:58.416 INFO:tasks.workunit.client.0.smithi063.stdout:4/534: write d2/d8/fa [5974705,91131] 0 2023-12-12T11:51:58.418 INFO:tasks.workunit.client.0.smithi063.stdout:7/427: link de/d39/d4b/l52 de/d34/d43/d45/l9c 0 2023-12-12T11:51:58.419 INFO:tasks.workunit.client.0.smithi063.stdout:2/383: dwrite d0/d1a/d48/f3d [0,4194304] 0 2023-12-12T11:51:58.419 INFO:tasks.workunit.client.0.smithi063.stdout:3/437: symlink d4/d23/d6b/l8b 0 2023-12-12T11:51:58.420 INFO:tasks.workunit.client.1.smithi093.stdout:2/720: dread d5/d14/d2d/fc [0,4194304] 0 2023-12-12T11:51:58.420 INFO:tasks.workunit.client.1.smithi093.stdout:9/669: dwrite d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d57/d63/f83 [0,4194304] 0 2023-12-12T11:51:58.420 INFO:tasks.workunit.client.1.smithi093.stdout:9/670: dread - d1/d23/d24/d29/d43/fcf zero size 2023-12-12T11:51:58.420 INFO:tasks.workunit.client.1.smithi093.stdout:3/670: dread df/d22/d49/d69/d78/daf/d3d/d59/f98 [0,4194304] 0 2023-12-12T11:51:58.420 INFO:tasks.workunit.client.0.smithi063.stdout:1/520: dwrite d3/db/d16/d24/d48/d75/d83/d5b/d6b/d6d/f7a [0,4194304] 0 2023-12-12T11:51:58.421 INFO:tasks.workunit.client.0.smithi063.stdout:1/521: dread - d3/db/d16/d4f/d9a/fab zero size 2023-12-12T11:51:58.421 INFO:tasks.workunit.client.0.smithi063.stdout:1/522: dread - d3/db/d16/d24/d4d/f7c zero size 2023-12-12T11:51:58.434 INFO:tasks.workunit.client.1.smithi093.stdout:8/728: read d3/d1a/d1f/d59/fcd [1964557,88654] 0 2023-12-12T11:51:58.444 INFO:tasks.workunit.client.1.smithi093.stdout:6/829: dwrite d0/da/d14/d38/d69/f117 [0,4194304] 0 2023-12-12T11:51:58.460 INFO:tasks.workunit.client.1.smithi093.stdout:0/710: write d5/dd/d62/f69 [42346,63051] 0 2023-12-12T11:51:58.460 INFO:tasks.workunit.client.1.smithi093.stdout:0/711: chown d5/d21/d2f 256196647 1 2023-12-12T11:51:58.461 INFO:tasks.workunit.client.1.smithi093.stdout:4/908: rename d0/c2b to d0/d87/d79/d96/c118 0 2023-12-12T11:51:58.469 INFO:tasks.workunit.client.1.smithi093.stdout:2/721: mkdir d5/d14/d2d/d12/d25/d7a/d7e/da0/df4 0 2023-12-12T11:51:58.471 INFO:tasks.workunit.client.0.smithi063.stdout:3/438: creat d4/df/d1a/d1c/d34/d54/f8c x:0 0 0 2023-12-12T11:51:58.471 INFO:tasks.workunit.client.0.smithi063.stdout:3/439: chown d4/d23/d5d 4448818 1 2023-12-12T11:51:58.471 INFO:tasks.workunit.client.0.smithi063.stdout:3/440: dread - d4/df/f80 zero size 2023-12-12T11:51:58.472 INFO:tasks.workunit.client.1.smithi093.stdout:1/681: sync 2023-12-12T11:51:58.473 INFO:tasks.workunit.client.1.smithi093.stdout:9/671: unlink d1/f16 0 2023-12-12T11:51:58.477 INFO:tasks.workunit.client.0.smithi063.stdout:5/481: dwrite d7/d28/d43/f88 [0,4194304] 0 2023-12-12T11:51:58.477 INFO:tasks.workunit.client.0.smithi063.stdout:7/428: dwrite de/d3f/f59 [0,4194304] 0 2023-12-12T11:51:58.477 INFO:tasks.workunit.client.1.smithi093.stdout:3/671: unlink df/d30/d33/d66/l7e 0 2023-12-12T11:51:58.477 INFO:tasks.workunit.client.1.smithi093.stdout:3/672: fdatasync df/d22/d49/d69/d78/fc0 0 2023-12-12T11:51:58.478 INFO:tasks.workunit.client.1.smithi093.stdout:3/673: stat df/d25/d6b 0 2023-12-12T11:51:58.478 INFO:tasks.workunit.client.0.smithi063.stdout:7/429: truncate de/d22/d6f/f9a 908546 0 2023-12-12T11:51:58.478 INFO:tasks.workunit.client.0.smithi063.stdout:7/430: chown de 415648 1 2023-12-12T11:51:58.478 INFO:tasks.workunit.client.0.smithi063.stdout:1/523: dwrite d3/db/d12/f27 [0,4194304] 0 2023-12-12T11:51:58.481 INFO:tasks.workunit.client.0.smithi063.stdout:1/524: read d3/db/d16/f3c [266776,46341] 0 2023-12-12T11:51:58.484 INFO:tasks.workunit.client.1.smithi093.stdout:5/578: dwrite d0/d7/d59/f2d [0,4194304] 0 2023-12-12T11:51:58.484 INFO:tasks.workunit.client.1.smithi093.stdout:7/645: dwrite da/d2e/d89/fbf [4194304,4194304] 0 2023-12-12T11:51:58.486 INFO:tasks.workunit.client.0.smithi063.stdout:5/482: dread d7/d28/f3f [0,4194304] 0 2023-12-12T11:51:58.489 INFO:tasks.workunit.client.1.smithi093.stdout:8/729: dwrite d3/d8/d88/dc5/fe6 [0,4194304] 0 2023-12-12T11:51:58.489 INFO:tasks.workunit.client.1.smithi093.stdout:8/730: truncate d3/d1a/d1f/d59/d69/dbc/fe8 1028871 0 2023-12-12T11:51:58.489 INFO:tasks.workunit.client.1.smithi093.stdout:8/731: fsync d3/d1a/d1f/d59/d6c/f93 0 2023-12-12T11:51:58.489 INFO:tasks.workunit.client.1.smithi093.stdout:8/732: chown d3/d1a/d1f/d29/d3a/d68/d8a/lc4 1683 1 2023-12-12T11:51:58.492 INFO:tasks.workunit.client.0.smithi063.stdout:2/384: getdents d0/d1a/d26 0 2023-12-12T11:51:58.492 INFO:tasks.workunit.client.0.smithi063.stdout:2/385: write d0/f17 [434641,105398] 0 2023-12-12T11:51:58.492 INFO:tasks.workunit.client.0.smithi063.stdout:2/386: creat d0/d1a/d3a/d59/f7e x:0 0 0 2023-12-12T11:51:58.492 INFO:tasks.workunit.client.0.smithi063.stdout:2/387: fdatasync d0/d1a/d26/f37 0 2023-12-12T11:51:58.495 INFO:tasks.workunit.client.1.smithi093.stdout:0/712: mkdir d5/dd/d14/d26/d58/d64/ddb 0 2023-12-12T11:51:58.495 INFO:tasks.workunit.client.1.smithi093.stdout:2/722: creat d5/d14/d47/d4e/dae/ff5 x:0 0 0 2023-12-12T11:51:58.496 INFO:tasks.workunit.client.1.smithi093.stdout:3/674: mknod df/d22/cd7 0 2023-12-12T11:51:58.496 INFO:tasks.workunit.client.1.smithi093.stdout:8/733: write d3/d1a/d1f/d75/f9f [72647,69974] 0 2023-12-12T11:51:58.496 INFO:tasks.workunit.client.1.smithi093.stdout:9/672: mknod d1/d23/d24/d29/d43/d56/d85/dc3/dce/de1/ce5 0 2023-12-12T11:51:58.502 INFO:tasks.workunit.client.1.smithi093.stdout:5/579: rename d0/d7/d36/d29/l3c to d0/d7/d8/d9e/d6a/lc6 0 2023-12-12T11:51:58.507 INFO:tasks.workunit.client.1.smithi093.stdout:7/646: mkdir da/d15/d59/de0 0 2023-12-12T11:51:58.513 INFO:tasks.workunit.client.1.smithi093.stdout:4/909: dwrite d0/d36/f4c [4194304,4194304] 0 2023-12-12T11:51:58.513 INFO:tasks.workunit.client.1.smithi093.stdout:6/830: dwrite d0/da/d14/f1b [4194304,4194304] 0 2023-12-12T11:51:58.514 INFO:tasks.workunit.client.0.smithi063.stdout:7/431: symlink de/d34/d68/d89/l9d 0 2023-12-12T11:51:58.515 INFO:tasks.workunit.client.1.smithi093.stdout:2/723: mkdir d5/d14/d2d/d12/d44/df6 0 2023-12-12T11:51:58.516 INFO:tasks.workunit.client.0.smithi063.stdout:1/525: mknod d3/db/d16/d24/d4d/d35/cac 0 2023-12-12T11:51:58.518 INFO:tasks.workunit.client.1.smithi093.stdout:1/682: dwrite d4/d1a/d1b/f3a [0,4194304] 0 2023-12-12T11:51:58.518 INFO:tasks.workunit.client.0.smithi063.stdout:5/483: symlink d7/d10/d2b/l93 0 2023-12-12T11:51:58.519 INFO:tasks.workunit.client.1.smithi093.stdout:7/647: dread da/d15/d2d/f6e [0,4194304] 0 2023-12-12T11:51:58.519 INFO:tasks.workunit.client.1.smithi093.stdout:7/648: creat da/de/d78/fe1 x:0 0 0 2023-12-12T11:51:58.521 INFO:tasks.workunit.client.0.smithi063.stdout:6/519: sync 2023-12-12T11:51:58.521 INFO:tasks.workunit.client.0.smithi063.stdout:8/510: sync 2023-12-12T11:51:58.521 INFO:tasks.workunit.client.0.smithi063.stdout:6/520: creat d9/d68/faa x:0 0 0 2023-12-12T11:51:58.521 INFO:tasks.workunit.client.0.smithi063.stdout:6/521: creat d9/d10/d5c/d5e/fab x:0 0 0 2023-12-12T11:51:58.525 INFO:tasks.workunit.client.1.smithi093.stdout:3/675: mkdir df/d22/d49/d69/d78/daf/d3d/d59/d72/d79/dd8 0 2023-12-12T11:51:58.527 INFO:tasks.workunit.client.1.smithi093.stdout:5/580: symlink d0/d7/lc7 0 2023-12-12T11:51:58.529 INFO:tasks.workunit.client.1.smithi093.stdout:4/910: rename d0/d31/d9d/cdf to d0/d36/d61/c119 0 2023-12-12T11:51:58.533 INFO:tasks.workunit.client.0.smithi063.stdout:1/526: unlink d3/d3a/d5e/la1 0 2023-12-12T11:51:58.535 INFO:tasks.workunit.client.1.smithi093.stdout:6/831: creat d0/d52/d6b/f129 x:0 0 0 2023-12-12T11:51:58.536 INFO:tasks.workunit.client.0.smithi063.stdout:5/484: mkdir d7/d28/d94 0 2023-12-12T11:51:58.536 INFO:tasks.workunit.client.0.smithi063.stdout:5/485: dread - d7/d10/d2b/d3c/d27/f81 zero size 2023-12-12T11:51:58.537 INFO:tasks.workunit.client.1.smithi093.stdout:2/724: creat d5/d14/d2d/d8b/da3/de5/ff7 x:0 0 0 2023-12-12T11:51:58.537 INFO:tasks.workunit.client.1.smithi093.stdout:7/649: dread da/d15/d2d/f3c [0,4194304] 0 2023-12-12T11:51:58.539 INFO:tasks.workunit.client.0.smithi063.stdout:8/511: link f3 d4/f9c 0 2023-12-12T11:51:58.545 INFO:tasks.workunit.client.0.smithi063.stdout:6/522: creat d9/d10/d5c/fac x:0 0 0 2023-12-12T11:51:58.546 INFO:tasks.workunit.client.0.smithi063.stdout:6/523: creat d9/d10/d5c/fad x:0 0 0 2023-12-12T11:51:58.546 INFO:tasks.workunit.client.1.smithi093.stdout:3/676: dread df/d22/d49/d69/d78/daf/f41 [0,4194304] 0 2023-12-12T11:51:58.547 INFO:tasks.workunit.client.1.smithi093.stdout:9/673: dwrite d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/f38 [0,4194304] 0 2023-12-12T11:51:58.548 INFO:tasks.workunit.client.0.smithi063.stdout:2/388: getdents d0/d1a/d1e 0 2023-12-12T11:51:58.551 INFO:tasks.workunit.client.0.smithi063.stdout:3/441: rename d4/c27 to d4/df/d1a/d1c/c8d 0 2023-12-12T11:51:58.554 INFO:tasks.workunit.client.0.smithi063.stdout:1/527: truncate d3/db/d16/d24/d48/f8f 1715747 0 2023-12-12T11:51:58.556 INFO:tasks.workunit.client.1.smithi093.stdout:4/911: mkdir d0/d36/d61/d97/d11a 0 2023-12-12T11:51:58.557 INFO:tasks.workunit.client.0.smithi063.stdout:8/512: symlink d4/d24/d38/d45/d5b/d92/d65/l9d 0 2023-12-12T11:51:58.563 INFO:tasks.workunit.client.1.smithi093.stdout:2/725: creat d5/d14/d47/de2/ff8 x:0 0 0 2023-12-12T11:51:58.563 INFO:tasks.workunit.client.1.smithi093.stdout:1/683: dwrite d4/dc/f18 [0,4194304] 0 2023-12-12T11:51:58.564 INFO:tasks.workunit.client.1.smithi093.stdout:1/684: stat d4/dc/f28 0 2023-12-12T11:51:58.564 INFO:tasks.workunit.client.0.smithi063.stdout:2/389: symlink d0/d1a/d1e/l7f 0 2023-12-12T11:51:58.564 INFO:tasks.workunit.client.0.smithi063.stdout:2/390: chown d0/d1a/d1e/l7f 960271 1 2023-12-12T11:51:58.565 INFO:tasks.workunit.client.0.smithi063.stdout:2/391: write d0/d1a/d26/f44 [1083055,21129] 0 2023-12-12T11:51:58.570 INFO:tasks.workunit.client.0.smithi063.stdout:6/524: rename d9/l45 to d9/d10/d2a/lae 0 2023-12-12T11:51:58.571 INFO:tasks.workunit.client.0.smithi063.stdout:6/525: write d9/d2c/d6b/f75 [668772,6989] 0 2023-12-12T11:51:58.571 INFO:tasks.workunit.client.0.smithi063.stdout:6/526: fsync d9/f8d 0 2023-12-12T11:51:58.573 INFO:tasks.workunit.client.0.smithi063.stdout:3/442: creat d4/d23/d5d/d4c/f8e x:0 0 0 2023-12-12T11:51:58.573 INFO:tasks.workunit.client.0.smithi063.stdout:3/443: dread - d4/df/d1a/d1c/d34/f85 zero size 2023-12-12T11:51:58.573 INFO:tasks.workunit.client.0.smithi063.stdout:3/444: fdatasync f0 0 2023-12-12T11:51:58.574 INFO:tasks.workunit.client.1.smithi093.stdout:3/677: creat df/d22/d49/d69/d78/daf/d3d/d59/d72/fd9 x:0 0 0 2023-12-12T11:51:58.574 INFO:tasks.workunit.client.1.smithi093.stdout:3/678: write df/d22/d49/d69/d6e/f94 [978288,60805] 0 2023-12-12T11:51:58.575 INFO:tasks.workunit.client.1.smithi093.stdout:9/674: stat d1/d23/d24/d29/d43/d56/d85/dc3/cd0 0 2023-12-12T11:51:58.579 INFO:tasks.workunit.client.1.smithi093.stdout:4/912: truncate d0/d36/d49/faf 2516983 0 2023-12-12T11:51:58.579 INFO:tasks.workunit.client.1.smithi093.stdout:4/913: chown d0/fe 27 1 2023-12-12T11:51:58.586 INFO:tasks.workunit.client.0.smithi063.stdout:1/528: rename d3/db/d16/d24/d4d/d35/cac to d3/d3a/cad 0 2023-12-12T11:51:58.586 INFO:tasks.workunit.client.0.smithi063.stdout:8/513: rename d4/d24/d38/d45 to d4/d24/d38/d45/d5b/d92/d95/d9e 22 2023-12-12T11:51:58.586 INFO:tasks.workunit.client.0.smithi063.stdout:8/514: stat d4/de/d3b/d62/d36/l81 0 2023-12-12T11:51:58.594 INFO:tasks.workunit.client.1.smithi093.stdout:6/832: write d0/da/d32/d9e/d4d/de9/fed [960865,70468] 0 2023-12-12T11:51:58.597 INFO:tasks.workunit.client.1.smithi093.stdout:2/726: mkdir d5/d14/d2d/d12/d44/df9 0 2023-12-12T11:51:58.597 INFO:tasks.workunit.client.1.smithi093.stdout:2/727: chown d5/d14/f3c 152142148 1 2023-12-12T11:51:58.597 INFO:tasks.workunit.client.1.smithi093.stdout:2/728: fsync d5/d14/d47/d4e/fcc 0 2023-12-12T11:51:58.597 INFO:tasks.workunit.client.1.smithi093.stdout:2/729: stat d5/d14/d2d/d4c/d54/d67/d69/d6c/df2/lf3 0 2023-12-12T11:51:58.598 INFO:tasks.workunit.client.1.smithi093.stdout:2/730: write d5/d14/f26 [5108892,123449] 0 2023-12-12T11:51:58.598 INFO:tasks.workunit.client.1.smithi093.stdout:1/685: mkdir d4/d1a/d1b/d26/d82/de3 0 2023-12-12T11:51:58.598 INFO:tasks.workunit.client.1.smithi093.stdout:2/731: truncate d5/d14/d2d/d4c/d54/dc5/d61/ff1 371043 0 2023-12-12T11:51:58.599 INFO:tasks.workunit.client.1.smithi093.stdout:7/650: rmdir da/d2e/d89 39 2023-12-12T11:51:58.602 INFO:tasks.workunit.client.1.smithi093.stdout:3/679: creat df/d22/d49/d69/d78/daf/d3d/d59/d72/d79/fda x:0 0 0 2023-12-12T11:51:58.603 INFO:tasks.workunit.client.1.smithi093.stdout:3/680: readlink df/d22/d49/d69/d78/daf/d3d/d6f/l71 0 2023-12-12T11:51:58.603 INFO:tasks.workunit.client.1.smithi093.stdout:3/681: creat df/d22/d49/d69/d78/daf/d3d/d6f/db1/fdb x:0 0 0 2023-12-12T11:51:58.605 INFO:tasks.workunit.client.0.smithi063.stdout:5/486: dwrite d7/d10/d2b/f58 [0,4194304] 0 2023-12-12T11:51:58.605 INFO:tasks.workunit.client.0.smithi063.stdout:5/487: chown d7/d10/f46 49277332 1 2023-12-12T11:51:58.609 INFO:tasks.workunit.client.1.smithi093.stdout:9/675: mkdir d1/d23/dd5/de6 0 2023-12-12T11:51:58.613 INFO:tasks.workunit.client.1.smithi093.stdout:4/914: symlink d0/d31/d89/da1/db7/l11b 0 2023-12-12T11:51:58.614 INFO:tasks.workunit.client.1.smithi093.stdout:4/915: truncate d0/d36/d49/f8c 692807 0 2023-12-12T11:51:58.617 INFO:tasks.workunit.client.0.smithi063.stdout:1/529: rmdir d3/d3a 39 2023-12-12T11:51:58.617 INFO:tasks.workunit.client.0.smithi063.stdout:1/530: rename d3/db/d16/d24/d30 to d3/db/d16/d24/d30/dae 22 2023-12-12T11:51:58.622 INFO:tasks.workunit.client.0.smithi063.stdout:8/515: dread d4/d24/d38/d45/f6a [0,4194304] 0 2023-12-12T11:51:58.623 INFO:tasks.workunit.client.0.smithi063.stdout:8/516: truncate d4/f9a 379047 0 2023-12-12T11:51:58.623 INFO:tasks.workunit.client.0.smithi063.stdout:8/517: chown d4/de/l28 0 1 2023-12-12T11:51:58.623 INFO:tasks.workunit.client.0.smithi063.stdout:8/518: write d4/de/d3b/d62/d36/d57/f63 [429728,92857] 0 2023-12-12T11:51:58.630 INFO:tasks.workunit.client.1.smithi093.stdout:3/682: dread df/d22/d49/d69/d78/daf/f41 [0,4194304] 0 2023-12-12T11:51:58.633 INFO:tasks.workunit.client.0.smithi063.stdout:5/488: mknod d7/d10/d2b/d3c/d42/d62/d69/c95 0 2023-12-12T11:51:58.636 INFO:tasks.workunit.client.1.smithi093.stdout:6/833: stat d0/da/d14/d38/d43/cfa 0 2023-12-12T11:51:58.639 INFO:tasks.workunit.client.0.smithi063.stdout:1/531: unlink d3/db/d12/l2f 0 2023-12-12T11:51:58.641 INFO:tasks.workunit.client.0.smithi063.stdout:8/519: getdents d4/d24/d38/d45/d5b/d92/d65 0 2023-12-12T11:51:58.645 INFO:tasks.workunit.client.1.smithi093.stdout:7/651: rename da/d8e/daa/ld2 to da/d15/d59/de0/le2 0 2023-12-12T11:51:58.645 INFO:tasks.workunit.client.0.smithi063.stdout:1/532: rmdir d3/d3a/d5e/d6f 39 2023-12-12T11:51:58.648 INFO:tasks.workunit.client.0.smithi063.stdout:1/533: mkdir d3/db/d16/d24/d48/d75/d83/d5b/d6b/d6d/daf 0 2023-12-12T11:51:58.648 INFO:tasks.workunit.client.0.smithi063.stdout:5/489: dread d7/d28/f47 [0,4194304] 0 2023-12-12T11:51:58.656 INFO:tasks.workunit.client.1.smithi093.stdout:8/734: sync 2023-12-12T11:51:58.656 INFO:tasks.workunit.client.1.smithi093.stdout:0/713: sync 2023-12-12T11:51:58.656 INFO:tasks.workunit.client.1.smithi093.stdout:9/676: mknod d1/d23/d24/d29/d43/d56/d85/ce7 0 2023-12-12T11:51:58.656 INFO:tasks.workunit.client.0.smithi063.stdout:6/527: dwrite d9/d10/d5c/d5e/f6a [0,4194304] 0 2023-12-12T11:51:58.660 INFO:tasks.workunit.client.1.smithi093.stdout:6/834: rename d0/d52/d7e/d102 to d0/d52/d7e/d42/dd5/ddc/d12a 0 2023-12-12T11:51:58.661 INFO:tasks.workunit.client.1.smithi093.stdout:2/732: dwrite d5/d14/d2d/d4c/d76/dc6/fcf [0,4194304] 0 2023-12-12T11:51:58.663 INFO:tasks.workunit.client.0.smithi063.stdout:6/528: creat d9/d68/d94/faf x:0 0 0 2023-12-12T11:51:58.664 INFO:tasks.workunit.client.1.smithi093.stdout:7/652: mknod da/ce3 0 2023-12-12T11:51:58.664 INFO:tasks.workunit.client.1.smithi093.stdout:9/677: symlink d1/d23/d24/d29/d43/d56/d85/le8 0 2023-12-12T11:51:58.665 INFO:tasks.workunit.client.0.smithi063.stdout:2/392: dwrite d0/d1a/d48/f3f [0,4194304] 0 2023-12-12T11:51:58.668 INFO:tasks.workunit.client.1.smithi093.stdout:3/683: rmdir df/d22/d49/d69/d78/daf/d3d/d59/d72 39 2023-12-12T11:51:58.669 INFO:tasks.workunit.client.1.smithi093.stdout:1/686: dwrite d4/d1a/d1b/f8e [0,4194304] 0 2023-12-12T11:51:58.670 INFO:tasks.workunit.client.1.smithi093.stdout:0/714: dread d5/d21/d27/d3a/f4a [0,4194304] 0 2023-12-12T11:51:58.673 INFO:tasks.workunit.client.1.smithi093.stdout:6/835: creat d0/da/d14/d3a/f12b x:0 0 0 2023-12-12T11:51:58.673 INFO:tasks.workunit.client.1.smithi093.stdout:6/836: readlink d0/da/d14/d21/le2 0 2023-12-12T11:51:58.678 INFO:tasks.workunit.client.1.smithi093.stdout:7/653: truncate da/d15/d2d/f9f 3120219 0 2023-12-12T11:51:58.678 INFO:tasks.workunit.client.1.smithi093.stdout:9/678: unlink d1/d23/d24/d29/d43/d56/d85/fcc 0 2023-12-12T11:51:58.678 INFO:tasks.workunit.client.1.smithi093.stdout:7/654: dread - da/d15/d2d/f50 zero size 2023-12-12T11:51:58.683 INFO:tasks.workunit.client.1.smithi093.stdout:4/916: rename d0/d36/d61 to d0/d36/d11c 0 2023-12-12T11:51:58.684 INFO:tasks.workunit.client.1.smithi093.stdout:4/917: chown d0/d36/d40/f63 4 1 2023-12-12T11:51:58.684 INFO:tasks.workunit.client.1.smithi093.stdout:3/684: link df/dc6/cce df/d22/d49/d69/d78/cdc 0 2023-12-12T11:51:58.684 INFO:tasks.workunit.client.1.smithi093.stdout:3/685: write df/d30/d33/f3a [2717295,117550] 0 2023-12-12T11:51:58.684 INFO:tasks.workunit.client.1.smithi093.stdout:3/686: write df/d22/d49/d69/d78/daf/d3d/d42/d8e/da5/fbb [4099032,69253] 0 2023-12-12T11:51:58.684 INFO:tasks.workunit.client.1.smithi093.stdout:3/687: stat df/d25/d2c/d85/fcf 0 2023-12-12T11:51:58.685 INFO:tasks.workunit.client.1.smithi093.stdout:3/688: creat df/d22/d49/d69/d78/fdd x:0 0 0 2023-12-12T11:51:58.688 INFO:tasks.workunit.client.1.smithi093.stdout:6/837: symlink d0/da/d32/d9e/d4d/dd8/l12c 0 2023-12-12T11:51:58.689 INFO:tasks.workunit.client.1.smithi093.stdout:9/679: mkdir d1/d23/d24/d29/d43/d56/de9 0 2023-12-12T11:51:58.689 INFO:tasks.workunit.client.1.smithi093.stdout:9/680: chown d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d5c 26 1 2023-12-12T11:51:58.691 INFO:tasks.workunit.client.1.smithi093.stdout:7/655: mknod da/d15/d19/d4c/d6d/ce4 0 2023-12-12T11:51:58.693 INFO:tasks.workunit.client.1.smithi093.stdout:9/681: creat d1/d23/d24/fea x:0 0 0 2023-12-12T11:51:58.694 INFO:tasks.workunit.client.1.smithi093.stdout:9/682: fsync d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/f35 0 2023-12-12T11:51:58.696 INFO:tasks.workunit.client.1.smithi093.stdout:3/689: symlink df/d22/d49/d69/d78/daf/d3d/d42/d8e/da5/lde 0 2023-12-12T11:51:58.700 INFO:tasks.workunit.client.1.smithi093.stdout:3/690: creat df/dc6/fdf x:0 0 0 2023-12-12T11:51:58.715 INFO:tasks.workunit.client.1.smithi093.stdout:5/581: sync 2023-12-12T11:51:58.715 INFO:tasks.workunit.client.1.smithi093.stdout:7/656: dread da/de/f3b [0,4194304] 0 2023-12-12T11:51:58.725 INFO:tasks.workunit.client.1.smithi093.stdout:0/715: dread d5/dd/d62/f69 [0,4194304] 0 2023-12-12T11:51:58.725 INFO:tasks.workunit.client.1.smithi093.stdout:0/716: chown d5/d21/d2f/d54/f7b 11035 1 2023-12-12T11:51:58.735 INFO:tasks.workunit.client.1.smithi093.stdout:3/691: write df/d22/f31 [3370353,115510] 0 2023-12-12T11:51:58.752 INFO:tasks.workunit.client.0.smithi063.stdout:5/490: dwrite d7/d10/d2b/f55 [0,4194304] 0 2023-12-12T11:51:58.752 INFO:tasks.workunit.client.0.smithi063.stdout:5/491: fsync d7/d28/d6e/f8b 0 2023-12-12T11:51:58.752 INFO:tasks.workunit.client.0.smithi063.stdout:5/492: dread - d7/d10/d2b/f85 zero size 2023-12-12T11:51:58.752 INFO:tasks.workunit.client.0.smithi063.stdout:5/493: creat d7/d10/d2b/d3c/d42/f96 x:0 0 0 2023-12-12T11:51:58.754 INFO:tasks.workunit.client.0.smithi063.stdout:5/494: rename d7/d28/d43/f68 to d7/d28/d43/d49/f97 0 2023-12-12T11:51:58.755 INFO:tasks.workunit.client.1.smithi093.stdout:0/717: dread d5/d41/d77/d79/d9b/fc9 [0,4194304] 0 2023-12-12T11:51:58.755 INFO:tasks.workunit.client.1.smithi093.stdout:0/718: chown d5/dd/d62 3085 1 2023-12-12T11:51:58.755 INFO:tasks.workunit.client.1.smithi093.stdout:1/687: write d4/d1c/f88 [10808612,19348] 0 2023-12-12T11:51:58.755 INFO:tasks.workunit.client.1.smithi093.stdout:1/688: chown d4/d1a/d1b/d26/d65/d6f/f89 667346 1 2023-12-12T11:51:58.763 INFO:tasks.workunit.client.0.smithi063.stdout:1/534: dwrite d3/d3a/f60 [0,4194304] 0 2023-12-12T11:51:58.763 INFO:tasks.workunit.client.0.smithi063.stdout:1/535: rename d3/db/d16/d24/d48 to d3/db/d16/d24/d48/d75/d83/d81/db0 22 2023-12-12T11:51:58.766 INFO:tasks.workunit.client.0.smithi063.stdout:1/536: creat d3/fb1 x:0 0 0 2023-12-12T11:51:58.767 INFO:tasks.workunit.client.1.smithi093.stdout:7/657: dread da/fb [4194304,4194304] 0 2023-12-12T11:51:58.767 INFO:tasks.workunit.client.1.smithi093.stdout:6/838: write d0/da/d14/d38/d43/f9d [2949463,57765] 0 2023-12-12T11:51:58.767 INFO:tasks.workunit.client.1.smithi093.stdout:5/582: write d0/d7/d8/f5d [2459381,56799] 0 2023-12-12T11:51:58.768 INFO:tasks.workunit.client.1.smithi093.stdout:5/583: write d0/d7/d59/fa1 [1532100,45410] 0 2023-12-12T11:51:58.768 INFO:tasks.workunit.client.1.smithi093.stdout:8/735: dwrite d3/d1a/d1f/d29/d3a/d8f/fce [0,4194304] 0 2023-12-12T11:51:58.769 INFO:tasks.workunit.client.1.smithi093.stdout:6/839: unlink d0/da/d14/f1b 0 2023-12-12T11:51:58.770 INFO:tasks.workunit.client.1.smithi093.stdout:7/658: creat da/d15/d59/fe5 x:0 0 0 2023-12-12T11:51:58.770 INFO:tasks.workunit.client.0.smithi063.stdout:8/520: dwrite d4/de/f53 [0,4194304] 0 2023-12-12T11:51:58.771 INFO:tasks.workunit.client.1.smithi093.stdout:5/584: link d0/d7/d8/d9e/c25 d0/d7/d85/da0/cc8 0 2023-12-12T11:51:58.775 INFO:tasks.workunit.client.1.smithi093.stdout:5/585: write d0/d7/d59/d48/f6c [1601216,107086] 0 2023-12-12T11:51:58.775 INFO:tasks.workunit.client.1.smithi093.stdout:6/840: mknod d0/da/d14/c12d 0 2023-12-12T11:51:58.775 INFO:tasks.workunit.client.1.smithi093.stdout:6/841: truncate d0/da/d32/d9e/d4d/de9/fed 1098754 0 2023-12-12T11:51:58.775 INFO:tasks.workunit.client.1.smithi093.stdout:7/659: creat da/d15/d19/fe6 x:0 0 0 2023-12-12T11:51:58.775 INFO:tasks.workunit.client.1.smithi093.stdout:6/842: symlink d0/da/d14/d3a/d95/l12e 0 2023-12-12T11:51:58.776 INFO:tasks.workunit.client.0.smithi063.stdout:8/521: link d4/de/f41 d4/d24/d38/d45/f9f 0 2023-12-12T11:51:58.778 INFO:tasks.workunit.client.1.smithi093.stdout:6/843: mknod d0/da/d32/d39/df3/c12f 0 2023-12-12T11:51:58.795 INFO:tasks.workunit.client.1.smithi093.stdout:8/736: write d3/d1a/d1f/d29/d30/d58/f85 [1840209,121395] 0 2023-12-12T11:51:58.795 INFO:tasks.workunit.client.1.smithi093.stdout:8/737: dread - d3/d1a/d1f/d29/d3a/fc3 zero size 2023-12-12T11:51:58.799 INFO:tasks.workunit.client.1.smithi093.stdout:0/719: write d5/d21/d27/f5a [1618690,29341] 0 2023-12-12T11:51:58.799 INFO:tasks.workunit.client.1.smithi093.stdout:0/720: chown d5/dd/d62/f69 3321439 1 2023-12-12T11:51:58.799 INFO:tasks.workunit.client.1.smithi093.stdout:8/738: rmdir d3/d1a/d1f/d50/de0 0 2023-12-12T11:51:58.800 INFO:tasks.workunit.client.1.smithi093.stdout:0/721: write d5/dd/d62/fb7 [426031,103017] 0 2023-12-12T11:51:58.800 INFO:tasks.workunit.client.1.smithi093.stdout:0/722: fdatasync d5/d21/d2f/d54/f7b 0 2023-12-12T11:51:58.801 INFO:tasks.workunit.client.1.smithi093.stdout:4/918: dwrite d0/f17 [4194304,4194304] 0 2023-12-12T11:51:58.805 INFO:tasks.workunit.client.1.smithi093.stdout:8/739: rmdir d3/ddf 0 2023-12-12T11:51:58.806 INFO:tasks.workunit.client.1.smithi093.stdout:9/683: dwrite d1/fa [4194304,4194304] 0 2023-12-12T11:51:58.810 INFO:tasks.workunit.client.0.smithi063.stdout:1/537: dwrite d3/db/d16/d24/d48/f84 [0,4194304] 0 2023-12-12T11:51:58.810 INFO:tasks.workunit.client.0.smithi063.stdout:1/538: readlink d3/db/d16/l43 0 2023-12-12T11:51:58.814 INFO:tasks.workunit.client.1.smithi093.stdout:9/684: chown d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d57/d63 1 1 2023-12-12T11:51:58.814 INFO:tasks.workunit.client.1.smithi093.stdout:2/733: dwrite d5/d14/d47/d4e/fcc [0,4194304] 0 2023-12-12T11:51:58.814 INFO:tasks.workunit.client.1.smithi093.stdout:2/734: stat d5/d14/d2d/d12/d25/f2a 0 2023-12-12T11:51:58.814 INFO:tasks.workunit.client.1.smithi093.stdout:0/723: mkdir d5/d41/d77/d79/d9b/ddc 0 2023-12-12T11:51:58.814 INFO:tasks.workunit.client.1.smithi093.stdout:0/724: write d5/f30 [1518122,94242] 0 2023-12-12T11:51:58.815 INFO:tasks.workunit.client.1.smithi093.stdout:4/919: unlink d0/d31/d89/d10c/f116 0 2023-12-12T11:51:58.815 INFO:tasks.workunit.client.1.smithi093.stdout:8/740: read d3/d1a/d1f/d29/d30/d58/f85 [3218107,48451] 0 2023-12-12T11:51:58.815 INFO:tasks.workunit.client.1.smithi093.stdout:8/741: dread - d3/d1a/d1f/fb7 zero size 2023-12-12T11:51:58.819 INFO:tasks.workunit.client.0.smithi063.stdout:1/539: truncate d3/db/d12/f27 6379085 0 2023-12-12T11:51:58.819 INFO:tasks.workunit.client.0.smithi063.stdout:1/540: write d3/db/d16/d24/d30/f9c [1627141,57970] 0 2023-12-12T11:51:58.824 INFO:tasks.workunit.client.0.smithi063.stdout:1/541: mknod d3/db/d16/d24/d48/d75/d83/d5b/d6b/d6d/daf/cb2 0 2023-12-12T11:51:58.824 INFO:tasks.workunit.client.0.smithi063.stdout:2/393: dwrite d0/d1a/d57/f6f [0,4194304] 0 2023-12-12T11:51:58.825 INFO:tasks.workunit.client.1.smithi093.stdout:2/735: mkdir d5/d14/d5e/dfa 0 2023-12-12T11:51:58.825 INFO:tasks.workunit.client.1.smithi093.stdout:2/736: chown d5/d14/d2d/d96/dad/cb3 17428 1 2023-12-12T11:51:58.826 INFO:tasks.workunit.client.0.smithi063.stdout:5/495: dwrite d7/d28/f3f [0,4194304] 0 2023-12-12T11:51:58.826 INFO:tasks.workunit.client.0.smithi063.stdout:5/496: write d7/d10/d2b/d3c/d42/d62/f6c [1080406,93014] 0 2023-12-12T11:51:58.826 INFO:tasks.workunit.client.1.smithi093.stdout:2/737: write d5/d14/d2d/d12/d25/d7a/d7e/da0/fa9 [225034,111881] 0 2023-12-12T11:51:58.828 INFO:tasks.workunit.client.1.smithi093.stdout:0/725: symlink d5/dd/d14/d26/d58/d64/d6f/d90/ldd 0 2023-12-12T11:51:58.830 INFO:tasks.workunit.client.1.smithi093.stdout:4/920: creat d0/d87/d79/d7f/f11d x:0 0 0 2023-12-12T11:51:58.831 INFO:tasks.workunit.client.0.smithi063.stdout:1/542: creat d3/db/d12/fb3 x:0 0 0 2023-12-12T11:51:58.833 INFO:tasks.workunit.client.0.smithi063.stdout:0/450: sync 2023-12-12T11:51:58.833 INFO:tasks.workunit.client.1.smithi093.stdout:2/738: symlink d5/d14/d2d/d4c/d54/d67/d69/dde/lfb 0 2023-12-12T11:51:58.833 INFO:tasks.workunit.client.1.smithi093.stdout:2/739: fsync d5/d14/d2d/d4c/d54/dc5/d55/f8e 0 2023-12-12T11:51:58.836 INFO:tasks.workunit.client.0.smithi063.stdout:2/394: symlink d0/d1a/d3a/d59/l80 0 2023-12-12T11:51:58.839 INFO:tasks.workunit.client.0.smithi063.stdout:5/497: rename d7/d10/d2b/d3c/d27/l82 to d7/d28/l98 0 2023-12-12T11:51:58.840 INFO:tasks.workunit.client.1.smithi093.stdout:2/740: truncate d5/d31/f45 3564448 0 2023-12-12T11:51:58.841 INFO:tasks.workunit.client.0.smithi063.stdout:1/543: creat d3/db/d16/d24/d4d/d35/d98/fb4 x:0 0 0 2023-12-12T11:51:58.841 INFO:tasks.workunit.client.1.smithi093.stdout:8/742: dread d3/d1a/d1f/d29/f43 [0,4194304] 0 2023-12-12T11:51:58.843 INFO:tasks.workunit.client.0.smithi063.stdout:0/451: mkdir d0/d1a/d23/d34/d42/d99 0 2023-12-12T11:51:58.843 INFO:tasks.workunit.client.0.smithi063.stdout:8/522: dwrite d4/de/f30 [0,4194304] 0 2023-12-12T11:51:58.846 INFO:tasks.workunit.client.0.smithi063.stdout:5/498: symlink d7/d10/d2b/d3c/d42/d62/d69/l99 0 2023-12-12T11:51:58.849 INFO:tasks.workunit.client.1.smithi093.stdout:1/689: dwrite d4/d81/fbd [0,4194304] 0 2023-12-12T11:51:58.850 INFO:tasks.workunit.client.1.smithi093.stdout:1/690: fdatasync d4/dc/d7a/f8d 0 2023-12-12T11:51:58.853 INFO:tasks.workunit.client.1.smithi093.stdout:2/741: mkdir d5/d14/d2d/d12/d25/d7a/d7e/da5/dfc 0 2023-12-12T11:51:58.853 INFO:tasks.workunit.client.1.smithi093.stdout:2/742: truncate d5/d14/d2d/fcb 726440 0 2023-12-12T11:51:58.854 INFO:tasks.workunit.client.0.smithi063.stdout:2/395: read d0/d1a/d1e/f70 [2457008,106859] 0 2023-12-12T11:51:58.858 INFO:tasks.workunit.client.0.smithi063.stdout:2/396: write d0/d1a/d1e/f35 [516379,40288] 0 2023-12-12T11:51:58.859 INFO:tasks.workunit.client.0.smithi063.stdout:1/544: write d3/db/d16/d24/d4d/f68 [378778,27367] 0 2023-12-12T11:51:58.859 INFO:tasks.workunit.client.1.smithi093.stdout:6/844: dwrite d0/d52/fd9 [4194304,4194304] 0 2023-12-12T11:51:58.859 INFO:tasks.workunit.client.1.smithi093.stdout:5/586: dwrite d0/d7/d8/d9e/d6a/fb3 [0,4194304] 0 2023-12-12T11:51:58.862 INFO:tasks.workunit.client.1.smithi093.stdout:1/691: symlink d4/d1a/d1b/d26/d82/de3/le4 0 2023-12-12T11:51:58.866 INFO:tasks.workunit.client.0.smithi063.stdout:0/452: truncate d0/d7/d27/d44/f97 2559687 0 2023-12-12T11:51:58.866 INFO:tasks.workunit.client.0.smithi063.stdout:0/453: getdents d0/d1a/d23/d34/d42/d99 0 2023-12-12T11:51:58.866 INFO:tasks.workunit.client.0.smithi063.stdout:8/523: unlink d4/de/d3b/d62/f86 0 2023-12-12T11:51:58.867 INFO:tasks.workunit.client.1.smithi093.stdout:3/692: dread df/d22/d49/d69/d78/daf/d3d/d42/d8e/da5/fbb [0,4194304] 0 2023-12-12T11:51:58.867 INFO:tasks.workunit.client.1.smithi093.stdout:7/660: dwrite da/d15/d2d/f51 [0,4194304] 0 2023-12-12T11:51:58.870 INFO:tasks.workunit.client.0.smithi063.stdout:5/499: creat d7/d28/d43/f9a x:0 0 0 2023-12-12T11:51:58.878 INFO:tasks.workunit.client.0.smithi063.stdout:2/397: symlink d0/d1a/d1e/l81 0 2023-12-12T11:51:58.878 INFO:tasks.workunit.client.0.smithi063.stdout:2/398: getdents d0/d1a/d48/d56/d77 0 2023-12-12T11:51:58.878 INFO:tasks.workunit.client.1.smithi093.stdout:6/845: link d0/da/d32/d9e/d4d/de9/ff9 d0/d52/d7e/d42/dd5/ddc/d12a/f130 0 2023-12-12T11:51:58.880 INFO:tasks.workunit.client.0.smithi063.stdout:1/545: rename d3/db/d16/d24/f29 to d3/db/d16/d24/d4d/d35/d98/fb5 0 2023-12-12T11:51:58.883 INFO:tasks.workunit.client.0.smithi063.stdout:5/500: dread d7/d10/d2b/d3c/d42/d62/d69/f73 [0,4194304] 0 2023-12-12T11:51:58.886 INFO:tasks.workunit.client.0.smithi063.stdout:0/454: link d0/d7/d27/d44/f85 d0/d1a/d23/f9a 0 2023-12-12T11:51:58.887 INFO:tasks.workunit.client.1.smithi093.stdout:5/587: symlink d0/d7/d8/d9e/dad/lc9 0 2023-12-12T11:51:58.889 INFO:tasks.workunit.client.0.smithi063.stdout:8/524: creat d4/d55/fa0 x:0 0 0 2023-12-12T11:51:58.889 INFO:tasks.workunit.client.1.smithi093.stdout:7/661: dread da/d2e/d89/fbf [0,4194304] 0 2023-12-12T11:51:58.889 INFO:tasks.workunit.client.1.smithi093.stdout:7/662: fsync da/fb 0 2023-12-12T11:51:58.892 INFO:tasks.workunit.client.1.smithi093.stdout:1/692: write d4/fa [1294607,101465] 0 2023-12-12T11:51:58.893 INFO:tasks.workunit.client.0.smithi063.stdout:1/546: rename d3/db/d16/d17/l2e to d3/db/d16/d24/d30/lb6 0 2023-12-12T11:51:58.894 INFO:tasks.workunit.client.1.smithi093.stdout:3/693: creat df/d25/dd2/fe0 x:0 0 0 2023-12-12T11:51:58.895 INFO:tasks.workunit.client.1.smithi093.stdout:0/726: dwrite d5/dd/d62/f69 [0,4194304] 0 2023-12-12T11:51:58.895 INFO:tasks.workunit.client.0.smithi063.stdout:5/501: symlink d7/d28/d67/l9b 0 2023-12-12T11:51:58.896 INFO:tasks.workunit.client.0.smithi063.stdout:2/399: dread d0/d1a/d26/f37 [0,4194304] 0 2023-12-12T11:51:58.896 INFO:tasks.workunit.client.1.smithi093.stdout:4/921: dwrite d0/d31/d9d/da0/fe5 [0,4194304] 0 2023-12-12T11:51:58.896 INFO:tasks.workunit.client.1.smithi093.stdout:8/743: dwrite d3/f91 [0,4194304] 0 2023-12-12T11:51:58.896 INFO:tasks.workunit.client.1.smithi093.stdout:4/922: fsync d0/d36/d11c/d97/f101 0 2023-12-12T11:51:58.896 INFO:tasks.workunit.client.1.smithi093.stdout:8/744: write d3/d1a/d1f/d75/f9f [1216094,10112] 0 2023-12-12T11:51:58.897 INFO:tasks.workunit.client.1.smithi093.stdout:8/745: readlink d3/d1a/d1f/d29/l2e 0 2023-12-12T11:51:58.897 INFO:tasks.workunit.client.1.smithi093.stdout:8/746: chown d3/d8/d88 417 1 2023-12-12T11:51:58.905 INFO:tasks.workunit.client.0.smithi063.stdout:5/502: truncate d7/f12 791910 0 2023-12-12T11:51:58.905 INFO:tasks.workunit.client.0.smithi063.stdout:5/503: dread - d7/d10/d2b/d3c/d42/f96 zero size 2023-12-12T11:51:58.905 INFO:tasks.workunit.client.0.smithi063.stdout:5/504: chown d7/d10/d2b/d3c 11644 1 2023-12-12T11:51:58.908 INFO:tasks.workunit.client.0.smithi063.stdout:1/547: dread d3/db/d16/d17/f55 [0,4194304] 0 2023-12-12T11:51:58.908 INFO:tasks.workunit.client.0.smithi063.stdout:1/548: chown d3/db/d16/d24/d4d/f7c 43 1 2023-12-12T11:51:58.908 INFO:tasks.workunit.client.0.smithi063.stdout:8/525: dread d4/de/d3b/d62/d6e/f8f [0,4194304] 0 2023-12-12T11:51:58.909 INFO:tasks.workunit.client.0.smithi063.stdout:5/505: creat d7/de/f9c x:0 0 0 2023-12-12T11:51:58.912 INFO:tasks.workunit.client.0.smithi063.stdout:5/506: write d7/d10/d2b/d3c/d42/d76/f78 [4485237,14298] 0 2023-12-12T11:51:58.919 INFO:tasks.workunit.client.0.smithi063.stdout:1/549: creat d3/d3a/d52/fb7 x:0 0 0 2023-12-12T11:51:58.919 INFO:tasks.workunit.client.0.smithi063.stdout:4/535: sync 2023-12-12T11:51:58.919 INFO:tasks.workunit.client.0.smithi063.stdout:9/384: sync 2023-12-12T11:51:58.920 INFO:tasks.workunit.client.0.smithi063.stdout:2/400: dread d0/d1a/d1e/f2e [4194304,4194304] 0 2023-12-12T11:51:58.920 INFO:tasks.workunit.client.1.smithi093.stdout:6/846: creat d0/d52/d7e/d42/dd5/f131 x:0 0 0 2023-12-12T11:51:58.920 INFO:tasks.workunit.client.1.smithi093.stdout:5/588: mkdir d0/d7/d36/db9/dca 0 2023-12-12T11:51:58.925 INFO:tasks.workunit.client.0.smithi063.stdout:0/455: fsync d0/d7/d27/d1f/f30 0 2023-12-12T11:51:58.927 INFO:tasks.workunit.client.0.smithi063.stdout:4/536: mknod d2/d17/d7f/da2/cab 0 2023-12-12T11:51:58.928 INFO:tasks.workunit.client.1.smithi093.stdout:1/693: unlink d4/d1a/d83/d92/fbc 0 2023-12-12T11:51:58.936 INFO:tasks.workunit.client.0.smithi063.stdout:5/507: write d7/f29 [3825832,24460] 0 2023-12-12T11:51:58.936 INFO:tasks.workunit.client.0.smithi063.stdout:2/401: rename d0/d1a/d1e/l81 to d0/d1a/d26/l82 0 2023-12-12T11:51:58.937 INFO:tasks.workunit.client.1.smithi093.stdout:3/694: mkdir df/d22/d49/d69/d78/daf/d3d/d42/d8e/de1 0 2023-12-12T11:51:58.937 INFO:tasks.workunit.client.1.smithi093.stdout:3/695: readlink df/d25/l34 0 2023-12-12T11:51:58.937 INFO:tasks.workunit.client.1.smithi093.stdout:3/696: chown df/d22/d49/d69/d78/daf/d3d/d42/d8e/da5/lde 315352065 1 2023-12-12T11:51:58.938 INFO:tasks.workunit.client.1.smithi093.stdout:3/697: chown df/d25/f44 934614 1 2023-12-12T11:51:58.938 INFO:tasks.workunit.client.0.smithi063.stdout:9/385: getdents d7 0 2023-12-12T11:51:58.941 INFO:tasks.workunit.client.1.smithi093.stdout:0/727: symlink d5/d21/d27/d3a/lde 0 2023-12-12T11:51:58.941 INFO:tasks.workunit.client.1.smithi093.stdout:0/728: write d5/d78/da4/fcc [692587,69211] 0 2023-12-12T11:51:58.941 INFO:tasks.workunit.client.1.smithi093.stdout:0/729: getdents d5/dd/d14 0 2023-12-12T11:51:58.945 INFO:tasks.workunit.client.0.smithi063.stdout:0/456: unlink d0/d1a/d23/d2e/d84/l8d 0 2023-12-12T11:51:58.945 INFO:tasks.workunit.client.0.smithi063.stdout:0/457: creat d0/d7/f9b x:0 0 0 2023-12-12T11:51:58.945 INFO:tasks.workunit.client.0.smithi063.stdout:0/458: chown d0/d1a/c83 6 1 2023-12-12T11:51:58.954 INFO:tasks.workunit.client.0.smithi063.stdout:5/508: creat d7/d10/d2b/d3c/d42/d62/d69/f9d x:0 0 0 2023-12-12T11:51:58.954 INFO:tasks.workunit.client.0.smithi063.stdout:5/509: chown d7/d10/d2b/d3c/c8d 14563782 1 2023-12-12T11:51:58.955 INFO:tasks.workunit.client.1.smithi093.stdout:7/663: dwrite da/d15/d19/d90/d7d/f88 [4194304,4194304] 0 2023-12-12T11:51:58.956 INFO:tasks.workunit.client.1.smithi093.stdout:1/694: dread d4/dc/f41 [0,4194304] 0 2023-12-12T11:51:58.957 INFO:tasks.workunit.client.1.smithi093.stdout:8/747: symlink d3/d1a/d1f/d29/d63/lf7 0 2023-12-12T11:51:58.957 INFO:tasks.workunit.client.1.smithi093.stdout:8/748: creat d3/d1a/d1f/d59/d69/ff8 x:0 0 0 2023-12-12T11:51:58.957 INFO:tasks.workunit.client.0.smithi063.stdout:1/550: dread d3/db/f20 [0,4194304] 0 2023-12-12T11:51:58.961 INFO:tasks.workunit.client.1.smithi093.stdout:3/698: truncate df/d22/d49/d69/d78/daf/d3d/d59/f98 627478 0 2023-12-12T11:51:58.963 INFO:tasks.workunit.client.0.smithi063.stdout:0/459: mknod d0/d7/d27/d19/d2d/d67/c9c 0 2023-12-12T11:51:58.964 INFO:tasks.workunit.client.1.smithi093.stdout:0/730: mkdir d5/dd/d14/d26/d58/d64/d6f/d90/ddf 0 2023-12-12T11:51:58.967 INFO:tasks.workunit.client.0.smithi063.stdout:5/510: creat d7/d10/d2b/d3c/d42/d76/f9e x:0 0 0 2023-12-12T11:51:58.968 INFO:tasks.workunit.client.1.smithi093.stdout:7/664: symlink da/d15/d2d/d2f/dc6/le7 0 2023-12-12T11:51:58.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:58 smithi093 ceph-mon[115914]: Updating smithi093:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-12T11:51:58.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:58 smithi093 ceph-mon[115914]: Updating smithi063:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-12T11:51:58.971 INFO:tasks.workunit.client.1.smithi093.stdout:1/695: mknod d4/d1a/d83/ce5 0 2023-12-12T11:51:58.971 INFO:tasks.workunit.client.1.smithi093.stdout:1/696: truncate d4/d1a/f5f 4347715 0 2023-12-12T11:51:58.971 INFO:tasks.workunit.client.1.smithi093.stdout:1/697: write d4/d1a/d1b/d26/d65/f7b [1074644,29836] 0 2023-12-12T11:51:58.972 INFO:tasks.workunit.client.1.smithi093.stdout:6/847: dwrite d0/da/d32/d39/d5b/fcd [0,4194304] 0 2023-12-12T11:51:58.972 INFO:tasks.workunit.client.1.smithi093.stdout:6/848: chown d0/da/d14/d21/dd0 819 1 2023-12-12T11:51:58.972 INFO:tasks.workunit.client.1.smithi093.stdout:6/849: fdatasync d0/d52/d6b/ddb/dfe/fc6 0 2023-12-12T11:51:58.972 INFO:tasks.workunit.client.1.smithi093.stdout:6/850: read - d0/da/d32/dd3/fcc zero size 2023-12-12T11:51:58.974 INFO:tasks.workunit.client.1.smithi093.stdout:8/749: getdents d3/d1a/d1f/d29/d3a/d68/d8a 0 2023-12-12T11:51:58.977 INFO:tasks.workunit.client.1.smithi093.stdout:5/589: rmdir d0/d7/d59/d48 39 2023-12-12T11:51:58.978 INFO:tasks.workunit.client.1.smithi093.stdout:5/590: chown d0/d7/d85/ca2 958981245 1 2023-12-12T11:51:58.978 INFO:tasks.workunit.client.0.smithi063.stdout:1/551: write d3/db/d16/d24/f2a [2787056,55707] 0 2023-12-12T11:51:58.978 INFO:tasks.workunit.client.0.smithi063.stdout:1/552: chown d3/db/d16/d24/d4d/f2c 382 1 2023-12-12T11:51:58.978 INFO:tasks.workunit.client.0.smithi063.stdout:1/553: truncate d3/db/d16/d24/d48/d75/d83/d5b/d6b/f99 1610737 0 2023-12-12T11:51:58.979 INFO:tasks.workunit.client.0.smithi063.stdout:1/554: write d3/db/d16/d24/d48/d75/d83/d5b/d6b/d6d/d7e/f9d [373966,20227] 0 2023-12-12T11:51:58.979 INFO:tasks.workunit.client.0.smithi063.stdout:1/555: stat d3/d3a/d52/fb7 0 2023-12-12T11:51:58.979 INFO:tasks.workunit.client.0.smithi063.stdout:1/556: chown d3/db/d16/d24/d48/d75/d83/d5b/d6b/f7f 7 1 2023-12-12T11:51:58.979 INFO:tasks.workunit.client.0.smithi063.stdout:1/557: chown d3/d3a/cad 0 1 2023-12-12T11:51:58.979 INFO:tasks.workunit.client.0.smithi063.stdout:9/386: rmdir d7/d11 39 2023-12-12T11:51:58.979 INFO:tasks.workunit.client.0.smithi063.stdout:9/387: write d7/d15/f17 [3698239,130186] 0 2023-12-12T11:51:58.980 INFO:tasks.workunit.client.0.smithi063.stdout:0/460: dread d0/d7/d27/d19/f51 [0,4194304] 0 2023-12-12T11:51:58.981 INFO:tasks.workunit.client.1.smithi093.stdout:3/699: symlink df/d22/d49/d69/d78/daf/d3d/d6f/db1/le2 0 2023-12-12T11:51:58.981 INFO:tasks.workunit.client.1.smithi093.stdout:3/700: stat df/d22/d49/d69/d78/daf/d3d/d42/cb7 0 2023-12-12T11:51:58.981 INFO:tasks.workunit.client.1.smithi093.stdout:0/731: rmdir d5/d21/d27/d3a/dc1 39 2023-12-12T11:51:58.981 INFO:tasks.workunit.client.1.smithi093.stdout:0/732: chown d5/db2 139995750 1 2023-12-12T11:51:58.981 INFO:tasks.workunit.client.1.smithi093.stdout:4/923: dwrite d0/f33 [0,4194304] 0 2023-12-12T11:51:58.981 INFO:tasks.workunit.client.1.smithi093.stdout:0/733: read d5/dd/d14/d26/d58/dab/f9c [42822,50258] 0 2023-12-12T11:51:58.982 INFO:tasks.workunit.client.0.smithi063.stdout:5/511: creat d7/d28/d94/f9f x:0 0 0 2023-12-12T11:51:58.986 INFO:tasks.workunit.client.0.smithi063.stdout:9/388: mknod d7/d11/d12/d30/d3e/c78 0 2023-12-12T11:51:58.988 INFO:tasks.workunit.client.0.smithi063.stdout:2/402: getdents d0/d1a/d26 0 2023-12-12T11:51:58.997 INFO:tasks.workunit.client.0.smithi063.stdout:9/389: creat d7/d11/d12/f79 x:0 0 0 2023-12-12T11:51:58.999 INFO:tasks.workunit.client.0.smithi063.stdout:0/461: dread d0/d7/f47 [4194304,4194304] 0 2023-12-12T11:51:59.000 INFO:tasks.workunit.client.1.smithi093.stdout:1/698: creat d4/d1a/d1b/d26/d31/ddb/fe6 x:0 0 0 2023-12-12T11:51:59.000 INFO:tasks.workunit.client.0.smithi063.stdout:5/512: rmdir d7/d28/d43 39 2023-12-12T11:51:59.003 INFO:tasks.workunit.client.1.smithi093.stdout:6/851: mkdir d0/da/d32/d132 0 2023-12-12T11:51:59.003 INFO:tasks.workunit.client.1.smithi093.stdout:6/852: readlink d0/d52/l7c 0 2023-12-12T11:51:59.005 INFO:tasks.workunit.client.0.smithi063.stdout:9/390: symlink d7/d11/d12/d30/l7a 0 2023-12-12T11:51:59.005 INFO:tasks.workunit.client.0.smithi063.stdout:9/391: truncate d7/d20/d3f/d40/d4e/f6b 445958 0 2023-12-12T11:51:59.006 INFO:tasks.workunit.client.0.smithi063.stdout:2/403: dread d0/ff [4194304,4194304] 0 2023-12-12T11:51:59.008 INFO:tasks.workunit.client.0.smithi063.stdout:0/462: link d0/d1a/d23/d2e/c4a d0/d1a/d23/c9d 0 2023-12-12T11:51:59.009 INFO:tasks.workunit.client.0.smithi063.stdout:0/463: write d0/d1a/d23/f9a [824668,26881] 0 2023-12-12T11:51:59.011 INFO:tasks.workunit.client.0.smithi063.stdout:5/513: getdents d7/d10/d2b/d3c/d42/d62 0 2023-12-12T11:51:59.011 INFO:tasks.workunit.client.0.smithi063.stdout:5/514: chown d7/d10/d2b/d3c/d42/d62/d69 10004 1 2023-12-12T11:51:59.017 INFO:tasks.workunit.client.0.smithi063.stdout:0/464: mknod d0/d7/d27/d19/d2d/c9e 0 2023-12-12T11:51:59.019 INFO:tasks.workunit.client.0.smithi063.stdout:0/465: dread - d0/d1a/d23/f7c zero size 2023-12-12T11:51:59.019 INFO:tasks.workunit.client.0.smithi063.stdout:0/466: dread - d0/d1a/d23/f74 zero size 2023-12-12T11:51:59.020 INFO:tasks.workunit.client.0.smithi063.stdout:5/515: symlink d7/d28/la0 0 2023-12-12T11:51:59.021 INFO:tasks.workunit.client.0.smithi063.stdout:9/392: dread d7/d20/d45/f57 [0,4194304] 0 2023-12-12T11:51:59.021 INFO:tasks.workunit.client.0.smithi063.stdout:9/393: fdatasync d7/d20/d3f/d40/f44 0 2023-12-12T11:51:59.022 INFO:tasks.workunit.client.0.smithi063.stdout:5/516: stat d7/d10/d2b/d3c/d5a/f72 0 2023-12-12T11:51:59.026 INFO:tasks.workunit.client.0.smithi063.stdout:9/394: mknod d7/d15/d39/c7b 0 2023-12-12T11:51:59.026 INFO:tasks.workunit.client.0.smithi063.stdout:9/395: write d7/d20/d3f/d40/d4e/f67 [59400,69040] 0 2023-12-12T11:51:59.027 INFO:tasks.workunit.client.1.smithi093.stdout:4/924: stat d0/d87/d79/d96/c118 0 2023-12-12T11:51:59.027 INFO:tasks.workunit.client.1.smithi093.stdout:4/925: readlink d0/d87/l77 0 2023-12-12T11:51:59.028 INFO:tasks.workunit.client.0.smithi063.stdout:5/517: creat d7/d10/d2b/d3c/d42/d62/fa1 x:0 0 0 2023-12-12T11:51:59.028 INFO:tasks.workunit.client.0.smithi063.stdout:5/518: write d7/de/f9c [596298,57137] 0 2023-12-12T11:51:59.029 INFO:tasks.workunit.client.1.smithi093.stdout:5/591: dwrite d0/d7/d36/d29/d76/fc1 [0,4194304] 0 2023-12-12T11:51:59.029 INFO:tasks.workunit.client.1.smithi093.stdout:7/665: truncate da/d15/d2d/f51 1244456 0 2023-12-12T11:51:59.031 INFO:tasks.workunit.client.0.smithi063.stdout:9/396: unlink d7/d11/d12/d30/l7a 0 2023-12-12T11:51:59.033 INFO:tasks.workunit.client.0.smithi063.stdout:5/519: creat d7/d10/d2b/fa2 x:0 0 0 2023-12-12T11:51:59.033 INFO:tasks.workunit.client.0.smithi063.stdout:5/520: chown d7/f29 53364 1 2023-12-12T11:51:59.034 INFO:tasks.workunit.client.1.smithi093.stdout:6/853: link d0/d52/d7e/d42/c122 d0/da/d14/d3a/c133 0 2023-12-12T11:51:59.034 INFO:tasks.workunit.client.1.smithi093.stdout:0/734: dread d5/d21/d2f/d54/f73 [0,4194304] 0 2023-12-12T11:51:59.034 INFO:tasks.workunit.client.1.smithi093.stdout:4/926: symlink d0/d31/d89/da1/dcd/l11e 0 2023-12-12T11:51:59.034 INFO:tasks.workunit.client.1.smithi093.stdout:4/927: fsync d0/d36/d11c/d97/f108 0 2023-12-12T11:51:59.034 INFO:tasks.workunit.client.1.smithi093.stdout:0/735: write d5/dd/f1a [1810339,5221] 0 2023-12-12T11:51:59.035 INFO:tasks.workunit.client.1.smithi093.stdout:1/699: write d4/dc/f33 [609241,2738] 0 2023-12-12T11:51:59.035 INFO:tasks.workunit.client.0.smithi063.stdout:5/521: mknod d7/d28/d43/d49/ca3 0 2023-12-12T11:51:59.035 INFO:tasks.workunit.client.0.smithi063.stdout:0/467: write d0/d1a/d23/d2e/f64 [460898,35937] 0 2023-12-12T11:51:59.036 INFO:tasks.workunit.client.0.smithi063.stdout:0/468: write d0/d1a/d23/f7c [414971,85603] 0 2023-12-12T11:51:59.037 INFO:tasks.workunit.client.1.smithi093.stdout:5/592: creat d0/d7/fcb x:0 0 0 2023-12-12T11:51:59.037 INFO:tasks.workunit.client.1.smithi093.stdout:5/593: dread - d0/d7/d59/d62/fa5 zero size 2023-12-12T11:51:59.041 INFO:tasks.workunit.client.1.smithi093.stdout:7/666: mknod da/d15/d19/d90/ce8 0 2023-12-12T11:51:59.042 INFO:tasks.workunit.client.0.smithi063.stdout:5/522: rename d7/f29 to d7/d10/d2b/d3c/fa4 0 2023-12-12T11:51:59.043 INFO:tasks.workunit.client.1.smithi093.stdout:1/700: mkdir d4/d1a/d83/d9a/de7 0 2023-12-12T11:51:59.046 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:58 smithi063 ceph-mon[107117]: Updating smithi093:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-12T11:51:59.046 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:58 smithi063 ceph-mon[107117]: Updating smithi063:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-12T11:51:59.046 INFO:tasks.workunit.client.0.smithi063.stdout:5/523: creat d7/d28/d94/fa5 x:0 0 0 2023-12-12T11:51:59.046 INFO:tasks.workunit.client.0.smithi063.stdout:0/469: mknod d0/d8e/c9f 0 2023-12-12T11:51:59.048 INFO:tasks.workunit.client.0.smithi063.stdout:9/397: write d7/ff [3684689,48796] 0 2023-12-12T11:51:59.048 INFO:tasks.workunit.client.1.smithi093.stdout:7/667: getdents da/d8e/daf 0 2023-12-12T11:51:59.048 INFO:tasks.workunit.client.1.smithi093.stdout:7/668: dread - da/d15/d19/fde zero size 2023-12-12T11:51:59.048 INFO:tasks.workunit.client.1.smithi093.stdout:7/669: truncate da/de/d46/d4f/f56 311732 0 2023-12-12T11:51:59.049 INFO:tasks.workunit.client.1.smithi093.stdout:7/670: chown da/d8e/f9e 89112 1 2023-12-12T11:51:59.049 INFO:tasks.workunit.client.1.smithi093.stdout:6/854: dread d0/d52/d7e/d42/f53 [0,4194304] 0 2023-12-12T11:51:59.049 INFO:tasks.workunit.client.1.smithi093.stdout:1/701: dread d4/d1a/d83/d9a/fd7 [0,4194304] 0 2023-12-12T11:51:59.052 INFO:tasks.workunit.client.1.smithi093.stdout:3/701: dwrite df/f2e [4194304,4194304] 0 2023-12-12T11:51:59.052 INFO:tasks.workunit.client.0.smithi063.stdout:0/470: link d0/d7/d27/d19/d2d/c9e d0/d7/ca0 0 2023-12-12T11:51:59.053 INFO:tasks.workunit.client.1.smithi093.stdout:4/928: dread d0/d36/d40/f4e [0,4194304] 0 2023-12-12T11:51:59.054 INFO:tasks.workunit.client.1.smithi093.stdout:7/671: truncate da/de/f30 3903824 0 2023-12-12T11:51:59.054 INFO:tasks.workunit.client.1.smithi093.stdout:7/672: truncate da/de/d78/fb8 1286346 0 2023-12-12T11:51:59.055 INFO:tasks.workunit.client.1.smithi093.stdout:0/736: dread d5/d21/f6b [0,4194304] 0 2023-12-12T11:51:59.055 INFO:tasks.workunit.client.1.smithi093.stdout:6/855: creat d0/d52/d7e/d42/dd5/ddc/d12a/f134 x:0 0 0 2023-12-12T11:51:59.056 INFO:tasks.workunit.client.0.smithi063.stdout:9/398: mknod d7/d11/c7c 0 2023-12-12T11:51:59.057 INFO:tasks.workunit.client.0.smithi063.stdout:9/399: fdatasync d7/d11/d12/d30/d3e/f5b 0 2023-12-12T11:51:59.058 INFO:tasks.workunit.client.1.smithi093.stdout:5/594: rename d0/d7/d8/d9e/dad to d0/d7/d36/db9/d66/d7c/db5/dcc 0 2023-12-12T11:51:59.061 INFO:tasks.workunit.client.0.smithi063.stdout:9/400: symlink d7/d11/l7d 0 2023-12-12T11:51:59.061 INFO:tasks.workunit.client.1.smithi093.stdout:9/685: sync 2023-12-12T11:51:59.063 INFO:tasks.workunit.client.1.smithi093.stdout:7/673: creat da/d15/d19/d90/d7d/fe9 x:0 0 0 2023-12-12T11:51:59.065 INFO:tasks.workunit.client.1.smithi093.stdout:2/743: sync 2023-12-12T11:51:59.067 INFO:tasks.workunit.client.1.smithi093.stdout:3/702: rename df/d22/d49/d69/d78/daf/d3d/d59/d72/f87 to df/d22/d49/d69/d6e/fe3 0 2023-12-12T11:51:59.068 INFO:tasks.workunit.client.1.smithi093.stdout:1/702: read d4/f3e [3641453,63077] 0 2023-12-12T11:51:59.069 INFO:tasks.workunit.client.1.smithi093.stdout:1/703: chown d4/d1a/d1b/d26/d31/fba 44157267 1 2023-12-12T11:51:59.071 INFO:tasks.workunit.client.0.smithi063.stdout:2/404: write d0/d1a/d48/f30 [402284,114677] 0 2023-12-12T11:51:59.072 INFO:tasks.workunit.client.0.smithi063.stdout:5/524: dread d7/d10/d2b/f55 [0,4194304] 0 2023-12-12T11:51:59.072 INFO:tasks.workunit.client.0.smithi063.stdout:1/558: dwrite d3/db/d16/d4f/d9a/fab [0,4194304] 0 2023-12-12T11:51:59.072 INFO:tasks.workunit.client.0.smithi063.stdout:1/559: stat d3/db/d16/d24/d48/f8a 0 2023-12-12T11:51:59.075 INFO:tasks.workunit.client.1.smithi093.stdout:9/686: symlink d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/d42/dd3/leb 0 2023-12-12T11:51:59.075 INFO:tasks.workunit.client.1.smithi093.stdout:6/856: read d0/d52/d7e/d42/f53 [7190780,19894] 0 2023-12-12T11:51:59.079 INFO:tasks.workunit.client.1.smithi093.stdout:4/929: rename d0/d36/f59 to d0/d36/d11c/f11f 0 2023-12-12T11:51:59.082 INFO:tasks.workunit.client.1.smithi093.stdout:3/703: symlink df/d22/d49/d69/d78/daf/d3d/d42/le4 0 2023-12-12T11:51:59.082 INFO:tasks.workunit.client.1.smithi093.stdout:3/704: getdents df/d22/d49/d69/d78/daf/d3d/d59/d72/dcc 0 2023-12-12T11:51:59.086 INFO:tasks.workunit.client.1.smithi093.stdout:1/704: creat d4/d1a/d1b/d26/d65/fe8 x:0 0 0 2023-12-12T11:51:59.092 INFO:tasks.workunit.client.1.smithi093.stdout:6/857: unlink d0/d52/d7e/d42/f60 0 2023-12-12T11:51:59.092 INFO:tasks.workunit.client.1.smithi093.stdout:6/858: write d0/f44 [1356002,32187] 0 2023-12-12T11:51:59.092 INFO:tasks.workunit.client.1.smithi093.stdout:6/859: fdatasync d0/d52/d6b/ddb/f11b 0 2023-12-12T11:51:59.092 INFO:tasks.workunit.client.1.smithi093.stdout:6/860: write d0/da/d14/d21/fd1 [4764335,11633] 0 2023-12-12T11:51:59.092 INFO:tasks.workunit.client.1.smithi093.stdout:6/861: chown d0/da/d14/d38/d43/d10e 2073848 1 2023-12-12T11:51:59.092 INFO:tasks.workunit.client.1.smithi093.stdout:6/862: chown d0/d52/d7e/fbb 57 1 2023-12-12T11:51:59.095 INFO:tasks.workunit.client.0.smithi063.stdout:0/471: write d0/d1a/d23/f7b [1892663,28786] 0 2023-12-12T11:51:59.096 INFO:tasks.workunit.client.0.smithi063.stdout:0/472: chown d0/d1a/d23/d34/d42/d99 3371581 1 2023-12-12T11:51:59.096 INFO:tasks.workunit.client.0.smithi063.stdout:1/560: mkdir d3/db/d16/db8 0 2023-12-12T11:51:59.114 INFO:tasks.workunit.client.1.smithi093.stdout:0/737: rename d5/dd/f1d to d5/dd/d14/d26/d58/d64/d6f/d90/fe0 0 2023-12-12T11:51:59.118 INFO:tasks.workunit.client.1.smithi093.stdout:4/930: symlink d0/d31/d5c/l120 0 2023-12-12T11:51:59.120 INFO:tasks.workunit.client.0.smithi063.stdout:1/561: truncate d3/db/fd 1005975 0 2023-12-12T11:51:59.121 INFO:tasks.workunit.client.0.smithi063.stdout:1/562: creat d3/db/d12/fb9 x:0 0 0 2023-12-12T11:51:59.123 INFO:tasks.workunit.client.1.smithi093.stdout:3/705: unlink df/l18 0 2023-12-12T11:51:59.125 INFO:tasks.workunit.client.1.smithi093.stdout:1/705: creat d4/dc/d7a/d9c/fe9 x:0 0 0 2023-12-12T11:51:59.125 INFO:tasks.workunit.client.1.smithi093.stdout:1/706: write d4/dc/d7a/d9c/da7/fc3 [5155253,40249] 0 2023-12-12T11:51:59.126 INFO:tasks.workunit.client.1.smithi093.stdout:2/744: dwrite d5/d14/d2d/d4c/fd8 [0,4194304] 0 2023-12-12T11:51:59.127 INFO:tasks.workunit.client.1.smithi093.stdout:2/745: write d5/d14/d2d/d12/d25/f30 [1144212,16560] 0 2023-12-12T11:51:59.127 INFO:tasks.workunit.client.1.smithi093.stdout:2/746: chown d5/d31/f45 953 1 2023-12-12T11:51:59.127 INFO:tasks.workunit.client.1.smithi093.stdout:9/687: dwrite d1/f94 [4194304,4194304] 0 2023-12-12T11:51:59.129 INFO:tasks.workunit.client.1.smithi093.stdout:6/863: creat d0/df1/f135 x:0 0 0 2023-12-12T11:51:59.129 INFO:tasks.workunit.client.1.smithi093.stdout:6/864: fsync d0/d52/dbc/fc2 0 2023-12-12T11:51:59.129 INFO:tasks.workunit.client.1.smithi093.stdout:6/865: chown d0/d52/d6b/ddb/dfe/fef 0 1 2023-12-12T11:51:59.130 INFO:tasks.workunit.client.0.smithi063.stdout:0/473: mkdir d0/d7/d27/da1 0 2023-12-12T11:51:59.130 INFO:tasks.workunit.client.0.smithi063.stdout:0/474: stat d0/d1a/d23/d2e/d84 0 2023-12-12T11:51:59.134 INFO:tasks.workunit.client.0.smithi063.stdout:9/401: dwrite d7/d20/d45/f66 [0,4194304] 0 2023-12-12T11:51:59.134 INFO:tasks.workunit.client.0.smithi063.stdout:2/405: write d0/d1a/d1e/f4b [2714388,80447] 0 2023-12-12T11:51:59.136 INFO:tasks.workunit.client.1.smithi093.stdout:5/595: rename d0/d7/d8/d9e/f1f to d0/d7/d36/d87/fcd 0 2023-12-12T11:51:59.137 INFO:tasks.workunit.client.1.smithi093.stdout:5/596: chown d0/d7/d36/db9/d66 3074 1 2023-12-12T11:51:59.137 INFO:tasks.workunit.client.1.smithi093.stdout:0/738: unlink d5/dd/d14/d26/d58/f8a 0 2023-12-12T11:51:59.139 INFO:tasks.workunit.client.1.smithi093.stdout:3/706: truncate df/d25/fb4 324219 0 2023-12-12T11:51:59.142 INFO:tasks.workunit.client.1.smithi093.stdout:4/931: write d0/f20 [509445,665] 0 2023-12-12T11:51:59.142 INFO:tasks.workunit.client.1.smithi093.stdout:4/932: chown d0/fd1 15 1 2023-12-12T11:51:59.145 INFO:tasks.workunit.client.1.smithi093.stdout:1/707: truncate d4/dc/f9f 971882 0 2023-12-12T11:51:59.146 INFO:tasks.workunit.client.1.smithi093.stdout:2/747: unlink d5/d31/led 0 2023-12-12T11:51:59.146 INFO:tasks.workunit.client.1.smithi093.stdout:2/748: chown d5/d14/d47/d4e/c58 124284 1 2023-12-12T11:51:59.151 INFO:tasks.workunit.client.0.smithi063.stdout:9/402: write d7/d20/d65/f72 [4150726,107673] 0 2023-12-12T11:51:59.152 INFO:tasks.workunit.client.1.smithi093.stdout:8/750: sync 2023-12-12T11:51:59.159 INFO:tasks.workunit.client.1.smithi093.stdout:9/688: creat d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d5c/fec x:0 0 0 2023-12-12T11:51:59.159 INFO:tasks.workunit.client.1.smithi093.stdout:9/689: stat d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/f3b 0 2023-12-12T11:51:59.160 INFO:tasks.workunit.client.0.smithi063.stdout:2/406: rename d0/d1a/c62 to d0/d1a/d1e/d64/c83 0 2023-12-12T11:51:59.160 INFO:tasks.workunit.client.1.smithi093.stdout:4/933: write d0/d36/d40/f99 [1136777,38949] 0 2023-12-12T11:51:59.162 INFO:tasks.workunit.client.1.smithi093.stdout:5/597: unlink d0/d7/d8/de/l5c 0 2023-12-12T11:51:59.164 INFO:tasks.workunit.client.1.smithi093.stdout:0/739: link d5/dd/d33/f3c d5/d21/d27/d3a/d9a/db5/fe1 0 2023-12-12T11:51:59.165 INFO:tasks.workunit.client.0.smithi063.stdout:1/563: dwrite d3/db/d16/d24/d48/d75/f86 [0,4194304] 0 2023-12-12T11:51:59.165 INFO:tasks.workunit.client.1.smithi093.stdout:9/690: dread d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d5c/f7b [0,4194304] 0 2023-12-12T11:51:59.166 INFO:tasks.workunit.client.0.smithi063.stdout:1/564: creat d3/db/d16/d4f/d9a/fba x:0 0 0 2023-12-12T11:51:59.166 INFO:tasks.workunit.client.0.smithi063.stdout:1/565: chown d3/db/d16/f5c 614992810 1 2023-12-12T11:51:59.166 INFO:tasks.workunit.client.0.smithi063.stdout:1/566: write d3/d3a/d54/f62 [415765,68615] 0 2023-12-12T11:51:59.167 INFO:tasks.workunit.client.1.smithi093.stdout:3/707: link df/d22/d49/d69/d6e/f94 df/d22/d49/d69/d78/daf/d3d/d42/d8e/de1/fe5 0 2023-12-12T11:51:59.169 INFO:tasks.workunit.client.0.smithi063.stdout:9/403: dread d7/fa [0,4194304] 0 2023-12-12T11:51:59.169 INFO:tasks.workunit.client.0.smithi063.stdout:9/404: chown d7/f54 14 1 2023-12-12T11:51:59.173 INFO:tasks.workunit.client.1.smithi093.stdout:1/708: creat d4/d1a/d73/dd4/dd5/fea x:0 0 0 2023-12-12T11:51:59.173 INFO:tasks.workunit.client.1.smithi093.stdout:1/709: write d4/d1a/dc2/fd1 [171364,92663] 0 2023-12-12T11:51:59.175 INFO:tasks.workunit.client.0.smithi063.stdout:0/475: rmdir d0/d7 39 2023-12-12T11:51:59.179 INFO:tasks.workunit.client.1.smithi093.stdout:2/749: rename d5/l3d to d5/d14/d2d/d12/db4/lfd 0 2023-12-12T11:51:59.180 INFO:tasks.workunit.client.1.smithi093.stdout:8/751: mkdir d3/d1a/d1f/d29/d3a/db1/df9 0 2023-12-12T11:51:59.180 INFO:tasks.workunit.client.1.smithi093.stdout:8/752: readlink d3/d1a/d1f/d75/leb 0 2023-12-12T11:51:59.186 INFO:tasks.workunit.client.1.smithi093.stdout:5/598: truncate d0/d7/d59/d48/f81 3765315 0 2023-12-12T11:51:59.186 INFO:tasks.workunit.client.1.smithi093.stdout:5/599: chown d0/d7/d85/da0/cc8 56963824 1 2023-12-12T11:51:59.188 INFO:tasks.workunit.client.0.smithi063.stdout:1/567: rename d3/db/d16/d17/d4b/l93 to d3/db/d16/d4f/d9a/lbb 0 2023-12-12T11:51:59.188 INFO:tasks.workunit.client.0.smithi063.stdout:9/405: symlink d7/d11/d12/d30/l7e 0 2023-12-12T11:51:59.188 INFO:tasks.workunit.client.0.smithi063.stdout:6/529: sync 2023-12-12T11:51:59.189 INFO:tasks.workunit.client.1.smithi093.stdout:1/710: creat d4/dc/feb x:0 0 0 2023-12-12T11:51:59.190 INFO:tasks.workunit.client.1.smithi093.stdout:9/691: dread d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/f3a [0,4194304] 0 2023-12-12T11:51:59.191 INFO:tasks.workunit.client.0.smithi063.stdout:3/445: sync 2023-12-12T11:51:59.191 INFO:tasks.workunit.client.0.smithi063.stdout:3/446: fdatasync d4/f15 0 2023-12-12T11:51:59.191 INFO:tasks.workunit.client.0.smithi063.stdout:7/432: sync 2023-12-12T11:51:59.191 INFO:tasks.workunit.client.1.smithi093.stdout:7/674: sync 2023-12-12T11:51:59.192 INFO:tasks.workunit.client.1.smithi093.stdout:2/750: creat d5/d14/d2d/d4c/d54/ffe x:0 0 0 2023-12-12T11:51:59.193 INFO:tasks.workunit.client.0.smithi063.stdout:0/476: mknod d0/d1a/d23/d2e/ca2 0 2023-12-12T11:51:59.193 INFO:tasks.workunit.client.0.smithi063.stdout:0/477: chown d0/d7/f98 23531795 1 2023-12-12T11:51:59.193 INFO:tasks.workunit.client.0.smithi063.stdout:9/406: mknod d7/d11/d4b/d75/c7f 0 2023-12-12T11:51:59.197 INFO:tasks.workunit.client.1.smithi093.stdout:8/753: rename d3/d8/d88/dc5/ce7 to d3/d1a/d1f/d75/de3/cfa 0 2023-12-12T11:51:59.198 INFO:tasks.workunit.client.0.smithi063.stdout:1/568: dread d3/db/d16/f21 [0,4194304] 0 2023-12-12T11:51:59.198 INFO:tasks.workunit.client.0.smithi063.stdout:1/569: write d3/db/d16/d24/d48/d75/d83/f9e [775009,62200] 0 2023-12-12T11:51:59.206 INFO:tasks.workunit.client.0.smithi063.stdout:3/447: creat d4/df/d1a/d1c/d3b/d50/f8f x:0 0 0 2023-12-12T11:51:59.206 INFO:tasks.workunit.client.0.smithi063.stdout:3/448: truncate d4/f44 127644 0 2023-12-12T11:51:59.206 INFO:tasks.workunit.client.0.smithi063.stdout:3/449: write d4/df/f80 [783383,104616] 0 2023-12-12T11:51:59.207 INFO:tasks.workunit.client.1.smithi093.stdout:4/934: dwrite d0/d36/d40/fb3 [0,4194304] 0 2023-12-12T11:51:59.208 INFO:tasks.workunit.client.0.smithi063.stdout:7/433: symlink de/d33/d71/l9e 0 2023-12-12T11:51:59.210 INFO:tasks.workunit.client.1.smithi093.stdout:1/711: mknod d4/d81/cec 0 2023-12-12T11:51:59.211 INFO:tasks.workunit.client.1.smithi093.stdout:1/712: truncate d4/d1a/d83/d9a/faf 510182 0 2023-12-12T11:51:59.211 INFO:tasks.workunit.client.0.smithi063.stdout:9/407: truncate d7/d15/f23 1815272 0 2023-12-12T11:51:59.214 INFO:tasks.workunit.client.1.smithi093.stdout:9/692: rmdir d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/db1 39 2023-12-12T11:51:59.214 INFO:tasks.workunit.client.1.smithi093.stdout:9/693: creat d1/d23/d24/d29/d43/d56/d85/dc3/dce/d3e/fed x:0 0 0 2023-12-12T11:51:59.215 INFO:tasks.workunit.client.1.smithi093.stdout:9/694: write d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/f49 [1032999,40984] 0 2023-12-12T11:51:59.217 INFO:tasks.workunit.client.0.smithi063.stdout:6/530: write d9/d10/f8c [3816996,4672] 0 2023-12-12T11:51:59.219 INFO:tasks.workunit.client.0.smithi063.stdout:3/450: rename d4/d23/d5d/d62 to d4/d23/d6b/d90 0 2023-12-12T11:51:59.225 INFO:tasks.workunit.client.0.smithi063.stdout:7/434: link de/c17 de/d22/d2b/d61/c9f 0 2023-12-12T11:51:59.229 INFO:tasks.workunit.client.1.smithi093.stdout:4/935: write d0/d36/f50 [1520508,38269] 0 2023-12-12T11:51:59.232 INFO:tasks.workunit.client.1.smithi093.stdout:8/754: unlink d3/d1a/l5f 0 2023-12-12T11:51:59.232 INFO:tasks.workunit.client.1.smithi093.stdout:8/755: write d3/d1a/d1f/d29/d30/d58/ff3 [48306,30536] 0 2023-12-12T11:51:59.235 INFO:tasks.workunit.client.0.smithi063.stdout:2/407: dwrite d0/f20 [4194304,4194304] 0 2023-12-12T11:51:59.237 INFO:tasks.workunit.client.0.smithi063.stdout:9/408: dread d7/d15/f1d [0,4194304] 0 2023-12-12T11:51:59.238 INFO:tasks.workunit.client.0.smithi063.stdout:9/409: write d7/d15/f17 [4628186,81725] 0 2023-12-12T11:51:59.239 INFO:tasks.workunit.client.0.smithi063.stdout:6/531: truncate d9/d2c/d6b/f72 2274575 0 2023-12-12T11:51:59.239 INFO:tasks.workunit.client.0.smithi063.stdout:6/532: fdatasync d9/d10/d2a/f67 0 2023-12-12T11:51:59.242 INFO:tasks.workunit.client.0.smithi063.stdout:3/451: rmdir d4/df/d1a/d1c/d57 39 2023-12-12T11:51:59.245 INFO:tasks.workunit.client.1.smithi093.stdout:3/708: dwrite df/d22/d49/d69/d78/fdd [0,4194304] 0 2023-12-12T11:51:59.245 INFO:tasks.workunit.client.1.smithi093.stdout:3/709: readlink df/d30/d33/d66/lb6 0 2023-12-12T11:51:59.245 INFO:tasks.workunit.client.1.smithi093.stdout:1/713: stat d4/l9 0 2023-12-12T11:51:59.245 INFO:tasks.workunit.client.1.smithi093.stdout:1/714: fdatasync d4/dc/f18 0 2023-12-12T11:51:59.246 INFO:tasks.workunit.client.1.smithi093.stdout:1/715: write d4/d1a/d1b/d26/d31/ddb/fe6 [436041,19349] 0 2023-12-12T11:51:59.251 INFO:tasks.workunit.client.1.smithi093.stdout:2/751: dwrite d5/d14/d2d/d4c/d54/dc5/d61/ff1 [0,4194304] 0 2023-12-12T11:51:59.261 INFO:tasks.workunit.client.1.smithi093.stdout:7/675: dwrite da/d15/d2d/f9f [0,4194304] 0 2023-12-12T11:51:59.262 INFO:tasks.workunit.client.1.smithi093.stdout:9/695: rmdir d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d57/d63 39 2023-12-12T11:51:59.270 INFO:tasks.workunit.client.1.smithi093.stdout:3/710: write df/f1c [3086281,120595] 0 2023-12-12T11:51:59.282 INFO:tasks.workunit.client.1.smithi093.stdout:4/936: mkdir d0/d36/d121 0 2023-12-12T11:51:59.282 INFO:tasks.workunit.client.1.smithi093.stdout:4/937: creat d0/d87/d79/f122 x:0 0 0 2023-12-12T11:51:59.282 INFO:tasks.workunit.client.1.smithi093.stdout:4/938: truncate d0/d87/d79/d96/fd8 1672953 0 2023-12-12T11:51:59.284 INFO:tasks.workunit.client.1.smithi093.stdout:4/939: write d0/d87/d79/d96/fd8 [1125620,6868] 0 2023-12-12T11:51:59.285 INFO:tasks.workunit.client.1.smithi093.stdout:8/756: rmdir d3/d1a/d1f/d29/d30/d58/d76 39 2023-12-12T11:51:59.287 INFO:tasks.workunit.client.0.smithi063.stdout:9/410: creat d7/d20/d3f/d40/d4e/f80 x:0 0 0 2023-12-12T11:51:59.289 INFO:tasks.workunit.client.0.smithi063.stdout:0/478: dwrite d0/d1a/d23/d34/d42/f5d [0,4194304] 0 2023-12-12T11:51:59.289 INFO:tasks.workunit.client.0.smithi063.stdout:0/479: fsync d0/d7/f47 0 2023-12-12T11:51:59.290 INFO:tasks.workunit.client.0.smithi063.stdout:2/408: dwrite d0/f22 [0,4194304] 0 2023-12-12T11:51:59.290 INFO:tasks.workunit.client.0.smithi063.stdout:2/409: chown d0/d1a/d1e/l74 9346416 1 2023-12-12T11:51:59.292 INFO:tasks.workunit.client.0.smithi063.stdout:6/533: mknod d9/d68/d8f/cb0 0 2023-12-12T11:51:59.292 INFO:tasks.workunit.client.0.smithi063.stdout:4/537: sync 2023-12-12T11:51:59.292 INFO:tasks.workunit.client.0.smithi063.stdout:8/526: sync 2023-12-12T11:51:59.292 INFO:tasks.workunit.client.0.smithi063.stdout:6/534: chown d9/d10/d2a/f34 362706 1 2023-12-12T11:51:59.292 INFO:tasks.workunit.client.0.smithi063.stdout:8/527: fdatasync d4/de/d11/f18 0 2023-12-12T11:51:59.293 INFO:tasks.workunit.client.0.smithi063.stdout:6/535: creat d9/d10/d25/fb1 x:0 0 0 2023-12-12T11:51:59.293 INFO:tasks.workunit.client.0.smithi063.stdout:3/452: stat d4/la 0 2023-12-12T11:51:59.296 INFO:tasks.workunit.client.0.smithi063.stdout:9/411: link d7/d11/d4b/f68 d7/d11/d12/d30/d3e/d55/f81 0 2023-12-12T11:51:59.296 INFO:tasks.workunit.client.0.smithi063.stdout:9/412: truncate d7/d11/d12/f60 440949 0 2023-12-12T11:51:59.298 INFO:tasks.workunit.client.0.smithi063.stdout:0/480: dread d0/d7/d27/d19/d2d/f43 [0,4194304] 0 2023-12-12T11:51:59.300 INFO:tasks.workunit.client.1.smithi093.stdout:2/752: unlink d5/d14/d2d/l24 0 2023-12-12T11:51:59.300 INFO:tasks.workunit.client.1.smithi093.stdout:2/753: truncate d5/d14/d2d/d4c/d54/d67/d69/f97 498075 0 2023-12-12T11:51:59.307 INFO:tasks.workunit.client.0.smithi063.stdout:2/410: truncate d0/f49 480827 0 2023-12-12T11:51:59.307 INFO:tasks.workunit.client.0.smithi063.stdout:0/481: dread d0/d1a/d23/d34/d42/f80 [0,4194304] 0 2023-12-12T11:51:59.307 INFO:tasks.workunit.client.0.smithi063.stdout:0/482: write d0/d7/d27/f88 [622148,101829] 0 2023-12-12T11:51:59.311 INFO:tasks.workunit.client.0.smithi063.stdout:4/538: rename d2/d48/d69/d98/fa1 to d2/d48/fac 0 2023-12-12T11:51:59.313 INFO:tasks.workunit.client.1.smithi093.stdout:7/676: creat da/d2e/d89/fea x:0 0 0 2023-12-12T11:51:59.318 INFO:tasks.workunit.client.1.smithi093.stdout:9/696: symlink d1/lee 0 2023-12-12T11:51:59.318 INFO:tasks.workunit.client.1.smithi093.stdout:9/697: chown d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/dc0/cc6 1 1 2023-12-12T11:51:59.318 INFO:tasks.workunit.client.0.smithi063.stdout:9/413: dread d7/f14 [0,4194304] 0 2023-12-12T11:51:59.319 INFO:tasks.workunit.client.0.smithi063.stdout:9/414: creat d7/d15/d39/f82 x:0 0 0 2023-12-12T11:51:59.319 INFO:tasks.workunit.client.0.smithi063.stdout:8/528: creat d4/d24/d38/d45/d5b/fa1 x:0 0 0 2023-12-12T11:51:59.320 INFO:tasks.workunit.client.0.smithi063.stdout:8/529: read d4/d24/f96 [98736,96805] 0 2023-12-12T11:51:59.324 INFO:tasks.workunit.client.0.smithi063.stdout:6/536: unlink d9/f1a 0 2023-12-12T11:51:59.324 INFO:tasks.workunit.client.0.smithi063.stdout:4/539: dread d2/d47/f31 [0,4194304] 0 2023-12-12T11:51:59.327 INFO:tasks.workunit.client.1.smithi093.stdout:7/677: dread da/d15/d19/d90/d7d/f88 [4194304,4194304] 0 2023-12-12T11:51:59.327 INFO:tasks.workunit.client.1.smithi093.stdout:7/678: write da/d15/d2d/f34 [2578728,65325] 0 2023-12-12T11:51:59.328 INFO:tasks.workunit.client.1.smithi093.stdout:7/679: chown da/de/d46/d4f/la2 14 1 2023-12-12T11:51:59.328 INFO:tasks.workunit.client.1.smithi093.stdout:8/757: getdents d3/d1a/d1f/d29/d30/d58/d76 0 2023-12-12T11:51:59.329 INFO:tasks.workunit.client.0.smithi063.stdout:2/411: unlink d0/ce 0 2023-12-12T11:51:59.330 INFO:tasks.workunit.client.0.smithi063.stdout:0/483: creat d0/d1a/fa3 x:0 0 0 2023-12-12T11:51:59.335 INFO:tasks.workunit.client.1.smithi093.stdout:7/680: dread da/de/f27 [0,4194304] 0 2023-12-12T11:51:59.341 INFO:tasks.workunit.client.0.smithi063.stdout:9/415: rename d7/d11/d4b/l6a to d7/d11/l83 0 2023-12-12T11:51:59.344 INFO:tasks.workunit.client.1.smithi093.stdout:5/600: rename d0/d7/d85/da0/da7 to d0/d7/d36/d38/dce 0 2023-12-12T11:51:59.345 INFO:tasks.workunit.client.0.smithi063.stdout:8/530: mknod d4/de/d1e/ca2 0 2023-12-12T11:51:59.346 INFO:tasks.workunit.client.1.smithi093.stdout:8/758: getdents d3/d1a/d1f/d59 0 2023-12-12T11:51:59.348 INFO:tasks.workunit.client.0.smithi063.stdout:9/416: read f6 [2087182,15167] 0 2023-12-12T11:51:59.349 INFO:tasks.workunit.client.0.smithi063.stdout:5/525: sync 2023-12-12T11:51:59.353 INFO:tasks.workunit.client.0.smithi063.stdout:3/453: mknod d4/df/d1a/c91 0 2023-12-12T11:51:59.355 INFO:tasks.workunit.client.0.smithi063.stdout:2/412: creat d0/d1a/d3a/f84 x:0 0 0 2023-12-12T11:51:59.369 INFO:tasks.workunit.client.0.smithi063.stdout:0/484: read d0/d7/f55 [2132730,107026] 0 2023-12-12T11:51:59.369 INFO:tasks.workunit.client.0.smithi063.stdout:0/485: creat d0/d1a/d66/fa4 x:0 0 0 2023-12-12T11:51:59.371 INFO:tasks.workunit.client.0.smithi063.stdout:4/540: rmdir d2/d8 39 2023-12-12T11:51:59.372 INFO:tasks.workunit.client.0.smithi063.stdout:4/541: fsync d2/d17/d81/f8c 0 2023-12-12T11:51:59.372 INFO:tasks.workunit.client.1.smithi093.stdout:6/866: sync 2023-12-12T11:51:59.372 INFO:tasks.workunit.client.1.smithi093.stdout:0/740: sync 2023-12-12T11:51:59.372 INFO:tasks.workunit.client.0.smithi063.stdout:3/454: dread d4/f76 [0,4194304] 0 2023-12-12T11:51:59.373 INFO:tasks.workunit.client.0.smithi063.stdout:3/455: stat d4/d23/d5d/f89 0 2023-12-12T11:51:59.374 INFO:tasks.workunit.client.1.smithi093.stdout:4/940: rename d0/d87 to d0/d31/db8/d123 0 2023-12-12T11:51:59.375 INFO:tasks.workunit.client.0.smithi063.stdout:5/526: unlink d7/d28/l5d 0 2023-12-12T11:51:59.377 INFO:tasks.workunit.client.0.smithi063.stdout:2/413: mkdir d0/d1a/d3a/d85 0 2023-12-12T11:51:59.377 INFO:tasks.workunit.client.0.smithi063.stdout:2/414: dread - d0/d1a/d3a/d59/f78 zero size 2023-12-12T11:51:59.379 INFO:tasks.workunit.client.1.smithi093.stdout:0/741: creat d5/dd/d33/fe2 x:0 0 0 2023-12-12T11:51:59.379 INFO:tasks.workunit.client.1.smithi093.stdout:0/742: chown d5/d21/d27/f6a 43 1 2023-12-12T11:51:59.379 INFO:tasks.workunit.client.1.smithi093.stdout:0/743: stat d5/d21 0 2023-12-12T11:51:59.379 INFO:tasks.workunit.client.0.smithi063.stdout:8/531: getdents d4/de/d1e/d6d 0 2023-12-12T11:51:59.381 INFO:tasks.workunit.client.1.smithi093.stdout:6/867: mknod d0/da/d32/d9e/d114/c136 0 2023-12-12T11:51:59.382 INFO:tasks.workunit.client.0.smithi063.stdout:6/537: dwrite d9/d10/d5c/d5e/f63 [4194304,4194304] 0 2023-12-12T11:51:59.383 INFO:tasks.workunit.client.1.smithi093.stdout:3/711: dwrite df/f54 [0,4194304] 0 2023-12-12T11:51:59.385 INFO:tasks.workunit.client.1.smithi093.stdout:9/698: rename d1/d23/d24/d29/d43/d56/d85/ce7 to d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/d42/cef 0 2023-12-12T11:51:59.386 INFO:tasks.workunit.client.0.smithi063.stdout:4/542: read d2/d47/f30 [2078703,51312] 0 2023-12-12T11:51:59.389 INFO:tasks.workunit.client.1.smithi093.stdout:4/941: mknod d0/d31/d89/da1/c124 0 2023-12-12T11:51:59.389 INFO:tasks.workunit.client.1.smithi093.stdout:4/942: readlink d0/d31/l4d 0 2023-12-12T11:51:59.390 INFO:tasks.workunit.client.1.smithi093.stdout:4/943: write d0/d31/db8/d123/d79/f122 [794335,89229] 0 2023-12-12T11:51:59.391 INFO:tasks.workunit.client.0.smithi063.stdout:3/456: creat d4/df/d1a/d1c/f92 x:0 0 0 2023-12-12T11:51:59.392 INFO:tasks.workunit.client.1.smithi093.stdout:0/744: symlink d5/dd/d14/d26/d58/d64/ddb/le3 0 2023-12-12T11:51:59.395 INFO:tasks.workunit.client.0.smithi063.stdout:5/527: truncate d7/d10/d2b/d3c/d5a/f6a 1710132 0 2023-12-12T11:51:59.395 INFO:tasks.workunit.client.0.smithi063.stdout:5/528: stat d7/d10/d2b/d3c/d63/f7a 0 2023-12-12T11:51:59.396 INFO:tasks.workunit.client.1.smithi093.stdout:7/681: rename da/de/cd3 to da/d15/d19/d4c/ceb 0 2023-12-12T11:51:59.397 INFO:tasks.workunit.client.1.smithi093.stdout:9/699: truncate d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/f6a 520583 0 2023-12-12T11:51:59.398 INFO:tasks.workunit.client.0.smithi063.stdout:2/415: unlink d0/l10 0 2023-12-12T11:51:59.398 INFO:tasks.workunit.client.0.smithi063.stdout:6/538: link d9/d10/d7a/f91 d9/d68/fb2 0 2023-12-12T11:51:59.399 INFO:tasks.workunit.client.0.smithi063.stdout:4/543: creat d2/d48/d69/d98/fad x:0 0 0 2023-12-12T11:51:59.404 INFO:tasks.workunit.client.0.smithi063.stdout:5/529: unlink d7/d28/d43/d49/l4d 0 2023-12-12T11:51:59.412 INFO:tasks.workunit.client.1.smithi093.stdout:4/944: truncate d0/ff 4490497 0 2023-12-12T11:51:59.412 INFO:tasks.workunit.client.1.smithi093.stdout:4/945: chown d0/d36/f39 155 1 2023-12-12T11:51:59.412 INFO:tasks.workunit.client.1.smithi093.stdout:4/946: stat d0/d31/d5c/d6c/ff5 0 2023-12-12T11:51:59.413 INFO:tasks.workunit.client.1.smithi093.stdout:7/682: getdents da/d2e 0 2023-12-12T11:51:59.413 INFO:tasks.workunit.client.1.smithi093.stdout:0/745: link d5/d41/d77/d79/d9b/f9d d5/d41/d77/fe4 0 2023-12-12T11:51:59.413 INFO:tasks.workunit.client.1.smithi093.stdout:8/759: rename d3/d1a/d1f/d29/d3a/d68/la2 to d3/d1a/d1f/d29/d3a/d68/d8a/lfb 0 2023-12-12T11:51:59.413 INFO:tasks.workunit.client.1.smithi093.stdout:7/683: write da/de/f4d [3936887,43059] 0 2023-12-12T11:51:59.416 INFO:tasks.workunit.client.1.smithi093.stdout:9/700: mknod d1/d23/d6b/d92/db2/cf0 0 2023-12-12T11:51:59.416 INFO:tasks.workunit.client.0.smithi063.stdout:9/417: dwrite d7/d15/d39/f47 [0,4194304] 0 2023-12-12T11:51:59.420 INFO:tasks.workunit.client.0.smithi063.stdout:9/418: mknod d7/d11/d4b/d75/c84 0 2023-12-12T11:51:59.421 INFO:tasks.workunit.client.0.smithi063.stdout:0/486: rmdir d0/d1a/d66 39 2023-12-12T11:51:59.427 INFO:tasks.workunit.client.1.smithi093.stdout:7/684: dread da/de/f27 [0,4194304] 0 2023-12-12T11:51:59.427 INFO:tasks.workunit.client.1.smithi093.stdout:7/685: write da/f7b [1344999,95471] 0 2023-12-12T11:51:59.437 INFO:tasks.workunit.client.0.smithi063.stdout:8/532: dwrite d4/de/d1e/f4f [4194304,4194304] 0 2023-12-12T11:51:59.443 INFO:tasks.workunit.client.1.smithi093.stdout:9/701: dread d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/f25 [0,4194304] 0 2023-12-12T11:51:59.457 INFO:tasks.workunit.client.1.smithi093.stdout:4/947: rename d0/d31/d5c/d6c/da4/fbd to d0/d31/d89/da1/dcd/f125 0 2023-12-12T11:51:59.460 INFO:tasks.workunit.client.0.smithi063.stdout:9/419: mkdir d7/d20/d45/d46/d51/d64/d6f/d85 0 2023-12-12T11:51:59.460 INFO:tasks.workunit.client.0.smithi063.stdout:9/420: write d7/d11/d12/d30/d3e/d55/f81 [441367,62906] 0 2023-12-12T11:51:59.464 INFO:tasks.workunit.client.0.smithi063.stdout:0/487: rename d0/d1a/d23/f7c to d0/d1a/d23/d2e/d84/fa5 0 2023-12-12T11:51:59.467 INFO:tasks.workunit.client.0.smithi063.stdout:0/488: chown d0/d1a/d23/d2e/c38 3876 1 2023-12-12T11:51:59.468 INFO:tasks.workunit.client.0.smithi063.stdout:0/489: truncate d0/d1a/d66/f87 1116407 0 2023-12-12T11:51:59.468 INFO:tasks.workunit.client.0.smithi063.stdout:0/490: fdatasync d0/d7/d27/d1f/f3f 0 2023-12-12T11:51:59.468 INFO:tasks.workunit.client.0.smithi063.stdout:0/491: truncate d0/f50 818222 0 2023-12-12T11:51:59.468 INFO:tasks.workunit.client.0.smithi063.stdout:0/492: write d0/d7/f31 [2374616,32002] 0 2023-12-12T11:51:59.470 INFO:tasks.workunit.client.0.smithi063.stdout:0/493: write d0/d7/d27/f88 [399931,96139] 0 2023-12-12T11:51:59.470 INFO:tasks.workunit.client.1.smithi093.stdout:6/868: dwrite d0/da/d32/d9e/d4d/f92 [0,4194304] 0 2023-12-12T11:51:59.471 INFO:tasks.workunit.client.1.smithi093.stdout:3/712: dwrite df/f10 [0,4194304] 0 2023-12-12T11:51:59.477 INFO:tasks.workunit.client.0.smithi063.stdout:5/530: dwrite d7/d10/d2b/d3c/d42/d62/fa1 [0,4194304] 0 2023-12-12T11:51:59.478 INFO:tasks.workunit.client.0.smithi063.stdout:5/531: stat d7/d10/d2b/fa2 0 2023-12-12T11:51:59.478 INFO:tasks.workunit.client.0.smithi063.stdout:5/532: fsync d7/d28/d43/d49/f4a 0 2023-12-12T11:51:59.479 INFO:tasks.workunit.client.1.smithi093.stdout:9/702: symlink d1/d23/d24/d29/da3/lf1 0 2023-12-12T11:51:59.479 INFO:tasks.workunit.client.1.smithi093.stdout:9/703: stat d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/f3b 0 2023-12-12T11:51:59.479 INFO:tasks.workunit.client.1.smithi093.stdout:9/704: readlink d1/d23/d24/d29/d43/l61 0 2023-12-12T11:51:59.479 INFO:tasks.workunit.client.1.smithi093.stdout:9/705: write d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d73/fab [511590,86804] 0 2023-12-12T11:51:59.479 INFO:tasks.workunit.client.1.smithi093.stdout:1/716: sync 2023-12-12T11:51:59.479 INFO:tasks.workunit.client.1.smithi093.stdout:1/717: dread - d4/d1a/f24 zero size 2023-12-12T11:51:59.480 INFO:tasks.workunit.client.1.smithi093.stdout:4/948: dread d0/d36/d40/f8e [0,4194304] 0 2023-12-12T11:51:59.480 INFO:tasks.workunit.client.1.smithi093.stdout:8/760: dwrite d3/d1a/d1f/d29/d3a/d40/f53 [0,4194304] 0 2023-12-12T11:51:59.487 INFO:tasks.workunit.client.0.smithi063.stdout:3/457: dwrite d4/f25 [4194304,4194304] 0 2023-12-12T11:51:59.489 INFO:tasks.workunit.client.0.smithi063.stdout:9/421: mknod d7/d11/d12/c86 0 2023-12-12T11:51:59.492 INFO:tasks.workunit.client.1.smithi093.stdout:0/746: rename d5/dd/d14/d26/f3f to d5/d21/fe5 0 2023-12-12T11:51:59.497 INFO:tasks.workunit.client.0.smithi063.stdout:4/544: dwrite d2/d47/f7d [0,4194304] 0 2023-12-12T11:51:59.505 INFO:tasks.workunit.client.1.smithi093.stdout:6/869: creat d0/da/d32/d9e/d4d/de9/f137 x:0 0 0 2023-12-12T11:51:59.509 INFO:tasks.workunit.client.1.smithi093.stdout:9/706: creat d1/d23/d24/d29/da3/ff2 x:0 0 0 2023-12-12T11:51:59.510 INFO:tasks.workunit.client.0.smithi063.stdout:0/494: creat d0/d1a/d23/fa6 x:0 0 0 2023-12-12T11:51:59.510 INFO:tasks.workunit.client.0.smithi063.stdout:0/495: fdatasync d0/d1a/d23/d34/d42/f5d 0 2023-12-12T11:51:59.515 INFO:tasks.workunit.client.1.smithi093.stdout:1/718: dread d4/d1a/d1b/d26/f27 [0,4194304] 0 2023-12-12T11:51:59.515 INFO:tasks.workunit.client.1.smithi093.stdout:1/719: creat d4/d1a/d1b/d26/d40/fed x:0 0 0 2023-12-12T11:51:59.515 INFO:tasks.workunit.client.1.smithi093.stdout:1/720: creat d4/d1a/d73/dd4/dd5/fee x:0 0 0 2023-12-12T11:51:59.515 INFO:tasks.workunit.client.1.smithi093.stdout:1/721: readlink d4/d1a/d1b/d26/l62 0 2023-12-12T11:51:59.515 INFO:tasks.workunit.client.1.smithi093.stdout:1/722: dread - d4/d1a/d1b/f99 zero size 2023-12-12T11:51:59.523 INFO:tasks.workunit.client.0.smithi063.stdout:3/458: creat d4/df/d1a/d1c/d3b/d50/d61/f93 x:0 0 0 2023-12-12T11:51:59.524 INFO:tasks.workunit.client.0.smithi063.stdout:8/533: dwrite d4/de/d3b/d62/d36/d57/f7c [0,4194304] 0 2023-12-12T11:51:59.524 INFO:tasks.workunit.client.0.smithi063.stdout:6/539: dwrite d9/f24 [0,4194304] 0 2023-12-12T11:51:59.528 INFO:tasks.workunit.client.1.smithi093.stdout:8/761: creat d3/d1a/d1f/ffc x:0 0 0 2023-12-12T11:51:59.534 INFO:tasks.workunit.client.1.smithi093.stdout:6/870: truncate d0/da/d32/d39/d5b/f5d 3656767 0 2023-12-12T11:51:59.536 INFO:tasks.workunit.client.0.smithi063.stdout:0/496: rename d0/d7/d27/da1 to d0/d8e/da7 0 2023-12-12T11:51:59.536 INFO:tasks.workunit.client.0.smithi063.stdout:0/497: stat d0/d7 0 2023-12-12T11:51:59.538 INFO:tasks.workunit.client.1.smithi093.stdout:4/949: dwrite d0/d36/d11c/f11f [0,4194304] 0 2023-12-12T11:51:59.539 INFO:tasks.workunit.client.0.smithi063.stdout:0/498: creat d0/d1a/d23/fa8 x:0 0 0 2023-12-12T11:51:59.546 INFO:tasks.workunit.client.0.smithi063.stdout:8/534: dread d4/f7 [0,4194304] 0 2023-12-12T11:51:59.547 INFO:tasks.workunit.client.0.smithi063.stdout:8/535: creat d4/d24/d38/d45/d5b/fa3 x:0 0 0 2023-12-12T11:51:59.549 INFO:tasks.workunit.client.1.smithi093.stdout:9/707: dwrite d1/d23/d24/d29/d43/d56/d85/dc3/dce/f4c [0,4194304] 0 2023-12-12T11:51:59.552 INFO:tasks.workunit.client.0.smithi063.stdout:6/540: link d9/f40 d9/d2c/d61/fb3 0 2023-12-12T11:51:59.553 INFO:tasks.workunit.client.1.smithi093.stdout:8/762: unlink d3/d1a/d1f/d29/d3a/d68/f92 0 2023-12-12T11:51:59.553 INFO:tasks.workunit.client.1.smithi093.stdout:7/686: rename da/d15/d19/d4c/fad to da/d15/fec 0 2023-12-12T11:51:59.553 INFO:tasks.workunit.client.1.smithi093.stdout:7/687: stat da/l12 0 2023-12-12T11:51:59.558 INFO:tasks.workunit.client.0.smithi063.stdout:7/435: sync 2023-12-12T11:51:59.558 INFO:tasks.workunit.client.1.smithi093.stdout:8/763: symlink d3/d1a/d1f/lfd 0 2023-12-12T11:51:59.564 INFO:tasks.workunit.client.0.smithi063.stdout:8/536: creat d4/de/d3b/fa4 x:0 0 0 2023-12-12T11:51:59.564 INFO:tasks.workunit.client.0.smithi063.stdout:8/537: fdatasync d4/f17 0 2023-12-12T11:51:59.565 INFO:tasks.workunit.client.0.smithi063.stdout:1/570: sync 2023-12-12T11:51:59.566 INFO:tasks.workunit.client.1.smithi093.stdout:2/754: sync 2023-12-12T11:51:59.566 INFO:tasks.workunit.client.1.smithi093.stdout:1/723: dwrite d4/d1a/d1b/d26/d65/f7b [0,4194304] 0 2023-12-12T11:51:59.566 INFO:tasks.workunit.client.0.smithi063.stdout:6/541: rmdir d9/d2c/d61 39 2023-12-12T11:51:59.567 INFO:tasks.workunit.client.1.smithi093.stdout:4/950: write d0/d31/db8/d123/d79/d86/fc4 [1264635,130541] 0 2023-12-12T11:51:59.568 INFO:tasks.workunit.client.1.smithi093.stdout:7/688: symlink da/d2e/led 0 2023-12-12T11:51:59.568 INFO:tasks.workunit.client.1.smithi093.stdout:7/689: fdatasync da/d15/d2d/f51 0 2023-12-12T11:51:59.568 INFO:tasks.workunit.client.1.smithi093.stdout:7/690: chown da/f7b 173979 1 2023-12-12T11:51:59.568 INFO:tasks.workunit.client.1.smithi093.stdout:3/713: rename df/d22/d49/d69/d78/daf/d3d/d59/d72/d79/dd8 to df/d22/de6 0 2023-12-12T11:51:59.568 INFO:tasks.workunit.client.0.smithi063.stdout:0/499: symlink d0/d7/d27/la9 0 2023-12-12T11:51:59.570 INFO:tasks.workunit.client.0.smithi063.stdout:8/538: creat d4/de/d3b/d62/d36/d7f/fa5 x:0 0 0 2023-12-12T11:51:59.571 INFO:tasks.workunit.client.0.smithi063.stdout:1/571: rmdir d3/d3a/d54 39 2023-12-12T11:51:59.573 INFO:tasks.workunit.client.1.smithi093.stdout:8/764: creat d3/d1a/d1f/d29/d3a/d68/ffe x:0 0 0 2023-12-12T11:51:59.573 INFO:tasks.workunit.client.1.smithi093.stdout:8/765: creat d3/d1a/d1f/d29/d3a/d40/dbf/fff x:0 0 0 2023-12-12T11:51:59.576 INFO:tasks.workunit.client.0.smithi063.stdout:0/500: mknod d0/d1a/d23/d34/d42/caa 0 2023-12-12T11:51:59.576 INFO:tasks.workunit.client.0.smithi063.stdout:0/501: readlink d0/d7/d27/d1f/l5b 0 2023-12-12T11:51:59.576 INFO:tasks.workunit.client.1.smithi093.stdout:8/766: write d3/d1a/d1f/d59/d6c/f93 [272523,105318] 0 2023-12-12T11:51:59.582 INFO:tasks.workunit.client.1.smithi093.stdout:1/724: unlink d4/d1a/d1b/f8f 0 2023-12-12T11:51:59.582 INFO:tasks.workunit.client.1.smithi093.stdout:4/951: unlink d0/d36/d49/c92 0 2023-12-12T11:51:59.582 INFO:tasks.workunit.client.1.smithi093.stdout:4/952: write d0/d36/d11c/d97/f101 [559617,128223] 0 2023-12-12T11:51:59.582 INFO:tasks.workunit.client.1.smithi093.stdout:2/755: write d5/d14/d2d/fc [5512943,63459] 0 2023-12-12T11:51:59.583 INFO:tasks.workunit.client.1.smithi093.stdout:7/691: dread da/de/f27 [0,4194304] 0 2023-12-12T11:51:59.584 INFO:tasks.workunit.client.0.smithi063.stdout:0/502: rmdir d0/d7/d27/d19/d2d/d95 0 2023-12-12T11:51:59.584 INFO:tasks.workunit.client.0.smithi063.stdout:0/503: truncate d0/f65 1233393 0 2023-12-12T11:51:59.584 INFO:tasks.workunit.client.0.smithi063.stdout:0/504: truncate d0/d7/f55 5153572 0 2023-12-12T11:51:59.584 INFO:tasks.workunit.client.0.smithi063.stdout:0/505: truncate d0/d1a/d23/d34/d42/f6a 548932 0 2023-12-12T11:51:59.584 INFO:tasks.workunit.client.0.smithi063.stdout:0/506: fsync d0/d7/d27/d19/d2d/f43 0 2023-12-12T11:51:59.586 INFO:tasks.workunit.client.1.smithi093.stdout:3/714: creat df/d22/d49/d69/d78/daf/d3d/d59/fe7 x:0 0 0 2023-12-12T11:51:59.586 INFO:tasks.workunit.client.1.smithi093.stdout:3/715: read - df/d25/f9a zero size 2023-12-12T11:51:59.586 INFO:tasks.workunit.client.1.smithi093.stdout:3/716: truncate df/d22/d49/d69/fb5 275903 0 2023-12-12T11:51:59.586 INFO:tasks.workunit.client.0.smithi063.stdout:0/507: rmdir d0/d1a/d66 39 2023-12-12T11:51:59.586 INFO:tasks.workunit.client.0.smithi063.stdout:0/508: chown d0/d1a/d23/d34/d42/l39 69 1 2023-12-12T11:51:59.587 INFO:tasks.workunit.client.0.smithi063.stdout:0/509: truncate d0/d7/d27/f3b 1560723 0 2023-12-12T11:51:59.591 INFO:tasks.workunit.client.1.smithi093.stdout:1/725: write d4/d1c/f6d [1148090,127561] 0 2023-12-12T11:51:59.601 INFO:tasks.workunit.client.0.smithi063.stdout:3/459: dwrite d4/d23/f49 [0,4194304] 0 2023-12-12T11:51:59.603 INFO:tasks.workunit.client.0.smithi063.stdout:3/460: rmdir d4/df/d1a/d1c/d3b 39 2023-12-12T11:51:59.603 INFO:tasks.workunit.client.0.smithi063.stdout:3/461: stat d4/d23/d6b 0 2023-12-12T11:51:59.605 INFO:tasks.workunit.client.1.smithi093.stdout:8/767: unlink d3/d1a/d1f/d29/f43 0 2023-12-12T11:51:59.605 INFO:tasks.workunit.client.1.smithi093.stdout:8/768: fsync d3/d1a/d1f/d29/d3a/d40/f53 0 2023-12-12T11:51:59.605 INFO:tasks.workunit.client.1.smithi093.stdout:8/769: fsync d3/d1a/d1f/d29/d30/d58/f85 0 2023-12-12T11:51:59.605 INFO:tasks.workunit.client.1.smithi093.stdout:8/770: write d3/d1a/d1f/d75/fd0 [527355,65487] 0 2023-12-12T11:51:59.605 INFO:tasks.workunit.client.1.smithi093.stdout:8/771: dread - d3/d1a/d1f/d29/d3a/fc3 zero size 2023-12-12T11:51:59.605 INFO:tasks.workunit.client.1.smithi093.stdout:8/772: chown d3/d1a/d1f/d29/lbd 19618470 1 2023-12-12T11:51:59.605 INFO:tasks.workunit.client.1.smithi093.stdout:8/773: readlink d3/d1a/d1f/d29/d3a/d68/d8a/lfb 0 2023-12-12T11:51:59.606 INFO:tasks.workunit.client.1.smithi093.stdout:1/726: dread d4/d1a/d1b/d26/d65/f8a [0,4194304] 0 2023-12-12T11:51:59.606 INFO:tasks.workunit.client.1.smithi093.stdout:1/727: fsync d4/d1c/d2a/f2b 0 2023-12-12T11:51:59.606 INFO:tasks.workunit.client.1.smithi093.stdout:7/692: dread da/d15/d2d/f9f [0,4194304] 0 2023-12-12T11:51:59.606 INFO:tasks.workunit.client.1.smithi093.stdout:9/708: dwrite d1/d23/d6b/d92/fd2 [0,4194304] 0 2023-12-12T11:51:59.606 INFO:tasks.workunit.client.1.smithi093.stdout:3/717: write df/f54 [1862803,43646] 0 2023-12-12T11:51:59.606 INFO:tasks.workunit.client.1.smithi093.stdout:7/693: write da/d15/d59/d80/f8b [2845484,85023] 0 2023-12-12T11:51:59.606 INFO:tasks.workunit.client.1.smithi093.stdout:6/871: dwrite d0/da/d32/d9e/d4d/f6f [0,4194304] 0 2023-12-12T11:51:59.612 INFO:tasks.workunit.client.1.smithi093.stdout:4/953: creat d0/d31/db8/d123/d79/d96/db5/f126 x:0 0 0 2023-12-12T11:51:59.620 INFO:tasks.workunit.client.1.smithi093.stdout:5/601: sync 2023-12-12T11:51:59.628 INFO:tasks.workunit.client.0.smithi063.stdout:8/539: dread d4/d24/d38/d45/f9f [4194304,4194304] 0 2023-12-12T11:51:59.637 INFO:tasks.workunit.client.1.smithi093.stdout:8/774: dread d3/d1a/d1f/d29/d30/fd2 [0,4194304] 0 2023-12-12T11:51:59.637 INFO:tasks.workunit.client.1.smithi093.stdout:8/775: write d3/d8/d88/fb4 [877703,47056] 0 2023-12-12T11:51:59.639 INFO:tasks.workunit.client.1.smithi093.stdout:9/709: dread d1/d23/d6b/d92/fb9 [0,4194304] 0 2023-12-12T11:51:59.639 INFO:tasks.workunit.client.1.smithi093.stdout:9/710: chown d1/d23/d24/d29/d43/d58/l60 118814 1 2023-12-12T11:51:59.641 INFO:tasks.workunit.client.1.smithi093.stdout:1/728: rename d4/d1a/d1b/d26/d82/ce1 to d4/d1a/d1b/d26/d65/d6f/cef 0 2023-12-12T11:51:59.641 INFO:tasks.workunit.client.1.smithi093.stdout:3/718: mknod df/d22/d49/d69/d78/daf/d3d/d42/d9d/ce8 0 2023-12-12T11:51:59.641 INFO:tasks.workunit.client.1.smithi093.stdout:4/954: mkdir d0/d36/d11c/d97/d103/d127 0 2023-12-12T11:51:59.641 INFO:tasks.workunit.client.1.smithi093.stdout:4/955: dread - d0/d31/db8/d123/d79/d96/db5/ddd/fee zero size 2023-12-12T11:51:59.641 INFO:tasks.workunit.client.1.smithi093.stdout:6/872: dread d0/da/d32/dd3/f94 [0,4194304] 0 2023-12-12T11:51:59.642 INFO:tasks.workunit.client.1.smithi093.stdout:5/602: creat d0/d7/d59/fcf x:0 0 0 2023-12-12T11:51:59.644 INFO:tasks.workunit.client.1.smithi093.stdout:9/711: creat d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/db1/ff3 x:0 0 0 2023-12-12T11:51:59.644 INFO:tasks.workunit.client.1.smithi093.stdout:9/712: chown d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/d42/dd3 863505 1 2023-12-12T11:51:59.644 INFO:tasks.workunit.client.1.smithi093.stdout:9/713: stat d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/d42/lcb 0 2023-12-12T11:51:59.645 INFO:tasks.workunit.client.0.smithi063.stdout:0/510: truncate d0/f65 666641 0 2023-12-12T11:51:59.648 INFO:tasks.workunit.client.1.smithi093.stdout:1/729: creat d4/d1a/d1b/d26/ff0 x:0 0 0 2023-12-12T11:51:59.649 INFO:tasks.workunit.client.0.smithi063.stdout:8/540: dread d4/d24/d38/d45/d5b/f8c [0,4194304] 0 2023-12-12T11:51:59.649 INFO:tasks.workunit.client.0.smithi063.stdout:8/541: truncate d4/de/d3b/d62/d36/d57/f78 4647187 0 2023-12-12T11:51:59.649 INFO:tasks.workunit.client.0.smithi063.stdout:8/542: chown d4/de/d3b/d62/d6e/d76 972 1 2023-12-12T11:51:59.649 INFO:tasks.workunit.client.0.smithi063.stdout:8/543: chown d4/d24/d38/d45/d5b/l79 46 1 2023-12-12T11:51:59.649 INFO:tasks.workunit.client.0.smithi063.stdout:0/511: creat d0/d1a/d23/d2e/d84/fab x:0 0 0 2023-12-12T11:51:59.651 INFO:tasks.workunit.client.1.smithi093.stdout:6/873: unlink d0/da/d14/d21/f5f 0 2023-12-12T11:51:59.651 INFO:tasks.workunit.client.0.smithi063.stdout:6/542: dwrite d9/f55 [0,4194304] 0 2023-12-12T11:51:59.652 INFO:tasks.workunit.client.0.smithi063.stdout:6/543: chown d9/d10/d2a 6985258 1 2023-12-12T11:51:59.652 INFO:tasks.workunit.client.1.smithi093.stdout:2/756: dwrite d5/d14/d5e/f70 [0,4194304] 0 2023-12-12T11:51:59.653 INFO:tasks.workunit.client.1.smithi093.stdout:2/757: creat d5/d14/d27/fff x:0 0 0 2023-12-12T11:51:59.653 INFO:tasks.workunit.client.1.smithi093.stdout:1/730: rename d4/d1a/d83/f8b to d4/dc/ff1 0 2023-12-12T11:51:59.653 INFO:tasks.workunit.client.1.smithi093.stdout:1/731: chown d4/d1a/d83/d9a/da9/lca 346 1 2023-12-12T11:51:59.655 INFO:tasks.workunit.client.0.smithi063.stdout:8/544: creat d4/de/d3b/d62/fa6 x:0 0 0 2023-12-12T11:51:59.655 INFO:tasks.workunit.client.0.smithi063.stdout:8/545: creat d4/d24/d38/d45/d5b/fa7 x:0 0 0 2023-12-12T11:51:59.660 INFO:tasks.workunit.client.0.smithi063.stdout:0/512: unlink d0/d1a/f76 0 2023-12-12T11:51:59.660 INFO:tasks.workunit.client.0.smithi063.stdout:0/513: chown d0/d7/d27/d19/l94 232 1 2023-12-12T11:51:59.665 INFO:tasks.workunit.client.1.smithi093.stdout:2/758: rename d5/d14/d2d/d12/db4/lc2 to d5/d14/d2d/d12/d25/d7a/d7e/da5/dfc/l100 0 2023-12-12T11:51:59.665 INFO:tasks.workunit.client.1.smithi093.stdout:2/759: creat d5/d14/d2d/d12/d25/d7a/d7e/da5/f101 x:0 0 0 2023-12-12T11:51:59.665 INFO:tasks.workunit.client.1.smithi093.stdout:2/760: dread - d5/d14/d2d/d12/d25/d7a/d7e/da5/f101 zero size 2023-12-12T11:51:59.666 INFO:tasks.workunit.client.0.smithi063.stdout:6/544: symlink d9/d2c/d6b/d8a/lb4 0 2023-12-12T11:51:59.668 INFO:tasks.workunit.client.1.smithi093.stdout:1/732: dread d4/d1a/d73/f95 [0,4194304] 0 2023-12-12T11:51:59.672 INFO:tasks.workunit.client.0.smithi063.stdout:8/546: dread d4/d24/d38/d45/f9f [4194304,4194304] 0 2023-12-12T11:51:59.672 INFO:tasks.workunit.client.0.smithi063.stdout:8/547: creat d4/de/d3b/fa8 x:0 0 0 2023-12-12T11:51:59.674 INFO:tasks.workunit.client.0.smithi063.stdout:8/548: symlink d4/d24/d38/la9 0 2023-12-12T11:51:59.674 INFO:tasks.workunit.client.1.smithi093.stdout:3/719: dread df/d22/d49/d69/d78/daf/d3d/d59/d9c/fa2 [0,4194304] 0 2023-12-12T11:51:59.674 INFO:tasks.workunit.client.1.smithi093.stdout:3/720: dread - df/d22/d49/d69/d78/daf/d3d/d59/d9c/fcd zero size 2023-12-12T11:51:59.675 INFO:tasks.workunit.client.0.smithi063.stdout:8/549: symlink d4/d24/d38/d45/d5b/d92/laa 0 2023-12-12T11:51:59.676 INFO:tasks.workunit.client.0.smithi063.stdout:8/550: creat d4/de/d3b/d62/d36/fab x:0 0 0 2023-12-12T11:51:59.676 INFO:tasks.workunit.client.0.smithi063.stdout:8/551: chown d4/de/d1e/f7b 92 1 2023-12-12T11:51:59.678 INFO:tasks.workunit.client.1.smithi093.stdout:8/776: write d3/d1a/d1f/d29/f4d [3604944,98179] 0 2023-12-12T11:51:59.682 INFO:tasks.workunit.client.1.smithi093.stdout:1/733: write d4/d1a/d1b/d26/f27 [1645752,129307] 0 2023-12-12T11:51:59.682 INFO:tasks.workunit.client.0.smithi063.stdout:6/545: write d9/d10/d2a/f67 [1964863,11531] 0 2023-12-12T11:51:59.682 INFO:tasks.workunit.client.0.smithi063.stdout:0/514: dread d0/d1a/d23/d2e/f5e [0,4194304] 0 2023-12-12T11:51:59.682 INFO:tasks.workunit.client.0.smithi063.stdout:6/546: creat d9/d2c/d61/fb5 x:0 0 0 2023-12-12T11:51:59.682 INFO:tasks.workunit.client.0.smithi063.stdout:6/547: stat d9/d68/fb2 0 2023-12-12T11:51:59.682 INFO:tasks.workunit.client.0.smithi063.stdout:6/548: fdatasync d9/d10/d5c/fad 0 2023-12-12T11:51:59.683 INFO:tasks.workunit.client.0.smithi063.stdout:6/549: mknod d9/d68/cb6 0 2023-12-12T11:51:59.683 INFO:tasks.workunit.client.1.smithi093.stdout:1/734: symlink d4/d1a/d1b/d26/d82/de3/lf2 0 2023-12-12T11:51:59.683 INFO:tasks.workunit.client.1.smithi093.stdout:1/735: creat d4/d1a/d83/ff3 x:0 0 0 2023-12-12T11:51:59.684 INFO:tasks.workunit.client.0.smithi063.stdout:6/550: mknod d9/d2c/d61/cb7 0 2023-12-12T11:51:59.684 INFO:tasks.workunit.client.0.smithi063.stdout:6/551: write d9/d10/d25/f7b [565148,61010] 0 2023-12-12T11:51:59.685 INFO:tasks.workunit.client.0.smithi063.stdout:1/572: dwrite d3/fb1 [0,4194304] 0 2023-12-12T11:51:59.688 INFO:tasks.workunit.client.1.smithi093.stdout:1/736: symlink d4/d85/lf4 0 2023-12-12T11:51:59.692 INFO:tasks.workunit.client.1.smithi093.stdout:1/737: rename d4/d1a/d73/cb6 to d4/d1a/d83/d9a/de7/cf5 0 2023-12-12T11:51:59.693 INFO:tasks.workunit.client.1.smithi093.stdout:0/747: sync 2023-12-12T11:51:59.695 INFO:tasks.workunit.client.1.smithi093.stdout:1/738: rmdir d4/d1a/d1b/dbf 39 2023-12-12T11:51:59.697 INFO:tasks.workunit.client.1.smithi093.stdout:0/748: getdents d5/d21/d2f/d54/d7e/db4 0 2023-12-12T11:51:59.697 INFO:tasks.workunit.client.1.smithi093.stdout:0/749: chown d5/d21/f2e 1509 1 2023-12-12T11:51:59.702 INFO:tasks.workunit.client.1.smithi093.stdout:4/956: dwrite d0/d36/f39 [0,4194304] 0 2023-12-12T11:51:59.703 INFO:tasks.workunit.client.1.smithi093.stdout:4/957: chown d0/d36/f75 1408711 1 2023-12-12T11:51:59.705 INFO:tasks.workunit.client.1.smithi093.stdout:1/739: link d4/d1a/l4f d4/lf6 0 2023-12-12T11:51:59.705 INFO:tasks.workunit.client.1.smithi093.stdout:1/740: write d4/d1a/d73/f50 [1264777,99848] 0 2023-12-12T11:51:59.705 INFO:tasks.workunit.client.1.smithi093.stdout:0/750: rename d5/dd/d62/cd0 to d5/d21/d27/d3a/dc1/ce6 0 2023-12-12T11:51:59.708 INFO:tasks.workunit.client.0.smithi063.stdout:6/552: dread d9/f4b [0,4194304] 0 2023-12-12T11:51:59.708 INFO:tasks.workunit.client.0.smithi063.stdout:6/553: fdatasync d9/d10/f1e 0 2023-12-12T11:51:59.713 INFO:tasks.workunit.client.0.smithi063.stdout:8/552: getdents d4/de/d3b/d62 0 2023-12-12T11:51:59.714 INFO:tasks.workunit.client.0.smithi063.stdout:8/553: mknod d4/d55/cac 0 2023-12-12T11:51:59.722 INFO:tasks.workunit.client.1.smithi093.stdout:4/958: dread d0/fd1 [0,4194304] 0 2023-12-12T11:51:59.722 INFO:tasks.workunit.client.1.smithi093.stdout:4/959: stat d0/d31/d5c/d66/fe4 0 2023-12-12T11:51:59.729 INFO:tasks.workunit.client.1.smithi093.stdout:4/960: mkdir d0/d36/d128 0 2023-12-12T11:51:59.729 INFO:tasks.workunit.client.1.smithi093.stdout:0/751: write d5/dd/d14/d26/d58/d64/f97 [1411158,128755] 0 2023-12-12T11:51:59.729 INFO:tasks.workunit.client.1.smithi093.stdout:4/961: write d0/d31/db8/d123/d79/fed [1437454,101760] 0 2023-12-12T11:51:59.730 INFO:tasks.workunit.client.1.smithi093.stdout:0/752: write d5/d21/d27/d3a/d9a/fc3 [743732,103216] 0 2023-12-12T11:51:59.730 INFO:tasks.workunit.client.1.smithi093.stdout:3/721: dwrite df/d25/f44 [0,4194304] 0 2023-12-12T11:51:59.731 INFO:tasks.workunit.client.0.smithi063.stdout:2/416: sync 2023-12-12T11:51:59.732 INFO:tasks.workunit.client.0.smithi063.stdout:6/554: dread d9/d2c/d61/fa5 [0,4194304] 0 2023-12-12T11:51:59.733 INFO:tasks.workunit.client.0.smithi063.stdout:1/573: write f2 [6258934,41963] 0 2023-12-12T11:51:59.735 INFO:tasks.workunit.client.0.smithi063.stdout:8/554: dread d4/de/f13 [0,4194304] 0 2023-12-12T11:51:59.735 INFO:tasks.workunit.client.0.smithi063.stdout:5/533: sync 2023-12-12T11:51:59.735 INFO:tasks.workunit.client.0.smithi063.stdout:5/534: creat d7/d10/d2b/d3c/d42/d76/fa6 x:0 0 0 2023-12-12T11:51:59.736 INFO:tasks.workunit.client.0.smithi063.stdout:6/555: mkdir d9/d10/d73/db8 0 2023-12-12T11:51:59.739 INFO:tasks.workunit.client.0.smithi063.stdout:8/555: mknod d4/de/d3b/d62/d6e/cad 0 2023-12-12T11:51:59.744 INFO:tasks.workunit.client.1.smithi093.stdout:4/962: symlink d0/d31/d5c/l129 0 2023-12-12T11:51:59.744 INFO:tasks.workunit.client.0.smithi063.stdout:5/535: creat d7/fa7 x:0 0 0 2023-12-12T11:51:59.745 INFO:tasks.workunit.client.0.smithi063.stdout:6/556: symlink d9/d2c/d6b/lb9 0 2023-12-12T11:51:59.746 INFO:tasks.workunit.client.0.smithi063.stdout:6/557: creat d9/fba x:0 0 0 2023-12-12T11:51:59.748 INFO:tasks.workunit.client.1.smithi093.stdout:3/722: dread df/d22/d49/d69/d78/daf/d3d/d42/d8e/da5/fbb [0,4194304] 0 2023-12-12T11:51:59.749 INFO:tasks.workunit.client.0.smithi063.stdout:6/558: rename d9/d10/f71 to d9/d10/d5c/fbb 0 2023-12-12T11:51:59.754 INFO:tasks.workunit.client.1.smithi093.stdout:0/753: write d5/d21/d27/d3a/d9a/db5/db8/f85 [4131465,19070] 0 2023-12-12T11:51:59.756 INFO:tasks.workunit.client.0.smithi063.stdout:8/556: write f3 [3862412,80014] 0 2023-12-12T11:51:59.757 INFO:tasks.workunit.client.1.smithi093.stdout:1/741: dwrite d4/d1a/dc2/fd1 [0,4194304] 0 2023-12-12T11:51:59.757 INFO:tasks.workunit.client.1.smithi093.stdout:1/742: stat d4/d1a/d73/ld8 0 2023-12-12T11:51:59.758 INFO:tasks.workunit.client.0.smithi063.stdout:8/557: truncate d4/de/d3b/d62/d36/f73 630164 0 2023-12-12T11:51:59.758 INFO:tasks.workunit.client.0.smithi063.stdout:8/558: stat d4/d24/d38/d45/d5b/d92 0 2023-12-12T11:51:59.759 INFO:tasks.workunit.client.0.smithi063.stdout:8/559: chown d4/de/d3b/d62/d36/d7f/f87 978 1 2023-12-12T11:51:59.764 INFO:tasks.workunit.client.1.smithi093.stdout:4/963: dread d0/d36/f70 [0,4194304] 0 2023-12-12T11:51:59.764 INFO:tasks.workunit.client.1.smithi093.stdout:4/964: readlink d0/d31/d5c/l129 0 2023-12-12T11:51:59.765 INFO:tasks.workunit.client.1.smithi093.stdout:1/743: truncate d4/d1a/d1b/d26/d31/f7e 2061134 0 2023-12-12T11:51:59.767 INFO:tasks.workunit.client.0.smithi063.stdout:8/560: symlink d4/d55/d52/d8e/lae 0 2023-12-12T11:51:59.768 INFO:tasks.workunit.client.0.smithi063.stdout:6/559: dread d9/d10/d5c/f9f [0,4194304] 0 2023-12-12T11:51:59.768 INFO:tasks.workunit.client.1.smithi093.stdout:4/965: symlink d0/d31/d5c/d66/d102/l12a 0 2023-12-12T11:51:59.770 INFO:tasks.workunit.client.1.smithi093.stdout:1/744: mkdir d4/d1a/d83/d9a/df7 0 2023-12-12T11:51:59.771 INFO:tasks.workunit.client.1.smithi093.stdout:4/966: mkdir d0/d36/d11c/d12b 0 2023-12-12T11:51:59.771 INFO:tasks.workunit.client.1.smithi093.stdout:4/967: fsync d0/d36/d40/f107 0 2023-12-12T11:51:59.771 INFO:tasks.workunit.client.1.smithi093.stdout:4/968: chown d0/d31/d9d/c106 2261679 1 2023-12-12T11:51:59.771 INFO:tasks.workunit.client.1.smithi093.stdout:4/969: write d0/d31/db8/d123/d79/d96/db5/ddd/fee [120673,44536] 0 2023-12-12T11:51:59.771 INFO:tasks.workunit.client.0.smithi063.stdout:5/536: read d7/d10/d2b/d3c/d63/f7a [134746,34645] 0 2023-12-12T11:51:59.771 INFO:tasks.workunit.client.0.smithi063.stdout:2/417: dread d0/ff [0,4194304] 0 2023-12-12T11:51:59.774 INFO:tasks.workunit.client.1.smithi093.stdout:4/970: creat d0/d31/db8/d123/d79/f12c x:0 0 0 2023-12-12T11:51:59.775 INFO:tasks.workunit.client.1.smithi093.stdout:1/745: link d4/d1a/d73/c39 d4/cf8 0 2023-12-12T11:51:59.778 INFO:tasks.workunit.client.0.smithi063.stdout:5/537: mknod d7/d10/d2b/d3c/d42/ca8 0 2023-12-12T11:51:59.780 INFO:tasks.workunit.client.1.smithi093.stdout:4/971: rmdir d0/d31/d5c/d6c/da4 39 2023-12-12T11:51:59.782 INFO:tasks.workunit.client.0.smithi063.stdout:2/418: rename d0/d1a/d1e/c2a to d0/c86 0 2023-12-12T11:51:59.783 INFO:tasks.workunit.client.0.smithi063.stdout:8/561: dread d4/d24/f31 [0,4194304] 0 2023-12-12T11:51:59.789 INFO:tasks.workunit.client.0.smithi063.stdout:5/538: creat d7/d28/d43/d49/fa9 x:0 0 0 2023-12-12T11:51:59.791 INFO:tasks.workunit.client.1.smithi093.stdout:1/746: dread d4/d1c/d2a/f4b [0,4194304] 0 2023-12-12T11:51:59.791 INFO:tasks.workunit.client.1.smithi093.stdout:1/747: stat d4/d1a/d1b/d26/f91 0 2023-12-12T11:51:59.792 INFO:tasks.workunit.client.1.smithi093.stdout:1/748: read - d4/d1a/d83/ff3 zero size 2023-12-12T11:51:59.794 INFO:tasks.workunit.client.1.smithi093.stdout:4/972: creat d0/d31/db8/d123/d79/d7f/f12d x:0 0 0 2023-12-12T11:51:59.797 INFO:tasks.workunit.client.0.smithi063.stdout:2/419: rename d0/d1a/d48/c2c to d0/d1a/d1e/c87 0 2023-12-12T11:51:59.799 INFO:tasks.workunit.client.0.smithi063.stdout:8/562: mknod d4/de/d3b/d62/d36/d7f/caf 0 2023-12-12T11:51:59.799 INFO:tasks.workunit.client.0.smithi063.stdout:8/563: fsync d4/d24/d38/d45/d5b/d92/d65/f8d 0 2023-12-12T11:51:59.801 INFO:tasks.workunit.client.1.smithi093.stdout:4/973: unlink d0/d31/d5c/d66/d102/l12a 0 2023-12-12T11:51:59.801 INFO:tasks.workunit.client.1.smithi093.stdout:4/974: stat d0/d31/db8/d123/d79/d96/db5/fea 0 2023-12-12T11:51:59.803 INFO:tasks.workunit.client.0.smithi063.stdout:2/420: rename d0/d1a/l40 to d0/d69/l88 0 2023-12-12T11:51:59.803 INFO:tasks.workunit.client.0.smithi063.stdout:2/421: readlink d0/d1a/d26/l82 0 2023-12-12T11:51:59.805 INFO:tasks.workunit.client.0.smithi063.stdout:1/574: dwrite d3/db/d16/d24/d4d/f1e [0,4194304] 0 2023-12-12T11:51:59.807 INFO:tasks.workunit.client.0.smithi063.stdout:8/564: link d4/d55/d52/d8e/lae d4/de/d3b/d62/d36/d57/d84/lb0 0 2023-12-12T11:51:59.808 INFO:tasks.workunit.client.0.smithi063.stdout:2/422: creat d0/d1a/d1e/d64/f89 x:0 0 0 2023-12-12T11:51:59.808 INFO:tasks.workunit.client.0.smithi063.stdout:2/423: chown d0/d1a/d3a/d59/l79 30 1 2023-12-12T11:51:59.808 INFO:tasks.workunit.client.0.smithi063.stdout:2/424: fdatasync d0/d1a/d3a/d59/f7e 0 2023-12-12T11:51:59.811 INFO:tasks.workunit.client.0.smithi063.stdout:8/565: rename d4/d24/d38/d45/d5b/fa1 to d4/de/d1e/d6d/fb1 0 2023-12-12T11:51:59.815 INFO:tasks.workunit.client.0.smithi063.stdout:2/425: creat d0/d69/f8a x:0 0 0 2023-12-12T11:51:59.815 INFO:tasks.workunit.client.0.smithi063.stdout:2/426: dread - d0/d1a/d1e/d64/f89 zero size 2023-12-12T11:51:59.827 INFO:tasks.workunit.client.1.smithi093.stdout:3/723: dwrite df/f86 [0,4194304] 0 2023-12-12T11:51:59.831 INFO:tasks.workunit.client.1.smithi093.stdout:0/754: dwrite d5/d21/d27/f5a [0,4194304] 0 2023-12-12T11:51:59.835 INFO:tasks.workunit.client.1.smithi093.stdout:1/749: dwrite d4/d1a/d1b/d26/ff0 [0,4194304] 0 2023-12-12T11:51:59.839 INFO:tasks.workunit.client.0.smithi063.stdout:6/560: dwrite d9/f59 [0,4194304] 0 2023-12-12T11:51:59.846 INFO:tasks.workunit.client.1.smithi093.stdout:3/724: link df/d22/f31 df/d22/d49/fe9 0 2023-12-12T11:51:59.846 INFO:tasks.workunit.client.1.smithi093.stdout:3/725: dread - df/d22/d49/d69/d78/daf/d3d/d42/d8e/fb8 zero size 2023-12-12T11:51:59.854 INFO:tasks.workunit.client.1.smithi093.stdout:0/755: rename d5/dd/d14/d26/d58/d64/d6f/d90/lac to d5/dd/d62/le7 0 2023-12-12T11:51:59.857 INFO:tasks.workunit.client.1.smithi093.stdout:3/726: mkdir df/d22/d49/d69/d78/dea 0 2023-12-12T11:51:59.857 INFO:tasks.workunit.client.1.smithi093.stdout:3/727: readlink df/d25/d2c/l77 0 2023-12-12T11:51:59.860 INFO:tasks.workunit.client.1.smithi093.stdout:3/728: rename df/d30/d33/c61 to df/d22/d49/d69/ceb 0 2023-12-12T11:51:59.862 INFO:tasks.workunit.client.1.smithi093.stdout:3/729: write df/d22/d49/d69/d78/daf/d3d/d6f/db1/fdb [663712,20941] 0 2023-12-12T11:51:59.870 INFO:tasks.workunit.client.1.smithi093.stdout:7/694: sync 2023-12-12T11:51:59.871 INFO:tasks.workunit.client.1.smithi093.stdout:2/761: sync 2023-12-12T11:51:59.874 INFO:tasks.workunit.client.1.smithi093.stdout:5/603: sync 2023-12-12T11:51:59.874 INFO:tasks.workunit.client.1.smithi093.stdout:8/777: sync 2023-12-12T11:51:59.874 INFO:tasks.workunit.client.1.smithi093.stdout:9/714: sync 2023-12-12T11:51:59.874 INFO:tasks.workunit.client.1.smithi093.stdout:9/715: chown d1/d23/d24/d29/d43/d56/de9 1263 1 2023-12-12T11:51:59.875 INFO:tasks.workunit.client.1.smithi093.stdout:9/716: write d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d57/d63/fc8 [513027,27857] 0 2023-12-12T11:51:59.876 INFO:tasks.workunit.client.1.smithi093.stdout:9/717: dread - d1/d23/d24/d29/da3/ff2 zero size 2023-12-12T11:51:59.876 INFO:tasks.workunit.client.1.smithi093.stdout:6/874: sync 2023-12-12T11:51:59.876 INFO:tasks.workunit.client.1.smithi093.stdout:6/875: fsync d0/da/d14/d3a/d106/f11c 0 2023-12-12T11:51:59.876 INFO:tasks.workunit.client.1.smithi093.stdout:8/778: mknod d3/d1a/d1f/d75/de3/c100 0 2023-12-12T11:51:59.879 INFO:tasks.workunit.client.1.smithi093.stdout:9/718: unlink d1/d23/f52 0 2023-12-12T11:51:59.880 INFO:tasks.workunit.client.1.smithi093.stdout:9/719: chown d1/d23/d24/d29/d43/d56/d85/dc3/dce/de1 1295378 1 2023-12-12T11:51:59.880 INFO:tasks.workunit.client.0.smithi063.stdout:8/566: dwrite d4/de/d1e/f64 [0,4194304] 0 2023-12-12T11:51:59.885 INFO:tasks.workunit.client.1.smithi093.stdout:8/779: mknod d3/d1a/c101 0 2023-12-12T11:51:59.885 INFO:tasks.workunit.client.1.smithi093.stdout:5/604: unlink d0/d7/d36/db9/c8c 0 2023-12-12T11:51:59.889 INFO:tasks.workunit.client.1.smithi093.stdout:9/720: symlink d1/d23/dd5/lf4 0 2023-12-12T11:51:59.889 INFO:tasks.workunit.client.1.smithi093.stdout:1/750: dwrite d4/d1a/d73/dd4/dd5/fea [0,4194304] 0 2023-12-12T11:51:59.890 INFO:tasks.workunit.client.0.smithi063.stdout:1/575: dwrite d3/d3a/d52/fb7 [0,4194304] 0 2023-12-12T11:51:59.890 INFO:tasks.workunit.client.0.smithi063.stdout:1/576: chown d3/db/d16/d24/d48/d75/d83/l7b 422252689 1 2023-12-12T11:51:59.890 INFO:tasks.workunit.client.0.smithi063.stdout:1/577: creat d3/db/d16/d17/d4b/fbc x:0 0 0 2023-12-12T11:51:59.892 INFO:tasks.workunit.client.1.smithi093.stdout:8/780: rename d3/d1a/d1f/d29/d3a/da0/fe1 to d3/d1a/d1f/d75/de3/f102 0 2023-12-12T11:51:59.892 INFO:tasks.workunit.client.1.smithi093.stdout:8/781: creat d3/d1a/d1f/d29/d30/f103 x:0 0 0 2023-12-12T11:51:59.899 INFO:tasks.workunit.client.1.smithi093.stdout:9/721: truncate d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/f35 3317627 0 2023-12-12T11:51:59.899 INFO:tasks.workunit.client.1.smithi093.stdout:9/722: chown d1/d23/d24/d29/d43/d56/d85/dc3/dce/f1c 10359729 1 2023-12-12T11:51:59.899 INFO:tasks.workunit.client.1.smithi093.stdout:9/723: fdatasync d1/d23/d24/d29/d43/d56/d68/f87 0 2023-12-12T11:51:59.899 INFO:tasks.workunit.client.1.smithi093.stdout:1/751: write d4/d1a/d1b/d26/d31/f7e [1779903,113034] 0 2023-12-12T11:51:59.899 INFO:tasks.workunit.client.1.smithi093.stdout:9/724: write d1/d23/d24/d29/d43/d56/d85/dc3/dce/d3e/f99 [669400,109492] 0 2023-12-12T11:51:59.900 INFO:tasks.workunit.client.1.smithi093.stdout:5/605: rename d0/d7/l17 to d0/d7/d8/d9e/d6a/ld0 0 2023-12-12T11:51:59.902 INFO:tasks.workunit.client.0.smithi063.stdout:1/578: unlink d3/db/d16/d17/d4b/fbc 0 2023-12-12T11:51:59.903 INFO:tasks.workunit.client.1.smithi093.stdout:8/782: link d3/d1a/d1f/d29/d3a/da0/la9 d3/d1a/d1f/d75/de3/l104 0 2023-12-12T11:51:59.903 INFO:tasks.workunit.client.1.smithi093.stdout:8/783: truncate d3/d1a/d1f/d75/de3/f102 457593 0 2023-12-12T11:51:59.905 INFO:tasks.workunit.client.0.smithi063.stdout:2/427: dwrite d0/d1a/d57/f6f [0,4194304] 0 2023-12-12T11:51:59.905 INFO:tasks.workunit.client.0.smithi063.stdout:6/561: dwrite d9/d2c/d6b/f9b [0,4194304] 0 2023-12-12T11:51:59.908 INFO:tasks.workunit.client.1.smithi093.stdout:1/752: symlink d4/d1a/d83/d9a/da9/lf9 0 2023-12-12T11:51:59.908 INFO:tasks.workunit.client.1.smithi093.stdout:9/725: mkdir d1/d23/d24/d29/d43/d56/d85/dc3/dce/df5 0 2023-12-12T11:51:59.908 INFO:tasks.workunit.client.1.smithi093.stdout:8/784: unlink d3/d8/d88/fef 0 2023-12-12T11:51:59.908 INFO:tasks.workunit.client.1.smithi093.stdout:8/785: chown d3/d1a/d1f/d29/d3a/d40/cd6 1281099782 1 2023-12-12T11:51:59.911 INFO:tasks.workunit.client.1.smithi093.stdout:9/726: creat d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d57/d9e/ff6 x:0 0 0 2023-12-12T11:51:59.913 INFO:tasks.workunit.client.1.smithi093.stdout:0/756: dwrite d5/dd/d14/d26/d58/dab/fb6 [0,4194304] 0 2023-12-12T11:51:59.921 INFO:tasks.workunit.client.0.smithi063.stdout:2/428: creat d0/d1a/d48/d56/d77/f8b x:0 0 0 2023-12-12T11:51:59.921 INFO:tasks.workunit.client.1.smithi093.stdout:9/727: creat d1/d23/d24/d29/ff7 x:0 0 0 2023-12-12T11:51:59.925 INFO:tasks.workunit.client.1.smithi093.stdout:7/695: dread da/d15/d19/f45 [0,4194304] 0 2023-12-12T11:51:59.926 INFO:tasks.workunit.client.0.smithi063.stdout:6/562: rename d9/d10/l11 to d9/d2c/d6b/d8a/lbc 0 2023-12-12T11:51:59.931 INFO:tasks.workunit.client.0.smithi063.stdout:2/429: unlink d0/d1a/l25 0 2023-12-12T11:51:59.931 INFO:tasks.workunit.client.0.smithi063.stdout:2/430: creat d0/d69/f8c x:0 0 0 2023-12-12T11:51:59.931 INFO:tasks.workunit.client.0.smithi063.stdout:2/431: creat d0/d1a/d48/d56/d77/f8d x:0 0 0 2023-12-12T11:51:59.934 INFO:tasks.workunit.client.1.smithi093.stdout:0/757: mkdir d5/dd/d14/d26/d58/d64/d6f/de8 0 2023-12-12T11:51:59.934 INFO:tasks.workunit.client.1.smithi093.stdout:9/728: rename d1/d23/d24/d29/d43/l72 to d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/lf8 0 2023-12-12T11:51:59.936 INFO:tasks.workunit.client.0.smithi063.stdout:6/563: link d9/f59 d9/d2c/d6b/d8a/fbd 0 2023-12-12T11:51:59.943 INFO:tasks.workunit.client.1.smithi093.stdout:7/696: creat da/d15/ddd/fee x:0 0 0 2023-12-12T11:51:59.943 INFO:tasks.workunit.client.1.smithi093.stdout:7/697: creat da/de/d46/d4f/fef x:0 0 0 2023-12-12T11:51:59.943 INFO:tasks.workunit.client.1.smithi093.stdout:6/876: dread d0/d52/d7e/fbb [0,4194304] 0 2023-12-12T11:51:59.944 INFO:tasks.workunit.client.1.smithi093.stdout:2/762: dread d5/d31/f3f [0,4194304] 0 2023-12-12T11:51:59.944 INFO:tasks.workunit.client.1.smithi093.stdout:3/730: dwrite df/d22/d49/d69/d78/fc0 [0,4194304] 0 2023-12-12T11:51:59.944 INFO:tasks.workunit.client.1.smithi093.stdout:0/758: link d5/dd/d14/d26/d58/d64/ccb d5/dd/d14/d99/ce9 0 2023-12-12T11:51:59.944 INFO:tasks.workunit.client.0.smithi063.stdout:9/422: sync 2023-12-12T11:51:59.944 INFO:tasks.workunit.client.0.smithi063.stdout:7/436: sync 2023-12-12T11:51:59.944 INFO:tasks.workunit.client.0.smithi063.stdout:3/462: sync 2023-12-12T11:51:59.944 INFO:tasks.workunit.client.0.smithi063.stdout:0/515: sync 2023-12-12T11:51:59.944 INFO:tasks.workunit.client.0.smithi063.stdout:7/437: chown de/d39/c3a 3376262 1 2023-12-12T11:51:59.944 INFO:tasks.workunit.client.0.smithi063.stdout:3/463: readlink d4/df/l10 0 2023-12-12T11:51:59.947 INFO:tasks.workunit.client.0.smithi063.stdout:6/564: rename d9/d10/d5c/f9f to d9/d2c/d6b/d86/fbe 0 2023-12-12T11:51:59.947 INFO:tasks.workunit.client.0.smithi063.stdout:6/565: chown d9/d10/d5c/f65 0 1 2023-12-12T11:51:59.952 INFO:tasks.workunit.client.0.smithi063.stdout:0/516: rmdir d0/d1a/d23/d34 39 2023-12-12T11:51:59.952 INFO:tasks.workunit.client.0.smithi063.stdout:0/517: write d0/d1a/d23/f75 [887834,14025] 0 2023-12-12T11:51:59.953 INFO:tasks.workunit.client.0.smithi063.stdout:0/518: write d0/d7/d27/d19/f86 [4287209,114434] 0 2023-12-12T11:51:59.953 INFO:tasks.workunit.client.0.smithi063.stdout:0/519: write d0/d7/d27/d44/f97 [392553,124790] 0 2023-12-12T11:51:59.953 INFO:tasks.workunit.client.0.smithi063.stdout:0/520: dread - d0/d1a/d66/f6e zero size 2023-12-12T11:51:59.955 INFO:tasks.workunit.client.0.smithi063.stdout:4/545: sync 2023-12-12T11:51:59.955 INFO:tasks.workunit.client.0.smithi063.stdout:4/546: chown d2/d17/d81 10552 1 2023-12-12T11:51:59.958 INFO:tasks.workunit.client.0.smithi063.stdout:9/423: creat d7/d11/d4b/d75/f87 x:0 0 0 2023-12-12T11:51:59.960 INFO:tasks.workunit.client.1.smithi093.stdout:6/877: getdents d0/da/d32/d9e/d113 0 2023-12-12T11:51:59.960 INFO:tasks.workunit.client.1.smithi093.stdout:6/878: write d0/da/d32/d39/d5b/f101 [539974,55024] 0 2023-12-12T11:51:59.961 INFO:tasks.workunit.client.1.smithi093.stdout:5/606: dwrite d0/d7/d59/d48/fc3 [0,4194304] 0 2023-12-12T11:51:59.961 INFO:tasks.workunit.client.1.smithi093.stdout:5/607: chown d0/d7/d36/d29/d44/c5e 2 1 2023-12-12T11:51:59.963 INFO:tasks.workunit.client.0.smithi063.stdout:0/521: symlink d0/d7/d27/d19/d2d/d67/lac 0 2023-12-12T11:51:59.963 INFO:tasks.workunit.client.0.smithi063.stdout:0/522: chown d0/d1a/d23/d34 0 1 2023-12-12T11:51:59.964 INFO:tasks.workunit.client.1.smithi093.stdout:7/698: dread da/d15/d2d/f9f [0,4194304] 0 2023-12-12T11:51:59.967 INFO:tasks.workunit.client.0.smithi063.stdout:4/547: symlink d2/d17/lae 0 2023-12-12T11:51:59.969 INFO:tasks.workunit.client.0.smithi063.stdout:7/438: symlink de/d22/la0 0 2023-12-12T11:51:59.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:59 smithi093 ceph-mon[115914]: Updating smithi093:/etc/ceph/ceph.client.admin.keyring 2023-12-12T11:51:59.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:59 smithi093 ceph-mon[115914]: pgmap v14: 65 pgs: 65 active+clean; 2.6 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 227 MiB/s rd, 282 MiB/s wr, 413 op/s 2023-12-12T11:51:59.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:51:59 smithi093 ceph-mon[115914]: Updating smithi063:/etc/ceph/ceph.client.admin.keyring 2023-12-12T11:51:59.973 INFO:tasks.workunit.client.1.smithi093.stdout:1/753: dwrite d4/d1a/d1b/dbf/fd3 [8388608,4194304] 0 2023-12-12T11:51:59.973 INFO:tasks.workunit.client.0.smithi063.stdout:3/464: dread d4/df/d1a/d1c/d34/f6a [0,4194304] 0 2023-12-12T11:51:59.973 INFO:tasks.workunit.client.0.smithi063.stdout:3/465: creat d4/df/d1a/d1c/d3b/d50/d61/f94 x:0 0 0 2023-12-12T11:51:59.973 INFO:tasks.workunit.client.0.smithi063.stdout:3/466: dread - d4/df/d1a/d1c/d3b/d50/f8f zero size 2023-12-12T11:51:59.975 INFO:tasks.workunit.client.0.smithi063.stdout:9/424: mknod d7/d11/c88 0 2023-12-12T11:51:59.978 INFO:tasks.workunit.client.0.smithi063.stdout:1/579: dwrite d3/db/d16/d17/f55 [0,4194304] 0 2023-12-12T11:51:59.980 INFO:tasks.workunit.client.1.smithi093.stdout:3/731: rename df/l11 to df/d22/d49/d69/d78/daf/d3d/d42/d8e/da5/lec 0 2023-12-12T11:51:59.980 INFO:tasks.workunit.client.1.smithi093.stdout:3/732: dread - df/dc6/fdf zero size 2023-12-12T11:51:59.981 INFO:tasks.workunit.client.0.smithi063.stdout:6/566: rmdir d9/d68 39 2023-12-12T11:51:59.981 INFO:tasks.workunit.client.0.smithi063.stdout:6/567: creat d9/d10/d5c/fbf x:0 0 0 2023-12-12T11:51:59.982 INFO:tasks.workunit.client.1.smithi093.stdout:9/729: getdents d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d5c 0 2023-12-12T11:51:59.984 INFO:tasks.workunit.client.0.smithi063.stdout:4/548: creat d2/d17/d7f/da2/faf x:0 0 0 2023-12-12T11:51:59.984 INFO:tasks.workunit.client.0.smithi063.stdout:4/549: write d2/d17/d61/f71 [5109947,13074] 0 2023-12-12T11:51:59.984 INFO:tasks.workunit.client.0.smithi063.stdout:4/550: fdatasync d2/f56 0 2023-12-12T11:51:59.987 INFO:tasks.workunit.client.1.smithi093.stdout:8/786: dwrite d3/d1a/d1f/d29/d3a/d8f/fce [4194304,4194304] 0 2023-12-12T11:51:59.988 INFO:tasks.workunit.client.0.smithi063.stdout:7/439: mkdir de/d34/d68/da1 0 2023-12-12T11:51:59.995 INFO:tasks.workunit.client.1.smithi093.stdout:2/763: dwrite d5/d14/d47/d4e/fee [0,4194304] 0 2023-12-12T11:51:59.995 INFO:tasks.workunit.client.1.smithi093.stdout:2/764: chown d5/d14/d2d/fcb 0 1 2023-12-12T11:51:59.995 INFO:tasks.workunit.client.1.smithi093.stdout:0/759: dwrite d5/f31 [0,4194304] 0 2023-12-12T11:51:59.995 INFO:tasks.workunit.client.1.smithi093.stdout:0/760: readlink d5/d21/d27/l9f 0 2023-12-12T11:51:59.998 INFO:tasks.workunit.client.0.smithi063.stdout:3/467: creat d4/d23/d6b/f95 x:0 0 0 2023-12-12T11:52:00.000 INFO:tasks.workunit.client.1.smithi093.stdout:7/699: mkdir da/d15/d59/df0 0 2023-12-12T11:52:00.000 INFO:tasks.workunit.client.1.smithi093.stdout:7/700: readlink da/d2e/l8c 0 2023-12-12T11:52:00.000 INFO:tasks.workunit.client.1.smithi093.stdout:7/701: chown da/f4b 238945035 1 2023-12-12T11:52:00.003 INFO:tasks.workunit.client.0.smithi063.stdout:0/523: dread d0/d7/d27/d44/f97 [0,4194304] 0 2023-12-12T11:52:00.005 INFO:tasks.workunit.client.1.smithi093.stdout:4/975: sync 2023-12-12T11:52:00.007 INFO:tasks.workunit.client.0.smithi063.stdout:9/425: symlink d7/d11/d12/d30/d3e/d55/l89 0 2023-12-12T11:52:00.015 INFO:tasks.workunit.client.1.smithi093.stdout:9/730: getdents d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/dae 0 2023-12-12T11:52:00.015 INFO:tasks.workunit.client.1.smithi093.stdout:9/731: creat d1/d23/d24/d29/d43/ff9 x:0 0 0 2023-12-12T11:52:00.018 INFO:tasks.workunit.client.0.smithi063.stdout:1/580: creat d3/d3a/fbd x:0 0 0 2023-12-12T11:52:00.018 INFO:tasks.workunit.client.0.smithi063.stdout:1/581: readlink d3/db/d16/d24/d48/d75/d83/l7b 0 2023-12-12T11:52:00.019 INFO:tasks.workunit.client.0.smithi063.stdout:1/582: creat d3/d3a/fbe x:0 0 0 2023-12-12T11:52:00.019 INFO:tasks.workunit.client.0.smithi063.stdout:1/583: readlink d3/db/d16/d24/d4d/d35/l76 0 2023-12-12T11:52:00.027 INFO:tasks.workunit.client.1.smithi093.stdout:6/879: dwrite d0/d52/d6b/f129 [0,4194304] 0 2023-12-12T11:52:00.027 INFO:tasks.workunit.client.1.smithi093.stdout:6/880: truncate d0/da/d14/d3a/d95/fab 4716506 0 2023-12-12T11:52:00.027 INFO:tasks.workunit.client.1.smithi093.stdout:6/881: write d0/da/dbf/fc0 [42290,36788] 0 2023-12-12T11:52:00.027 INFO:tasks.workunit.client.1.smithi093.stdout:6/882: read d0/da/d14/d3a/f6a [237387,2554] 0 2023-12-12T11:52:00.028 INFO:tasks.workunit.client.1.smithi093.stdout:6/883: creat d0/da/d32/d9e/d4d/de9/f138 x:0 0 0 2023-12-12T11:52:00.028 INFO:tasks.workunit.client.1.smithi093.stdout:1/754: dwrite d4/d1a/d1b/d26/d40/fed [0,4194304] 0 2023-12-12T11:52:00.028 INFO:tasks.workunit.client.0.smithi063.stdout:3/468: dread d4/d23/d6b/d90/f82 [0,4194304] 0 2023-12-12T11:52:00.028 INFO:tasks.workunit.client.0.smithi063.stdout:6/568: mknod d9/d10/d73/db8/cc0 0 2023-12-12T11:52:00.028 INFO:tasks.workunit.client.0.smithi063.stdout:4/551: creat d2/d47/daa/fb0 x:0 0 0 2023-12-12T11:52:00.031 INFO:tasks.workunit.client.1.smithi093.stdout:5/608: mknod d0/d7/d36/d38/cd1 0 2023-12-12T11:52:00.031 INFO:tasks.workunit.client.1.smithi093.stdout:5/609: write d0/d7/d85/fb2 [4756827,7260] 0 2023-12-12T11:52:00.034 INFO:tasks.workunit.client.0.smithi063.stdout:7/440: mkdir de/d22/d6e/da2 0 2023-12-12T11:52:00.034 INFO:tasks.workunit.client.0.smithi063.stdout:7/441: fdatasync de/d33/f5c 0 2023-12-12T11:52:00.035 INFO:tasks.workunit.client.0.smithi063.stdout:7/442: write de/d39/d4b/d7b/f9b [738735,43306] 0 2023-12-12T11:52:00.035 INFO:tasks.workunit.client.0.smithi063.stdout:7/443: fdatasync de/f4c 0 2023-12-12T11:52:00.035 INFO:tasks.workunit.client.0.smithi063.stdout:7/444: fdatasync fb 0 2023-12-12T11:52:00.035 INFO:tasks.workunit.client.0.smithi063.stdout:7/445: chown de/d33/d71/l9e 3374 1 2023-12-12T11:52:00.035 INFO:tasks.workunit.client.0.smithi063.stdout:7/446: write de/d33/f5c [14412,110089] 0 2023-12-12T11:52:00.039 INFO:tasks.workunit.client.1.smithi093.stdout:9/732: dread d1/f2f [0,4194304] 0 2023-12-12T11:52:00.039 INFO:tasks.workunit.client.1.smithi093.stdout:7/702: rmdir da/d8e/da9/dda 0 2023-12-12T11:52:00.042 INFO:tasks.workunit.client.1.smithi093.stdout:3/733: getdents df/d22/d49/d69/d78/daf/d3d/d42/d8e/da5 0 2023-12-12T11:52:00.042 INFO:tasks.workunit.client.1.smithi093.stdout:4/976: truncate d0/f17 2543183 0 2023-12-12T11:52:00.043 INFO:tasks.workunit.client.1.smithi093.stdout:4/977: chown d0/d36/d11c/la6 377770867 1 2023-12-12T11:52:00.043 INFO:tasks.workunit.client.0.smithi063.stdout:0/524: mkdir d0/d1a/d23/d2e/dad 0 2023-12-12T11:52:00.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:59 smithi063 ceph-mon[107117]: Updating smithi093:/etc/ceph/ceph.client.admin.keyring 2023-12-12T11:52:00.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:59 smithi063 ceph-mon[107117]: pgmap v14: 65 pgs: 65 active+clean; 2.6 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 227 MiB/s rd, 282 MiB/s wr, 413 op/s 2023-12-12T11:52:00.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:51:59 smithi063 ceph-mon[107117]: Updating smithi063:/etc/ceph/ceph.client.admin.keyring 2023-12-12T11:52:00.044 INFO:tasks.workunit.client.1.smithi093.stdout:1/755: dread d4/d1a/d1b/d26/d40/f6a [0,4194304] 0 2023-12-12T11:52:00.050 INFO:tasks.workunit.client.0.smithi063.stdout:3/469: dread f0 [4194304,4194304] 0 2023-12-12T11:52:00.050 INFO:tasks.workunit.client.0.smithi063.stdout:3/470: readlink d4/df/d1a/d1c/d3b/d50/l4d 0 2023-12-12T11:52:00.050 INFO:tasks.workunit.client.0.smithi063.stdout:3/471: write d4/df/d1a/d1c/d57/f8a [9521205,68365] 0 2023-12-12T11:52:00.050 INFO:tasks.workunit.client.0.smithi063.stdout:9/426: mkdir d7/d8a 0 2023-12-12T11:52:00.055 INFO:tasks.workunit.client.0.smithi063.stdout:6/569: rename d9/d68/d8f/cb0 to d9/d10/d73/db8/cc1 0 2023-12-12T11:52:00.055 INFO:tasks.workunit.client.1.smithi093.stdout:6/884: stat d0/c17 0 2023-12-12T11:52:00.056 INFO:tasks.workunit.client.0.smithi063.stdout:4/552: creat d2/d17/d9d/fb1 x:0 0 0 2023-12-12T11:52:00.061 INFO:tasks.workunit.client.1.smithi093.stdout:7/703: truncate da/d15/d2d/d2f/fa5 2402921 0 2023-12-12T11:52:00.061 INFO:tasks.workunit.client.1.smithi093.stdout:7/704: chown l5 362297 1 2023-12-12T11:52:00.062 INFO:tasks.workunit.client.0.smithi063.stdout:9/427: creat d7/d11/d12/d30/f8b x:0 0 0 2023-12-12T11:52:00.063 INFO:tasks.workunit.client.1.smithi093.stdout:4/978: creat d0/d31/db8/d123/f12e x:0 0 0 2023-12-12T11:52:00.066 INFO:tasks.workunit.client.1.smithi093.stdout:8/787: dwrite d3/d1a/f2b [0,4194304] 0 2023-12-12T11:52:00.066 INFO:tasks.workunit.client.1.smithi093.stdout:6/885: creat d0/d52/d6b/ddb/f139 x:0 0 0 2023-12-12T11:52:00.067 INFO:tasks.workunit.client.1.smithi093.stdout:2/765: dwrite d5/fbf [0,4194304] 0 2023-12-12T11:52:00.069 INFO:tasks.workunit.client.1.smithi093.stdout:5/610: rmdir d0/d7/d36/d29/d44 39 2023-12-12T11:52:00.069 INFO:tasks.workunit.client.0.smithi063.stdout:1/584: getdents d3/db/d16/d17/d4b 0 2023-12-12T11:52:00.070 INFO:tasks.workunit.client.0.smithi063.stdout:1/585: write d3/d3a/f40 [596804,82043] 0 2023-12-12T11:52:00.073 INFO:tasks.workunit.client.0.smithi063.stdout:7/447: rename de/d34/d43/d45/d4e to de/d22/d6e/d8a/da3 0 2023-12-12T11:52:00.074 INFO:tasks.workunit.client.0.smithi063.stdout:7/448: stat de/d33/c35 0 2023-12-12T11:52:00.077 INFO:tasks.workunit.client.1.smithi093.stdout:0/761: dwrite d5/dd/d14/d99/fd8 [0,4194304] 0 2023-12-12T11:52:00.077 INFO:tasks.workunit.client.1.smithi093.stdout:0/762: fdatasync d5/d21/d2f/d54/f7b 0 2023-12-12T11:52:00.077 INFO:tasks.workunit.client.1.smithi093.stdout:9/733: unlink d1/d23/l2c 0 2023-12-12T11:52:00.077 INFO:tasks.workunit.client.0.smithi063.stdout:6/570: mkdir d9/d2c/d6b/d86/dc2 0 2023-12-12T11:52:00.078 INFO:tasks.workunit.client.1.smithi093.stdout:1/756: dread d4/d1a/d1b/d26/ff0 [0,4194304] 0 2023-12-12T11:52:00.082 INFO:tasks.workunit.client.0.smithi063.stdout:4/553: mknod d2/d47/cb2 0 2023-12-12T11:52:00.082 INFO:tasks.workunit.client.0.smithi063.stdout:4/554: write d2/d17/f3e [4939135,48142] 0 2023-12-12T11:52:00.082 INFO:tasks.workunit.client.0.smithi063.stdout:4/555: dread - d2/d47/f7b zero size 2023-12-12T11:52:00.082 INFO:tasks.workunit.client.1.smithi093.stdout:6/886: dread d0/d52/d7e/f58 [0,4194304] 0 2023-12-12T11:52:00.088 INFO:tasks.workunit.client.0.smithi063.stdout:1/586: write d3/db/d16/d24/d48/d75/f86 [3319398,130475] 0 2023-12-12T11:52:00.088 INFO:tasks.workunit.client.0.smithi063.stdout:1/587: rename d3/db/d16/d24/d48/d75/d83/d5b/d6b to d3/db/d16/d24/d48/d75/d83/d5b/d6b/d6d/daf/dbf 22 2023-12-12T11:52:00.088 INFO:tasks.workunit.client.0.smithi063.stdout:1/588: creat d3/db/d16/d24/d4d/d35/d98/fc0 x:0 0 0 2023-12-12T11:52:00.094 INFO:tasks.workunit.client.1.smithi093.stdout:7/705: write da/de/fb1 [2791288,54062] 0 2023-12-12T11:52:00.094 INFO:tasks.workunit.client.1.smithi093.stdout:8/788: symlink d3/d1a/l105 0 2023-12-12T11:52:00.094 INFO:tasks.workunit.client.1.smithi093.stdout:8/789: creat d3/d8/d88/f106 x:0 0 0 2023-12-12T11:52:00.094 INFO:tasks.workunit.client.1.smithi093.stdout:0/763: dread d5/dd/d14/d26/d58/d64/f97 [0,4194304] 0 2023-12-12T11:52:00.094 INFO:tasks.workunit.client.0.smithi063.stdout:5/539: sync 2023-12-12T11:52:00.094 INFO:tasks.workunit.client.0.smithi063.stdout:6/571: rmdir d9/d68/d8f 39 2023-12-12T11:52:00.095 INFO:tasks.workunit.client.1.smithi093.stdout:2/766: link d5/d31/d86/cdb d5/d14/d47/d4e/dae/c102 0 2023-12-12T11:52:00.095 INFO:tasks.workunit.client.1.smithi093.stdout:2/767: creat d5/d14/d2d/d4c/d76/dc6/f103 x:0 0 0 2023-12-12T11:52:00.097 INFO:tasks.workunit.client.1.smithi093.stdout:3/734: dwrite df/f86 [4194304,4194304] 0 2023-12-12T11:52:00.097 INFO:tasks.workunit.client.1.smithi093.stdout:3/735: dread - df/d25/f9a zero size 2023-12-12T11:52:00.100 INFO:tasks.workunit.client.1.smithi093.stdout:6/887: read d0/da/d32/d39/f91 [3903229,83045] 0 2023-12-12T11:52:00.102 INFO:tasks.workunit.client.0.smithi063.stdout:5/540: symlink d7/d28/d67/laa 0 2023-12-12T11:52:00.107 INFO:tasks.workunit.client.0.smithi063.stdout:6/572: mkdir d9/d10/d2a/dc3 0 2023-12-12T11:52:00.112 INFO:tasks.workunit.client.0.smithi063.stdout:5/541: rename d7/d28/d43/c5e to d7/d10/d2b/d3c/d42/cab 0 2023-12-12T11:52:00.113 INFO:tasks.workunit.client.1.smithi093.stdout:1/757: link d4/d1c/fdf d4/d1a/d1b/d26/d65/dc8/ffa 0 2023-12-12T11:52:00.113 INFO:tasks.workunit.client.0.smithi063.stdout:9/428: dwrite d7/d20/d3f/d40/f44 [0,4194304] 0 2023-12-12T11:52:00.114 INFO:tasks.workunit.client.1.smithi093.stdout:7/706: mknod da/d2e/d89/cf1 0 2023-12-12T11:52:00.115 INFO:tasks.workunit.client.1.smithi093.stdout:7/707: write da/d8e/dbc/fd9 [479395,65121] 0 2023-12-12T11:52:00.118 INFO:tasks.workunit.client.0.smithi063.stdout:6/573: truncate d9/d2c/d61/fa5 2296821 0 2023-12-12T11:52:00.120 INFO:tasks.workunit.client.0.smithi063.stdout:4/556: dread d2/d17/d41/f75 [0,4194304] 0 2023-12-12T11:52:00.120 INFO:tasks.workunit.client.0.smithi063.stdout:4/557: chown d2/d47/l3b 0 1 2023-12-12T11:52:00.127 INFO:tasks.workunit.client.1.smithi093.stdout:0/764: truncate d5/dd/d33/f5e 971578 0 2023-12-12T11:52:00.131 INFO:tasks.workunit.client.0.smithi063.stdout:9/429: truncate d7/f27 3826631 0 2023-12-12T11:52:00.131 INFO:tasks.workunit.client.0.smithi063.stdout:9/430: dread - d7/d11/d4b/d75/f87 zero size 2023-12-12T11:52:00.135 INFO:tasks.workunit.client.0.smithi063.stdout:6/574: creat d9/d68/fc4 x:0 0 0 2023-12-12T11:52:00.135 INFO:tasks.workunit.client.0.smithi063.stdout:6/575: fdatasync d9/d2c/d6b/d8a/fbd 0 2023-12-12T11:52:00.138 INFO:tasks.workunit.client.1.smithi093.stdout:3/736: dread df/d25/fb4 [0,4194304] 0 2023-12-12T11:52:00.139 INFO:tasks.workunit.client.0.smithi063.stdout:4/558: dread d2/d8/f32 [0,4194304] 0 2023-12-12T11:52:00.139 INFO:tasks.workunit.client.0.smithi063.stdout:4/559: dread - d2/d17/d7f/da2/faf zero size 2023-12-12T11:52:00.139 INFO:tasks.workunit.client.0.smithi063.stdout:4/560: read - d2/d47/f6b zero size 2023-12-12T11:52:00.139 INFO:tasks.workunit.client.0.smithi063.stdout:4/561: dread - d2/d47/d6d/d88/fa6 zero size 2023-12-12T11:52:00.140 INFO:tasks.workunit.client.1.smithi093.stdout:2/768: link d5/d14/d47/d56/fe8 d5/d14/d47/f104 0 2023-12-12T11:52:00.140 INFO:tasks.workunit.client.1.smithi093.stdout:2/769: stat d5/d14/d2d/d12/f2c 0 2023-12-12T11:52:00.145 INFO:tasks.workunit.client.1.smithi093.stdout:8/790: dwrite d3/d1a/d1f/d29/d3a/f55 [0,4194304] 0 2023-12-12T11:52:00.145 INFO:tasks.workunit.client.1.smithi093.stdout:8/791: read - d3/d1a/d1f/d29/d63/ff5 zero size 2023-12-12T11:52:00.145 INFO:tasks.workunit.client.1.smithi093.stdout:8/792: chown d3/d1a/d1f/d59/d69/ff8 490336585 1 2023-12-12T11:52:00.145 INFO:tasks.workunit.client.1.smithi093.stdout:8/793: stat d3/d1a/fde 0 2023-12-12T11:52:00.150 INFO:tasks.workunit.client.0.smithi063.stdout:1/589: dwrite d3/db/d16/d24/d4d/f3e [0,4194304] 0 2023-12-12T11:52:00.153 INFO:tasks.workunit.client.0.smithi063.stdout:6/576: rmdir d9/d2c/d6b/d8a 39 2023-12-12T11:52:00.158 INFO:tasks.workunit.client.0.smithi063.stdout:4/562: dread d2/d8/f26 [0,4194304] 0 2023-12-12T11:52:00.158 INFO:tasks.workunit.client.0.smithi063.stdout:4/563: stat d2/d47/f30 0 2023-12-12T11:52:00.163 INFO:tasks.workunit.client.0.smithi063.stdout:9/431: dread d7/d15/f23 [0,4194304] 0 2023-12-12T11:52:00.166 INFO:tasks.workunit.client.0.smithi063.stdout:6/577: creat d9/d10/d2a/dc3/fc5 x:0 0 0 2023-12-12T11:52:00.166 INFO:tasks.workunit.client.0.smithi063.stdout:6/578: creat d9/fc6 x:0 0 0 2023-12-12T11:52:00.167 INFO:tasks.workunit.client.1.smithi093.stdout:3/737: dread fc [0,4194304] 0 2023-12-12T11:52:00.169 INFO:tasks.workunit.client.0.smithi063.stdout:1/590: dread d3/db/f20 [0,4194304] 0 2023-12-12T11:52:00.172 INFO:tasks.workunit.client.1.smithi093.stdout:5/611: dwrite d0/d7/d36/db9/d66/f7d [0,4194304] 0 2023-12-12T11:52:00.172 INFO:tasks.workunit.client.1.smithi093.stdout:5/612: chown d0/d7/d36 1292408 1 2023-12-12T11:52:00.173 INFO:tasks.workunit.client.1.smithi093.stdout:9/734: dwrite d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d57/d63/f79 [0,4194304] 0 2023-12-12T11:52:00.173 INFO:tasks.workunit.client.1.smithi093.stdout:9/735: chown d1/d23/d24/d29/fa0 11 1 2023-12-12T11:52:00.173 INFO:tasks.workunit.client.1.smithi093.stdout:6/888: dwrite d0/da/d32/d39/f91 [0,4194304] 0 2023-12-12T11:52:00.173 INFO:tasks.workunit.client.0.smithi063.stdout:9/432: link d7/d11/f4c d7/d20/d3f/d40/d76/f8c 0 2023-12-12T11:52:00.174 INFO:tasks.workunit.client.0.smithi063.stdout:9/433: creat d7/d20/d3f/d40/d4e/f8d x:0 0 0 2023-12-12T11:52:00.174 INFO:tasks.workunit.client.0.smithi063.stdout:9/434: fsync d7/fa 0 2023-12-12T11:52:00.174 INFO:tasks.workunit.client.0.smithi063.stdout:5/542: dwrite d7/d28/f47 [0,4194304] 0 2023-12-12T11:52:00.174 INFO:tasks.workunit.client.0.smithi063.stdout:9/435: write d7/d11/d12/f1a [1749357,118384] 0 2023-12-12T11:52:00.175 INFO:tasks.workunit.client.0.smithi063.stdout:9/436: chown d7/d20/d3f/d40/d76/f8c 69738 1 2023-12-12T11:52:00.180 INFO:tasks.workunit.client.0.smithi063.stdout:6/579: creat d9/d10/d2a/fc7 x:0 0 0 2023-12-12T11:52:00.180 INFO:tasks.workunit.client.0.smithi063.stdout:6/580: readlink d9/d2c/d6b/l9e 0 2023-12-12T11:52:00.180 INFO:tasks.workunit.client.0.smithi063.stdout:6/581: stat d9/d10/l2e 0 2023-12-12T11:52:00.183 INFO:tasks.workunit.client.1.smithi093.stdout:1/758: creat d4/dc/d7a/ffb x:0 0 0 2023-12-12T11:52:00.184 INFO:tasks.workunit.client.0.smithi063.stdout:4/564: mkdir d2/d8/db3 0 2023-12-12T11:52:00.188 INFO:tasks.workunit.client.0.smithi063.stdout:1/591: symlink d3/db/d16/d24/d48/d75/d83/d5b/lc1 0 2023-12-12T11:52:00.189 INFO:tasks.workunit.client.1.smithi093.stdout:7/708: mknod da/de/d46/d4f/cf2 0 2023-12-12T11:52:00.193 INFO:tasks.workunit.client.1.smithi093.stdout:0/765: rename d5/dd/cc7 to d5/dd/dbb/cea 0 2023-12-12T11:52:00.194 INFO:tasks.workunit.client.1.smithi093.stdout:0/766: creat d5/d21/d27/d3a/d9a/feb x:0 0 0 2023-12-12T11:52:00.194 INFO:tasks.workunit.client.1.smithi093.stdout:0/767: fsync d5/d21/d27/d3a/f56 0 2023-12-12T11:52:00.194 INFO:tasks.workunit.client.1.smithi093.stdout:0/768: creat d5/dd/d62/fec x:0 0 0 2023-12-12T11:52:00.198 INFO:tasks.workunit.client.1.smithi093.stdout:2/770: unlink d5/d14/d47/c9a 0 2023-12-12T11:52:00.202 INFO:tasks.workunit.client.0.smithi063.stdout:5/543: mkdir d7/d28/d94/dac 0 2023-12-12T11:52:00.202 INFO:tasks.workunit.client.0.smithi063.stdout:5/544: write d7/d10/d2b/f91 [2129431,70285] 0 2023-12-12T11:52:00.204 INFO:tasks.workunit.client.1.smithi093.stdout:8/794: mkdir d3/d1a/d1f/d59/d69/dbc/dc2/d107 0 2023-12-12T11:52:00.208 INFO:tasks.workunit.client.1.smithi093.stdout:5/613: dwrite d0/d7/d36/d38/f43 [0,4194304] 0 2023-12-12T11:52:00.208 INFO:tasks.workunit.client.0.smithi063.stdout:9/437: mkdir d7/d20/d45/d8e 0 2023-12-12T11:52:00.211 INFO:tasks.workunit.client.0.smithi063.stdout:6/582: mknod d9/d10/d25/cc8 0 2023-12-12T11:52:00.213 INFO:tasks.workunit.client.0.smithi063.stdout:4/565: creat d2/d8/db3/fb4 x:0 0 0 2023-12-12T11:52:00.213 INFO:tasks.workunit.client.0.smithi063.stdout:4/566: dread - d2/d8/db3/fb4 zero size 2023-12-12T11:52:00.220 INFO:tasks.workunit.client.0.smithi063.stdout:5/545: dread d7/d10/d2b/d3c/d42/d62/d69/f73 [0,4194304] 0 2023-12-12T11:52:00.223 INFO:tasks.workunit.client.0.smithi063.stdout:1/592: rename d3/db/d16/d17/l59 to d3/db/d16/d24/d4d/d35/lc2 0 2023-12-12T11:52:00.231 INFO:tasks.workunit.client.0.smithi063.stdout:6/583: rename d9/d10/f47 to d9/d10/fc9 0 2023-12-12T11:52:00.233 INFO:tasks.workunit.client.1.smithi093.stdout:9/736: link d1/d23/d6b/d92/d9f/lb7 d1/d23/d6b/lfa 0 2023-12-12T11:52:00.233 INFO:tasks.workunit.client.1.smithi093.stdout:9/737: chown d1/d23/d6b/d92/d9f 328700520 1 2023-12-12T11:52:00.239 INFO:tasks.workunit.client.1.smithi093.stdout:6/889: creat d0/da/d14/f13a x:0 0 0 2023-12-12T11:52:00.242 INFO:tasks.workunit.client.0.smithi063.stdout:6/584: creat d9/d2c/d6b/fca x:0 0 0 2023-12-12T11:52:00.243 INFO:tasks.workunit.client.1.smithi093.stdout:1/759: mkdir d4/d81/dfc 0 2023-12-12T11:52:00.243 INFO:tasks.workunit.client.1.smithi093.stdout:1/760: truncate d4/d1a/d1b/d26/d65/dc8/ffa 705810 0 2023-12-12T11:52:00.243 INFO:tasks.workunit.client.1.smithi093.stdout:7/709: truncate da/f7b 704906 0 2023-12-12T11:52:00.243 INFO:tasks.workunit.client.1.smithi093.stdout:3/738: dwrite df/d25/d2c/d85/f8f [0,4194304] 0 2023-12-12T11:52:00.258 INFO:tasks.workunit.client.0.smithi063.stdout:5/546: rmdir d7/d28 39 2023-12-12T11:52:00.259 INFO:tasks.workunit.client.1.smithi093.stdout:0/769: symlink d5/d41/d77/d79/led 0 2023-12-12T11:52:00.260 INFO:tasks.workunit.client.1.smithi093.stdout:8/795: symlink d3/d1a/d1f/d59/l108 0 2023-12-12T11:52:00.260 INFO:tasks.workunit.client.1.smithi093.stdout:8/796: stat d3/d1a/c31 0 2023-12-12T11:52:00.261 INFO:tasks.workunit.client.1.smithi093.stdout:5/614: read d0/d7/d36/db9/d66/f7d [702723,52593] 0 2023-12-12T11:52:00.262 INFO:tasks.workunit.client.1.smithi093.stdout:5/615: write d0/d7/d59/d62/fb0 [818345,121164] 0 2023-12-12T11:52:00.264 INFO:tasks.workunit.client.0.smithi063.stdout:6/585: dread d9/d10/f22 [0,4194304] 0 2023-12-12T11:52:00.264 INFO:tasks.workunit.client.0.smithi063.stdout:9/438: rename d7/d11/d12/d30/f52 to d7/d15/f8f 0 2023-12-12T11:52:00.264 INFO:tasks.workunit.client.0.smithi063.stdout:6/586: chown d9/d10/d5c/f65 1420552205 1 2023-12-12T11:52:00.266 INFO:tasks.workunit.client.1.smithi093.stdout:6/890: write d0/d52/fd9 [4679113,46880] 0 2023-12-12T11:52:00.266 INFO:tasks.workunit.client.1.smithi093.stdout:6/891: fdatasync d0/d52/d7e/f49 0 2023-12-12T11:52:00.266 INFO:tasks.workunit.client.1.smithi093.stdout:2/771: dwrite d5/d14/d2d/d12/f2c [0,4194304] 0 2023-12-12T11:52:00.276 INFO:tasks.workunit.client.1.smithi093.stdout:9/738: creat d1/d23/d24/d29/d43/d58/ffb x:0 0 0 2023-12-12T11:52:00.282 INFO:tasks.workunit.client.1.smithi093.stdout:4/979: sync 2023-12-12T11:52:00.283 INFO:tasks.workunit.client.0.smithi063.stdout:4/567: dwrite d2/d17/d41/f75 [0,4194304] 0 2023-12-12T11:52:00.283 INFO:tasks.workunit.client.0.smithi063.stdout:4/568: creat d2/d17/d7f/fb5 x:0 0 0 2023-12-12T11:52:00.283 INFO:tasks.workunit.client.0.smithi063.stdout:6/587: creat d9/d2c/d6b/d8a/fcb x:0 0 0 2023-12-12T11:52:00.286 INFO:tasks.workunit.client.1.smithi093.stdout:1/761: dwrite d4/d1a/d1b/f8e [0,4194304] 0 2023-12-12T11:52:00.286 INFO:tasks.workunit.client.1.smithi093.stdout:3/739: link df/d22/d49/d69/d78/daf/d3d/d59/d72/l82 df/d22/d49/d69/d78/daf/d3d/d42/d8e/de1/led 0 2023-12-12T11:52:00.287 INFO:tasks.workunit.client.1.smithi093.stdout:1/762: write d4/d1a/d73/f50 [1307983,82398] 0 2023-12-12T11:52:00.292 INFO:tasks.workunit.client.1.smithi093.stdout:0/770: mknod d5/dd/d14/d26/d58/d64/d6f/de8/cee 0 2023-12-12T11:52:00.293 INFO:tasks.workunit.client.1.smithi093.stdout:8/797: mkdir d3/d1a/d1f/d29/d3a/da0/dcb/d109 0 2023-12-12T11:52:00.293 INFO:tasks.workunit.client.1.smithi093.stdout:8/798: dread - d3/d1a/d1f/d29/d3a/d40/dbf/fff zero size 2023-12-12T11:52:00.293 INFO:tasks.workunit.client.1.smithi093.stdout:0/771: write d5/dd/d62/f83 [5432462,73364] 0 2023-12-12T11:52:00.293 INFO:tasks.workunit.client.1.smithi093.stdout:5/616: mkdir d0/dd2 0 2023-12-12T11:52:00.297 INFO:tasks.workunit.client.0.smithi063.stdout:6/588: symlink d9/d10/d7a/lcc 0 2023-12-12T11:52:00.297 INFO:tasks.workunit.client.0.smithi063.stdout:6/589: readlink d9/d10/l2e 0 2023-12-12T11:52:00.298 INFO:tasks.workunit.client.1.smithi093.stdout:6/892: rename d0/da/d14/d38/d69 to d0/d52/d13b 0 2023-12-12T11:52:00.299 INFO:tasks.workunit.client.1.smithi093.stdout:6/893: fdatasync d0/d52/d6b/ddb/dfe/fa8 0 2023-12-12T11:52:00.299 INFO:tasks.workunit.client.0.smithi063.stdout:1/593: dwrite f2 [0,4194304] 0 2023-12-12T11:52:00.305 INFO:tasks.workunit.client.1.smithi093.stdout:2/772: creat d5/d31/d86/db5/f105 x:0 0 0 2023-12-12T11:52:00.305 INFO:tasks.workunit.client.0.smithi063.stdout:4/569: truncate d2/d8/f12 746617 0 2023-12-12T11:52:00.305 INFO:tasks.workunit.client.0.smithi063.stdout:6/590: mkdir d9/d2c/d61/dcd 0 2023-12-12T11:52:00.306 INFO:tasks.workunit.client.1.smithi093.stdout:9/739: unlink d1/d23/d24/d29/d43/d58/l60 0 2023-12-12T11:52:00.309 INFO:tasks.workunit.client.1.smithi093.stdout:7/710: rmdir da/d2e/d89 39 2023-12-12T11:52:00.314 INFO:tasks.workunit.client.1.smithi093.stdout:4/980: symlink d0/d31/d5c/d66/d110/l12f 0 2023-12-12T11:52:00.314 INFO:tasks.workunit.client.1.smithi093.stdout:4/981: fdatasync d0/d36/f70 0 2023-12-12T11:52:00.317 INFO:tasks.workunit.client.0.smithi063.stdout:4/570: dread d2/d17/f3c [0,4194304] 0 2023-12-12T11:52:00.320 INFO:tasks.workunit.client.1.smithi093.stdout:6/894: unlink d0/da/d32/d39/l75 0 2023-12-12T11:52:00.320 INFO:tasks.workunit.client.1.smithi093.stdout:9/740: mkdir d1/d23/d24/d29/d43/dfc 0 2023-12-12T11:52:00.324 INFO:tasks.workunit.client.1.smithi093.stdout:1/763: dread d4/f3e [0,4194304] 0 2023-12-12T11:52:00.324 INFO:tasks.workunit.client.0.smithi063.stdout:4/571: link d2/d17/l29 d2/d48/d4f/lb6 0 2023-12-12T11:52:00.325 INFO:tasks.workunit.client.0.smithi063.stdout:1/594: write d3/db/d16/d4f/d9a/fab [712223,87085] 0 2023-12-12T11:52:00.325 INFO:tasks.workunit.client.0.smithi063.stdout:1/595: chown d3/db/d16/d24/d30 3 1 2023-12-12T11:52:00.325 INFO:tasks.workunit.client.0.smithi063.stdout:1/596: write d3/db/d16/d24/d48/d75/d83/d5b/d6b/f99 [2418055,77805] 0 2023-12-12T11:52:00.325 INFO:tasks.workunit.client.0.smithi063.stdout:1/597: fsync d3/db/d16/d24/d48/d75/d83/d5b/d6b/f91 0 2023-12-12T11:52:00.325 INFO:tasks.workunit.client.1.smithi093.stdout:4/982: rename d0/d31/db8/d123/d79/d86/da9/l114 to d0/d31/d9d/da0/l130 0 2023-12-12T11:52:00.325 INFO:tasks.workunit.client.1.smithi093.stdout:4/983: chown d0/d36/d40/l42 194760 1 2023-12-12T11:52:00.327 INFO:tasks.workunit.client.0.smithi063.stdout:9/439: dwrite d7/f54 [0,4194304] 0 2023-12-12T11:52:00.327 INFO:tasks.workunit.client.1.smithi093.stdout:0/772: mknod d5/cef 0 2023-12-12T11:52:00.328 INFO:tasks.workunit.client.1.smithi093.stdout:0/773: chown d5/dd/d14/d26/d58/l8f 249293 1 2023-12-12T11:52:00.330 INFO:tasks.workunit.client.0.smithi063.stdout:4/572: truncate d2/f6 76230 0 2023-12-12T11:52:00.330 INFO:tasks.workunit.client.0.smithi063.stdout:4/573: truncate d2/d47/d6d/f8e 925851 0 2023-12-12T11:52:00.334 INFO:tasks.workunit.client.0.smithi063.stdout:1/598: creat d3/d3a/d5e/fc3 x:0 0 0 2023-12-12T11:52:00.334 INFO:tasks.workunit.client.0.smithi063.stdout:1/599: chown d3/db/d12 0 1 2023-12-12T11:52:00.335 INFO:tasks.workunit.client.0.smithi063.stdout:1/600: chown d3/db/d16/c97 15159519 1 2023-12-12T11:52:00.336 INFO:tasks.workunit.client.1.smithi093.stdout:0/774: mknod d5/d21/d2f/cf0 0 2023-12-12T11:52:00.337 INFO:tasks.workunit.client.1.smithi093.stdout:1/764: getdents d4/dc/d7a/d9c/da7 0 2023-12-12T11:52:00.340 INFO:tasks.workunit.client.0.smithi063.stdout:5/547: dwrite d7/d10/d2b/d3c/d5a/f6a [0,4194304] 0 2023-12-12T11:52:00.346 INFO:tasks.workunit.client.0.smithi063.stdout:6/591: rename d9/d2c/d6b to d9/d10/d5c/dce 0 2023-12-12T11:52:00.346 INFO:tasks.workunit.client.0.smithi063.stdout:6/592: write d9/d10/d5c/fbb [729381,3209] 0 2023-12-12T11:52:00.348 INFO:tasks.workunit.client.1.smithi093.stdout:5/617: getdents d0 0 2023-12-12T11:52:00.348 INFO:tasks.workunit.client.0.smithi063.stdout:1/601: getdents d3/db/d16/d24 0 2023-12-12T11:52:00.353 INFO:tasks.workunit.client.0.smithi063.stdout:4/574: dread d2/d48/d4f/f5e [0,4194304] 0 2023-12-12T11:52:00.354 INFO:tasks.workunit.client.1.smithi093.stdout:1/765: unlink d4/d1a/d1b/d26/d65/c9b 0 2023-12-12T11:52:00.358 INFO:tasks.workunit.client.1.smithi093.stdout:3/740: dwrite df/d22/d49/d69/d78/daf/d3d/d59/f64 [0,4194304] 0 2023-12-12T11:52:00.376 INFO:tasks.workunit.client.1.smithi093.stdout:2/773: dwrite d5/d14/d2d/d8b/da2/fb7 [0,4194304] 0 2023-12-12T11:52:00.380 INFO:tasks.workunit.client.1.smithi093.stdout:5/618: creat d0/d7/d36/db9/d66/d7c/fd3 x:0 0 0 2023-12-12T11:52:00.386 INFO:tasks.workunit.client.1.smithi093.stdout:3/741: rename df/d22/d49/d69/d78/db9/fd1 to df/fee 0 2023-12-12T11:52:00.388 INFO:tasks.workunit.client.0.smithi063.stdout:5/548: unlink d7/f26 0 2023-12-12T11:52:00.389 INFO:tasks.workunit.client.1.smithi093.stdout:0/775: dwrite d5/dd/d14/d26/d58/d64/d6f/d90/fa0 [0,4194304] 0 2023-12-12T11:52:00.392 INFO:tasks.workunit.client.1.smithi093.stdout:2/774: dread d5/f19 [4194304,4194304] 0 2023-12-12T11:52:00.392 INFO:tasks.workunit.client.1.smithi093.stdout:3/742: rename df/d30/d33/d66 to df/d22/d49/d69/d78/daf/d3d/def 0 2023-12-12T11:52:00.392 INFO:tasks.workunit.client.1.smithi093.stdout:3/743: truncate df/d22/d49/d69/d8c/fae 712381 0 2023-12-12T11:52:00.392 INFO:tasks.workunit.client.1.smithi093.stdout:3/744: stat df/d22/d49/d69/d6e/lb2 0 2023-12-12T11:52:00.392 INFO:tasks.workunit.client.0.smithi063.stdout:6/593: mknod d9/d10/d5c/dce/ccf 0 2023-12-12T11:52:00.398 INFO:tasks.workunit.client.0.smithi063.stdout:4/575: link d2/d48/c89 d2/d47/d6d/cb7 0 2023-12-12T11:52:00.398 INFO:tasks.workunit.client.0.smithi063.stdout:4/576: truncate d2/d47/f7d 5172441 0 2023-12-12T11:52:00.398 INFO:tasks.workunit.client.0.smithi063.stdout:4/577: truncate d2/d17/d7f/fa9 52177 0 2023-12-12T11:52:00.402 INFO:tasks.workunit.client.0.smithi063.stdout:0/525: sync 2023-12-12T11:52:00.402 INFO:tasks.workunit.client.0.smithi063.stdout:2/432: sync 2023-12-12T11:52:00.402 INFO:tasks.workunit.client.0.smithi063.stdout:5/549: mkdir d7/d28/d6e/dad 0 2023-12-12T11:52:00.402 INFO:tasks.workunit.client.0.smithi063.stdout:5/550: read - d7/d10/f64 zero size 2023-12-12T11:52:00.402 INFO:tasks.workunit.client.0.smithi063.stdout:3/472: sync 2023-12-12T11:52:00.402 INFO:tasks.workunit.client.0.smithi063.stdout:3/473: chown d4/df/c33 1 1 2023-12-12T11:52:00.402 INFO:tasks.workunit.client.0.smithi063.stdout:7/449: sync 2023-12-12T11:52:00.403 INFO:tasks.workunit.client.1.smithi093.stdout:2/775: truncate d5/d31/f45 1080763 0 2023-12-12T11:52:00.404 INFO:tasks.workunit.client.1.smithi093.stdout:5/619: rename d0/l8d to d0/d7/d8/de/ld4 0 2023-12-12T11:52:00.404 INFO:tasks.workunit.client.1.smithi093.stdout:5/620: creat d0/d7/d36/d29/fd5 x:0 0 0 2023-12-12T11:52:00.405 INFO:tasks.workunit.client.0.smithi063.stdout:1/602: getdents d3/db/d16/d24/d4d/d35 0 2023-12-12T11:52:00.405 INFO:tasks.workunit.client.0.smithi063.stdout:2/433: creat d0/d1a/d3a/d59/f8e x:0 0 0 2023-12-12T11:52:00.408 INFO:tasks.workunit.client.1.smithi093.stdout:2/776: mknod d5/d14/d2d/d12/d44/df6/c106 0 2023-12-12T11:52:00.410 INFO:tasks.workunit.client.0.smithi063.stdout:4/578: rename d2/l24 to d2/d17/d41/lb8 0 2023-12-12T11:52:00.410 INFO:tasks.workunit.client.0.smithi063.stdout:4/579: dread - d2/d17/d7f/fa4 zero size 2023-12-12T11:52:00.410 INFO:tasks.workunit.client.1.smithi093.stdout:1/766: dwrite d4/d1a/d73/f95 [0,4194304] 0 2023-12-12T11:52:00.413 INFO:tasks.workunit.client.0.smithi063.stdout:8/567: sync 2023-12-12T11:52:00.413 INFO:tasks.workunit.client.0.smithi063.stdout:8/568: dread - d4/de/d3b/d62/d36/d7f/fa5 zero size 2023-12-12T11:52:00.413 INFO:tasks.workunit.client.0.smithi063.stdout:9/440: dwrite d7/d15/f8f [0,4194304] 0 2023-12-12T11:52:00.416 INFO:tasks.workunit.client.0.smithi063.stdout:0/526: mknod d0/cae 0 2023-12-12T11:52:00.416 INFO:tasks.workunit.client.1.smithi093.stdout:9/741: dwrite d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/f6a [0,4194304] 0 2023-12-12T11:52:00.417 INFO:tasks.workunit.client.1.smithi093.stdout:3/745: dread df/d22/d49/d69/d78/daf/d3d/d6f/f4b [0,4194304] 0 2023-12-12T11:52:00.422 INFO:tasks.workunit.client.1.smithi093.stdout:2/777: mkdir d5/d14/d2d/d4c/d54/dc5/d107 0 2023-12-12T11:52:00.429 INFO:tasks.workunit.client.0.smithi063.stdout:7/450: dread de/d33/d41/d44/f6b [0,4194304] 0 2023-12-12T11:52:00.429 INFO:tasks.workunit.client.0.smithi063.stdout:7/451: write de/f1a [2480657,81047] 0 2023-12-12T11:52:00.430 INFO:tasks.workunit.client.0.smithi063.stdout:7/452: readlink de/d22/d2b/d4a/l57 0 2023-12-12T11:52:00.431 INFO:tasks.workunit.client.0.smithi063.stdout:2/434: creat d0/d1a/d26/f8f x:0 0 0 2023-12-12T11:52:00.431 INFO:tasks.workunit.client.0.smithi063.stdout:1/603: creat d3/db/d16/d24/d4d/fc4 x:0 0 0 2023-12-12T11:52:00.432 INFO:tasks.workunit.client.0.smithi063.stdout:1/604: fdatasync d3/db/d16/d24/d48/d75/d83/d5b/d6b/f91 0 2023-12-12T11:52:00.432 INFO:tasks.workunit.client.0.smithi063.stdout:1/605: fdatasync d3/db/d16/d24/d4d/d35/d98/fb5 0 2023-12-12T11:52:00.434 INFO:tasks.workunit.client.1.smithi093.stdout:9/742: mkdir d1/d23/d24/dfd 0 2023-12-12T11:52:00.435 INFO:tasks.workunit.client.0.smithi063.stdout:9/441: creat d7/d11/d4b/f90 x:0 0 0 2023-12-12T11:52:00.436 INFO:tasks.workunit.client.0.smithi063.stdout:9/442: fdatasync d7/d11/d12/d30/d3e/d55/f81 0 2023-12-12T11:52:00.436 INFO:tasks.workunit.client.1.smithi093.stdout:3/746: write df/f86 [7842267,29184] 0 2023-12-12T11:52:00.438 INFO:tasks.workunit.client.0.smithi063.stdout:5/551: rmdir d7/de 39 2023-12-12T11:52:00.439 INFO:tasks.workunit.client.0.smithi063.stdout:0/527: symlink d0/d1a/d23/d34/d42/d99/laf 0 2023-12-12T11:52:00.441 INFO:tasks.workunit.client.1.smithi093.stdout:3/747: creat df/d25/ff0 x:0 0 0 2023-12-12T11:52:00.443 INFO:tasks.workunit.client.0.smithi063.stdout:7/453: mkdir de/d39/d60/da4 0 2023-12-12T11:52:00.443 INFO:tasks.workunit.client.0.smithi063.stdout:7/454: chown de/d34/d68/d89/f8d 149397952 1 2023-12-12T11:52:00.444 INFO:tasks.workunit.client.0.smithi063.stdout:8/569: dread d4/de/f53 [0,4194304] 0 2023-12-12T11:52:00.445 INFO:tasks.workunit.client.1.smithi093.stdout:9/743: rename d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d57/d63/f7f to d1/d23/d24/ffe 0 2023-12-12T11:52:00.446 INFO:tasks.workunit.client.0.smithi063.stdout:4/580: dread d2/d17/f3e [4194304,4194304] 0 2023-12-12T11:52:00.446 INFO:tasks.workunit.client.0.smithi063.stdout:4/581: truncate d2/d47/d6d/d88/fa6 503315 0 2023-12-12T11:52:00.447 INFO:tasks.workunit.client.0.smithi063.stdout:4/582: readlink d2/d17/d41/l5f 0 2023-12-12T11:52:00.447 INFO:tasks.workunit.client.0.smithi063.stdout:4/583: fdatasync d2/d47/d6d/d88/fa6 0 2023-12-12T11:52:00.447 INFO:tasks.workunit.client.0.smithi063.stdout:4/584: fsync d2/d8/db3/fb4 0 2023-12-12T11:52:00.448 INFO:tasks.workunit.client.0.smithi063.stdout:2/435: mkdir d0/d41/d90 0 2023-12-12T11:52:00.450 INFO:tasks.workunit.client.1.smithi093.stdout:2/778: truncate d5/d14/d2d/d4c/d54/d67/d69/f8f 462051 0 2023-12-12T11:52:00.453 INFO:tasks.workunit.client.0.smithi063.stdout:3/474: rename d4/d23/c46 to d4/c96 0 2023-12-12T11:52:00.455 INFO:tasks.workunit.client.1.smithi093.stdout:3/748: symlink df/d22/d49/d69/d78/daf/d3d/d42/dd6/lf1 0 2023-12-12T11:52:00.455 INFO:tasks.workunit.client.1.smithi093.stdout:3/749: chown df/d22/d49/d69/d8c 781606182 1 2023-12-12T11:52:00.455 INFO:tasks.workunit.client.1.smithi093.stdout:3/750: truncate df/d22/d49/fd3 46474 0 2023-12-12T11:52:00.458 INFO:tasks.workunit.client.0.smithi063.stdout:9/443: unlink d7/d20/d3f/d40/d4e/f69 0 2023-12-12T11:52:00.458 INFO:tasks.workunit.client.1.smithi093.stdout:0/776: dwrite d5/dd/d14/d26/f6e [0,4194304] 0 2023-12-12T11:52:00.462 INFO:tasks.workunit.client.0.smithi063.stdout:1/606: dread d3/db/d16/d24/d4d/f3e [0,4194304] 0 2023-12-12T11:52:00.462 INFO:tasks.workunit.client.0.smithi063.stdout:5/552: unlink d7/d10/d2b/d3c/d42/d76/fa6 0 2023-12-12T11:52:00.462 INFO:tasks.workunit.client.0.smithi063.stdout:1/607: write d3/db/d16/d24/d48/d75/d83/d5b/d6b/f91 [158412,11958] 0 2023-12-12T11:52:00.462 INFO:tasks.workunit.client.0.smithi063.stdout:5/553: write d7/d10/d2b/d3c/d42/d62/d69/f9d [89353,120176] 0 2023-12-12T11:52:00.463 INFO:tasks.workunit.client.1.smithi093.stdout:1/767: dwrite d4/d1a/d83/d9a/fd7 [0,4194304] 0 2023-12-12T11:52:00.464 INFO:tasks.workunit.client.0.smithi063.stdout:5/554: creat d7/d10/d2b/d3c/d42/d76/fae x:0 0 0 2023-12-12T11:52:00.464 INFO:tasks.workunit.client.1.smithi093.stdout:5/621: dread d0/d7/d36/db9/f63 [0,4194304] 0 2023-12-12T11:52:00.464 INFO:tasks.workunit.client.1.smithi093.stdout:5/622: chown d0/d7/d8/d9e/d6a 0 1 2023-12-12T11:52:00.467 INFO:tasks.workunit.client.0.smithi063.stdout:0/528: creat d0/d7/d27/fb0 x:0 0 0 2023-12-12T11:52:00.468 INFO:tasks.workunit.client.1.smithi093.stdout:2/779: creat d5/d14/d2d/d4c/d54/d67/d69/f108 x:0 0 0 2023-12-12T11:52:00.469 INFO:tasks.workunit.client.0.smithi063.stdout:8/570: symlink d4/de/d3b/d62/d36/d7f/lb2 0 2023-12-12T11:52:00.469 INFO:tasks.workunit.client.0.smithi063.stdout:8/571: read - d4/de/d3b/d62/fa6 zero size 2023-12-12T11:52:00.469 INFO:tasks.workunit.client.1.smithi093.stdout:0/777: dread d5/d21/d27/d3a/f67 [0,4194304] 0 2023-12-12T11:52:00.470 INFO:tasks.workunit.client.0.smithi063.stdout:1/608: write d3/db/d16/d24/d4d/d35/f51 [4221365,63468] 0 2023-12-12T11:52:00.470 INFO:tasks.workunit.client.0.smithi063.stdout:1/609: creat d3/fc5 x:0 0 0 2023-12-12T11:52:00.470 INFO:tasks.workunit.client.0.smithi063.stdout:1/610: readlink d3/db/d16/l44 0 2023-12-12T11:52:00.470 INFO:tasks.workunit.client.0.smithi063.stdout:1/611: creat d3/db/d16/d4f/d9a/fc6 x:0 0 0 2023-12-12T11:52:00.472 INFO:tasks.workunit.client.1.smithi093.stdout:3/751: mkdir df/d22/d49/d69/d78/dad/df2 0 2023-12-12T11:52:00.473 INFO:tasks.workunit.client.0.smithi063.stdout:4/585: symlink d2/d47/lb9 0 2023-12-12T11:52:00.475 INFO:tasks.workunit.client.0.smithi063.stdout:6/594: dwrite d9/f24 [4194304,4194304] 0 2023-12-12T11:52:00.476 INFO:tasks.workunit.client.0.smithi063.stdout:2/436: symlink d0/d1a/d48/d56/l91 0 2023-12-12T11:52:00.483 INFO:tasks.workunit.client.0.smithi063.stdout:3/475: rename d4/df/d1a/d1c/d34/d54/f8c to d4/df/d1a/d1c/d3b/d50/f97 0 2023-12-12T11:52:00.486 INFO:tasks.workunit.client.0.smithi063.stdout:9/444: symlink d7/d20/d45/d46/l91 0 2023-12-12T11:52:00.494 INFO:tasks.workunit.client.0.smithi063.stdout:5/555: symlink d7/d28/d94/laf 0 2023-12-12T11:52:00.498 INFO:tasks.workunit.client.0.smithi063.stdout:0/529: creat d0/d7/fb1 x:0 0 0 2023-12-12T11:52:00.504 INFO:tasks.workunit.client.0.smithi063.stdout:7/455: dwrite de/d39/d60/f95 [0,4194304] 0 2023-12-12T11:52:00.508 INFO:tasks.workunit.client.0.smithi063.stdout:1/612: symlink d3/db/d16/d24/d48/d75/d83/d5b/d6b/lc7 0 2023-12-12T11:52:00.512 INFO:tasks.workunit.client.1.smithi093.stdout:2/780: dwrite d5/d14/d47/d56/f83 [0,4194304] 0 2023-12-12T11:52:00.515 INFO:tasks.workunit.client.0.smithi063.stdout:4/586: mknod d2/d48/d4f/cba 0 2023-12-12T11:52:00.526 INFO:tasks.workunit.client.0.smithi063.stdout:2/437: unlink d0/f45 0 2023-12-12T11:52:00.528 INFO:tasks.workunit.client.1.smithi093.stdout:1/768: symlink d4/d1a/d1b/d26/d31/ddb/lfd 0 2023-12-12T11:52:00.530 INFO:tasks.workunit.client.0.smithi063.stdout:3/476: mkdir d4/d23/d5d/d98 0 2023-12-12T11:52:00.530 INFO:tasks.workunit.client.0.smithi063.stdout:3/477: chown d4/df/l77 1594736080 1 2023-12-12T11:52:00.532 INFO:tasks.workunit.client.1.smithi093.stdout:5/623: rename d0/d7/d85/ca2 to d0/d7/d36/db9/d66/d7c/db5/dcc/cd6 0 2023-12-12T11:52:00.534 INFO:tasks.workunit.client.0.smithi063.stdout:9/445: link d7/d11/d12/d30/c36 d7/d11/d4b/d75/c92 0 2023-12-12T11:52:00.541 INFO:tasks.workunit.client.0.smithi063.stdout:4/587: dread d2/d8/f49 [0,4194304] 0 2023-12-12T11:52:00.544 INFO:tasks.workunit.client.0.smithi063.stdout:5/556: unlink d7/d10/d2b/fa2 0 2023-12-12T11:52:00.545 INFO:tasks.workunit.client.0.smithi063.stdout:5/557: creat d7/fb0 x:0 0 0 2023-12-12T11:52:00.545 INFO:tasks.workunit.client.0.smithi063.stdout:5/558: rename d7/d10/d2b/d3c/d42 to d7/d10/d2b/d3c/d42/d62/db1 22 2023-12-12T11:52:00.545 INFO:tasks.workunit.client.0.smithi063.stdout:5/559: truncate d7/d10/d2b/d3c/d42/d62/d69/f73 1492090 0 2023-12-12T11:52:00.546 INFO:tasks.workunit.client.0.smithi063.stdout:3/478: dread d4/d23/d6b/d90/f82 [0,4194304] 0 2023-12-12T11:52:00.546 INFO:tasks.workunit.client.0.smithi063.stdout:3/479: dread - d4/df/d1a/d1c/d3b/d50/f8f zero size 2023-12-12T11:52:00.546 INFO:tasks.workunit.client.0.smithi063.stdout:3/480: fsync d4/d23/f24 0 2023-12-12T11:52:00.546 INFO:tasks.workunit.client.0.smithi063.stdout:8/572: dwrite d4/de/d3b/d62/d6e/d76/f7a [4194304,4194304] 0 2023-12-12T11:52:00.546 INFO:tasks.workunit.client.0.smithi063.stdout:3/481: creat d4/df/d1a/d1c/d41/f99 x:0 0 0 2023-12-12T11:52:00.546 INFO:tasks.workunit.client.0.smithi063.stdout:4/588: dread d2/d47/f53 [0,4194304] 0 2023-12-12T11:52:00.547 INFO:tasks.workunit.client.0.smithi063.stdout:0/530: symlink d0/d7/lb2 0 2023-12-12T11:52:00.547 INFO:tasks.workunit.client.0.smithi063.stdout:0/531: truncate d0/d7/d27/d1f/f2c 4809465 0 2023-12-12T11:52:00.547 INFO:tasks.workunit.client.0.smithi063.stdout:0/532: readlink d0/d7/d27/d1f/l57 0 2023-12-12T11:52:00.549 INFO:tasks.workunit.client.0.smithi063.stdout:7/456: dwrite de/d3f/f72 [0,4194304] 0 2023-12-12T11:52:00.550 INFO:tasks.workunit.client.1.smithi093.stdout:0/778: dwrite d5/fa [0,4194304] 0 2023-12-12T11:52:00.550 INFO:tasks.workunit.client.0.smithi063.stdout:6/595: dwrite d9/d68/fc4 [0,4194304] 0 2023-12-12T11:52:00.550 INFO:tasks.workunit.client.0.smithi063.stdout:6/596: chown f4 72 1 2023-12-12T11:52:00.550 INFO:tasks.workunit.client.0.smithi063.stdout:6/597: write d9/d10/d2a/f34 [4948591,63121] 0 2023-12-12T11:52:00.551 INFO:tasks.workunit.client.1.smithi093.stdout:5/624: read d0/d7/d59/d48/f81 [2772927,59535] 0 2023-12-12T11:52:00.551 INFO:tasks.workunit.client.1.smithi093.stdout:5/625: dread - d0/d7/d8/de/fa8 zero size 2023-12-12T11:52:00.552 INFO:tasks.workunit.client.0.smithi063.stdout:1/613: mkdir d3/db/d16/d17/d4b/d8c/dc8 0 2023-12-12T11:52:00.552 INFO:tasks.workunit.client.0.smithi063.stdout:1/614: dread - d3/db/d16/d24/d4d/d35/f5d zero size 2023-12-12T11:52:00.554 INFO:tasks.workunit.client.1.smithi093.stdout:9/744: rmdir d1/d23/d24/d29/d43/d56/d85 39 2023-12-12T11:52:00.555 INFO:tasks.workunit.client.1.smithi093.stdout:7/711: sync 2023-12-12T11:52:00.555 INFO:tasks.workunit.client.1.smithi093.stdout:4/984: sync 2023-12-12T11:52:00.555 INFO:tasks.workunit.client.1.smithi093.stdout:4/985: fsync d0/d36/d40/fb3 0 2023-12-12T11:52:00.555 INFO:tasks.workunit.client.1.smithi093.stdout:7/712: fsync da/de/d46/d4f/f62 0 2023-12-12T11:52:00.555 INFO:tasks.workunit.client.1.smithi093.stdout:9/745: creat d1/d23/d24/d89/fff x:0 0 0 2023-12-12T11:52:00.555 INFO:tasks.workunit.client.1.smithi093.stdout:9/746: chown d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32 140143097 1 2023-12-12T11:52:00.555 INFO:tasks.workunit.client.1.smithi093.stdout:9/747: readlink d1/d23/d24/d29/le0 0 2023-12-12T11:52:00.555 INFO:tasks.workunit.client.0.smithi063.stdout:2/438: truncate d0/d1a/d3a/f46 3802706 0 2023-12-12T11:52:00.556 INFO:tasks.workunit.client.1.smithi093.stdout:6/895: sync 2023-12-12T11:52:00.556 INFO:tasks.workunit.client.1.smithi093.stdout:8/799: sync 2023-12-12T11:52:00.556 INFO:tasks.workunit.client.1.smithi093.stdout:6/896: chown d0/da/l9 116084 1 2023-12-12T11:52:00.556 INFO:tasks.workunit.client.1.smithi093.stdout:6/897: readlink d0/l6 0 2023-12-12T11:52:00.556 INFO:tasks.workunit.client.1.smithi093.stdout:6/898: truncate d0/da/f11a 348240 0 2023-12-12T11:52:00.557 INFO:tasks.workunit.client.0.smithi063.stdout:9/446: link d7/d11/d4b/d75/c7f d7/d20/d45/d46/d51/d64/d6f/d85/c93 0 2023-12-12T11:52:00.557 INFO:tasks.workunit.client.1.smithi093.stdout:7/713: write da/f70 [617041,108770] 0 2023-12-12T11:52:00.558 INFO:tasks.workunit.client.1.smithi093.stdout:3/752: symlink df/d22/d49/d69/d78/daf/d3d/d42/d9d/lf3 0 2023-12-12T11:52:00.558 INFO:tasks.workunit.client.1.smithi093.stdout:3/753: write df/d25/ff0 [403318,529] 0 2023-12-12T11:52:00.563 INFO:tasks.workunit.client.0.smithi063.stdout:5/560: rename d7/d10/c11 to d7/d28/d43/cb2 0 2023-12-12T11:52:00.571 INFO:tasks.workunit.client.1.smithi093.stdout:4/986: write d0/fd0 [1949767,54737] 0 2023-12-12T11:52:00.575 INFO:tasks.workunit.client.1.smithi093.stdout:1/769: rename d4/d1a/d1b/f3a to d4/d81/dfc/ffe 0 2023-12-12T11:52:00.583 INFO:tasks.workunit.client.0.smithi063.stdout:8/573: mkdir d4/d24/db3 0 2023-12-12T11:52:00.585 INFO:tasks.workunit.client.1.smithi093.stdout:0/779: mknod d5/dd/d14/d26/d58/d64/d6f/cf1 0 2023-12-12T11:52:00.588 INFO:tasks.workunit.client.0.smithi063.stdout:4/589: creat d2/d8/fbb x:0 0 0 2023-12-12T11:52:00.589 INFO:tasks.workunit.client.0.smithi063.stdout:4/590: creat d2/d17/d9d/fbc x:0 0 0 2023-12-12T11:52:00.590 INFO:tasks.workunit.client.1.smithi093.stdout:5/626: creat d0/fd7 x:0 0 0 2023-12-12T11:52:00.597 INFO:tasks.workunit.client.1.smithi093.stdout:8/800: dread d3/f1c [0,4194304] 0 2023-12-12T11:52:00.600 INFO:tasks.workunit.client.1.smithi093.stdout:8/801: creat d3/d8/d88/f10a x:0 0 0 2023-12-12T11:52:00.602 INFO:tasks.workunit.client.1.smithi093.stdout:6/899: stat d0/da/d32/dd3/lb9 0 2023-12-12T11:52:00.605 INFO:tasks.workunit.client.1.smithi093.stdout:3/754: mknod df/d22/d49/d69/d78/daf/d3d/d59/d9c/cf4 0 2023-12-12T11:52:00.606 INFO:tasks.workunit.client.0.smithi063.stdout:7/457: link de/d33/d71/l9e de/d39/d60/d97/la5 0 2023-12-12T11:52:00.611 INFO:tasks.workunit.client.1.smithi093.stdout:4/987: rename d0/d31/db8/d123/d79/d7f/le8 to d0/d36/d128/l131 0 2023-12-12T11:52:00.614 INFO:tasks.workunit.client.0.smithi063.stdout:2/439: dread d0/d1a/d3a/f46 [0,4194304] 0 2023-12-12T11:52:00.614 INFO:tasks.workunit.client.0.smithi063.stdout:0/533: dwrite d0/d1a/d23/d34/f52 [0,4194304] 0 2023-12-12T11:52:00.614 INFO:tasks.workunit.client.0.smithi063.stdout:0/534: fdatasync d0/d7/d27/f33 0 2023-12-12T11:52:00.615 INFO:tasks.workunit.client.0.smithi063.stdout:9/447: mkdir d7/d11/d94 0 2023-12-12T11:52:00.616 INFO:tasks.workunit.client.0.smithi063.stdout:9/448: readlink d7/d20/l3b 0 2023-12-12T11:52:00.616 INFO:tasks.workunit.client.0.smithi063.stdout:9/449: chown d7/d11/f4c 18 1 2023-12-12T11:52:00.619 INFO:tasks.workunit.client.0.smithi063.stdout:1/615: rename d3/db/d16/d24/d4d/d35/l76 to d3/db/d16/lc9 0 2023-12-12T11:52:00.620 INFO:tasks.workunit.client.0.smithi063.stdout:1/616: write d3/db/fd [706117,36903] 0 2023-12-12T11:52:00.628 INFO:tasks.workunit.client.1.smithi093.stdout:7/714: dwrite da/de/d46/d4f/f62 [0,4194304] 0 2023-12-12T11:52:00.632 INFO:tasks.workunit.client.1.smithi093.stdout:1/770: mknod d4/d1a/d83/d92/cff 0 2023-12-12T11:52:00.632 INFO:tasks.workunit.client.1.smithi093.stdout:1/771: fdatasync d4/d1a/d73/f60 0 2023-12-12T11:52:00.632 INFO:tasks.workunit.client.1.smithi093.stdout:1/772: creat d4/d85/f100 x:0 0 0 2023-12-12T11:52:00.633 INFO:tasks.workunit.client.1.smithi093.stdout:9/748: getdents d1/d23 0 2023-12-12T11:52:00.633 INFO:tasks.workunit.client.1.smithi093.stdout:3/755: link df/d22/d49/d69/d78/daf/d3d/d59/d9c/f9f df/d30/d33/ff5 0 2023-12-12T11:52:00.633 INFO:tasks.workunit.client.1.smithi093.stdout:9/749: dread - d1/d23/fb3 zero size 2023-12-12T11:52:00.634 INFO:tasks.workunit.client.1.smithi093.stdout:5/627: rename d0/d7/d36/d87/c91 to d0/cd8 0 2023-12-12T11:52:00.634 INFO:tasks.workunit.client.1.smithi093.stdout:5/628: truncate d0/fd7 471705 0 2023-12-12T11:52:00.636 INFO:tasks.workunit.client.1.smithi093.stdout:0/780: truncate d5/dd/d14/d26/f6e 3659242 0 2023-12-12T11:52:00.636 INFO:tasks.workunit.client.1.smithi093.stdout:0/781: read - d5/d21/d27/fd7 zero size 2023-12-12T11:52:00.636 INFO:tasks.workunit.client.1.smithi093.stdout:0/782: chown d5/db2/dd2 33 1 2023-12-12T11:52:00.636 INFO:tasks.workunit.client.1.smithi093.stdout:0/783: write d5/d21/d2f/d54/f73 [2392052,101390] 0 2023-12-12T11:52:00.638 INFO:tasks.workunit.client.0.smithi063.stdout:3/482: rmdir d4/df 39 2023-12-12T11:52:00.638 INFO:tasks.workunit.client.0.smithi063.stdout:3/483: fdatasync d4/df/d1a/d1c/d34/f85 0 2023-12-12T11:52:00.638 INFO:tasks.workunit.client.0.smithi063.stdout:3/484: fdatasync d4/df/d1a/d1c/d57/f8a 0 2023-12-12T11:52:00.638 INFO:tasks.workunit.client.0.smithi063.stdout:3/485: write d4/d23/d5d/f89 [1237256,108433] 0 2023-12-12T11:52:00.638 INFO:tasks.workunit.client.0.smithi063.stdout:3/486: write d4/df/d1a/d1c/d3b/d50/f5a [3290800,60308] 0 2023-12-12T11:52:00.645 INFO:tasks.workunit.client.1.smithi093.stdout:7/715: rmdir da/d2e/d89 39 2023-12-12T11:52:00.646 INFO:tasks.workunit.client.0.smithi063.stdout:6/598: dwrite d9/fb [0,4194304] 0 2023-12-12T11:52:00.650 INFO:tasks.workunit.client.1.smithi093.stdout:5/629: mknod d0/cd9 0 2023-12-12T11:52:00.650 INFO:tasks.workunit.client.1.smithi093.stdout:5/630: dread - d0/d7/d36/db9/d66/d7c/fd3 zero size 2023-12-12T11:52:00.650 INFO:tasks.workunit.client.1.smithi093.stdout:5/631: read - d0/d7/d36/d29/d44/f94 zero size 2023-12-12T11:52:00.653 INFO:tasks.workunit.client.0.smithi063.stdout:8/574: creat d4/de/fb4 x:0 0 0 2023-12-12T11:52:00.654 INFO:tasks.workunit.client.0.smithi063.stdout:7/458: symlink de/d22/d2b/d61/la6 0 2023-12-12T11:52:00.654 INFO:tasks.workunit.client.0.smithi063.stdout:4/591: mkdir d2/d47/d6d/d88/dbd 0 2023-12-12T11:52:00.661 INFO:tasks.workunit.client.1.smithi093.stdout:1/773: rename d4/l5 to d4/d1c/l101 0 2023-12-12T11:52:00.662 INFO:tasks.workunit.client.1.smithi093.stdout:1/774: creat d4/d1a/d1b/d26/d31/f102 x:0 0 0 2023-12-12T11:52:00.662 INFO:tasks.workunit.client.0.smithi063.stdout:2/440: rename d0/l18 to d0/d1a/d3a/d59/l92 0 2023-12-12T11:52:00.662 INFO:tasks.workunit.client.0.smithi063.stdout:2/441: dread - d0/d1a/d26/f8f zero size 2023-12-12T11:52:00.662 INFO:tasks.workunit.client.0.smithi063.stdout:2/442: creat d0/d1a/d3a/d59/f93 x:0 0 0 2023-12-12T11:52:00.664 INFO:tasks.workunit.client.1.smithi093.stdout:0/784: mkdir d5/d41/d77/d79/df2 0 2023-12-12T11:52:00.664 INFO:tasks.workunit.client.0.smithi063.stdout:6/599: dread d9/d10/f96 [0,4194304] 0 2023-12-12T11:52:00.665 INFO:tasks.workunit.client.0.smithi063.stdout:6/600: write d9/fba [198630,104144] 0 2023-12-12T11:52:00.666 INFO:tasks.workunit.client.0.smithi063.stdout:3/487: readlink d4/df/d1a/d1c/l1f 0 2023-12-12T11:52:00.666 INFO:tasks.workunit.client.0.smithi063.stdout:3/488: write d4/df/d1a/d1c/f29 [5360793,48135] 0 2023-12-12T11:52:00.667 INFO:tasks.workunit.client.1.smithi093.stdout:7/716: dread da/de/d46/d4f/f64 [0,4194304] 0 2023-12-12T11:52:00.675 INFO:tasks.workunit.client.0.smithi063.stdout:5/561: dwrite d7/d10/f48 [0,4194304] 0 2023-12-12T11:52:00.675 INFO:tasks.workunit.client.0.smithi063.stdout:5/562: chown d7/d10/d2b/d3c/d42 13764059 1 2023-12-12T11:52:00.675 INFO:tasks.workunit.client.1.smithi093.stdout:8/802: dwrite d3/d8/fe4 [0,4194304] 0 2023-12-12T11:52:00.675 INFO:tasks.workunit.client.1.smithi093.stdout:5/632: unlink d0/d7/d85/fb2 0 2023-12-12T11:52:00.675 INFO:tasks.workunit.client.1.smithi093.stdout:1/775: mkdir d4/d1a/d83/d9a/de7/d103 0 2023-12-12T11:52:00.678 INFO:tasks.workunit.client.1.smithi093.stdout:7/717: creat da/d15/d19/d90/d7d/dd1/ff3 x:0 0 0 2023-12-12T11:52:00.678 INFO:tasks.workunit.client.0.smithi063.stdout:2/443: truncate d0/f6 6714435 0 2023-12-12T11:52:00.678 INFO:tasks.workunit.client.0.smithi063.stdout:2/444: write d0/d1a/d48/f30 [2722747,60769] 0 2023-12-12T11:52:00.681 INFO:tasks.workunit.client.0.smithi063.stdout:0/535: rename d0/d7/fb1 to d0/d1a/d23/fb3 0 2023-12-12T11:52:00.684 INFO:tasks.workunit.client.0.smithi063.stdout:9/450: rename d7/d20/d45/d46 to d7/d20/d45/d46/d51/d95 22 2023-12-12T11:52:00.686 INFO:tasks.workunit.client.1.smithi093.stdout:1/776: getdents d4/d1a 0 2023-12-12T11:52:00.690 INFO:tasks.workunit.client.0.smithi063.stdout:6/601: symlink d9/d10/ld0 0 2023-12-12T11:52:00.691 INFO:tasks.workunit.client.1.smithi093.stdout:6/900: dwrite d0/da/d14/d21/f120 [0,4194304] 0 2023-12-12T11:52:00.691 INFO:tasks.workunit.client.1.smithi093.stdout:6/901: fdatasync d0/da/d32/d9e/d4d/f8f 0 2023-12-12T11:52:00.694 INFO:tasks.workunit.client.0.smithi063.stdout:1/617: dwrite d3/db/d16/d24/d48/f8f [0,4194304] 0 2023-12-12T11:52:00.694 INFO:tasks.workunit.client.0.smithi063.stdout:1/618: dread - d3/db/d16/d24/d48/d75/d83/d5b/d6b/f85 zero size 2023-12-12T11:52:00.696 INFO:tasks.workunit.client.1.smithi093.stdout:3/756: dwrite df/d22/d49/d69/d78/daf/f70 [4194304,4194304] 0 2023-12-12T11:52:00.700 INFO:tasks.workunit.client.0.smithi063.stdout:3/489: symlink d4/df/d1a/d1c/d57/l9a 0 2023-12-12T11:52:00.700 INFO:tasks.workunit.client.1.smithi093.stdout:7/718: rename da/de/d78/c84 to da/d8e/daa/cf4 0 2023-12-12T11:52:00.706 INFO:tasks.workunit.client.0.smithi063.stdout:0/536: dread d0/d1a/d23/f7b [0,4194304] 0 2023-12-12T11:52:00.706 INFO:tasks.workunit.client.0.smithi063.stdout:0/537: chown d0/d1a/d23/c9d 35264186 1 2023-12-12T11:52:00.712 INFO:tasks.workunit.client.0.smithi063.stdout:6/602: write d9/f24 [7734199,37952] 0 2023-12-12T11:52:00.712 INFO:tasks.workunit.client.0.smithi063.stdout:6/603: dread - d9/d68/f9d zero size 2023-12-12T11:52:00.715 INFO:tasks.workunit.client.0.smithi063.stdout:5/563: dwrite d7/d10/d2b/d3c/f36 [0,4194304] 0 2023-12-12T11:52:00.715 INFO:tasks.workunit.client.0.smithi063.stdout:5/564: stat d7/d28 0 2023-12-12T11:52:00.715 INFO:tasks.workunit.client.0.smithi063.stdout:5/565: dread - d7/d10/d2b/d3c/d42/f96 zero size 2023-12-12T11:52:00.715 INFO:tasks.workunit.client.0.smithi063.stdout:5/566: chown d7/d28/d43/d49/l57 2487613 1 2023-12-12T11:52:00.715 INFO:tasks.workunit.client.0.smithi063.stdout:5/567: chown d7/d28/d6e/dad 2 1 2023-12-12T11:52:00.715 INFO:tasks.workunit.client.0.smithi063.stdout:5/568: truncate d7/d28/d67/f90 1100427 0 2023-12-12T11:52:00.716 INFO:tasks.workunit.client.1.smithi093.stdout:1/777: mkdir d4/d1a/d1b/d26/d65/dc8/d104 0 2023-12-12T11:52:00.716 INFO:tasks.workunit.client.1.smithi093.stdout:1/778: readlink d4/d1a/d1b/d26/d31/ddb/lfd 0 2023-12-12T11:52:00.717 INFO:tasks.workunit.client.0.smithi063.stdout:4/592: write d2/d8/f12 [1270342,59834] 0 2023-12-12T11:52:00.718 INFO:tasks.workunit.client.0.smithi063.stdout:7/459: rename f8 to de/d22/d66/fa7 0 2023-12-12T11:52:00.719 INFO:tasks.workunit.client.1.smithi093.stdout:4/988: dwrite d0/d36/d49/f81 [0,4194304] 0 2023-12-12T11:52:00.719 INFO:tasks.workunit.client.1.smithi093.stdout:4/989: chown d0/l1e 1267155 1 2023-12-12T11:52:00.719 INFO:tasks.workunit.client.1.smithi093.stdout:4/990: write d0/d31/db8/d123/d79/d86/f8a [5022945,11517] 0 2023-12-12T11:52:00.721 INFO:tasks.workunit.client.1.smithi093.stdout:6/902: link d0/d52/d13b/caa d0/da/d14/d38/d43/d10e/c13c 0 2023-12-12T11:52:00.722 INFO:tasks.workunit.client.0.smithi063.stdout:9/451: stat d7/d11/d12/d30/d3e/c5a 0 2023-12-12T11:52:00.726 INFO:tasks.workunit.client.0.smithi063.stdout:4/593: dread d2/d17/d41/f5b [0,4194304] 0 2023-12-12T11:52:00.732 INFO:tasks.workunit.client.1.smithi093.stdout:3/757: truncate df/d22/d49/d69/d78/daf/f41 1197915 0 2023-12-12T11:52:00.733 INFO:tasks.workunit.client.1.smithi093.stdout:3/758: write df/d22/d49/d69/d78/daf/d3d/d6f/fd5 [713117,4326] 0 2023-12-12T11:52:00.733 INFO:tasks.workunit.client.1.smithi093.stdout:7/719: mknod da/d8e/dbc/cf5 0 2023-12-12T11:52:00.737 INFO:tasks.workunit.client.1.smithi093.stdout:1/779: symlink d4/d1a/d1b/dbf/l105 0 2023-12-12T11:52:00.743 INFO:tasks.workunit.client.1.smithi093.stdout:0/785: dwrite d5/d21/d2f/d54/d7e/db4/fd6 [0,4194304] 0 2023-12-12T11:52:00.743 INFO:tasks.workunit.client.1.smithi093.stdout:0/786: stat d5/d41/d77/d79/fbe 0 2023-12-12T11:52:00.747 INFO:tasks.workunit.client.1.smithi093.stdout:8/803: dwrite d3/d1a/d1f/d59/fcd [0,4194304] 0 2023-12-12T11:52:00.751 INFO:tasks.workunit.client.0.smithi063.stdout:1/619: getdents d3/db/d16/d24/d48 0 2023-12-12T11:52:00.751 INFO:tasks.workunit.client.0.smithi063.stdout:1/620: fdatasync d3/db/d16/d17/d4b/fa6 0 2023-12-12T11:52:00.751 INFO:tasks.workunit.client.0.smithi063.stdout:1/621: write d3/d3a/fa3 [797669,101354] 0 2023-12-12T11:52:00.751 INFO:tasks.workunit.client.0.smithi063.stdout:1/622: fdatasync d3/d3a/d5e/f87 0 2023-12-12T11:52:00.751 INFO:tasks.workunit.client.0.smithi063.stdout:1/623: write d3/db/d16/d24/d4d/fc4 [160599,68082] 0 2023-12-12T11:52:00.759 INFO:tasks.workunit.client.0.smithi063.stdout:2/445: dread d0/f6 [0,4194304] 0 2023-12-12T11:52:00.767 INFO:tasks.workunit.client.0.smithi063.stdout:0/538: creat d0/d7/d27/d19/d2d/fb4 x:0 0 0 2023-12-12T11:52:00.774 INFO:tasks.workunit.client.0.smithi063.stdout:6/604: unlink d9/f24 0 2023-12-12T11:52:00.776 INFO:tasks.workunit.client.1.smithi093.stdout:6/903: creat d0/da/d14/d3a/d95/d11f/f13d x:0 0 0 2023-12-12T11:52:00.776 INFO:tasks.workunit.client.1.smithi093.stdout:6/904: creat d0/d52/d7e/d42/dd5/f13e x:0 0 0 2023-12-12T11:52:00.776 INFO:tasks.workunit.client.1.smithi093.stdout:6/905: chown d0/da/d32/dd3/fcc 2679983 1 2023-12-12T11:52:00.777 INFO:tasks.workunit.client.1.smithi093.stdout:5/633: dwrite d0/d7/d59/d48/f5f [0,4194304] 0 2023-12-12T11:52:00.777 INFO:tasks.workunit.client.0.smithi063.stdout:5/569: symlink d7/d28/lb3 0 2023-12-12T11:52:00.777 INFO:tasks.workunit.client.0.smithi063.stdout:5/570: write d7/d28/d67/f90 [1831569,120250] 0 2023-12-12T11:52:00.782 INFO:tasks.workunit.client.1.smithi093.stdout:7/720: unlink da/de/f4d 0 2023-12-12T11:52:00.782 INFO:tasks.workunit.client.0.smithi063.stdout:9/452: dwrite d7/d11/f53 [0,4194304] 0 2023-12-12T11:52:00.783 INFO:tasks.workunit.client.1.smithi093.stdout:1/780: dwrite d4/d1a/f6b [0,4194304] 0 2023-12-12T11:52:00.785 INFO:tasks.workunit.client.1.smithi093.stdout:2/781: sync 2023-12-12T11:52:00.786 INFO:tasks.workunit.client.0.smithi063.stdout:7/460: link l3 de/d33/d41/la8 0 2023-12-12T11:52:00.786 INFO:tasks.workunit.client.0.smithi063.stdout:2/446: mknod d0/d1a/d3a/d59/c94 0 2023-12-12T11:52:00.789 INFO:tasks.workunit.client.1.smithi093.stdout:8/804: mknod d3/d1a/d1f/d59/c10b 0 2023-12-12T11:52:00.789 INFO:tasks.workunit.client.1.smithi093.stdout:8/805: readlink d3/d8/l2d 0 2023-12-12T11:52:00.791 INFO:tasks.workunit.client.1.smithi093.stdout:7/721: dread f0 [0,4194304] 0 2023-12-12T11:52:00.791 INFO:tasks.workunit.client.0.smithi063.stdout:9/453: dread d7/d20/d3f/d40/d4e/f67 [0,4194304] 0 2023-12-12T11:52:00.793 INFO:tasks.workunit.client.0.smithi063.stdout:3/490: unlink d4/c18 0 2023-12-12T11:52:00.795 INFO:tasks.workunit.client.1.smithi093.stdout:4/991: rmdir d0/d31/db8/d123 39 2023-12-12T11:52:00.797 INFO:tasks.workunit.client.1.smithi093.stdout:5/634: dread d0/d7/d59/f2d [0,4194304] 0 2023-12-12T11:52:00.798 INFO:tasks.workunit.client.0.smithi063.stdout:0/539: unlink d0/d7/d27/d1f/l57 0 2023-12-12T11:52:00.800 INFO:tasks.workunit.client.0.smithi063.stdout:6/605: mknod d9/d10/d5c/dce/d86/dc2/cd1 0 2023-12-12T11:52:00.801 INFO:tasks.workunit.client.1.smithi093.stdout:2/782: dread d5/d14/d2d/d12/d25/f2a [0,4194304] 0 2023-12-12T11:52:00.808 INFO:tasks.workunit.client.1.smithi093.stdout:6/906: rmdir d0/da/d14/d3a/d95 39 2023-12-12T11:52:00.808 INFO:tasks.workunit.client.1.smithi093.stdout:0/787: mkdir d5/dd/d14/d26/d58/d64/d7c/df3 0 2023-12-12T11:52:00.809 INFO:tasks.workunit.client.1.smithi093.stdout:8/806: symlink d3/d1a/d1f/d29/d30/l10c 0 2023-12-12T11:52:00.811 INFO:tasks.workunit.client.1.smithi093.stdout:4/992: creat d0/f132 x:0 0 0 2023-12-12T11:52:00.813 INFO:tasks.workunit.client.0.smithi063.stdout:6/606: dread d9/d10/f8c [0,4194304] 0 2023-12-12T11:52:00.814 INFO:tasks.workunit.client.0.smithi063.stdout:6/607: write d9/fc6 [271124,95200] 0 2023-12-12T11:52:00.816 INFO:tasks.workunit.client.1.smithi093.stdout:5/635: unlink d0/d7/d36/l5b 0 2023-12-12T11:52:00.816 INFO:tasks.workunit.client.1.smithi093.stdout:1/781: dwrite d4/fd6 [0,4194304] 0 2023-12-12T11:52:00.818 INFO:tasks.workunit.client.1.smithi093.stdout:2/783: creat d5/d14/d2d/d4c/d76/f109 x:0 0 0 2023-12-12T11:52:00.818 INFO:tasks.workunit.client.1.smithi093.stdout:2/784: chown d5/d14/d2d/d12/de9 47375 1 2023-12-12T11:52:00.818 INFO:tasks.workunit.client.1.smithi093.stdout:2/785: readlink l4 0 2023-12-12T11:52:00.818 INFO:tasks.workunit.client.1.smithi093.stdout:2/786: chown d5/d14/d47/d56/d6f/d73/fc0 29979275 1 2023-12-12T11:52:00.823 INFO:tasks.workunit.client.1.smithi093.stdout:6/907: rename d0/d52/d13b/ff4 to d0/d52/d7e/d42/dd5/ddc/d12a/f13f 0 2023-12-12T11:52:00.825 INFO:tasks.workunit.client.1.smithi093.stdout:0/788: mknod d5/d78/da4/cf4 0 2023-12-12T11:52:00.828 INFO:tasks.workunit.client.1.smithi093.stdout:4/993: dread d0/d31/db8/d123/fc6 [0,4194304] 0 2023-12-12T11:52:00.828 INFO:tasks.workunit.client.1.smithi093.stdout:8/807: creat d3/d1a/d1f/d75/de3/f10d x:0 0 0 2023-12-12T11:52:00.829 INFO:tasks.workunit.client.1.smithi093.stdout:9/750: sync 2023-12-12T11:52:00.834 INFO:tasks.workunit.client.0.smithi063.stdout:6/608: write d9/fd [101514,73519] 0 2023-12-12T11:52:00.834 INFO:tasks.workunit.client.0.smithi063.stdout:6/609: dread - d9/d68/f9d zero size 2023-12-12T11:52:00.834 INFO:tasks.workunit.client.0.smithi063.stdout:6/610: truncate d9/d68/d94/faf 483532 0 2023-12-12T11:52:00.837 INFO:tasks.workunit.client.0.smithi063.stdout:4/594: rmdir d2/d17/d81 39 2023-12-12T11:52:00.839 INFO:tasks.workunit.client.0.smithi063.stdout:7/461: symlink de/d34/d68/la9 0 2023-12-12T11:52:00.844 INFO:tasks.workunit.client.1.smithi093.stdout:5/636: link d0/d7/d59/d48/fb4 d0/dd2/fda 0 2023-12-12T11:52:00.845 INFO:tasks.workunit.client.1.smithi093.stdout:0/789: creat d5/d21/d27/d3a/ff5 x:0 0 0 2023-12-12T11:52:00.845 INFO:tasks.workunit.client.1.smithi093.stdout:0/790: readlink d5/dd/d14/d26/l2c 0 2023-12-12T11:52:00.846 INFO:tasks.workunit.client.1.smithi093.stdout:2/787: rmdir d5/d14/d2d/d12/d25/d7a/d7e/d98 0 2023-12-12T11:52:00.846 INFO:tasks.workunit.client.0.smithi063.stdout:3/491: getdents d4/df/d1a/d1c/d41 0 2023-12-12T11:52:00.846 INFO:tasks.workunit.client.0.smithi063.stdout:7/462: write de/f21 [1230644,18061] 0 2023-12-12T11:52:00.846 INFO:tasks.workunit.client.0.smithi063.stdout:3/492: write d4/d23/d6b/f95 [399813,109084] 0 2023-12-12T11:52:00.848 INFO:tasks.workunit.client.1.smithi093.stdout:8/808: symlink d3/d1a/d1f/d29/d3a/d68/l10e 0 2023-12-12T11:52:00.850 INFO:tasks.workunit.client.1.smithi093.stdout:1/782: dread d4/d1a/d1b/d26/f7d [0,4194304] 0 2023-12-12T11:52:00.850 INFO:tasks.workunit.client.0.smithi063.stdout:0/540: mknod d0/d8e/cb5 0 2023-12-12T11:52:00.851 INFO:tasks.workunit.client.1.smithi093.stdout:9/751: symlink d1/d23/d24/d29/da3/l100 0 2023-12-12T11:52:00.852 INFO:tasks.workunit.client.1.smithi093.stdout:9/752: chown d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/d42/la4 109 1 2023-12-12T11:52:00.852 INFO:tasks.workunit.client.0.smithi063.stdout:5/571: getdents d7/d10/d2b/d3c/d42 0 2023-12-12T11:52:00.857 INFO:tasks.workunit.client.0.smithi063.stdout:3/493: dread d4/df/d1a/d1c/f29 [4194304,4194304] 0 2023-12-12T11:52:00.863 INFO:tasks.workunit.client.1.smithi093.stdout:0/791: rename d5/d78/c91 to d5/d41/d77/d79/d9b/cf6 0 2023-12-12T11:52:00.865 INFO:tasks.workunit.client.1.smithi093.stdout:5/637: dread d0/d7/d8/d9e/d6a/fb3 [0,4194304] 0 2023-12-12T11:52:00.866 INFO:tasks.workunit.client.1.smithi093.stdout:2/788: mknod d5/d31/d86/c10a 0 2023-12-12T11:52:00.867 INFO:tasks.workunit.client.1.smithi093.stdout:8/809: mknod d3/d1a/d1f/d59/ddb/c10f 0 2023-12-12T11:52:00.868 INFO:tasks.workunit.client.1.smithi093.stdout:7/722: dwrite da/de/f53 [0,4194304] 0 2023-12-12T11:52:00.869 INFO:tasks.workunit.client.0.smithi063.stdout:2/447: getdents d0/d69 0 2023-12-12T11:52:00.869 INFO:tasks.workunit.client.0.smithi063.stdout:2/448: write d0/d69/f8c [299084,86676] 0 2023-12-12T11:52:00.873 INFO:tasks.workunit.client.1.smithi093.stdout:8/810: write d3/d73/fd9 [740214,90606] 0 2023-12-12T11:52:00.875 INFO:tasks.workunit.client.1.smithi093.stdout:1/783: symlink d4/d1a/d1b/l106 0 2023-12-12T11:52:00.875 INFO:tasks.workunit.client.1.smithi093.stdout:1/784: read d4/d1c/f6d [282519,29631] 0 2023-12-12T11:52:00.875 INFO:tasks.workunit.client.1.smithi093.stdout:1/785: creat d4/d81/f107 x:0 0 0 2023-12-12T11:52:00.877 INFO:tasks.workunit.client.1.smithi093.stdout:9/753: truncate d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/f6a 129224 0 2023-12-12T11:52:00.877 INFO:tasks.workunit.client.1.smithi093.stdout:9/754: fdatasync d1/d23/d24/fa1 0 2023-12-12T11:52:00.878 INFO:tasks.workunit.client.0.smithi063.stdout:9/454: getdents d7/d20/d3f/d40/d4e 0 2023-12-12T11:52:00.879 INFO:tasks.workunit.client.1.smithi093.stdout:5/638: readlink d0/d7/d36/db9/lb6 0 2023-12-12T11:52:00.886 INFO:tasks.workunit.client.0.smithi063.stdout:7/463: creat de/d22/faa x:0 0 0 2023-12-12T11:52:00.886 INFO:tasks.workunit.client.0.smithi063.stdout:5/572: mkdir d7/d10/d2b/d3c/d42/d62/db4 0 2023-12-12T11:52:00.887 INFO:tasks.workunit.client.0.smithi063.stdout:5/573: stat d7/d28/d6e/f8b 0 2023-12-12T11:52:00.888 INFO:tasks.workunit.client.0.smithi063.stdout:3/494: mknod d4/d23/d5d/d4c/d56/d79/c9b 0 2023-12-12T11:52:00.888 INFO:tasks.workunit.client.0.smithi063.stdout:2/449: creat d0/d41/d90/f95 x:0 0 0 2023-12-12T11:52:00.889 INFO:tasks.workunit.client.0.smithi063.stdout:2/450: chown d0/d1a/d26 60853127 1 2023-12-12T11:52:00.889 INFO:tasks.workunit.client.0.smithi063.stdout:2/451: write d0/f15 [679588,19217] 0 2023-12-12T11:52:00.889 INFO:tasks.workunit.client.0.smithi063.stdout:2/452: write d0/d1a/d48/f34 [3714576,9171] 0 2023-12-12T11:52:00.889 INFO:tasks.workunit.client.0.smithi063.stdout:6/611: getdents d9 0 2023-12-12T11:52:00.891 INFO:tasks.workunit.client.1.smithi093.stdout:4/994: dwrite d0/f1f [0,4194304] 0 2023-12-12T11:52:00.895 INFO:tasks.workunit.client.1.smithi093.stdout:2/789: read d5/d14/d2d/d12/d25/f33 [3287938,117614] 0 2023-12-12T11:52:00.895 INFO:tasks.workunit.client.1.smithi093.stdout:7/723: creat da/d15/d59/df0/ff6 x:0 0 0 2023-12-12T11:52:00.895 INFO:tasks.workunit.client.1.smithi093.stdout:1/786: rename d4/lcc to d4/d1a/d1b/dbf/l108 0 2023-12-12T11:52:00.895 INFO:tasks.workunit.client.1.smithi093.stdout:1/787: creat d4/d1a/d83/d92/f109 x:0 0 0 2023-12-12T11:52:00.895 INFO:tasks.workunit.client.1.smithi093.stdout:6/908: dwrite d0/d52/d7e/d42/dd5/fda [0,4194304] 0 2023-12-12T11:52:00.896 INFO:tasks.workunit.client.0.smithi063.stdout:0/541: getdents d0/d7/d27/d19/d2d 0 2023-12-12T11:52:00.896 INFO:tasks.workunit.client.1.smithi093.stdout:9/755: symlink d1/d23/d6b/l101 0 2023-12-12T11:52:00.898 INFO:tasks.workunit.client.0.smithi063.stdout:5/574: symlink d7/d28/d67/lb5 0 2023-12-12T11:52:00.898 INFO:tasks.workunit.client.0.smithi063.stdout:5/575: stat d7/d28/d43/d49/l57 0 2023-12-12T11:52:00.898 INFO:tasks.workunit.client.0.smithi063.stdout:5/576: write d7/d10/d2b/f58 [4627731,51224] 0 2023-12-12T11:52:00.898 INFO:tasks.workunit.client.0.smithi063.stdout:5/577: creat d7/d10/d2b/fb6 x:0 0 0 2023-12-12T11:52:00.902 INFO:tasks.workunit.client.1.smithi093.stdout:1/788: write d4/d1c/d2a/f6e [81072,87800] 0 2023-12-12T11:52:00.904 INFO:tasks.workunit.client.0.smithi063.stdout:4/595: dwrite d2/d8/f12 [0,4194304] 0 2023-12-12T11:52:00.911 INFO:tasks.workunit.client.1.smithi093.stdout:5/639: link d0/d7/d36/d68/f7a d0/d7/d85/da0/fdb 0 2023-12-12T11:52:00.914 INFO:tasks.workunit.client.0.smithi063.stdout:7/464: read de/d22/d2b/d61/f86 [574774,126364] 0 2023-12-12T11:52:00.914 INFO:tasks.workunit.client.1.smithi093.stdout:4/995: symlink d0/d36/d121/l133 0 2023-12-12T11:52:00.916 INFO:tasks.workunit.client.1.smithi093.stdout:0/792: dread d5/dd/d33/f46 [0,4194304] 0 2023-12-12T11:52:00.917 INFO:tasks.workunit.client.1.smithi093.stdout:2/790: getdents d5/d14/d2d/d12/d25 0 2023-12-12T11:52:00.919 INFO:tasks.workunit.client.1.smithi093.stdout:8/811: dwrite d3/d1a/d1f/d29/d30/fd2 [0,4194304] 0 2023-12-12T11:52:00.920 INFO:tasks.workunit.client.1.smithi093.stdout:8/812: chown d3/d8/fe4 101804 1 2023-12-12T11:52:00.920 INFO:tasks.workunit.client.1.smithi093.stdout:8/813: chown d3/d1a/d1f/d75/de3/f102 52023 1 2023-12-12T11:52:00.920 INFO:tasks.workunit.client.1.smithi093.stdout:8/814: write d3/d8/d88/f10a [471558,76551] 0 2023-12-12T11:52:00.921 INFO:tasks.workunit.client.0.smithi063.stdout:2/453: link d0/f4c d0/d1a/d3a/d59/f96 0 2023-12-12T11:52:00.924 INFO:tasks.workunit.client.1.smithi093.stdout:7/724: creat da/d15/d19/d90/ff7 x:0 0 0 2023-12-12T11:52:00.925 INFO:tasks.workunit.client.0.smithi063.stdout:6/612: creat d9/d68/d8f/fd2 x:0 0 0 2023-12-12T11:52:00.938 INFO:tasks.workunit.client.0.smithi063.stdout:0/542: rename d0/d1a/d23/d34/f52 to d0/d1a/d23/d2e/fb6 0 2023-12-12T11:52:00.945 INFO:tasks.workunit.client.1.smithi093.stdout:3/759: sync 2023-12-12T11:52:00.947 INFO:tasks.workunit.client.1.smithi093.stdout:6/909: creat d0/d52/f140 x:0 0 0 2023-12-12T11:52:00.952 INFO:tasks.workunit.client.1.smithi093.stdout:9/756: symlink d1/d23/d6b/d92/db2/dcd/l102 0 2023-12-12T11:52:00.957 INFO:tasks.workunit.client.0.smithi063.stdout:4/596: symlink d2/lbe 0 2023-12-12T11:52:00.957 INFO:tasks.workunit.client.0.smithi063.stdout:4/597: stat d2/d17/d7f/l96 0 2023-12-12T11:52:00.963 INFO:tasks.workunit.client.0.smithi063.stdout:9/455: dwrite d7/d15/f63 [0,4194304] 0 2023-12-12T11:52:00.966 INFO:tasks.workunit.client.1.smithi093.stdout:2/791: mkdir d5/d14/d47/da7/d10b 0 2023-12-12T11:52:00.966 INFO:tasks.workunit.client.1.smithi093.stdout:4/996: truncate d0/f17 1458474 0 2023-12-12T11:52:00.970 INFO:tasks.workunit.client.1.smithi093.stdout:7/725: creat da/d8e/dbc/ff8 x:0 0 0 2023-12-12T11:52:00.970 INFO:tasks.workunit.client.1.smithi093.stdout:7/726: stat da/d15/d19/d4c/d6d/l9a 0 2023-12-12T11:52:00.971 INFO:tasks.workunit.client.1.smithi093.stdout:7/727: write f0 [4653781,111187] 0 2023-12-12T11:52:00.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:00 smithi093 ceph-mon[115914]: Updating smithi093:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-12T11:52:00.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:00 smithi093 ceph-mon[115914]: Updating smithi063:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-12T11:52:00.974 INFO:tasks.workunit.client.0.smithi063.stdout:3/495: dwrite d4/f15 [0,4194304] 0 2023-12-12T11:52:00.974 INFO:tasks.workunit.client.1.smithi093.stdout:6/910: dread d0/f44 [0,4194304] 0 2023-12-12T11:52:00.974 INFO:tasks.workunit.client.1.smithi093.stdout:8/815: dwrite d3/d1a/f97 [0,4194304] 0 2023-12-12T11:52:00.974 INFO:tasks.workunit.client.1.smithi093.stdout:9/757: symlink d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/db1/dbc/l103 0 2023-12-12T11:52:00.975 INFO:tasks.workunit.client.1.smithi093.stdout:5/640: dwrite d0/d7/d36/d29/f9d [0,4194304] 0 2023-12-12T11:52:00.975 INFO:tasks.workunit.client.1.smithi093.stdout:5/641: fdatasync d0/d7/d59/d48/fc3 0 2023-12-12T11:52:00.975 INFO:tasks.workunit.client.1.smithi093.stdout:0/793: getdents d5/dd/d14/d26/d58/d72 0 2023-12-12T11:52:00.977 INFO:tasks.workunit.client.1.smithi093.stdout:1/789: symlink d4/l10a 0 2023-12-12T11:52:00.980 INFO:tasks.workunit.client.0.smithi063.stdout:7/465: creat de/fab x:0 0 0 2023-12-12T11:52:00.983 INFO:tasks.workunit.client.1.smithi093.stdout:2/792: mknod d5/d31/dbc/dd0/c10c 0 2023-12-12T11:52:00.983 INFO:tasks.workunit.client.1.smithi093.stdout:2/793: fsync d5/d14/d2d/d12/d44/f57 0 2023-12-12T11:52:00.990 INFO:tasks.workunit.client.1.smithi093.stdout:4/997: dread d0/fd1 [0,4194304] 0 2023-12-12T11:52:00.990 INFO:tasks.workunit.client.0.smithi063.stdout:5/578: dwrite d7/d28/f3f [0,4194304] 0 2023-12-12T11:52:00.991 INFO:tasks.workunit.client.0.smithi063.stdout:5/579: truncate d7/d28/d43/d49/f97 575899 0 2023-12-12T11:52:00.991 INFO:tasks.workunit.client.0.smithi063.stdout:5/580: chown d7/d10/d2b/d3c/d27/f54 3294 1 2023-12-12T11:52:00.994 INFO:tasks.workunit.client.0.smithi063.stdout:2/454: rename d0/d1a/f1d to d0/d69/f97 0 2023-12-12T11:52:00.994 INFO:tasks.workunit.client.0.smithi063.stdout:2/455: write d0/d1a/d3a/f84 [833398,42802] 0 2023-12-12T11:52:00.994 INFO:tasks.workunit.client.0.smithi063.stdout:2/456: chown d0/d1a/d3a/d59/f7e 13 1 2023-12-12T11:52:00.995 INFO:tasks.workunit.client.0.smithi063.stdout:2/457: write d0/f15 [843702,127528] 0 2023-12-12T11:52:01.001 INFO:tasks.workunit.client.0.smithi063.stdout:4/598: mknod d2/d17/d7f/cbf 0 2023-12-12T11:52:01.002 INFO:tasks.workunit.client.1.smithi093.stdout:6/911: write d0/da/d14/d21/f120 [2287334,75155] 0 2023-12-12T11:52:01.003 INFO:tasks.workunit.client.0.smithi063.stdout:4/599: dread - d2/d47/f7b zero size 2023-12-12T11:52:01.003 INFO:tasks.workunit.client.0.smithi063.stdout:0/543: dwrite d0/d7/d27/d19/f86 [0,4194304] 0 2023-12-12T11:52:01.003 INFO:tasks.workunit.client.0.smithi063.stdout:0/544: chown d0/d1a/f32 42472138 1 2023-12-12T11:52:01.003 INFO:tasks.workunit.client.1.smithi093.stdout:7/728: dread da/d2e/f79 [0,4194304] 0 2023-12-12T11:52:01.006 INFO:tasks.workunit.client.1.smithi093.stdout:3/760: dwrite df/d22/d49/d69/fa7 [0,4194304] 0 2023-12-12T11:52:01.018 INFO:tasks.workunit.client.0.smithi063.stdout:4/600: dread d2/f58 [0,4194304] 0 2023-12-12T11:52:01.018 INFO:tasks.workunit.client.0.smithi063.stdout:4/601: stat d2/d17/d41/f52 0 2023-12-12T11:52:01.020 INFO:tasks.workunit.client.1.smithi093.stdout:9/758: creat d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/db1/dbc/f104 x:0 0 0 2023-12-12T11:52:01.023 INFO:tasks.workunit.client.0.smithi063.stdout:9/456: unlink d7/d20/d45/d46/d51/f5d 0 2023-12-12T11:52:01.024 INFO:tasks.workunit.client.0.smithi063.stdout:9/457: chown d7/lb 15812 1 2023-12-12T11:52:01.024 INFO:tasks.workunit.client.0.smithi063.stdout:9/458: fsync d7/d11/f4c 0 2023-12-12T11:52:01.027 INFO:tasks.workunit.client.0.smithi063.stdout:3/496: getdents d4/df/d1a/d1c/d3b/d52 0 2023-12-12T11:52:01.028 INFO:tasks.workunit.client.1.smithi093.stdout:5/642: rename d0/c6d to d0/d7/d36/d29/d44/cdc 0 2023-12-12T11:52:01.029 INFO:tasks.workunit.client.1.smithi093.stdout:5/643: stat d0/d7/d36/f90 0 2023-12-12T11:52:01.032 INFO:tasks.workunit.client.0.smithi063.stdout:7/466: dwrite de/d22/d6f/f9a [0,4194304] 0 2023-12-12T11:52:01.032 INFO:tasks.workunit.client.0.smithi063.stdout:7/467: chown de/d39/d4b/l52 21786793 1 2023-12-12T11:52:01.033 INFO:tasks.workunit.client.1.smithi093.stdout:2/794: symlink d5/d14/d2d/d8b/da3/de5/l10d 0 2023-12-12T11:52:01.035 INFO:tasks.workunit.client.0.smithi063.stdout:2/458: mknod d0/c98 0 2023-12-12T11:52:01.037 INFO:tasks.workunit.client.1.smithi093.stdout:4/998: mknod d0/d36/d49/c134 0 2023-12-12T11:52:01.037 INFO:tasks.workunit.client.1.smithi093.stdout:4/999: chown d0/d31/d9d/da0/fe5 52909129 1 2023-12-12T11:52:01.039 INFO:tasks.workunit.client.0.smithi063.stdout:0/545: link d0/c62 d0/d7/d27/d19/d2d/d67/cb7 0 2023-12-12T11:52:01.040 INFO:tasks.workunit.client.0.smithi063.stdout:1/624: sync 2023-12-12T11:52:01.041 INFO:tasks.workunit.client.0.smithi063.stdout:8/575: sync 2023-12-12T11:52:01.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:00 smithi063 ceph-mon[107117]: Updating smithi093:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-12T11:52:01.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:00 smithi063 ceph-mon[107117]: Updating smithi063:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-12T11:52:01.046 INFO:tasks.workunit.client.1.smithi093.stdout:7/729: creat da/d2e/d89/ff9 x:0 0 0 2023-12-12T11:52:01.060 INFO:tasks.workunit.client.1.smithi093.stdout:0/794: dwrite d5/d78/da4/fcc [0,4194304] 0 2023-12-12T11:52:01.060 INFO:tasks.workunit.client.1.smithi093.stdout:0/795: chown d5/d21/d2f/d54/fb9 5988 1 2023-12-12T11:52:01.060 INFO:tasks.workunit.client.0.smithi063.stdout:3/497: dread d4/f3f [4194304,4194304] 0 2023-12-12T11:52:01.060 INFO:tasks.workunit.client.0.smithi063.stdout:3/498: chown d4/df/d1a/d1c/c7d 3908934 1 2023-12-12T11:52:01.063 INFO:tasks.workunit.client.0.smithi063.stdout:7/468: dread de/f1e [0,4194304] 0 2023-12-12T11:52:01.065 INFO:tasks.workunit.client.0.smithi063.stdout:4/602: creat d2/d48/d69/fc0 x:0 0 0 2023-12-12T11:52:01.069 INFO:tasks.workunit.client.0.smithi063.stdout:5/581: dwrite d7/d10/d2b/d3c/f36 [4194304,4194304] 0 2023-12-12T11:52:01.072 INFO:tasks.workunit.client.0.smithi063.stdout:9/459: symlink d7/d20/d65/l96 0 2023-12-12T11:52:01.076 INFO:tasks.workunit.client.1.smithi093.stdout:9/759: mknod d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d73/c105 0 2023-12-12T11:52:01.076 INFO:tasks.workunit.client.1.smithi093.stdout:9/760: chown d1/d23/d6b/d92/db2/fb6 24639 1 2023-12-12T11:52:01.076 INFO:tasks.workunit.client.1.smithi093.stdout:9/761: write d1/d23/d6b/d92/db2/fb6 [5078,85941] 0 2023-12-12T11:52:01.083 INFO:tasks.workunit.client.1.smithi093.stdout:1/790: rename d4/d85/fdd to d4/d1a/d83/d9a/da9/db9/f10b 0 2023-12-12T11:52:01.084 INFO:tasks.workunit.client.0.smithi063.stdout:2/459: mknod d0/d1a/d3a/d59/c99 0 2023-12-12T11:52:01.084 INFO:tasks.workunit.client.0.smithi063.stdout:2/460: write d0/f4 [503390,7593] 0 2023-12-12T11:52:01.093 INFO:tasks.workunit.client.0.smithi063.stdout:1/625: truncate d3/db/fe 640986 0 2023-12-12T11:52:01.093 INFO:tasks.workunit.client.0.smithi063.stdout:3/499: stat d4/c11 0 2023-12-12T11:52:01.098 INFO:tasks.workunit.client.0.smithi063.stdout:4/603: mkdir d2/d8/db3/dc1 0 2023-12-12T11:52:01.099 INFO:tasks.workunit.client.0.smithi063.stdout:8/576: dwrite d4/de/fb4 [0,4194304] 0 2023-12-12T11:52:01.107 INFO:tasks.workunit.client.1.smithi093.stdout:3/761: link df/d22/d49/d69/d78/daf/d3d/d42/l99 df/d25/d2c/d85/lf6 0 2023-12-12T11:52:01.107 INFO:tasks.workunit.client.1.smithi093.stdout:3/762: fsync df/d22/d49/d69/d78/daf/d3d/d6f/fd5 0 2023-12-12T11:52:01.109 INFO:tasks.workunit.client.0.smithi063.stdout:5/582: symlink d7/d10/lb7 0 2023-12-12T11:52:01.114 INFO:tasks.workunit.client.1.smithi093.stdout:1/791: mknod d4/d1a/d73/dd4/dd5/c10c 0 2023-12-12T11:52:01.114 INFO:tasks.workunit.client.1.smithi093.stdout:1/792: read d4/d1c/d2a/f3d [152253,125861] 0 2023-12-12T11:52:01.115 INFO:tasks.workunit.client.1.smithi093.stdout:1/793: fdatasync d4/d85/f100 0 2023-12-12T11:52:01.115 INFO:tasks.workunit.client.0.smithi063.stdout:9/460: getdents d7/d15 0 2023-12-12T11:52:01.115 INFO:tasks.workunit.client.0.smithi063.stdout:9/461: chown d7/d20/d45 12 1 2023-12-12T11:52:01.118 INFO:tasks.workunit.client.0.smithi063.stdout:0/546: dwrite d0/d7/d27/d44/f85 [0,4194304] 0 2023-12-12T11:52:01.118 INFO:tasks.workunit.client.0.smithi063.stdout:0/547: chown d0/d7/d27/d19 0 1 2023-12-12T11:52:01.119 INFO:tasks.workunit.client.1.smithi093.stdout:5/644: rename d0/d7/d59/d62/fb0 to d0/d7/d36/db9/d66/d7c/db5/fdd 0 2023-12-12T11:52:01.122 INFO:tasks.workunit.client.0.smithi063.stdout:2/461: mknod d0/d1a/c9a 0 2023-12-12T11:52:01.122 INFO:tasks.workunit.client.0.smithi063.stdout:2/462: truncate d0/d1a/d48/d56/f76 334484 0 2023-12-12T11:52:01.122 INFO:tasks.workunit.client.0.smithi063.stdout:2/463: chown d0/l67 13545651 1 2023-12-12T11:52:01.124 INFO:tasks.workunit.client.1.smithi093.stdout:2/795: dwrite d5/d14/d2d/d4c/d54/dc5/d55/f8e [4194304,4194304] 0 2023-12-12T11:52:01.124 INFO:tasks.workunit.client.1.smithi093.stdout:2/796: truncate d5/d14/d2d/d4c/d54/d67/d69/f108 979700 0 2023-12-12T11:52:01.125 INFO:tasks.workunit.client.1.smithi093.stdout:3/763: unlink df/d22/d49/d69/d78/daf/d3d/d59/f64 0 2023-12-12T11:52:01.125 INFO:tasks.workunit.client.1.smithi093.stdout:3/764: fsync df/f43 0 2023-12-12T11:52:01.125 INFO:tasks.workunit.client.1.smithi093.stdout:1/794: creat d4/d81/dfc/f10d x:0 0 0 2023-12-12T11:52:01.125 INFO:tasks.workunit.client.1.smithi093.stdout:5/645: mknod d0/d7/d85/da0/cde 0 2023-12-12T11:52:01.126 INFO:tasks.workunit.client.1.smithi093.stdout:1/795: stat d4/d1a/d1b/d26/d65/fe8 0 2023-12-12T11:52:01.126 INFO:tasks.workunit.client.1.smithi093.stdout:1/796: write d4/d1a/d1b/d26/d65/f7b [4642713,9167] 0 2023-12-12T11:52:01.129 INFO:tasks.workunit.client.0.smithi063.stdout:8/577: mknod d4/de/d1e/cb5 0 2023-12-12T11:52:01.129 INFO:tasks.workunit.client.0.smithi063.stdout:8/578: truncate d4/d55/d52/f71 825769 0 2023-12-12T11:52:01.130 INFO:tasks.workunit.client.0.smithi063.stdout:5/583: write d7/d28/f3f [3901179,73263] 0 2023-12-12T11:52:01.132 INFO:tasks.workunit.client.1.smithi093.stdout:2/797: symlink d5/d14/d2d/d4c/d54/dc5/l10e 0 2023-12-12T11:52:01.132 INFO:tasks.workunit.client.1.smithi093.stdout:2/798: fdatasync d5/d14/d2d/d12/d25/f29 0 2023-12-12T11:52:01.132 INFO:tasks.workunit.client.1.smithi093.stdout:2/799: creat d5/d14/d47/d4e/dae/f10f x:0 0 0 2023-12-12T11:52:01.133 INFO:tasks.workunit.client.1.smithi093.stdout:3/765: truncate df/d22/d49/fe9 832951 0 2023-12-12T11:52:01.134 INFO:tasks.workunit.client.0.smithi063.stdout:0/548: link d0/d7/d27/d19/d2d/d67/c9c d0/d1a/d23/d2e/dad/cb8 0 2023-12-12T11:52:01.134 INFO:tasks.workunit.client.0.smithi063.stdout:0/549: chown d0/d1a/d23/d34/d42/f60 436 1 2023-12-12T11:52:01.134 INFO:tasks.workunit.client.0.smithi063.stdout:0/550: chown d0/d7/d27/d44/f97 519171 1 2023-12-12T11:52:01.134 INFO:tasks.workunit.client.0.smithi063.stdout:0/551: fsync d0/d1a/d66/f87 0 2023-12-12T11:52:01.135 INFO:tasks.workunit.client.0.smithi063.stdout:7/469: dwrite de/d33/d41/d44/f6b [0,4194304] 0 2023-12-12T11:52:01.138 INFO:tasks.workunit.client.1.smithi093.stdout:9/762: dwrite d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/f6a [0,4194304] 0 2023-12-12T11:52:01.138 INFO:tasks.workunit.client.1.smithi093.stdout:5/646: truncate d0/d7/d59/d48/f5f 1831246 0 2023-12-12T11:52:01.138 INFO:tasks.workunit.client.1.smithi093.stdout:1/797: mkdir d4/d1a/d73/d10e 0 2023-12-12T11:52:01.138 INFO:tasks.workunit.client.1.smithi093.stdout:1/798: write d4/d1c/d2a/f4b [5580738,37215] 0 2023-12-12T11:52:01.140 INFO:tasks.workunit.client.0.smithi063.stdout:2/464: symlink d0/d41/d90/l9b 0 2023-12-12T11:52:01.140 INFO:tasks.workunit.client.1.smithi093.stdout:0/796: dwrite d5/d41/fcd [0,4194304] 0 2023-12-12T11:52:01.143 INFO:tasks.workunit.client.0.smithi063.stdout:1/626: getdents d3 0 2023-12-12T11:52:01.147 INFO:tasks.workunit.client.1.smithi093.stdout:5/647: symlink d0/d7/d59/d48/ldf 0 2023-12-12T11:52:01.149 INFO:tasks.workunit.client.0.smithi063.stdout:3/500: rename d4/c8 to d4/df/c9c 0 2023-12-12T11:52:01.149 INFO:tasks.workunit.client.0.smithi063.stdout:3/501: stat d4/d23/d5d/d4c/d69 0 2023-12-12T11:52:01.149 INFO:tasks.workunit.client.0.smithi063.stdout:3/502: dread - d4/df/d1a/d1c/d3b/d50/f97 zero size 2023-12-12T11:52:01.150 INFO:tasks.workunit.client.0.smithi063.stdout:5/584: symlink d7/d28/lb8 0 2023-12-12T11:52:01.151 INFO:tasks.workunit.client.1.smithi093.stdout:3/766: read df/d22/d49/d69/d78/dad/fa9 [1880464,22998] 0 2023-12-12T11:52:01.153 INFO:tasks.workunit.client.1.smithi093.stdout:9/763: dread d1/d23/f41 [0,4194304] 0 2023-12-12T11:52:01.157 INFO:tasks.workunit.client.0.smithi063.stdout:8/579: write d4/de/d1e/f64 [2805910,25830] 0 2023-12-12T11:52:01.157 INFO:tasks.workunit.client.0.smithi063.stdout:8/580: read - d4/de/d3b/d62/fa6 zero size 2023-12-12T11:52:01.164 INFO:tasks.workunit.client.1.smithi093.stdout:1/799: write d4/d1a/d73/dd4/dd5/fea [1738614,68532] 0 2023-12-12T11:52:01.164 INFO:tasks.workunit.client.1.smithi093.stdout:1/800: truncate d4/d81/f107 776707 0 2023-12-12T11:52:01.165 INFO:tasks.workunit.client.1.smithi093.stdout:0/797: write d5/d41/d77/d79/d9b/f9e [427912,33226] 0 2023-12-12T11:52:01.165 INFO:tasks.workunit.client.0.smithi063.stdout:0/552: unlink d0/d7/d27/d19/c7a 0 2023-12-12T11:52:01.165 INFO:tasks.workunit.client.0.smithi063.stdout:0/553: readlink d0/d8e/l92 0 2023-12-12T11:52:01.165 INFO:tasks.workunit.client.0.smithi063.stdout:0/554: write d0/d7/d27/d1f/f40 [457917,73214] 0 2023-12-12T11:52:01.167 INFO:tasks.workunit.client.1.smithi093.stdout:8/816: sync 2023-12-12T11:52:01.167 INFO:tasks.workunit.client.1.smithi093.stdout:6/912: sync 2023-12-12T11:52:01.171 INFO:tasks.workunit.client.1.smithi093.stdout:1/801: dread d4/d1a/d1b/d26/d31/ddb/fe6 [0,4194304] 0 2023-12-12T11:52:01.171 INFO:tasks.workunit.client.1.smithi093.stdout:3/767: fsync df/d22/f31 0 2023-12-12T11:52:01.176 INFO:tasks.workunit.client.1.smithi093.stdout:9/764: stat d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d57/d63/fad 0 2023-12-12T11:52:01.179 INFO:tasks.workunit.client.1.smithi093.stdout:6/913: getdents d0/da/d14/d38/d43/d10e 0 2023-12-12T11:52:01.183 INFO:tasks.workunit.client.1.smithi093.stdout:6/914: dread - d0/da/d14/d21/dd0/fe3 zero size 2023-12-12T11:52:01.183 INFO:tasks.workunit.client.1.smithi093.stdout:8/817: mkdir d3/d1a/d1f/d29/d30/d110 0 2023-12-12T11:52:01.183 INFO:tasks.workunit.client.1.smithi093.stdout:8/818: readlink d3/d1a/d1f/d75/leb 0 2023-12-12T11:52:01.184 INFO:tasks.workunit.client.1.smithi093.stdout:8/819: stat d3/d1a/d1f/d29/d3a/db1/fcf 0 2023-12-12T11:52:01.184 INFO:tasks.workunit.client.1.smithi093.stdout:7/730: dwrite da/de/f10 [0,4194304] 0 2023-12-12T11:52:01.184 INFO:tasks.workunit.client.0.smithi063.stdout:7/470: truncate de/f13 3261748 0 2023-12-12T11:52:01.184 INFO:tasks.workunit.client.0.smithi063.stdout:8/581: dread d4/de/f53 [0,4194304] 0 2023-12-12T11:52:01.193 INFO:tasks.workunit.client.0.smithi063.stdout:5/585: write d7/d10/d2b/d3c/d27/f54 [909140,73649] 0 2023-12-12T11:52:01.193 INFO:tasks.workunit.client.0.smithi063.stdout:5/586: creat d7/d10/d2b/d3c/d27/fb9 x:0 0 0 2023-12-12T11:52:01.194 INFO:tasks.workunit.client.0.smithi063.stdout:0/555: truncate d0/d7/d27/f90 4108337 0 2023-12-12T11:52:01.196 INFO:tasks.workunit.client.1.smithi093.stdout:7/731: dread da/d15/d2d/f34 [4194304,4194304] 0 2023-12-12T11:52:01.196 INFO:tasks.workunit.client.1.smithi093.stdout:3/768: write df/d25/d2c/f9b [2876438,54221] 0 2023-12-12T11:52:01.198 INFO:tasks.workunit.client.0.smithi063.stdout:3/503: dwrite d4/d23/f24 [0,4194304] 0 2023-12-12T11:52:01.198 INFO:tasks.workunit.client.1.smithi093.stdout:8/820: rename d3/d1a/d1f/d29/d3a/d40/fc9 to d3/d8/d88/dc5/f111 0 2023-12-12T11:52:01.200 INFO:tasks.workunit.client.0.smithi063.stdout:7/471: mknod de/d39/d60/da4/cac 0 2023-12-12T11:52:01.202 INFO:tasks.workunit.client.1.smithi093.stdout:5/648: dwrite d0/d7/f1c [0,4194304] 0 2023-12-12T11:52:01.205 INFO:tasks.workunit.client.1.smithi093.stdout:1/802: getdents d4/d1a/d73/dd4/dd5 0 2023-12-12T11:52:01.205 INFO:tasks.workunit.client.0.smithi063.stdout:8/582: link d4/d55/d52/d8e/lae d4/d24/d38/d45/d5b/lb6 0 2023-12-12T11:52:01.209 INFO:tasks.workunit.client.0.smithi063.stdout:4/604: rename d2/d17/d7f/f84 to d2/d8/fc2 0 2023-12-12T11:52:01.216 INFO:tasks.workunit.client.1.smithi093.stdout:8/821: dread d3/d1a/d1f/d29/d3a/d40/f53 [0,4194304] 0 2023-12-12T11:52:01.216 INFO:tasks.workunit.client.1.smithi093.stdout:8/822: chown d3/d1a/d1f/daf 307 1 2023-12-12T11:52:01.216 INFO:tasks.workunit.client.0.smithi063.stdout:0/556: mknod d0/d1a/d23/d2e/d84/cb9 0 2023-12-12T11:52:01.219 INFO:tasks.workunit.client.0.smithi063.stdout:6/613: sync 2023-12-12T11:52:01.222 INFO:tasks.workunit.client.1.smithi093.stdout:3/769: creat df/d22/d49/d69/d78/daf/d3d/def/ff7 x:0 0 0 2023-12-12T11:52:01.224 INFO:tasks.workunit.client.0.smithi063.stdout:3/504: dread d4/df/d1a/d1c/f28 [0,4194304] 0 2023-12-12T11:52:01.224 INFO:tasks.workunit.client.0.smithi063.stdout:9/462: rename f0 to d7/d20/d3f/f97 0 2023-12-12T11:52:01.224 INFO:tasks.workunit.client.0.smithi063.stdout:9/463: truncate d7/d11/d4b/d75/f87 430105 0 2023-12-12T11:52:01.227 INFO:tasks.workunit.client.1.smithi093.stdout:1/803: dread d4/d1a/d73/f97 [0,4194304] 0 2023-12-12T11:52:01.227 INFO:tasks.workunit.client.1.smithi093.stdout:1/804: chown d4/d1a/d83/d9a/de7/d103 156 1 2023-12-12T11:52:01.227 INFO:tasks.workunit.client.1.smithi093.stdout:1/805: stat d4/d1a/d73/l5b 0 2023-12-12T11:52:01.227 INFO:tasks.workunit.client.1.smithi093.stdout:1/806: write d4/d1a/d1b/d26/fc9 [116911,71050] 0 2023-12-12T11:52:01.227 INFO:tasks.workunit.client.0.smithi063.stdout:4/605: mknod d2/d17/d9d/d85/cc3 0 2023-12-12T11:52:01.230 INFO:tasks.workunit.client.1.smithi093.stdout:8/823: truncate d3/d1a/f83 294445 0 2023-12-12T11:52:01.240 INFO:tasks.workunit.client.1.smithi093.stdout:1/807: truncate d4/f25 3562598 0 2023-12-12T11:52:01.240 INFO:tasks.workunit.client.1.smithi093.stdout:1/808: chown d4/d1c/d2a/f6e 904384 1 2023-12-12T11:52:01.244 INFO:tasks.workunit.client.0.smithi063.stdout:6/614: mknod d9/d68/cd3 0 2023-12-12T11:52:01.249 INFO:tasks.workunit.client.0.smithi063.stdout:4/606: mknod d2/d17/cc4 0 2023-12-12T11:52:01.250 INFO:tasks.workunit.client.0.smithi063.stdout:4/607: write d2/d47/f6b [978687,74941] 0 2023-12-12T11:52:01.250 INFO:tasks.workunit.client.1.smithi093.stdout:6/915: dwrite d0/d52/d7e/d42/f8b [0,4194304] 0 2023-12-12T11:52:01.252 INFO:tasks.workunit.client.0.smithi063.stdout:1/627: rename d3/d3a/d5e to d3/db/d16/d4f/da7/dca 0 2023-12-12T11:52:01.256 INFO:tasks.workunit.client.0.smithi063.stdout:3/505: write d4/d23/f24 [937742,18553] 0 2023-12-12T11:52:01.256 INFO:tasks.workunit.client.0.smithi063.stdout:3/506: stat d4/f44 0 2023-12-12T11:52:01.256 INFO:tasks.workunit.client.0.smithi063.stdout:3/507: fdatasync d4/df/d1a/d1c/f28 0 2023-12-12T11:52:01.256 INFO:tasks.workunit.client.1.smithi093.stdout:1/809: dread d4/d1a/d1b/d26/d40/f6a [0,4194304] 0 2023-12-12T11:52:01.257 INFO:tasks.workunit.client.0.smithi063.stdout:1/628: mknod d3/db/d16/d24/d48/d75/d83/d5b/ccb 0 2023-12-12T11:52:01.258 INFO:tasks.workunit.client.1.smithi093.stdout:6/916: rename d0/d52/d7e/d42/dd5/ddc/ce5 to d0/d52/d6b/ddb/c141 0 2023-12-12T11:52:01.261 INFO:tasks.workunit.client.0.smithi063.stdout:7/472: rename de/d22/d66/l84 to de/d39/d4b/d7b/lad 0 2023-12-12T11:52:01.264 INFO:tasks.workunit.client.1.smithi093.stdout:1/810: creat d4/d1a/d1b/d26/d65/dc8/d104/f10f x:0 0 0 2023-12-12T11:52:01.266 INFO:tasks.workunit.client.1.smithi093.stdout:1/811: read d4/d1a/d1b/d26/fc9 [3415,7188] 0 2023-12-12T11:52:01.266 INFO:tasks.workunit.client.1.smithi093.stdout:3/770: dread df/d22/d49/d69/d78/daf/d3d/d59/f5c [0,4194304] 0 2023-12-12T11:52:01.273 INFO:tasks.workunit.client.1.smithi093.stdout:5/649: dwrite d0/d7/d59/f60 [0,4194304] 0 2023-12-12T11:52:01.273 INFO:tasks.workunit.client.1.smithi093.stdout:5/650: chown d0/d7/d36/db9/f63 7 1 2023-12-12T11:52:01.273 INFO:tasks.workunit.client.1.smithi093.stdout:5/651: creat d0/d7/d36/d68/fe0 x:0 0 0 2023-12-12T11:52:01.273 INFO:tasks.workunit.client.1.smithi093.stdout:6/917: rename d0/da/d14/d38/f4f to d0/da/d32/d9e/f142 0 2023-12-12T11:52:01.273 INFO:tasks.workunit.client.1.smithi093.stdout:6/918: write d0/d52/d7e/d42/dd5/ddc/d12a/f105 [486257,22686] 0 2023-12-12T11:52:01.274 INFO:tasks.workunit.client.1.smithi093.stdout:3/771: truncate df/d22/d49/d69/d78/daf/d3d/d42/d8e/da5/fb0 3107497 0 2023-12-12T11:52:01.274 INFO:tasks.workunit.client.1.smithi093.stdout:3/772: fdatasync df/f2f 0 2023-12-12T11:52:01.274 INFO:tasks.workunit.client.1.smithi093.stdout:3/773: dread - df/d22/d49/d69/d78/daf/d3d/d59/d72/d79/fda zero size 2023-12-12T11:52:01.274 INFO:tasks.workunit.client.1.smithi093.stdout:3/774: getdents df/d22/d49/d69/d78/dad/df2 0 2023-12-12T11:52:01.277 INFO:tasks.workunit.client.0.smithi063.stdout:7/473: link de/d33/d41/d44/d8b/l90 de/d34/d68/da1/lae 0 2023-12-12T11:52:01.279 INFO:tasks.workunit.client.0.smithi063.stdout:3/508: rename d4/df/c4f to d4/df/d1a/d1c/d3b/d52/d74/c9d 0 2023-12-12T11:52:01.279 INFO:tasks.workunit.client.0.smithi063.stdout:3/509: fdatasync d4/df/d1a/d1c/d41/f99 0 2023-12-12T11:52:01.279 INFO:tasks.workunit.client.0.smithi063.stdout:3/510: chown d4/d23/d6b/f95 0 1 2023-12-12T11:52:01.280 INFO:tasks.workunit.client.1.smithi093.stdout:1/812: dread d4/d1c/f21 [0,4194304] 0 2023-12-12T11:52:01.282 INFO:tasks.workunit.client.0.smithi063.stdout:8/583: dwrite d4/f42 [0,4194304] 0 2023-12-12T11:52:01.283 INFO:tasks.workunit.client.0.smithi063.stdout:6/615: dread d9/d10/d5c/dce/d86/fbe [0,4194304] 0 2023-12-12T11:52:01.284 INFO:tasks.workunit.client.0.smithi063.stdout:0/557: dwrite d0/d1a/d66/f87 [0,4194304] 0 2023-12-12T11:52:01.285 INFO:tasks.workunit.client.0.smithi063.stdout:1/629: getdents d3/d3a/d52 0 2023-12-12T11:52:01.285 INFO:tasks.workunit.client.0.smithi063.stdout:1/630: readlink d3/d3a/d54/l92 0 2023-12-12T11:52:01.285 INFO:tasks.workunit.client.1.smithi093.stdout:5/652: dread d0/d7/d59/d48/f5f [0,4194304] 0 2023-12-12T11:52:01.288 INFO:tasks.workunit.client.0.smithi063.stdout:7/474: mkdir de/d39/d60/d97/daf 0 2023-12-12T11:52:01.290 INFO:tasks.workunit.client.0.smithi063.stdout:5/587: truncate d7/f56 2929163 0 2023-12-12T11:52:01.290 INFO:tasks.workunit.client.0.smithi063.stdout:5/588: dread - d7/d10/d2b/d3c/d42/f7d zero size 2023-12-12T11:52:01.292 INFO:tasks.workunit.client.0.smithi063.stdout:7/475: write de/f3c [95170,115862] 0 2023-12-12T11:52:01.292 INFO:tasks.workunit.client.0.smithi063.stdout:7/476: stat de/l2c 0 2023-12-12T11:52:01.292 INFO:tasks.workunit.client.1.smithi093.stdout:6/919: mkdir d0/da/d32/df7/d143 0 2023-12-12T11:52:01.292 INFO:tasks.workunit.client.1.smithi093.stdout:6/920: truncate d0/d52/d7e/d42/dd5/f131 1003737 0 2023-12-12T11:52:01.294 INFO:tasks.workunit.client.0.smithi063.stdout:6/616: creat d9/d2c/d61/dcd/fd4 x:0 0 0 2023-12-12T11:52:01.296 INFO:tasks.workunit.client.1.smithi093.stdout:3/775: getdents df/d30/d33 0 2023-12-12T11:52:01.296 INFO:tasks.workunit.client.1.smithi093.stdout:3/776: write df/d22/d49/d69/d78/daf/d3d/fc5 [249763,30444] 0 2023-12-12T11:52:01.296 INFO:tasks.workunit.client.1.smithi093.stdout:3/777: chown df/d22/d49/d69/d78/dad 18972 1 2023-12-12T11:52:01.301 INFO:tasks.workunit.client.1.smithi093.stdout:5/653: mkdir d0/d7/d59/d62/de1 0 2023-12-12T11:52:01.303 INFO:tasks.workunit.client.0.smithi063.stdout:0/558: truncate d0/d7/f31 1316162 0 2023-12-12T11:52:01.306 INFO:tasks.workunit.client.0.smithi063.stdout:1/631: link d3/db/d16/d24/d48/d75/d83/d5b/d6b/d6d/daf/cb2 d3/db/d16/d4f/da7/ccc 0 2023-12-12T11:52:01.307 INFO:tasks.workunit.client.1.smithi093.stdout:6/921: dread d0/d52/d7e/d42/dd5/f131 [0,4194304] 0 2023-12-12T11:52:01.308 INFO:tasks.workunit.client.1.smithi093.stdout:1/813: getdents d4/d1c 0 2023-12-12T11:52:01.313 INFO:tasks.workunit.client.0.smithi063.stdout:3/511: dread d4/df/d1a/d1c/d41/f58 [0,4194304] 0 2023-12-12T11:52:01.314 INFO:tasks.workunit.client.0.smithi063.stdout:5/589: mkdir d7/d28/d6e/dad/dba 0 2023-12-12T11:52:01.314 INFO:tasks.workunit.client.0.smithi063.stdout:5/590: read d7/d10/f1b [2283245,77638] 0 2023-12-12T11:52:01.319 INFO:tasks.workunit.client.0.smithi063.stdout:6/617: symlink d9/d10/d73/db8/ld5 0 2023-12-12T11:52:01.324 INFO:tasks.workunit.client.0.smithi063.stdout:0/559: symlink d0/d7/d27/d44/lba 0 2023-12-12T11:52:01.327 INFO:tasks.workunit.client.1.smithi093.stdout:6/922: dread d0/d52/f6e [0,4194304] 0 2023-12-12T11:52:01.332 INFO:tasks.workunit.client.0.smithi063.stdout:9/464: dwrite d7/d15/f2e [0,4194304] 0 2023-12-12T11:52:01.332 INFO:tasks.workunit.client.1.smithi093.stdout:5/654: rename d0/d7/d59/d48/f81 to d0/dd2/fe2 0 2023-12-12T11:52:01.333 INFO:tasks.workunit.client.1.smithi093.stdout:5/655: readlink d0/d7/d8/l55 0 2023-12-12T11:52:01.340 INFO:tasks.workunit.client.1.smithi093.stdout:3/778: dwrite df/d22/d49/d69/d78/daf/d3d/d6f/db1/fdb [0,4194304] 0 2023-12-12T11:52:01.341 INFO:tasks.workunit.client.1.smithi093.stdout:6/923: creat d0/d52/d7e/d42/dd5/ddc/d103/f144 x:0 0 0 2023-12-12T11:52:01.341 INFO:tasks.workunit.client.1.smithi093.stdout:6/924: write d0/da/d14/d21/fa5 [3261017,7521] 0 2023-12-12T11:52:01.346 INFO:tasks.workunit.client.1.smithi093.stdout:2/800: sync 2023-12-12T11:52:01.346 INFO:tasks.workunit.client.1.smithi093.stdout:2/801: chown d5/d14/d2d/d12/d44/c80 12435030 1 2023-12-12T11:52:01.347 INFO:tasks.workunit.client.0.smithi063.stdout:1/632: dread d3/db/fd [0,4194304] 0 2023-12-12T11:52:01.350 INFO:tasks.workunit.client.1.smithi093.stdout:5/656: rmdir d0/d7/d36/db9/d66/d7c/db5/dcc 39 2023-12-12T11:52:01.354 INFO:tasks.workunit.client.0.smithi063.stdout:8/584: dwrite d4/de/d3b/d62/d6e/d76/f8b [0,4194304] 0 2023-12-12T11:52:01.355 INFO:tasks.workunit.client.0.smithi063.stdout:6/618: symlink d9/ld6 0 2023-12-12T11:52:01.357 INFO:tasks.workunit.client.0.smithi063.stdout:0/560: dread d0/d1a/d23/d34/d42/f3e [0,4194304] 0 2023-12-12T11:52:01.357 INFO:tasks.workunit.client.0.smithi063.stdout:0/561: write d0/d7/d27/f29 [1073628,105415] 0 2023-12-12T11:52:01.357 INFO:tasks.workunit.client.1.smithi093.stdout:3/779: truncate df/d22/d49/d69/d78/daf/d3d/d42/d9d/fa4 2647536 0 2023-12-12T11:52:01.358 INFO:tasks.workunit.client.1.smithi093.stdout:3/780: creat df/d22/d49/d69/d78/daf/d3d/d42/d8e/ff8 x:0 0 0 2023-12-12T11:52:01.369 INFO:tasks.workunit.client.1.smithi093.stdout:6/925: symlink d0/da/d14/d21/l145 0 2023-12-12T11:52:01.371 INFO:tasks.workunit.client.0.smithi063.stdout:6/619: rename d9/d10/c5d to d9/d68/cd7 0 2023-12-12T11:52:01.372 INFO:tasks.workunit.client.0.smithi063.stdout:6/620: stat d9/d10/f37 0 2023-12-12T11:52:01.380 INFO:tasks.workunit.client.0.smithi063.stdout:5/591: dwrite d7/d10/f1b [4194304,4194304] 0 2023-12-12T11:52:01.380 INFO:tasks.workunit.client.0.smithi063.stdout:5/592: stat d7/d10/d2b/d3c/d42/f7d 0 2023-12-12T11:52:01.384 INFO:tasks.workunit.client.1.smithi093.stdout:5/657: dread d0/d7/f99 [0,4194304] 0 2023-12-12T11:52:01.388 INFO:tasks.workunit.client.0.smithi063.stdout:3/512: link d4/df/d1a/f31 d4/d23/d5d/d4c/d69/f9e 0 2023-12-12T11:52:01.388 INFO:tasks.workunit.client.0.smithi063.stdout:3/513: fsync d4/d23/d6b/f95 0 2023-12-12T11:52:01.388 INFO:tasks.workunit.client.0.smithi063.stdout:3/514: dread - d4/df/d1a/d1c/d41/f99 zero size 2023-12-12T11:52:01.388 INFO:tasks.workunit.client.0.smithi063.stdout:3/515: chown d4/df/d1a/d1c/d3b/d52/d74/c9d 1937234 1 2023-12-12T11:52:01.389 INFO:tasks.workunit.client.1.smithi093.stdout:1/814: dwrite d4/d1a/d73/f50 [0,4194304] 0 2023-12-12T11:52:01.393 INFO:tasks.workunit.client.0.smithi063.stdout:6/621: dread d9/fc [4194304,4194304] 0 2023-12-12T11:52:01.393 INFO:tasks.workunit.client.0.smithi063.stdout:6/622: chown d9/d10/d5c/dce/f75 76894856 1 2023-12-12T11:52:01.393 INFO:tasks.workunit.client.0.smithi063.stdout:6/623: creat d9/d10/d5c/d5e/fd8 x:0 0 0 2023-12-12T11:52:01.395 INFO:tasks.workunit.client.0.smithi063.stdout:0/562: link d0/d1a/d23/fb3 d0/d1a/d66/fbb 0 2023-12-12T11:52:01.395 INFO:tasks.workunit.client.0.smithi063.stdout:0/563: chown d0/d1a/fa3 1099 1 2023-12-12T11:52:01.397 INFO:tasks.workunit.client.1.smithi093.stdout:3/781: symlink df/d22/d49/d69/d78/dad/lf9 0 2023-12-12T11:52:01.397 INFO:tasks.workunit.client.1.smithi093.stdout:0/798: sync 2023-12-12T11:52:01.397 INFO:tasks.workunit.client.1.smithi093.stdout:3/782: write df/d22/d49/d69/d78/daf/d3d/d42/f53 [2906869,71494] 0 2023-12-12T11:52:01.397 INFO:tasks.workunit.client.1.smithi093.stdout:3/783: write df/d25/ff0 [1261513,87937] 0 2023-12-12T11:52:01.398 INFO:tasks.workunit.client.1.smithi093.stdout:6/926: rmdir d0/da/d32/d9e/d114 39 2023-12-12T11:52:01.400 INFO:tasks.workunit.client.0.smithi063.stdout:5/593: truncate d7/f1a 2501024 0 2023-12-12T11:52:01.400 INFO:tasks.workunit.client.0.smithi063.stdout:5/594: fsync d7/d28/d43/d49/fa9 0 2023-12-12T11:52:01.403 INFO:tasks.workunit.client.0.smithi063.stdout:0/564: creat d0/d1a/fbc x:0 0 0 2023-12-12T11:52:01.406 INFO:tasks.workunit.client.1.smithi093.stdout:2/802: dwrite d5/d14/d47/d56/fe8 [0,4194304] 0 2023-12-12T11:52:01.406 INFO:tasks.workunit.client.0.smithi063.stdout:9/465: dwrite d7/d11/d4b/f90 [0,4194304] 0 2023-12-12T11:52:01.407 INFO:tasks.workunit.client.0.smithi063.stdout:7/477: dwrite de/d3f/f59 [0,4194304] 0 2023-12-12T11:52:01.409 INFO:tasks.workunit.client.0.smithi063.stdout:8/585: dwrite d4/de/d3b/d62/d36/f3a [0,4194304] 0 2023-12-12T11:52:01.412 INFO:tasks.workunit.client.1.smithi093.stdout:0/799: link d5/d21/d27/d3a/c4b d5/dd/d14/d26/d58/d72/cf7 0 2023-12-12T11:52:01.413 INFO:tasks.workunit.client.0.smithi063.stdout:3/516: dread d4/d23/d6b/d90/f82 [0,4194304] 0 2023-12-12T11:52:01.414 INFO:tasks.workunit.client.0.smithi063.stdout:5/595: unlink d7/ff 0 2023-12-12T11:52:01.414 INFO:tasks.workunit.client.0.smithi063.stdout:5/596: fsync d7/d28/d67/f87 0 2023-12-12T11:52:01.416 INFO:tasks.workunit.client.1.smithi093.stdout:3/784: mkdir df/d22/d49/d69/dfa 0 2023-12-12T11:52:01.416 INFO:tasks.workunit.client.0.smithi063.stdout:6/624: write d9/f8d [1486754,129877] 0 2023-12-12T11:52:01.417 INFO:tasks.workunit.client.0.smithi063.stdout:6/625: write d9/d10/d5c/fbf [951758,8671] 0 2023-12-12T11:52:01.417 INFO:tasks.workunit.client.0.smithi063.stdout:0/565: creat d0/d1a/d23/d34/d42/fbd x:0 0 0 2023-12-12T11:52:01.417 INFO:tasks.workunit.client.0.smithi063.stdout:0/566: creat d0/d1a/d23/fbe x:0 0 0 2023-12-12T11:52:01.417 INFO:tasks.workunit.client.0.smithi063.stdout:9/466: dread d7/d11/d12/f60 [0,4194304] 0 2023-12-12T11:52:01.418 INFO:tasks.workunit.client.0.smithi063.stdout:9/467: creat d7/d11/d4b/d75/f98 x:0 0 0 2023-12-12T11:52:01.426 INFO:tasks.workunit.client.1.smithi093.stdout:5/658: getdents d0/d7/d36 0 2023-12-12T11:52:01.426 INFO:tasks.workunit.client.1.smithi093.stdout:5/659: chown d0/d7/d36/d29/d44/c5e 417560071 1 2023-12-12T11:52:01.434 INFO:tasks.workunit.client.0.smithi063.stdout:7/478: creat de/d39/d60/d97/daf/fb0 x:0 0 0 2023-12-12T11:52:01.434 INFO:tasks.workunit.client.0.smithi063.stdout:7/479: readlink de/d33/d41/la8 0 2023-12-12T11:52:01.434 INFO:tasks.workunit.client.0.smithi063.stdout:7/480: fsync de/d33/d71/f96 0 2023-12-12T11:52:01.438 INFO:tasks.workunit.client.1.smithi093.stdout:8/824: sync 2023-12-12T11:52:01.438 INFO:tasks.workunit.client.1.smithi093.stdout:9/765: sync 2023-12-12T11:52:01.438 INFO:tasks.workunit.client.1.smithi093.stdout:7/732: sync 2023-12-12T11:52:01.439 INFO:tasks.workunit.client.0.smithi063.stdout:8/586: getdents d4/d55/d52/d8e 0 2023-12-12T11:52:01.443 INFO:tasks.workunit.client.1.smithi093.stdout:0/800: getdents d5/dd/d14/d26/d58/d64/ddb 0 2023-12-12T11:52:01.445 INFO:tasks.workunit.client.1.smithi093.stdout:3/785: rename df/d22/d49/d69/d6e/f94 to df/d25/dd2/ffb 0 2023-12-12T11:52:01.445 INFO:tasks.workunit.client.1.smithi093.stdout:3/786: fdatasync df/d22/d49/d69/d78/daf/d3d/d59/fe7 0 2023-12-12T11:52:01.447 INFO:tasks.workunit.client.1.smithi093.stdout:1/815: write d4/d1a/d83/d9a/faf [174358,104770] 0 2023-12-12T11:52:01.453 INFO:tasks.workunit.client.1.smithi093.stdout:2/803: dwrite d5/d14/d2d/f53 [0,4194304] 0 2023-12-12T11:52:01.455 INFO:tasks.workunit.client.1.smithi093.stdout:6/927: getdents d0/da/d32/d9e/d4d/de9 0 2023-12-12T11:52:01.457 INFO:tasks.workunit.client.0.smithi063.stdout:0/567: creat d0/d1a/d23/d34/d42/d99/fbf x:0 0 0 2023-12-12T11:52:01.457 INFO:tasks.workunit.client.0.smithi063.stdout:9/468: symlink d7/l99 0 2023-12-12T11:52:01.459 INFO:tasks.workunit.client.1.smithi093.stdout:5/660: symlink d0/d7/d8/d9e/le3 0 2023-12-12T11:52:01.459 INFO:tasks.workunit.client.1.smithi093.stdout:5/661: read d0/d7/f99 [833029,25522] 0 2023-12-12T11:52:01.464 INFO:tasks.workunit.client.1.smithi093.stdout:7/733: truncate f0 4366553 0 2023-12-12T11:52:01.465 INFO:tasks.workunit.client.1.smithi093.stdout:9/766: truncate d1/d23/d24/d29/d43/d56/d68/fd1 3364684 0 2023-12-12T11:52:01.465 INFO:tasks.workunit.client.1.smithi093.stdout:9/767: fdatasync d1/d23/d6b/f8c 0 2023-12-12T11:52:01.465 INFO:tasks.workunit.client.1.smithi093.stdout:9/768: readlink d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/d42/lcb 0 2023-12-12T11:52:01.465 INFO:tasks.workunit.client.1.smithi093.stdout:9/769: getdents d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d5c 0 2023-12-12T11:52:01.465 INFO:tasks.workunit.client.1.smithi093.stdout:9/770: read d1/d23/d6b/d92/db2/fb6 [32038,28628] 0 2023-12-12T11:52:01.468 INFO:tasks.workunit.client.0.smithi063.stdout:7/481: creat de/d39/fb1 x:0 0 0 2023-12-12T11:52:01.469 INFO:tasks.workunit.client.1.smithi093.stdout:3/787: truncate df/d22/f6d 2675842 0 2023-12-12T11:52:01.469 INFO:tasks.workunit.client.0.smithi063.stdout:7/482: creat de/d22/d66/fb2 x:0 0 0 2023-12-12T11:52:01.470 INFO:tasks.workunit.client.0.smithi063.stdout:8/587: creat d4/de/d11/fb7 x:0 0 0 2023-12-12T11:52:01.472 INFO:tasks.workunit.client.1.smithi093.stdout:8/825: dread d3/d1a/f2b [0,4194304] 0 2023-12-12T11:52:01.475 INFO:tasks.workunit.client.1.smithi093.stdout:1/816: mkdir d4/d1a/d1b/dbf/d110 0 2023-12-12T11:52:01.475 INFO:tasks.workunit.client.1.smithi093.stdout:1/817: fdatasync d4/d1a/dc2/fd1 0 2023-12-12T11:52:01.479 INFO:tasks.workunit.client.0.smithi063.stdout:6/626: dwrite d9/d10/d5c/dce/d86/fbe [0,4194304] 0 2023-12-12T11:52:01.479 INFO:tasks.workunit.client.0.smithi063.stdout:6/627: read d9/f43 [315439,79112] 0 2023-12-12T11:52:01.480 INFO:tasks.workunit.client.0.smithi063.stdout:0/568: creat d0/d7/d27/d19/d2d/d67/fc0 x:0 0 0 2023-12-12T11:52:01.486 INFO:tasks.workunit.client.1.smithi093.stdout:2/804: write d5/d14/d2d/f1f [1337960,24675] 0 2023-12-12T11:52:01.487 INFO:tasks.workunit.client.1.smithi093.stdout:6/928: mkdir d0/da/d14/d21/d146 0 2023-12-12T11:52:01.487 INFO:tasks.workunit.client.1.smithi093.stdout:8/826: write d3/d1a/d1f/d29/d3a/f55 [1906942,91995] 0 2023-12-12T11:52:01.489 INFO:tasks.workunit.client.0.smithi063.stdout:7/483: link de/d22/d2b/d61/l92 de/d33/d41/d44/d8b/lb3 0 2023-12-12T11:52:01.490 INFO:tasks.workunit.client.1.smithi093.stdout:7/734: mknod da/d15/d19/d4c/d6d/cfa 0 2023-12-12T11:52:01.490 INFO:tasks.workunit.client.1.smithi093.stdout:7/735: fdatasync da/d2e/d89/ff9 0 2023-12-12T11:52:01.492 INFO:tasks.workunit.client.0.smithi063.stdout:6/628: mkdir d9/d10/d5c/dce/d8a/dd9 0 2023-12-12T11:52:01.494 INFO:tasks.workunit.client.1.smithi093.stdout:9/771: creat d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/f106 x:0 0 0 2023-12-12T11:52:01.495 INFO:tasks.workunit.client.0.smithi063.stdout:8/588: dread d4/de/f41 [4194304,4194304] 0 2023-12-12T11:52:01.495 INFO:tasks.workunit.client.1.smithi093.stdout:8/827: dread d3/d1a/d1f/d59/d69/fc6 [0,4194304] 0 2023-12-12T11:52:01.495 INFO:tasks.workunit.client.1.smithi093.stdout:8/828: write d3/d1a/d1f/d29/d63/ff5 [857007,46915] 0 2023-12-12T11:52:01.495 INFO:tasks.workunit.client.1.smithi093.stdout:8/829: write d3/d1a/d1f/d59/d69/ff8 [668828,14734] 0 2023-12-12T11:52:01.495 INFO:tasks.workunit.client.1.smithi093.stdout:8/830: chown d3/d1a/f97 13623886 1 2023-12-12T11:52:01.499 INFO:tasks.workunit.client.0.smithi063.stdout:0/569: rename d0/d7/d27/d19/d2d/f43 to d0/d7/d27/d19/fc1 0 2023-12-12T11:52:01.499 INFO:tasks.workunit.client.0.smithi063.stdout:0/570: stat d0/d1a/d23/d2e/f79 0 2023-12-12T11:52:01.499 INFO:tasks.workunit.client.0.smithi063.stdout:0/571: truncate d0/d1a/d23/d2e/f5a 1149087 0 2023-12-12T11:52:01.503 INFO:tasks.workunit.client.0.smithi063.stdout:6/629: symlink d9/d68/d94/lda 0 2023-12-12T11:52:01.506 INFO:tasks.workunit.client.1.smithi093.stdout:3/788: link df/d22/c9e df/d22/d49/d69/d78/daf/d3d/d42/d8e/da5/cfc 0 2023-12-12T11:52:01.507 INFO:tasks.workunit.client.1.smithi093.stdout:3/789: dread - df/d22/d49/d69/d78/daf/d3d/d59/d72/fd9 zero size 2023-12-12T11:52:01.508 INFO:tasks.workunit.client.1.smithi093.stdout:0/801: dwrite d5/d78/da4/fcc [0,4194304] 0 2023-12-12T11:52:01.510 INFO:tasks.workunit.client.0.smithi063.stdout:8/589: creat d4/de/d3b/d62/d36/d57/d84/fb8 x:0 0 0 2023-12-12T11:52:01.516 INFO:tasks.workunit.client.1.smithi093.stdout:2/805: rmdir d5/d14/df0 0 2023-12-12T11:52:01.516 INFO:tasks.workunit.client.1.smithi093.stdout:0/802: dread d5/d21/fb1 [0,4194304] 0 2023-12-12T11:52:01.520 INFO:tasks.workunit.client.0.smithi063.stdout:8/590: unlink d4/de/d3b/d62/d36/l49 0 2023-12-12T11:52:01.523 INFO:tasks.workunit.client.1.smithi093.stdout:6/929: rename d0/da/d32/d39/d5b/ld6 to d0/da/d14/l147 0 2023-12-12T11:52:01.523 INFO:tasks.workunit.client.1.smithi093.stdout:6/930: chown d0/f29 397019967 1 2023-12-12T11:52:01.525 INFO:tasks.workunit.client.1.smithi093.stdout:5/662: creat d0/d7/d36/db9/dca/fe4 x:0 0 0 2023-12-12T11:52:01.527 INFO:tasks.workunit.client.0.smithi063.stdout:3/517: dwrite d4/f15 [0,4194304] 0 2023-12-12T11:52:01.529 INFO:tasks.workunit.client.0.smithi063.stdout:3/518: stat d4/d23/d5d/d4c/f66 0 2023-12-12T11:52:01.530 INFO:tasks.workunit.client.1.smithi093.stdout:3/790: dread df/d22/d49/d69/d78/daf/d3d/d6f/f4b [0,4194304] 0 2023-12-12T11:52:01.534 INFO:tasks.workunit.client.1.smithi093.stdout:8/831: mknod d3/d1a/d1f/d29/d3a/db1/c112 0 2023-12-12T11:52:01.537 INFO:tasks.workunit.client.1.smithi093.stdout:1/818: mknod d4/c111 0 2023-12-12T11:52:01.547 INFO:tasks.workunit.client.0.smithi063.stdout:0/572: dread d0/d7/d27/d1f/f2c [0,4194304] 0 2023-12-12T11:52:01.547 INFO:tasks.workunit.client.0.smithi063.stdout:0/573: dread - d0/d1a/d66/fbb zero size 2023-12-12T11:52:01.549 INFO:tasks.workunit.client.0.smithi063.stdout:7/484: dwrite de/d39/d4b/d7b/f9b [0,4194304] 0 2023-12-12T11:52:01.550 INFO:tasks.workunit.client.1.smithi093.stdout:2/806: mkdir d5/d14/d2d/d12/d25/d110 0 2023-12-12T11:52:01.551 INFO:tasks.workunit.client.0.smithi063.stdout:0/574: mknod d0/d7/d27/d1f/cc2 0 2023-12-12T11:52:01.554 INFO:tasks.workunit.client.1.smithi093.stdout:7/736: dwrite da/f7b [0,4194304] 0 2023-12-12T11:52:01.555 INFO:tasks.workunit.client.1.smithi093.stdout:7/737: creat da/d15/d59/d80/ffb x:0 0 0 2023-12-12T11:52:01.555 INFO:tasks.workunit.client.1.smithi093.stdout:7/738: fsync da/de/d46/d4f/f64 0 2023-12-12T11:52:01.559 INFO:tasks.workunit.client.1.smithi093.stdout:6/931: creat d0/da/d32/f148 x:0 0 0 2023-12-12T11:52:01.559 INFO:tasks.workunit.client.1.smithi093.stdout:6/932: stat d0/c17 0 2023-12-12T11:52:01.559 INFO:tasks.workunit.client.1.smithi093.stdout:6/933: chown d0/da/d14/d21/f120 67351 1 2023-12-12T11:52:01.561 INFO:tasks.workunit.client.0.smithi063.stdout:7/485: mkdir de/d39/d88/db4 0 2023-12-12T11:52:01.561 INFO:tasks.workunit.client.0.smithi063.stdout:7/486: rename de/d22 to de/d22/d6e/d8a/da3/db5 22 2023-12-12T11:52:01.562 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.558+0000 7f36d4c56700 1 -- 172.21.15.63:0/3077665214 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36d0070570 msgr2=0x7f36d00709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:01.562 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.558+0000 7f36d4c56700 1 --2- 172.21.15.63:0/3077665214 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36d0070570 0x7f36d00709c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f36c0004940 tx=0x7f36c0009e30 comp rx=0 tx=0).stop 2023-12-12T11:52:01.562 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.559+0000 7f36d4c56700 1 -- 172.21.15.63:0/3077665214 shutdown_connections 2023-12-12T11:52:01.563 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.559+0000 7f36d4c56700 1 --2- 172.21.15.63:0/3077665214 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36d0070570 0x7f36d00709c0 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f36c0004940 tx=0x7f36c0009e30 comp rx=0 tx=0).stop 2023-12-12T11:52:01.563 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.559+0000 7f36d4c56700 1 --2- 172.21.15.63:0/3077665214 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36d0071bc0 0x7f36d0070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:01.563 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.559+0000 7f36d4c56700 1 -- 172.21.15.63:0/3077665214 >> 172.21.15.63:0/3077665214 conn(0x7f36d00f82d0 msgr2=0x7f36d00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:52:01.563 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.559+0000 7f36d4c56700 1 -- 172.21.15.63:0/3077665214 shutdown_connections 2023-12-12T11:52:01.563 INFO:tasks.workunit.client.1.smithi093.stdout:5/663: mkdir d0/d7/d8/de/dab/de5 0 2023-12-12T11:52:01.564 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.559+0000 7f36d4c56700 1 -- 172.21.15.63:0/3077665214 wait complete. 2023-12-12T11:52:01.566 INFO:tasks.workunit.client.0.smithi063.stdout:0/575: unlink d0/d1a/f32 0 2023-12-12T11:52:01.566 INFO:tasks.workunit.client.0.smithi063.stdout:0/576: stat d0/f65 0 2023-12-12T11:52:01.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.563+0000 7f36d4c56700 1 Processor -- start 2023-12-12T11:52:01.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.563+0000 7f36d4c56700 1 -- start start 2023-12-12T11:52:01.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.565+0000 7f36d4c56700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36d0071bc0 0x7f36d006eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:01.568 INFO:tasks.workunit.client.1.smithi093.stdout:3/791: truncate df/d22/d49/d69/d78/daf/f41 115957 0 2023-12-12T11:52:01.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.565+0000 7f36d4c56700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36d006f400 0x7f36d011d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:01.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.566+0000 7f36d4c56700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d006f8c0 con 0x7f36d0071bc0 2023-12-12T11:52:01.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.566+0000 7f36d4c56700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d006fa00 con 0x7f36d006f400 2023-12-12T11:52:01.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.566+0000 7f36cdd9b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36d006f400 0x7f36d011d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:01.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.566+0000 7f36cdd9b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36d006f400 0x7f36d011d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:40804/0 (socket says 172.21.15.63:40804) 2023-12-12T11:52:01.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.566+0000 7f36cdd9b700 1 -- 172.21.15.63:0/3221208305 learned_addr learned my addr 172.21.15.63:0/3221208305 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:52:01.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.566+0000 7f36ce59c700 1 --2- 172.21.15.63:0/3221208305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36d0071bc0 0x7f36d006eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:01.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.567+0000 7f36cdd9b700 1 -- 172.21.15.63:0/3221208305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36d0071bc0 msgr2=0x7f36d006eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:01.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.567+0000 7f36cdd9b700 1 --2- 172.21.15.63:0/3221208305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36d0071bc0 0x7f36d006eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:01.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.567+0000 7f36cdd9b700 1 -- 172.21.15.63:0/3221208305 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c0005040 con 0x7f36d006f400 2023-12-12T11:52:01.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.568+0000 7f36cdd9b700 1 --2- 172.21.15.63:0/3221208305 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36d006f400 0x7f36d011d8b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f36c0009fd0 tx=0x7f36c0009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:52:01.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.568+0000 7f36beffd700 1 -- 172.21.15.63:0/3221208305 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36c000e040 con 0x7f36d006f400 2023-12-12T11:52:01.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.568+0000 7f36d4c56700 1 -- 172.21.15.63:0/3221208305 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d011deb0 con 0x7f36d006f400 2023-12-12T11:52:01.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.568+0000 7f36d4c56700 1 -- 172.21.15.63:0/3221208305 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d011e3c0 con 0x7f36d006f400 2023-12-12T11:52:01.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.569+0000 7f36beffd700 1 -- 172.21.15.63:0/3221208305 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f36c0004290 con 0x7f36d006f400 2023-12-12T11:52:01.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.570+0000 7f36beffd700 1 -- 172.21.15.63:0/3221208305 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36c0013e00 con 0x7f36d006f400 2023-12-12T11:52:01.573 INFO:tasks.workunit.client.1.smithi093.stdout:0/803: dwrite d5/dd/d14/d26/d58/d64/f97 [4194304,4194304] 0 2023-12-12T11:52:01.573 INFO:tasks.workunit.client.1.smithi093.stdout:0/804: creat d5/dd/d14/d26/d58/dab/ff8 x:0 0 0 2023-12-12T11:52:01.576 INFO:tasks.workunit.client.0.smithi063.stdout:0/577: mknod d0/d8e/da7/cc3 0 2023-12-12T11:52:01.576 INFO:tasks.workunit.client.0.smithi063.stdout:0/578: write d0/d1a/d23/d34/f70 [701838,64070] 0 2023-12-12T11:52:01.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.573+0000 7f36beffd700 1 -- 172.21.15.63:0/3221208305 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 24) v1 ==== 88724+0+0 (secure 0 0 0) 0x7f36c000bb80 con 0x7f36d006f400 2023-12-12T11:52:01.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.574+0000 7f36beffd700 1 --2- 172.21.15.63:0/3221208305 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f36b806af10 0x7f36b806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:01.577 INFO:tasks.workunit.client.0.smithi063.stdout:0/579: chown d0/d1a/d23/d2e/f5a 1654 1 2023-12-12T11:52:01.577 INFO:tasks.workunit.client.0.smithi063.stdout:0/580: truncate d0/d1a/d23/f74 247751 0 2023-12-12T11:52:01.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.574+0000 7f36beffd700 1 -- 172.21.15.63:0/3221208305 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f36c008aae0 con 0x7f36d006f400 2023-12-12T11:52:01.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.575+0000 7f36ce59c700 1 --2- 172.21.15.63:0/3221208305 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f36b806af10 0x7f36b806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:01.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.576+0000 7f36ce59c700 1 --2- 172.21.15.63:0/3221208305 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f36b806af10 0x7f36b806d3c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f36c40041d0 tx=0x7f36c40043c0 comp rx=0 tx=0).ready entity=mgr.24471 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:52:01.579 INFO:tasks.workunit.client.1.smithi093.stdout:8/832: mkdir d3/d73/d113 0 2023-12-12T11:52:01.580 INFO:tasks.workunit.client.1.smithi093.stdout:1/819: mkdir d4/d1a/d83/d112 0 2023-12-12T11:52:01.580 INFO:tasks.workunit.client.1.smithi093.stdout:1/820: write d4/dc/d7a/d9c/fe9 [34693,84735] 0 2023-12-12T11:52:01.580 INFO:tasks.workunit.client.1.smithi093.stdout:1/821: write d4/d1a/d1b/d26/d65/d6f/fd9 [110462,12649] 0 2023-12-12T11:52:01.580 INFO:tasks.workunit.client.1.smithi093.stdout:6/934: write d0/d52/d6b/f129 [805266,7936] 0 2023-12-12T11:52:01.580 INFO:tasks.workunit.client.1.smithi093.stdout:6/935: write d0/d52/d7e/faf [2824271,117634] 0 2023-12-12T11:52:01.581 INFO:tasks.workunit.client.1.smithi093.stdout:6/936: write d0/da/d32/d39/d5b/f101 [756541,127932] 0 2023-12-12T11:52:01.581 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.578+0000 7f36d4c56700 1 -- 172.21.15.63:0/3221208305 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b00052e0 con 0x7f36d006f400 2023-12-12T11:52:01.584 INFO:tasks.workunit.client.1.smithi093.stdout:2/807: getdents d5/d14/d2d/d12/d25/d7a/d7e/da5/dfc 0 2023-12-12T11:52:01.585 INFO:tasks.workunit.client.1.smithi093.stdout:7/739: mknod da/d15/d2d/d2f/dc6/cfc 0 2023-12-12T11:52:01.585 INFO:tasks.workunit.client.1.smithi093.stdout:7/740: creat da/de/d78/ffd x:0 0 0 2023-12-12T11:52:01.585 INFO:tasks.workunit.client.1.smithi093.stdout:7/741: chown da/de/d81 2081 1 2023-12-12T11:52:01.587 INFO:tasks.workunit.client.0.smithi063.stdout:8/591: dwrite d4/de/d3b/d62/d36/d57/d84/fb8 [0,4194304] 0 2023-12-12T11:52:01.590 INFO:tasks.workunit.client.1.smithi093.stdout:3/792: truncate df/d22/d49/d69/d78/daf/d3d/d42/d8e/de1/fe5 963777 0 2023-12-12T11:52:01.592 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:01.589+0000 7f36beffd700 1 -- 172.21.15.63:0/3221208305 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f36c0058600 con 0x7f36d006f400 2023-12-12T11:52:01.595 INFO:tasks.workunit.client.1.smithi093.stdout:8/833: write d3/f74 [1647409,106311] 0 2023-12-12T11:52:01.596 INFO:tasks.workunit.client.1.smithi093.stdout:8/834: fsync d3/d1a/d1f/d59/d6c/f93 0 2023-12-12T11:52:01.596 INFO:tasks.workunit.client.0.smithi063.stdout:2/465: sync 2023-12-12T11:52:01.599 INFO:tasks.workunit.client.1.smithi093.stdout:0/805: rename d5/d21/d2f/d54/l94 to d5/d21/d2f/lf9 0 2023-12-12T11:52:01.599 INFO:tasks.workunit.client.1.smithi093.stdout:5/664: dwrite d0/d7/d59/fa1 [0,4194304] 0 2023-12-12T11:52:01.599 INFO:tasks.workunit.client.1.smithi093.stdout:5/665: creat d0/d7/d36/db9/dca/fe6 x:0 0 0 2023-12-12T11:52:01.600 INFO:tasks.workunit.client.1.smithi093.stdout:5/666: write d0/d7/d36/d29/fd5 [279531,108911] 0 2023-12-12T11:52:01.600 INFO:tasks.workunit.client.1.smithi093.stdout:5/667: read - d0/d7/d36/db9/d66/f9a zero size 2023-12-12T11:52:01.600 INFO:tasks.workunit.client.1.smithi093.stdout:5/668: chown d0/d7/d8/f37 22814147 1 2023-12-12T11:52:01.600 INFO:tasks.workunit.client.1.smithi093.stdout:5/669: chown d0/d7/d59/fcf 6 1 2023-12-12T11:52:01.602 INFO:tasks.workunit.client.0.smithi063.stdout:8/592: creat d4/d24/d38/d45/d5b/d92/fb9 x:0 0 0 2023-12-12T11:52:01.607 INFO:tasks.workunit.client.1.smithi093.stdout:8/835: write d3/d1a/f2b [1028910,35929] 0 2023-12-12T11:52:01.613 INFO:tasks.workunit.client.0.smithi063.stdout:2/466: rmdir d0/d1a/d26 39 2023-12-12T11:52:01.625 INFO:tasks.workunit.client.1.smithi093.stdout:3/793: mkdir df/d22/d49/d69/d78/daf/d3d/dfd 0 2023-12-12T11:52:01.625 INFO:tasks.workunit.client.1.smithi093.stdout:7/742: link l5 da/d15/d19/d4c/dc1/lfe 0 2023-12-12T11:52:01.627 INFO:tasks.workunit.client.0.smithi063.stdout:2/467: rename d0/c98 to d0/d1a/d48/d56/c9c 0 2023-12-12T11:52:01.633 INFO:tasks.workunit.client.0.smithi063.stdout:2/468: creat d0/d69/f9d x:0 0 0 2023-12-12T11:52:01.641 INFO:tasks.workunit.client.1.smithi093.stdout:0/806: mknod d5/dd/d14/d26/d58/cfa 0 2023-12-12T11:52:01.641 INFO:tasks.workunit.client.1.smithi093.stdout:0/807: read d5/dd/f16 [457158,92952] 0 2023-12-12T11:52:01.642 INFO:tasks.workunit.client.1.smithi093.stdout:6/937: dwrite d0/d52/d6b/ddb/dfe/f108 [0,4194304] 0 2023-12-12T11:52:01.647 INFO:tasks.workunit.client.1.smithi093.stdout:5/670: mkdir d0/d7/d59/de7 0 2023-12-12T11:52:01.648 INFO:tasks.workunit.client.1.smithi093.stdout:1/822: getdents d4 0 2023-12-12T11:52:01.649 INFO:tasks.workunit.client.1.smithi093.stdout:2/808: mknod d5/c111 0 2023-12-12T11:52:01.650 INFO:tasks.workunit.client.0.smithi063.stdout:0/581: dwrite d0/d7/d27/d44/f56 [0,4194304] 0 2023-12-12T11:52:01.651 INFO:tasks.workunit.client.1.smithi093.stdout:7/743: unlink da/d2e/d89/fbf 0 2023-12-12T11:52:01.651 INFO:tasks.workunit.client.1.smithi093.stdout:7/744: dread - da/d8e/daf/fdc zero size 2023-12-12T11:52:01.654 INFO:tasks.workunit.client.0.smithi063.stdout:8/593: dwrite d4/d24/f5f [0,4194304] 0 2023-12-12T11:52:01.654 INFO:tasks.workunit.client.0.smithi063.stdout:8/594: fdatasync d4/de/d3b/fa8 0 2023-12-12T11:52:01.664 INFO:tasks.workunit.client.1.smithi093.stdout:8/836: dwrite d3/d8/f96 [0,4194304] 0 2023-12-12T11:52:01.672 INFO:tasks.workunit.client.0.smithi063.stdout:0/582: write d0/d7/d27/d44/f85 [499316,110566] 0 2023-12-12T11:52:01.687 INFO:tasks.workunit.client.0.smithi063.stdout:0/583: write d0/d1a/d23/d34/f58 [1068553,113140] 0 2023-12-12T11:52:01.688 INFO:tasks.workunit.client.1.smithi093.stdout:7/745: dread da/d15/d19/d4c/f7a [0,4194304] 0 2023-12-12T11:52:01.691 INFO:tasks.workunit.client.1.smithi093.stdout:6/938: dwrite d0/da/f2e [0,4194304] 0 2023-12-12T11:52:01.693 INFO:tasks.workunit.client.1.smithi093.stdout:0/808: dwrite d5/d21/d27/d3a/f48 [0,4194304] 0 2023-12-12T11:52:01.693 INFO:tasks.workunit.client.1.smithi093.stdout:0/809: chown d5/d21/d27/d3a/d9a 16 1 2023-12-12T11:52:01.710 INFO:tasks.workunit.client.1.smithi093.stdout:3/794: rename df/c1d to df/d22/cfe 0 2023-12-12T11:52:01.713 INFO:tasks.workunit.client.1.smithi093.stdout:1/823: link d4/d1a/d83/ce5 d4/d1a/d1b/d26/d65/d6f/c113 0 2023-12-12T11:52:01.713 INFO:tasks.workunit.client.1.smithi093.stdout:1/824: dread - d4/d81/dfc/f10d zero size 2023-12-12T11:52:01.713 INFO:tasks.workunit.client.1.smithi093.stdout:1/825: write d4/d1a/d1b/d26/f27 [680486,36328] 0 2023-12-12T11:52:01.713 INFO:tasks.workunit.client.1.smithi093.stdout:1/826: chown d4/d1a/d1b/d26/d65/d6f/f89 32582 1 2023-12-12T11:52:01.718 INFO:tasks.workunit.client.1.smithi093.stdout:8/837: symlink d3/d1a/d1f/d29/d63/l114 0 2023-12-12T11:52:01.718 INFO:tasks.workunit.client.1.smithi093.stdout:8/838: chown d3/d8/fda 32728060 1 2023-12-12T11:52:01.718 INFO:tasks.workunit.client.1.smithi093.stdout:8/839: write d3/d1a/d1f/d59/d69/ff8 [917986,130145] 0 2023-12-12T11:52:01.719 INFO:tasks.workunit.client.0.smithi063.stdout:8/595: symlink d4/lba 0 2023-12-12T11:52:01.720 INFO:tasks.workunit.client.1.smithi093.stdout:9/772: sync 2023-12-12T11:52:01.720 INFO:tasks.workunit.client.1.smithi093.stdout:9/773: symlink d1/d23/d24/d29/d43/d56/d85/dc3/dce/l107 2 2023-12-12T11:52:01.720 INFO:tasks.workunit.client.1.smithi093.stdout:9/774: write d1/d23/d24/ffe [715411,75787] 0 2023-12-12T11:52:01.726 INFO:tasks.workunit.client.0.smithi063.stdout:8/596: symlink d4/de/d3b/d62/d36/d57/d84/lbb 0 2023-12-12T11:52:01.729 INFO:tasks.workunit.client.1.smithi093.stdout:7/746: creat da/d15/d59/de0/fff x:0 0 0 2023-12-12T11:52:01.729 INFO:tasks.workunit.client.1.smithi093.stdout:3/795: write df/d22/d49/d69/d78/daf/d3d/d6f/db1/fdb [1503262,52580] 0 2023-12-12T11:52:01.732 INFO:tasks.workunit.client.0.smithi063.stdout:8/597: rename d4/d24/d38/d45/d5b/f8c to d4/de/d3b/d62/d36/d57/d84/fbc 0 2023-12-12T11:52:01.732 INFO:tasks.workunit.client.0.smithi063.stdout:8/598: fdatasync d4/de/d3b/d62/d36/f73 0 2023-12-12T11:52:01.735 INFO:tasks.workunit.client.1.smithi093.stdout:0/810: mkdir d5/dd/d14/d99/dfb 0 2023-12-12T11:52:01.740 INFO:tasks.workunit.client.1.smithi093.stdout:5/671: rename d0/d7/d59/d48/fb4 to d0/d7/d36/fe8 0 2023-12-12T11:52:01.743 INFO:tasks.workunit.client.0.smithi063.stdout:8/599: unlink d4/lba 0 2023-12-12T11:52:01.744 INFO:tasks.workunit.client.1.smithi093.stdout:1/827: mknod d4/d1a/d83/d112/c114 0 2023-12-12T11:52:01.745 INFO:tasks.workunit.client.1.smithi093.stdout:1/828: truncate d4/dc/feb 707962 0 2023-12-12T11:52:01.745 INFO:tasks.workunit.client.1.smithi093.stdout:1/829: write d4/d85/f100 [130917,57368] 0 2023-12-12T11:52:01.745 INFO:tasks.workunit.client.1.smithi093.stdout:7/747: dread da/d15/f16 [0,4194304] 0 2023-12-12T11:52:01.746 INFO:tasks.workunit.client.0.smithi063.stdout:4/608: sync 2023-12-12T11:52:01.746 INFO:tasks.workunit.client.0.smithi063.stdout:4/609: chown d2/d48/d4f/l67 2 1 2023-12-12T11:52:01.747 INFO:tasks.workunit.client.0.smithi063.stdout:4/610: write d2/d48/d69/d98/fad [451379,111079] 0 2023-12-12T11:52:01.747 INFO:tasks.workunit.client.1.smithi093.stdout:8/840: mkdir d3/d1a/d1f/d59/d69/dbc/dc2/d115 0 2023-12-12T11:52:01.748 INFO:tasks.workunit.client.1.smithi093.stdout:8/841: creat d3/d1a/d1f/d29/d63/f116 x:0 0 0 2023-12-12T11:52:01.748 INFO:tasks.workunit.client.1.smithi093.stdout:8/842: chown d3/d1a/d1f/d29/l4a 42 1 2023-12-12T11:52:01.748 INFO:tasks.workunit.client.1.smithi093.stdout:8/843: stat d3/d1a/fab 0 2023-12-12T11:52:01.748 INFO:tasks.workunit.client.0.smithi063.stdout:8/600: symlink d4/d24/lbd 0 2023-12-12T11:52:01.750 INFO:tasks.workunit.client.0.smithi063.stdout:4/611: mkdir d2/d17/d61/dc5 0 2023-12-12T11:52:01.752 INFO:tasks.workunit.client.1.smithi093.stdout:3/796: mknod df/d30/d33/cff 0 2023-12-12T11:52:01.752 INFO:tasks.workunit.client.1.smithi093.stdout:3/797: write df/d30/d33/ff5 [1706237,125034] 0 2023-12-12T11:52:01.754 INFO:tasks.workunit.client.0.smithi063.stdout:0/584: dwrite d0/d7/f98 [0,4194304] 0 2023-12-12T11:52:01.754 INFO:tasks.workunit.client.0.smithi063.stdout:0/585: write d0/d1a/d66/fbb [843029,86584] 0 2023-12-12T11:52:01.755 INFO:tasks.workunit.client.1.smithi093.stdout:0/811: creat d5/ffc x:0 0 0 2023-12-12T11:52:01.759 INFO:tasks.workunit.client.0.smithi063.stdout:4/612: creat d2/fc6 x:0 0 0 2023-12-12T11:52:01.759 INFO:tasks.workunit.client.0.smithi063.stdout:8/601: truncate f3 450494 0 2023-12-12T11:52:01.759 INFO:tasks.workunit.client.1.smithi093.stdout:9/775: dwrite d1/d23/d24/d29/d43/d56/d85/dc3/dce/d3e/fed [0,4194304] 0 2023-12-12T11:52:01.760 INFO:tasks.workunit.client.1.smithi093.stdout:6/939: rename d0/d52/d6b/fa4 to d0/da/d32/df7/d143/f149 0 2023-12-12T11:52:01.762 INFO:tasks.workunit.client.1.smithi093.stdout:5/672: mkdir d0/d7/d36/d38/dce/de9 0 2023-12-12T11:52:01.764 INFO:tasks.workunit.client.1.smithi093.stdout:1/830: symlink d4/d1a/d1b/d26/d82/l115 0 2023-12-12T11:52:01.764 INFO:tasks.workunit.client.1.smithi093.stdout:1/831: creat d4/d1a/d73/f116 x:0 0 0 2023-12-12T11:52:01.768 INFO:tasks.workunit.client.1.smithi093.stdout:7/748: mkdir da/de/d100 0 2023-12-12T11:52:01.770 INFO:tasks.workunit.client.0.smithi063.stdout:8/602: truncate d4/f4e 255058 0 2023-12-12T11:52:01.771 INFO:tasks.workunit.client.0.smithi063.stdout:8/603: fsync d4/de/d1e/d6d/fb1 0 2023-12-12T11:52:01.771 INFO:tasks.workunit.client.0.smithi063.stdout:8/604: fsync d4/de/d1e/f33 0 2023-12-12T11:52:01.771 INFO:tasks.workunit.client.0.smithi063.stdout:8/605: write d4/d24/f96 [163366,29449] 0 2023-12-12T11:52:01.771 INFO:tasks.workunit.client.1.smithi093.stdout:8/844: symlink d3/d8/d88/l117 0 2023-12-12T11:52:01.774 INFO:tasks.workunit.client.1.smithi093.stdout:3/798: symlink df/d22/d49/d69/d78/daf/d3d/d6f/l100 0 2023-12-12T11:52:01.776 INFO:tasks.workunit.client.1.smithi093.stdout:5/673: write d0/d7/d36/f90 [3494126,82853] 0 2023-12-12T11:52:01.776 INFO:tasks.workunit.client.1.smithi093.stdout:5/674: creat d0/d7/d85/fea x:0 0 0 2023-12-12T11:52:01.777 INFO:tasks.workunit.client.1.smithi093.stdout:0/812: creat d5/dd/d14/d26/d58/d64/ffd x:0 0 0 2023-12-12T11:52:01.782 INFO:tasks.workunit.client.0.smithi063.stdout:8/606: creat d4/d55/d52/d8e/fbe x:0 0 0 2023-12-12T11:52:01.782 INFO:tasks.workunit.client.0.smithi063.stdout:8/607: stat d4/d24/d38/d45/c4c 0 2023-12-12T11:52:01.785 INFO:tasks.workunit.client.0.smithi063.stdout:8/608: mknod d4/cbf 0 2023-12-12T11:52:01.800 INFO:tasks.workunit.client.0.smithi063.stdout:8/609: rename d4/cbf to d4/de/cc0 0 2023-12-12T11:52:01.800 INFO:tasks.workunit.client.0.smithi063.stdout:8/610: dread - d4/de/d3b/d62/fa6 zero size 2023-12-12T11:52:01.807 INFO:tasks.workunit.client.1.smithi093.stdout:9/776: creat d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/d42/dd3/f108 x:0 0 0 2023-12-12T11:52:01.808 INFO:tasks.workunit.client.1.smithi093.stdout:6/940: symlink d0/da/d14/d3a/d95/d11f/l14a 0 2023-12-12T11:52:01.811 INFO:tasks.workunit.client.1.smithi093.stdout:7/749: dwrite da/d15/d19/d90/ff7 [0,4194304] 0 2023-12-12T11:52:01.811 INFO:tasks.workunit.client.1.smithi093.stdout:1/832: dwrite d4/d1a/d83/d9a/fd0 [0,4194304] 0 2023-12-12T11:52:01.811 INFO:tasks.workunit.client.1.smithi093.stdout:7/750: chown da/d15/d19/l85 226040642 1 2023-12-12T11:52:01.814 INFO:tasks.workunit.client.1.smithi093.stdout:8/845: rename d3/d1a/fab to d3/d1a/d1f/d29/d30/d58/d76/f118 0 2023-12-12T11:52:01.818 INFO:tasks.workunit.client.0.smithi063.stdout:8/611: dread d4/de/d3b/d62/d6e/d76/f7a [0,4194304] 0 2023-12-12T11:52:01.818 INFO:tasks.workunit.client.0.smithi063.stdout:8/612: chown d4/de/d1e/f64 0 1 2023-12-12T11:52:01.819 INFO:tasks.workunit.client.0.smithi063.stdout:8/613: creat d4/d55/d52/d8e/fc1 x:0 0 0 2023-12-12T11:52:01.820 INFO:tasks.workunit.client.1.smithi093.stdout:5/675: truncate d0/d7/d8/d9e/d6a/f72 987637 0 2023-12-12T11:52:01.823 INFO:tasks.workunit.client.0.smithi063.stdout:8/614: mkdir d4/d24/d38/d45/dc2 0 2023-12-12T11:52:01.825 INFO:tasks.workunit.client.1.smithi093.stdout:6/941: link d0/da/d14/d21/fa5 d0/da/d32/d132/f14b 0 2023-12-12T11:52:01.825 INFO:tasks.workunit.client.1.smithi093.stdout:6/942: write d0/d52/d6b/ddb/dfe/fad [58438,30109] 0 2023-12-12T11:52:01.826 INFO:tasks.workunit.client.1.smithi093.stdout:2/809: sync 2023-12-12T11:52:01.829 INFO:tasks.workunit.client.0.smithi063.stdout:8/615: rmdir d4/de/d3b/d62/d36/d57/d84 39 2023-12-12T11:52:01.829 INFO:tasks.workunit.client.1.smithi093.stdout:7/751: write da/d15/d19/f7c [1811040,27945] 0 2023-12-12T11:52:01.830 INFO:tasks.workunit.client.0.smithi063.stdout:8/616: write d4/de/d3b/d62/fa6 [348132,117527] 0 2023-12-12T11:52:01.832 INFO:tasks.workunit.client.1.smithi093.stdout:3/799: rename df/d22/d49/d69/ceb to df/d22/d49/d69/d78/daf/d3d/d59/d72/dcc/c101 0 2023-12-12T11:52:01.834 INFO:tasks.workunit.client.0.smithi063.stdout:0/586: dwrite d0/d7/d27/d1f/f2c [0,4194304] 0 2023-12-12T11:52:01.834 INFO:tasks.workunit.client.0.smithi063.stdout:0/587: write d0/d7/d27/d19/d2d/f82 [351322,89692] 0 2023-12-12T11:52:01.834 INFO:tasks.workunit.client.1.smithi093.stdout:8/846: creat d3/d1a/d1f/d29/d30/d110/f119 x:0 0 0 2023-12-12T11:52:01.839 INFO:tasks.workunit.client.0.smithi063.stdout:0/588: unlink d0/f50 0 2023-12-12T11:52:01.839 INFO:tasks.workunit.client.0.smithi063.stdout:0/589: fsync d0/d1a/d66/f87 0 2023-12-12T11:52:01.841 INFO:tasks.workunit.client.1.smithi093.stdout:5/676: symlink d0/d7/d36/db9/d66/leb 0 2023-12-12T11:52:01.845 INFO:tasks.workunit.client.1.smithi093.stdout:9/777: getdents d1/d23/d24/d29/d43 0 2023-12-12T11:52:01.846 INFO:tasks.workunit.client.1.smithi093.stdout:9/778: creat d1/d23/d6b/d92/db2/f109 x:0 0 0 2023-12-12T11:52:01.850 INFO:tasks.workunit.client.1.smithi093.stdout:6/943: creat d0/f14c x:0 0 0 2023-12-12T11:52:01.850 INFO:tasks.workunit.client.1.smithi093.stdout:8/847: dread d3/d8/fe4 [0,4194304] 0 2023-12-12T11:52:01.855 INFO:tasks.workunit.client.1.smithi093.stdout:7/752: read da/de/d46/f52 [1499222,54557] 0 2023-12-12T11:52:01.855 INFO:tasks.workunit.client.1.smithi093.stdout:7/753: readlink da/d2e/l35 0 2023-12-12T11:52:01.858 INFO:tasks.workunit.client.0.smithi063.stdout:0/590: rename d0/d7/d27/d19/d2d to d0/d7/d27/d1f/dc4 0 2023-12-12T11:52:01.861 INFO:tasks.workunit.client.1.smithi093.stdout:0/813: rename d5/dd/d33/c98 to d5/d41/d77/d79/df2/cfe 0 2023-12-12T11:52:01.861 INFO:tasks.workunit.client.1.smithi093.stdout:0/814: readlink d5/d21/d2f/lce 0 2023-12-12T11:52:01.861 INFO:tasks.workunit.client.1.smithi093.stdout:0/815: write d5/dd/d14/d26/d58/d64/fc5 [477004,87461] 0 2023-12-12T11:52:01.863 INFO:tasks.workunit.client.1.smithi093.stdout:3/800: mkdir df/d22/d49/d69/d78/daf/d102 0 2023-12-12T11:52:01.863 INFO:tasks.workunit.client.1.smithi093.stdout:3/801: fsync df/d22/d49/d69/d78/daf/d3d/d59/d9c/fcd 0 2023-12-12T11:52:01.868 INFO:tasks.workunit.client.0.smithi063.stdout:0/591: link d0/d1a/d23/d34/f70 d0/d7/d27/fc5 0 2023-12-12T11:52:01.868 INFO:tasks.workunit.client.0.smithi063.stdout:0/592: chown d0/d7/d27/d1f/dc4/d67/fc0 1170747 1 2023-12-12T11:52:01.871 INFO:tasks.workunit.client.1.smithi093.stdout:9/779: unlink d1/d23/d24/d29/d43/d56/d85/dc3/dce/f1c 0 2023-12-12T11:52:01.873 INFO:tasks.workunit.client.1.smithi093.stdout:2/810: dwrite d5/d31/f64 [0,4194304] 0 2023-12-12T11:52:01.875 INFO:tasks.workunit.client.0.smithi063.stdout:0/593: symlink d0/d7/d27/d1f/dc4/d67/lc6 0 2023-12-12T11:52:01.875 INFO:tasks.workunit.client.0.smithi063.stdout:0/594: stat d0/d7/d27/d1f/f3f 0 2023-12-12T11:52:01.875 INFO:tasks.workunit.client.0.smithi063.stdout:0/595: creat d0/d1a/d23/d34/d42/d99/fc7 x:0 0 0 2023-12-12T11:52:01.875 INFO:tasks.workunit.client.0.smithi063.stdout:0/596: read d0/d7/ff [2544684,38333] 0 2023-12-12T11:52:01.876 INFO:tasks.workunit.client.1.smithi093.stdout:6/944: truncate d0/d52/d6b/ddb/dfe/f7d 1770264 0 2023-12-12T11:52:01.878 INFO:tasks.workunit.client.1.smithi093.stdout:8/848: truncate d3/d8/f7d 96331 0 2023-12-12T11:52:01.879 INFO:tasks.workunit.client.0.smithi063.stdout:1/633: sync 2023-12-12T11:52:01.881 INFO:tasks.workunit.client.1.smithi093.stdout:7/754: mknod da/d15/d19/d4c/d6d/c101 0 2023-12-12T11:52:01.883 INFO:tasks.workunit.client.0.smithi063.stdout:0/597: unlink d0/d1a/d23/f75 0 2023-12-12T11:52:01.885 INFO:tasks.workunit.client.1.smithi093.stdout:1/833: rename d4/d85/lf4 to d4/d1a/d83/d9a/de7/l117 0 2023-12-12T11:52:01.885 INFO:tasks.workunit.client.1.smithi093.stdout:0/816: rmdir d5/dd/d14/d26 39 2023-12-12T11:52:01.885 INFO:tasks.workunit.client.1.smithi093.stdout:3/802: symlink df/d25/dd2/l103 0 2023-12-12T11:52:01.887 INFO:tasks.workunit.client.1.smithi093.stdout:5/677: dwrite d0/d7/d59/faf [0,4194304] 0 2023-12-12T11:52:01.888 INFO:tasks.workunit.client.1.smithi093.stdout:2/811: truncate d5/f49 6631155 0 2023-12-12T11:52:01.891 INFO:tasks.workunit.client.0.smithi063.stdout:8/617: dwrite d4/de/f13 [0,4194304] 0 2023-12-12T11:52:01.891 INFO:tasks.workunit.client.1.smithi093.stdout:7/755: mknod da/d8e/daa/dd6/c102 0 2023-12-12T11:52:01.892 INFO:tasks.workunit.client.1.smithi093.stdout:9/780: rename d1/d23/d24/d29/d43/d56/d85/l86 to d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/db1/dbc/l10a 0 2023-12-12T11:52:01.894 INFO:tasks.workunit.client.1.smithi093.stdout:1/834: link d4/d1c/d2a/f2c d4/d1a/d83/d112/f118 0 2023-12-12T11:52:01.899 INFO:tasks.workunit.client.1.smithi093.stdout:7/756: mknod da/c103 0 2023-12-12T11:52:01.899 INFO:tasks.workunit.client.1.smithi093.stdout:3/803: dread df/d22/d49/d69/d78/daf/d3d/d42/f57 [0,4194304] 0 2023-12-12T11:52:01.899 INFO:tasks.workunit.client.1.smithi093.stdout:3/804: truncate df/d22/d49/d69/d78/daf/d3d/d59/fe7 484563 0 2023-12-12T11:52:01.900 INFO:tasks.workunit.client.1.smithi093.stdout:0/817: rename d5/dd/f4f to d5/d21/d2f/d54/d7e/fff 0 2023-12-12T11:52:01.901 INFO:tasks.workunit.client.1.smithi093.stdout:0/818: write d5/d78/fbd [57783,118329] 0 2023-12-12T11:52:01.901 INFO:tasks.workunit.client.1.smithi093.stdout:0/819: write d5/d41/d77/fe4 [38117,91401] 0 2023-12-12T11:52:01.901 INFO:tasks.workunit.client.1.smithi093.stdout:0/820: write d5/d41/fc2 [782737,14218] 0 2023-12-12T11:52:01.902 INFO:tasks.workunit.client.1.smithi093.stdout:8/849: read d3/d1a/d1f/d59/fcd [1285432,104870] 0 2023-12-12T11:52:01.902 INFO:tasks.workunit.client.1.smithi093.stdout:1/835: dread d4/d1c/d2a/f3d [0,4194304] 0 2023-12-12T11:52:01.907 INFO:tasks.workunit.client.0.smithi063.stdout:8/618: symlink d4/de/d3b/d62/d36/d57/lc3 0 2023-12-12T11:52:01.916 INFO:tasks.workunit.client.1.smithi093.stdout:9/781: dread d1/d23/d6b/f8c [0,4194304] 0 2023-12-12T11:52:01.921 INFO:tasks.workunit.client.0.smithi063.stdout:8/619: creat d4/de/d3b/d62/fc4 x:0 0 0 2023-12-12T11:52:01.926 INFO:tasks.workunit.client.1.smithi093.stdout:2/812: write d5/d14/d2d/fcb [2447906,81215] 0 2023-12-12T11:52:01.926 INFO:tasks.workunit.client.1.smithi093.stdout:2/813: chown d5/d14/d2d/d8b/da3/de5/l10d 5006 1 2023-12-12T11:52:01.926 INFO:tasks.workunit.client.0.smithi063.stdout:8/620: mkdir d4/de/d3b/d62/d36/dc5 0 2023-12-12T11:52:01.926 INFO:tasks.workunit.client.0.smithi063.stdout:8/621: write d4/d24/d38/d45/d5b/d92/fb9 [431899,45905] 0 2023-12-12T11:52:01.926 INFO:tasks.workunit.client.0.smithi063.stdout:8/622: write d4/de/d1e/d6d/f97 [248812,89565] 0 2023-12-12T11:52:01.927 INFO:tasks.workunit.client.1.smithi093.stdout:0/821: rmdir d5/dd/d14/d26/d58/d64 39 2023-12-12T11:52:01.927 INFO:tasks.workunit.client.1.smithi093.stdout:8/850: truncate d3/d1a/d1f/d29/d3a/d8f/fcc 153644 0 2023-12-12T11:52:01.935 INFO:tasks.workunit.client.1.smithi093.stdout:9/782: dread d1/d23/d24/d29/d43/d56/d68/fbe [0,4194304] 0 2023-12-12T11:52:01.937 INFO:tasks.workunit.client.0.smithi063.stdout:8/623: mkdir d4/de/d3b/d62/d36/dc6 0 2023-12-12T11:52:01.938 INFO:tasks.workunit.client.0.smithi063.stdout:8/624: write d4/de/d1e/d6d/fb1 [510450,115348] 0 2023-12-12T11:52:01.938 INFO:tasks.workunit.client.0.smithi063.stdout:8/625: chown d4/f22 2631 1 2023-12-12T11:52:01.938 INFO:tasks.workunit.client.0.smithi063.stdout:8/626: dread - d4/de/d3b/fa4 zero size 2023-12-12T11:52:01.941 INFO:tasks.workunit.client.1.smithi093.stdout:9/783: creat d1/d23/d6b/d92/f10b x:0 0 0 2023-12-12T11:52:01.944 INFO:tasks.workunit.client.1.smithi093.stdout:5/678: rename d0/d7/d8/d8f to d0/dec 0 2023-12-12T11:52:01.946 INFO:tasks.workunit.client.1.smithi093.stdout:1/836: dread d4/d1a/d1b/d26/d65/d6f/f96 [8388608,4194304] 0 2023-12-12T11:52:01.951 INFO:tasks.workunit.client.1.smithi093.stdout:0/822: creat d5/dd/d14/f100 x:0 0 0 2023-12-12T11:52:01.952 INFO:tasks.workunit.client.1.smithi093.stdout:9/784: symlink d1/d23/d24/d29/d43/d56/de9/l10c 0 2023-12-12T11:52:01.955 INFO:tasks.workunit.client.1.smithi093.stdout:5/679: unlink d0/cd9 0 2023-12-12T11:52:01.955 INFO:tasks.workunit.client.1.smithi093.stdout:5/680: chown d0/d7/d85/da0/cde 82840 1 2023-12-12T11:52:01.955 INFO:tasks.workunit.client.1.smithi093.stdout:5/681: chown d0/d7/d8/f5d 0 1 2023-12-12T11:52:01.955 INFO:tasks.workunit.client.1.smithi093.stdout:5/682: creat d0/d7/d59/fed x:0 0 0 2023-12-12T11:52:01.955 INFO:tasks.workunit.client.1.smithi093.stdout:5/683: write d0/d7/d36/db9/d66/d7c/fd3 [1039360,59332] 0 2023-12-12T11:52:01.955 INFO:tasks.workunit.client.1.smithi093.stdout:5/684: chown d0/d7/d8/c2c 6034930 1 2023-12-12T11:52:01.956 INFO:tasks.workunit.client.1.smithi093.stdout:5/685: chown d0/d7/d36/d38/cd1 1 1 2023-12-12T11:52:01.956 INFO:tasks.workunit.client.1.smithi093.stdout:1/837: creat d4/d1a/d83/d9a/df7/f119 x:0 0 0 2023-12-12T11:52:01.958 INFO:tasks.workunit.client.1.smithi093.stdout:0/823: rename d5/d21/d27/fd7 to d5/d21/d27/d3a/d9a/dc8/f101 0 2023-12-12T11:52:01.963 INFO:tasks.workunit.client.1.smithi093.stdout:2/814: dread d5/fbf [0,4194304] 0 2023-12-12T11:52:01.964 INFO:tasks.workunit.client.1.smithi093.stdout:9/785: creat d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d57/f10d x:0 0 0 2023-12-12T11:52:01.965 INFO:tasks.workunit.client.1.smithi093.stdout:1/838: rename d4/d81/fb1 to d4/f11a 0 2023-12-12T11:52:01.965 INFO:tasks.workunit.client.1.smithi093.stdout:1/839: fdatasync d4/d1a/d83/d9a/fd0 0 2023-12-12T11:52:01.966 INFO:tasks.workunit.client.1.smithi093.stdout:3/805: dwrite df/f10 [4194304,4194304] 0 2023-12-12T11:52:01.966 INFO:tasks.workunit.client.0.smithi063.stdout:0/598: dwrite d0/d1a/d23/f7e [0,4194304] 0 2023-12-12T11:52:01.969 INFO:tasks.workunit.client.0.smithi063.stdout:1/634: dwrite d3/db/d16/d24/f78 [0,4194304] 0 2023-12-12T11:52:01.970 INFO:tasks.workunit.client.1.smithi093.stdout:2/815: creat d5/d14/d2d/d4c/d54/d67/f112 x:0 0 0 2023-12-12T11:52:01.970 INFO:tasks.workunit.client.1.smithi093.stdout:2/816: chown d5/d14/d2d/d12/d25/d7a/d7e/da0/fa9 51336 1 2023-12-12T11:52:01.971 INFO:tasks.workunit.client.1.smithi093.stdout:2/817: fdatasync d5/d14/d47/d4e/f8a 0 2023-12-12T11:52:01.980 INFO:tasks.workunit.client.1.smithi093.stdout:9/786: mknod d1/d23/d24/d29/d43/dfc/c10e 0 2023-12-12T11:52:01.981 INFO:tasks.workunit.client.1.smithi093.stdout:9/787: readlink d1/d23/d24/d29/d43/d56/laa 0 2023-12-12T11:52:01.981 INFO:tasks.workunit.client.1.smithi093.stdout:2/818: mknod d5/d14/d2d/d96/c113 0 2023-12-12T11:52:01.983 INFO:tasks.workunit.client.1.smithi093.stdout:8/851: dwrite d3/f74 [0,4194304] 0 2023-12-12T11:52:01.986 INFO:tasks.workunit.client.0.smithi063.stdout:0/599: dread d0/d1a/d23/f74 [0,4194304] 0 2023-12-12T11:52:01.986 INFO:tasks.workunit.client.0.smithi063.stdout:0/600: readlink d0/d1a/l8b 0 2023-12-12T11:52:01.986 INFO:tasks.workunit.client.0.smithi063.stdout:0/601: readlink d0/d1a/d23/d2e/d84/l89 0 2023-12-12T11:52:01.988 INFO:tasks.workunit.client.1.smithi093.stdout:9/788: mkdir d1/d23/d24/d29/d43/d56/de9/d10f 0 2023-12-12T11:52:01.988 INFO:tasks.workunit.client.1.smithi093.stdout:9/789: write d1/d23/d24/d29/d43/f48 [1806730,63432] 0 2023-12-12T11:52:01.995 INFO:tasks.workunit.client.1.smithi093.stdout:2/819: rename d5/d14/d5e/f70 to d5/d14/d2d/d12/d25/d7a/d7e/da0/f114 0 2023-12-12T11:52:02.001 INFO:tasks.workunit.client.0.smithi063.stdout:8/627: dwrite d4/d24/f5f [4194304,4194304] 0 2023-12-12T11:52:02.004 INFO:tasks.workunit.client.1.smithi093.stdout:6/945: dwrite d0/d52/d7e/d42/f8e [0,4194304] 0 2023-12-12T11:52:02.004 INFO:tasks.workunit.client.1.smithi093.stdout:7/757: dwrite da/de/d46/d4f/fef [0,4194304] 0 2023-12-12T11:52:02.007 INFO:tasks.workunit.client.1.smithi093.stdout:0/824: write d5/d21/d27/d3a/d9a/fa7 [3049425,97145] 0 2023-12-12T11:52:02.007 INFO:tasks.workunit.client.1.smithi093.stdout:0/825: fsync d5/dd/f16 0 2023-12-12T11:52:02.007 INFO:tasks.workunit.client.1.smithi093.stdout:0/826: stat d5/dd/dbb 0 2023-12-12T11:52:02.007 INFO:tasks.workunit.client.0.smithi063.stdout:0/602: dread d0/f21 [0,4194304] 0 2023-12-12T11:52:02.012 INFO:tasks.workunit.client.1.smithi093.stdout:5/686: write d0/d7/d59/f60 [3096157,84208] 0 2023-12-12T11:52:02.035 INFO:tasks.workunit.client.1.smithi093.stdout:1/840: dwrite d4/d1a/f6b [0,4194304] 0 2023-12-12T11:52:02.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.033+0000 7f36d4c56700 1 -- 172.21.15.63:0/3221208305 --> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f36b0000bf0 con 0x7f36b806af10 2023-12-12T11:52:02.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.036+0000 7f36beffd700 1 -- 172.21.15.63:0/3221208305 <== mgr.24471 v2:172.21.15.93:6828/3441331233 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f36b0000bf0 con 0x7f36b806af10 2023-12-12T11:52:02.042 INFO:tasks.workunit.client.1.smithi093.stdout:9/790: dread d1/d23/d24/d29/d43/d58/f78 [0,4194304] 0 2023-12-12T11:52:02.042 INFO:tasks.workunit.client.1.smithi093.stdout:9/791: write d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d57/d9e/ff6 [371345,8910] 0 2023-12-12T11:52:02.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:01 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:02.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:01 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:02.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:01 smithi063 ceph-mon[107117]: pgmap v15: 65 pgs: 65 active+clean; 2.6 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 151 MiB/s rd, 185 MiB/s wr, 275 op/s 2023-12-12T11:52:02.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:01 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:02.046 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:01 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:02.046 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:01 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:02.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.043+0000 7f36d4c56700 1 -- 172.21.15.63:0/3221208305 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f36b806af10 msgr2=0x7f36b806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:02.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.043+0000 7f36d4c56700 1 --2- 172.21.15.63:0/3221208305 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f36b806af10 0x7f36b806d3c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f36c40041d0 tx=0x7f36c40043c0 comp rx=0 tx=0).stop 2023-12-12T11:52:02.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.043+0000 7f36d4c56700 1 -- 172.21.15.63:0/3221208305 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36d006f400 msgr2=0x7f36d011d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:02.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.043+0000 7f36d4c56700 1 --2- 172.21.15.63:0/3221208305 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36d006f400 0x7f36d011d8b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f36c0009fd0 tx=0x7f36c0009e30 comp rx=0 tx=0).stop 2023-12-12T11:52:02.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.044+0000 7f36d4c56700 1 -- 172.21.15.63:0/3221208305 shutdown_connections 2023-12-12T11:52:02.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.044+0000 7f36d4c56700 1 --2- 172.21.15.63:0/3221208305 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f36b806af10 0x7f36b806d3c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:02.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.044+0000 7f36d4c56700 1 --2- 172.21.15.63:0/3221208305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36d0071bc0 0x7f36d006eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:02.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.044+0000 7f36d4c56700 1 --2- 172.21.15.63:0/3221208305 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36d006f400 0x7f36d011d8b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:02.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.044+0000 7f36d4c56700 1 -- 172.21.15.63:0/3221208305 >> 172.21.15.63:0/3221208305 conn(0x7f36d00f82d0 msgr2=0x7f36d00fa670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:52:02.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.044+0000 7f36d4c56700 1 -- 172.21.15.63:0/3221208305 shutdown_connections 2023-12-12T11:52:02.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.044+0000 7f36d4c56700 1 -- 172.21.15.63:0/3221208305 wait complete. 2023-12-12T11:52:02.064 INFO:tasks.workunit.client.1.smithi093.stdout:9/792: dread d1/d23/d24/d29/d43/d56/d85/dc3/dce/f4c [0,4194304] 0 2023-12-12T11:52:02.064 INFO:tasks.workunit.client.1.smithi093.stdout:9/793: write d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/db1/dbc/f104 [705197,35749] 0 2023-12-12T11:52:02.064 INFO:tasks.workunit.client.1.smithi093.stdout:9/794: write d1/f54 [496472,86300] 0 2023-12-12T11:52:02.065 INFO:tasks.workunit.client.1.smithi093.stdout:9/795: chown d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f 4565714 1 2023-12-12T11:52:02.065 INFO:tasks.workunit.client.1.smithi093.stdout:9/796: truncate d1/d23/d24/ffe 1379473 0 2023-12-12T11:52:02.065 INFO:tasks.workunit.client.1.smithi093.stdout:9/797: fsync d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/f70 0 2023-12-12T11:52:02.078 INFO:tasks.workunit.client.1.smithi093.stdout:8/852: mkdir d3/d1a/d1f/d59/ddb/d11a 0 2023-12-12T11:52:02.082 INFO:tasks.workunit.client.1.smithi093.stdout:5/687: dwrite d0/d7/d36/db9/dca/fe4 [0,4194304] 0 2023-12-12T11:52:02.082 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-12T11:52:02.088 INFO:tasks.workunit.client.1.smithi093.stdout:9/798: dread d1/f4f [0,4194304] 0 2023-12-12T11:52:02.088 INFO:tasks.workunit.client.1.smithi093.stdout:9/799: chown d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/d42/fdf 109574 1 2023-12-12T11:52:02.095 INFO:tasks.workunit.client.1.smithi093.stdout:1/841: dwrite d4/d1a/d1b/d26/d65/dc8/ffa [0,4194304] 0 2023-12-12T11:52:02.095 INFO:tasks.workunit.client.1.smithi093.stdout:1/842: readlink d4/d1a/lb8 0 2023-12-12T11:52:02.097 INFO:tasks.workunit.client.0.smithi063.stdout:8/628: creat d4/de/d3b/d62/d36/d57/fc7 x:0 0 0 2023-12-12T11:52:02.097 INFO:tasks.workunit.client.0.smithi063.stdout:8/629: dread - d4/d55/d52/d8e/fbe zero size 2023-12-12T11:52:02.098 INFO:tasks.workunit.client.0.smithi063.stdout:0/603: dwrite d0/d7/d27/d19/fc1 [0,4194304] 0 2023-12-12T11:52:02.098 INFO:tasks.workunit.client.0.smithi063.stdout:0/604: chown d0/d7/la 112 1 2023-12-12T11:52:02.098 INFO:tasks.workunit.client.0.smithi063.stdout:0/605: fdatasync d0/d1a/d23/f9a 0 2023-12-12T11:52:02.104 INFO:tasks.workunit.client.1.smithi093.stdout:6/946: symlink d0/da/d14/d3a/d106/l14d 0 2023-12-12T11:52:02.104 INFO:tasks.workunit.client.1.smithi093.stdout:6/947: write d0/d52/d7e/f68 [834566,44888] 0 2023-12-12T11:52:02.104 INFO:tasks.workunit.client.1.smithi093.stdout:6/948: chown d0/d52/d13b 8140 1 2023-12-12T11:52:02.106 INFO:tasks.workunit.client.1.smithi093.stdout:7/758: mknod da/d15/d19/d90/d7d/dd1/c104 0 2023-12-12T11:52:02.106 INFO:tasks.workunit.client.1.smithi093.stdout:7/759: fdatasync da/d15/d2d/f6e 0 2023-12-12T11:52:02.112 INFO:tasks.workunit.client.1.smithi093.stdout:0/827: link d5/dd/d62/fec d5/d21/d27/d3a/d9a/db5/db8/dd4/f102 0 2023-12-12T11:52:02.112 INFO:tasks.workunit.client.1.smithi093.stdout:0/828: chown d5/d21/d2f/d54/d7e/lcf 30039 1 2023-12-12T11:52:02.112 INFO:tasks.workunit.client.1.smithi093.stdout:0/829: readlink d5/dd/d14/d26/d58/d64/ddb/le3 0 2023-12-12T11:52:02.122 INFO:tasks.workunit.client.0.smithi063.stdout:8/630: dread d4/f9c [0,4194304] 0 2023-12-12T11:52:02.130 INFO:tasks.workunit.client.1.smithi093.stdout:7/760: dread da/de/d46/d4f/f62 [0,4194304] 0 2023-12-12T11:52:02.136 INFO:tasks.workunit.client.1.smithi093.stdout:5/688: dwrite d0/d7/d59/f7e [0,4194304] 0 2023-12-12T11:52:02.141 INFO:tasks.workunit.client.0.smithi063.stdout:8/631: dread d4/de/f41 [0,4194304] 0 2023-12-12T11:52:02.142 INFO:tasks.workunit.client.0.smithi063.stdout:8/632: truncate d4/de/d1e/f3c 4799851 0 2023-12-12T11:52:02.177 INFO:tasks.workunit.client.1.smithi093.stdout:5/689: dwrite d0/d7/d36/d87/fcd [4194304,4194304] 0 2023-12-12T11:52:02.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:01 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:02.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:01 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:02.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:01 smithi093 ceph-mon[115914]: pgmap v15: 65 pgs: 65 active+clean; 2.6 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 151 MiB/s rd, 185 MiB/s wr, 275 op/s 2023-12-12T11:52:02.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:01 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:02.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:01 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:02.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:01 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:02.230 INFO:tasks.workunit.client.0.smithi063.stdout:5/597: sync 2023-12-12T11:52:02.230 INFO:tasks.workunit.client.0.smithi063.stdout:6/630: sync 2023-12-12T11:52:02.231 INFO:tasks.workunit.client.0.smithi063.stdout:9/469: sync 2023-12-12T11:52:02.231 INFO:tasks.workunit.client.0.smithi063.stdout:6/631: write d9/d68/f9d [1032593,66564] 0 2023-12-12T11:52:02.238 INFO:tasks.workunit.client.0.smithi063.stdout:5/598: write d7/d10/d2b/d3c/d42/d62/d69/f73 [602796,98384] 0 2023-12-12T11:52:02.238 INFO:tasks.workunit.client.0.smithi063.stdout:5/599: truncate d7/d10/d2b/fb6 883095 0 2023-12-12T11:52:02.238 INFO:tasks.workunit.client.0.smithi063.stdout:5/600: chown d7/d10/d2b/d3c/d27/c70 2268 1 2023-12-12T11:52:02.256 INFO:tasks.workunit.client.0.smithi063.stdout:0/606: unlink d0/d8e/cb5 0 2023-12-12T11:52:02.256 INFO:tasks.workunit.client.0.smithi063.stdout:0/607: read - d0/d7/d27/fb0 zero size 2023-12-12T11:52:02.257 INFO:tasks.workunit.client.0.smithi063.stdout:5/601: dread d7/d10/d2b/d3c/fa4 [0,4194304] 0 2023-12-12T11:52:02.257 INFO:tasks.workunit.client.0.smithi063.stdout:5/602: fdatasync d7/d10/d2b/d3c/d5a/f6a 0 2023-12-12T11:52:02.257 INFO:tasks.workunit.client.0.smithi063.stdout:5/603: write d7/d28/d6e/f8b [355498,59904] 0 2023-12-12T11:52:02.258 INFO:tasks.workunit.client.0.smithi063.stdout:8/633: mknod d4/d55/d52/cc8 0 2023-12-12T11:52:02.271 INFO:tasks.workunit.client.0.smithi063.stdout:9/470: mknod d7/d20/d45/d46/d51/d64/d6f/d85/c9a 0 2023-12-12T11:52:02.274 INFO:tasks.workunit.client.0.smithi063.stdout:0/608: symlink d0/d1a/d23/d34/d42/d99/lc8 0 2023-12-12T11:52:02.274 INFO:tasks.workunit.client.0.smithi063.stdout:0/609: write d0/d1a/d23/f74 [797776,86348] 0 2023-12-12T11:52:02.278 INFO:tasks.workunit.client.0.smithi063.stdout:5/604: truncate d7/d28/d43/d49/f4a 775875 0 2023-12-12T11:52:02.278 INFO:tasks.workunit.client.0.smithi063.stdout:5/605: read - d7/fa7 zero size 2023-12-12T11:52:02.278 INFO:tasks.workunit.client.0.smithi063.stdout:5/606: dread - d7/d10/d2b/d3c/d42/d76/f9e zero size 2023-12-12T11:52:02.282 INFO:tasks.workunit.client.0.smithi063.stdout:8/634: mkdir d4/d24/db3/dc9 0 2023-12-12T11:52:02.282 INFO:tasks.workunit.client.0.smithi063.stdout:8/635: write f3 [1192505,126328] 0 2023-12-12T11:52:02.304 INFO:tasks.workunit.client.0.smithi063.stdout:5/607: rmdir d7/d10/d2b/d3c/d42/d76 39 2023-12-12T11:52:02.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.303+0000 7f3390db9700 1 -- 172.21.15.63:0/3686792977 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f338c06f0e0 msgr2=0x7f338c108c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:02.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.303+0000 7f3390db9700 1 --2- 172.21.15.63:0/3686792977 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f338c06f0e0 0x7f338c108c60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f337c004940 tx=0x7f337c009e30 comp rx=0 tx=0).stop 2023-12-12T11:52:02.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.304+0000 7f3390db9700 1 -- 172.21.15.63:0/3686792977 shutdown_connections 2023-12-12T11:52:02.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.304+0000 7f3390db9700 1 --2- 172.21.15.63:0/3686792977 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f338c06f0e0 0x7f338c108c60 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:02.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.304+0000 7f3390db9700 1 --2- 172.21.15.63:0/3686792977 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f338c06e700 0x7f338c06eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:02.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.304+0000 7f3390db9700 1 -- 172.21.15.63:0/3686792977 >> 172.21.15.63:0/3686792977 conn(0x7f338c069b20 msgr2=0x7f338c06bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:52:02.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.304+0000 7f3390db9700 1 -- 172.21.15.63:0/3686792977 shutdown_connections 2023-12-12T11:52:02.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.304+0000 7f3390db9700 1 -- 172.21.15.63:0/3686792977 wait complete. 2023-12-12T11:52:02.307 INFO:tasks.workunit.client.0.smithi063.stdout:5/608: getdents d7/d28/d94 0 2023-12-12T11:52:02.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.306+0000 7f3390db9700 1 Processor -- start 2023-12-12T11:52:02.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.306+0000 7f3390db9700 1 -- start start 2023-12-12T11:52:02.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.306+0000 7f3390db9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f338c06e700 0x7f338c1180a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:02.309 INFO:tasks.workunit.client.1.smithi093.stdout:8/853: unlink d3/d1a/d1f/d29/d3a/d68/c71 0 2023-12-12T11:52:02.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.306+0000 7f3390db9700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f338c1185e0 0x7f338c119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:02.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.306+0000 7f3390db9700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338c118aa0 con 0x7f338c06e700 2023-12-12T11:52:02.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.306+0000 7f3390db9700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338c118be0 con 0x7f338c1185e0 2023-12-12T11:52:02.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.307+0000 7f338a59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f338c06e700 0x7f338c1180a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:02.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.307+0000 7f338a59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f338c06e700 0x7f338c1180a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59722/0 (socket says 172.21.15.63:59722) 2023-12-12T11:52:02.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.307+0000 7f338a59c700 1 -- 172.21.15.63:0/1591843919 learned_addr learned my addr 172.21.15.63:0/1591843919 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:52:02.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.308+0000 7f338a59c700 1 -- 172.21.15.63:0/1591843919 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f338c1185e0 msgr2=0x7f338c119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:02.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.308+0000 7f338a59c700 1 --2- 172.21.15.63:0/1591843919 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f338c1185e0 0x7f338c119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:02.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.308+0000 7f338a59c700 1 -- 172.21.15.63:0/1591843919 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c005040 con 0x7f338c06e700 2023-12-12T11:52:02.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.308+0000 7f338a59c700 1 --2- 172.21.15.63:0/1591843919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f338c06e700 0x7f338c1180a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f338400ec90 tx=0x7f338400d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:52:02.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.309+0000 7f337affd700 1 -- 172.21.15.63:0/1591843919 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3384010040 con 0x7f338c06e700 2023-12-12T11:52:02.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.309+0000 7f3390db9700 1 -- 172.21.15.63:0/1591843919 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f338c119ae0 con 0x7f338c06e700 2023-12-12T11:52:02.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.309+0000 7f3390db9700 1 -- 172.21.15.63:0/1591843919 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f338c119ff0 con 0x7f338c06e700 2023-12-12T11:52:02.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.310+0000 7f337affd700 1 -- 172.21.15.63:0/1591843919 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f338400eea0 con 0x7f338c06e700 2023-12-12T11:52:02.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.310+0000 7f337affd700 1 -- 172.21.15.63:0/1591843919 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3384009770 con 0x7f338c06e700 2023-12-12T11:52:02.314 INFO:tasks.workunit.client.0.smithi063.stdout:5/609: unlink d7/d10/f64 0 2023-12-12T11:52:02.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.311+0000 7f3390db9700 1 -- 172.21.15.63:0/1591843919 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f336c0052e0 con 0x7f338c06e700 2023-12-12T11:52:02.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.312+0000 7f337affd700 1 -- 172.21.15.63:0/1591843919 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 24) v1 ==== 88724+0+0 (secure 0 0 0) 0x7f338401d400 con 0x7f338c06e700 2023-12-12T11:52:02.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.313+0000 7f337affd700 1 --2- 172.21.15.63:0/1591843919 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f337406ae90 0x7f337406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:02.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.313+0000 7f337affd700 1 -- 172.21.15.63:0/1591843919 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f3384089bd0 con 0x7f338c06e700 2023-12-12T11:52:02.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.314+0000 7f3389d9b700 1 --2- 172.21.15.63:0/1591843919 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f337406ae90 0x7f337406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:02.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.315+0000 7f3389d9b700 1 --2- 172.21.15.63:0/1591843919 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f337406ae90 0x7f337406d340 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f337c009fd0 tx=0x7f337c009e30 comp rx=0 tx=0).ready entity=mgr.24471 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:52:02.320 INFO:tasks.workunit.client.1.smithi093.stdout:8/854: dread d3/d1a/d1f/d29/d3a/f55 [0,4194304] 0 2023-12-12T11:52:02.321 INFO:tasks.workunit.client.0.smithi063.stdout:5/610: dread d7/d10/d2b/f4b [0,4194304] 0 2023-12-12T11:52:02.321 INFO:tasks.workunit.client.0.smithi063.stdout:5/611: chown d7/d28/d43/d49/c50 8899107 1 2023-12-12T11:52:02.323 INFO:tasks.workunit.client.0.smithi063.stdout:9/471: dwrite d7/d20/d3f/d40/d4e/f80 [0,4194304] 0 2023-12-12T11:52:02.323 INFO:tasks.workunit.client.0.smithi063.stdout:9/472: chown d7/d11/d12/f79 232 1 2023-12-12T11:52:02.326 INFO:tasks.workunit.client.0.smithi063.stdout:5/612: mkdir d7/d10/d2b/d3c/d5a/dbb 0 2023-12-12T11:52:02.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.325+0000 7f337affd700 1 -- 172.21.15.63:0/1591843919 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f3384057880 con 0x7f338c06e700 2023-12-12T11:52:02.339 INFO:tasks.workunit.client.0.smithi063.stdout:9/473: link d7/d20/d3f/d40/f44 d7/d11/d4b/d75/f9b 0 2023-12-12T11:52:02.345 INFO:tasks.workunit.client.0.smithi063.stdout:9/474: mknod d7/d20/c9c 0 2023-12-12T11:52:02.350 INFO:tasks.workunit.client.1.smithi093.stdout:9/800: mknod d1/d23/d24/d29/d43/d56/d85/dc3/dce/d3e/c110 0 2023-12-12T11:52:02.350 INFO:tasks.workunit.client.1.smithi093.stdout:9/801: chown d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/f70 13204066 1 2023-12-12T11:52:02.350 INFO:tasks.workunit.client.1.smithi093.stdout:9/802: readlink d1/d23/d6b/lfa 0 2023-12-12T11:52:02.350 INFO:tasks.workunit.client.1.smithi093.stdout:9/803: chown d1/d23/d6b/d92/db2/fb6 165164 1 2023-12-12T11:52:02.350 INFO:tasks.workunit.client.1.smithi093.stdout:2/820: mkdir d5/d115 0 2023-12-12T11:52:02.354 INFO:tasks.workunit.client.1.smithi093.stdout:1/843: mknod d4/dc/d7a/d9c/da7/c11b 0 2023-12-12T11:52:02.354 INFO:tasks.workunit.client.1.smithi093.stdout:1/844: creat d4/d1a/d1b/d26/f11c x:0 0 0 2023-12-12T11:52:02.357 INFO:tasks.workunit.client.1.smithi093.stdout:6/949: mknod d0/da/d14/d21/df6/c14e 0 2023-12-12T11:52:02.364 INFO:tasks.workunit.client.1.smithi093.stdout:7/761: getdents da/d8e/da9 0 2023-12-12T11:52:02.365 INFO:tasks.workunit.client.1.smithi093.stdout:8/855: truncate d3/d8/fda 825429 0 2023-12-12T11:52:02.376 INFO:tasks.workunit.client.1.smithi093.stdout:5/690: mknod d0/d7/d36/db9/cee 0 2023-12-12T11:52:02.380 INFO:tasks.workunit.client.1.smithi093.stdout:2/821: rmdir d5/d14/d2d/d12/d25/d7a/d7e/da5 39 2023-12-12T11:52:02.380 INFO:tasks.workunit.client.1.smithi093.stdout:2/822: readlink d5/d14/d2d/d4c/d54/d67/l71 0 2023-12-12T11:52:02.382 INFO:tasks.workunit.client.0.smithi063.stdout:5/613: dwrite d7/d10/d2b/d3c/d42/d62/f6c [0,4194304] 0 2023-12-12T11:52:02.385 INFO:tasks.workunit.client.1.smithi093.stdout:5/691: unlink d0/d7/d36/d38/caa 0 2023-12-12T11:52:02.385 INFO:tasks.workunit.client.1.smithi093.stdout:5/692: write d0/d7/d59/d48/f89 [95499,90675] 0 2023-12-12T11:52:02.386 INFO:tasks.workunit.client.1.smithi093.stdout:7/762: rmdir da/d8e/dbc 39 2023-12-12T11:52:02.386 INFO:tasks.workunit.client.1.smithi093.stdout:7/763: write da/d15/d59/f66 [3805113,83309] 0 2023-12-12T11:52:02.386 INFO:tasks.workunit.client.1.smithi093.stdout:7/764: creat da/d15/d19/d90/d7d/f105 x:0 0 0 2023-12-12T11:52:02.392 INFO:tasks.workunit.client.1.smithi093.stdout:2/823: truncate d5/d14/d2d/d4c/d54/dc5/faa 395815 0 2023-12-12T11:52:02.392 INFO:tasks.workunit.client.1.smithi093.stdout:2/824: creat d5/d14/d2d/d4c/d76/dc6/f116 x:0 0 0 2023-12-12T11:52:02.392 INFO:tasks.workunit.client.1.smithi093.stdout:5/693: rmdir d0/d7/d36/db9/d66 39 2023-12-12T11:52:02.397 INFO:tasks.workunit.client.0.smithi063.stdout:5/614: mkdir d7/d10/d2b/d3c/d5a/dbb/dbc 0 2023-12-12T11:52:02.401 INFO:tasks.workunit.client.0.smithi063.stdout:1/635: symlink d3/db/d16/d17/lcd 0 2023-12-12T11:52:02.405 INFO:tasks.workunit.client.0.smithi063.stdout:9/475: dwrite d7/d20/d3f/d40/d4e/f80 [0,4194304] 0 2023-12-12T11:52:02.405 INFO:tasks.workunit.client.0.smithi063.stdout:1/636: symlink d3/db/d16/db8/lce 0 2023-12-12T11:52:02.405 INFO:tasks.workunit.client.0.smithi063.stdout:1/637: chown d3/db/d16/d17 7 1 2023-12-12T11:52:02.405 INFO:tasks.workunit.client.1.smithi093.stdout:1/845: dwrite d4/d1a/d83/d9a/faf [0,4194304] 0 2023-12-12T11:52:02.411 INFO:tasks.workunit.client.0.smithi063.stdout:9/476: creat d7/d20/d3f/d40/d76/f9d x:0 0 0 2023-12-12T11:52:02.411 INFO:tasks.workunit.client.0.smithi063.stdout:1/638: rename d3/db/d16/d24/d48/f8a to d3/db/d16/d4f/fcf 0 2023-12-12T11:52:02.414 INFO:tasks.workunit.client.0.smithi063.stdout:9/477: dread d7/d20/d3f/d40/d4e/f6b [0,4194304] 0 2023-12-12T11:52:02.415 INFO:tasks.workunit.client.1.smithi093.stdout:2/825: mknod d5/d14/d2d/d4c/d76/c117 0 2023-12-12T11:52:02.415 INFO:tasks.workunit.client.1.smithi093.stdout:2/826: truncate d5/d14/d2d/f42 1614016 0 2023-12-12T11:52:02.422 INFO:tasks.workunit.client.1.smithi093.stdout:5/694: rmdir d0/d7/d8 39 2023-12-12T11:52:02.422 INFO:tasks.workunit.client.1.smithi093.stdout:1/846: read d4/dc/d7a/f8d [2891085,66692] 0 2023-12-12T11:52:02.423 INFO:tasks.workunit.client.1.smithi093.stdout:1/847: readlink d4/d1c/d2a/l35 0 2023-12-12T11:52:02.424 INFO:tasks.workunit.client.0.smithi063.stdout:1/639: symlink d3/db/d16/d24/d4d/d35/d98/ld0 0 2023-12-12T11:52:02.438 INFO:tasks.workunit.client.0.smithi063.stdout:8/636: rmdir d4/de/d3b 39 2023-12-12T11:52:02.449 INFO:tasks.workunit.client.0.smithi063.stdout:1/640: dread d3/db/d16/d24/f2a [0,4194304] 0 2023-12-12T11:52:02.453 INFO:tasks.workunit.client.1.smithi093.stdout:7/765: dwrite da/de/d46/d4f/f64 [0,4194304] 0 2023-12-12T11:52:02.453 INFO:tasks.workunit.client.1.smithi093.stdout:7/766: write da/d15/d2d/f50 [321653,36293] 0 2023-12-12T11:52:02.461 INFO:tasks.workunit.client.1.smithi093.stdout:7/767: mknod da/d15/ddd/c106 0 2023-12-12T11:52:02.463 INFO:tasks.workunit.client.1.smithi093.stdout:7/768: mknod da/d8e/daa/c107 0 2023-12-12T11:52:02.463 INFO:tasks.workunit.client.1.smithi093.stdout:7/769: creat da/d15/d2d/d2f/dc6/f108 x:0 0 0 2023-12-12T11:52:02.463 INFO:tasks.workunit.client.1.smithi093.stdout:7/770: chown da/d15/d19/d4c/d6d/lc2 633411051 1 2023-12-12T11:52:02.463 INFO:tasks.workunit.client.1.smithi093.stdout:7/771: getdents da/de/d100 0 2023-12-12T11:52:02.464 INFO:tasks.workunit.client.1.smithi093.stdout:7/772: fdatasync da/d15/d2d/d2f/fa5 0 2023-12-12T11:52:02.464 INFO:tasks.workunit.client.1.smithi093.stdout:7/773: write da/de/fd8 [2690693,50092] 0 2023-12-12T11:52:02.465 INFO:tasks.workunit.client.1.smithi093.stdout:5/695: dwrite d0/d7/d85/fea [0,4194304] 0 2023-12-12T11:52:02.465 INFO:tasks.workunit.client.1.smithi093.stdout:5/696: chown d0/f5 517 1 2023-12-12T11:52:02.475 INFO:tasks.workunit.client.1.smithi093.stdout:5/697: mkdir d0/d7/d36/d68/def 0 2023-12-12T11:52:02.484 INFO:tasks.workunit.client.0.smithi063.stdout:6/632: creat d9/d10/fdb x:0 0 0 2023-12-12T11:52:02.484 INFO:tasks.workunit.client.0.smithi063.stdout:6/633: creat d9/d2c/d61/fdc x:0 0 0 2023-12-12T11:52:02.485 INFO:tasks.workunit.client.1.smithi093.stdout:7/774: dread da/de/f53 [0,4194304] 0 2023-12-12T11:52:02.486 INFO:tasks.workunit.client.1.smithi093.stdout:7/775: dread - da/d2e/d89/ff9 zero size 2023-12-12T11:52:02.492 INFO:tasks.workunit.client.1.smithi093.stdout:7/776: unlink da/de/d46/d4f/fef 0 2023-12-12T11:52:02.495 INFO:tasks.workunit.client.0.smithi063.stdout:6/634: getdents d9/d68/d94 0 2023-12-12T11:52:02.495 INFO:tasks.workunit.client.0.smithi063.stdout:6/635: dread - d9/d2c/d61/f97 zero size 2023-12-12T11:52:02.498 INFO:tasks.workunit.client.1.smithi093.stdout:3/806: sync 2023-12-12T11:52:02.498 INFO:tasks.workunit.client.1.smithi093.stdout:3/807: write df/d22/d49/d69/d78/daf/d3d/def/ff7 [913898,48305] 0 2023-12-12T11:52:02.498 INFO:tasks.workunit.client.1.smithi093.stdout:3/808: chown df/d22/d49/d69/d78/daf/d3d/d42 709 1 2023-12-12T11:52:02.498 INFO:tasks.workunit.client.1.smithi093.stdout:3/809: stat df/d22/d49/d69/d78/daf/d3d/d6f/db1/le2 0 2023-12-12T11:52:02.498 INFO:tasks.workunit.client.1.smithi093.stdout:3/810: fsync df/d25/fb4 0 2023-12-12T11:52:02.499 INFO:tasks.workunit.client.1.smithi093.stdout:7/777: getdents da/d15/d59 0 2023-12-12T11:52:02.502 INFO:tasks.workunit.client.1.smithi093.stdout:0/830: creat d5/dd/d14/d26/d58/f103 x:0 0 0 2023-12-12T11:52:02.505 INFO:tasks.workunit.client.0.smithi063.stdout:0/610: creat d0/d7/d27/fc9 x:0 0 0 2023-12-12T11:52:02.514 INFO:tasks.workunit.client.0.smithi063.stdout:6/636: dread d9/d10/f15 [4194304,4194304] 0 2023-12-12T11:52:02.516 INFO:tasks.workunit.client.0.smithi063.stdout:6/637: symlink d9/d10/d2a/dc3/ldd 0 2023-12-12T11:52:02.516 INFO:tasks.workunit.client.0.smithi063.stdout:7/487: sync 2023-12-12T11:52:02.516 INFO:tasks.workunit.client.0.smithi063.stdout:3/519: sync 2023-12-12T11:52:02.519 INFO:tasks.workunit.client.0.smithi063.stdout:2/469: sync 2023-12-12T11:52:02.519 INFO:tasks.workunit.client.0.smithi063.stdout:2/470: creat d0/d1a/d3a/f9e x:0 0 0 2023-12-12T11:52:02.519 INFO:tasks.workunit.client.0.smithi063.stdout:4/613: sync 2023-12-12T11:52:02.521 INFO:tasks.workunit.client.0.smithi063.stdout:6/638: symlink d9/d10/d2a/lde 0 2023-12-12T11:52:02.522 INFO:tasks.workunit.client.0.smithi063.stdout:6/639: write d9/d68/fb2 [1592642,72576] 0 2023-12-12T11:52:02.523 INFO:tasks.workunit.client.0.smithi063.stdout:6/640: write d9/fba [54536,72922] 0 2023-12-12T11:52:02.526 INFO:tasks.workunit.client.0.smithi063.stdout:7/488: creat de/d22/d6e/d8a/fb6 x:0 0 0 2023-12-12T11:52:02.527 INFO:tasks.workunit.client.1.smithi093.stdout:9/804: rename d1/d23/d6b/l101 to d1/d23/d24/d29/l111 0 2023-12-12T11:52:02.530 INFO:tasks.workunit.client.0.smithi063.stdout:2/471: unlink d0/d1a/d1e/f27 0 2023-12-12T11:52:02.531 INFO:tasks.workunit.client.0.smithi063.stdout:2/472: creat d0/d1a/d3a/f9f x:0 0 0 2023-12-12T11:52:02.531 INFO:tasks.workunit.client.0.smithi063.stdout:4/614: truncate d2/d8/f49 7298060 0 2023-12-12T11:52:02.532 INFO:tasks.workunit.client.0.smithi063.stdout:2/473: write d0/f43 [1474872,28259] 0 2023-12-12T11:52:02.532 INFO:tasks.workunit.client.0.smithi063.stdout:2/474: stat d0/d1a/d48/d56/l91 0 2023-12-12T11:52:02.532 INFO:tasks.workunit.client.1.smithi093.stdout:0/831: dread d5/d41/fa6 [4194304,4194304] 0 2023-12-12T11:52:02.535 INFO:tasks.workunit.client.1.smithi093.stdout:7/778: dwrite da/de/f3b [0,4194304] 0 2023-12-12T11:52:02.541 INFO:tasks.workunit.client.1.smithi093.stdout:9/805: write d1/d23/d24/d29/d43/d56/d85/dc3/dce/d3e/fed [1806930,7984] 0 2023-12-12T11:52:02.541 INFO:tasks.workunit.client.1.smithi093.stdout:9/806: dread - d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/f106 zero size 2023-12-12T11:52:02.541 INFO:tasks.workunit.client.1.smithi093.stdout:9/807: dread - d1/d23/d24/d29/d43/d58/fac zero size 2023-12-12T11:52:02.541 INFO:tasks.workunit.client.1.smithi093.stdout:6/950: rename d0/d52/d7e/f68 to d0/da/d14/d38/d43/d10e/f14f 0 2023-12-12T11:52:02.544 INFO:tasks.workunit.client.0.smithi063.stdout:4/615: mknod d2/d48/cc7 0 2023-12-12T11:52:02.545 INFO:tasks.workunit.client.0.smithi063.stdout:4/616: dread - d2/d47/d6d/d88/fa0 zero size 2023-12-12T11:52:02.545 INFO:tasks.workunit.client.0.smithi063.stdout:2/475: symlink d0/d1a/d48/d56/la0 0 2023-12-12T11:52:02.546 INFO:tasks.workunit.client.1.smithi093.stdout:7/779: creat da/d2e/f109 x:0 0 0 2023-12-12T11:52:02.551 INFO:tasks.workunit.client.0.smithi063.stdout:4/617: stat d2/d17/d4e/l65 0 2023-12-12T11:52:02.553 INFO:tasks.workunit.client.0.smithi063.stdout:4/618: fsync d2/d48/d69/d98/fad 0 2023-12-12T11:52:02.553 INFO:tasks.workunit.client.0.smithi063.stdout:4/619: getdents d2/d17/d7f/d86 0 2023-12-12T11:52:02.553 INFO:tasks.workunit.client.0.smithi063.stdout:4/620: chown d2/d17/lae 269934478 1 2023-12-12T11:52:02.553 INFO:tasks.workunit.client.0.smithi063.stdout:4/621: chown d2/f40 12232 1 2023-12-12T11:52:02.553 INFO:tasks.workunit.client.1.smithi093.stdout:9/808: creat d1/d23/d24/d29/d43/d56/d85/dc3/dce/d3e/f112 x:0 0 0 2023-12-12T11:52:02.558 INFO:tasks.workunit.client.1.smithi093.stdout:8/856: rename d3/d1a/d1f/d29/d30/d58/ff3 to d3/d1a/d1f/d29/d3a/d8f/f11b 0 2023-12-12T11:52:02.558 INFO:tasks.workunit.client.0.smithi063.stdout:2/476: truncate d0/f17 406919 0 2023-12-12T11:52:02.558 INFO:tasks.workunit.client.0.smithi063.stdout:2/477: chown d0/f15 61 1 2023-12-12T11:52:02.558 INFO:tasks.workunit.client.0.smithi063.stdout:2/478: write d0/d1a/d1e/d64/f89 [343577,41141] 0 2023-12-12T11:52:02.559 INFO:tasks.workunit.client.1.smithi093.stdout:3/811: unlink df/d22/d49/d69/d78/cdc 0 2023-12-12T11:52:02.560 INFO:tasks.workunit.client.0.smithi063.stdout:4/622: creat d2/d48/fc8 x:0 0 0 2023-12-12T11:52:02.562 INFO:tasks.workunit.client.0.smithi063.stdout:5/615: dwrite d7/de/f25 [0,4194304] 0 2023-12-12T11:52:02.564 INFO:tasks.workunit.client.1.smithi093.stdout:6/951: mknod d0/d52/d7e/d42/c150 0 2023-12-12T11:52:02.564 INFO:tasks.workunit.client.1.smithi093.stdout:6/952: read d0/da/f11a [82193,114350] 0 2023-12-12T11:52:02.564 INFO:tasks.workunit.client.1.smithi093.stdout:6/953: dread - d0/da/d32/d9e/d4d/f11e zero size 2023-12-12T11:52:02.564 INFO:tasks.workunit.client.0.smithi063.stdout:1/641: dwrite d3/db/d16/d4f/fcf [0,4194304] 0 2023-12-12T11:52:02.570 INFO:tasks.workunit.client.1.smithi093.stdout:8/857: creat d3/d1a/d1f/d59/ddb/f11c x:0 0 0 2023-12-12T11:52:02.571 INFO:tasks.workunit.client.0.smithi063.stdout:4/623: symlink d2/d17/d61/dc5/lc9 0 2023-12-12T11:52:02.571 INFO:tasks.workunit.client.0.smithi063.stdout:4/624: rename d2 to d2/d17/d81/dca 22 2023-12-12T11:52:02.573 INFO:tasks.workunit.client.1.smithi093.stdout:3/812: link df/d22/d49/d69/d78/daf/d3d/d42/f57 df/dc6/f104 0 2023-12-12T11:52:02.576 INFO:tasks.workunit.client.1.smithi093.stdout:6/954: creat d0/d52/dbc/f151 x:0 0 0 2023-12-12T11:52:02.576 INFO:tasks.workunit.client.1.smithi093.stdout:6/955: creat d0/d52/d7e/d42/dd5/ddc/d12a/f152 x:0 0 0 2023-12-12T11:52:02.582 INFO:tasks.workunit.client.0.smithi063.stdout:1/642: symlink d3/db/d16/d24/d48/d75/d83/d81/ld1 0 2023-12-12T11:52:02.582 INFO:tasks.workunit.client.0.smithi063.stdout:1/643: chown d3/db/d16/d4f/da7/dca 1 1 2023-12-12T11:52:02.584 INFO:tasks.workunit.client.1.smithi093.stdout:7/780: rmdir da/d2e/d89 39 2023-12-12T11:52:02.591 INFO:tasks.workunit.client.0.smithi063.stdout:2/479: getdents d0/d1a/d48/d56/d77 0 2023-12-12T11:52:02.592 INFO:tasks.workunit.client.0.smithi063.stdout:1/644: symlink d3/d3a/ld2 0 2023-12-12T11:52:02.594 INFO:tasks.workunit.client.1.smithi093.stdout:2/827: rename d5/d14/d47 to d5/d14/d2d/d4c/d76/dc6/d118 0 2023-12-12T11:52:02.594 INFO:tasks.workunit.client.1.smithi093.stdout:2/828: dread - d5/d14/d2d/d4c/d76/dc6/f116 zero size 2023-12-12T11:52:02.598 INFO:tasks.workunit.client.0.smithi063.stdout:1/645: truncate d3/db/d16/d24/d48/d75/d83/d5b/d6b/f7f 2596696 0 2023-12-12T11:52:02.599 INFO:tasks.workunit.client.1.smithi093.stdout:3/813: creat df/d22/d49/d69/d78/dad/f105 x:0 0 0 2023-12-12T11:52:02.599 INFO:tasks.workunit.client.1.smithi093.stdout:3/814: readlink df/d25/l34 0 2023-12-12T11:52:02.600 INFO:tasks.workunit.client.1.smithi093.stdout:6/956: mknod d0/c153 0 2023-12-12T11:52:02.604 INFO:tasks.workunit.client.0.smithi063.stdout:1/646: creat d3/db/d16/d4f/da7/dca/d6f/fd3 x:0 0 0 2023-12-12T11:52:02.604 INFO:tasks.workunit.client.0.smithi063.stdout:1/647: dread - d3/db/d16/d4f/d9a/fba zero size 2023-12-12T11:52:02.604 INFO:tasks.workunit.client.0.smithi063.stdout:2/480: dread d0/d69/f8c [0,4194304] 0 2023-12-12T11:52:02.607 INFO:tasks.workunit.client.1.smithi093.stdout:1/848: rename d4/d1a/da6/lb2 to d4/d81/dfc/l11d 0 2023-12-12T11:52:02.610 INFO:tasks.workunit.client.1.smithi093.stdout:1/849: write d4/d81/f107 [293087,30163] 0 2023-12-12T11:52:02.610 INFO:tasks.workunit.client.1.smithi093.stdout:2/829: creat d5/d14/d2d/d4c/d54/dc5/d55/d75/f119 x:0 0 0 2023-12-12T11:52:02.610 INFO:tasks.workunit.client.1.smithi093.stdout:2/830: write d5/d14/d2d/fcb [1707738,122734] 0 2023-12-12T11:52:02.615 INFO:tasks.workunit.client.0.smithi063.stdout:1/648: unlink d3/db/d16/d24/d4d/f7c 0 2023-12-12T11:52:02.620 INFO:tasks.workunit.client.0.smithi063.stdout:8/637: dwrite d4/de/d1e/d6d/f97 [0,4194304] 0 2023-12-12T11:52:02.620 INFO:tasks.workunit.client.0.smithi063.stdout:8/638: truncate d4/de/d3b/fa8 375586 0 2023-12-12T11:52:02.621 INFO:tasks.workunit.client.1.smithi093.stdout:0/832: rename d5/d21/d2f/d54/d7e/lcf to d5/d21/d27/l104 0 2023-12-12T11:52:02.621 INFO:tasks.workunit.client.1.smithi093.stdout:5/698: dwrite d0/dd2/fda [0,4194304] 0 2023-12-12T11:52:02.622 INFO:tasks.workunit.client.0.smithi063.stdout:3/520: dwrite f0 [0,4194304] 0 2023-12-12T11:52:02.634 INFO:tasks.workunit.client.0.smithi063.stdout:2/481: rename d0/d1a/d1e/f35 to d0/d41/d90/fa1 0 2023-12-12T11:52:02.634 INFO:tasks.workunit.client.0.smithi063.stdout:2/482: dread - d0/d1a/d3a/d59/f96 zero size 2023-12-12T11:52:02.635 INFO:tasks.workunit.client.0.smithi063.stdout:2/483: chown d0/d1a/d1e/l6a 48 1 2023-12-12T11:52:02.637 INFO:tasks.workunit.client.1.smithi093.stdout:2/831: link d5/d14/d2d/d4c/d54/dc5/d61/le0 d5/d14/d2d/d96/l11a 0 2023-12-12T11:52:02.643 INFO:tasks.workunit.client.1.smithi093.stdout:9/809: rename d1/d23/d24/d29/d43/d56/d85/dc3/dce/d3e/cd8 to d1/d23/d24/dfd/c113 0 2023-12-12T11:52:02.645 INFO:tasks.workunit.client.0.smithi063.stdout:1/649: dread d3/db/d12/f49 [0,4194304] 0 2023-12-12T11:52:02.647 INFO:tasks.workunit.client.0.smithi063.stdout:6/641: dwrite d9/d68/f90 [0,4194304] 0 2023-12-12T11:52:02.647 INFO:tasks.workunit.client.0.smithi063.stdout:5/616: dwrite d7/d10/d2b/d3c/f36 [4194304,4194304] 0 2023-12-12T11:52:02.647 INFO:tasks.workunit.client.0.smithi063.stdout:5/617: write d7/d10/d2b/d3c/d27/f8e [782471,27283] 0 2023-12-12T11:52:02.647 INFO:tasks.workunit.client.0.smithi063.stdout:5/618: chown d7/de/c40 0 1 2023-12-12T11:52:02.650 INFO:tasks.workunit.client.1.smithi093.stdout:8/858: dwrite d3/f6 [0,4194304] 0 2023-12-12T11:52:02.650 INFO:tasks.workunit.client.1.smithi093.stdout:8/859: fdatasync d3/f74 0 2023-12-12T11:52:02.650 INFO:tasks.workunit.client.1.smithi093.stdout:8/860: chown d3/d1a/d1f/d29/d30/f103 0 1 2023-12-12T11:52:02.653 INFO:tasks.workunit.client.1.smithi093.stdout:2/832: dread d5/d14/d2d/d12/d25/fb2 [0,4194304] 0 2023-12-12T11:52:02.653 INFO:tasks.workunit.client.1.smithi093.stdout:2/833: readlink d5/lc8 0 2023-12-12T11:52:02.664 INFO:tasks.workunit.client.1.smithi093.stdout:9/810: dread d1/d23/d6b/fa6 [0,4194304] 0 2023-12-12T11:52:02.664 INFO:tasks.workunit.client.1.smithi093.stdout:3/815: dwrite df/d22/d49/d69/f6a [0,4194304] 0 2023-12-12T11:52:02.664 INFO:tasks.workunit.client.1.smithi093.stdout:9/811: write d1/d23/d24/fea [952022,21220] 0 2023-12-12T11:52:02.664 INFO:tasks.workunit.client.1.smithi093.stdout:3/816: write df/f2f [2212448,118493] 0 2023-12-12T11:52:02.667 INFO:tasks.workunit.client.1.smithi093.stdout:7/781: rename da/de/c4a to da/d8e/daa/db3/c10a 0 2023-12-12T11:52:02.673 INFO:tasks.workunit.client.0.smithi063.stdout:0/611: write d0/d1a/d23/d34/d42/f6a [79375,123130] 0 2023-12-12T11:52:02.673 INFO:tasks.workunit.client.0.smithi063.stdout:0/612: fdatasync d0/d7/d27/d1f/f3f 0 2023-12-12T11:52:02.675 INFO:tasks.workunit.client.1.smithi093.stdout:8/861: mkdir d3/d1a/d1f/d50/d11d 0 2023-12-12T11:52:02.678 INFO:tasks.workunit.client.0.smithi063.stdout:8/639: creat d4/de/d3b/d62/d36/d57/d84/fca x:0 0 0 2023-12-12T11:52:02.681 INFO:tasks.workunit.client.0.smithi063.stdout:2/484: mkdir d0/d1a/d48/d56/da2 0 2023-12-12T11:52:02.681 INFO:tasks.workunit.client.0.smithi063.stdout:2/485: readlink d0/d69/l75 0 2023-12-12T11:52:02.681 INFO:tasks.workunit.client.0.smithi063.stdout:2/486: write d0/d41/f66 [1958972,11272] 0 2023-12-12T11:52:02.681 INFO:tasks.workunit.client.0.smithi063.stdout:2/487: dread - d0/d1a/d48/d56/f65 zero size 2023-12-12T11:52:02.684 INFO:tasks.workunit.client.1.smithi093.stdout:3/817: symlink df/d25/d6b/l106 0 2023-12-12T11:52:02.684 INFO:tasks.workunit.client.1.smithi093.stdout:3/818: chown df/dc6/cce 49095797 1 2023-12-12T11:52:02.687 INFO:tasks.workunit.client.0.smithi063.stdout:1/650: creat d3/db/d16/d24/d48/d75/fd4 x:0 0 0 2023-12-12T11:52:02.690 INFO:tasks.workunit.client.1.smithi093.stdout:5/699: rename d0/d7/d8/d9e/d6a/l71 to d0/d7/d59/lf0 0 2023-12-12T11:52:02.690 INFO:tasks.workunit.client.1.smithi093.stdout:5/700: readlink d0/d7/d8/l64 0 2023-12-12T11:52:02.691 INFO:tasks.workunit.client.1.smithi093.stdout:6/957: dwrite d0/d52/d6b/f129 [4194304,4194304] 0 2023-12-12T11:52:02.692 INFO:tasks.workunit.client.0.smithi063.stdout:3/521: dwrite d4/df/d1a/d1c/d3b/d50/f8f [0,4194304] 0 2023-12-12T11:52:02.693 INFO:tasks.workunit.client.1.smithi093.stdout:1/850: dwrite d4/dc/f28 [0,4194304] 0 2023-12-12T11:52:02.693 INFO:tasks.workunit.client.1.smithi093.stdout:1/851: chown d4/d1a/d1b/dbf/l108 39682257 1 2023-12-12T11:52:02.693 INFO:tasks.workunit.client.1.smithi093.stdout:0/833: dwrite d5/d21/d2f/d54/f73 [0,4194304] 0 2023-12-12T11:52:02.697 INFO:tasks.workunit.client.1.smithi093.stdout:9/812: getdents d1/d23/d24/d89 0 2023-12-12T11:52:02.700 INFO:tasks.workunit.client.1.smithi093.stdout:3/819: symlink df/d22/d49/d69/d78/daf/d3d/d6f/l107 0 2023-12-12T11:52:02.700 INFO:tasks.workunit.client.1.smithi093.stdout:3/820: creat df/d25/f108 x:0 0 0 2023-12-12T11:52:02.700 INFO:tasks.workunit.client.1.smithi093.stdout:3/821: read - df/d25/dd2/fe0 zero size 2023-12-12T11:52:02.707 INFO:tasks.workunit.client.1.smithi093.stdout:7/782: rename da/d8e/dbc/ff8 to da/de/d78/f10b 0 2023-12-12T11:52:02.708 INFO:tasks.workunit.client.0.smithi063.stdout:6/642: mknod d9/d10/d2a/cdf 0 2023-12-12T11:52:02.708 INFO:tasks.workunit.client.0.smithi063.stdout:6/643: readlink d9/d10/l7f 0 2023-12-12T11:52:02.716 INFO:tasks.workunit.client.1.smithi093.stdout:2/834: dwrite d5/d14/d2d/d4c/d76/dc6/f103 [0,4194304] 0 2023-12-12T11:52:02.718 INFO:tasks.workunit.client.0.smithi063.stdout:5/619: creat d7/d10/d2b/d3c/fbd x:0 0 0 2023-12-12T11:52:02.719 INFO:tasks.workunit.client.1.smithi093.stdout:6/958: creat d0/da/d14/d21/d146/f154 x:0 0 0 2023-12-12T11:52:02.723 INFO:tasks.workunit.client.1.smithi093.stdout:5/701: symlink d0/d7/d36/db9/d66/d7c/db5/dcc/lf1 0 2023-12-12T11:52:02.725 INFO:tasks.workunit.client.0.smithi063.stdout:2/488: truncate d0/f15 1362600 0 2023-12-12T11:52:02.728 INFO:tasks.workunit.client.1.smithi093.stdout:8/862: dwrite d3/f42 [0,4194304] 0 2023-12-12T11:52:02.731 INFO:tasks.workunit.client.0.smithi063.stdout:1/651: rename d3/db/d16/d24/d48/d75/d83/d5b/d6b/d6d/daf/cb2 to d3/db/d16/d24/d30/cd5 0 2023-12-12T11:52:02.731 INFO:tasks.workunit.client.0.smithi063.stdout:1/652: fdatasync d3/db/d16/d24/d48/f8f 0 2023-12-12T11:52:02.731 INFO:tasks.workunit.client.0.smithi063.stdout:1/653: write d3/db/d16/d4f/f79 [978412,1855] 0 2023-12-12T11:52:02.731 INFO:tasks.workunit.client.0.smithi063.stdout:1/654: chown d3/db/d16/d24/d48/d75/d83/d5b/lc1 0 1 2023-12-12T11:52:02.735 INFO:tasks.workunit.client.1.smithi093.stdout:0/834: mknod d5/dd/d14/d26/d58/d64/c105 0 2023-12-12T11:52:02.738 INFO:tasks.workunit.client.1.smithi093.stdout:9/813: symlink d1/d23/d24/d29/d43/d58/l114 0 2023-12-12T11:52:02.738 INFO:tasks.workunit.client.1.smithi093.stdout:9/814: write d1/d23/d24/d29/d43/d56/d85/dc3/dce/d3e/fe4 [198056,13583] 0 2023-12-12T11:52:02.744 INFO:tasks.workunit.client.1.smithi093.stdout:9/815: dread d1/d23/d24/d29/fa0 [0,4194304] 0 2023-12-12T11:52:02.748 INFO:tasks.workunit.client.1.smithi093.stdout:1/852: dwrite d4/d1a/d83/d9a/fd7 [0,4194304] 0 2023-12-12T11:52:02.750 INFO:tasks.workunit.client.1.smithi093.stdout:3/822: symlink df/d22/d49/d69/d78/daf/d3d/d59/d72/l109 0 2023-12-12T11:52:02.751 INFO:tasks.workunit.client.0.smithi063.stdout:3/522: mkdir d4/df/d1a/d1c/d3b/d50/d9f 0 2023-12-12T11:52:02.753 INFO:tasks.workunit.client.0.smithi063.stdout:5/620: unlink d7/de/c3b 0 2023-12-12T11:52:02.762 INFO:tasks.workunit.client.1.smithi093.stdout:2/835: rmdir d5/d14/d2d/d4c/d54/d67 39 2023-12-12T11:52:02.762 INFO:tasks.workunit.client.1.smithi093.stdout:2/836: chown d5/d14/d2d/d4c/d76/c117 3529 1 2023-12-12T11:52:02.762 INFO:tasks.workunit.client.0.smithi063.stdout:1/655: link d3/l3f d3/db/d16/d17/d4b/ld6 0 2023-12-12T11:52:02.762 INFO:tasks.workunit.client.0.smithi063.stdout:1/656: chown d3/db/d16/d24/d48/d75 117061881 1 2023-12-12T11:52:02.763 INFO:tasks.workunit.client.1.smithi093.stdout:6/959: getdents d0/da/d32/df7/d143 0 2023-12-12T11:52:02.766 INFO:tasks.workunit.client.1.smithi093.stdout:5/702: mknod d0/d7/d36/d68/cf2 0 2023-12-12T11:52:02.771 INFO:tasks.workunit.client.1.smithi093.stdout:0/835: symlink d5/dd/d14/d26/d58/d64/ddb/l106 0 2023-12-12T11:52:02.777 INFO:tasks.workunit.client.1.smithi093.stdout:8/863: write d3/d8/d88/dc5/fe6 [1859863,29719] 0 2023-12-12T11:52:02.777 INFO:tasks.workunit.client.1.smithi093.stdout:8/864: fdatasync d3/d1a/fde 0 2023-12-12T11:52:02.779 INFO:tasks.workunit.client.0.smithi063.stdout:1/657: truncate f2 1358492 0 2023-12-12T11:52:02.779 INFO:tasks.workunit.client.0.smithi063.stdout:8/640: dwrite d4/d55/d52/d8e/fbe [0,4194304] 0 2023-12-12T11:52:02.786 INFO:tasks.workunit.client.0.smithi063.stdout:5/621: write d7/de/f1e [4402543,38607] 0 2023-12-12T11:52:02.786 INFO:tasks.workunit.client.0.smithi063.stdout:5/622: write d7/f12 [481673,104075] 0 2023-12-12T11:52:02.786 INFO:tasks.workunit.client.1.smithi093.stdout:7/783: dwrite da/de/f5c [0,4194304] 0 2023-12-12T11:52:02.786 INFO:tasks.workunit.client.1.smithi093.stdout:7/784: getdents da/de/d100 0 2023-12-12T11:52:02.787 INFO:tasks.workunit.client.1.smithi093.stdout:7/785: fdatasync da/d15/d19/f9d 0 2023-12-12T11:52:02.795 INFO:tasks.workunit.client.1.smithi093.stdout:9/816: creat d1/d23/d24/dfd/f115 x:0 0 0 2023-12-12T11:52:02.795 INFO:tasks.workunit.client.1.smithi093.stdout:9/817: stat d1/d23/fb5 0 2023-12-12T11:52:02.800 INFO:tasks.workunit.client.1.smithi093.stdout:0/836: dread d5/d21/d27/f5a [0,4194304] 0 2023-12-12T11:52:02.802 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.800+0000 7f3390db9700 1 -- 172.21.15.63:0/1591843919 --> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f336c000bf0 con 0x7f337406ae90 2023-12-12T11:52:02.804 INFO:tasks.workunit.client.1.smithi093.stdout:1/853: mknod d4/d1a/dc2/c11e 0 2023-12-12T11:52:02.804 INFO:tasks.workunit.client.1.smithi093.stdout:1/854: rename d4/d1a to d4/d1a/d1b/d26/d11f 22 2023-12-12T11:52:02.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.802+0000 7f337affd700 1 -- 172.21.15.63:0/1591843919 <== mgr.24471 v2:172.21.15.93:6828/3441331233 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f336c000bf0 con 0x7f337406ae90 2023-12-12T11:52:02.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.807+0000 7f3390db9700 1 -- 172.21.15.63:0/1591843919 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f337406ae90 msgr2=0x7f337406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:02.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.807+0000 7f3390db9700 1 --2- 172.21.15.63:0/1591843919 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f337406ae90 0x7f337406d340 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f337c009fd0 tx=0x7f337c009e30 comp rx=0 tx=0).stop 2023-12-12T11:52:02.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.807+0000 7f3390db9700 1 -- 172.21.15.63:0/1591843919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f338c06e700 msgr2=0x7f338c1180a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:02.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.807+0000 7f3390db9700 1 --2- 172.21.15.63:0/1591843919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f338c06e700 0x7f338c1180a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f338400ec90 tx=0x7f338400d040 comp rx=0 tx=0).stop 2023-12-12T11:52:02.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.807+0000 7f3390db9700 1 -- 172.21.15.63:0/1591843919 shutdown_connections 2023-12-12T11:52:02.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.807+0000 7f3390db9700 1 --2- 172.21.15.63:0/1591843919 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f337406ae90 0x7f337406d340 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:02.810 INFO:tasks.workunit.client.0.smithi063.stdout:1/658: dread d3/f1a [0,4194304] 0 2023-12-12T11:52:02.810 INFO:tasks.workunit.client.0.smithi063.stdout:1/659: chown d3/db/d16/d24/d4d/c1c 7 1 2023-12-12T11:52:02.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.807+0000 7f3390db9700 1 --2- 172.21.15.63:0/1591843919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f338c06e700 0x7f338c1180a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:02.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.807+0000 7f3390db9700 1 --2- 172.21.15.63:0/1591843919 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f338c1185e0 0x7f338c119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:02.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.807+0000 7f3390db9700 1 -- 172.21.15.63:0/1591843919 >> 172.21.15.63:0/1591843919 conn(0x7f338c069b20 msgr2=0x7f338c1074e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:52:02.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.808+0000 7f3390db9700 1 -- 172.21.15.63:0/1591843919 shutdown_connections 2023-12-12T11:52:02.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:02.808+0000 7f3390db9700 1 -- 172.21.15.63:0/1591843919 wait complete. 2023-12-12T11:52:02.811 INFO:tasks.workunit.client.1.smithi093.stdout:9/818: dread d1/f1e [0,4194304] 0 2023-12-12T11:52:02.812 INFO:tasks.workunit.client.1.smithi093.stdout:9/819: chown d1/d23/d6b/d92/db2/lc5 961 1 2023-12-12T11:52:02.812 INFO:tasks.workunit.client.1.smithi093.stdout:3/823: unlink df/d22/d49/d69/d78/daf/d3d/d59/f98 0 2023-12-12T11:52:02.813 INFO:tasks.workunit.client.1.smithi093.stdout:2/837: getdents d5/d14/d2d/d4c/d54/d67/d69/d6c/df2 0 2023-12-12T11:52:02.814 INFO:tasks.workunit.client.0.smithi063.stdout:2/489: dwrite d0/f43 [0,4194304] 0 2023-12-12T11:52:02.815 INFO:tasks.workunit.client.1.smithi093.stdout:9/820: dread d1/d23/d24/d29/d43/d56/d85/dc3/dce/d3e/fe4 [0,4194304] 0 2023-12-12T11:52:02.816 INFO:tasks.workunit.client.1.smithi093.stdout:6/960: mkdir d0/da/d14/d155 0 2023-12-12T11:52:02.821 INFO:tasks.workunit.client.0.smithi063.stdout:3/523: dwrite d4/df/d1a/d1c/d3b/d50/d61/f93 [0,4194304] 0 2023-12-12T11:52:02.821 INFO:tasks.workunit.client.0.smithi063.stdout:3/524: chown d4/df/d1a/d1c/d34/c35 28780 1 2023-12-12T11:52:02.822 INFO:tasks.workunit.client.1.smithi093.stdout:7/786: creat da/d15/d19/f10c x:0 0 0 2023-12-12T11:52:02.825 INFO:tasks.workunit.client.0.smithi063.stdout:8/641: symlink d4/d24/lcb 0 2023-12-12T11:52:02.827 INFO:tasks.workunit.client.0.smithi063.stdout:5/623: unlink d7/d10/d2b/d3c/d42/l6f 0 2023-12-12T11:52:02.832 INFO:tasks.workunit.client.0.smithi063.stdout:1/660: unlink d3/db/d16/d24/d48/d75/d83/d5b/d6b/lc7 0 2023-12-12T11:52:02.855 INFO:tasks.workunit.client.0.smithi063.stdout:3/525: truncate d4/df/d1a/d1c/d3b/d50/f5a 3450778 0 2023-12-12T11:52:02.858 INFO:tasks.workunit.client.0.smithi063.stdout:5/624: mknod d7/d10/d2b/d3c/d27/cbe 0 2023-12-12T11:52:02.858 INFO:tasks.workunit.client.0.smithi063.stdout:5/625: creat d7/d10/d2b/d3c/d42/d62/d69/fbf x:0 0 0 2023-12-12T11:52:02.864 INFO:tasks.workunit.client.0.smithi063.stdout:1/661: truncate d3/db/d12/f50 2399875 0 2023-12-12T11:52:02.876 INFO:tasks.workunit.client.0.smithi063.stdout:8/642: dwrite d4/de/d3b/fa4 [0,4194304] 0 2023-12-12T11:52:02.876 INFO:tasks.workunit.client.0.smithi063.stdout:8/643: creat d4/de/d11/fcc x:0 0 0 2023-12-12T11:52:02.880 INFO:tasks.workunit.client.0.smithi063.stdout:2/490: rmdir d0/d1a/d3a 39 2023-12-12T11:52:02.881 INFO:tasks.workunit.client.1.smithi093.stdout:9/821: unlink d1/d23/d24/d29/d43/d56/d85/dc3/dce/f1a 0 2023-12-12T11:52:02.883 INFO:tasks.workunit.client.0.smithi063.stdout:3/526: mknod d4/df/d1a/d1c/d41/ca0 0 2023-12-12T11:52:02.883 INFO:tasks.workunit.client.0.smithi063.stdout:3/527: getdents d4/df/d1a/d1c/d3b/d81 0 2023-12-12T11:52:02.883 INFO:tasks.workunit.client.0.smithi063.stdout:3/528: stat d4/df/d1a/d1c/d3b/d52 0 2023-12-12T11:52:02.884 INFO:tasks.workunit.client.1.smithi093.stdout:6/961: mknod d0/da/d14/d38/d43/c156 0 2023-12-12T11:52:02.892 INFO:tasks.workunit.client.0.smithi063.stdout:0/613: dwrite d0/d7/d27/f3b [0,4194304] 0 2023-12-12T11:52:02.895 INFO:tasks.workunit.client.0.smithi063.stdout:0/614: write d0/d1a/d23/fa6 [746289,63695] 0 2023-12-12T11:52:02.895 INFO:tasks.workunit.client.0.smithi063.stdout:5/626: symlink d7/d10/d2b/d3c/d27/lc0 0 2023-12-12T11:52:02.906 INFO:tasks.workunit.client.1.smithi093.stdout:6/962: dread d0/d52/fd9 [0,4194304] 0 2023-12-12T11:52:02.915 INFO:tasks.workunit.client.0.smithi063.stdout:0/615: dread d0/d7/ff [0,4194304] 0 2023-12-12T11:52:02.916 INFO:tasks.workunit.client.0.smithi063.stdout:0/616: write d0/d1a/d66/f8a [4632142,110059] 0 2023-12-12T11:52:02.916 INFO:tasks.workunit.client.0.smithi063.stdout:0/617: write d0/d1a/d23/d34/d42/d99/fc7 [14812,76073] 0 2023-12-12T11:52:02.919 INFO:tasks.workunit.client.0.smithi063.stdout:9/478: sync 2023-12-12T11:52:02.919 INFO:tasks.workunit.client.0.smithi063.stdout:7/489: sync 2023-12-12T11:52:02.920 INFO:tasks.workunit.client.0.smithi063.stdout:8/644: symlink d4/d24/d38/d45/dc2/lcd 0 2023-12-12T11:52:02.928 INFO:tasks.workunit.client.0.smithi063.stdout:2/491: creat d0/fa3 x:0 0 0 2023-12-12T11:52:02.928 INFO:tasks.workunit.client.0.smithi063.stdout:2/492: chown d0/l5b 3 1 2023-12-12T11:52:02.928 INFO:tasks.workunit.client.0.smithi063.stdout:2/493: chown d0/l67 10 1 2023-12-12T11:52:02.929 INFO:tasks.workunit.client.0.smithi063.stdout:2/494: write d0/d41/d90/f95 [68429,13320] 0 2023-12-12T11:52:02.935 INFO:tasks.workunit.client.0.smithi063.stdout:3/529: mkdir d4/d23/d5d/d4c/d69/da1 0 2023-12-12T11:52:02.936 INFO:tasks.workunit.client.0.smithi063.stdout:3/530: write d4/df/d1a/d1c/d3b/d50/f97 [885355,23203] 0 2023-12-12T11:52:02.936 INFO:tasks.workunit.client.0.smithi063.stdout:0/618: dread d0/d7/d27/d19/f86 [0,4194304] 0 2023-12-12T11:52:02.937 INFO:tasks.workunit.client.0.smithi063.stdout:4/625: sync 2023-12-12T11:52:02.943 INFO:tasks.workunit.client.0.smithi063.stdout:4/626: write d2/d47/f66 [811974,94644] 0 2023-12-12T11:52:02.949 INFO:tasks.workunit.client.1.smithi093.stdout:8/865: truncate d3/d1a/f83 178165 0 2023-12-12T11:52:02.950 INFO:tasks.workunit.client.1.smithi093.stdout:7/787: creat da/d8e/daa/dd6/f10d x:0 0 0 2023-12-12T11:52:02.950 INFO:tasks.workunit.client.1.smithi093.stdout:8/866: write d3/d1a/d1f/d29/d63/ff5 [1882399,66338] 0 2023-12-12T11:52:02.952 INFO:tasks.workunit.client.0.smithi063.stdout:8/645: dread d4/de/d11/f14 [4194304,4194304] 0 2023-12-12T11:52:02.957 INFO:tasks.workunit.client.0.smithi063.stdout:5/627: unlink d7/l61 0 2023-12-12T11:52:02.962 INFO:tasks.workunit.client.1.smithi093.stdout:0/837: rmdir d5/d41/d77/d79/d9b 39 2023-12-12T11:52:02.964 INFO:tasks.workunit.client.0.smithi063.stdout:8/646: dread d4/f9c [0,4194304] 0 2023-12-12T11:52:02.969 INFO:tasks.workunit.client.1.smithi093.stdout:2/838: rename d5/d31/d86 to d5/d14/d2d/d12/d44/d11b 0 2023-12-12T11:52:02.970 INFO:tasks.workunit.client.1.smithi093.stdout:0/838: dread d5/d21/d27/d3a/d9a/fc3 [0,4194304] 0 2023-12-12T11:52:02.971 INFO:tasks.workunit.client.1.smithi093.stdout:9/822: symlink d1/d23/d24/d29/d43/d58/l116 0 2023-12-12T11:52:02.981 INFO:tasks.workunit.client.1.smithi093.stdout:6/963: dwrite d0/da/d32/d9e/d4d/de9/f138 [0,4194304] 0 2023-12-12T11:52:02.981 INFO:tasks.workunit.client.1.smithi093.stdout:6/964: chown d0/da/d14/d3a/d106/f11c 91243558 1 2023-12-12T11:52:02.994 INFO:tasks.workunit.client.0.smithi063.stdout:8/647: dread d4/de/d1e/f4f [0,4194304] 0 2023-12-12T11:52:02.994 INFO:tasks.workunit.client.0.smithi063.stdout:8/648: dread - d4/de/d3b/d62/d36/d57/f89 zero size 2023-12-12T11:52:02.999 INFO:tasks.workunit.client.1.smithi093.stdout:7/788: link da/d15/d19/d4c/d6d/f92 da/d15/d19/d4c/f10e 0 2023-12-12T11:52:03.005 INFO:tasks.workunit.client.1.smithi093.stdout:8/867: unlink d3/d1a/d1f/d29/d3a/d68/l10e 0 2023-12-12T11:52:03.011 INFO:tasks.workunit.client.1.smithi093.stdout:9/823: symlink d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/d42/dd3/l117 0 2023-12-12T11:52:03.011 INFO:tasks.workunit.client.1.smithi093.stdout:9/824: chown d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/c74 60 1 2023-12-12T11:52:03.027 INFO:tasks.workunit.client.0.smithi063.stdout:5/628: dwrite d7/d10/d2b/f34 [0,4194304] 0 2023-12-12T11:52:03.027 INFO:tasks.workunit.client.1.smithi093.stdout:2/839: dwrite d5/d14/d2d/f53 [0,4194304] 0 2023-12-12T11:52:03.028 INFO:tasks.workunit.client.1.smithi093.stdout:7/789: symlink da/d15/d2d/d2f/dc6/l10f 0 2023-12-12T11:52:03.028 INFO:tasks.workunit.client.1.smithi093.stdout:7/790: read - da/d15/d59/fe5 zero size 2023-12-12T11:52:03.029 INFO:tasks.workunit.client.1.smithi093.stdout:9/825: creat d1/d23/d6b/d92/f118 x:0 0 0 2023-12-12T11:52:03.030 INFO:tasks.workunit.client.1.smithi093.stdout:9/826: dread - d1/d23/f9c zero size 2023-12-12T11:52:03.035 INFO:tasks.workunit.client.1.smithi093.stdout:2/840: creat d5/d14/d2d/d12/d25/d7a/d7e/dc9/f11c x:0 0 0 2023-12-12T11:52:03.037 INFO:tasks.workunit.client.1.smithi093.stdout:7/791: creat da/d2e/d89/f110 x:0 0 0 2023-12-12T11:52:03.041 INFO:tasks.workunit.client.1.smithi093.stdout:6/965: dwrite d0/da/d32/f10d [0,4194304] 0 2023-12-12T11:52:03.043 INFO:tasks.workunit.client.0.smithi063.stdout:1/662: rename d3/db to d3/d3a/dd7 0 2023-12-12T11:52:03.043 INFO:tasks.workunit.client.0.smithi063.stdout:1/663: dread - d3/d3a/dd7/d16/d4f/d9a/fba zero size 2023-12-12T11:52:03.044 INFO:tasks.workunit.client.1.smithi093.stdout:9/827: symlink d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/dae/l119 0 2023-12-12T11:52:03.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:02 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:03.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:02 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:03.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:02 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:03.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:02 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:03.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:02 smithi063 ceph-mon[107117]: Reconfiguring node-exporter.smithi063 (dependencies changed)... 2023-12-12T11:52:03.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:02 smithi063 ceph-mon[107117]: Reconfiguring daemon node-exporter.smithi063 on smithi063 2023-12-12T11:52:03.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:02 smithi063 ceph-mon[107117]: from='client.24521 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:52:03.045 INFO:tasks.workunit.client.0.smithi063.stdout:9/479: mknod d7/d20/c9e 0 2023-12-12T11:52:03.048 INFO:tasks.workunit.client.1.smithi093.stdout:7/792: creat da/f111 x:0 0 0 2023-12-12T11:52:03.048 INFO:tasks.workunit.client.1.smithi093.stdout:7/793: read da/d15/d2d/f6e [70352,31668] 0 2023-12-12T11:52:03.050 INFO:tasks.workunit.client.1.smithi093.stdout:0/839: dwrite d5/d21/fb1 [0,4194304] 0 2023-12-12T11:52:03.051 INFO:tasks.workunit.client.0.smithi063.stdout:7/490: creat de/d39/d60/da4/fb7 x:0 0 0 2023-12-12T11:52:03.053 INFO:tasks.workunit.client.1.smithi093.stdout:8/868: dwrite d3/d1a/d1f/d29/f32 [0,4194304] 0 2023-12-12T11:52:03.053 INFO:tasks.workunit.client.1.smithi093.stdout:8/869: write d3/d8/d88/dc5/f111 [1899339,12934] 0 2023-12-12T11:52:03.056 INFO:tasks.workunit.client.0.smithi063.stdout:2/495: symlink d0/d1a/d48/d56/da2/la4 0 2023-12-12T11:52:03.056 INFO:tasks.workunit.client.1.smithi093.stdout:2/841: write d5/d14/d2d/d4c/fd8 [4096590,51432] 0 2023-12-12T11:52:03.058 INFO:tasks.workunit.client.1.smithi093.stdout:1/855: dwrite d4/d1a/d1b/d26/f7d [0,4194304] 0 2023-12-12T11:52:03.058 INFO:tasks.workunit.client.1.smithi093.stdout:1/856: write d4/dc/d7a/ffb [597136,84720] 0 2023-12-12T11:52:03.058 INFO:tasks.workunit.client.1.smithi093.stdout:1/857: chown d4/dc/d7a/d9c/fe9 2 1 2023-12-12T11:52:03.058 INFO:tasks.workunit.client.1.smithi093.stdout:1/858: creat d4/d1a/dc2/f120 x:0 0 0 2023-12-12T11:52:03.058 INFO:tasks.workunit.client.1.smithi093.stdout:9/828: dread d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/f49 [0,4194304] 0 2023-12-12T11:52:03.058 INFO:tasks.workunit.client.0.smithi063.stdout:3/531: link d4/d23/f24 d4/d23/d5d/d4c/d69/da1/fa2 0 2023-12-12T11:52:03.060 INFO:tasks.workunit.client.0.smithi063.stdout:4/627: mknod d2/d17/d41/ccb 0 2023-12-12T11:52:03.063 INFO:tasks.workunit.client.1.smithi093.stdout:6/966: mknod d0/da/d14/d38/d43/c157 0 2023-12-12T11:52:03.065 INFO:tasks.workunit.client.1.smithi093.stdout:7/794: truncate da/d15/d19/d90/f87 1197357 0 2023-12-12T11:52:03.065 INFO:tasks.workunit.client.1.smithi093.stdout:7/795: stat da/cd 0 2023-12-12T11:52:03.068 INFO:tasks.workunit.client.0.smithi063.stdout:3/532: write d4/df/f19 [1107282,2543] 0 2023-12-12T11:52:03.068 INFO:tasks.workunit.client.0.smithi063.stdout:3/533: chown d4/d23/d5d/d4c/d69/da1/fa2 7720 1 2023-12-12T11:52:03.068 INFO:tasks.workunit.client.0.smithi063.stdout:7/491: write de/d39/d4b/f70 [3721323,98715] 0 2023-12-12T11:52:03.068 INFO:tasks.workunit.client.0.smithi063.stdout:7/492: fdatasync de/d39/d60/d97/daf/fb0 0 2023-12-12T11:52:03.068 INFO:tasks.workunit.client.0.smithi063.stdout:7/493: write de/d34/d68/d89/f8e [949033,26151] 0 2023-12-12T11:52:03.069 INFO:tasks.workunit.client.1.smithi093.stdout:6/967: dread d0/da/d32/d9e/d4d/de9/fed [0,4194304] 0 2023-12-12T11:52:03.070 INFO:tasks.workunit.client.0.smithi063.stdout:9/480: write d7/d15/f63 [4003729,19223] 0 2023-12-12T11:52:03.074 INFO:tasks.workunit.client.0.smithi063.stdout:8/649: link d4/d24/d38/d45/d5b/l98 d4/d24/d38/lce 0 2023-12-12T11:52:03.077 INFO:tasks.workunit.client.0.smithi063.stdout:5/629: getdents d7/d10/d2b/d3c/d42/d76 0 2023-12-12T11:52:03.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.075+0000 7f9dbff6a700 1 -- 172.21.15.63:0/3843868212 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9db80fbaf0 msgr2=0x7f9db80fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:03.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.075+0000 7f9dbff6a700 1 --2- 172.21.15.63:0/3843868212 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9db80fbaf0 0x7f9db80fbf00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9db4004940 tx=0x7f9db4009e30 comp rx=0 tx=0).stop 2023-12-12T11:52:03.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.075+0000 7f9dbff6a700 1 -- 172.21.15.63:0/3843868212 shutdown_connections 2023-12-12T11:52:03.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.075+0000 7f9dbff6a700 1 --2- 172.21.15.63:0/3843868212 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9db80fcd00 0x7f9db80fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:03.079 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.075+0000 7f9dbff6a700 1 --2- 172.21.15.63:0/3843868212 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9db80fbaf0 0x7f9db80fbf00 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:03.079 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.075+0000 7f9dbff6a700 1 -- 172.21.15.63:0/3843868212 >> 172.21.15.63:0/3843868212 conn(0x7f9db80f71d0 msgr2=0x7f9db80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:52:03.079 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.076+0000 7f9dbff6a700 1 -- 172.21.15.63:0/3843868212 shutdown_connections 2023-12-12T11:52:03.079 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.076+0000 7f9dbff6a700 1 -- 172.21.15.63:0/3843868212 wait complete. 2023-12-12T11:52:03.079 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.077+0000 7f9dbff6a700 1 Processor -- start 2023-12-12T11:52:03.079 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.077+0000 7f9dbff6a700 1 -- start start 2023-12-12T11:52:03.080 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.078+0000 7f9dbff6a700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9db80fbaf0 0x7f9db80ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:03.080 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.078+0000 7f9dbff6a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9db80fcd00 0x7f9db80fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:03.080 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.078+0000 7f9dbff6a700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db80fe6d0 con 0x7f9db80fcd00 2023-12-12T11:52:03.080 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.078+0000 7f9dbff6a700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db80fe840 con 0x7f9db80fbaf0 2023-12-12T11:52:03.080 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.078+0000 7f9dbdd06700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9db80fbaf0 0x7f9db80ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:03.080 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.078+0000 7f9dbdd06700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9db80fbaf0 0x7f9db80ffbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:40842/0 (socket says 172.21.15.63:40842) 2023-12-12T11:52:03.080 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.078+0000 7f9dbdd06700 1 -- 172.21.15.63:0/1037858834 learned_addr learned my addr 172.21.15.63:0/1037858834 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:52:03.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.079+0000 7f9dbdd06700 1 -- 172.21.15.63:0/1037858834 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9db80fcd00 msgr2=0x7f9db80fe040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:03.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.079+0000 7f9dbdd06700 1 --2- 172.21.15.63:0/1037858834 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9db80fcd00 0x7f9db80fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:03.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.079+0000 7f9dbdd06700 1 -- 172.21.15.63:0/1037858834 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db4005040 con 0x7f9db80fbaf0 2023-12-12T11:52:03.081 INFO:tasks.workunit.client.0.smithi063.stdout:0/619: rename d0/d1a/d23/d2e/c4a to d0/d1a/d23/cca 0 2023-12-12T11:52:03.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.079+0000 7f9dbdd06700 1 --2- 172.21.15.63:0/1037858834 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9db80fbaf0 0x7f9db80ffbc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9db4000c00 tx=0x7f9db4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:52:03.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.079+0000 7f9dae7fc700 1 -- 172.21.15.63:0/1037858834 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9db400e030 con 0x7f9db80fbaf0 2023-12-12T11:52:03.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.079+0000 7f9dae7fc700 1 -- 172.21.15.63:0/1037858834 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9db4004290 con 0x7f9db80fbaf0 2023-12-12T11:52:03.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.080+0000 7f9dae7fc700 1 -- 172.21.15.63:0/1037858834 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9db401c400 con 0x7f9db80fbaf0 2023-12-12T11:52:03.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.080+0000 7f9dbff6a700 1 -- 172.21.15.63:0/1037858834 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db80feac0 con 0x7f9db80fbaf0 2023-12-12T11:52:03.082 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.080+0000 7f9dbff6a700 1 -- 172.21.15.63:0/1037858834 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db8115640 con 0x7f9db80fbaf0 2023-12-12T11:52:03.086 INFO:tasks.workunit.client.0.smithi063.stdout:1/664: creat d3/d3a/dd7/d16/d17/d4b/fd8 x:0 0 0 2023-12-12T11:52:03.087 INFO:tasks.workunit.client.1.smithi093.stdout:8/870: symlink d3/d1a/d1f/d50/l11e 0 2023-12-12T11:52:03.087 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.082+0000 7f9dbff6a700 1 -- 172.21.15.63:0/1037858834 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db804bb80 con 0x7f9db80fbaf0 2023-12-12T11:52:03.087 INFO:tasks.workunit.client.0.smithi063.stdout:3/534: dread d4/df/d1a/d1c/d41/f51 [0,4194304] 0 2023-12-12T11:52:03.088 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.083+0000 7f9dae7fc700 1 -- 172.21.15.63:0/1037858834 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 24) v1 ==== 88724+0+0 (secure 0 0 0) 0x7f9db4013420 con 0x7f9db80fbaf0 2023-12-12T11:52:03.088 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.085+0000 7f9dae7fc700 1 --2- 172.21.15.63:0/1037858834 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f9da406ae40 0x7f9da406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:03.088 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.085+0000 7f9dae7fc700 1 -- 172.21.15.63:0/1037858834 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f9db408b050 con 0x7f9db80fbaf0 2023-12-12T11:52:03.088 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.086+0000 7f9dbd505700 1 --2- 172.21.15.63:0/1037858834 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f9da406ae40 0x7f9da406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:03.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.087+0000 7f9dbd505700 1 --2- 172.21.15.63:0/1037858834 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f9da406ae40 0x7f9da406d2f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9da80097c0 tx=0x7f9da8006ce0 comp rx=0 tx=0).ready entity=mgr.24471 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:52:03.091 INFO:tasks.workunit.client.0.smithi063.stdout:2/496: symlink d0/d41/la5 0 2023-12-12T11:52:03.091 INFO:tasks.workunit.client.0.smithi063.stdout:2/497: readlink d0/d1a/d1e/l36 0 2023-12-12T11:52:03.094 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.092+0000 7f9dae7fc700 1 -- 172.21.15.63:0/1037858834 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f9db4058ec0 con 0x7f9db80fbaf0 2023-12-12T11:52:03.096 INFO:tasks.workunit.client.1.smithi093.stdout:0/840: dread d5/dd/d33/f5e [0,4194304] 0 2023-12-12T11:52:03.100 INFO:tasks.workunit.client.1.smithi093.stdout:9/829: truncate d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/d42/f6e 868262 0 2023-12-12T11:52:03.103 INFO:tasks.workunit.client.0.smithi063.stdout:7/494: mknod de/d33/d41/d44/d8b/cb8 0 2023-12-12T11:52:03.103 INFO:tasks.workunit.client.0.smithi063.stdout:7/495: chown de/d34/d43/d45/l8c 7435072 1 2023-12-12T11:52:03.106 INFO:tasks.workunit.client.0.smithi063.stdout:1/665: dread d3/d3a/f60 [0,4194304] 0 2023-12-12T11:52:03.106 INFO:tasks.workunit.client.0.smithi063.stdout:1/666: chown d3/d3a/dd7/d12/c53 1541 1 2023-12-12T11:52:03.107 INFO:tasks.workunit.client.1.smithi093.stdout:3/824: sync 2023-12-12T11:52:03.107 INFO:tasks.workunit.client.1.smithi093.stdout:5/703: sync 2023-12-12T11:52:03.107 INFO:tasks.workunit.client.1.smithi093.stdout:5/704: stat d0/d7/d36/d68/cf2 0 2023-12-12T11:52:03.110 INFO:tasks.workunit.client.0.smithi063.stdout:5/630: symlink d7/d28/d6e/dad/dba/lc1 0 2023-12-12T11:52:03.110 INFO:tasks.workunit.client.0.smithi063.stdout:5/631: fdatasync d7/d28/d43/d49/f4a 0 2023-12-12T11:52:03.114 INFO:tasks.workunit.client.1.smithi093.stdout:7/796: link da/d15/d19/d4c/d6d/c101 da/d15/d59/c112 0 2023-12-12T11:52:03.116 INFO:tasks.workunit.client.0.smithi063.stdout:2/498: dread d0/d1a/d57/f6f [0,4194304] 0 2023-12-12T11:52:03.116 INFO:tasks.workunit.client.0.smithi063.stdout:0/620: mkdir d0/d7/d27/d1f/dc4/d67/dcb 0 2023-12-12T11:52:03.117 INFO:tasks.workunit.client.1.smithi093.stdout:6/968: mknod d0/d52/d7e/d42/c158 0 2023-12-12T11:52:03.118 INFO:tasks.workunit.client.1.smithi093.stdout:2/842: dwrite d5/d14/d2d/f1c [0,4194304] 0 2023-12-12T11:52:03.118 INFO:tasks.workunit.client.0.smithi063.stdout:1/667: read d3/d3a/dd7/d16/d24/d4d/d35/f51 [1229292,111498] 0 2023-12-12T11:52:03.120 INFO:tasks.workunit.client.0.smithi063.stdout:4/628: rename d2/d47/l3a to d2/d17/d9d/lcc 0 2023-12-12T11:52:03.124 INFO:tasks.workunit.client.0.smithi063.stdout:6/644: sync 2023-12-12T11:52:03.131 INFO:tasks.workunit.client.0.smithi063.stdout:5/632: dread d7/de/f30 [0,4194304] 0 2023-12-12T11:52:03.132 INFO:tasks.workunit.client.1.smithi093.stdout:7/797: dread da/d15/d2d/f6e [0,4194304] 0 2023-12-12T11:52:03.134 INFO:tasks.workunit.client.0.smithi063.stdout:7/496: mknod de/d33/d41/cb9 0 2023-12-12T11:52:03.135 INFO:tasks.workunit.client.1.smithi093.stdout:6/969: write d0/da/d32/d9e/d4d/f8f [3805267,68449] 0 2023-12-12T11:52:03.143 INFO:tasks.workunit.client.0.smithi063.stdout:0/621: symlink d0/d1a/d23/d34/d42/d99/lcc 0 2023-12-12T11:52:03.144 INFO:tasks.workunit.client.1.smithi093.stdout:0/841: link d5/d41/fc2 d5/d21/d2f/dae/f107 0 2023-12-12T11:52:03.144 INFO:tasks.workunit.client.1.smithi093.stdout:0/842: stat d5/dd/d14/d26/d58/dab/f9c 0 2023-12-12T11:52:03.144 INFO:tasks.workunit.client.1.smithi093.stdout:0/843: read d5/d41/d77/d79/d9b/f9d [95469,97363] 0 2023-12-12T11:52:03.153 INFO:tasks.workunit.client.1.smithi093.stdout:9/830: dwrite d1/d23/f9c [0,4194304] 0 2023-12-12T11:52:03.153 INFO:tasks.workunit.client.1.smithi093.stdout:9/831: chown d1/d23/d24/d29/d43/d56/d85/dc3/dce/c18 73 1 2023-12-12T11:52:03.161 INFO:tasks.workunit.client.1.smithi093.stdout:3/825: creat df/d22/d49/d69/d78/daf/d3d/d42/d8e/de1/f10a x:0 0 0 2023-12-12T11:52:03.166 INFO:tasks.workunit.client.0.smithi063.stdout:1/668: unlink d3/d3a/dd7/d16/d24/d48/d75/d83/f8d 0 2023-12-12T11:52:03.170 INFO:tasks.workunit.client.0.smithi063.stdout:8/650: rename d4/de/d3b/d62/d36/d7f/lb2 to d4/de/d3b/d62/d36/d57/d84/lcf 0 2023-12-12T11:52:03.170 INFO:tasks.workunit.client.0.smithi063.stdout:8/651: write d4/d24/d38/f88 [307805,65302] 0 2023-12-12T11:52:03.176 INFO:tasks.workunit.client.1.smithi093.stdout:7/798: unlink da/d15/d19/d90/cb0 0 2023-12-12T11:52:03.180 INFO:tasks.workunit.client.0.smithi063.stdout:4/629: unlink d2/d8/f43 0 2023-12-12T11:52:03.180 INFO:tasks.workunit.client.0.smithi063.stdout:4/630: read - d2/d17/d9d/fbc zero size 2023-12-12T11:52:03.180 INFO:tasks.workunit.client.0.smithi063.stdout:4/631: fdatasync d2/d48/d69/d98/fad 0 2023-12-12T11:52:03.180 INFO:tasks.workunit.client.0.smithi063.stdout:4/632: chown d2/d47/daa/fb0 7 1 2023-12-12T11:52:03.182 INFO:tasks.workunit.client.1.smithi093.stdout:8/871: getdents d3/d1a/d1f/d29 0 2023-12-12T11:52:03.184 INFO:tasks.workunit.client.1.smithi093.stdout:5/705: dwrite d0/d7/d59/d48/f6c [0,4194304] 0 2023-12-12T11:52:03.184 INFO:tasks.workunit.client.1.smithi093.stdout:5/706: write d0/d7/d36/db9/d66/f7d [3442926,99656] 0 2023-12-12T11:52:03.185 INFO:tasks.workunit.client.1.smithi093.stdout:5/707: chown d0/d7/d36/d38/dce/de9 410609939 1 2023-12-12T11:52:03.185 INFO:tasks.workunit.client.1.smithi093.stdout:5/708: creat d0/d7/d36/d68/ff3 x:0 0 0 2023-12-12T11:52:03.189 INFO:tasks.workunit.client.0.smithi063.stdout:6/645: unlink d9/d10/d5c/dce/l80 0 2023-12-12T11:52:03.193 INFO:tasks.workunit.client.1.smithi093.stdout:0/844: symlink d5/d21/d27/d3a/d9a/dc8/l108 0 2023-12-12T11:52:03.194 INFO:tasks.workunit.client.0.smithi063.stdout:3/535: mknod d4/df/d1a/ca3 0 2023-12-12T11:52:03.194 INFO:tasks.workunit.client.0.smithi063.stdout:3/536: write d4/df/d1a/d1c/d57/f6c [1039278,23226] 0 2023-12-12T11:52:03.196 INFO:tasks.workunit.client.0.smithi063.stdout:7/497: mknod de/d3f/cba 0 2023-12-12T11:52:03.197 INFO:tasks.workunit.client.0.smithi063.stdout:0/622: creat d0/d7/d27/fcd x:0 0 0 2023-12-12T11:52:03.202 INFO:tasks.workunit.client.1.smithi093.stdout:2/843: dwrite d5/d14/d2d/d4c/d54/d67/f112 [0,4194304] 0 2023-12-12T11:52:03.203 INFO:tasks.workunit.client.0.smithi063.stdout:8/652: mknod d4/d55/d52/d8e/cd0 0 2023-12-12T11:52:03.203 INFO:tasks.workunit.client.0.smithi063.stdout:8/653: fdatasync d4/de/d3b/fa8 0 2023-12-12T11:52:03.207 INFO:tasks.workunit.client.0.smithi063.stdout:3/537: write f0 [6467806,77427] 0 2023-12-12T11:52:03.207 INFO:tasks.workunit.client.0.smithi063.stdout:3/538: read d4/df/f37 [233728,105053] 0 2023-12-12T11:52:03.208 INFO:tasks.workunit.client.0.smithi063.stdout:5/633: dwrite d7/d28/f47 [0,4194304] 0 2023-12-12T11:52:03.210 INFO:tasks.workunit.client.1.smithi093.stdout:3/826: creat df/d25/d2c/f10b x:0 0 0 2023-12-12T11:52:03.212 INFO:tasks.workunit.client.0.smithi063.stdout:6/646: symlink d9/d10/d5c/dce/d86/le0 0 2023-12-12T11:52:03.212 INFO:tasks.workunit.client.0.smithi063.stdout:6/647: dread - d9/d10/d73/f98 zero size 2023-12-12T11:52:03.218 INFO:tasks.workunit.client.1.smithi093.stdout:7/799: creat da/d15/d19/d4c/dc1/f113 x:0 0 0 2023-12-12T11:52:03.218 INFO:tasks.workunit.client.1.smithi093.stdout:7/800: readlink da/d2e/led 0 2023-12-12T11:52:03.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:02 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:03.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:02 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:03.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:02 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:03.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:02 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:03.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:02 smithi093 ceph-mon[115914]: Reconfiguring node-exporter.smithi063 (dependencies changed)... 2023-12-12T11:52:03.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:02 smithi093 ceph-mon[115914]: Reconfiguring daemon node-exporter.smithi063 on smithi063 2023-12-12T11:52:03.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:02 smithi093 ceph-mon[115914]: from='client.24521 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:52:03.223 INFO:tasks.workunit.client.1.smithi093.stdout:8/872: truncate d3/d1a/d1f/d29/d30/d58/d76/f86 1690756 0 2023-12-12T11:52:03.223 INFO:tasks.workunit.client.1.smithi093.stdout:8/873: dread - d3/d1a/d1f/d29/d30/d110/f119 zero size 2023-12-12T11:52:03.223 INFO:tasks.workunit.client.1.smithi093.stdout:8/874: chown d3/d1a/d1f/d29/d3a/d40/dbf/fff 1162 1 2023-12-12T11:52:03.223 INFO:tasks.workunit.client.1.smithi093.stdout:9/832: dwrite d1/d23/f40 [0,4194304] 0 2023-12-12T11:52:03.223 INFO:tasks.workunit.client.1.smithi093.stdout:9/833: readlink d1/d23/d24/d29/d43/d56/de9/l10c 0 2023-12-12T11:52:03.224 INFO:tasks.workunit.client.0.smithi063.stdout:2/499: dwrite d0/d1a/d1e/f60 [0,4194304] 0 2023-12-12T11:52:03.232 INFO:tasks.workunit.client.0.smithi063.stdout:7/498: creat de/d33/fbb x:0 0 0 2023-12-12T11:52:03.239 INFO:tasks.workunit.client.0.smithi063.stdout:0/623: unlink d0/d1a/c83 0 2023-12-12T11:52:03.243 INFO:tasks.workunit.client.1.smithi093.stdout:7/801: write da/de/f30 [3745110,32702] 0 2023-12-12T11:52:03.249 INFO:tasks.workunit.client.1.smithi093.stdout:5/709: rename d0/d7/d36/d29/f30 to d0/d7/d36/d87/ff4 0 2023-12-12T11:52:03.253 INFO:tasks.workunit.client.1.smithi093.stdout:3/827: dwrite df/d22/d49/d69/d78/daf/d3d/d6f/db1/fdb [0,4194304] 0 2023-12-12T11:52:03.253 INFO:tasks.workunit.client.1.smithi093.stdout:3/828: readlink df/d22/d49/d69/d78/daf/d3d/lca 0 2023-12-12T11:52:03.253 INFO:tasks.workunit.client.1.smithi093.stdout:3/829: fsync df/d22/d49/d69/d78/daf/d3d/d59/d9c/fcd 0 2023-12-12T11:52:03.254 INFO:tasks.workunit.client.1.smithi093.stdout:0/845: rmdir d5/d21/d27/d3a/d9a/db5 39 2023-12-12T11:52:03.254 INFO:tasks.workunit.client.1.smithi093.stdout:0/846: chown d5/dd/d62/fec 16469315 1 2023-12-12T11:52:03.254 INFO:tasks.workunit.client.1.smithi093.stdout:0/847: creat d5/dd/d33/f109 x:0 0 0 2023-12-12T11:52:03.254 INFO:tasks.workunit.client.1.smithi093.stdout:0/848: creat d5/dd/d14/d26/d58/dab/f10a x:0 0 0 2023-12-12T11:52:03.254 INFO:tasks.workunit.client.1.smithi093.stdout:0/849: stat d5/d21/d27/d3a/d9a/db5/db8/dd4 0 2023-12-12T11:52:03.255 INFO:tasks.workunit.client.0.smithi063.stdout:8/654: rmdir d4 39 2023-12-12T11:52:03.255 INFO:tasks.workunit.client.0.smithi063.stdout:8/655: chown d4/d24/d38/d45/d5b/l77 214 1 2023-12-12T11:52:03.255 INFO:tasks.workunit.client.0.smithi063.stdout:8/656: write d4/d24/d38/d45/d5b/d92/d65/f8d [201820,100684] 0 2023-12-12T11:52:03.255 INFO:tasks.workunit.client.0.smithi063.stdout:8/657: fdatasync d4/de/f53 0 2023-12-12T11:52:03.259 INFO:tasks.workunit.client.0.smithi063.stdout:3/539: link d4/df/d1a/d1c/d41/f58 d4/df/d1a/d1c/d3b/d50/fa4 0 2023-12-12T11:52:03.259 INFO:tasks.workunit.client.0.smithi063.stdout:3/540: fdatasync d4/df/d1a/d1c/d3b/d50/f8f 0 2023-12-12T11:52:03.270 INFO:tasks.workunit.client.1.smithi093.stdout:7/802: dread da/de/d46/d4f/f62 [0,4194304] 0 2023-12-12T11:52:03.271 INFO:tasks.workunit.client.1.smithi093.stdout:9/834: dwrite d1/d23/d24/d29/d43/d56/d68/f90 [4194304,4194304] 0 2023-12-12T11:52:03.271 INFO:tasks.workunit.client.1.smithi093.stdout:2/844: symlink d5/d31/dbc/l11d 0 2023-12-12T11:52:03.275 INFO:tasks.workunit.client.0.smithi063.stdout:5/634: creat d7/d10/d2b/d3c/d5a/dbb/fc2 x:0 0 0 2023-12-12T11:52:03.275 INFO:tasks.workunit.client.0.smithi063.stdout:5/635: write d7/d10/d2b/d3c/d42/d76/fae [606527,22196] 0 2023-12-12T11:52:03.278 INFO:tasks.workunit.client.0.smithi063.stdout:4/633: link d2/d48/fac d2/d8/fcd 0 2023-12-12T11:52:03.278 INFO:tasks.workunit.client.0.smithi063.stdout:4/634: write d2/d48/fc8 [1029469,64949] 0 2023-12-12T11:52:03.286 INFO:tasks.workunit.client.0.smithi063.stdout:8/658: dread d4/de/d3b/d62/d36/d57/d84/fbc [4194304,4194304] 0 2023-12-12T11:52:03.286 INFO:tasks.workunit.client.0.smithi063.stdout:8/659: fdatasync d4/d24/d38/d45/d5b/d92/fb9 0 2023-12-12T11:52:03.286 INFO:tasks.workunit.client.0.smithi063.stdout:6/648: mknod d9/d10/d2a/ce1 0 2023-12-12T11:52:03.286 INFO:tasks.workunit.client.0.smithi063.stdout:6/649: fdatasync d9/d68/f90 0 2023-12-12T11:52:03.286 INFO:tasks.workunit.client.0.smithi063.stdout:9/481: dwrite d7/d15/f23 [0,4194304] 0 2023-12-12T11:52:03.289 INFO:tasks.workunit.client.0.smithi063.stdout:5/636: dread d7/d10/d2b/d3c/d42/d76/fae [0,4194304] 0 2023-12-12T11:52:03.289 INFO:tasks.workunit.client.0.smithi063.stdout:5/637: write d7/d10/d2b/d3c/d42/d76/fae [1559868,49980] 0 2023-12-12T11:52:03.289 INFO:tasks.workunit.client.0.smithi063.stdout:5/638: creat d7/d10/d2b/d3c/d5a/dbb/fc3 x:0 0 0 2023-12-12T11:52:03.290 INFO:tasks.workunit.client.0.smithi063.stdout:5/639: fsync d7/d10/f92 0 2023-12-12T11:52:03.293 INFO:tasks.workunit.client.1.smithi093.stdout:0/850: dwrite d5/d41/d77/d79/d9b/f9e [0,4194304] 0 2023-12-12T11:52:03.297 INFO:tasks.workunit.client.0.smithi063.stdout:2/500: mkdir d0/d1a/d3a/d85/da6 0 2023-12-12T11:52:03.305 INFO:tasks.workunit.client.0.smithi063.stdout:7/499: symlink de/d22/d2b/lbc 0 2023-12-12T11:52:03.306 INFO:tasks.workunit.client.0.smithi063.stdout:0/624: chown d0/d1a/l37 1618227581 1 2023-12-12T11:52:03.311 INFO:tasks.workunit.client.1.smithi093.stdout:2/845: dwrite d5/d14/d2d/d12/d25/d7a/d7e/da0/fa9 [0,4194304] 0 2023-12-12T11:52:03.311 INFO:tasks.workunit.client.1.smithi093.stdout:8/875: rename d3/d1a/d1f/daf/cf0 to d3/d1a/d1f/d29/d3a/da0/dcb/d109/c11f 0 2023-12-12T11:52:03.311 INFO:tasks.workunit.client.1.smithi093.stdout:8/876: readlink d3/d1a/d1f/d59/d69/l6f 0 2023-12-12T11:52:03.313 INFO:tasks.workunit.client.1.smithi093.stdout:5/710: truncate d0/d7/d59/d48/f4c 4892431 0 2023-12-12T11:52:03.319 INFO:tasks.workunit.client.0.smithi063.stdout:3/541: rename d4/d23/d5d to d4/df/d1a/d1c/d3b/d52/d78/da5 0 2023-12-12T11:52:03.322 INFO:tasks.workunit.client.1.smithi093.stdout:3/830: mknod df/d30/d33/c10c 0 2023-12-12T11:52:03.325 INFO:tasks.workunit.client.1.smithi093.stdout:8/877: dread d3/f42 [0,4194304] 0 2023-12-12T11:52:03.325 INFO:tasks.workunit.client.1.smithi093.stdout:8/878: truncate d3/d1a/d1f/d75/fdc 643995 0 2023-12-12T11:52:03.331 INFO:tasks.workunit.client.0.smithi063.stdout:4/635: mknod d2/d17/d9d/cce 0 2023-12-12T11:52:03.338 INFO:tasks.workunit.client.1.smithi093.stdout:1/859: sync 2023-12-12T11:52:03.339 INFO:tasks.workunit.client.0.smithi063.stdout:7/500: mknod de/d22/d6e/da2/cbd 0 2023-12-12T11:52:03.339 INFO:tasks.workunit.client.0.smithi063.stdout:7/501: chown de/d34/d43/d45 0 1 2023-12-12T11:52:03.339 INFO:tasks.workunit.client.0.smithi063.stdout:7/502: creat de/d39/d4b/d7b/fbe x:0 0 0 2023-12-12T11:52:03.339 INFO:tasks.workunit.client.0.smithi063.stdout:3/542: write d4/df/d1a/d1c/d3b/d50/f8f [1914752,65120] 0 2023-12-12T11:52:03.342 INFO:tasks.workunit.client.1.smithi093.stdout:7/803: unlink da/d15/d2d/d2f/cac 0 2023-12-12T11:52:03.344 INFO:tasks.workunit.client.0.smithi063.stdout:0/625: mknod d0/d1a/d23/d2e/d96/cce 0 2023-12-12T11:52:03.345 INFO:tasks.workunit.client.1.smithi093.stdout:9/835: symlink d1/d23/d24/d29/da3/l11a 0 2023-12-12T11:52:03.345 INFO:tasks.workunit.client.1.smithi093.stdout:9/836: chown d1/d23/d24/d29/d43/dfc/c10e 74481 1 2023-12-12T11:52:03.350 INFO:tasks.workunit.client.1.smithi093.stdout:0/851: mkdir d5/d41/d77/d79/df2/d10b 0 2023-12-12T11:52:03.350 INFO:tasks.workunit.client.1.smithi093.stdout:0/852: readlink d5/dd/d14/d26/d58/l8f 0 2023-12-12T11:52:03.352 INFO:tasks.workunit.client.0.smithi063.stdout:8/660: rename d4/d24/lcb to d4/de/d3b/d62/d91/ld1 0 2023-12-12T11:52:03.352 INFO:tasks.workunit.client.0.smithi063.stdout:8/661: write d4/de/d3b/d62/d36/d57/f78 [984049,123663] 0 2023-12-12T11:52:03.352 INFO:tasks.workunit.client.0.smithi063.stdout:5/640: dwrite d7/d28/d6e/f7c [4194304,4194304] 0 2023-12-12T11:52:03.352 INFO:tasks.workunit.client.0.smithi063.stdout:5/641: fsync d7/d10/f92 0 2023-12-12T11:52:03.358 INFO:tasks.workunit.client.0.smithi063.stdout:0/626: dread d0/d1a/d23/f74 [0,4194304] 0 2023-12-12T11:52:03.362 INFO:tasks.workunit.client.0.smithi063.stdout:7/503: truncate de/d3f/f59 888181 0 2023-12-12T11:52:03.363 INFO:tasks.workunit.client.1.smithi093.stdout:2/846: truncate d5/f49 1230838 0 2023-12-12T11:52:03.363 INFO:tasks.workunit.client.1.smithi093.stdout:2/847: stat d5/d14/d2d/fcb 0 2023-12-12T11:52:03.366 INFO:tasks.workunit.client.0.smithi063.stdout:2/501: dwrite d0/d1a/d26/f44 [0,4194304] 0 2023-12-12T11:52:03.366 INFO:tasks.workunit.client.0.smithi063.stdout:2/502: fdatasync d0/d69/f97 0 2023-12-12T11:52:03.366 INFO:tasks.workunit.client.0.smithi063.stdout:2/503: chown d0/f5f 5 1 2023-12-12T11:52:03.368 INFO:tasks.workunit.client.0.smithi063.stdout:3/543: creat d4/df/d1a/d1c/d34/fa6 x:0 0 0 2023-12-12T11:52:03.368 INFO:tasks.workunit.client.0.smithi063.stdout:3/544: chown f0 48003 1 2023-12-12T11:52:03.373 INFO:tasks.workunit.client.1.smithi093.stdout:5/711: creat d0/dd2/ff5 x:0 0 0 2023-12-12T11:52:03.373 INFO:tasks.workunit.client.1.smithi093.stdout:5/712: creat d0/d7/d36/d68/ff6 x:0 0 0 2023-12-12T11:52:03.373 INFO:tasks.workunit.client.1.smithi093.stdout:5/713: dread - d0/d7/d59/fed zero size 2023-12-12T11:52:03.374 INFO:tasks.workunit.client.1.smithi093.stdout:3/831: truncate fc 2782288 0 2023-12-12T11:52:03.374 INFO:tasks.workunit.client.0.smithi063.stdout:6/650: dwrite d9/d10/f1e [0,4194304] 0 2023-12-12T11:52:03.374 INFO:tasks.workunit.client.0.smithi063.stdout:6/651: dread - d9/d2c/d61/fdc zero size 2023-12-12T11:52:03.375 INFO:tasks.workunit.client.0.smithi063.stdout:8/662: creat d4/d24/db3/fd2 x:0 0 0 2023-12-12T11:52:03.376 INFO:tasks.workunit.client.1.smithi093.stdout:8/879: mknod d3/d1a/d1f/d59/d69/dbc/dc2/d115/c120 0 2023-12-12T11:52:03.378 INFO:tasks.workunit.client.1.smithi093.stdout:6/970: sync 2023-12-12T11:52:03.382 INFO:tasks.workunit.client.1.smithi093.stdout:1/860: dwrite d4/d1a/f24 [0,4194304] 0 2023-12-12T11:52:03.384 INFO:tasks.workunit.client.0.smithi063.stdout:0/627: dread d0/d7/d27/d1f/f3f [0,4194304] 0 2023-12-12T11:52:03.384 INFO:tasks.workunit.client.0.smithi063.stdout:9/482: rename d7/d11/d4b/d75/f87 to d7/d20/d3f/d40/d4e/f9f 0 2023-12-12T11:52:03.385 INFO:tasks.workunit.client.1.smithi093.stdout:9/837: mknod d1/d23/d24/d29/d43/d56/d85/dc3/dce/d3e/c11b 0 2023-12-12T11:52:03.389 INFO:tasks.workunit.client.1.smithi093.stdout:0/853: unlink d5/d21/d27/d3a/d9a/db5/db8/f85 0 2023-12-12T11:52:03.390 INFO:tasks.workunit.client.0.smithi063.stdout:5/642: mknod d7/d10/cc4 0 2023-12-12T11:52:03.390 INFO:tasks.workunit.client.0.smithi063.stdout:4/636: rmdir d2/d47/daa 39 2023-12-12T11:52:03.393 INFO:tasks.workunit.client.0.smithi063.stdout:0/628: dread d0/d1a/d23/d2e/d84/fa5 [0,4194304] 0 2023-12-12T11:52:03.409 INFO:tasks.workunit.client.1.smithi093.stdout:5/714: unlink d0/d7/d36/db9/d66/d7c/db5/dcc/lf1 0 2023-12-12T11:52:03.412 INFO:tasks.workunit.client.0.smithi063.stdout:4/637: dread d2/d17/f3c [0,4194304] 0 2023-12-12T11:52:03.412 INFO:tasks.workunit.client.0.smithi063.stdout:4/638: creat d2/d17/d4e/fcf x:0 0 0 2023-12-12T11:52:03.419 INFO:tasks.workunit.client.0.smithi063.stdout:2/504: truncate d0/d41/d90/fa1 25684 0 2023-12-12T11:52:03.419 INFO:tasks.workunit.client.0.smithi063.stdout:2/505: readlink d0/d1a/d1e/l36 0 2023-12-12T11:52:03.419 INFO:tasks.workunit.client.0.smithi063.stdout:2/506: write d0/d69/f8a [963659,9860] 0 2023-12-12T11:52:03.419 INFO:tasks.workunit.client.0.smithi063.stdout:2/507: chown d0/d41/f66 12126 1 2023-12-12T11:52:03.419 INFO:tasks.workunit.client.0.smithi063.stdout:2/508: readlink d0/d1a/d1e/l74 0 2023-12-12T11:52:03.419 INFO:tasks.workunit.client.0.smithi063.stdout:2/509: truncate d0/d69/f97 5358506 0 2023-12-12T11:52:03.420 INFO:tasks.workunit.client.0.smithi063.stdout:2/510: fsync d0/d69/f9d 0 2023-12-12T11:52:03.423 INFO:tasks.workunit.client.0.smithi063.stdout:9/483: dread d7/d11/f53 [0,4194304] 0 2023-12-12T11:52:03.423 INFO:tasks.workunit.client.0.smithi063.stdout:9/484: write d7/f14 [736003,103724] 0 2023-12-12T11:52:03.423 INFO:tasks.workunit.client.0.smithi063.stdout:7/504: dwrite de/d22/d66/fb2 [0,4194304] 0 2023-12-12T11:52:03.423 INFO:tasks.workunit.client.0.smithi063.stdout:7/505: chown de/d39/d4b/d7b 262590634 1 2023-12-12T11:52:03.426 INFO:tasks.workunit.client.0.smithi063.stdout:7/506: fsync de/d22/d66/fa7 0 2023-12-12T11:52:03.426 INFO:tasks.workunit.client.0.smithi063.stdout:3/545: symlink d4/df/d1a/d1c/d3b/d50/d61/la7 0 2023-12-12T11:52:03.427 INFO:tasks.workunit.client.1.smithi093.stdout:3/832: link df/d22/d49/d69/d78/daf/d3d/d42/d8e/da5/fb0 df/d22/d49/d69/d78/dad/f10d 0 2023-12-12T11:52:03.427 INFO:tasks.workunit.client.1.smithi093.stdout:3/833: chown df/dc6/f104 404 1 2023-12-12T11:52:03.427 INFO:tasks.workunit.client.1.smithi093.stdout:3/834: fsync df/d22/d49/d69/fb5 0 2023-12-12T11:52:03.430 INFO:tasks.workunit.client.1.smithi093.stdout:8/880: symlink d3/d1a/d1f/d29/d3a/d68/d8a/l121 0 2023-12-12T11:52:03.430 INFO:tasks.workunit.client.1.smithi093.stdout:8/881: dread - d3/d1a/d1f/ffc zero size 2023-12-12T11:52:03.430 INFO:tasks.workunit.client.1.smithi093.stdout:8/882: chown d3/d1a/d1f/d29/d3a/d40/c7e 3942470 1 2023-12-12T11:52:03.430 INFO:tasks.workunit.client.1.smithi093.stdout:8/883: fdatasync d3/d1a/d1f/d75/de3/f10d 0 2023-12-12T11:52:03.431 INFO:tasks.workunit.client.1.smithi093.stdout:2/848: dwrite d5/d14/d2d/d4c/d76/dc6/d118/d56/d6f/d73/fc0 [0,4194304] 0 2023-12-12T11:52:03.436 INFO:tasks.workunit.client.1.smithi093.stdout:6/971: mkdir d0/d52/d7e/d42/dd5/ddc/d12a/d159 0 2023-12-12T11:52:03.436 INFO:tasks.workunit.client.1.smithi093.stdout:6/972: chown d0/da/d14/d21/le2 0 1 2023-12-12T11:52:03.436 INFO:tasks.workunit.client.1.smithi093.stdout:6/973: readlink d0/da/d32/d9e/d4d/deb/lff 0 2023-12-12T11:52:03.436 INFO:tasks.workunit.client.1.smithi093.stdout:6/974: read d0/da/d32/d9e/d4d/f8f [598001,54701] 0 2023-12-12T11:52:03.442 INFO:tasks.workunit.client.0.smithi063.stdout:7/507: write de/d3f/f72 [2682559,6795] 0 2023-12-12T11:52:03.442 INFO:tasks.workunit.client.0.smithi063.stdout:9/485: write d7/f27 [1820979,44182] 0 2023-12-12T11:52:03.450 INFO:tasks.workunit.client.1.smithi093.stdout:1/861: truncate d4/d1c/f6d 1294087 0 2023-12-12T11:52:03.456 INFO:tasks.workunit.client.0.smithi063.stdout:0/629: mkdir d0/d8e/da7/dcf 0 2023-12-12T11:52:03.461 INFO:tasks.workunit.client.1.smithi093.stdout:9/838: rename d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d57/ca8 to d1/d23/d24/d29/d43/d56/d85/dc3/dce/df5/c11c 0 2023-12-12T11:52:03.461 INFO:tasks.workunit.client.1.smithi093.stdout:9/839: write d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/f27 [4567199,112501] 0 2023-12-12T11:52:03.464 INFO:tasks.workunit.client.1.smithi093.stdout:0/854: mkdir d5/dd/d62/d10c 0 2023-12-12T11:52:03.465 INFO:tasks.workunit.client.0.smithi063.stdout:4/639: symlink d2/d47/d6d/ld0 0 2023-12-12T11:52:03.465 INFO:tasks.workunit.client.0.smithi063.stdout:4/640: chown d2/d8/fcd 55100 1 2023-12-12T11:52:03.465 INFO:tasks.workunit.client.0.smithi063.stdout:8/663: dwrite d4/de/d3b/d62/d6e/d76/f7a [4194304,4194304] 0 2023-12-12T11:52:03.465 INFO:tasks.workunit.client.0.smithi063.stdout:8/664: fsync d4/de/d3b/d62/fa6 0 2023-12-12T11:52:03.466 INFO:tasks.workunit.client.1.smithi093.stdout:5/715: creat d0/d7/d59/de7/ff7 x:0 0 0 2023-12-12T11:52:03.466 INFO:tasks.workunit.client.1.smithi093.stdout:5/716: fsync d0/d7/d36/fe8 0 2023-12-12T11:52:03.467 INFO:tasks.workunit.client.1.smithi093.stdout:5/717: fsync d0/d7/d36/db9/dca/fe4 0 2023-12-12T11:52:03.470 INFO:tasks.workunit.client.0.smithi063.stdout:2/511: creat d0/d41/fa7 x:0 0 0 2023-12-12T11:52:03.471 INFO:tasks.workunit.client.0.smithi063.stdout:2/512: fsync d0/d1a/d3a/d59/f8e 0 2023-12-12T11:52:03.478 INFO:tasks.workunit.client.0.smithi063.stdout:3/546: rename d4/df/d1a/d1c/d34/f6a to d4/df/d1a/d1c/d3b/d52/d74/fa8 0 2023-12-12T11:52:03.479 INFO:tasks.workunit.client.1.smithi093.stdout:3/835: dwrite df/d22/d49/d69/fa7 [0,4194304] 0 2023-12-12T11:52:03.479 INFO:tasks.workunit.client.1.smithi093.stdout:3/836: fdatasync df/d22/d49/d69/d78/daf/f63 0 2023-12-12T11:52:03.482 INFO:tasks.workunit.client.1.smithi093.stdout:8/884: symlink d3/d1a/d1f/d29/d63/l122 0 2023-12-12T11:52:03.482 INFO:tasks.workunit.client.1.smithi093.stdout:8/885: fdatasync d3/d1a/d1f/d29/d3a/d40/dbf/fe9 0 2023-12-12T11:52:03.487 INFO:tasks.workunit.client.1.smithi093.stdout:5/718: dread d0/d7/d36/d29/fd5 [0,4194304] 0 2023-12-12T11:52:03.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.493+0000 7f9dbff6a700 1 -- 172.21.15.63:0/1037858834 --> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9db8066310 con 0x7f9da406ae40 2023-12-12T11:52:03.496 INFO:tasks.workunit.client.0.smithi063.stdout:9/486: creat d7/d11/fa0 x:0 0 0 2023-12-12T11:52:03.502 INFO:tasks.workunit.client.1.smithi093.stdout:2/849: creat d5/d14/d2d/d4c/d76/dc6/d118/d4e/f11e x:0 0 0 2023-12-12T11:52:03.508 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.506+0000 7f9dae7fc700 1 -- 172.21.15.63:0/1037858834 <== mgr.24471 v2:172.21.15.93:6828/3441331233 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f9db8066310 con 0x7f9da406ae40 2023-12-12T11:52:03.508 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-12T11:52:03.508 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (6m) 9s ago 7m 14.5M - 0.25.0 c8568f914cd2 cd61d03c786f 2023-12-12T11:52:03.508 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (7m) 9s ago 7m 7818k - 17.2.7-123-gbef78a51 ae6196193935 ee4415610fae 2023-12-12T11:52:03.508 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi093 smithi093 running (6m) 13s ago 6m 7810k - 17.2.7-123-gbef78a51 ae6196193935 f64e68742cfe 2023-12-12T11:52:03.508 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (6m) 9s ago 7m 79.8M - 9.4.7 954c08fa6188 2eeaef85f231 2023-12-12T11:52:03.509 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.aevpzg smithi063 running (2m) 9s ago 2m 3867M - 17.2.7-123-gbef78a51 ae6196193935 df9a6781f836 2023-12-12T11:52:03.509 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.bdqbnp smithi063 running (3m) 9s ago 3m 13.6M - 17.2.7-123-gbef78a51 ae6196193935 0c7e1d21eee9 2023-12-12T11:52:03.509 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.rhaqsh smithi093 running (3m) 13s ago 2m 13.4M - 17.2.7-123-gbef78a51 ae6196193935 257aee771d87 2023-12-12T11:52:03.509 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.swdqms smithi093 running (2m) 13s ago 2m 13.4M - 17.2.7-123-gbef78a51 ae6196193935 f46d7173d3b1 2023-12-12T11:52:03.509 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.zjnfdi smithi063 *:9283 running (8m) 9s ago 8m 343M - 17.2.7-123-gbef78a51 ae6196193935 1b9efe5a68d3 2023-12-12T11:52:03.509 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi093.nbtltu smithi093 *:8443,9283 running (44s) 13s ago 6m 497M - 19.0.0-96-gf1fbf3c5 8cf689f388db 58a1ec037be4 2023-12-12T11:52:03.509 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (8m) 9s ago 8m 81.6M 2048M 17.2.7-123-gbef78a51 ae6196193935 ee8e9d7455f9 2023-12-12T11:52:03.509 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi093 smithi093 running (6m) 13s ago 6m 57.4M 2048M 17.2.7-123-gbef78a51 ae6196193935 fac71666a805 2023-12-12T11:52:03.509 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (7m) 9s ago 7m 9105k - 1.5.0 0da6a335fe13 9c94f98d1396 2023-12-12T11:52:03.509 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi093 smithi093 *:9100 running (6m) 13s ago 6m 8925k - 1.5.0 0da6a335fe13 55fa35accdef 2023-12-12T11:52:03.509 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (6m) 9s ago 5m 420M 1618M 17.2.7-123-gbef78a51 ae6196193935 636790d2b28c 2023-12-12T11:52:03.509 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (5m) 9s ago 5m 447M 1618M 17.2.7-123-gbef78a51 ae6196193935 5388a4bc6b12 2023-12-12T11:52:03.509 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (5m) 9s ago 5m 379M 1618M 17.2.7-123-gbef78a51 ae6196193935 9eb2483337c8 2023-12-12T11:52:03.509 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi093 running (4m) 13s ago 4m 479M 2642M 17.2.7-123-gbef78a51 ae6196193935 5b2bb36b5843 2023-12-12T11:52:03.509 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi093 running (4m) 13s ago 4m 384M 2642M 17.2.7-123-gbef78a51 ae6196193935 7dc3f04b04cb 2023-12-12T11:52:03.509 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi093 running (4m) 13s ago 4m 458M 2642M 17.2.7-123-gbef78a51 ae6196193935 16fe8e4668f1 2023-12-12T11:52:03.510 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (6m) 9s ago 7m 50.8M - 2.43.0 a07b618ecd1d 14c481676fd7 2023-12-12T11:52:03.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.510+0000 7f9dbff6a700 1 -- 172.21.15.63:0/1037858834 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f9da406ae40 msgr2=0x7f9da406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:03.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.510+0000 7f9dbff6a700 1 --2- 172.21.15.63:0/1037858834 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f9da406ae40 0x7f9da406d2f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9da80097c0 tx=0x7f9da8006ce0 comp rx=0 tx=0).stop 2023-12-12T11:52:03.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.510+0000 7f9dbff6a700 1 -- 172.21.15.63:0/1037858834 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9db80fbaf0 msgr2=0x7f9db80ffbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:03.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.510+0000 7f9dbff6a700 1 --2- 172.21.15.63:0/1037858834 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9db80fbaf0 0x7f9db80ffbc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9db4000c00 tx=0x7f9db4009e30 comp rx=0 tx=0).stop 2023-12-12T11:52:03.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.510+0000 7f9dbff6a700 1 -- 172.21.15.63:0/1037858834 shutdown_connections 2023-12-12T11:52:03.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.510+0000 7f9dbff6a700 1 --2- 172.21.15.63:0/1037858834 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f9da406ae40 0x7f9da406d2f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:03.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.510+0000 7f9dbff6a700 1 --2- 172.21.15.63:0/1037858834 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9db80fbaf0 0x7f9db80ffbc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:03.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.510+0000 7f9dbff6a700 1 --2- 172.21.15.63:0/1037858834 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9db80fcd00 0x7f9db80fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:03.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.510+0000 7f9dbff6a700 1 -- 172.21.15.63:0/1037858834 >> 172.21.15.63:0/1037858834 conn(0x7f9db80f71d0 msgr2=0x7f9db8065c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:52:03.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.511+0000 7f9dbff6a700 1 -- 172.21.15.63:0/1037858834 shutdown_connections 2023-12-12T11:52:03.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.511+0000 7f9dbff6a700 1 -- 172.21.15.63:0/1037858834 wait complete. 2023-12-12T11:52:03.518 INFO:tasks.workunit.client.1.smithi093.stdout:9/840: dwrite d1/f54 [0,4194304] 0 2023-12-12T11:52:03.518 INFO:tasks.workunit.client.1.smithi093.stdout:9/841: stat d1/d23/d24/d89/l96 0 2023-12-12T11:52:03.522 INFO:tasks.workunit.client.1.smithi093.stdout:1/862: rmdir d4/d1a 39 2023-12-12T11:52:03.522 INFO:tasks.workunit.client.0.smithi063.stdout:3/547: write d4/df/d1a/d1c/d3b/d50/d61/f83 [3706086,78465] 0 2023-12-12T11:52:03.529 INFO:tasks.workunit.client.0.smithi063.stdout:8/665: creat d4/d55/d52/fd3 x:0 0 0 2023-12-12T11:52:03.531 INFO:tasks.workunit.client.1.smithi093.stdout:3/837: mkdir df/d22/d49/d69/d78/daf/d10e 0 2023-12-12T11:52:03.532 INFO:tasks.workunit.client.1.smithi093.stdout:2/850: dread d5/d14/d2d/d4c/d76/dc6/f103 [0,4194304] 0 2023-12-12T11:52:03.532 INFO:tasks.workunit.client.1.smithi093.stdout:0/855: dwrite d5/d78/fbd [0,4194304] 0 2023-12-12T11:52:03.535 INFO:tasks.workunit.client.0.smithi063.stdout:4/641: dwrite d2/d17/d9d/fbc [0,4194304] 0 2023-12-12T11:52:03.538 INFO:tasks.workunit.client.1.smithi093.stdout:5/719: mknod d0/d7/d59/d62/cf8 0 2023-12-12T11:52:03.538 INFO:tasks.workunit.client.1.smithi093.stdout:8/886: creat d3/d1a/d1f/d59/ddb/d11a/f123 x:0 0 0 2023-12-12T11:52:03.538 INFO:tasks.workunit.client.1.smithi093.stdout:5/720: creat d0/d7/d36/db9/d66/d7c/db5/ff9 x:0 0 0 2023-12-12T11:52:03.539 INFO:tasks.workunit.client.0.smithi063.stdout:9/487: mknod d7/d15/d39/ca1 0 2023-12-12T11:52:03.539 INFO:tasks.workunit.client.0.smithi063.stdout:9/488: chown d7/d11/d4b/d75/f98 203 1 2023-12-12T11:52:03.542 INFO:tasks.workunit.client.0.smithi063.stdout:7/508: symlink de/d22/lbf 0 2023-12-12T11:52:03.542 INFO:tasks.workunit.client.0.smithi063.stdout:7/509: chown de/f3c 0 1 2023-12-12T11:52:03.542 INFO:tasks.workunit.client.0.smithi063.stdout:7/510: chown de/d22/d2b/lbc 92 1 2023-12-12T11:52:03.545 INFO:tasks.workunit.client.0.smithi063.stdout:0/630: mknod d0/d1a/cd0 0 2023-12-12T11:52:03.546 INFO:tasks.workunit.client.1.smithi093.stdout:7/804: sync 2023-12-12T11:52:03.546 INFO:tasks.workunit.client.1.smithi093.stdout:7/805: chown da/d15/d59/f66 1 1 2023-12-12T11:52:03.549 INFO:tasks.workunit.client.1.smithi093.stdout:3/838: creat df/d22/d49/f10f x:0 0 0 2023-12-12T11:52:03.550 INFO:tasks.workunit.client.1.smithi093.stdout:0/856: dread d5/d21/d2f/d54/f7b [0,4194304] 0 2023-12-12T11:52:03.551 INFO:tasks.workunit.client.1.smithi093.stdout:1/863: dread d4/d1a/d83/d9a/fd0 [0,4194304] 0 2023-12-12T11:52:03.551 INFO:tasks.workunit.client.1.smithi093.stdout:1/864: readlink d4/d1a/d73/l5b 0 2023-12-12T11:52:03.557 INFO:tasks.workunit.client.0.smithi063.stdout:8/666: write d4/d24/d38/d45/f9f [1059707,4304] 0 2023-12-12T11:52:03.558 INFO:tasks.workunit.client.0.smithi063.stdout:3/548: creat d4/df/d1a/d1c/d3b/d50/d9f/fa9 x:0 0 0 2023-12-12T11:52:03.581 INFO:tasks.workunit.client.1.smithi093.stdout:2/851: mkdir d5/d14/d2d/d4c/d76/dc6/d118/d56/d6f/d11f 0 2023-12-12T11:52:03.581 INFO:tasks.workunit.client.1.smithi093.stdout:9/842: dwrite d1/d23/d24/d29/ff7 [0,4194304] 0 2023-12-12T11:52:03.581 INFO:tasks.workunit.client.0.smithi063.stdout:2/513: dwrite d0/d1a/d48/d56/f65 [0,4194304] 0 2023-12-12T11:52:03.582 INFO:tasks.workunit.client.0.smithi063.stdout:2/514: stat d0/d1a/d26/f29 0 2023-12-12T11:52:03.582 INFO:tasks.workunit.client.0.smithi063.stdout:2/515: write d0/d1a/d3a/f84 [1133685,56528] 0 2023-12-12T11:52:03.582 INFO:tasks.workunit.client.0.smithi063.stdout:2/516: dread - d0/d1a/d3a/f9e zero size 2023-12-12T11:52:03.582 INFO:tasks.workunit.client.0.smithi063.stdout:7/511: truncate de/d22/d2b/d61/f86 2414579 0 2023-12-12T11:52:03.582 INFO:tasks.workunit.client.0.smithi063.stdout:7/512: truncate de/d39/d4b/d7b/fbe 306776 0 2023-12-12T11:52:03.582 INFO:tasks.workunit.client.0.smithi063.stdout:4/642: link d2/d8/c80 d2/d8/db3/dc1/cd1 0 2023-12-12T11:52:03.586 INFO:tasks.workunit.client.0.smithi063.stdout:8/667: link f0 d4/d24/d38/d45/d5b/d92/fd4 0 2023-12-12T11:52:03.595 INFO:tasks.workunit.client.1.smithi093.stdout:7/806: creat da/d15/d19/d4c/f114 x:0 0 0 2023-12-12T11:52:03.598 INFO:tasks.workunit.client.1.smithi093.stdout:0/857: symlink d5/dd/d14/d26/d58/d64/d6f/de8/l10d 0 2023-12-12T11:52:03.601 INFO:tasks.workunit.client.0.smithi063.stdout:2/517: creat d0/d1a/d3a/fa8 x:0 0 0 2023-12-12T11:52:03.613 INFO:tasks.workunit.client.1.smithi093.stdout:9/843: rename d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/d42/lcb to d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d5c/l11d 0 2023-12-12T11:52:03.613 INFO:tasks.workunit.client.1.smithi093.stdout:9/844: fdatasync d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/f49 0 2023-12-12T11:52:03.614 INFO:tasks.workunit.client.0.smithi063.stdout:0/631: dwrite d0/d7/d27/f29 [0,4194304] 0 2023-12-12T11:52:03.615 INFO:tasks.workunit.client.0.smithi063.stdout:8/668: write d4/d24/f31 [6231356,121638] 0 2023-12-12T11:52:03.615 INFO:tasks.workunit.client.0.smithi063.stdout:8/669: fdatasync f1 0 2023-12-12T11:52:03.616 INFO:tasks.workunit.client.0.smithi063.stdout:6/652: dwrite f4 [0,4194304] 0 2023-12-12T11:52:03.616 INFO:tasks.workunit.client.0.smithi063.stdout:6/653: fdatasync d9/fba 0 2023-12-12T11:52:03.616 INFO:tasks.workunit.client.0.smithi063.stdout:8/670: write d4/de/d3b/d62/d6e/f8f [4776946,123720] 0 2023-12-12T11:52:03.622 INFO:tasks.workunit.client.0.smithi063.stdout:7/513: creat de/d22/fc0 x:0 0 0 2023-12-12T11:52:03.622 INFO:tasks.workunit.client.0.smithi063.stdout:4/643: getdents d2/d8/d76 0 2023-12-12T11:52:03.623 INFO:tasks.workunit.client.1.smithi093.stdout:6/975: sync 2023-12-12T11:52:03.624 INFO:tasks.workunit.client.0.smithi063.stdout:2/518: mknod d0/d1a/d48/d56/d77/ca9 0 2023-12-12T11:52:03.625 INFO:tasks.workunit.client.1.smithi093.stdout:5/721: dwrite d0/d7/d59/d62/fa5 [0,4194304] 0 2023-12-12T11:52:03.632 INFO:tasks.workunit.client.1.smithi093.stdout:6/976: truncate d0/da/d14/d21/f120 978933 0 2023-12-12T11:52:03.633 INFO:tasks.workunit.client.1.smithi093.stdout:0/858: write d5/d78/da4/fcc [2803249,64279] 0 2023-12-12T11:52:03.637 INFO:tasks.workunit.client.0.smithi063.stdout:3/549: dwrite d4/df/d1a/d1c/d3b/d50/f8f [4194304,4194304] 0 2023-12-12T11:52:03.639 INFO:tasks.workunit.client.1.smithi093.stdout:8/887: dwrite d3/d1a/d1f/fec [4194304,4194304] 0 2023-12-12T11:52:03.639 INFO:tasks.workunit.client.1.smithi093.stdout:3/839: dwrite df/d22/d49/fd3 [0,4194304] 0 2023-12-12T11:52:03.641 INFO:tasks.workunit.client.0.smithi063.stdout:4/644: dread d2/f58 [0,4194304] 0 2023-12-12T11:52:03.641 INFO:tasks.workunit.client.0.smithi063.stdout:4/645: chown d2/d8/d76 995 1 2023-12-12T11:52:03.648 INFO:tasks.workunit.client.1.smithi093.stdout:2/852: dread d5/d14/d2d/d4c/fd8 [0,4194304] 0 2023-12-12T11:52:03.653 INFO:tasks.workunit.client.1.smithi093.stdout:6/977: mknod d0/d52/dbc/c15a 0 2023-12-12T11:52:03.653 INFO:tasks.workunit.client.1.smithi093.stdout:6/978: readlink d0/da/d14/d21/le2 0 2023-12-12T11:52:03.653 INFO:tasks.workunit.client.1.smithi093.stdout:6/979: chown d0/da/d32/dd3/f94 685778 1 2023-12-12T11:52:03.653 INFO:tasks.workunit.client.1.smithi093.stdout:6/980: creat d0/da/d14/f15b x:0 0 0 2023-12-12T11:52:03.658 INFO:tasks.workunit.client.1.smithi093.stdout:0/859: rmdir d5/d21/d27/d3a/d9a/db5/db8 39 2023-12-12T11:52:03.658 INFO:tasks.workunit.client.1.smithi093.stdout:0/860: read d5/d21/d27/f5f [147009,52463] 0 2023-12-12T11:52:03.667 INFO:tasks.workunit.client.1.smithi093.stdout:9/845: dwrite d1/d23/d24/d29/d43/fcf [0,4194304] 0 2023-12-12T11:52:03.669 INFO:tasks.workunit.client.1.smithi093.stdout:8/888: truncate d3/d1a/d1f/f27 65045 0 2023-12-12T11:52:03.669 INFO:tasks.workunit.client.1.smithi093.stdout:7/807: dwrite da/d15/d59/de0/fff [0,4194304] 0 2023-12-12T11:52:03.671 INFO:tasks.workunit.client.1.smithi093.stdout:7/808: stat da/d15/d19/d90/d7d/l9b 0 2023-12-12T11:52:03.673 INFO:tasks.workunit.client.0.smithi063.stdout:6/654: link d9/d10/d5c/dce/d86/la2 d9/d2c/d61/le2 0 2023-12-12T11:52:03.673 INFO:tasks.workunit.client.0.smithi063.stdout:6/655: chown d9/d10/d5c/fbb 37580 1 2023-12-12T11:52:03.673 INFO:tasks.workunit.client.1.smithi093.stdout:3/840: rmdir df/d25/d2c/d85/dac 39 2023-12-12T11:52:03.673 INFO:tasks.workunit.client.1.smithi093.stdout:1/865: dwrite d4/d1a/d73/f116 [0,4194304] 0 2023-12-12T11:52:03.673 INFO:tasks.workunit.client.1.smithi093.stdout:1/866: chown d4/d85/cc7 1513309 1 2023-12-12T11:52:03.684 INFO:tasks.workunit.client.1.smithi093.stdout:6/981: rename d0/da/d14/f72 to d0/da/d32/d39/d5b/f15c 0 2023-12-12T11:52:03.686 INFO:tasks.workunit.client.0.smithi063.stdout:7/514: truncate de/f21 397623 0 2023-12-12T11:52:03.686 INFO:tasks.workunit.client.0.smithi063.stdout:7/515: dread - de/d33/fbb zero size 2023-12-12T11:52:03.686 INFO:tasks.workunit.client.0.smithi063.stdout:2/519: creat d0/d1a/d3a/d85/faa x:0 0 0 2023-12-12T11:52:03.687 INFO:tasks.workunit.client.1.smithi093.stdout:0/861: rmdir d5/d21/d27/dca 0 2023-12-12T11:52:03.687 INFO:tasks.workunit.client.1.smithi093.stdout:0/862: stat d5/d21/d27/d3a/f56 0 2023-12-12T11:52:03.688 INFO:tasks.workunit.client.0.smithi063.stdout:3/550: symlink d4/df/d1a/d1c/d3b/d50/d9f/laa 0 2023-12-12T11:52:03.688 INFO:tasks.workunit.client.0.smithi063.stdout:3/551: fsync d4/df/d1a/d1c/d3b/d50/f97 0 2023-12-12T11:52:03.694 INFO:tasks.workunit.client.0.smithi063.stdout:6/656: link d9/d68/cd3 d9/d10/d5c/ce3 0 2023-12-12T11:52:03.696 INFO:tasks.workunit.client.0.smithi063.stdout:3/552: read d4/df/d1a/d1c/d57/f6c [296314,93125] 0 2023-12-12T11:52:03.697 INFO:tasks.workunit.client.1.smithi093.stdout:9/846: creat d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/dc0/f11e x:0 0 0 2023-12-12T11:52:03.697 INFO:tasks.workunit.client.0.smithi063.stdout:1/669: sync 2023-12-12T11:52:03.698 INFO:tasks.workunit.client.1.smithi093.stdout:9/847: truncate d1/d23/d24/d29/d43/d56/d85/dc3/dce/d3e/fe4 964712 0 2023-12-12T11:52:03.700 INFO:tasks.workunit.client.0.smithi063.stdout:7/516: rename de/d39/d4b/d7b/d7f/c98 to de/d22/d6e/d8a/cc1 0 2023-12-12T11:52:03.709 INFO:tasks.workunit.client.0.smithi063.stdout:2/520: symlink d0/d1a/d3a/lab 0 2023-12-12T11:52:03.709 INFO:tasks.workunit.client.0.smithi063.stdout:0/632: dwrite d0/d7/d27/fcd [0,4194304] 0 2023-12-12T11:52:03.709 INFO:tasks.workunit.client.0.smithi063.stdout:0/633: truncate d0/d1a/d23/d34/d42/f53 1441249 0 2023-12-12T11:52:03.709 INFO:tasks.workunit.client.0.smithi063.stdout:6/657: mkdir d9/d68/de4 0 2023-12-12T11:52:03.715 INFO:tasks.workunit.client.0.smithi063.stdout:3/553: truncate d4/df/d1a/d1c/f2d 3331833 0 2023-12-12T11:52:03.715 INFO:tasks.workunit.client.0.smithi063.stdout:3/554: write d4/df/d1a/d1c/f92 [472938,14978] 0 2023-12-12T11:52:03.717 INFO:tasks.workunit.client.1.smithi093.stdout:8/889: dread d3/d1a/d1f/d29/d3a/d40/f53 [0,4194304] 0 2023-12-12T11:52:03.721 INFO:tasks.workunit.client.1.smithi093.stdout:2/853: dwrite d5/d14/d2d/d12/d25/d7a/d7e/da5/fdc [0,4194304] 0 2023-12-12T11:52:03.725 INFO:tasks.workunit.client.0.smithi063.stdout:1/670: mkdir d3/d3a/dd7/d16/d17/d4b/d8c/dd9 0 2023-12-12T11:52:03.733 INFO:tasks.workunit.client.0.smithi063.stdout:2/521: dread d0/ff [4194304,4194304] 0 2023-12-12T11:52:03.734 INFO:tasks.workunit.client.0.smithi063.stdout:8/671: dwrite d4/d24/d38/d45/d5b/d92/d65/f8d [0,4194304] 0 2023-12-12T11:52:03.734 INFO:tasks.workunit.client.0.smithi063.stdout:8/672: fdatasync d4/de/f30 0 2023-12-12T11:52:03.734 INFO:tasks.workunit.client.0.smithi063.stdout:7/517: link l3 de/d39/d60/d97/lc2 0 2023-12-12T11:52:03.735 INFO:tasks.workunit.client.1.smithi093.stdout:3/841: creat df/d22/d49/d69/d78/db9/f110 x:0 0 0 2023-12-12T11:52:03.736 INFO:tasks.workunit.client.1.smithi093.stdout:1/867: dwrite d4/d81/f107 [0,4194304] 0 2023-12-12T11:52:03.739 INFO:tasks.workunit.client.1.smithi093.stdout:6/982: symlink d0/d52/d7e/l15d 0 2023-12-12T11:52:03.740 INFO:tasks.workunit.client.0.smithi063.stdout:3/555: dread d4/df/d1a/d1c/f28 [0,4194304] 0 2023-12-12T11:52:03.741 INFO:tasks.workunit.client.1.smithi093.stdout:8/890: dread d3/d8/d88/dc5/f111 [0,4194304] 0 2023-12-12T11:52:03.746 INFO:tasks.workunit.client.1.smithi093.stdout:7/809: dwrite da/d15/d19/fde [0,4194304] 0 2023-12-12T11:52:03.747 INFO:tasks.workunit.client.1.smithi093.stdout:7/810: write da/d15/d19/f7c [1042198,68502] 0 2023-12-12T11:52:03.747 INFO:tasks.workunit.client.1.smithi093.stdout:7/811: truncate da/d15/d2d/d2f/dc6/f108 9450 0 2023-12-12T11:52:03.747 INFO:tasks.workunit.client.1.smithi093.stdout:9/848: rename d1/d23/d24/d29/d43/d56/d85/dc3/dce/d3e/f99 to d1/d23/d24/d29/d43/dfc/f11f 0 2023-12-12T11:52:03.753 INFO:tasks.workunit.client.0.smithi063.stdout:6/658: rmdir d9 39 2023-12-12T11:52:03.754 INFO:tasks.workunit.client.1.smithi093.stdout:8/891: read d3/d8/d88/fb4 [536024,102562] 0 2023-12-12T11:52:03.754 INFO:tasks.workunit.client.1.smithi093.stdout:8/892: truncate d3/d1a/d1f/d59/d69/fc6 1845301 0 2023-12-12T11:52:03.754 INFO:tasks.workunit.client.1.smithi093.stdout:0/863: dwrite d5/dd/d14/d26/f34 [0,4194304] 0 2023-12-12T11:52:03.772 INFO:tasks.workunit.client.1.smithi093.stdout:2/854: unlink d5/d14/d2d/d4c/d76/l7c 0 2023-12-12T11:52:03.775 INFO:tasks.workunit.client.0.smithi063.stdout:1/671: dwrite d3/d3a/dd7/d16/f2b [0,4194304] 0 2023-12-12T11:52:03.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.777+0000 7f8f432dc700 1 -- 172.21.15.63:0/2948960995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f3c0fd730 msgr2=0x7f8f3c0ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:03.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.777+0000 7f8f432dc700 1 --2- 172.21.15.63:0/2948960995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f3c0fd730 0x7f8f3c0ffb10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8f38004e90 tx=0x7f8f38004990 comp rx=0 tx=0).stop 2023-12-12T11:52:03.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.778+0000 7f8f432dc700 1 -- 172.21.15.63:0/2948960995 shutdown_connections 2023-12-12T11:52:03.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.778+0000 7f8f432dc700 1 --2- 172.21.15.63:0/2948960995 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f3c100050 0x7f8f3c102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:03.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.778+0000 7f8f432dc700 1 --2- 172.21.15.63:0/2948960995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f3c0fd730 0x7f8f3c0ffb10 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:03.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.778+0000 7f8f432dc700 1 -- 172.21.15.63:0/2948960995 >> 172.21.15.63:0/2948960995 conn(0x7f8f3c0f7190 msgr2=0x7f8f3c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:52:03.781 INFO:tasks.workunit.client.1.smithi093.stdout:3/842: dwrite df/d22/d49/d69/d78/dad/f10d [0,4194304] 0 2023-12-12T11:52:03.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.778+0000 7f8f432dc700 1 -- 172.21.15.63:0/2948960995 shutdown_connections 2023-12-12T11:52:03.781 INFO:tasks.workunit.client.0.smithi063.stdout:8/673: unlink d4/de/d3b/d62/d36/l81 0 2023-12-12T11:52:03.782 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.778+0000 7f8f432dc700 1 -- 172.21.15.63:0/2948960995 wait complete. 2023-12-12T11:52:03.782 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.780+0000 7f8f432dc700 1 Processor -- start 2023-12-12T11:52:03.782 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.780+0000 7f8f432dc700 1 -- start start 2023-12-12T11:52:03.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.782+0000 7f8f432dc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f3c0fd730 0x7f8f3c06ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:03.785 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.782+0000 7f8f432dc700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f3c100050 0x7f8f3c06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:03.785 INFO:tasks.workunit.client.0.smithi063.stdout:7/518: mkdir de/d3f/dc3 0 2023-12-12T11:52:03.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.783+0000 7f8f432dc700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c06f840 con 0x7f8f3c0fd730 2023-12-12T11:52:03.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.783+0000 7f8f432dc700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c114ef0 con 0x7f8f3c100050 2023-12-12T11:52:03.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.783+0000 7f8f40877700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f3c100050 0x7f8f3c06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:03.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.783+0000 7f8f40877700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f3c100050 0x7f8f3c06f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:40860/0 (socket says 172.21.15.63:40860) 2023-12-12T11:52:03.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.783+0000 7f8f40877700 1 -- 172.21.15.63:0/3078376874 learned_addr learned my addr 172.21.15.63:0/3078376874 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:52:03.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.784+0000 7f8f41078700 1 --2- 172.21.15.63:0/3078376874 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f3c0fd730 0x7f8f3c06ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:03.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.784+0000 7f8f40877700 1 -- 172.21.15.63:0/3078376874 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f3c0fd730 msgr2=0x7f8f3c06ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:03.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.784+0000 7f8f40877700 1 --2- 172.21.15.63:0/3078376874 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f3c0fd730 0x7f8f3c06ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:03.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.785+0000 7f8f40877700 1 -- 172.21.15.63:0/3078376874 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f38005040 con 0x7f8f3c100050 2023-12-12T11:52:03.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.785+0000 7f8f40877700 1 --2- 172.21.15.63:0/3078376874 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f3c100050 0x7f8f3c06f1b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c00b790 tx=0x7f8f2c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:52:03.788 INFO:tasks.workunit.client.1.smithi093.stdout:5/722: sync 2023-12-12T11:52:03.788 INFO:tasks.workunit.client.1.smithi093.stdout:5/723: write d0/f15 [9508110,11774] 0 2023-12-12T11:52:03.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.785+0000 7f8f31ffb700 1 -- 172.21.15.63:0/3078376874 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f2c00f6f0 con 0x7f8f3c100050 2023-12-12T11:52:03.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.786+0000 7f8f31ffb700 1 -- 172.21.15.63:0/3078376874 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8f2c00fd00 con 0x7f8f3c100050 2023-12-12T11:52:03.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.786+0000 7f8f432dc700 1 -- 172.21.15.63:0/3078376874 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f3c1151d0 con 0x7f8f3c100050 2023-12-12T11:52:03.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.786+0000 7f8f31ffb700 1 -- 172.21.15.63:0/3078376874 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f2c0103a0 con 0x7f8f3c100050 2023-12-12T11:52:03.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.786+0000 7f8f432dc700 1 -- 172.21.15.63:0/3078376874 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f3c115710 con 0x7f8f3c100050 2023-12-12T11:52:03.791 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.789+0000 7f8f432dc700 1 -- 172.21.15.63:0/3078376874 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f3c04bb80 con 0x7f8f3c100050 2023-12-12T11:52:03.792 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.789+0000 7f8f31ffb700 1 -- 172.21.15.63:0/3078376874 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 24) v1 ==== 88724+0+0 (secure 0 0 0) 0x7f8f2c011400 con 0x7f8f3c100050 2023-12-12T11:52:03.792 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.790+0000 7f8f31ffb700 1 --2- 172.21.15.63:0/3078376874 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f8f2806af00 0x7f8f2806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:03.792 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.790+0000 7f8f31ffb700 1 -- 172.21.15.63:0/3078376874 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f8f2c0893f0 con 0x7f8f3c100050 2023-12-12T11:52:03.793 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.791+0000 7f8f41078700 1 --2- 172.21.15.63:0/3078376874 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f8f2806af00 0x7f8f2806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:03.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.792+0000 7f8f41078700 1 --2- 172.21.15.63:0/3078376874 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f8f2806af00 0x7f8f2806d3b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8f3800fde0 tx=0x7f8f38004990 comp rx=0 tx=0).ready entity=mgr.24471 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:52:03.798 INFO:tasks.workunit.client.0.smithi063.stdout:0/634: getdents d0/d1a/d23/d2e/d84 0 2023-12-12T11:52:03.798 INFO:tasks.workunit.client.0.smithi063.stdout:6/659: mkdir d9/de5 0 2023-12-12T11:52:03.799 INFO:tasks.workunit.client.1.smithi093.stdout:7/812: link da/d15/d19/d4c/f10e da/de/d46/f115 0 2023-12-12T11:52:03.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:03.797+0000 7f8f31ffb700 1 -- 172.21.15.63:0/3078376874 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f8f2c057370 con 0x7f8f3c100050 2023-12-12T11:52:03.801 INFO:tasks.workunit.client.0.smithi063.stdout:2/522: getdents d0/d1a/d3a 0 2023-12-12T11:52:03.801 INFO:tasks.workunit.client.0.smithi063.stdout:2/523: readlink d0/d1a/d1e/l7a 0 2023-12-12T11:52:03.801 INFO:tasks.workunit.client.0.smithi063.stdout:2/524: fsync d0/d1a/d1e/f31 0 2023-12-12T11:52:03.801 INFO:tasks.workunit.client.0.smithi063.stdout:3/556: dwrite d4/df/d1a/f20 [4194304,4194304] 0 2023-12-12T11:52:03.809 INFO:tasks.workunit.client.0.smithi063.stdout:1/672: getdents d3/d3a/dd7/d16/d4f/da7/dca/d6f 0 2023-12-12T11:52:03.811 INFO:tasks.workunit.client.1.smithi093.stdout:5/724: read d0/d7/d8/de/f28 [1006231,114758] 0 2023-12-12T11:52:03.811 INFO:tasks.workunit.client.1.smithi093.stdout:5/725: chown d0/l7f 1763786 1 2023-12-12T11:52:03.814 INFO:tasks.workunit.client.0.smithi063.stdout:8/674: mknod d4/de/d1e/d6d/cd5 0 2023-12-12T11:52:03.814 INFO:tasks.workunit.client.0.smithi063.stdout:8/675: chown d4/de/d3b/d62/d6e/c74 87763875 1 2023-12-12T11:52:03.816 INFO:tasks.workunit.client.0.smithi063.stdout:5/643: sync 2023-12-12T11:52:03.816 INFO:tasks.workunit.client.0.smithi063.stdout:5/644: write d7/d10/d2b/d3c/d63/f7a [234656,60960] 0 2023-12-12T11:52:03.817 INFO:tasks.workunit.client.1.smithi093.stdout:8/893: rename d3/d1a/d1f/d29/f4d to d3/d1a/d1f/d29/d30/d110/f124 0 2023-12-12T11:52:03.817 INFO:tasks.workunit.client.0.smithi063.stdout:5/645: write d7/d28/f5f [422553,50571] 0 2023-12-12T11:52:03.820 INFO:tasks.workunit.client.0.smithi063.stdout:7/519: unlink de/d33/d41/d44/f6b 0 2023-12-12T11:52:03.821 INFO:tasks.workunit.client.1.smithi093.stdout:0/864: symlink d5/d41/l10e 0 2023-12-12T11:52:03.831 INFO:tasks.workunit.client.1.smithi093.stdout:1/868: getdents d4/d1a/d1b/d26/d40 0 2023-12-12T11:52:03.831 INFO:tasks.workunit.client.1.smithi093.stdout:1/869: chown d4/d1a/d1b/d26/d40/l42 191 1 2023-12-12T11:52:03.831 INFO:tasks.workunit.client.1.smithi093.stdout:3/843: rmdir df/d22/d49/d69/d78/daf/d10e 0 2023-12-12T11:52:03.831 INFO:tasks.workunit.client.1.smithi093.stdout:2/855: dwrite d5/d14/d2d/d4c/fbe [0,4194304] 0 2023-12-12T11:52:03.837 INFO:tasks.workunit.client.1.smithi093.stdout:5/726: dread d0/d7/d36/d87/ff4 [0,4194304] 0 2023-12-12T11:52:03.837 INFO:tasks.workunit.client.1.smithi093.stdout:5/727: dread - d0/d7/d36/db9/d66/d7c/db5/fbd zero size 2023-12-12T11:52:03.839 INFO:tasks.workunit.client.1.smithi093.stdout:7/813: mknod da/d15/d19/d90/d7d/c116 0 2023-12-12T11:52:03.839 INFO:tasks.workunit.client.1.smithi093.stdout:9/849: rmdir d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/db1/dbc 39 2023-12-12T11:52:03.855 INFO:tasks.workunit.client.1.smithi093.stdout:8/894: rename d3/d1a/d1f/d29/d3a/d40/cd6 to d3/d1a/d1f/c125 0 2023-12-12T11:52:03.857 INFO:tasks.workunit.client.0.smithi063.stdout:3/557: mknod d4/df/cab 0 2023-12-12T11:52:03.863 INFO:tasks.workunit.client.0.smithi063.stdout:8/676: rename d4/de/d3b/c4d to d4/de/d3b/d62/d36/d7f/cd6 0 2023-12-12T11:52:03.866 INFO:tasks.workunit.client.0.smithi063.stdout:2/525: read d0/f49 [345218,100003] 0 2023-12-12T11:52:03.866 INFO:tasks.workunit.client.0.smithi063.stdout:2/526: write d0/d1a/d3a/d59/f7e [782247,10407] 0 2023-12-12T11:52:03.866 INFO:tasks.workunit.client.0.smithi063.stdout:2/527: creat d0/d1a/d57/fac x:0 0 0 2023-12-12T11:52:03.867 INFO:tasks.workunit.client.0.smithi063.stdout:2/528: chown d0/d1a 425 1 2023-12-12T11:52:03.870 INFO:tasks.workunit.client.0.smithi063.stdout:5/646: mknod d7/d28/cc5 0 2023-12-12T11:52:03.870 INFO:tasks.workunit.client.0.smithi063.stdout:5/647: truncate d7/d28/d67/f87 656201 0 2023-12-12T11:52:03.872 INFO:tasks.workunit.client.0.smithi063.stdout:7/520: rmdir de/d34 39 2023-12-12T11:52:03.872 INFO:tasks.workunit.client.1.smithi093.stdout:1/870: creat d4/d1a/d83/d9a/f121 x:0 0 0 2023-12-12T11:52:03.872 INFO:tasks.workunit.client.1.smithi093.stdout:1/871: chown d4/d81/cec 2590245 1 2023-12-12T11:52:03.873 INFO:tasks.workunit.client.1.smithi093.stdout:3/844: symlink df/d22/d49/l111 0 2023-12-12T11:52:03.873 INFO:tasks.workunit.client.1.smithi093.stdout:3/845: fdatasync df/d22/d49/d69/d78/daf/d3d/def/ff7 0 2023-12-12T11:52:03.875 INFO:tasks.workunit.client.1.smithi093.stdout:2/856: symlink d5/d14/d2d/d4c/da1/l120 0 2023-12-12T11:52:03.877 INFO:tasks.workunit.client.0.smithi063.stdout:3/558: dread d4/df/d1a/f2e [0,4194304] 0 2023-12-12T11:52:03.878 INFO:tasks.workunit.client.0.smithi063.stdout:0/635: dwrite d0/d7/d27/d19/fc1 [4194304,4194304] 0 2023-12-12T11:52:03.879 INFO:tasks.workunit.client.0.smithi063.stdout:0/636: chown d0/d8e/da7 55 1 2023-12-12T11:52:03.879 INFO:tasks.workunit.client.0.smithi063.stdout:0/637: fsync d0/d1a/d23/d34/f58 0 2023-12-12T11:52:03.880 INFO:tasks.workunit.client.0.smithi063.stdout:1/673: dwrite f2 [0,4194304] 0 2023-12-12T11:52:03.880 INFO:tasks.workunit.client.0.smithi063.stdout:1/674: stat d3/d3a/dd7/d16/db8/lce 0 2023-12-12T11:52:03.882 INFO:tasks.workunit.client.1.smithi093.stdout:5/728: dread d0/f15 [4194304,4194304] 0 2023-12-12T11:52:03.882 INFO:tasks.workunit.client.1.smithi093.stdout:5/729: dread - d0/d7/d8/de/f86 zero size 2023-12-12T11:52:03.883 INFO:tasks.workunit.client.1.smithi093.stdout:0/865: dwrite d5/d41/d77/f86 [0,4194304] 0 2023-12-12T11:52:03.887 INFO:tasks.workunit.client.1.smithi093.stdout:7/814: symlink da/d15/d2d/d2f/dc6/l117 0 2023-12-12T11:52:03.887 INFO:tasks.workunit.client.1.smithi093.stdout:9/850: mknod d1/d23/d24/d29/d43/d56/d85/dc3/dce/de1/c120 0 2023-12-12T11:52:03.887 INFO:tasks.workunit.client.1.smithi093.stdout:8/895: rename d3/d1a/d1f/d29/c3e to d3/d1a/d1f/d59/d69/dbc/c126 0 2023-12-12T11:52:03.887 INFO:tasks.workunit.client.1.smithi093.stdout:8/896: write d3/d8/d88/f106 [915595,666] 0 2023-12-12T11:52:03.887 INFO:tasks.workunit.client.1.smithi093.stdout:9/851: write d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/f27 [1053105,94190] 0 2023-12-12T11:52:03.887 INFO:tasks.workunit.client.1.smithi093.stdout:8/897: creat d3/d1a/d1f/d29/d3a/da0/dcb/f127 x:0 0 0 2023-12-12T11:52:03.888 INFO:tasks.workunit.client.0.smithi063.stdout:7/521: mkdir de/d22/d6e/dc4 0 2023-12-12T11:52:03.888 INFO:tasks.workunit.client.0.smithi063.stdout:3/559: mkdir d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/dac 0 2023-12-12T11:52:03.897 INFO:tasks.workunit.client.0.smithi063.stdout:3/560: write d4/df/d1a/d1c/d3b/d50/fa4 [8458107,30267] 0 2023-12-12T11:52:03.898 INFO:tasks.workunit.client.0.smithi063.stdout:6/660: dwrite d9/fc [4194304,4194304] 0 2023-12-12T11:52:03.898 INFO:tasks.workunit.client.0.smithi063.stdout:6/661: stat d9/d10/f8c 0 2023-12-12T11:52:03.898 INFO:tasks.workunit.client.0.smithi063.stdout:9/489: sync 2023-12-12T11:52:03.898 INFO:tasks.workunit.client.0.smithi063.stdout:8/677: dread d4/de/f43 [0,4194304] 0 2023-12-12T11:52:03.902 INFO:tasks.workunit.client.1.smithi093.stdout:8/898: dread d3/d1a/d1f/d29/d3a/f55 [0,4194304] 0 2023-12-12T11:52:03.904 INFO:tasks.workunit.client.0.smithi063.stdout:0/638: symlink d0/d8e/ld1 0 2023-12-12T11:52:03.904 INFO:tasks.workunit.client.0.smithi063.stdout:0/639: chown d0/d7/d27/d1f/f2c 3333205 1 2023-12-12T11:52:03.904 INFO:tasks.workunit.client.0.smithi063.stdout:0/640: stat d0/d1a/d23/d34/d42/f3e 0 2023-12-12T11:52:03.910 INFO:tasks.workunit.client.1.smithi093.stdout:1/872: mkdir d4/d1a/d1b/d26/d31/d122 0 2023-12-12T11:52:03.910 INFO:tasks.workunit.client.1.smithi093.stdout:3/846: mkdir df/d22/d49/d69/dfa/d112 0 2023-12-12T11:52:03.910 INFO:tasks.workunit.client.1.smithi093.stdout:6/983: sync 2023-12-12T11:52:03.923 INFO:tasks.workunit.client.1.smithi093.stdout:2/857: creat d5/d14/d2d/d4c/da1/f121 x:0 0 0 2023-12-12T11:52:03.923 INFO:tasks.workunit.client.1.smithi093.stdout:2/858: readlink d5/d14/d2d/d12/d25/l66 0 2023-12-12T11:52:03.927 INFO:tasks.workunit.client.1.smithi093.stdout:5/730: creat d0/d7/d36/db9/d66/d7c/db5/dcc/ffa x:0 0 0 2023-12-12T11:52:03.935 INFO:tasks.workunit.client.1.smithi093.stdout:2/859: write d5/d14/d2d/d4c/d54/dc5/d55/f8e [8094797,7875] 0 2023-12-12T11:52:03.935 INFO:tasks.workunit.client.1.smithi093.stdout:2/860: creat d5/d14/d2d/d4c/d54/dc5/d55/d75/f122 x:0 0 0 2023-12-12T11:52:03.936 INFO:tasks.workunit.client.0.smithi063.stdout:3/561: dread d4/f44 [0,4194304] 0 2023-12-12T11:52:03.945 INFO:tasks.workunit.client.1.smithi093.stdout:7/815: unlink da/d8e/f9e 0 2023-12-12T11:52:03.945 INFO:tasks.workunit.client.1.smithi093.stdout:7/816: write da/d15/d19/d90/d7d/dd1/ff3 [1070,39414] 0 2023-12-12T11:52:03.946 INFO:tasks.workunit.client.1.smithi093.stdout:7/817: chown da/d8e/daf 812618 1 2023-12-12T11:52:03.948 INFO:tasks.workunit.client.1.smithi093.stdout:7/818: write da/d8e/dbc/fd9 [362001,100869] 0 2023-12-12T11:52:03.948 INFO:tasks.workunit.client.1.smithi093.stdout:9/852: creat d1/d23/d24/d29/d43/dfc/f121 x:0 0 0 2023-12-12T11:52:03.948 INFO:tasks.workunit.client.1.smithi093.stdout:9/853: stat d1/d23/d24/d29/d43/d58/f6c 0 2023-12-12T11:52:03.948 INFO:tasks.workunit.client.1.smithi093.stdout:9/854: fsync d1/f59 0 2023-12-12T11:52:03.949 INFO:tasks.workunit.client.1.smithi093.stdout:9/855: write d1/d23/d24/dfd/f115 [135973,122836] 0 2023-12-12T11:52:03.949 INFO:tasks.workunit.client.1.smithi093.stdout:9/856: fdatasync d1/d23/d24/d29/d43/d58/f78 0 2023-12-12T11:52:03.951 INFO:tasks.workunit.client.1.smithi093.stdout:1/873: write d4/d81/dfc/ffe [2174347,32704] 0 2023-12-12T11:52:03.952 INFO:tasks.workunit.client.0.smithi063.stdout:6/662: symlink d9/de5/le6 0 2023-12-12T11:52:03.955 INFO:tasks.workunit.client.0.smithi063.stdout:1/675: dwrite d3/d3a/dd7/d12/fb3 [0,4194304] 0 2023-12-12T11:52:03.955 INFO:tasks.workunit.client.1.smithi093.stdout:3/847: mkdir df/d22/d49/d69/d78/daf/d3d/d59/d72/d79/d113 0 2023-12-12T11:52:03.956 INFO:tasks.workunit.client.0.smithi063.stdout:8/678: link d4/de/f41 d4/d24/fd7 0 2023-12-12T11:52:03.956 INFO:tasks.workunit.client.0.smithi063.stdout:8/679: dread - d4/de/d11/fcc zero size 2023-12-12T11:52:03.956 INFO:tasks.workunit.client.0.smithi063.stdout:8/680: fdatasync d4/de/d3b/d62/d6e/d76/f7a 0 2023-12-12T11:52:03.957 INFO:tasks.workunit.client.1.smithi093.stdout:6/984: symlink d0/da/d14/d155/l15e 0 2023-12-12T11:52:03.957 INFO:tasks.workunit.client.1.smithi093.stdout:6/985: write d0/da/f11a [463715,20004] 0 2023-12-12T11:52:03.961 INFO:tasks.workunit.client.1.smithi093.stdout:5/731: rename d0/d7/d36/d38/cd1 to d0/d7/d59/d62/cfb 0 2023-12-12T11:52:03.961 INFO:tasks.workunit.client.1.smithi093.stdout:5/732: stat d0/d7/d36/d38/dce/de9 0 2023-12-12T11:52:03.963 INFO:tasks.workunit.client.0.smithi063.stdout:2/529: dwrite d0/d1a/d3a/f9e [0,4194304] 0 2023-12-12T11:52:03.963 INFO:tasks.workunit.client.0.smithi063.stdout:2/530: creat d0/d1a/d3a/d85/fad x:0 0 0 2023-12-12T11:52:03.963 INFO:tasks.workunit.client.0.smithi063.stdout:3/562: dread d4/df/d1a/d1c/d3b/d50/d61/f65 [0,4194304] 0 2023-12-12T11:52:03.964 INFO:tasks.workunit.client.0.smithi063.stdout:3/563: write d4/f44 [84087,124469] 0 2023-12-12T11:52:03.966 INFO:tasks.workunit.client.1.smithi093.stdout:2/861: creat d5/d14/d2d/d12/d25/d7a/d7e/f123 x:0 0 0 2023-12-12T11:52:03.966 INFO:tasks.workunit.client.1.smithi093.stdout:2/862: readlink d5/d14/d2d/d4c/d54/d67/d69/dde/lfb 0 2023-12-12T11:52:03.966 INFO:tasks.workunit.client.1.smithi093.stdout:2/863: chown d5/d14/d2d/d96/c113 655363458 1 2023-12-12T11:52:03.966 INFO:tasks.workunit.client.1.smithi093.stdout:2/864: chown d5/d14/d2d/d8b/da3/de5 9047870 1 2023-12-12T11:52:03.966 INFO:tasks.workunit.client.1.smithi093.stdout:7/819: dread da/de/f72 [0,4194304] 0 2023-12-12T11:52:03.970 INFO:tasks.workunit.client.1.smithi093.stdout:9/857: link d1/d23/d24/d29/d43/c8a d1/d23/d6b/d92/ddd/c122 0 2023-12-12T11:52:03.973 INFO:tasks.workunit.client.0.smithi063.stdout:8/681: mkdir d4/d24/d38/dd8 0 2023-12-12T11:52:03.973 INFO:tasks.workunit.client.0.smithi063.stdout:7/522: dread de/d39/d60/f95 [0,4194304] 0 2023-12-12T11:52:03.977 INFO:tasks.workunit.client.0.smithi063.stdout:5/648: dwrite d7/d28/f5f [0,4194304] 0 2023-12-12T11:52:03.995 INFO:tasks.workunit.client.0.smithi063.stdout:8/682: read d4/d55/d52/d8e/fbe [2654825,74116] 0 2023-12-12T11:52:03.998 INFO:tasks.workunit.client.1.smithi093.stdout:0/866: dwrite d5/d41/d77/d79/fbe [0,4194304] 0 2023-12-12T11:52:04.002 INFO:tasks.workunit.client.1.smithi093.stdout:1/874: rmdir d4/d1a/d73/d10e 0 2023-12-12T11:52:04.006 INFO:tasks.workunit.client.1.smithi093.stdout:6/986: mkdir d0/da/d32/df7/d143/d15f 0 2023-12-12T11:52:04.011 INFO:tasks.workunit.client.0.smithi063.stdout:3/564: symlink d4/df/d1a/d1c/d3b/d52/d74/lad 0 2023-12-12T11:52:04.011 INFO:tasks.workunit.client.0.smithi063.stdout:2/531: dread d0/f22 [4194304,4194304] 0 2023-12-12T11:52:04.011 INFO:tasks.workunit.client.0.smithi063.stdout:2/532: readlink d0/d41/la5 0 2023-12-12T11:52:04.012 INFO:tasks.workunit.client.0.smithi063.stdout:4/646: sync 2023-12-12T11:52:04.012 INFO:tasks.workunit.client.0.smithi063.stdout:4/647: fsync d2/d17/d81/f8a 0 2023-12-12T11:52:04.012 INFO:tasks.workunit.client.1.smithi093.stdout:0/867: dread d5/dd/d14/d26/f6e [0,4194304] 0 2023-12-12T11:52:04.012 INFO:tasks.workunit.client.1.smithi093.stdout:5/733: mkdir d0/dfc 0 2023-12-12T11:52:04.012 INFO:tasks.workunit.client.1.smithi093.stdout:0/868: write d5/d21/d2f/fc6 [733370,12980] 0 2023-12-12T11:52:04.012 INFO:tasks.workunit.client.1.smithi093.stdout:5/734: fdatasync d0/d7/d36/d68/ff6 0 2023-12-12T11:52:04.012 INFO:tasks.workunit.client.1.smithi093.stdout:0/869: readlink d5/dd/l51 0 2023-12-12T11:52:04.012 INFO:tasks.workunit.client.1.smithi093.stdout:7/820: dwrite da/d15/d2d/f9f [0,4194304] 0 2023-12-12T11:52:04.013 INFO:tasks.workunit.client.0.smithi063.stdout:0/641: dwrite d0/d7/d27/d1f/f48 [0,4194304] 0 2023-12-12T11:52:04.014 INFO:tasks.workunit.client.0.smithi063.stdout:1/676: dwrite d3/d3a/dd7/d16/d24/f2a [0,4194304] 0 2023-12-12T11:52:04.015 INFO:tasks.workunit.client.0.smithi063.stdout:6/663: rename d9/d10/d5c/dce to d9/d10/d2a/de7 0 2023-12-12T11:52:04.017 INFO:tasks.workunit.client.0.smithi063.stdout:7/523: symlink de/d22/d2b/d4a/lc5 0 2023-12-12T11:52:04.022 INFO:tasks.workunit.client.0.smithi063.stdout:5/649: rmdir d7/d28/d94/dac 0 2023-12-12T11:52:04.022 INFO:tasks.workunit.client.0.smithi063.stdout:5/650: truncate d7/d10/d2b/f85 753827 0 2023-12-12T11:52:04.022 INFO:tasks.workunit.client.0.smithi063.stdout:5/651: write d7/d28/f47 [5197211,76751] 0 2023-12-12T11:52:04.023 INFO:tasks.workunit.client.0.smithi063.stdout:2/533: creat d0/d1a/d26/fae x:0 0 0 2023-12-12T11:52:04.026 INFO:tasks.workunit.client.0.smithi063.stdout:4/648: mkdir d2/d48/d69/dd2 0 2023-12-12T11:52:04.026 INFO:tasks.workunit.client.0.smithi063.stdout:4/649: truncate d2/d48/d4f/f68 884127 0 2023-12-12T11:52:04.027 INFO:tasks.workunit.client.1.smithi093.stdout:2/865: link d5/d14/d2d/l28 d5/d14/d2d/d12/d25/d110/l124 0 2023-12-12T11:52:04.033 INFO:tasks.workunit.client.1.smithi093.stdout:9/858: creat d1/d23/f123 x:0 0 0 2023-12-12T11:52:04.033 INFO:tasks.workunit.client.1.smithi093.stdout:9/859: fsync d1/d23/f2a 0 2023-12-12T11:52:04.033 INFO:tasks.workunit.client.1.smithi093.stdout:9/860: chown d1/d23/c37 1855528 1 2023-12-12T11:52:04.034 INFO:tasks.workunit.client.0.smithi063.stdout:0/642: mknod d0/d7/cd2 0 2023-12-12T11:52:04.042 INFO:tasks.workunit.client.1.smithi093.stdout:2/866: dread d5/d14/d2d/ff [0,4194304] 0 2023-12-12T11:52:04.043 INFO:tasks.workunit.client.1.smithi093.stdout:2/867: chown d5/d14/d2d/d4c/fba 2 1 2023-12-12T11:52:04.043 INFO:tasks.workunit.client.1.smithi093.stdout:1/875: creat d4/d1a/d1b/f123 x:0 0 0 2023-12-12T11:52:04.045 INFO:tasks.workunit.client.0.smithi063.stdout:8/683: rename d4/d24/d38/d45/f6a to d4/de/d11/fd9 0 2023-12-12T11:52:04.045 INFO:tasks.workunit.client.0.smithi063.stdout:8/684: write d4/de/d3b/d62/d36/fab [1026140,15529] 0 2023-12-12T11:52:04.046 INFO:tasks.workunit.client.1.smithi093.stdout:6/987: getdents d0/da/d32/d39/d5b 0 2023-12-12T11:52:04.046 INFO:tasks.workunit.client.1.smithi093.stdout:6/988: write d0/f29 [2015558,70296] 0 2023-12-12T11:52:04.046 INFO:tasks.workunit.client.1.smithi093.stdout:6/989: read - d0/d52/d7e/d42/dd5/ddc/d12a/f134 zero size 2023-12-12T11:52:04.049 INFO:tasks.workunit.client.1.smithi093.stdout:0/870: link d5/c8 d5/dd/d14/c10f 0 2023-12-12T11:52:04.049 INFO:tasks.workunit.client.1.smithi093.stdout:9/861: dread d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/f38 [0,4194304] 0 2023-12-12T11:52:04.051 INFO:tasks.workunit.client.0.smithi063.stdout:7/524: creat de/d22/d2b/d4a/d65/fc6 x:0 0 0 2023-12-12T11:52:04.053 INFO:tasks.workunit.client.0.smithi063.stdout:6/664: symlink d9/d68/le8 0 2023-12-12T11:52:04.054 INFO:tasks.workunit.client.1.smithi093.stdout:5/735: creat d0/d7/d8/de/dab/de5/ffd x:0 0 0 2023-12-12T11:52:04.054 INFO:tasks.workunit.client.1.smithi093.stdout:5/736: write d0/d7/d59/f60 [1513161,128253] 0 2023-12-12T11:52:04.055 INFO:tasks.workunit.client.0.smithi063.stdout:6/665: creat d9/d10/d25/fe9 x:0 0 0 2023-12-12T11:52:04.055 INFO:tasks.workunit.client.0.smithi063.stdout:0/643: write d0/d1a/d23/d34/d42/f5d [3095047,128675] 0 2023-12-12T11:52:04.055 INFO:tasks.workunit.client.0.smithi063.stdout:0/644: chown d0/d7/d27/d1f/dc4/d67/fc0 0 1 2023-12-12T11:52:04.055 INFO:tasks.workunit.client.0.smithi063.stdout:0/645: chown d0/d1a/d23/c9d 77917720 1 2023-12-12T11:52:04.059 INFO:tasks.workunit.client.0.smithi063.stdout:2/534: mkdir d0/d41/daf 0 2023-12-12T11:52:04.059 INFO:tasks.workunit.client.0.smithi063.stdout:2/535: write d0/d1a/d48/d56/f76 [1050519,642] 0 2023-12-12T11:52:04.063 INFO:tasks.workunit.client.0.smithi063.stdout:4/650: mknod d2/d47/d6d/d88/dbd/cd3 0 2023-12-12T11:52:04.063 INFO:tasks.workunit.client.0.smithi063.stdout:4/651: fsync d2/f58 0 2023-12-12T11:52:04.063 INFO:tasks.workunit.client.1.smithi093.stdout:7/821: mkdir da/d8e/daa/dd6/d118 0 2023-12-12T11:52:04.067 INFO:tasks.workunit.client.0.smithi063.stdout:8/685: mknod d4/de/d1e/cda 0 2023-12-12T11:52:04.067 INFO:tasks.workunit.client.0.smithi063.stdout:8/686: dread - d4/de/d11/fcc zero size 2023-12-12T11:52:04.068 INFO:tasks.workunit.client.0.smithi063.stdout:7/525: rmdir de/d33/d71 39 2023-12-12T11:52:04.070 INFO:tasks.workunit.client.1.smithi093.stdout:2/868: mknod d5/d14/d2d/d12/d44/df6/c125 0 2023-12-12T11:52:04.072 INFO:tasks.workunit.client.1.smithi093.stdout:1/876: creat d4/d1c/d2a/f124 x:0 0 0 2023-12-12T11:52:04.073 INFO:tasks.workunit.client.0.smithi063.stdout:1/677: write d3/d3a/dd7/fe [815033,112166] 0 2023-12-12T11:52:04.073 INFO:tasks.workunit.client.0.smithi063.stdout:1/678: read - d3/d3a/fbe zero size 2023-12-12T11:52:04.075 INFO:tasks.workunit.client.0.smithi063.stdout:5/652: dwrite d7/d10/d2b/f4b [0,4194304] 0 2023-12-12T11:52:04.075 INFO:tasks.workunit.client.0.smithi063.stdout:2/536: dread d0/f4 [0,4194304] 0 2023-12-12T11:52:04.075 INFO:tasks.workunit.client.0.smithi063.stdout:5/653: truncate d7/fa7 134660 0 2023-12-12T11:52:04.077 INFO:tasks.workunit.client.0.smithi063.stdout:6/666: rename d9/d2c/l89 to d9/d10/d5c/lea 0 2023-12-12T11:52:04.080 INFO:tasks.workunit.client.1.smithi093.stdout:6/990: mkdir d0/d52/d7e/d42/dd5/ddc/d103/d160 0 2023-12-12T11:52:04.080 INFO:tasks.workunit.client.1.smithi093.stdout:6/991: chown d0/d52/d7e/d42/dd5/ddc/d12a/f13f 826 1 2023-12-12T11:52:04.082 INFO:tasks.workunit.client.1.smithi093.stdout:0/871: getdents d5/d21/d2f/d54 0 2023-12-12T11:52:04.084 INFO:tasks.workunit.client.1.smithi093.stdout:9/862: mknod d1/d23/d24/d89/c124 0 2023-12-12T11:52:04.085 INFO:tasks.workunit.client.0.smithi063.stdout:4/652: creat d2/d48/d69/dd2/fd4 x:0 0 0 2023-12-12T11:52:04.087 INFO:tasks.workunit.client.0.smithi063.stdout:8/687: truncate d4/de/d3b/d62/d6e/f8f 3019096 0 2023-12-12T11:52:04.090 INFO:tasks.workunit.client.1.smithi093.stdout:8/899: sync 2023-12-12T11:52:04.090 INFO:tasks.workunit.client.1.smithi093.stdout:7/822: mknod da/de/d100/c119 0 2023-12-12T11:52:04.090 INFO:tasks.workunit.client.1.smithi093.stdout:8/900: write d3/d1a/d1f/d29/d3a/d40/dbf/fe9 [691472,12534] 0 2023-12-12T11:52:04.091 INFO:tasks.workunit.client.0.smithi063.stdout:1/679: symlink d3/d3a/dd7/d16/d17/d4b/d8c/lda 0 2023-12-12T11:52:04.092 INFO:tasks.workunit.client.1.smithi093.stdout:6/992: rename d0/da/d14/d38/d43/f86 to d0/d52/d7e/d42/f161 0 2023-12-12T11:52:04.093 INFO:tasks.workunit.client.1.smithi093.stdout:3/848: sync 2023-12-12T11:52:04.099 INFO:tasks.workunit.client.1.smithi093.stdout:9/863: symlink d1/d23/d24/d29/d43/d56/d85/dc3/dce/de1/l125 0 2023-12-12T11:52:04.101 INFO:tasks.workunit.client.1.smithi093.stdout:5/737: getdents d0/d7/d59/de7 0 2023-12-12T11:52:04.104 INFO:tasks.workunit.client.1.smithi093.stdout:7/823: mknod da/d8e/daa/dd6/d118/c11a 0 2023-12-12T11:52:04.107 INFO:tasks.workunit.client.1.smithi093.stdout:8/901: mknod d3/d1a/d1f/c128 0 2023-12-12T11:52:04.114 INFO:tasks.workunit.client.1.smithi093.stdout:3/849: truncate df/f1a 900839 0 2023-12-12T11:52:04.114 INFO:tasks.workunit.client.1.smithi093.stdout:3/850: write df/f21 [2492307,90087] 0 2023-12-12T11:52:04.114 INFO:tasks.workunit.client.1.smithi093.stdout:3/851: write df/d22/d49/d69/d78/daf/d3d/def/fa1 [5236241,48993] 0 2023-12-12T11:52:04.115 INFO:tasks.workunit.client.1.smithi093.stdout:2/869: dwrite d5/d14/d2d/ff [0,4194304] 0 2023-12-12T11:52:04.116 INFO:tasks.workunit.client.1.smithi093.stdout:1/877: dwrite d4/d1c/d2a/f4b [0,4194304] 0 2023-12-12T11:52:04.118 INFO:tasks.workunit.client.1.smithi093.stdout:0/872: getdents d5/d78 0 2023-12-12T11:52:04.118 INFO:tasks.workunit.client.1.smithi093.stdout:0/873: creat d5/dd/d33/d87/f110 x:0 0 0 2023-12-12T11:52:04.119 INFO:tasks.workunit.client.0.smithi063.stdout:2/537: creat d0/d1a/d3a/d59/fb0 x:0 0 0 2023-12-12T11:52:04.120 INFO:tasks.workunit.client.0.smithi063.stdout:2/538: chown d0/d1a/d1e/l7f 6734570 1 2023-12-12T11:52:04.125 INFO:tasks.workunit.client.1.smithi093.stdout:7/824: mknod da/d8e/daa/c11b 0 2023-12-12T11:52:04.126 INFO:tasks.workunit.client.0.smithi063.stdout:6/667: mknod d9/d10/d5c/ceb 0 2023-12-12T11:52:04.128 INFO:tasks.workunit.client.0.smithi063.stdout:0/646: link d0/d1a/l46 d0/d7/d27/d1f/ld3 0 2023-12-12T11:52:04.130 INFO:tasks.workunit.client.0.smithi063.stdout:0/647: stat d0/d7/f55 0 2023-12-12T11:52:04.130 INFO:tasks.workunit.client.0.smithi063.stdout:0/648: truncate d0/d1a/d23/fb3 1384764 0 2023-12-12T11:52:04.130 INFO:tasks.workunit.client.0.smithi063.stdout:0/649: write d0/d1a/d23/d34/d42/d99/fbf [1026806,55123] 0 2023-12-12T11:52:04.130 INFO:tasks.workunit.client.0.smithi063.stdout:0/650: chown d0/d7/d27/fc5 11 1 2023-12-12T11:52:04.131 INFO:tasks.workunit.client.1.smithi093.stdout:3/852: creat df/d22/d49/d69/d78/daf/d3d/f114 x:0 0 0 2023-12-12T11:52:04.132 INFO:tasks.workunit.client.0.smithi063.stdout:4/653: mkdir d2/d17/dd5 0 2023-12-12T11:52:04.140 INFO:tasks.workunit.client.1.smithi093.stdout:1/878: dread d4/d1a/d1b/d26/d65/d6f/f89 [0,4194304] 0 2023-12-12T11:52:04.140 INFO:tasks.workunit.client.0.smithi063.stdout:2/539: dread d0/d1a/d26/f44 [0,4194304] 0 2023-12-12T11:52:04.142 INFO:tasks.workunit.client.0.smithi063.stdout:8/688: getdents d4/de/d3b/d62/d91 0 2023-12-12T11:52:04.145 INFO:tasks.workunit.client.0.smithi063.stdout:1/680: creat d3/d3a/dd7/d16/d24/d4d/d35/d98/fdb x:0 0 0 2023-12-12T11:52:04.147 INFO:tasks.workunit.client.0.smithi063.stdout:5/654: getdents d7/d10 0 2023-12-12T11:52:04.149 INFO:tasks.workunit.client.1.smithi093.stdout:0/874: mkdir d5/d41/d77/d79/df2/d111 0 2023-12-12T11:52:04.149 INFO:tasks.workunit.client.1.smithi093.stdout:0/875: dread - d5/dd/d33/f109 zero size 2023-12-12T11:52:04.152 INFO:tasks.workunit.client.1.smithi093.stdout:7/825: creat da/d15/f11c x:0 0 0 2023-12-12T11:52:04.152 INFO:tasks.workunit.client.0.smithi063.stdout:6/668: symlink d9/d10/d2a/de7/d86/dc2/lec 0 2023-12-12T11:52:04.154 INFO:tasks.workunit.client.1.smithi093.stdout:8/902: dwrite d3/d1a/d1f/d59/d69/dbc/fe8 [0,4194304] 0 2023-12-12T11:52:04.155 INFO:tasks.workunit.client.0.smithi063.stdout:2/540: symlink d0/d41/daf/lb1 0 2023-12-12T11:52:04.155 INFO:tasks.workunit.client.0.smithi063.stdout:2/541: chown d0/d1a/d26/f29 60609 1 2023-12-12T11:52:04.155 INFO:tasks.workunit.client.0.smithi063.stdout:2/542: write d0/d1a/d57/f6d [614758,109875] 0 2023-12-12T11:52:04.155 INFO:tasks.workunit.client.0.smithi063.stdout:8/689: creat d4/d24/d38/d45/fdb x:0 0 0 2023-12-12T11:52:04.156 INFO:tasks.workunit.client.0.smithi063.stdout:0/651: write d0/d7/d27/d1f/f3f [243407,77012] 0 2023-12-12T11:52:04.156 INFO:tasks.workunit.client.1.smithi093.stdout:9/864: dwrite d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/f3b [0,4194304] 0 2023-12-12T11:52:04.157 INFO:tasks.workunit.client.1.smithi093.stdout:9/865: write d1/d23/d24/d29/d43/d56/fba [988327,6044] 0 2023-12-12T11:52:04.157 INFO:tasks.workunit.client.1.smithi093.stdout:1/879: dread d4/d1c/f21 [0,4194304] 0 2023-12-12T11:52:04.157 INFO:tasks.workunit.client.1.smithi093.stdout:3/853: rmdir df/d22/d49/d69/d78/daf/d3d/dfd 0 2023-12-12T11:52:04.157 INFO:tasks.workunit.client.1.smithi093.stdout:0/876: symlink d5/dd/d14/d26/l112 0 2023-12-12T11:52:04.157 INFO:tasks.workunit.client.1.smithi093.stdout:0/877: readlink d5/d21/d27/l9f 0 2023-12-12T11:52:04.157 INFO:tasks.workunit.client.1.smithi093.stdout:0/878: chown d5/d41/d77/d79/df2 134 1 2023-12-12T11:52:04.158 INFO:tasks.workunit.client.0.smithi063.stdout:1/681: unlink d3/d3a/dd7/d16/d24/d4d/d35/d98/ld0 0 2023-12-12T11:52:04.159 INFO:tasks.workunit.client.0.smithi063.stdout:4/654: dread d2/f56 [0,4194304] 0 2023-12-12T11:52:04.160 INFO:tasks.workunit.client.0.smithi063.stdout:4/655: truncate d2/d47/d6d/f8e 1699647 0 2023-12-12T11:52:04.160 INFO:tasks.workunit.client.0.smithi063.stdout:4/656: chown d2/d17/f3e 1796 1 2023-12-12T11:52:04.161 INFO:tasks.workunit.client.0.smithi063.stdout:5/655: symlink d7/d10/d2b/d3c/lc6 0 2023-12-12T11:52:04.169 INFO:tasks.workunit.client.0.smithi063.stdout:7/526: rename de/d22/d6f to de/d39/d60/d97/dc7 0 2023-12-12T11:52:04.169 INFO:tasks.workunit.client.0.smithi063.stdout:9/490: sync 2023-12-12T11:52:04.175 INFO:tasks.workunit.client.0.smithi063.stdout:6/669: mkdir d9/d10/d2a/de7/d86/dc2/ded 0 2023-12-12T11:52:04.175 INFO:tasks.workunit.client.0.smithi063.stdout:6/670: stat d9/d10/d7a/f91 0 2023-12-12T11:52:04.176 INFO:tasks.workunit.client.1.smithi093.stdout:8/903: rename d3/d1a/d1f/d29/d30/d58/fd7 to d3/f129 0 2023-12-12T11:52:04.178 INFO:tasks.workunit.client.0.smithi063.stdout:2/543: creat d0/d1a/d48/d56/da2/fb2 x:0 0 0 2023-12-12T11:52:04.178 INFO:tasks.workunit.client.0.smithi063.stdout:2/544: read - d0/d1a/d48/d56/d77/f8b zero size 2023-12-12T11:52:04.178 INFO:tasks.workunit.client.0.smithi063.stdout:2/545: creat d0/fb3 x:0 0 0 2023-12-12T11:52:04.178 INFO:tasks.workunit.client.1.smithi093.stdout:0/879: write d5/d41/fa6 [4695591,55576] 0 2023-12-12T11:52:04.181 INFO:tasks.workunit.client.0.smithi063.stdout:8/690: mkdir d4/d24/d38/ddc 0 2023-12-12T11:52:04.185 INFO:tasks.workunit.client.0.smithi063.stdout:0/652: mkdir d0/d1a/d23/d2e/dd4 0 2023-12-12T11:52:04.185 INFO:tasks.workunit.client.0.smithi063.stdout:0/653: chown d0/d7/d27/d44/f97 1 1 2023-12-12T11:52:04.186 INFO:tasks.workunit.client.0.smithi063.stdout:7/527: read de/d39/d60/d97/dc7/f9a [192356,36211] 0 2023-12-12T11:52:04.186 INFO:tasks.workunit.client.0.smithi063.stdout:7/528: stat de/d33/d41/f7c 0 2023-12-12T11:52:04.186 INFO:tasks.workunit.client.0.smithi063.stdout:7/529: fsync de/d39/d60/da4/fb7 0 2023-12-12T11:52:04.188 INFO:tasks.workunit.client.0.smithi063.stdout:1/682: truncate d3/d3a/dd7/d16/d4f/fcf 758830 0 2023-12-12T11:52:04.189 INFO:tasks.workunit.client.1.smithi093.stdout:1/880: symlink d4/d1a/d73/dd4/l125 0 2023-12-12T11:52:04.191 INFO:tasks.workunit.client.1.smithi093.stdout:3/854: getdents df/d22/d49/d69/dfa 0 2023-12-12T11:52:04.193 INFO:tasks.workunit.client.0.smithi063.stdout:4/657: rename d2/d17/c57 to d2/d8/db3/dc1/cd6 0 2023-12-12T11:52:04.198 INFO:tasks.workunit.client.1.smithi093.stdout:7/826: getdents da/d15/d2d/d2f/dc6 0 2023-12-12T11:52:04.198 INFO:tasks.workunit.client.0.smithi063.stdout:6/671: write d9/d10/d2a/f34 [969155,10068] 0 2023-12-12T11:52:04.198 INFO:tasks.workunit.client.0.smithi063.stdout:6/672: dread - d9/d10/d5c/d5e/fab zero size 2023-12-12T11:52:04.199 INFO:tasks.workunit.client.0.smithi063.stdout:6/673: stat d9/d10/f58 0 2023-12-12T11:52:04.199 INFO:tasks.workunit.client.0.smithi063.stdout:6/674: creat d9/d10/d7a/fee x:0 0 0 2023-12-12T11:52:04.200 INFO:tasks.workunit.client.0.smithi063.stdout:1/683: write d3/d3a/dd7/d16/d24/d30/f9c [503858,93771] 0 2023-12-12T11:52:04.200 INFO:tasks.workunit.client.0.smithi063.stdout:1/684: truncate d3/d3a/dd7/d16/d17/f90 444863 0 2023-12-12T11:52:04.201 INFO:tasks.workunit.client.0.smithi063.stdout:1/685: write d3/f9 [544690,85656] 0 2023-12-12T11:52:04.202 INFO:tasks.workunit.client.1.smithi093.stdout:1/881: dread d4/d1c/f6d [0,4194304] 0 2023-12-12T11:52:04.207 INFO:tasks.workunit.client.0.smithi063.stdout:2/546: symlink d0/d1a/d48/lb4 0 2023-12-12T11:52:04.207 INFO:tasks.workunit.client.0.smithi063.stdout:2/547: fsync d0/d1a/d48/d56/d77/f8b 0 2023-12-12T11:52:04.210 INFO:tasks.workunit.client.0.smithi063.stdout:8/691: symlink d4/d24/db3/dc9/ldd 0 2023-12-12T11:52:04.210 INFO:tasks.workunit.client.0.smithi063.stdout:8/692: fsync d4/d24/d38/d45/d5b/d92/fb9 0 2023-12-12T11:52:04.211 INFO:tasks.workunit.client.0.smithi063.stdout:8/693: write d4/de/d3b/d62/d36/d57/fc7 [590972,81609] 0 2023-12-12T11:52:04.218 INFO:tasks.workunit.client.1.smithi093.stdout:8/904: write d3/d1a/d1f/d29/d3a/d40/f53 [1184751,14969] 0 2023-12-12T11:52:04.218 INFO:tasks.workunit.client.1.smithi093.stdout:8/905: truncate d3/d8/d88/f10a 1545791 0 2023-12-12T11:52:04.218 INFO:tasks.workunit.client.1.smithi093.stdout:8/906: fdatasync d3/d1a/d1f/d29/d3a/d68/d8a/f94 0 2023-12-12T11:52:04.218 INFO:tasks.workunit.client.1.smithi093.stdout:8/907: chown d3/d1a/d1f/d59/ddb/c10f 0 1 2023-12-12T11:52:04.218 INFO:tasks.workunit.client.1.smithi093.stdout:8/908: read - d3/d1a/d1f/d29/d30/f89 zero size 2023-12-12T11:52:04.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:03 smithi093 ceph-mon[115914]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:52:04.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:03 smithi093 ceph-mon[115914]: pgmap v16: 65 pgs: 65 active+clean; 2.7 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 157 MiB/s rd, 198 MiB/s wr, 285 op/s 2023-12-12T11:52:04.222 INFO:tasks.workunit.client.0.smithi063.stdout:7/530: getdents de/d39/d60/d97 0 2023-12-12T11:52:04.223 INFO:tasks.workunit.client.0.smithi063.stdout:9/491: rename d7/f14 to d7/d20/d65/fa2 0 2023-12-12T11:52:04.224 INFO:tasks.workunit.client.1.smithi093.stdout:9/866: rename d1/f54 to d1/d23/d6b/d92/ddd/f126 0 2023-12-12T11:52:04.225 INFO:tasks.workunit.client.1.smithi093.stdout:2/870: dwrite d5/f49 [0,4194304] 0 2023-12-12T11:52:04.235 INFO:tasks.workunit.client.0.smithi063.stdout:5/656: dwrite d7/d10/d2b/d3c/d42/d62/d69/f9d [0,4194304] 0 2023-12-12T11:52:04.248 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:03 smithi063 ceph-mon[107117]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:52:04.248 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:03 smithi063 ceph-mon[107117]: pgmap v16: 65 pgs: 65 active+clean; 2.7 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 157 MiB/s rd, 198 MiB/s wr, 285 op/s 2023-12-12T11:52:04.251 INFO:tasks.workunit.client.1.smithi093.stdout:0/880: symlink d5/dd/d14/d99/l113 0 2023-12-12T11:52:04.251 INFO:tasks.workunit.client.1.smithi093.stdout:7/827: creat da/d8e/da9/f11d x:0 0 0 2023-12-12T11:52:04.259 INFO:tasks.workunit.client.1.smithi093.stdout:8/909: creat d3/d73/d113/f12a x:0 0 0 2023-12-12T11:52:04.269 INFO:tasks.workunit.client.1.smithi093.stdout:3/855: rename df/dc6/cce to df/d22/d49/d69/d78/daf/d3d/d6f/db1/c115 0 2023-12-12T11:52:04.269 INFO:tasks.workunit.client.1.smithi093.stdout:3/856: creat df/d25/dd2/f116 x:0 0 0 2023-12-12T11:52:04.269 INFO:tasks.workunit.client.1.smithi093.stdout:3/857: read df/d22/f31 [458471,127760] 0 2023-12-12T11:52:04.272 INFO:tasks.workunit.client.0.smithi063.stdout:4/658: dwrite d2/d17/d41/f52 [0,4194304] 0 2023-12-12T11:52:04.286 INFO:tasks.workunit.client.0.smithi063.stdout:7/531: mkdir de/dc8 0 2023-12-12T11:52:04.286 INFO:tasks.workunit.client.0.smithi063.stdout:7/532: write de/d22/d66/fa7 [108427,32911] 0 2023-12-12T11:52:04.286 INFO:tasks.workunit.client.0.smithi063.stdout:0/654: rename d0/d1a/d23/d34/d42/f60 to d0/d1a/d23/d34/fd5 0 2023-12-12T11:52:04.288 INFO:tasks.workunit.client.0.smithi063.stdout:9/492: creat d7/d11/d94/fa3 x:0 0 0 2023-12-12T11:52:04.289 INFO:tasks.workunit.client.1.smithi093.stdout:2/871: getdents d5/d14/d2d/d4c/d54/dc5 0 2023-12-12T11:52:04.290 INFO:tasks.workunit.client.1.smithi093.stdout:2/872: creat d5/d14/d2d/d12/d25/d7a/d7e/dc9/f126 x:0 0 0 2023-12-12T11:52:04.293 INFO:tasks.workunit.client.1.smithi093.stdout:7/828: mkdir da/d2e/d89/d11e 0 2023-12-12T11:52:04.294 INFO:tasks.workunit.client.1.smithi093.stdout:7/829: fdatasync da/de/d78/f10b 0 2023-12-12T11:52:04.298 INFO:tasks.workunit.client.1.smithi093.stdout:2/873: dread d5/d14/d2d/d4c/d54/dc5/d55/f60 [0,4194304] 0 2023-12-12T11:52:04.299 INFO:tasks.workunit.client.1.smithi093.stdout:9/867: symlink d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d57/d63/l127 0 2023-12-12T11:52:04.303 INFO:tasks.workunit.client.0.smithi063.stdout:8/694: dwrite d4/de/f30 [0,4194304] 0 2023-12-12T11:52:04.306 INFO:tasks.workunit.client.0.smithi063.stdout:2/548: dwrite d0/d1a/d1e/f70 [0,4194304] 0 2023-12-12T11:52:04.310 INFO:tasks.workunit.client.1.smithi093.stdout:7/830: mknod da/d15/d19/c11f 0 2023-12-12T11:52:04.311 INFO:tasks.workunit.client.1.smithi093.stdout:7/831: write da/f8a [1733001,51549] 0 2023-12-12T11:52:04.312 INFO:tasks.workunit.client.1.smithi093.stdout:7/832: chown da/de/d46/d4f 7178072 1 2023-12-12T11:52:04.314 INFO:tasks.workunit.client.1.smithi093.stdout:0/881: dwrite d5/dd/d62/f83 [4194304,4194304] 0 2023-12-12T11:52:04.315 INFO:tasks.workunit.client.0.smithi063.stdout:7/533: symlink de/d22/d4d/lc9 0 2023-12-12T11:52:04.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.312+0000 7f8f432dc700 1 -- 172.21.15.63:0/3078376874 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8f3c1033f0 con 0x7f8f3c100050 2023-12-12T11:52:04.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.315+0000 7f8f31ffb700 1 -- 172.21.15.63:0/3078376874 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+840 (secure 0 0 0) 0x7f8f2c056f00 con 0x7f8f3c100050 2023-12-12T11:52:04.317 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:52:04.317 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-12T11:52:04.318 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 2 2023-12-12T11:52:04.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:52:04.318 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-12T11:52:04.318 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 1, 2023-12-12T11:52:04.318 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 1 2023-12-12T11:52:04.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:52:04.318 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-12T11:52:04.318 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 6 2023-12-12T11:52:04.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:52:04.318 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-12T11:52:04.318 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 4 2023-12-12T11:52:04.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:52:04.318 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-12T11:52:04.318 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 13, 2023-12-12T11:52:04.318 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 1 2023-12-12T11:52:04.319 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-12T11:52:04.319 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:52:04.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.319+0000 7f8f432dc700 1 -- 172.21.15.63:0/3078376874 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f8f2806af00 msgr2=0x7f8f2806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:04.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.319+0000 7f8f432dc700 1 --2- 172.21.15.63:0/3078376874 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f8f2806af00 0x7f8f2806d3b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8f3800fde0 tx=0x7f8f38004990 comp rx=0 tx=0).stop 2023-12-12T11:52:04.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.319+0000 7f8f432dc700 1 -- 172.21.15.63:0/3078376874 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f3c100050 msgr2=0x7f8f3c06f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:04.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.319+0000 7f8f432dc700 1 --2- 172.21.15.63:0/3078376874 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f3c100050 0x7f8f3c06f1b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c00b790 tx=0x7f8f2c009250 comp rx=0 tx=0).stop 2023-12-12T11:52:04.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.319+0000 7f8f432dc700 1 -- 172.21.15.63:0/3078376874 shutdown_connections 2023-12-12T11:52:04.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.319+0000 7f8f432dc700 1 --2- 172.21.15.63:0/3078376874 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f8f2806af00 0x7f8f2806d3b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:04.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.319+0000 7f8f432dc700 1 --2- 172.21.15.63:0/3078376874 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f3c0fd730 0x7f8f3c06ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:04.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.319+0000 7f8f432dc700 1 --2- 172.21.15.63:0/3078376874 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f3c100050 0x7f8f3c06f1b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:04.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.319+0000 7f8f432dc700 1 -- 172.21.15.63:0/3078376874 >> 172.21.15.63:0/3078376874 conn(0x7f8f3c0f7190 msgr2=0x7f8f3c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:52:04.322 INFO:tasks.workunit.client.1.smithi093.stdout:3/858: dwrite df/d22/d49/d69/d78/fdd [0,4194304] 0 2023-12-12T11:52:04.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.320+0000 7f8f432dc700 1 -- 172.21.15.63:0/3078376874 shutdown_connections 2023-12-12T11:52:04.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.320+0000 7f8f432dc700 1 -- 172.21.15.63:0/3078376874 wait complete. 2023-12-12T11:52:04.323 INFO:tasks.workunit.client.0.smithi063.stdout:4/659: dwrite d2/d17/d7f/fa9 [0,4194304] 0 2023-12-12T11:52:04.324 INFO:tasks.workunit.client.0.smithi063.stdout:6/675: rename d9/fb to d9/d10/d2a/de7/d86/dc2/fef 0 2023-12-12T11:52:04.324 INFO:tasks.workunit.client.0.smithi063.stdout:6/676: fdatasync d9/d68/f78 0 2023-12-12T11:52:04.327 INFO:tasks.workunit.client.1.smithi093.stdout:6/993: sync 2023-12-12T11:52:04.327 INFO:tasks.workunit.client.1.smithi093.stdout:5/738: sync 2023-12-12T11:52:04.327 INFO:tasks.workunit.client.1.smithi093.stdout:2/874: rename d5/d14/d2d/d4c/d76/dc6/d118/da7 to d5/d14/d2d/d8b/da2/d127 0 2023-12-12T11:52:04.329 INFO:tasks.workunit.client.0.smithi063.stdout:9/493: getdents d7 0 2023-12-12T11:52:04.329 INFO:tasks.workunit.client.1.smithi093.stdout:9/868: dread d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/f25 [4194304,4194304] 0 2023-12-12T11:52:04.332 INFO:tasks.workunit.client.1.smithi093.stdout:8/910: dwrite d3/d1a/d1f/d29/d3a/d40/f53 [0,4194304] 0 2023-12-12T11:52:04.333 INFO:tasks.workunit.client.0.smithi063.stdout:7/534: dread de/d39/f5e [0,4194304] 0 2023-12-12T11:52:04.334 INFO:tasks.workunit.client.0.smithi063.stdout:7/535: chown de/d33/c35 8 1 2023-12-12T11:52:04.335 INFO:tasks.workunit.client.1.smithi093.stdout:0/882: unlink d5/dd/d14/d26/d58/f103 0 2023-12-12T11:52:04.341 INFO:tasks.workunit.client.0.smithi063.stdout:2/549: creat d0/d1a/d3a/d85/da6/fb5 x:0 0 0 2023-12-12T11:52:04.342 INFO:tasks.workunit.client.1.smithi093.stdout:6/994: read d0/da/d14/f115 [928375,87550] 0 2023-12-12T11:52:04.342 INFO:tasks.workunit.client.1.smithi093.stdout:6/995: creat d0/da/d32/f162 x:0 0 0 2023-12-12T11:52:04.351 INFO:tasks.workunit.client.1.smithi093.stdout:3/859: rmdir df/d30/d33 39 2023-12-12T11:52:04.352 INFO:tasks.workunit.client.1.smithi093.stdout:5/739: mknod d0/d7/d8/d9e/d6a/cfe 0 2023-12-12T11:52:04.352 INFO:tasks.workunit.client.1.smithi093.stdout:5/740: stat d0/d7/d59/d48/ldf 0 2023-12-12T11:52:04.354 INFO:tasks.workunit.client.0.smithi063.stdout:1/686: rename d3/d3a/dd7/d16/d24/d48/c96 to d3/d3a/dd7/d16/d24/d4d/d35/cdc 0 2023-12-12T11:52:04.355 INFO:tasks.workunit.client.0.smithi063.stdout:8/695: dwrite f3 [0,4194304] 0 2023-12-12T11:52:04.356 INFO:tasks.workunit.client.1.smithi093.stdout:2/875: mknod d5/d14/d5e/c128 0 2023-12-12T11:52:04.358 INFO:tasks.workunit.client.0.smithi063.stdout:4/660: mkdir d2/d17/d41/dd7 0 2023-12-12T11:52:04.361 INFO:tasks.workunit.client.1.smithi093.stdout:9/869: getdents d1/d23/d24/d29/d43/d56/d85/dc3/dce/df5 0 2023-12-12T11:52:04.363 INFO:tasks.workunit.client.0.smithi063.stdout:6/677: symlink d9/d2c/d61/lf0 0 2023-12-12T11:52:04.365 INFO:tasks.workunit.client.1.smithi093.stdout:1/882: sync 2023-12-12T11:52:04.366 INFO:tasks.workunit.client.0.smithi063.stdout:9/494: symlink d7/d20/d45/d8e/la4 0 2023-12-12T11:52:04.366 INFO:tasks.workunit.client.0.smithi063.stdout:9/495: write d7/d11/d12/d30/f8b [653019,30073] 0 2023-12-12T11:52:04.369 INFO:tasks.workunit.client.0.smithi063.stdout:3/565: sync 2023-12-12T11:52:04.369 INFO:tasks.workunit.client.1.smithi093.stdout:7/833: getdents da/de/d78 0 2023-12-12T11:52:04.371 INFO:tasks.workunit.client.0.smithi063.stdout:8/696: dread d4/de/d11/f14 [4194304,4194304] 0 2023-12-12T11:52:04.372 INFO:tasks.workunit.client.0.smithi063.stdout:7/536: mknod de/d22/d4d/cca 0 2023-12-12T11:52:04.372 INFO:tasks.workunit.client.1.smithi093.stdout:9/870: dread d1/d23/d24/d29/d43/d58/f6c [0,4194304] 0 2023-12-12T11:52:04.373 INFO:tasks.workunit.client.1.smithi093.stdout:9/871: creat d1/d23/d6b/d92/db2/f128 x:0 0 0 2023-12-12T11:52:04.373 INFO:tasks.workunit.client.1.smithi093.stdout:9/872: chown d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/f49 263 1 2023-12-12T11:52:04.373 INFO:tasks.workunit.client.1.smithi093.stdout:9/873: fdatasync d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/db1/ff3 0 2023-12-12T11:52:04.376 INFO:tasks.workunit.client.0.smithi063.stdout:2/550: unlink d0/d1a/d48/d56/da2/la4 0 2023-12-12T11:52:04.380 INFO:tasks.workunit.client.0.smithi063.stdout:5/657: rename d7/f56 to d7/d10/d2b/d3c/d63/fc7 0 2023-12-12T11:52:04.380 INFO:tasks.workunit.client.0.smithi063.stdout:5/658: dread - d7/d10/d2b/d3c/fbd zero size 2023-12-12T11:52:04.382 INFO:tasks.workunit.client.1.smithi093.stdout:6/996: creat d0/da/d32/df7/d143/f163 x:0 0 0 2023-12-12T11:52:04.385 INFO:tasks.workunit.client.0.smithi063.stdout:1/687: creat d3/d3a/dd7/d16/d17/d4b/d8c/fdd x:0 0 0 2023-12-12T11:52:04.391 INFO:tasks.workunit.client.1.smithi093.stdout:3/860: creat df/d30/d33/f117 x:0 0 0 2023-12-12T11:52:04.392 INFO:tasks.workunit.client.0.smithi063.stdout:4/661: rmdir d2 39 2023-12-12T11:52:04.394 INFO:tasks.workunit.client.1.smithi093.stdout:5/741: readlink d0/d7/d36/db9/l6f 0 2023-12-12T11:52:04.400 INFO:tasks.workunit.client.0.smithi063.stdout:6/678: creat d9/d68/d94/ff1 x:0 0 0 2023-12-12T11:52:04.406 INFO:tasks.workunit.client.1.smithi093.stdout:8/911: getdents d3/d1a/d1f/d29/d30/d110 0 2023-12-12T11:52:04.406 INFO:tasks.workunit.client.0.smithi063.stdout:8/697: mknod d4/d55/cde 0 2023-12-12T11:52:04.406 INFO:tasks.workunit.client.0.smithi063.stdout:5/659: write d7/d10/d2b/d3c/d42/d76/f78 [1283409,9834] 0 2023-12-12T11:52:04.406 INFO:tasks.workunit.client.0.smithi063.stdout:5/660: fsync d7/f15 0 2023-12-12T11:52:04.406 INFO:tasks.workunit.client.0.smithi063.stdout:7/537: mkdir de/d34/d68/da1/dcb 0 2023-12-12T11:52:04.407 INFO:tasks.workunit.client.0.smithi063.stdout:2/551: truncate d0/f22 4655655 0 2023-12-12T11:52:04.408 INFO:tasks.workunit.client.1.smithi093.stdout:1/883: mknod d4/d1a/d83/d9a/da9/c126 0 2023-12-12T11:52:04.408 INFO:tasks.workunit.client.1.smithi093.stdout:1/884: chown d4/dc/d7a/d9c/da7/fc3 584889 1 2023-12-12T11:52:04.409 INFO:tasks.workunit.client.1.smithi093.stdout:1/885: write d4/d1a/d1b/dbf/fd3 [3578126,109768] 0 2023-12-12T11:52:04.409 INFO:tasks.workunit.client.1.smithi093.stdout:7/834: mknod da/d8e/c120 0 2023-12-12T11:52:04.410 INFO:tasks.workunit.client.1.smithi093.stdout:9/874: dwrite d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/f3b [4194304,4194304] 0 2023-12-12T11:52:04.411 INFO:tasks.workunit.client.1.smithi093.stdout:9/875: write d1/d23/d24/d29/d43/d56/d85/dc3/dce/d3e/f112 [221273,26217] 0 2023-12-12T11:52:04.411 INFO:tasks.workunit.client.1.smithi093.stdout:9/876: dread - d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/d42/fdf zero size 2023-12-12T11:52:04.412 INFO:tasks.workunit.client.1.smithi093.stdout:0/883: rmdir d5/dd/d62 39 2023-12-12T11:52:04.414 INFO:tasks.workunit.client.0.smithi063.stdout:0/655: rename d0/d7/la to d0/d1a/d23/d34/d42/ld6 0 2023-12-12T11:52:04.415 INFO:tasks.workunit.client.0.smithi063.stdout:0/656: chown d0/d1a/d23/c9d 30 1 2023-12-12T11:52:04.419 INFO:tasks.workunit.client.1.smithi093.stdout:0/884: write d5/dd/d62/fb7 [385347,43011] 0 2023-12-12T11:52:04.421 INFO:tasks.workunit.client.0.smithi063.stdout:9/496: write d7/d15/f2e [3837863,110698] 0 2023-12-12T11:52:04.421 INFO:tasks.workunit.client.0.smithi063.stdout:9/497: write d7/d11/d12/d30/f48 [1604731,29739] 0 2023-12-12T11:52:04.421 INFO:tasks.workunit.client.0.smithi063.stdout:4/662: write d2/d17/d7f/fa9 [237554,23391] 0 2023-12-12T11:52:04.422 INFO:tasks.workunit.client.1.smithi093.stdout:6/997: link d0/da/d14/d38/f125 d0/d52/d7e/d42/dd5/ddc/d12a/f164 0 2023-12-12T11:52:04.422 INFO:tasks.workunit.client.1.smithi093.stdout:6/998: dread - d0/da/d14/d21/d146/f154 zero size 2023-12-12T11:52:04.423 INFO:tasks.workunit.client.0.smithi063.stdout:1/688: mknod d3/d3a/dd7/d16/d24/d48/d75/d83/d81/cde 0 2023-12-12T11:52:04.423 INFO:tasks.workunit.client.0.smithi063.stdout:6/679: mknod d9/d10/d2a/de7/d86/cf2 0 2023-12-12T11:52:04.423 INFO:tasks.workunit.client.0.smithi063.stdout:6/680: write d9/d10/d25/fe9 [547922,44737] 0 2023-12-12T11:52:04.423 INFO:tasks.workunit.client.0.smithi063.stdout:6/681: truncate d9/d10/d2a/fc7 32801 0 2023-12-12T11:52:04.423 INFO:tasks.workunit.client.0.smithi063.stdout:6/682: chown d9/d10/d5c/c7c 6723556 1 2023-12-12T11:52:04.433 INFO:tasks.workunit.client.0.smithi063.stdout:8/698: creat d4/de/d3b/d62/d36/dc6/fdf x:0 0 0 2023-12-12T11:52:04.442 INFO:tasks.workunit.client.1.smithi093.stdout:3/861: creat df/d22/d49/d69/d78/dad/df2/f118 x:0 0 0 2023-12-12T11:52:04.442 INFO:tasks.workunit.client.1.smithi093.stdout:3/862: write df/f54 [1320021,95403] 0 2023-12-12T11:52:04.452 INFO:tasks.workunit.client.1.smithi093.stdout:8/912: dwrite d3/d1a/d1f/d75/fd0 [0,4194304] 0 2023-12-12T11:52:04.457 INFO:tasks.workunit.client.1.smithi093.stdout:5/742: creat d0/d7/d36/d29/fff x:0 0 0 2023-12-12T11:52:04.464 INFO:tasks.workunit.client.0.smithi063.stdout:3/566: dwrite d4/f76 [4194304,4194304] 0 2023-12-12T11:52:04.465 INFO:tasks.workunit.client.1.smithi093.stdout:2/876: getdents d5/d14/d2d/d12/d25/d7a/d7e/da0 0 2023-12-12T11:52:04.467 INFO:tasks.workunit.client.0.smithi063.stdout:5/661: read d7/f1a [892456,77634] 0 2023-12-12T11:52:04.469 INFO:tasks.workunit.client.0.smithi063.stdout:7/538: mknod de/d34/d43/d45/ccc 0 2023-12-12T11:52:04.470 INFO:tasks.workunit.client.1.smithi093.stdout:1/886: getdents d4/d1a/d83 0 2023-12-12T11:52:04.470 INFO:tasks.workunit.client.1.smithi093.stdout:1/887: chown d4/d1a/d73/dd4/lcf 562 1 2023-12-12T11:52:04.472 INFO:tasks.workunit.client.1.smithi093.stdout:7/835: creat da/d8e/daf/f121 x:0 0 0 2023-12-12T11:52:04.475 INFO:tasks.workunit.client.0.smithi063.stdout:2/552: rename d0/d1a/d26/f44 to d0/d1a/d3a/d85/da6/fb6 0 2023-12-12T11:52:04.475 INFO:tasks.workunit.client.1.smithi093.stdout:9/877: rmdir d1/d23/d24/d89 39 2023-12-12T11:52:04.476 INFO:tasks.workunit.client.1.smithi093.stdout:9/878: chown d1/d23/d6b/fa6 14 1 2023-12-12T11:52:04.481 INFO:tasks.workunit.client.1.smithi093.stdout:0/885: rename d5/dd/d14/d26/d58/dab/ff8 to d5/dd/d33/f114 0 2023-12-12T11:52:04.481 INFO:tasks.workunit.client.1.smithi093.stdout:0/886: chown d5/d21/d27/d3a/d9a/dc8/ld5 2 1 2023-12-12T11:52:04.481 INFO:tasks.workunit.client.1.smithi093.stdout:0/887: readlink d5/d21/d27/d3a/d9a/db5/db8/l4e 0 2023-12-12T11:52:04.486 INFO:tasks.workunit.client.0.smithi063.stdout:9/498: creat d7/d20/d45/fa5 x:0 0 0 2023-12-12T11:52:04.486 INFO:tasks.workunit.client.0.smithi063.stdout:9/499: fdatasync d7/d15/f31 0 2023-12-12T11:52:04.488 INFO:tasks.workunit.client.0.smithi063.stdout:9/500: chown d7/d11/d12/d30/l32 17 1 2023-12-12T11:52:04.489 INFO:tasks.workunit.client.0.smithi063.stdout:1/689: mkdir d3/d3a/d52/ddf 0 2023-12-12T11:52:04.490 INFO:tasks.workunit.client.1.smithi093.stdout:6/999: mkdir d0/d52/d7e/d42/d165 0 2023-12-12T11:52:04.492 INFO:tasks.workunit.client.1.smithi093.stdout:3/863: rmdir df/d22 39 2023-12-12T11:52:04.494 INFO:tasks.workunit.client.0.smithi063.stdout:3/567: creat d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/fae x:0 0 0 2023-12-12T11:52:04.494 INFO:tasks.workunit.client.0.smithi063.stdout:3/568: write d4/df/d1a/d1c/d34/f85 [990376,129882] 0 2023-12-12T11:52:04.494 INFO:tasks.workunit.client.0.smithi063.stdout:3/569: chown d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d56/c87 1 1 2023-12-12T11:52:04.502 INFO:tasks.workunit.client.0.smithi063.stdout:7/539: mkdir de/d34/d68/da1/dcd 0 2023-12-12T11:52:04.502 INFO:tasks.workunit.client.1.smithi093.stdout:8/913: creat d3/d1a/d1f/d29/d30/f12b x:0 0 0 2023-12-12T11:52:04.503 INFO:tasks.workunit.client.0.smithi063.stdout:5/662: dread d7/d10/d2b/f85 [0,4194304] 0 2023-12-12T11:52:04.503 INFO:tasks.workunit.client.0.smithi063.stdout:5/663: fdatasync d7/d10/d2b/f55 0 2023-12-12T11:52:04.503 INFO:tasks.workunit.client.0.smithi063.stdout:0/657: dwrite d0/d1a/d23/d34/d42/fbd [0,4194304] 0 2023-12-12T11:52:04.504 INFO:tasks.workunit.client.0.smithi063.stdout:8/699: dwrite d4/de/f43 [0,4194304] 0 2023-12-12T11:52:04.504 INFO:tasks.workunit.client.0.smithi063.stdout:6/683: dwrite d9/fc6 [0,4194304] 0 2023-12-12T11:52:04.504 INFO:tasks.workunit.client.0.smithi063.stdout:6/684: dread - d9/d68/d8f/fd2 zero size 2023-12-12T11:52:04.505 INFO:tasks.workunit.client.0.smithi063.stdout:6/685: chown d9/d2c/la6 13 1 2023-12-12T11:52:04.505 INFO:tasks.workunit.client.0.smithi063.stdout:6/686: truncate d9/d10/d5c/fac 285935 0 2023-12-12T11:52:04.508 INFO:tasks.workunit.client.0.smithi063.stdout:2/553: creat d0/d1a/d3a/fb7 x:0 0 0 2023-12-12T11:52:04.508 INFO:tasks.workunit.client.0.smithi063.stdout:9/501: write d7/d20/d65/f72 [5014762,128218] 0 2023-12-12T11:52:04.508 INFO:tasks.workunit.client.0.smithi063.stdout:9/502: chown d7/d11/d12/d30/l7e 271849 1 2023-12-12T11:52:04.510 INFO:tasks.workunit.client.1.smithi093.stdout:5/743: symlink d0/dfc/l100 0 2023-12-12T11:52:04.514 INFO:tasks.workunit.client.0.smithi063.stdout:6/687: dread d9/d10/fc9 [0,4194304] 0 2023-12-12T11:52:04.517 INFO:tasks.workunit.client.0.smithi063.stdout:4/663: rename d2/d17/d7f/da2/faf to d2/d47/fd8 0 2023-12-12T11:52:04.519 INFO:tasks.workunit.client.1.smithi093.stdout:2/877: creat d5/d14/d2d/d4c/d54/d67/d69/dde/f129 x:0 0 0 2023-12-12T11:52:04.519 INFO:tasks.workunit.client.1.smithi093.stdout:2/878: chown d5/d14/d2d/d4c/d54/ffe 492025584 1 2023-12-12T11:52:04.519 INFO:tasks.workunit.client.1.smithi093.stdout:2/879: write d5/d31/f64 [3213816,29167] 0 2023-12-12T11:52:04.519 INFO:tasks.workunit.client.1.smithi093.stdout:2/880: fsync d5/d14/d2d/f53 0 2023-12-12T11:52:04.520 INFO:tasks.workunit.client.0.smithi063.stdout:1/690: symlink d3/d3a/d54/le0 0 2023-12-12T11:52:04.523 INFO:tasks.workunit.client.1.smithi093.stdout:3/864: dread df/d22/d49/d69/f6a [0,4194304] 0 2023-12-12T11:52:04.525 INFO:tasks.workunit.client.0.smithi063.stdout:3/570: mknod d4/df/d1a/d1c/d57/caf 0 2023-12-12T11:52:04.528 INFO:tasks.workunit.client.1.smithi093.stdout:8/914: symlink d3/d1a/d1f/d59/d69/dbc/dc2/l12c 0 2023-12-12T11:52:04.528 INFO:tasks.workunit.client.1.smithi093.stdout:1/888: dwrite d4/d1a/d83/d9a/da9/db9/f10b [0,4194304] 0 2023-12-12T11:52:04.528 INFO:tasks.workunit.client.1.smithi093.stdout:1/889: fsync d4/d1c/d2a/f3d 0 2023-12-12T11:52:04.528 INFO:tasks.workunit.client.1.smithi093.stdout:1/890: fdatasync d4/d1a/d73/dd4/dd5/fee 0 2023-12-12T11:52:04.533 INFO:tasks.workunit.client.0.smithi063.stdout:6/688: dread d9/d10/f41 [0,4194304] 0 2023-12-12T11:52:04.533 INFO:tasks.workunit.client.0.smithi063.stdout:6/689: readlink d9/d10/d2a/de7/d86/dc2/lec 0 2023-12-12T11:52:04.535 INFO:tasks.workunit.client.1.smithi093.stdout:5/744: creat d0/d7/d59/d62/f101 x:0 0 0 2023-12-12T11:52:04.535 INFO:tasks.workunit.client.1.smithi093.stdout:5/745: fdatasync d0/dd2/fe2 0 2023-12-12T11:52:04.535 INFO:tasks.workunit.client.1.smithi093.stdout:2/881: mkdir d5/d14/d2d/d12/d25/d7a/d7e/da5/d12a 0 2023-12-12T11:52:04.539 INFO:tasks.workunit.client.1.smithi093.stdout:7/836: getdents da/d8e/daa/dd6 0 2023-12-12T11:52:04.539 INFO:tasks.workunit.client.1.smithi093.stdout:7/837: write da/de/d46/d4f/f56 [774017,109571] 0 2023-12-12T11:52:04.544 INFO:tasks.workunit.client.1.smithi093.stdout:9/879: dwrite d1/d23/f31 [0,4194304] 0 2023-12-12T11:52:04.544 INFO:tasks.workunit.client.1.smithi093.stdout:3/865: creat df/d25/d2c/d85/f119 x:0 0 0 2023-12-12T11:52:04.544 INFO:tasks.workunit.client.1.smithi093.stdout:3/866: dread - df/d22/d49/d69/d78/daf/d3d/d42/d8e/de1/f10a zero size 2023-12-12T11:52:04.544 INFO:tasks.workunit.client.1.smithi093.stdout:3/867: dread - df/d22/d49/d69/d78/daf/d3d/d42/d8e/fb8 zero size 2023-12-12T11:52:04.547 INFO:tasks.workunit.client.0.smithi063.stdout:5/664: unlink d7/d28/d94/fa5 0 2023-12-12T11:52:04.549 INFO:tasks.workunit.client.1.smithi093.stdout:0/888: dwrite d5/dd/d14/d26/d58/d64/ffd [0,4194304] 0 2023-12-12T11:52:04.550 INFO:tasks.workunit.client.0.smithi063.stdout:0/658: mkdir d0/d1a/d23/d2e/dd7 0 2023-12-12T11:52:04.553 INFO:tasks.workunit.client.1.smithi093.stdout:8/915: read d3/d1a/d1f/d29/d3a/d8f/fce [5096699,64496] 0 2023-12-12T11:52:04.553 INFO:tasks.workunit.client.1.smithi093.stdout:8/916: write d3/d1a/d1f/d59/fd8 [250541,89351] 0 2023-12-12T11:52:04.561 INFO:tasks.workunit.client.0.smithi063.stdout:8/700: creat d4/de/d3b/d62/fe0 x:0 0 0 2023-12-12T11:52:04.565 INFO:tasks.workunit.client.1.smithi093.stdout:1/891: dwrite d4/d1a/d1b/d26/f91 [0,4194304] 0 2023-12-12T11:52:04.565 INFO:tasks.workunit.client.1.smithi093.stdout:2/882: mknod d5/d14/d2d/d4c/da1/de4/c12b 0 2023-12-12T11:52:04.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.563+0000 7fbca98cf700 1 -- 172.21.15.63:0/427315765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbca40fde00 msgr2=0x7fbca40fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:04.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.563+0000 7fbca98cf700 1 --2- 172.21.15.63:0/427315765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbca40fde00 0x7fbca40fe250 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbc94004e90 tx=0x7fbc94004990 comp rx=0 tx=0).stop 2023-12-12T11:52:04.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.564+0000 7fbca98cf700 1 -- 172.21.15.63:0/427315765 shutdown_connections 2023-12-12T11:52:04.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.564+0000 7fbca98cf700 1 --2- 172.21.15.63:0/427315765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbca40fde00 0x7fbca40fe250 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:04.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.564+0000 7fbca98cf700 1 --2- 172.21.15.63:0/427315765 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbca40fcbf0 0x7fbca40fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:04.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.564+0000 7fbca98cf700 1 -- 172.21.15.63:0/427315765 >> 172.21.15.63:0/427315765 conn(0x7fbca40f82d0 msgr2=0x7fbca40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:52:04.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.564+0000 7fbca98cf700 1 -- 172.21.15.63:0/427315765 shutdown_connections 2023-12-12T11:52:04.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.564+0000 7fbca98cf700 1 -- 172.21.15.63:0/427315765 wait complete. 2023-12-12T11:52:04.567 INFO:tasks.workunit.client.0.smithi063.stdout:2/554: dwrite d0/d1a/d1e/d64/f68 [0,4194304] 0 2023-12-12T11:52:04.567 INFO:tasks.workunit.client.0.smithi063.stdout:2/555: dread - d0/d41/fa7 zero size 2023-12-12T11:52:04.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.565+0000 7fbca98cf700 1 Processor -- start 2023-12-12T11:52:04.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.565+0000 7fbca98cf700 1 -- start start 2023-12-12T11:52:04.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.566+0000 7fbca98cf700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbca40fcbf0 0x7fbca4113ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:04.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.566+0000 7fbca98cf700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbca40fde00 0x7fbca4114000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:04.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.566+0000 7fbca98cf700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca4114600 con 0x7fbca40fcbf0 2023-12-12T11:52:04.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.566+0000 7fbca98cf700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca4114ea0 con 0x7fbca40fde00 2023-12-12T11:52:04.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.567+0000 7fbca2ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbca40fcbf0 0x7fbca4113ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:04.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.567+0000 7fbca2ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbca40fcbf0 0x7fbca4113ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59772/0 (socket says 172.21.15.63:59772) 2023-12-12T11:52:04.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.567+0000 7fbca2ffd700 1 -- 172.21.15.63:0/3679428897 learned_addr learned my addr 172.21.15.63:0/3679428897 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:52:04.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.569+0000 7fbca2ffd700 1 -- 172.21.15.63:0/3679428897 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbca40fde00 msgr2=0x7fbca4114000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:04.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.569+0000 7fbca2ffd700 1 --2- 172.21.15.63:0/3679428897 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbca40fde00 0x7fbca4114000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:04.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.569+0000 7fbca2ffd700 1 -- 172.21.15.63:0/3679428897 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc94005040 con 0x7fbca40fcbf0 2023-12-12T11:52:04.572 INFO:tasks.workunit.client.0.smithi063.stdout:9/503: mknod d7/d11/d12/d30/d3e/d55/ca6 0 2023-12-12T11:52:04.573 INFO:tasks.workunit.client.1.smithi093.stdout:2/883: dread d5/d14/d2d/d4c/fba [0,4194304] 0 2023-12-12T11:52:04.574 INFO:tasks.workunit.client.1.smithi093.stdout:7/838: getdents da/de/d100 0 2023-12-12T11:52:04.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.570+0000 7fbca2ffd700 1 --2- 172.21.15.63:0/3679428897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbca40fcbf0 0x7fbca4113ac0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c002a80 tx=0x7fbc8c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:52:04.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.572+0000 7fbc9b7fe700 1 -- 172.21.15.63:0/3679428897 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc8c007cc0 con 0x7fbca40fcbf0 2023-12-12T11:52:04.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.572+0000 7fbc9b7fe700 1 -- 172.21.15.63:0/3679428897 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbc8c00f040 con 0x7fbca40fcbf0 2023-12-12T11:52:04.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.572+0000 7fbc9b7fe700 1 -- 172.21.15.63:0/3679428897 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc8c00da20 con 0x7fbca40fcbf0 2023-12-12T11:52:04.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.574+0000 7fbca98cf700 1 -- 172.21.15.63:0/3679428897 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca4115180 con 0x7fbca40fcbf0 2023-12-12T11:52:04.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.574+0000 7fbca98cf700 1 -- 172.21.15.63:0/3679428897 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca41156c0 con 0x7fbca40fcbf0 2023-12-12T11:52:04.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.575+0000 7fbca98cf700 1 -- 172.21.15.63:0/3679428897 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca404bb80 con 0x7fbca40fcbf0 2023-12-12T11:52:04.582 INFO:tasks.workunit.client.0.smithi063.stdout:4/664: truncate d2/f56 1341845 0 2023-12-12T11:52:04.584 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.579+0000 7fbc9b7fe700 1 -- 172.21.15.63:0/3679428897 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 24) v1 ==== 88724+0+0 (secure 0 0 0) 0x7fbc8c00db80 con 0x7fbca40fcbf0 2023-12-12T11:52:04.584 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.581+0000 7fbc9b7fe700 1 --2- 172.21.15.63:0/3679428897 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7fbc9006ae40 0x7fbc9006d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:04.584 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.581+0000 7fbc9b7fe700 1 -- 172.21.15.63:0/3679428897 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fbc8c089320 con 0x7fbca40fcbf0 2023-12-12T11:52:04.584 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.582+0000 7fbca27fc700 1 --2- 172.21.15.63:0/3679428897 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7fbc9006ae40 0x7fbc9006d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:04.585 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.582+0000 7fbca27fc700 1 --2- 172.21.15.63:0/3679428897 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7fbc9006ae40 0x7fbc9006d2f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbc94005010 tx=0x7fbc94004990 comp rx=0 tx=0).ready entity=mgr.24471 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:52:04.585 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:04.582+0000 7fbc9b7fe700 1 -- 172.21.15.63:0/3679428897 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fbc8c057190 con 0x7fbca40fcbf0 2023-12-12T11:52:04.591 INFO:tasks.workunit.client.0.smithi063.stdout:1/691: mknod d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/ce1 0 2023-12-12T11:52:04.601 INFO:tasks.workunit.client.1.smithi093.stdout:0/889: link d5/dd/d14/c17 d5/dd/d14/c115 0 2023-12-12T11:52:04.608 INFO:tasks.workunit.client.0.smithi063.stdout:6/690: link d9/d10/d5c/c7c d9/d10/d5c/d5e/cf3 0 2023-12-12T11:52:04.611 INFO:tasks.workunit.client.0.smithi063.stdout:5/665: mknod d7/d28/cc8 0 2023-12-12T11:52:04.616 INFO:tasks.workunit.client.0.smithi063.stdout:8/701: symlink d4/de/d3b/d62/d6e/d76/d93/le1 0 2023-12-12T11:52:04.619 INFO:tasks.workunit.client.1.smithi093.stdout:1/892: rename d4/d1c/l5e to d4/l127 0 2023-12-12T11:52:04.626 INFO:tasks.workunit.client.0.smithi063.stdout:7/540: dwrite de/d22/d2b/d61/f73 [0,4194304] 0 2023-12-12T11:52:04.626 INFO:tasks.workunit.client.0.smithi063.stdout:7/541: truncate de/d33/d41/d44/d8b/f8f 1133613 0 2023-12-12T11:52:04.628 INFO:tasks.workunit.client.1.smithi093.stdout:2/884: unlink d5/d14/d2d/d12/d25/l3e 0 2023-12-12T11:52:04.628 INFO:tasks.workunit.client.1.smithi093.stdout:8/917: dwrite d3/d1a/d1f/d29/d30/f103 [0,4194304] 0 2023-12-12T11:52:04.628 INFO:tasks.workunit.client.1.smithi093.stdout:8/918: readlink d3/d1a/d1f/d59/d69/dbc/dc2/lc8 0 2023-12-12T11:52:04.628 INFO:tasks.workunit.client.1.smithi093.stdout:8/919: stat d3/d1a/d1f/d75/f9f 0 2023-12-12T11:52:04.630 INFO:tasks.workunit.client.1.smithi093.stdout:7/839: mkdir da/d8e/da9/d122 0 2023-12-12T11:52:04.630 INFO:tasks.workunit.client.1.smithi093.stdout:9/880: dwrite d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/f3b [8388608,4194304] 0 2023-12-12T11:52:04.630 INFO:tasks.workunit.client.1.smithi093.stdout:9/881: chown d1/d23/d24/dfd 4700907 1 2023-12-12T11:52:04.632 INFO:tasks.workunit.client.1.smithi093.stdout:5/746: dwrite d0/d7/d36/db9/d66/d7c/db5/dcc/fb1 [0,4194304] 0 2023-12-12T11:52:04.633 INFO:tasks.workunit.client.1.smithi093.stdout:5/747: chown d0/d7/d36/db9/dca 88 1 2023-12-12T11:52:04.633 INFO:tasks.workunit.client.0.smithi063.stdout:2/556: creat d0/d1a/fb8 x:0 0 0 2023-12-12T11:52:04.633 INFO:tasks.workunit.client.0.smithi063.stdout:2/557: chown d0/d1a/d1e/l36 4398240 1 2023-12-12T11:52:04.636 INFO:tasks.workunit.client.1.smithi093.stdout:0/890: mkdir d5/dd/d14/d26/d58/dab/d116 0 2023-12-12T11:52:04.636 INFO:tasks.workunit.client.1.smithi093.stdout:0/891: stat d5/dd/d14/d26/d58/d64/c105 0 2023-12-12T11:52:04.636 INFO:tasks.workunit.client.1.smithi093.stdout:0/892: readlink d5/dd/d14/d26/lc0 0 2023-12-12T11:52:04.636 INFO:tasks.workunit.client.0.smithi063.stdout:9/504: mkdir d7/d20/d3f/d40/da7 0 2023-12-12T11:52:04.637 INFO:tasks.workunit.client.0.smithi063.stdout:9/505: write d7/d11/d12/f3d [3802295,99707] 0 2023-12-12T11:52:04.637 INFO:tasks.workunit.client.0.smithi063.stdout:9/506: fdatasync d7/d11/d12/f60 0 2023-12-12T11:52:04.638 INFO:tasks.workunit.client.1.smithi093.stdout:3/868: dwrite df/fee [0,4194304] 0 2023-12-12T11:52:04.648 INFO:tasks.workunit.client.0.smithi063.stdout:7/542: dread de/d22/d66/fb2 [0,4194304] 0 2023-12-12T11:52:04.648 INFO:tasks.workunit.client.0.smithi063.stdout:1/692: rename d3/d3a/dd7/d16/d24/d48/d75/d83/d5b/d6b/d6d to d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2 0 2023-12-12T11:52:04.648 INFO:tasks.workunit.client.0.smithi063.stdout:1/693: readlink d3/d3a/dd7/d16/d24/d48/d75/d83/l7b 0 2023-12-12T11:52:04.648 INFO:tasks.workunit.client.0.smithi063.stdout:7/543: fsync de/f21 0 2023-12-12T11:52:04.649 INFO:tasks.workunit.client.0.smithi063.stdout:7/544: chown de/d22/d6e/da2/cbd 1613030 1 2023-12-12T11:52:04.649 INFO:tasks.workunit.client.0.smithi063.stdout:0/659: dwrite d0/d1a/d23/fbe [0,4194304] 0 2023-12-12T11:52:04.652 INFO:tasks.workunit.client.0.smithi063.stdout:3/571: getdents d4/df/d1a/d1c/d34 0 2023-12-12T11:52:04.652 INFO:tasks.workunit.client.0.smithi063.stdout:3/572: chown d4/f44 14089 1 2023-12-12T11:52:04.655 INFO:tasks.workunit.client.1.smithi093.stdout:8/920: truncate d3/d1a/d1f/fbb 2522952 0 2023-12-12T11:52:04.657 INFO:tasks.workunit.client.0.smithi063.stdout:5/666: truncate d7/d28/d6e/f39 1609696 0 2023-12-12T11:52:04.660 INFO:tasks.workunit.client.0.smithi063.stdout:8/702: mkdir d4/d24/d38/ddc/de2 0 2023-12-12T11:52:04.660 INFO:tasks.workunit.client.0.smithi063.stdout:8/703: fsync d4/d55/d52/f71 0 2023-12-12T11:52:04.661 INFO:tasks.workunit.client.1.smithi093.stdout:9/882: truncate d1/d23/d24/d29/d43/d56/d85/fc2 941074 0 2023-12-12T11:52:04.661 INFO:tasks.workunit.client.1.smithi093.stdout:9/883: creat d1/d23/d6b/d92/db2/f129 x:0 0 0 2023-12-12T11:52:04.662 INFO:tasks.workunit.client.0.smithi063.stdout:6/691: dread d9/d68/fc4 [0,4194304] 0 2023-12-12T11:52:04.671 INFO:tasks.workunit.client.1.smithi093.stdout:9/884: dread d1/d23/d6b/d92/d9f/fdc [0,4194304] 0 2023-12-12T11:52:04.673 INFO:tasks.workunit.client.0.smithi063.stdout:9/507: symlink d7/d20/d3f/d40/da7/la8 0 2023-12-12T11:52:04.673 INFO:tasks.workunit.client.0.smithi063.stdout:9/508: truncate d7/d11/d12/f60 982920 0 2023-12-12T11:52:04.673 INFO:tasks.workunit.client.0.smithi063.stdout:9/509: truncate d7/d15/d39/f82 288527 0 2023-12-12T11:52:04.673 INFO:tasks.workunit.client.0.smithi063.stdout:9/510: chown d7/ff 84 1 2023-12-12T11:52:04.673 INFO:tasks.workunit.client.0.smithi063.stdout:9/511: chown d7/d20/d3f/d40/d4e/f8d 9787 1 2023-12-12T11:52:04.675 INFO:tasks.workunit.client.0.smithi063.stdout:4/665: dwrite d2/d47/d6d/d88/fa6 [0,4194304] 0 2023-12-12T11:52:04.678 INFO:tasks.workunit.client.1.smithi093.stdout:1/893: dwrite d4/d1a/d1b/d26/f91 [0,4194304] 0 2023-12-12T11:52:04.679 INFO:tasks.workunit.client.0.smithi063.stdout:1/694: rmdir d3/d3a/dd7/d16/d24/d48 39 2023-12-12T11:52:04.680 INFO:tasks.workunit.client.0.smithi063.stdout:7/545: truncate fb 158492 0 2023-12-12T11:52:04.681 INFO:tasks.workunit.client.0.smithi063.stdout:7/546: stat de/d22/d66 0 2023-12-12T11:52:04.681 INFO:tasks.workunit.client.1.smithi093.stdout:2/885: dwrite d5/d14/d2d/d12/f2c [0,4194304] 0 2023-12-12T11:52:04.689 INFO:tasks.workunit.client.0.smithi063.stdout:9/512: dread d7/d15/f63 [0,4194304] 0 2023-12-12T11:52:04.691 INFO:tasks.workunit.client.0.smithi063.stdout:2/558: dwrite d0/d1a/d3a/d85/fad [0,4194304] 0 2023-12-12T11:52:04.691 INFO:tasks.workunit.client.0.smithi063.stdout:2/559: fdatasync d0/d1a/d1e/f60 0 2023-12-12T11:52:04.693 INFO:tasks.workunit.client.1.smithi093.stdout:8/921: creat d3/d1a/d1f/d59/d69/f12d x:0 0 0 2023-12-12T11:52:04.695 INFO:tasks.workunit.client.0.smithi063.stdout:0/660: rmdir d0/d7/d27/d44 39 2023-12-12T11:52:04.697 INFO:tasks.workunit.client.1.smithi093.stdout:7/840: rename da/d15/d19/c11f to da/d15/c123 0 2023-12-12T11:52:04.701 INFO:tasks.workunit.client.0.smithi063.stdout:3/573: link d4/df/d1a/c91 d4/d23/d6b/d90/cb0 0 2023-12-12T11:52:04.702 INFO:tasks.workunit.client.0.smithi063.stdout:3/574: chown d4/df/d1a/d1c/d3b/d52/d78/da5 12007549 1 2023-12-12T11:52:04.703 INFO:tasks.workunit.client.0.smithi063.stdout:2/560: write d0/d1a/d26/f29 [635221,26789] 0 2023-12-12T11:52:04.703 INFO:tasks.workunit.client.0.smithi063.stdout:2/561: write d0/fb3 [454370,114039] 0 2023-12-12T11:52:04.703 INFO:tasks.workunit.client.0.smithi063.stdout:2/562: fdatasync d0/d1a/d48/f4a 0 2023-12-12T11:52:04.708 INFO:tasks.workunit.client.0.smithi063.stdout:9/513: fsync d7/d11/f25 0 2023-12-12T11:52:04.735 INFO:tasks.workunit.client.1.smithi093.stdout:9/885: dwrite d1/d23/d24/d29/d43/f51 [0,4194304] 0 2023-12-12T11:52:04.736 INFO:tasks.workunit.client.1.smithi093.stdout:9/886: creat d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/d42/dd3/f12a x:0 0 0 2023-12-12T11:52:04.740 INFO:tasks.workunit.client.1.smithi093.stdout:5/748: mknod d0/d7/d36/db9/c102 0 2023-12-12T11:52:04.740 INFO:tasks.workunit.client.1.smithi093.stdout:1/894: mkdir d4/dc/d128 0 2023-12-12T11:52:04.740 INFO:tasks.workunit.client.1.smithi093.stdout:5/749: dread - d0/d7/d8/d9e/f78 zero size 2023-12-12T11:52:04.746 INFO:tasks.workunit.client.1.smithi093.stdout:7/841: dread da/d15/d19/d90/d7d/f88 [4194304,4194304] 0 2023-12-12T11:52:04.746 INFO:tasks.workunit.client.1.smithi093.stdout:7/842: chown da/d8e/daa/c11b 763 1 2023-12-12T11:52:04.749 INFO:tasks.workunit.client.1.smithi093.stdout:2/886: dwrite d5/f19 [0,4194304] 0 2023-12-12T11:52:04.749 INFO:tasks.workunit.client.1.smithi093.stdout:2/887: readlink d5/d14/d2d/d12/d44/l78 0 2023-12-12T11:52:04.754 INFO:tasks.workunit.client.1.smithi093.stdout:9/887: write d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d5c/f88 [2311197,130922] 0 2023-12-12T11:52:04.759 INFO:tasks.workunit.client.0.smithi063.stdout:0/661: read d0/d7/d27/d19/f86 [15659,26302] 0 2023-12-12T11:52:04.760 INFO:tasks.workunit.client.0.smithi063.stdout:0/662: chown d0/d1a/d23/d34 2789540 1 2023-12-12T11:52:04.760 INFO:tasks.workunit.client.0.smithi063.stdout:0/663: chown d0/d7/d27/d1f/cc2 37296 1 2023-12-12T11:52:04.760 INFO:tasks.workunit.client.0.smithi063.stdout:5/667: getdents d7/d28/d43/d49 0 2023-12-12T11:52:04.760 INFO:tasks.workunit.client.0.smithi063.stdout:8/704: truncate d4/de/d3b/d62/d36/f73 158941 0 2023-12-12T11:52:04.760 INFO:tasks.workunit.client.0.smithi063.stdout:8/705: write d4/de/d3b/d62/d36/d57/d84/fbc [2153415,18321] 0 2023-12-12T11:52:04.760 INFO:tasks.workunit.client.0.smithi063.stdout:8/706: chown d4/de/d3b/d62/d6e/d76/f8b 0 1 2023-12-12T11:52:04.765 INFO:tasks.workunit.client.0.smithi063.stdout:4/666: truncate d2/d48/d69/d98/fad 475986 0 2023-12-12T11:52:04.765 INFO:tasks.workunit.client.0.smithi063.stdout:6/692: rename d9/d2c/la6 to d9/d10/d73/db8/lf4 0 2023-12-12T11:52:04.765 INFO:tasks.workunit.client.0.smithi063.stdout:6/693: fdatasync d9/d10/d2a/de7/f72 0 2023-12-12T11:52:04.765 INFO:tasks.workunit.client.0.smithi063.stdout:7/547: unlink de/c5b 0 2023-12-12T11:52:04.765 INFO:tasks.workunit.client.0.smithi063.stdout:1/695: creat d3/d3a/dd7/d16/d24/d48/d75/d83/fe3 x:0 0 0 2023-12-12T11:52:04.782 INFO:tasks.workunit.client.1.smithi093.stdout:1/895: creat d4/d1a/d1b/d26/d65/dc8/f129 x:0 0 0 2023-12-12T11:52:04.782 INFO:tasks.workunit.client.1.smithi093.stdout:5/750: symlink d0/d7/d36/d38/dce/l103 0 2023-12-12T11:52:04.783 INFO:tasks.workunit.client.1.smithi093.stdout:5/751: chown d0/d7/d36/d68/f7a 995127 1 2023-12-12T11:52:04.791 INFO:tasks.workunit.client.0.smithi063.stdout:0/664: creat d0/d7/d27/d1f/dc4/d67/fd8 x:0 0 0 2023-12-12T11:52:04.792 INFO:tasks.workunit.client.0.smithi063.stdout:5/668: getdents d7/d28/d67 0 2023-12-12T11:52:04.797 INFO:tasks.workunit.client.1.smithi093.stdout:2/888: dwrite d5/d14/d2d/d4c/d54/dc5/d55/f60 [0,4194304] 0 2023-12-12T11:52:04.799 INFO:tasks.workunit.client.0.smithi063.stdout:8/707: rename d4/d24/f5f to d4/d24/db3/fe3 0 2023-12-12T11:52:04.799 INFO:tasks.workunit.client.0.smithi063.stdout:8/708: readlink d4/d24/lbd 0 2023-12-12T11:52:04.803 INFO:tasks.workunit.client.0.smithi063.stdout:7/548: creat de/d22/d2b/d4a/fce x:0 0 0 2023-12-12T11:52:04.806 INFO:tasks.workunit.client.1.smithi093.stdout:8/922: rmdir d3/d1a/d1f/d29/d3a/d68 39 2023-12-12T11:52:04.807 INFO:tasks.workunit.client.1.smithi093.stdout:1/896: creat d4/dc/d7a/d9c/da7/f12a x:0 0 0 2023-12-12T11:52:04.808 INFO:tasks.workunit.client.1.smithi093.stdout:1/897: creat d4/d1a/d1b/d26/d31/ddb/f12b x:0 0 0 2023-12-12T11:52:04.809 INFO:tasks.workunit.client.0.smithi063.stdout:9/514: write d7/d20/d3f/d40/d4e/f9f [235989,118330] 0 2023-12-12T11:52:04.809 INFO:tasks.workunit.client.1.smithi093.stdout:5/752: symlink d0/d7/d8/l104 0 2023-12-12T11:52:04.817 INFO:tasks.workunit.client.0.smithi063.stdout:8/709: creat d4/de/d3b/d62/d6e/d76/d93/fe4 x:0 0 0 2023-12-12T11:52:04.817 INFO:tasks.workunit.client.0.smithi063.stdout:8/710: fsync d4/d24/d38/f88 0 2023-12-12T11:52:04.820 INFO:tasks.workunit.client.1.smithi093.stdout:7/843: rmdir da/d8e 39 2023-12-12T11:52:04.822 INFO:tasks.workunit.client.0.smithi063.stdout:9/515: dread d7/d11/d12/d30/d3e/d55/f81 [0,4194304] 0 2023-12-12T11:52:04.822 INFO:tasks.workunit.client.0.smithi063.stdout:5/669: rename d7/d28/d67/f87 to d7/d28/d6e/dad/dba/fc9 0 2023-12-12T11:52:04.822 INFO:tasks.workunit.client.0.smithi063.stdout:5/670: fsync d7/de/f25 0 2023-12-12T11:52:04.823 INFO:tasks.workunit.client.0.smithi063.stdout:4/667: dwrite d2/d48/d4f/fa3 [0,4194304] 0 2023-12-12T11:52:04.823 INFO:tasks.workunit.client.0.smithi063.stdout:4/668: write d2/d47/d6d/d88/fa0 [702367,42034] 0 2023-12-12T11:52:04.826 INFO:tasks.workunit.client.0.smithi063.stdout:7/549: mknod de/d34/d68/ccf 0 2023-12-12T11:52:04.826 INFO:tasks.workunit.client.0.smithi063.stdout:7/550: read - de/d22/fc0 zero size 2023-12-12T11:52:04.826 INFO:tasks.workunit.client.0.smithi063.stdout:7/551: creat de/d39/d60/d97/daf/fd0 x:0 0 0 2023-12-12T11:52:04.826 INFO:tasks.workunit.client.0.smithi063.stdout:7/552: chown de/d22/d6e/da2 131 1 2023-12-12T11:52:04.828 INFO:tasks.workunit.client.0.smithi063.stdout:0/665: rmdir d0/d1a/d23/d34/d42/d99 39 2023-12-12T11:52:04.830 INFO:tasks.workunit.client.1.smithi093.stdout:2/889: rename d5/d14/d2d/d12/f59 to d5/d14/d2d/d4c/d54/d67/f12c 0 2023-12-12T11:52:04.832 INFO:tasks.workunit.client.1.smithi093.stdout:0/893: sync 2023-12-12T11:52:04.832 INFO:tasks.workunit.client.1.smithi093.stdout:3/869: sync 2023-12-12T11:52:04.833 INFO:tasks.workunit.client.0.smithi063.stdout:8/711: creat d4/de/d3b/d62/d6e/fe5 x:0 0 0 2023-12-12T11:52:04.835 INFO:tasks.workunit.client.1.smithi093.stdout:9/888: rmdir d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/dc0 39 2023-12-12T11:52:04.835 INFO:tasks.workunit.client.0.smithi063.stdout:3/575: dwrite d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/f9e [0,4194304] 0 2023-12-12T11:52:04.840 INFO:tasks.workunit.client.1.smithi093.stdout:8/923: mkdir d3/d1a/d1f/d29/d30/d58/d76/d12e 0 2023-12-12T11:52:04.841 INFO:tasks.workunit.client.0.smithi063.stdout:9/516: symlink d7/d20/d3f/d40/d76/la9 0 2023-12-12T11:52:04.842 INFO:tasks.workunit.client.0.smithi063.stdout:5/671: unlink d7/l71 0 2023-12-12T11:52:04.842 INFO:tasks.workunit.client.0.smithi063.stdout:5/672: chown d7/d10/f48 2 1 2023-12-12T11:52:04.849 INFO:tasks.workunit.client.0.smithi063.stdout:1/696: dwrite d3/fb1 [0,4194304] 0 2023-12-12T11:52:04.849 INFO:tasks.workunit.client.0.smithi063.stdout:4/669: mkdir d2/d17/d4e/dd9 0 2023-12-12T11:52:04.850 INFO:tasks.workunit.client.1.smithi093.stdout:1/898: mkdir d4/d1a/d83/d9a/da9/d12c 0 2023-12-12T11:52:04.856 INFO:tasks.workunit.client.0.smithi063.stdout:7/553: creat de/d39/d60/fd1 x:0 0 0 2023-12-12T11:52:04.856 INFO:tasks.workunit.client.0.smithi063.stdout:7/554: readlink de/d22/d4d/lc9 0 2023-12-12T11:52:04.857 INFO:tasks.workunit.client.1.smithi093.stdout:7/844: rename da/d15/d19/d4c/d6d/lc0 to da/de/d46/l124 0 2023-12-12T11:52:04.859 INFO:tasks.workunit.client.1.smithi093.stdout:5/753: dwrite d0/d7/d8/de/f28 [4194304,4194304] 0 2023-12-12T11:52:04.859 INFO:tasks.workunit.client.0.smithi063.stdout:0/666: unlink d0/d1a/d23/d34/f70 0 2023-12-12T11:52:04.861 INFO:tasks.workunit.client.1.smithi093.stdout:2/890: creat d5/d14/d2d/d12/de9/f12d x:0 0 0 2023-12-12T11:52:04.861 INFO:tasks.workunit.client.1.smithi093.stdout:2/891: chown d5/d14/d2d/d12/d44/df9 5 1 2023-12-12T11:52:04.862 INFO:tasks.workunit.client.0.smithi063.stdout:8/712: rename d4/d24/f96 to d4/de/d3b/d62/d36/dc6/fe6 0 2023-12-12T11:52:04.863 INFO:tasks.workunit.client.1.smithi093.stdout:3/870: rmdir df/d22/d49/d69/d78/db9/dbe 39 2023-12-12T11:52:04.864 INFO:tasks.workunit.client.1.smithi093.stdout:0/894: dwrite d5/dd/d14/d26/d58/d64/d6f/d90/fe0 [0,4194304] 0 2023-12-12T11:52:04.864 INFO:tasks.workunit.client.1.smithi093.stdout:2/892: read d5/d14/d2d/d4c/d54/d67/d69/dde/fd1 [55923,31502] 0 2023-12-12T11:52:04.864 INFO:tasks.workunit.client.1.smithi093.stdout:2/893: write d5/d14/d2d/d12/d25/d7a/f81 [1752342,57510] 0 2023-12-12T11:52:04.864 INFO:tasks.workunit.client.1.smithi093.stdout:2/894: chown d5/d14/d2d/d12/d25/d7a/d7e/dc9/f11c 235658 1 2023-12-12T11:52:04.864 INFO:tasks.workunit.client.1.smithi093.stdout:2/895: write d5/d14/d2d/d12/d25/d7a/d7e/da5/f101 [523191,95706] 0 2023-12-12T11:52:04.865 INFO:tasks.workunit.client.1.smithi093.stdout:9/889: creat d1/f12b x:0 0 0 2023-12-12T11:52:04.868 INFO:tasks.workunit.client.0.smithi063.stdout:3/576: symlink d4/df/d1a/d1c/d3b/d52/d74/lb1 0 2023-12-12T11:52:04.869 INFO:tasks.workunit.client.0.smithi063.stdout:9/517: unlink d7/d20/d45/f57 0 2023-12-12T11:52:04.870 INFO:tasks.workunit.client.1.smithi093.stdout:1/899: rename d4/d1a/f5f to d4/d1a/d1b/d26/d31/ddb/f12d 0 2023-12-12T11:52:04.874 INFO:tasks.workunit.client.1.smithi093.stdout:7/845: truncate da/d15/f16 516672 0 2023-12-12T11:52:04.877 INFO:tasks.workunit.client.0.smithi063.stdout:5/673: symlink d7/d10/d2b/d3c/d5a/dbb/lca 0 2023-12-12T11:52:04.877 INFO:tasks.workunit.client.0.smithi063.stdout:5/674: fdatasync d7/d28/f47 0 2023-12-12T11:52:04.884 INFO:tasks.workunit.client.0.smithi063.stdout:1/697: creat d3/d3a/dd7/d16/d17/d4b/fe4 x:0 0 0 2023-12-12T11:52:04.886 INFO:tasks.workunit.client.1.smithi093.stdout:3/871: creat df/d22/d49/d69/d78/daf/d3d/d42/f11a x:0 0 0 2023-12-12T11:52:04.886 INFO:tasks.workunit.client.1.smithi093.stdout:3/872: write df/d22/d49/d69/d78/daf/d3d/f114 [235467,83276] 0 2023-12-12T11:52:04.888 INFO:tasks.workunit.client.1.smithi093.stdout:0/895: mknod d5/d41/d77/d79/df2/d111/c117 0 2023-12-12T11:52:04.891 INFO:tasks.workunit.client.1.smithi093.stdout:2/896: getdents d5/d14/d2d/d96 0 2023-12-12T11:52:04.894 INFO:tasks.workunit.client.0.smithi063.stdout:4/670: symlink d2/d47/d6d/lda 0 2023-12-12T11:52:04.894 INFO:tasks.workunit.client.0.smithi063.stdout:4/671: fsync d2/fc6 0 2023-12-12T11:52:04.894 INFO:tasks.workunit.client.0.smithi063.stdout:0/667: creat d0/fd9 x:0 0 0 2023-12-12T11:52:04.894 INFO:tasks.workunit.client.1.smithi093.stdout:3/873: dread df/d22/d49/d69/d78/daf/d3d/d6f/fd5 [0,4194304] 0 2023-12-12T11:52:04.895 INFO:tasks.workunit.client.1.smithi093.stdout:8/924: rmdir d3/d1a/d1f/d59/d69 39 2023-12-12T11:52:04.905 INFO:tasks.workunit.client.1.smithi093.stdout:7/846: stat da/c73 0 2023-12-12T11:52:04.905 INFO:tasks.workunit.client.1.smithi093.stdout:9/890: rename d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/lf8 to d1/d23/d6b/d92/d9f/l12c 0 2023-12-12T11:52:04.909 INFO:tasks.workunit.client.1.smithi093.stdout:7/847: read da/d15/d2d/f51 [269375,73848] 0 2023-12-12T11:52:04.909 INFO:tasks.workunit.client.1.smithi093.stdout:7/848: readlink da/d2e/d89/la3 0 2023-12-12T11:52:04.918 INFO:tasks.workunit.client.1.smithi093.stdout:5/754: rmdir d0/d7/d36/d29/d76 39 2023-12-12T11:52:04.918 INFO:tasks.workunit.client.1.smithi093.stdout:5/755: write d0/d7/d36/d29/d44/fae [1775976,30236] 0 2023-12-12T11:52:04.918 INFO:tasks.workunit.client.1.smithi093.stdout:5/756: readlink d0/d7/d36/d38/dce/l103 0 2023-12-12T11:52:04.923 INFO:tasks.workunit.client.1.smithi093.stdout:2/897: truncate d5/d14/d2d/d4c/d76/dc6/d118/f5b 2064622 0 2023-12-12T11:52:04.926 INFO:tasks.workunit.client.0.smithi063.stdout:8/713: unlink d4/de/d3b/d62/d36/d7f/fa5 0 2023-12-12T11:52:04.926 INFO:tasks.workunit.client.0.smithi063.stdout:8/714: truncate d4/d55/d52/d8e/fc1 95067 0 2023-12-12T11:52:04.933 INFO:tasks.workunit.client.0.smithi063.stdout:4/672: mknod d2/d17/d7f/da2/cdb 0 2023-12-12T11:52:04.933 INFO:tasks.workunit.client.0.smithi063.stdout:4/673: dread - d2/d48/f6e zero size 2023-12-12T11:52:04.933 INFO:tasks.workunit.client.0.smithi063.stdout:4/674: fdatasync d2/d48/d4f/fa3 0 2023-12-12T11:52:04.938 INFO:tasks.workunit.client.0.smithi063.stdout:3/577: dwrite d4/df/d1a/d1c/d3b/d50/d9f/fa9 [0,4194304] 0 2023-12-12T11:52:04.938 INFO:tasks.workunit.client.0.smithi063.stdout:3/578: write d4/df/d1a/d1c/d3b/d50/f97 [1535165,22155] 0 2023-12-12T11:52:04.941 INFO:tasks.workunit.client.0.smithi063.stdout:9/518: dwrite d7/d11/d12/d30/f48 [0,4194304] 0 2023-12-12T11:52:04.941 INFO:tasks.workunit.client.0.smithi063.stdout:9/519: fdatasync d7/d15/d39/f47 0 2023-12-12T11:52:04.941 INFO:tasks.workunit.client.1.smithi093.stdout:3/874: getdents df/d25/d6b 0 2023-12-12T11:52:04.945 INFO:tasks.workunit.client.1.smithi093.stdout:7/849: dread da/d15/d19/f7c [0,4194304] 0 2023-12-12T11:52:04.950 INFO:tasks.workunit.client.1.smithi093.stdout:8/925: symlink d3/d1a/d1f/d29/d3a/d68/l12f 0 2023-12-12T11:52:04.955 INFO:tasks.workunit.client.0.smithi063.stdout:8/715: creat d4/de/d3b/d62/d36/d7f/fe7 x:0 0 0 2023-12-12T11:52:04.955 INFO:tasks.workunit.client.0.smithi063.stdout:8/716: chown d4/de/d3b/d62/d91/l99 3 1 2023-12-12T11:52:04.955 INFO:tasks.workunit.client.0.smithi063.stdout:8/717: stat d4/de/d11/fcc 0 2023-12-12T11:52:04.955 INFO:tasks.workunit.client.0.smithi063.stdout:8/718: truncate d4/de/d3b/d62/d6e/fe5 378438 0 2023-12-12T11:52:04.955 INFO:tasks.workunit.client.0.smithi063.stdout:8/719: readlink d4/d24/d38/d45/d5b/l98 0 2023-12-12T11:52:04.958 INFO:tasks.workunit.client.1.smithi093.stdout:9/891: symlink d1/d23/d24/d29/d43/l12d 0 2023-12-12T11:52:04.958 INFO:tasks.workunit.client.1.smithi093.stdout:9/892: creat d1/d23/d24/d29/d43/d58/f12e x:0 0 0 2023-12-12T11:52:04.958 INFO:tasks.workunit.client.0.smithi063.stdout:5/675: dwrite d7/d10/d2b/d3c/d42/d62/fa1 [0,4194304] 0 2023-12-12T11:52:04.958 INFO:tasks.workunit.client.0.smithi063.stdout:5/676: readlink d7/d10/d2b/d3c/l75 0 2023-12-12T11:52:04.959 INFO:tasks.workunit.client.0.smithi063.stdout:5/677: write d7/d10/d2b/d3c/d42/d62/d69/fbf [807778,127303] 0 2023-12-12T11:52:04.960 INFO:tasks.workunit.client.0.smithi063.stdout:7/555: rename de/d22/d2b to de/d33/dd2 0 2023-12-12T11:52:04.963 INFO:tasks.workunit.client.0.smithi063.stdout:0/668: read d0/d7/d27/f90 [1767881,78876] 0 2023-12-12T11:52:04.965 INFO:tasks.workunit.client.1.smithi093.stdout:2/898: dwrite d5/d14/d2d/d4c/d54/ffe [0,4194304] 0 2023-12-12T11:52:04.967 INFO:tasks.workunit.client.0.smithi063.stdout:0/669: write d0/d1a/d23/d34/f71 [88995,99938] 0 2023-12-12T11:52:04.967 INFO:tasks.workunit.client.0.smithi063.stdout:4/675: creat d2/fdc x:0 0 0 2023-12-12T11:52:04.967 INFO:tasks.workunit.client.1.smithi093.stdout:0/896: write d5/dd/d33/f5e [118754,22106] 0 2023-12-12T11:52:04.968 INFO:tasks.workunit.client.0.smithi063.stdout:1/698: dwrite d3/d3a/dd7/d16/d24/d48/d75/d83/f9e [0,4194304] 0 2023-12-12T11:52:04.968 INFO:tasks.workunit.client.0.smithi063.stdout:1/699: chown d3/d3a/dd7/d16/d24/d48/d75/d83/d81/ld1 57 1 2023-12-12T11:52:04.968 INFO:tasks.workunit.client.0.smithi063.stdout:1/700: creat d3/d3a/dd7/d16/d17/d4b/d8c/fe5 x:0 0 0 2023-12-12T11:52:04.968 INFO:tasks.workunit.client.0.smithi063.stdout:1/701: read - d3/d3a/dd7/d16/d4f/da7/dca/d6f/fd3 zero size 2023-12-12T11:52:04.969 INFO:tasks.workunit.client.0.smithi063.stdout:1/702: write d3/d3a/dd7/d16/d17/d4b/fd8 [202618,108877] 0 2023-12-12T11:52:04.969 INFO:tasks.workunit.client.0.smithi063.stdout:1/703: chown d3/d3a/dd7/d12/f49 60 1 2023-12-12T11:52:04.969 INFO:tasks.workunit.client.0.smithi063.stdout:3/579: mkdir d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/db2 0 2023-12-12T11:52:04.969 INFO:tasks.workunit.client.1.smithi093.stdout:5/757: creat d0/d7/d36/d87/f105 x:0 0 0 2023-12-12T11:52:04.969 INFO:tasks.workunit.client.1.smithi093.stdout:3/875: link df/d25/l34 df/d22/d49/d69/d78/daf/d3d/d59/d72/l11b 0 2023-12-12T11:52:04.970 INFO:tasks.workunit.client.1.smithi093.stdout:5/758: readlink d0/dfc/l100 0 2023-12-12T11:52:04.970 INFO:tasks.workunit.client.1.smithi093.stdout:5/759: chown d0/d7/d36/d68/cf2 170186832 1 2023-12-12T11:52:04.970 INFO:tasks.workunit.client.1.smithi093.stdout:5/760: fdatasync d0/d7/d59/fed 0 2023-12-12T11:52:04.970 INFO:tasks.workunit.client.1.smithi093.stdout:3/876: write fc [3684010,96768] 0 2023-12-12T11:52:04.971 INFO:tasks.workunit.client.1.smithi093.stdout:7/850: mkdir da/d8e/daa/d125 0 2023-12-12T11:52:04.971 INFO:tasks.workunit.client.1.smithi093.stdout:7/851: dread - da/d2e/f109 zero size 2023-12-12T11:52:04.973 INFO:tasks.workunit.client.1.smithi093.stdout:9/893: dread d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d5c/f88 [0,4194304] 0 2023-12-12T11:52:04.973 INFO:tasks.workunit.client.1.smithi093.stdout:9/894: dread - d1/d23/d24/d89/fdb zero size 2023-12-12T11:52:04.981 INFO:tasks.workunit.client.0.smithi063.stdout:9/520: link d7/d11/d4b/d75/f98 d7/d11/d4b/d75/faa 0 2023-12-12T11:52:04.985 INFO:tasks.workunit.client.0.smithi063.stdout:4/676: dread d2/d8/f26 [0,4194304] 0 2023-12-12T11:52:04.985 INFO:tasks.workunit.client.0.smithi063.stdout:4/677: truncate d2/d48/fac 1729029 0 2023-12-12T11:52:04.985 INFO:tasks.workunit.client.0.smithi063.stdout:4/678: truncate d2/fc6 611303 0 2023-12-12T11:52:04.985 INFO:tasks.workunit.client.0.smithi063.stdout:4/679: read d2/f58 [998520,5469] 0 2023-12-12T11:52:04.985 INFO:tasks.workunit.client.0.smithi063.stdout:4/680: write d2/d47/f7b [461799,83197] 0 2023-12-12T11:52:04.985 INFO:tasks.workunit.client.0.smithi063.stdout:4/681: dread - d2/d17/d9d/fb1 zero size 2023-12-12T11:52:04.985 INFO:tasks.workunit.client.0.smithi063.stdout:4/682: chown d2/lbe 56 1 2023-12-12T11:52:04.986 INFO:tasks.workunit.client.1.smithi093.stdout:0/897: dread d5/d21/fb1 [0,4194304] 0 2023-12-12T11:52:04.987 INFO:tasks.workunit.client.0.smithi063.stdout:8/720: truncate d4/d24/db3/fe3 6154938 0 2023-12-12T11:52:04.987 INFO:tasks.workunit.client.0.smithi063.stdout:8/721: readlink d4/de/l10 0 2023-12-12T11:52:04.995 INFO:tasks.workunit.client.0.smithi063.stdout:5/678: mkdir d7/d10/d2b/d3c/d42/d62/d69/dcb 0 2023-12-12T11:52:04.996 INFO:tasks.workunit.client.0.smithi063.stdout:7/556: stat de/d33/d41/d44/d8b/l90 0 2023-12-12T11:52:04.997 INFO:tasks.workunit.client.1.smithi093.stdout:2/899: write d5/d14/d27/f36 [2645560,8113] 0 2023-12-12T11:52:04.997 INFO:tasks.workunit.client.1.smithi093.stdout:2/900: write d5/d14/d2d/d8b/da3/de5/ff7 [866473,116511] 0 2023-12-12T11:52:05.003 INFO:tasks.workunit.client.0.smithi063.stdout:0/670: link d0/d1a/d23/d2e/d84/fab d0/fda 0 2023-12-12T11:52:05.006 INFO:tasks.workunit.client.1.smithi093.stdout:9/895: dwrite d1/d23/d24/d29/d43/f48 [0,4194304] 0 2023-12-12T11:52:05.006 INFO:tasks.workunit.client.1.smithi093.stdout:9/896: write d1/d23/d24/d29/d43/d56/d85/dc3/dce/fb4 [732000,106224] 0 2023-12-12T11:52:05.009 INFO:tasks.workunit.client.0.smithi063.stdout:4/683: write d2/d47/d6d/d88/fa6 [1176743,27384] 0 2023-12-12T11:52:05.010 INFO:tasks.workunit.client.1.smithi093.stdout:8/926: dwrite d3/d1a/d1f/d29/d30/d110/f119 [0,4194304] 0 2023-12-12T11:52:05.010 INFO:tasks.workunit.client.1.smithi093.stdout:8/927: chown d3/d1a/d1f/d29/d3a/db1/df9 4722 1 2023-12-12T11:52:05.012 INFO:tasks.workunit.client.1.smithi093.stdout:5/761: mknod d0/d7/d59/d62/de1/c106 0 2023-12-12T11:52:05.014 INFO:tasks.workunit.client.1.smithi093.stdout:1/900: sync 2023-12-12T11:52:05.016 INFO:tasks.workunit.client.1.smithi093.stdout:3/877: truncate df/d22/d49/d69/d78/daf/d3d/d59/f5c 82368 0 2023-12-12T11:52:05.018 INFO:tasks.workunit.client.0.smithi063.stdout:1/704: creat d3/d3a/d52/fe6 x:0 0 0 2023-12-12T11:52:05.020 INFO:tasks.workunit.client.1.smithi093.stdout:7/852: rename da/d15/d2d/f50 to da/d15/d19/d90/d7d/dd1/f126 0 2023-12-12T11:52:05.021 INFO:tasks.workunit.client.0.smithi063.stdout:3/580: creat d4/df/d1a/d1c/d3b/d50/fb3 x:0 0 0 2023-12-12T11:52:05.021 INFO:tasks.workunit.client.0.smithi063.stdout:3/581: write d4/df/f19 [2165824,40379] 0 2023-12-12T11:52:05.021 INFO:tasks.workunit.client.1.smithi093.stdout:0/898: symlink d5/dd/d14/d99/dfb/l118 0 2023-12-12T11:52:05.022 INFO:tasks.workunit.client.1.smithi093.stdout:9/897: dread d1/d23/d24/d29/d43/f48 [0,4194304] 0 2023-12-12T11:52:05.023 INFO:tasks.workunit.client.1.smithi093.stdout:8/928: dread d3/d1a/d1f/d29/d3a/d40/f61 [0,4194304] 0 2023-12-12T11:52:05.024 INFO:tasks.workunit.client.0.smithi063.stdout:9/521: rename d7/d20/d3f/d40/d4e/l77 to d7/d11/d4b/lab 0 2023-12-12T11:52:05.024 INFO:tasks.workunit.client.0.smithi063.stdout:9/522: truncate d7/d11/f4c 102589 0 2023-12-12T11:52:05.024 INFO:tasks.workunit.client.0.smithi063.stdout:9/523: chown d7/d20/d3f/d40/d4e/f6b 11767 1 2023-12-12T11:52:05.026 INFO:tasks.workunit.client.0.smithi063.stdout:7/557: dread de/d22/d66/fa7 [0,4194304] 0 2023-12-12T11:52:05.029 INFO:tasks.workunit.client.1.smithi093.stdout:2/901: symlink d5/d14/d2d/d12/d44/d11b/db5/l12e 0 2023-12-12T11:52:05.029 INFO:tasks.workunit.client.1.smithi093.stdout:1/901: read d4/d1a/f6b [3065778,13937] 0 2023-12-12T11:52:05.030 INFO:tasks.workunit.client.0.smithi063.stdout:5/679: mkdir d7/dcc 0 2023-12-12T11:52:05.030 INFO:tasks.workunit.client.0.smithi063.stdout:5/680: truncate d7/d10/d2b/d3c/d5a/dbb/fc3 597362 0 2023-12-12T11:52:05.031 INFO:tasks.workunit.client.1.smithi093.stdout:8/929: dread d3/d1a/d1f/d59/d69/ff8 [0,4194304] 0 2023-12-12T11:52:05.031 INFO:tasks.workunit.client.1.smithi093.stdout:8/930: stat d3/d1a/d1f/d59/d69/ff2 0 2023-12-12T11:52:05.033 INFO:tasks.workunit.client.1.smithi093.stdout:7/853: dread da/d15/d59/d80/f8b [0,4194304] 0 2023-12-12T11:52:05.033 INFO:tasks.workunit.client.0.smithi063.stdout:0/671: mkdir d0/ddb 0 2023-12-12T11:52:05.034 INFO:tasks.workunit.client.1.smithi093.stdout:5/762: truncate d0/f15 2914504 0 2023-12-12T11:52:05.036 INFO:tasks.workunit.client.1.smithi093.stdout:3/878: unlink df/d25/l29 0 2023-12-12T11:52:05.037 INFO:tasks.workunit.client.1.smithi093.stdout:0/899: write d5/d21/fb1 [510017,110334] 0 2023-12-12T11:52:05.037 INFO:tasks.workunit.client.1.smithi093.stdout:0/900: fdatasync d5/d21/d2f/f3d 0 2023-12-12T11:52:05.037 INFO:tasks.workunit.client.1.smithi093.stdout:0/901: readlink d5/dd/l51 0 2023-12-12T11:52:05.037 INFO:tasks.workunit.client.0.smithi063.stdout:4/684: symlink d2/d17/d4e/dd9/ldd 0 2023-12-12T11:52:05.040 INFO:tasks.workunit.client.1.smithi093.stdout:9/898: rename d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/f9d to d1/d23/d24/d29/d43/f12f 0 2023-12-12T11:52:05.040 INFO:tasks.workunit.client.1.smithi093.stdout:9/899: write d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/f70 [869218,2990] 0 2023-12-12T11:52:05.041 INFO:tasks.workunit.client.1.smithi093.stdout:2/902: symlink d5/d14/d2d/d4c/d54/d67/d69/l12f 0 2023-12-12T11:52:05.041 INFO:tasks.workunit.client.1.smithi093.stdout:2/903: fdatasync d5/d14/d2d/d12/d44/d11b/db5/f105 0 2023-12-12T11:52:05.042 INFO:tasks.workunit.client.1.smithi093.stdout:2/904: write d5/d14/d2d/d12/d25/d7a/d7e/f123 [164348,58810] 0 2023-12-12T11:52:05.042 INFO:tasks.workunit.client.1.smithi093.stdout:2/905: chown d5/d14/d2d/cd9 167 1 2023-12-12T11:52:05.042 INFO:tasks.workunit.client.1.smithi093.stdout:2/906: dread - d5/d14/d2d/d4c/d76/dc6/f116 zero size 2023-12-12T11:52:05.043 INFO:tasks.workunit.client.0.smithi063.stdout:3/582: symlink d4/df/d1a/d1c/d3b/d52/d78/da5/lb4 0 2023-12-12T11:52:05.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:04 smithi063 ceph-mon[107117]: from='client.24525 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:52:05.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:04 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/3078376874' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:52:05.044 INFO:tasks.workunit.client.1.smithi093.stdout:8/931: mkdir d3/d73/d113/d130 0 2023-12-12T11:52:05.049 INFO:tasks.workunit.client.1.smithi093.stdout:7/854: getdents da/d8e/daf 0 2023-12-12T11:52:05.053 INFO:tasks.workunit.client.0.smithi063.stdout:1/705: rename d3/d3a/dd7/d16/d17/d4b/d8c/fdd to d3/d3a/dd7/d16/d24/d48/fe7 0 2023-12-12T11:52:05.055 INFO:tasks.workunit.client.1.smithi093.stdout:5/763: truncate d0/d7/d36/d29/d44/fae 83608 0 2023-12-12T11:52:05.055 INFO:tasks.workunit.client.1.smithi093.stdout:5/764: chown d0/d7/d8/d9e/d6a/lc6 19 1 2023-12-12T11:52:05.058 INFO:tasks.workunit.client.0.smithi063.stdout:7/558: truncate de/d3f/f72 1289629 0 2023-12-12T11:52:05.058 INFO:tasks.workunit.client.0.smithi063.stdout:7/559: truncate de/d33/dd2/d4a/d65/fc6 25677 0 2023-12-12T11:52:05.059 INFO:tasks.workunit.client.1.smithi093.stdout:0/902: dread d5/d41/d77/f86 [0,4194304] 0 2023-12-12T11:52:05.061 INFO:tasks.workunit.client.0.smithi063.stdout:5/681: mkdir d7/d10/d2b/d3c/d27/dcd 0 2023-12-12T11:52:05.068 INFO:tasks.workunit.client.1.smithi093.stdout:2/907: getdents d5/d14/d2d/d4c/d76/dc6/d118/de2 0 2023-12-12T11:52:05.071 INFO:tasks.workunit.client.1.smithi093.stdout:8/932: symlink d3/d1a/d1f/d59/d69/dbc/dc2/d115/l131 0 2023-12-12T11:52:05.072 INFO:tasks.workunit.client.0.smithi063.stdout:8/722: write d4/f4e [227423,35944] 0 2023-12-12T11:52:05.072 INFO:tasks.workunit.client.0.smithi063.stdout:3/583: mknod d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d56/d79/cb5 0 2023-12-12T11:52:05.072 INFO:tasks.workunit.client.0.smithi063.stdout:3/584: write d4/df/d1a/d1c/d3b/d50/d61/f94 [666542,91245] 0 2023-12-12T11:52:05.072 INFO:tasks.workunit.client.0.smithi063.stdout:3/585: fsync d4/d23/f24 0 2023-12-12T11:52:05.072 INFO:tasks.workunit.client.0.smithi063.stdout:3/586: chown d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/c72 2 1 2023-12-12T11:52:05.072 INFO:tasks.workunit.client.0.smithi063.stdout:3/587: readlink d4/l68 0 2023-12-12T11:52:05.078 INFO:tasks.workunit.client.1.smithi093.stdout:7/855: rename da/d15/d19/d4c/d6d/lc2 to da/de/l127 0 2023-12-12T11:52:05.079 INFO:tasks.workunit.client.0.smithi063.stdout:9/524: getdents d7/d11/d94 0 2023-12-12T11:52:05.081 INFO:tasks.workunit.client.1.smithi093.stdout:3/879: dwrite df/d22/d49/d69/d78/daf/d3d/def/ff7 [0,4194304] 0 2023-12-12T11:52:05.089 INFO:tasks.workunit.client.1.smithi093.stdout:0/903: creat d5/d21/f119 x:0 0 0 2023-12-12T11:52:05.089 INFO:tasks.workunit.client.1.smithi093.stdout:5/765: dread d0/d7/d36/db9/d66/f7d [0,4194304] 0 2023-12-12T11:52:05.089 INFO:tasks.workunit.client.1.smithi093.stdout:5/766: creat d0/d7/d36/d87/f107 x:0 0 0 2023-12-12T11:52:05.094 INFO:tasks.workunit.client.1.smithi093.stdout:2/908: write d5/d14/d2d/d12/d25/d7a/d7e/da0/fa9 [633921,15334] 0 2023-12-12T11:52:05.094 INFO:tasks.workunit.client.1.smithi093.stdout:9/900: rmdir d1/d23/d24/d29/d43/d56/d68 39 2023-12-12T11:52:05.094 INFO:tasks.workunit.client.1.smithi093.stdout:9/901: chown d1/d23/d24/d29/d43/d56/d85/dc3/dce/f4c 96364 1 2023-12-12T11:52:05.094 INFO:tasks.workunit.client.1.smithi093.stdout:9/902: chown d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d5c/fec 1749 1 2023-12-12T11:52:05.094 INFO:tasks.workunit.client.1.smithi093.stdout:1/902: dwrite d4/d1a/d1b/d26/d31/ddb/f12d [0,4194304] 0 2023-12-12T11:52:05.094 INFO:tasks.workunit.client.1.smithi093.stdout:8/933: dread d3/d8/d88/dc5/fd4 [0,4194304] 0 2023-12-12T11:52:05.095 INFO:tasks.workunit.client.0.smithi063.stdout:5/682: dread d7/d10/d2b/d3c/d42/d62/d69/f9d [0,4194304] 0 2023-12-12T11:52:05.099 INFO:tasks.workunit.client.1.smithi093.stdout:7/856: creat da/d15/f128 x:0 0 0 2023-12-12T11:52:05.106 INFO:tasks.workunit.client.0.smithi063.stdout:8/723: dread f3 [0,4194304] 0 2023-12-12T11:52:05.109 INFO:tasks.workunit.client.1.smithi093.stdout:3/880: dread df/d25/d2c/d85/f8f [0,4194304] 0 2023-12-12T11:52:05.109 INFO:tasks.workunit.client.0.smithi063.stdout:4/685: rename d2/d17/d41/f4d to d2/d47/d6d/d88/fde 0 2023-12-12T11:52:05.117 INFO:tasks.workunit.client.0.smithi063.stdout:1/706: dwrite d3/d3a/dd7/d16/d24/d4d/f3e [0,4194304] 0 2023-12-12T11:52:05.118 INFO:tasks.workunit.client.0.smithi063.stdout:7/560: creat de/d33/d41/d44/fd3 x:0 0 0 2023-12-12T11:52:05.118 INFO:tasks.workunit.client.0.smithi063.stdout:7/561: readlink de/d22/l93 0 2023-12-12T11:52:05.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.115+0000 7fbca98cf700 1 -- 172.21.15.63:0/3679428897 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbca41159a0 con 0x7fbca40fcbf0 2023-12-12T11:52:05.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.116+0000 7fbc9b7fe700 1 -- 172.21.15.63:0/3679428897 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1807 (secure 0 0 0) 0x7fbc8c056d20 con 0x7fbca40fcbf0 2023-12-12T11:52:05.119 INFO:teuthology.orchestra.run.smithi063.stdout:e13 2023-12-12T11:52:05.119 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-12T11:52:05.119 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:52:05.119 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-12T11:52:05.119 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:52:05.119 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-12T11:52:05.119 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-12T11:52:05.119 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 13 2023-12-12T11:52:05.119 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-12T11:52:05.119 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-12T11:48:58.523481+0000 2023-12-12T11:52:05.119 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-12T11:49:14.113993+0000 2023-12-12T11:52:05.119 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-12T11:52:05.120 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-12T11:52:05.120 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-12T11:52:05.120 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-12T11:52:05.120 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-12T11:52:05.120 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-12T11:52:05.120 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-12T11:52:05.120 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 46 2023-12-12T11:52:05.120 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:52:05.120 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 1 2023-12-12T11:52:05.120 INFO:teuthology.orchestra.run.smithi063.stdout:in 0 2023-12-12T11:52:05.120 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=14492} 2023-12-12T11:52:05.120 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-12T11:52:05.120 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-12T11:52:05.120 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-12T11:52:05.120 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-12T11:52:05.120 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-12T11:52:05.121 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data enabled 2023-12-12T11:52:05.121 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-12T11:52:05.121 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 1 2023-12-12T11:52:05.121 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.aevpzg{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.63:6828/3709000039,v1:172.21.15.63:6829/3709000039] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:52:05.121 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:52:05.121 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:52:05.121 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2023-12-12T11:52:05.121 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:52:05.121 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.swdqms{-1:14500} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.93:6826/3307558569,v1:172.21.15.93:6827/3307558569] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:52:05.121 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.bdqbnp{-1:14508} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/2191270944,v1:172.21.15.63:6827/2191270944] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:52:05.121 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.rhaqsh{-1:24317} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.93:6824/3161864019,v1:172.21.15.93:6825/3161864019] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:52:05.122 INFO:tasks.workunit.client.0.smithi063.stdout:9/525: link d7/d20/d3f/d40/d76/la9 d7/d20/d45/d46/d51/d64/d6f/d85/lac 0 2023-12-12T11:52:05.122 INFO:tasks.workunit.client.0.smithi063.stdout:9/526: write d7/d20/d45/fa5 [556192,82885] 0 2023-12-12T11:52:05.122 INFO:tasks.workunit.client.1.smithi093.stdout:1/903: write d4/d1a/d83/d9a/fd0 [2976823,65546] 0 2023-12-12T11:52:05.122 INFO:tasks.workunit.client.1.smithi093.stdout:1/904: fdatasync d4/d1a/d1b/d26/d31/f7e 0 2023-12-12T11:52:05.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.120+0000 7fbca98cf700 1 -- 172.21.15.63:0/3679428897 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7fbc9006ae40 msgr2=0x7fbc9006d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:05.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.120+0000 7fbca98cf700 1 --2- 172.21.15.63:0/3679428897 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7fbc9006ae40 0x7fbc9006d2f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbc94005010 tx=0x7fbc94004990 comp rx=0 tx=0).stop 2023-12-12T11:52:05.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.120+0000 7fbca98cf700 1 -- 172.21.15.63:0/3679428897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbca40fcbf0 msgr2=0x7fbca4113ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:05.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.120+0000 7fbca98cf700 1 --2- 172.21.15.63:0/3679428897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbca40fcbf0 0x7fbca4113ac0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c002a80 tx=0x7fbc8c004600 comp rx=0 tx=0).stop 2023-12-12T11:52:05.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.121+0000 7fbca98cf700 1 -- 172.21.15.63:0/3679428897 shutdown_connections 2023-12-12T11:52:05.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.121+0000 7fbca98cf700 1 --2- 172.21.15.63:0/3679428897 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7fbc9006ae40 0x7fbc9006d2f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:05.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.121+0000 7fbca98cf700 1 --2- 172.21.15.63:0/3679428897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbca40fcbf0 0x7fbca4113ac0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:05.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.121+0000 7fbca98cf700 1 --2- 172.21.15.63:0/3679428897 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbca40fde00 0x7fbca4114000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:05.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.121+0000 7fbca98cf700 1 -- 172.21.15.63:0/3679428897 >> 172.21.15.63:0/3679428897 conn(0x7fbca40f82d0 msgr2=0x7fbca4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:52:05.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.121+0000 7fbca98cf700 1 -- 172.21.15.63:0/3679428897 shutdown_connections 2023-12-12T11:52:05.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.121+0000 7fbca98cf700 1 -- 172.21.15.63:0/3679428897 wait complete. 2023-12-12T11:52:05.126 INFO:tasks.workunit.client.0.smithi063.stdout:8/724: dread d4/de/d11/fd9 [0,4194304] 0 2023-12-12T11:52:05.126 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 13 2023-12-12T11:52:05.128 INFO:tasks.workunit.client.1.smithi093.stdout:5/767: creat d0/d7/d36/d68/def/f108 x:0 0 0 2023-12-12T11:52:05.128 INFO:tasks.workunit.client.1.smithi093.stdout:5/768: creat d0/f109 x:0 0 0 2023-12-12T11:52:05.128 INFO:tasks.workunit.client.1.smithi093.stdout:5/769: chown d0/dec/c9b 129794754 1 2023-12-12T11:52:05.132 INFO:tasks.workunit.client.1.smithi093.stdout:2/909: symlink d5/d14/d2d/d12/de9/l130 0 2023-12-12T11:52:05.132 INFO:tasks.workunit.client.1.smithi093.stdout:0/904: dread d5/d21/d27/f5d [0,4194304] 0 2023-12-12T11:52:05.135 INFO:tasks.workunit.client.0.smithi063.stdout:1/707: creat d3/d3a/dd7/d16/d24/d48/d75/fe8 x:0 0 0 2023-12-12T11:52:05.135 INFO:tasks.workunit.client.1.smithi093.stdout:7/857: stat da/de/d46/l124 0 2023-12-12T11:52:05.138 INFO:tasks.workunit.client.1.smithi093.stdout:3/881: unlink df/d25/dd2/l103 0 2023-12-12T11:52:05.138 INFO:tasks.workunit.client.1.smithi093.stdout:3/882: dread - df/d25/d2c/d85/fcf zero size 2023-12-12T11:52:05.138 INFO:tasks.workunit.client.1.smithi093.stdout:3/883: fsync df/f21 0 2023-12-12T11:52:05.140 INFO:tasks.workunit.client.0.smithi063.stdout:9/527: rmdir d7/d20/d45/d46/d51/d64/d6f/d85 39 2023-12-12T11:52:05.140 INFO:tasks.workunit.client.0.smithi063.stdout:3/588: dwrite d4/df/d1a/d1c/f43 [0,4194304] 0 2023-12-12T11:52:05.145 INFO:tasks.workunit.client.0.smithi063.stdout:8/725: mkdir d4/d55/d52/d8e/de8 0 2023-12-12T11:52:05.146 INFO:tasks.workunit.client.0.smithi063.stdout:8/726: truncate d4/de/d3b/d62/d6e/fe5 1238795 0 2023-12-12T11:52:05.148 INFO:tasks.workunit.client.0.smithi063.stdout:4/686: mkdir d2/d8/ddf 0 2023-12-12T11:52:05.148 INFO:tasks.workunit.client.0.smithi063.stdout:4/687: readlink d2/l62 0 2023-12-12T11:52:05.150 INFO:tasks.workunit.client.1.smithi093.stdout:1/905: link d4/c4c d4/d1a/d1b/d26/d40/c12e 0 2023-12-12T11:52:05.153 INFO:tasks.workunit.client.0.smithi063.stdout:1/708: truncate d3/d3a/dd7/d16/d24/d48/d75/d83/d5b/d6b/f99 125006 0 2023-12-12T11:52:05.153 INFO:tasks.workunit.client.0.smithi063.stdout:1/709: fdatasync d3/d3a/dd7/d16/d24/d48/d75/d83/d5b/f9b 0 2023-12-12T11:52:05.155 INFO:tasks.workunit.client.0.smithi063.stdout:7/562: getdents de 0 2023-12-12T11:52:05.156 INFO:tasks.workunit.client.0.smithi063.stdout:7/563: creat de/d33/fd4 x:0 0 0 2023-12-12T11:52:05.156 INFO:tasks.workunit.client.0.smithi063.stdout:7/564: truncate fb 548282 0 2023-12-12T11:52:05.162 INFO:tasks.workunit.client.1.smithi093.stdout:5/770: symlink d0/d7/d8/de/l10a 0 2023-12-12T11:52:05.162 INFO:tasks.workunit.client.1.smithi093.stdout:5/771: chown d0/d7/d85/da0/cc8 61314839 1 2023-12-12T11:52:05.166 INFO:tasks.workunit.client.0.smithi063.stdout:8/727: dread d4/d24/fd7 [0,4194304] 0 2023-12-12T11:52:05.168 INFO:tasks.workunit.client.0.smithi063.stdout:9/528: mkdir d7/d20/d45/d46/d51/d64/d6f/dad 0 2023-12-12T11:52:05.173 INFO:tasks.workunit.client.0.smithi063.stdout:4/688: link d2/d17/d41/f52 d2/d48/fe0 0 2023-12-12T11:52:05.174 INFO:tasks.workunit.client.1.smithi093.stdout:0/905: dwrite d5/dd/d14/d26/d58/d64/d6f/d90/fe0 [4194304,4194304] 0 2023-12-12T11:52:05.174 INFO:tasks.workunit.client.1.smithi093.stdout:0/906: fdatasync d5/dd/d14/d26/d58/d64/d6f/d90/fe0 0 2023-12-12T11:52:05.181 INFO:tasks.workunit.client.0.smithi063.stdout:8/728: dread d4/d24/fd7 [0,4194304] 0 2023-12-12T11:52:05.183 INFO:tasks.workunit.client.1.smithi093.stdout:2/910: chown d5/f10 3 1 2023-12-12T11:52:05.183 INFO:tasks.workunit.client.0.smithi063.stdout:1/710: creat d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2/fe9 x:0 0 0 2023-12-12T11:52:05.183 INFO:tasks.workunit.client.0.smithi063.stdout:1/711: chown d3/f9 221 1 2023-12-12T11:52:05.195 INFO:tasks.workunit.client.1.smithi093.stdout:1/906: dwrite d4/d1a/d73/dd4/dd5/fee [0,4194304] 0 2023-12-12T11:52:05.197 INFO:tasks.workunit.client.1.smithi093.stdout:1/907: write d4/dc/d7a/ffb [21655,31430] 0 2023-12-12T11:52:05.197 INFO:tasks.workunit.client.1.smithi093.stdout:1/908: fsync d4/d1a/d1b/d26/d40/fed 0 2023-12-12T11:52:05.197 INFO:tasks.workunit.client.1.smithi093.stdout:1/909: stat d4/d1a/d1b/d26/d65/dc8/f129 0 2023-12-12T11:52:05.209 INFO:tasks.workunit.client.0.smithi063.stdout:7/565: mknod de/d39/d88/db4/cd5 0 2023-12-12T11:52:05.213 INFO:tasks.workunit.client.0.smithi063.stdout:9/529: symlink d7/d20/lae 0 2023-12-12T11:52:05.213 INFO:tasks.workunit.client.1.smithi093.stdout:8/934: getdents d3/d1a/d1f/d59/ddb/d11a 0 2023-12-12T11:52:05.213 INFO:tasks.workunit.client.1.smithi093.stdout:8/935: dread - d3/d1a/d1f/d59/d69/fa5 zero size 2023-12-12T11:52:05.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:04 smithi093 ceph-mon[115914]: from='client.24525 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:52:05.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:04 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/3078376874' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:52:05.223 INFO:tasks.workunit.client.0.smithi063.stdout:8/729: creat d4/d24/d38/d45/d5b/d92/d65/fe9 x:0 0 0 2023-12-12T11:52:05.223 INFO:tasks.workunit.client.0.smithi063.stdout:8/730: truncate d4/d55/fa0 21585 0 2023-12-12T11:52:05.226 INFO:tasks.workunit.client.1.smithi093.stdout:7/858: unlink da/de/l127 0 2023-12-12T11:52:05.235 INFO:tasks.workunit.client.0.smithi063.stdout:3/589: dwrite d4/df/d1a/d1c/d3b/d50/fa4 [0,4194304] 0 2023-12-12T11:52:05.242 INFO:tasks.workunit.client.1.smithi093.stdout:3/884: truncate df/f21 196818 0 2023-12-12T11:52:05.243 INFO:tasks.workunit.client.1.smithi093.stdout:5/772: rename d0/d7/d36/d29/c41 to d0/dec/c10b 0 2023-12-12T11:52:05.243 INFO:tasks.workunit.client.0.smithi063.stdout:9/530: dread d7/d15/f2e [0,4194304] 0 2023-12-12T11:52:05.247 INFO:tasks.workunit.client.1.smithi093.stdout:0/907: creat d5/dd/d14/d99/dfb/f11a x:0 0 0 2023-12-12T11:52:05.249 INFO:tasks.workunit.client.0.smithi063.stdout:9/531: dread d7/d11/f4c [0,4194304] 0 2023-12-12T11:52:05.249 INFO:tasks.workunit.client.0.smithi063.stdout:9/532: dread - d7/d20/d3f/d40/d76/f9d zero size 2023-12-12T11:52:05.251 INFO:tasks.workunit.client.0.smithi063.stdout:8/731: read d4/de/f43 [2451694,91332] 0 2023-12-12T11:52:05.252 INFO:tasks.workunit.client.0.smithi063.stdout:1/712: dwrite d3/d3a/d54/f62 [0,4194304] 0 2023-12-12T11:52:05.252 INFO:tasks.workunit.client.0.smithi063.stdout:1/713: dread - d3/d3a/dd7/d16/d4f/d9a/fba zero size 2023-12-12T11:52:05.252 INFO:tasks.workunit.client.0.smithi063.stdout:4/689: dwrite d2/d47/f30 [0,4194304] 0 2023-12-12T11:52:05.254 INFO:tasks.workunit.client.0.smithi063.stdout:5/683: dwrite d7/d10/d2b/f85 [0,4194304] 0 2023-12-12T11:52:05.258 INFO:tasks.workunit.client.1.smithi093.stdout:7/859: mknod da/d2e/d89/c129 0 2023-12-12T11:52:05.258 INFO:tasks.workunit.client.1.smithi093.stdout:7/860: readlink da/l48 0 2023-12-12T11:52:05.261 INFO:tasks.workunit.client.1.smithi093.stdout:3/885: mknod df/d22/d49/d69/d78/daf/d3d/d59/c11c 0 2023-12-12T11:52:05.264 INFO:tasks.workunit.client.1.smithi093.stdout:9/903: sync 2023-12-12T11:52:05.264 INFO:tasks.workunit.client.1.smithi093.stdout:9/904: readlink d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d5c/l11d 0 2023-12-12T11:52:05.264 INFO:tasks.workunit.client.0.smithi063.stdout:3/590: write d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/f9e [3943957,56764] 0 2023-12-12T11:52:05.265 INFO:tasks.workunit.client.1.smithi093.stdout:1/910: rename d4/l10a to d4/d85/l12f 0 2023-12-12T11:52:05.265 INFO:tasks.workunit.client.1.smithi093.stdout:7/861: dread da/d15/d19/d90/d7d/dd1/ff3 [0,4194304] 0 2023-12-12T11:52:05.270 INFO:tasks.workunit.client.1.smithi093.stdout:5/773: unlink d0/d7/d59/d62/cfb 0 2023-12-12T11:52:05.276 INFO:tasks.workunit.client.1.smithi093.stdout:0/908: getdents d5/d41 0 2023-12-12T11:52:05.277 INFO:tasks.workunit.client.0.smithi063.stdout:7/566: rename de/d33/l51 to de/d39/d4b/ld6 0 2023-12-12T11:52:05.278 INFO:tasks.workunit.client.1.smithi093.stdout:2/911: symlink d5/l131 0 2023-12-12T11:52:05.279 INFO:tasks.workunit.client.0.smithi063.stdout:9/533: mkdir d7/d20/daf 0 2023-12-12T11:52:05.279 INFO:tasks.workunit.client.0.smithi063.stdout:9/534: readlink d7/d20/d3f/d40/d76/la9 0 2023-12-12T11:52:05.282 INFO:tasks.workunit.client.1.smithi093.stdout:3/886: link df/f21 df/d22/d49/d69/d78/f11d 0 2023-12-12T11:52:05.282 INFO:tasks.workunit.client.1.smithi093.stdout:3/887: chown df/d22/d49/d69/d6e/l95 67667 1 2023-12-12T11:52:05.287 INFO:tasks.workunit.client.1.smithi093.stdout:9/905: link d1/d23/d24/d29/ff7 d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/dae/f130 0 2023-12-12T11:52:05.287 INFO:tasks.workunit.client.1.smithi093.stdout:9/906: chown d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/f91 5019782 1 2023-12-12T11:52:05.287 INFO:tasks.workunit.client.1.smithi093.stdout:9/907: dread - d1/d23/d24/d29/d43/d58/fac zero size 2023-12-12T11:52:05.290 INFO:tasks.workunit.client.1.smithi093.stdout:8/936: rename d3/d1a/c101 to d3/d1a/d1f/d29/d3a/c132 0 2023-12-12T11:52:05.292 INFO:tasks.workunit.client.0.smithi063.stdout:1/714: truncate d3/d3a/dd7/d16/d17/f90 253470 0 2023-12-12T11:52:05.294 INFO:tasks.workunit.client.1.smithi093.stdout:1/911: unlink d4/d1a/d1b/d26/d40/l72 0 2023-12-12T11:52:05.295 INFO:tasks.workunit.client.1.smithi093.stdout:0/909: dread d5/d21/d2f/d54/f7b [0,4194304] 0 2023-12-12T11:52:05.296 INFO:tasks.workunit.client.0.smithi063.stdout:4/690: symlink d2/d47/d6d/d88/dbd/le1 0 2023-12-12T11:52:05.297 INFO:tasks.workunit.client.0.smithi063.stdout:4/691: truncate d2/d48/d69/d98/fad 764435 0 2023-12-12T11:52:05.297 INFO:tasks.workunit.client.1.smithi093.stdout:3/888: dread df/f68 [0,4194304] 0 2023-12-12T11:52:05.297 INFO:tasks.workunit.client.1.smithi093.stdout:3/889: truncate df/d30/d33/f117 446239 0 2023-12-12T11:52:05.297 INFO:tasks.workunit.client.1.smithi093.stdout:3/890: chown df/d30/d33/l4c 295396360 1 2023-12-12T11:52:05.297 INFO:tasks.workunit.client.1.smithi093.stdout:3/891: creat df/d30/d33/f11e x:0 0 0 2023-12-12T11:52:05.298 INFO:tasks.workunit.client.1.smithi093.stdout:5/774: mkdir d0/d7/d8/d10c 0 2023-12-12T11:52:05.305 INFO:tasks.workunit.client.1.smithi093.stdout:1/912: rename d4/dc/f18 to d4/d1a/d83/d9a/df7/f130 0 2023-12-12T11:52:05.305 INFO:tasks.workunit.client.1.smithi093.stdout:1/913: fsync d4/d1c/f6d 0 2023-12-12T11:52:05.308 INFO:tasks.workunit.client.1.smithi093.stdout:3/892: creat df/d22/d49/d69/f11f x:0 0 0 2023-12-12T11:52:05.311 INFO:tasks.workunit.client.1.smithi093.stdout:5/775: getdents d0/d7/d8/de 0 2023-12-12T11:52:05.311 INFO:tasks.workunit.client.1.smithi093.stdout:5/776: fsync d0/d7/d36/f90 0 2023-12-12T11:52:05.311 INFO:tasks.workunit.client.1.smithi093.stdout:5/777: chown d0/d7/d59/l69 14509 1 2023-12-12T11:52:05.311 INFO:tasks.workunit.client.1.smithi093.stdout:5/778: stat d0/d7/d36/d87/l7b 0 2023-12-12T11:52:05.311 INFO:tasks.workunit.client.1.smithi093.stdout:5/779: truncate d0/d7/d36/d68/ff3 678965 0 2023-12-12T11:52:05.311 INFO:tasks.workunit.client.1.smithi093.stdout:5/780: dread - d0/d7/d59/fcf zero size 2023-12-12T11:52:05.313 INFO:tasks.workunit.client.1.smithi093.stdout:3/893: write df/d25/dd2/ffb [864879,54993] 0 2023-12-12T11:52:05.314 INFO:tasks.workunit.client.1.smithi093.stdout:1/914: creat d4/d1a/f131 x:0 0 0 2023-12-12T11:52:05.319 INFO:tasks.workunit.client.0.smithi063.stdout:7/567: mknod de/d22/d6e/d8a/cd7 0 2023-12-12T11:52:05.327 INFO:tasks.workunit.client.1.smithi093.stdout:0/910: dread d5/f24 [0,4194304] 0 2023-12-12T11:52:05.334 INFO:tasks.workunit.client.0.smithi063.stdout:5/684: rename d7/d28/d43/f88 to d7/d10/d2b/d3c/d27/dcd/fce 0 2023-12-12T11:52:05.336 INFO:tasks.workunit.client.1.smithi093.stdout:8/937: write d3/d1a/d1f/d29/d3a/d40/dbf/fc1 [4101475,63180] 0 2023-12-12T11:52:05.336 INFO:tasks.workunit.client.1.smithi093.stdout:8/938: creat d3/d1a/d1f/d59/ddb/f133 x:0 0 0 2023-12-12T11:52:05.337 INFO:tasks.workunit.client.1.smithi093.stdout:5/781: creat d0/d7/d8/f10d x:0 0 0 2023-12-12T11:52:05.341 INFO:tasks.workunit.client.0.smithi063.stdout:8/732: dwrite d4/de/f13 [0,4194304] 0 2023-12-12T11:52:05.341 INFO:tasks.workunit.client.0.smithi063.stdout:8/733: readlink d4/de/l10 0 2023-12-12T11:52:05.341 INFO:tasks.workunit.client.0.smithi063.stdout:8/734: write d4/de/d3b/d62/d6e/d76/d93/fe4 [274057,59699] 0 2023-12-12T11:52:05.341 INFO:tasks.workunit.client.0.smithi063.stdout:8/735: fdatasync d4/f22 0 2023-12-12T11:52:05.341 INFO:tasks.workunit.client.0.smithi063.stdout:8/736: dread - d4/d24/d38/d45/d5b/d92/d65/fe9 zero size 2023-12-12T11:52:05.342 INFO:tasks.workunit.client.1.smithi093.stdout:3/894: creat df/d22/d49/d69/d78/daf/d102/f120 x:0 0 0 2023-12-12T11:52:05.345 INFO:tasks.workunit.client.1.smithi093.stdout:1/915: creat d4/d1a/d83/d9a/da9/f132 x:0 0 0 2023-12-12T11:52:05.346 INFO:tasks.workunit.client.1.smithi093.stdout:1/916: fdatasync d4/dc/d7a/d9c/da7/fc3 0 2023-12-12T11:52:05.347 INFO:tasks.workunit.client.0.smithi063.stdout:7/568: dread de/f4c [0,4194304] 0 2023-12-12T11:52:05.347 INFO:tasks.workunit.client.0.smithi063.stdout:7/569: chown de/d22/d66/fa7 887700918 1 2023-12-12T11:52:05.347 INFO:tasks.workunit.client.1.smithi093.stdout:0/911: mkdir d5/dd/d62/d10c/d11b 0 2023-12-12T11:52:05.349 INFO:tasks.workunit.client.0.smithi063.stdout:3/591: rename d4/df/d1a/d1c/d3b/d81 to d4/df/d1a/d1c/d3b/d52/db6 0 2023-12-12T11:52:05.349 INFO:tasks.workunit.client.0.smithi063.stdout:1/715: rename d3/d3a/dd7/d16/d17/d4b/d8c to d3/d3a/dd7/d16/d17/d4b/d8c/dea 22 2023-12-12T11:52:05.350 INFO:tasks.workunit.client.0.smithi063.stdout:1/716: chown d3/d3a/dd7/c45 1 1 2023-12-12T11:52:05.350 INFO:tasks.workunit.client.0.smithi063.stdout:3/592: dread - d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/fae zero size 2023-12-12T11:52:05.350 INFO:tasks.workunit.client.0.smithi063.stdout:8/737: write d4/de/d1e/f33 [63174,124353] 0 2023-12-12T11:52:05.351 INFO:tasks.workunit.client.1.smithi093.stdout:9/908: dwrite d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/f49 [0,4194304] 0 2023-12-12T11:52:05.352 INFO:tasks.workunit.client.0.smithi063.stdout:5/685: symlink d7/d10/d2b/d3c/d5a/dbb/dbc/lcf 0 2023-12-12T11:52:05.353 INFO:tasks.workunit.client.1.smithi093.stdout:0/912: dread d5/dd/d14/d26/d58/dab/f9c [0,4194304] 0 2023-12-12T11:52:05.354 INFO:tasks.workunit.client.1.smithi093.stdout:0/913: write d5/dd/d33/fe2 [739687,28916] 0 2023-12-12T11:52:05.354 INFO:tasks.workunit.client.1.smithi093.stdout:0/914: chown d5/dd/d14/c115 299378 1 2023-12-12T11:52:05.354 INFO:tasks.workunit.client.0.smithi063.stdout:9/535: dwrite d7/d11/d12/f60 [0,4194304] 0 2023-12-12T11:52:05.354 INFO:tasks.workunit.client.0.smithi063.stdout:9/536: getdents d7/d15 0 2023-12-12T11:52:05.354 INFO:tasks.workunit.client.0.smithi063.stdout:9/537: chown d7/d11/d4b/d75/f98 118 1 2023-12-12T11:52:05.355 INFO:tasks.workunit.client.0.smithi063.stdout:2/563: sync 2023-12-12T11:52:05.355 INFO:tasks.workunit.client.0.smithi063.stdout:6/694: sync 2023-12-12T11:52:05.355 INFO:tasks.workunit.client.0.smithi063.stdout:6/695: readlink d9/d10/d2a/de7/d8a/lb4 0 2023-12-12T11:52:05.356 INFO:tasks.workunit.client.1.smithi093.stdout:8/939: link d3/d1a/c78 d3/d1a/d1f/d29/d30/c134 0 2023-12-12T11:52:05.356 INFO:tasks.workunit.client.1.smithi093.stdout:8/940: chown d3/c52 110286 1 2023-12-12T11:52:05.361 INFO:tasks.workunit.client.1.smithi093.stdout:5/782: mkdir d0/d7/d36/db9/d66/d7c/db5/d10e 0 2023-12-12T11:52:05.361 INFO:tasks.workunit.client.1.smithi093.stdout:5/783: stat d0/d7/d8/de/dab/de5/ffd 0 2023-12-12T11:52:05.367 INFO:tasks.workunit.client.1.smithi093.stdout:1/917: mknod d4/d1a/d1b/d26/d82/de3/c133 0 2023-12-12T11:52:05.372 INFO:tasks.workunit.client.0.smithi063.stdout:7/570: creat de/d3f/dc3/fd8 x:0 0 0 2023-12-12T11:52:05.376 INFO:tasks.workunit.client.0.smithi063.stdout:3/593: symlink d4/df/d1a/d1c/d3b/d50/d9f/lb7 0 2023-12-12T11:52:05.376 INFO:tasks.workunit.client.0.smithi063.stdout:3/594: write d4/df/d1a/d1c/d3b/d50/f5a [4391029,86540] 0 2023-12-12T11:52:05.377 INFO:tasks.workunit.client.0.smithi063.stdout:8/738: truncate d4/d24/d38/d45/f69 646978 0 2023-12-12T11:52:05.380 INFO:tasks.workunit.client.1.smithi093.stdout:9/909: symlink d1/d23/d24/d29/d43/d56/l131 0 2023-12-12T11:52:05.381 INFO:tasks.workunit.client.1.smithi093.stdout:9/910: creat d1/d23/d6b/d92/db2/f132 x:0 0 0 2023-12-12T11:52:05.381 INFO:tasks.workunit.client.1.smithi093.stdout:9/911: chown d1/d23/f123 0 1 2023-12-12T11:52:05.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.387+0000 7fd63cda2700 1 -- 172.21.15.63:0/2026796785 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd6380fcbf0 msgr2=0x7fd6380fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:05.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.387+0000 7fd63cda2700 1 --2- 172.21.15.63:0/2026796785 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd6380fcbf0 0x7fd6380fd000 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd628004940 tx=0x7fd628009e30 comp rx=0 tx=0).stop 2023-12-12T11:52:05.390 INFO:tasks.workunit.client.0.smithi063.stdout:5/686: link d7/de/l7b d7/d10/d2b/d3c/d42/d62/db4/ld0 0 2023-12-12T11:52:05.390 INFO:tasks.workunit.client.0.smithi063.stdout:5/687: fsync d7/d10/d2b/f55 0 2023-12-12T11:52:05.391 INFO:tasks.workunit.client.0.smithi063.stdout:5/688: chown d7/d10/d2b/d3c/d42/f96 782135294 1 2023-12-12T11:52:05.391 INFO:tasks.workunit.client.0.smithi063.stdout:5/689: readlink d7/d10/d2b/d3c/d42/d62/db4/ld0 0 2023-12-12T11:52:05.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.389+0000 7fd63cda2700 1 -- 172.21.15.63:0/2026796785 shutdown_connections 2023-12-12T11:52:05.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.389+0000 7fd63cda2700 1 --2- 172.21.15.63:0/2026796785 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6380fde00 0x7fd6380fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:05.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.389+0000 7fd63cda2700 1 --2- 172.21.15.63:0/2026796785 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd6380fcbf0 0x7fd6380fd000 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:05.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.389+0000 7fd63cda2700 1 -- 172.21.15.63:0/2026796785 >> 172.21.15.63:0/2026796785 conn(0x7fd6380f82d0 msgr2=0x7fd6380fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:52:05.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.389+0000 7fd63cda2700 1 -- 172.21.15.63:0/2026796785 shutdown_connections 2023-12-12T11:52:05.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.389+0000 7fd63cda2700 1 -- 172.21.15.63:0/2026796785 wait complete. 2023-12-12T11:52:05.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.390+0000 7fd63cda2700 1 Processor -- start 2023-12-12T11:52:05.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.391+0000 7fd63cda2700 1 -- start start 2023-12-12T11:52:05.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.391+0000 7fd63cda2700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd6380fcbf0 0x7fd63810b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:05.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.391+0000 7fd63cda2700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6380fde00 0x7fd63810b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:05.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.391+0000 7fd63cda2700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63810bd70 con 0x7fd6380fde00 2023-12-12T11:52:05.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.391+0000 7fd63cda2700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63810c580 con 0x7fd6380fcbf0 2023-12-12T11:52:05.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.392+0000 7fd62dd9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6380fde00 0x7fd63810b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:05.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.392+0000 7fd62dd9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6380fde00 0x7fd63810b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59790/0 (socket says 172.21.15.63:59790) 2023-12-12T11:52:05.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.392+0000 7fd62dd9b700 1 -- 172.21.15.63:0/3193236303 learned_addr learned my addr 172.21.15.63:0/3193236303 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:52:05.396 INFO:tasks.workunit.client.1.smithi093.stdout:0/915: symlink d5/db2/l11c 0 2023-12-12T11:52:05.396 INFO:tasks.workunit.client.1.smithi093.stdout:0/916: dread - d5/ffc zero size 2023-12-12T11:52:05.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.393+0000 7fd63659c700 1 --2- 172.21.15.63:0/3193236303 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd6380fcbf0 0x7fd63810b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:05.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.393+0000 7fd62dd9b700 1 -- 172.21.15.63:0/3193236303 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd6380fcbf0 msgr2=0x7fd63810b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:05.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.393+0000 7fd62dd9b700 1 --2- 172.21.15.63:0/3193236303 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd6380fcbf0 0x7fd63810b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:05.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.393+0000 7fd62dd9b700 1 -- 172.21.15.63:0/3193236303 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd628005040 con 0x7fd6380fde00 2023-12-12T11:52:05.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.393+0000 7fd63659c700 1 --2- 172.21.15.63:0/3193236303 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd6380fcbf0 0x7fd63810b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T11:52:05.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.394+0000 7fd62dd9b700 1 --2- 172.21.15.63:0/3193236303 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6380fde00 0x7fd63810b690 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd62000b790 tx=0x7fd620009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:52:05.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.394+0000 7fd62f7fe700 1 -- 172.21.15.63:0/3193236303 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd62000f770 con 0x7fd6380fde00 2023-12-12T11:52:05.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.395+0000 7fd62f7fe700 1 -- 172.21.15.63:0/3193236303 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd62000fd80 con 0x7fd6380fde00 2023-12-12T11:52:05.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.395+0000 7fd63cda2700 1 -- 172.21.15.63:0/3193236303 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd63810c860 con 0x7fd6380fde00 2023-12-12T11:52:05.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.395+0000 7fd63cda2700 1 -- 172.21.15.63:0/3193236303 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd63810cda0 con 0x7fd6380fde00 2023-12-12T11:52:05.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.395+0000 7fd62f7fe700 1 -- 172.21.15.63:0/3193236303 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd62000d310 con 0x7fd6380fde00 2023-12-12T11:52:05.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.397+0000 7fd63cda2700 1 -- 172.21.15.63:0/3193236303 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd61c0052e0 con 0x7fd6380fde00 2023-12-12T11:52:05.400 INFO:tasks.workunit.client.0.smithi063.stdout:9/538: rename d7/d20/d3f/d40/da7/la8 to d7/d20/d3f/d40/d4e/lb0 0 2023-12-12T11:52:05.402 INFO:tasks.workunit.client.0.smithi063.stdout:2/564: truncate d0/d1a/d1e/f60 2073698 0 2023-12-12T11:52:05.402 INFO:tasks.workunit.client.1.smithi093.stdout:5/784: getdents d0/d7/d8/d9e 0 2023-12-12T11:52:05.403 INFO:tasks.workunit.client.0.smithi063.stdout:7/571: write de/f4c [3069954,129533] 0 2023-12-12T11:52:05.403 INFO:tasks.workunit.client.0.smithi063.stdout:7/572: write de/d39/d4b/f70 [1769468,13651] 0 2023-12-12T11:52:05.404 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.401+0000 7fd62f7fe700 1 -- 172.21.15.63:0/3193236303 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 24) v1 ==== 88724+0+0 (secure 0 0 0) 0x7fd62000f8d0 con 0x7fd6380fde00 2023-12-12T11:52:05.405 INFO:tasks.workunit.client.0.smithi063.stdout:6/696: dwrite d9/d10/d5c/d5e/f6a [0,4194304] 0 2023-12-12T11:52:05.407 INFO:tasks.workunit.client.0.smithi063.stdout:0/672: sync 2023-12-12T11:52:05.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.404+0000 7fd62f7fe700 1 --2- 172.21.15.63:0/3193236303 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7fd61806af10 0x7fd61806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:05.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.405+0000 7fd62f7fe700 1 -- 172.21.15.63:0/3193236303 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fd620089d90 con 0x7fd6380fde00 2023-12-12T11:52:05.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.405+0000 7fd63659c700 1 --2- 172.21.15.63:0/3193236303 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7fd61806af10 0x7fd61806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:05.410 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.407+0000 7fd63659c700 1 --2- 172.21.15.63:0/3193236303 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7fd61806af10 0x7fd61806d3c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd628000c00 tx=0x7fd628009e30 comp rx=0 tx=0).ready entity=mgr.24471 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:52:05.410 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.408+0000 7fd62f7fe700 1 -- 172.21.15.63:0/3193236303 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fd6200541c0 con 0x7fd6380fde00 2023-12-12T11:52:05.417 INFO:tasks.workunit.client.0.smithi063.stdout:5/690: write d7/d28/f5f [1722658,24883] 0 2023-12-12T11:52:05.417 INFO:tasks.workunit.client.0.smithi063.stdout:3/595: getdents d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d56 0 2023-12-12T11:52:05.418 INFO:tasks.workunit.client.1.smithi093.stdout:1/918: mknod d4/d1a/d1b/d26/c134 0 2023-12-12T11:52:05.418 INFO:tasks.workunit.client.1.smithi093.stdout:9/912: rmdir d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/db1 39 2023-12-12T11:52:05.418 INFO:tasks.workunit.client.1.smithi093.stdout:0/917: rmdir d5/d21/d27/d3a/d9a/db5/db8 39 2023-12-12T11:52:05.418 INFO:tasks.workunit.client.1.smithi093.stdout:9/913: write d1/d23/d24/d29/d43/dfc/f11f [781944,119002] 0 2023-12-12T11:52:05.421 INFO:tasks.workunit.client.0.smithi063.stdout:8/739: rmdir d4/d24/d38/d45/d5b/d92/d95 0 2023-12-12T11:52:05.421 INFO:tasks.workunit.client.0.smithi063.stdout:9/539: symlink d7/d15/lb1 0 2023-12-12T11:52:05.421 INFO:tasks.workunit.client.0.smithi063.stdout:9/540: chown d7/f2b 11816 1 2023-12-12T11:52:05.423 INFO:tasks.workunit.client.0.smithi063.stdout:2/565: creat d0/d41/daf/fb9 x:0 0 0 2023-12-12T11:52:05.427 INFO:tasks.workunit.client.1.smithi093.stdout:8/941: dwrite d3/f129 [0,4194304] 0 2023-12-12T11:52:05.435 INFO:tasks.workunit.client.0.smithi063.stdout:7/573: dread de/d22/d66/fb2 [0,4194304] 0 2023-12-12T11:52:05.440 INFO:tasks.workunit.client.1.smithi093.stdout:1/919: symlink d4/d1a/d83/d9a/l135 0 2023-12-12T11:52:05.442 INFO:tasks.workunit.client.1.smithi093.stdout:5/785: dwrite d0/d7/d59/de7/ff7 [0,4194304] 0 2023-12-12T11:52:05.442 INFO:tasks.workunit.client.1.smithi093.stdout:0/918: symlink d5/dd/dbb/l11d 0 2023-12-12T11:52:05.442 INFO:tasks.workunit.client.1.smithi093.stdout:0/919: chown d5/d21/d27/d3a/c4b 15 1 2023-12-12T11:52:05.443 INFO:tasks.workunit.client.0.smithi063.stdout:1/717: dwrite d3/d3a/dd7/d16/d4f/d9a/fab [4194304,4194304] 0 2023-12-12T11:52:05.443 INFO:tasks.workunit.client.0.smithi063.stdout:4/692: dwrite d2/d8/fcd [0,4194304] 0 2023-12-12T11:52:05.444 INFO:tasks.workunit.client.0.smithi063.stdout:3/596: write d4/f3f [3732187,115815] 0 2023-12-12T11:52:05.444 INFO:tasks.workunit.client.0.smithi063.stdout:3/597: chown d4/f25 1007 1 2023-12-12T11:52:05.445 INFO:tasks.workunit.client.1.smithi093.stdout:9/914: link d1/d23/d6b/d92/d9f/lb7 d1/d23/d24/d29/d43/d56/d68/l133 0 2023-12-12T11:52:05.445 INFO:tasks.workunit.client.1.smithi093.stdout:9/915: write d1/d23/d24/d29/d43/f12f [906545,28862] 0 2023-12-12T11:52:05.448 INFO:tasks.workunit.client.0.smithi063.stdout:6/697: rename d9/d10/d73/db8 to d9/d10/d2a/de7/d86/dc2/ded/df5 0 2023-12-12T11:52:05.448 INFO:tasks.workunit.client.0.smithi063.stdout:6/698: creat d9/d2c/d61/dcd/ff6 x:0 0 0 2023-12-12T11:52:05.451 INFO:tasks.workunit.client.0.smithi063.stdout:6/699: stat d9/d10/d2a/de7/ccf 0 2023-12-12T11:52:05.452 INFO:tasks.workunit.client.0.smithi063.stdout:0/673: fsync d0/d7/d27/fc9 0 2023-12-12T11:52:05.458 INFO:tasks.workunit.client.1.smithi093.stdout:9/916: write d1/d23/d24/d29/d43/d56/d85/dc3/dce/f4c [874340,380] 0 2023-12-12T11:52:05.458 INFO:tasks.workunit.client.1.smithi093.stdout:9/917: fdatasync d1/f2f 0 2023-12-12T11:52:05.458 INFO:tasks.workunit.client.1.smithi093.stdout:9/918: read - d1/d23/d24/d89/fdb zero size 2023-12-12T11:52:05.459 INFO:tasks.workunit.client.0.smithi063.stdout:5/691: mkdir d7/d28/d43/dd1 0 2023-12-12T11:52:05.459 INFO:tasks.workunit.client.0.smithi063.stdout:5/692: truncate d7/d28/d43/d49/f4a 1089491 0 2023-12-12T11:52:05.459 INFO:tasks.workunit.client.0.smithi063.stdout:5/693: write d7/d10/d2b/d3c/fbd [432846,65779] 0 2023-12-12T11:52:05.465 INFO:tasks.workunit.client.1.smithi093.stdout:8/942: unlink d3/d1a/d1f/d29/d3a/c132 0 2023-12-12T11:52:05.465 INFO:tasks.workunit.client.1.smithi093.stdout:8/943: fsync d3/d1a/d1f/d29/d3a/da0/dcb/f127 0 2023-12-12T11:52:05.465 INFO:tasks.workunit.client.1.smithi093.stdout:8/944: read d3/d1a/f2b [1300644,17207] 0 2023-12-12T11:52:05.465 INFO:tasks.workunit.client.1.smithi093.stdout:8/945: truncate d3/d1a/d1f/d59/d6c/f93 406989 0 2023-12-12T11:52:05.472 INFO:tasks.workunit.client.0.smithi063.stdout:3/598: dread d4/df/d1a/d1c/d3b/d50/d9f/fa9 [0,4194304] 0 2023-12-12T11:52:05.472 INFO:tasks.workunit.client.0.smithi063.stdout:3/599: read - d4/df/d1a/d1c/d34/fa6 zero size 2023-12-12T11:52:05.475 INFO:tasks.workunit.client.0.smithi063.stdout:9/541: mkdir d7/d15/db2 0 2023-12-12T11:52:05.475 INFO:tasks.workunit.client.1.smithi093.stdout:7/862: sync 2023-12-12T11:52:05.475 INFO:tasks.workunit.client.1.smithi093.stdout:7/863: chown da/d15/d2d/d2f/c55 398101 1 2023-12-12T11:52:05.480 INFO:tasks.workunit.client.1.smithi093.stdout:1/920: mkdir d4/d1a/d1b/dbf/d110/d136 0 2023-12-12T11:52:05.480 INFO:tasks.workunit.client.1.smithi093.stdout:1/921: fdatasync d4/dc/f17 0 2023-12-12T11:52:05.485 INFO:tasks.workunit.client.0.smithi063.stdout:7/574: creat de/d33/d71/fd9 x:0 0 0 2023-12-12T11:52:05.488 INFO:tasks.workunit.client.1.smithi093.stdout:0/920: dwrite d5/d21/f2e [0,4194304] 0 2023-12-12T11:52:05.488 INFO:tasks.workunit.client.1.smithi093.stdout:0/921: write d5/d21/d27/d3a/f56 [2976535,99493] 0 2023-12-12T11:52:05.489 INFO:tasks.workunit.client.1.smithi093.stdout:0/922: dread - d5/dd/d33/f109 zero size 2023-12-12T11:52:05.489 INFO:tasks.workunit.client.1.smithi093.stdout:0/923: chown d5/d41/d77/d79/df2/d10b 375 1 2023-12-12T11:52:05.489 INFO:tasks.workunit.client.1.smithi093.stdout:5/786: creat d0/d7/d59/d48/f10f x:0 0 0 2023-12-12T11:52:05.498 INFO:tasks.workunit.client.0.smithi063.stdout:8/740: dwrite f0 [0,4194304] 0 2023-12-12T11:52:05.502 INFO:tasks.workunit.client.0.smithi063.stdout:4/693: dwrite d2/d47/f7b [0,4194304] 0 2023-12-12T11:52:05.502 INFO:tasks.workunit.client.0.smithi063.stdout:1/718: mknod d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2/ceb 0 2023-12-12T11:52:05.510 INFO:tasks.workunit.client.0.smithi063.stdout:7/575: read de/d22/d4d/f91 [2540842,26117] 0 2023-12-12T11:52:05.510 INFO:tasks.workunit.client.0.smithi063.stdout:7/576: fsync de/d22/faa 0 2023-12-12T11:52:05.510 INFO:tasks.workunit.client.1.smithi093.stdout:9/919: link d1/d23/d24/d29/d43/d56/d85/le8 d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/l134 0 2023-12-12T11:52:05.513 INFO:tasks.workunit.client.0.smithi063.stdout:3/600: dread d4/f15 [0,4194304] 0 2023-12-12T11:52:05.513 INFO:tasks.workunit.client.0.smithi063.stdout:6/700: dwrite d9/d2c/d61/dcd/ff6 [0,4194304] 0 2023-12-12T11:52:05.513 INFO:tasks.workunit.client.0.smithi063.stdout:6/701: chown d9/d10/d2a/c36 70 1 2023-12-12T11:52:05.513 INFO:tasks.workunit.client.0.smithi063.stdout:6/702: creat d9/d10/d7a/ff7 x:0 0 0 2023-12-12T11:52:05.513 INFO:tasks.workunit.client.0.smithi063.stdout:6/703: write d9/d2c/d61/dcd/fd4 [221748,72821] 0 2023-12-12T11:52:05.513 INFO:tasks.workunit.client.0.smithi063.stdout:6/704: dread - d9/d2c/f54 zero size 2023-12-12T11:52:05.514 INFO:tasks.workunit.client.1.smithi093.stdout:7/864: rename da/de/d46/d4f/lcc to da/d15/ddd/l12a 0 2023-12-12T11:52:05.516 INFO:tasks.workunit.client.1.smithi093.stdout:1/922: mknod d4/d1a/d1b/d26/d82/c137 0 2023-12-12T11:52:05.522 INFO:tasks.workunit.client.0.smithi063.stdout:5/694: mknod d7/d10/d2b/d3c/d27/cd2 0 2023-12-12T11:52:05.524 INFO:tasks.workunit.client.0.smithi063.stdout:9/542: mknod d7/d11/d4b/cb3 0 2023-12-12T11:52:05.525 INFO:tasks.workunit.client.0.smithi063.stdout:9/543: fsync d7/d11/d12/f37 0 2023-12-12T11:52:05.529 INFO:tasks.workunit.client.1.smithi093.stdout:5/787: unlink d0/d7/d36/l9c 0 2023-12-12T11:52:05.529 INFO:tasks.workunit.client.1.smithi093.stdout:0/924: creat d5/dd/d14/d26/d58/d64/ddb/f11e x:0 0 0 2023-12-12T11:52:05.529 INFO:tasks.workunit.client.1.smithi093.stdout:0/925: chown d5/d21/d27/d3a/f4a 10110370 1 2023-12-12T11:52:05.529 INFO:tasks.workunit.client.1.smithi093.stdout:7/865: dread da/d15/d2d/f9f [0,4194304] 0 2023-12-12T11:52:05.530 INFO:tasks.workunit.client.1.smithi093.stdout:9/920: dread d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/f27 [0,4194304] 0 2023-12-12T11:52:05.530 INFO:tasks.workunit.client.1.smithi093.stdout:9/921: chown d1/d23/d24/d29/d43/d56/d85/le8 2 1 2023-12-12T11:52:05.530 INFO:tasks.workunit.client.0.smithi063.stdout:2/566: rmdir d0/d1a/d1e 39 2023-12-12T11:52:05.531 INFO:tasks.workunit.client.0.smithi063.stdout:2/567: dread - d0/d1a/d48/d56/da2/fb2 zero size 2023-12-12T11:52:05.532 INFO:tasks.workunit.client.0.smithi063.stdout:8/741: link d4/d24/f31 d4/d24/d38/d45/d5b/d92/d65/fea 0 2023-12-12T11:52:05.535 INFO:tasks.workunit.client.1.smithi093.stdout:7/866: unlink da/de/f5c 0 2023-12-12T11:52:05.542 INFO:tasks.workunit.client.1.smithi093.stdout:9/922: truncate d1/d23/d24/d29/d43/d56/d68/f90 8182780 0 2023-12-12T11:52:05.542 INFO:tasks.workunit.client.1.smithi093.stdout:9/923: readlink d1/d23/d24/d29/d43/d58/l114 0 2023-12-12T11:52:05.542 INFO:tasks.workunit.client.1.smithi093.stdout:9/924: write d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/dc0/f11e [903999,124571] 0 2023-12-12T11:52:05.542 INFO:tasks.workunit.client.1.smithi093.stdout:1/923: dread d4/fd [0,4194304] 0 2023-12-12T11:52:05.543 INFO:tasks.workunit.client.1.smithi093.stdout:7/867: link da/d15/c123 da/de/c12b 0 2023-12-12T11:52:05.546 INFO:tasks.workunit.client.1.smithi093.stdout:9/925: mknod d1/d23/d24/d89/c135 0 2023-12-12T11:52:05.547 INFO:tasks.workunit.client.1.smithi093.stdout:5/788: dread d0/dd2/fe2 [0,4194304] 0 2023-12-12T11:52:05.548 INFO:tasks.workunit.client.0.smithi063.stdout:1/719: rename d3/d3a/dd7/d16/d24/d48/d75/d83/d5b/c69 to d3/d3a/dd7/d16/d24/d48/d75/d83/cec 0 2023-12-12T11:52:05.551 INFO:tasks.workunit.client.1.smithi093.stdout:1/924: rename d4/d1a/d1b/d26/d40/fed to d4/d1a/d83/d9a/f138 0 2023-12-12T11:52:05.552 INFO:tasks.workunit.client.1.smithi093.stdout:0/926: dread d5/d21/fb1 [0,4194304] 0 2023-12-12T11:52:05.552 INFO:tasks.workunit.client.1.smithi093.stdout:0/927: fsync d5/d21/d27/f5a 0 2023-12-12T11:52:05.552 INFO:tasks.workunit.client.1.smithi093.stdout:0/928: readlink d5/d21/d27/d3a/lde 0 2023-12-12T11:52:05.552 INFO:tasks.workunit.client.1.smithi093.stdout:0/929: chown d5/d21/d27/d3a/d9a/db5/db8 1308714834 1 2023-12-12T11:52:05.563 INFO:tasks.workunit.client.1.smithi093.stdout:5/789: rename d0/d7/d59/d62/f101 to d0/d7/d36/db9/d66/f110 0 2023-12-12T11:52:05.564 INFO:tasks.workunit.client.1.smithi093.stdout:9/926: write d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/dae/f130 [2021477,77990] 0 2023-12-12T11:52:05.565 INFO:tasks.workunit.client.0.smithi063.stdout:3/601: unlink d4/d23/d6b/d90/f82 0 2023-12-12T11:52:05.565 INFO:tasks.workunit.client.0.smithi063.stdout:3/602: chown d4/d23/c47 4760455 1 2023-12-12T11:52:05.574 INFO:tasks.workunit.client.1.smithi093.stdout:2/912: sync 2023-12-12T11:52:05.574 INFO:tasks.workunit.client.1.smithi093.stdout:2/913: readlink d5/d14/d2d/l35 0 2023-12-12T11:52:05.574 INFO:tasks.workunit.client.0.smithi063.stdout:6/705: getdents d9/d10/d2a/de7/d86 0 2023-12-12T11:52:05.578 INFO:tasks.workunit.client.0.smithi063.stdout:5/695: link d7/fa7 d7/d10/d2b/d3c/d42/d76/fd3 0 2023-12-12T11:52:05.578 INFO:tasks.workunit.client.0.smithi063.stdout:8/742: dwrite d4/f42 [0,4194304] 0 2023-12-12T11:52:05.578 INFO:tasks.workunit.client.0.smithi063.stdout:8/743: write d4/de/d3b/d62/d36/d57/f78 [8404761,99834] 0 2023-12-12T11:52:05.582 INFO:tasks.workunit.client.1.smithi093.stdout:0/930: getdents d5/d21/d27/d3a/d9a 0 2023-12-12T11:52:05.582 INFO:tasks.workunit.client.1.smithi093.stdout:3/895: sync 2023-12-12T11:52:05.584 INFO:tasks.workunit.client.0.smithi063.stdout:2/568: mkdir d0/d1a/dba 0 2023-12-12T11:52:05.587 INFO:tasks.workunit.client.1.smithi093.stdout:7/868: getdents da 0 2023-12-12T11:52:05.589 INFO:tasks.workunit.client.0.smithi063.stdout:3/603: write d4/df/d1a/f2b [73988,7209] 0 2023-12-12T11:52:05.589 INFO:tasks.workunit.client.0.smithi063.stdout:3/604: chown d4/df/d1a/d1c/d3b/d52/d74/lad 0 1 2023-12-12T11:52:05.589 INFO:tasks.workunit.client.0.smithi063.stdout:4/694: rmdir d2/d8/db3 39 2023-12-12T11:52:05.592 INFO:tasks.workunit.client.1.smithi093.stdout:1/925: rename d4/dc/cbe to d4/d1a/d1b/d26/d31/ddb/de2/c139 0 2023-12-12T11:52:05.592 INFO:tasks.workunit.client.1.smithi093.stdout:2/914: write d5/d14/d2d/d12/f2c [4020877,91420] 0 2023-12-12T11:52:05.592 INFO:tasks.workunit.client.1.smithi093.stdout:1/926: fdatasync d4/d81/dfc/f10d 0 2023-12-12T11:52:05.592 INFO:tasks.workunit.client.1.smithi093.stdout:1/927: chown d4/c30 3 1 2023-12-12T11:52:05.592 INFO:tasks.workunit.client.1.smithi093.stdout:2/915: write d5/d31/dbc/fd4 [589968,66972] 0 2023-12-12T11:52:05.595 INFO:tasks.workunit.client.0.smithi063.stdout:7/577: rename de/d33/dd2/d61/f73 to de/d39/d60/d97/daf/fda 0 2023-12-12T11:52:05.597 INFO:tasks.workunit.client.1.smithi093.stdout:5/790: mkdir d0/d7/d36/d38/dce/d111 0 2023-12-12T11:52:05.603 INFO:tasks.workunit.client.0.smithi063.stdout:1/720: mknod d3/d3a/dd7/d16/d24/d4d/d35/ced 0 2023-12-12T11:52:05.604 INFO:tasks.workunit.client.1.smithi093.stdout:3/896: dread df/d22/d49/d69/d78/dad/fa9 [0,4194304] 0 2023-12-12T11:52:05.604 INFO:tasks.workunit.client.1.smithi093.stdout:3/897: truncate df/d22/d49/d69/d78/daf/d3d/fc5 1286947 0 2023-12-12T11:52:05.611 INFO:tasks.workunit.client.1.smithi093.stdout:0/931: write d5/d21/d27/d3a/d9a/fc3 [213227,104589] 0 2023-12-12T11:52:05.611 INFO:tasks.workunit.client.1.smithi093.stdout:0/932: creat d5/dd/d33/f11f x:0 0 0 2023-12-12T11:52:05.611 INFO:tasks.workunit.client.1.smithi093.stdout:7/869: dread da/de/f53 [0,4194304] 0 2023-12-12T11:52:05.613 INFO:tasks.workunit.client.0.smithi063.stdout:2/569: dread d0/ff [0,4194304] 0 2023-12-12T11:52:05.617 INFO:tasks.workunit.client.0.smithi063.stdout:3/605: mknod d4/d23/d6b/cb8 0 2023-12-12T11:52:05.617 INFO:tasks.workunit.client.0.smithi063.stdout:3/606: readlink d4/d23/d6b/l8b 0 2023-12-12T11:52:05.617 INFO:tasks.workunit.client.0.smithi063.stdout:3/607: write d4/df/d1a/f2b [2516706,21296] 0 2023-12-12T11:52:05.618 INFO:tasks.workunit.client.0.smithi063.stdout:4/695: truncate d2/f40 744742 0 2023-12-12T11:52:05.622 INFO:tasks.workunit.client.0.smithi063.stdout:7/578: rename de/l1f to de/d39/d4b/d7b/d7f/ldb 0 2023-12-12T11:52:05.622 INFO:tasks.workunit.client.0.smithi063.stdout:7/579: write de/d22/fc0 [199134,14114] 0 2023-12-12T11:52:05.623 INFO:tasks.workunit.client.0.smithi063.stdout:7/580: write de/d39/d4b/d7b/fbe [432439,108079] 0 2023-12-12T11:52:05.623 INFO:tasks.workunit.client.1.smithi093.stdout:2/916: symlink d5/d14/d2d/d96/l132 0 2023-12-12T11:52:05.623 INFO:tasks.workunit.client.1.smithi093.stdout:5/791: mknod d0/d7/d36/d38/dce/de9/c112 0 2023-12-12T11:52:05.624 INFO:tasks.workunit.client.1.smithi093.stdout:3/898: creat df/d92/dd4/f121 x:0 0 0 2023-12-12T11:52:05.624 INFO:tasks.workunit.client.1.smithi093.stdout:5/792: read d0/d7/d36/db9/f63 [3028962,79371] 0 2023-12-12T11:52:05.624 INFO:tasks.workunit.client.1.smithi093.stdout:3/899: creat df/d25/dd2/f122 x:0 0 0 2023-12-12T11:52:05.625 INFO:tasks.workunit.client.0.smithi063.stdout:1/721: unlink d3/d3a/dd7/d16/d24/d48/d75/d83/d5b/f64 0 2023-12-12T11:52:05.630 INFO:tasks.workunit.client.1.smithi093.stdout:8/946: sync 2023-12-12T11:52:05.631 INFO:tasks.workunit.client.0.smithi063.stdout:2/570: mknod d0/d1a/d48/cbb 0 2023-12-12T11:52:05.642 INFO:tasks.workunit.client.1.smithi093.stdout:7/870: mknod da/d15/d59/df0/c12c 0 2023-12-12T11:52:05.644 INFO:tasks.workunit.client.0.smithi063.stdout:8/744: rmdir d4/d55/d52 39 2023-12-12T11:52:05.650 INFO:tasks.workunit.client.1.smithi093.stdout:2/917: rename l2 to d5/d14/d2d/d4c/d54/dc5/d61/l133 0 2023-12-12T11:52:05.651 INFO:tasks.workunit.client.1.smithi093.stdout:9/927: dwrite d1/d23/f9c [0,4194304] 0 2023-12-12T11:52:05.651 INFO:tasks.workunit.client.1.smithi093.stdout:9/928: read d1/d23/d24/d29/d43/d56/d85/dc3/dce/d3e/fed [2889262,43802] 0 2023-12-12T11:52:05.656 INFO:tasks.workunit.client.0.smithi063.stdout:4/696: symlink d2/d8/ddf/le2 0 2023-12-12T11:52:05.657 INFO:tasks.workunit.client.1.smithi093.stdout:5/793: dread d0/d7/d59/fa1 [0,4194304] 0 2023-12-12T11:52:05.658 INFO:tasks.workunit.client.1.smithi093.stdout:5/794: creat d0/d7/d36/db9/d66/d7c/f113 x:0 0 0 2023-12-12T11:52:05.660 INFO:tasks.workunit.client.1.smithi093.stdout:3/900: unlink df/d22/d49/d69/d78/daf/f70 0 2023-12-12T11:52:05.664 INFO:tasks.workunit.client.1.smithi093.stdout:1/928: dwrite d4/d1a/d1b/d26/f27 [4194304,4194304] 0 2023-12-12T11:52:05.664 INFO:tasks.workunit.client.0.smithi063.stdout:9/544: rename d7/d11/d4b/d75/faa to d7/d11/d94/fb4 0 2023-12-12T11:52:05.665 INFO:tasks.workunit.client.0.smithi063.stdout:9/545: creat d7/d11/fb5 x:0 0 0 2023-12-12T11:52:05.665 INFO:tasks.workunit.client.0.smithi063.stdout:9/546: creat d7/d20/d45/fb6 x:0 0 0 2023-12-12T11:52:05.666 INFO:tasks.workunit.client.0.smithi063.stdout:5/696: dwrite d7/d10/d2b/d3c/d42/d76/f78 [4194304,4194304] 0 2023-12-12T11:52:05.666 INFO:tasks.workunit.client.0.smithi063.stdout:7/581: mkdir de/d34/d68/da1/dcd/ddc 0 2023-12-12T11:52:05.668 INFO:tasks.workunit.client.1.smithi093.stdout:7/871: symlink da/d8e/daf/l12d 0 2023-12-12T11:52:05.671 INFO:tasks.workunit.client.0.smithi063.stdout:1/722: link d3/d3a/dd7/d16/l44 d3/d3a/dd7/d16/lee 0 2023-12-12T11:52:05.671 INFO:tasks.workunit.client.0.smithi063.stdout:1/723: creat d3/d3a/dd7/d16/d24/d4d/d35/d98/fef x:0 0 0 2023-12-12T11:52:05.671 INFO:tasks.workunit.client.0.smithi063.stdout:1/724: fsync d3/d3a/fa3 0 2023-12-12T11:52:05.674 INFO:tasks.workunit.client.0.smithi063.stdout:6/706: dwrite d9/fba [0,4194304] 0 2023-12-12T11:52:05.679 INFO:tasks.workunit.client.1.smithi093.stdout:3/901: dread df/d22/d49/d69/d78/daf/d3d/d42/d8e/de1/fe5 [0,4194304] 0 2023-12-12T11:52:05.682 INFO:tasks.workunit.client.0.smithi063.stdout:6/707: write d9/d10/f96 [121399,86524] 0 2023-12-12T11:52:05.692 INFO:tasks.workunit.client.0.smithi063.stdout:8/745: write d4/d55/f34 [734572,96448] 0 2023-12-12T11:52:05.694 INFO:tasks.workunit.client.0.smithi063.stdout:3/608: rename d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/c5c to d4/df/d1a/d1c/d3b/cb9 0 2023-12-12T11:52:05.695 INFO:tasks.workunit.client.1.smithi093.stdout:7/872: read da/d15/d19/d90/d7d/f88 [6512108,28679] 0 2023-12-12T11:52:05.695 INFO:tasks.workunit.client.1.smithi093.stdout:7/873: write da/d15/d2d/f51 [1580566,56594] 0 2023-12-12T11:52:05.695 INFO:tasks.workunit.client.1.smithi093.stdout:7/874: chown da/de/d46/d4f/fa8 2273483 1 2023-12-12T11:52:05.695 INFO:tasks.workunit.client.1.smithi093.stdout:2/918: creat d5/d115/f134 x:0 0 0 2023-12-12T11:52:05.699 INFO:tasks.workunit.client.1.smithi093.stdout:8/947: dwrite d3/d1a/d1f/d59/fd8 [0,4194304] 0 2023-12-12T11:52:05.702 INFO:tasks.workunit.client.1.smithi093.stdout:8/948: write d3/d1a/d1f/d29/d63/ff5 [1384369,58566] 0 2023-12-12T11:52:05.702 INFO:tasks.workunit.client.1.smithi093.stdout:8/949: fsync d3/d1a/d1f/d29/d3a/f5c 0 2023-12-12T11:52:05.703 INFO:tasks.workunit.client.1.smithi093.stdout:9/929: creat d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/d42/f136 x:0 0 0 2023-12-12T11:52:05.709 INFO:tasks.workunit.client.0.smithi063.stdout:0/674: dwrite d0/d1a/d23/d34/fd5 [0,4194304] 0 2023-12-12T11:52:05.710 INFO:tasks.workunit.client.0.smithi063.stdout:5/697: symlink d7/d10/d2b/d3c/d27/ld4 0 2023-12-12T11:52:05.716 INFO:tasks.workunit.client.0.smithi063.stdout:9/547: write d7/d11/d4b/f90 [896482,74899] 0 2023-12-12T11:52:05.718 INFO:tasks.workunit.client.1.smithi093.stdout:1/929: dwrite d4/d1a/d73/f60 [4194304,4194304] 0 2023-12-12T11:52:05.718 INFO:tasks.workunit.client.1.smithi093.stdout:1/930: fdatasync d4/d85/f100 0 2023-12-12T11:52:05.718 INFO:tasks.workunit.client.1.smithi093.stdout:1/931: write d4/d1a/d1b/d26/d31/ddb/f12b [919278,39476] 0 2023-12-12T11:52:05.718 INFO:tasks.workunit.client.1.smithi093.stdout:1/932: fdatasync d4/f11a 0 2023-12-12T11:52:05.719 INFO:tasks.workunit.client.0.smithi063.stdout:0/675: dread d0/d1a/d23/d34/d42/d99/fc7 [0,4194304] 0 2023-12-12T11:52:05.720 INFO:tasks.workunit.client.0.smithi063.stdout:7/582: getdents de/d33/dd2 0 2023-12-12T11:52:05.727 INFO:tasks.workunit.client.1.smithi093.stdout:5/795: creat d0/d7/d8/d9e/f114 x:0 0 0 2023-12-12T11:52:05.729 INFO:tasks.workunit.client.1.smithi093.stdout:3/902: mknod df/d25/c123 0 2023-12-12T11:52:05.729 INFO:tasks.workunit.client.1.smithi093.stdout:3/903: chown df/f86 6452 1 2023-12-12T11:52:05.729 INFO:tasks.workunit.client.0.smithi063.stdout:3/609: write d4/df/d1a/f2e [2468931,104754] 0 2023-12-12T11:52:05.729 INFO:tasks.workunit.client.0.smithi063.stdout:3/610: write d4/d23/d6b/f95 [714679,33085] 0 2023-12-12T11:52:05.733 INFO:tasks.workunit.client.1.smithi093.stdout:9/930: write d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/f6a [1227915,11590] 0 2023-12-12T11:52:05.779 INFO:tasks.workunit.client.1.smithi093.stdout:9/931: creat d1/d23/d24/d29/d43/d56/d85/dc3/dce/d3e/f137 x:0 0 0 2023-12-12T11:52:05.781 INFO:tasks.workunit.client.0.smithi063.stdout:8/746: dwrite d4/d24/d38/d45/d5b/d92/d65/fea [0,4194304] 0 2023-12-12T11:52:05.781 INFO:tasks.workunit.client.0.smithi063.stdout:8/747: fdatasync d4/de/d1e/f64 0 2023-12-12T11:52:05.781 INFO:tasks.workunit.client.0.smithi063.stdout:2/571: rmdir d0/d41/daf 39 2023-12-12T11:52:05.782 INFO:tasks.workunit.client.0.smithi063.stdout:2/572: write d0/d1a/d3a/d85/faa [1045491,96440] 0 2023-12-12T11:52:05.782 INFO:tasks.workunit.client.0.smithi063.stdout:6/708: rename d9/d10/d2a/de7/d8a/dd9 to d9/d10/d2a/de7/d8a/df8 0 2023-12-12T11:52:05.782 INFO:tasks.workunit.client.0.smithi063.stdout:6/709: fsync d9/d10/d5c/d5e/fab 0 2023-12-12T11:52:05.782 INFO:tasks.workunit.client.0.smithi063.stdout:6/710: chown d9/d10/d2a/de7/d86/la2 13 1 2023-12-12T11:52:05.782 INFO:tasks.workunit.client.0.smithi063.stdout:1/725: rename d3/d3a/fa3 to d3/d3a/dd7/d16/d24/d4d/ff0 0 2023-12-12T11:52:05.782 INFO:tasks.workunit.client.0.smithi063.stdout:1/726: chown d3/d3a/dd7/d16/d24/d48 0 1 2023-12-12T11:52:05.782 INFO:tasks.workunit.client.0.smithi063.stdout:5/698: creat d7/de/fd5 x:0 0 0 2023-12-12T11:52:05.782 INFO:tasks.workunit.client.0.smithi063.stdout:5/699: chown d7/de/f25 83262215 1 2023-12-12T11:52:05.783 INFO:tasks.workunit.client.1.smithi093.stdout:2/919: mkdir d5/d14/d2d/d12/d135 0 2023-12-12T11:52:05.783 INFO:tasks.workunit.client.1.smithi093.stdout:3/904: dread df/d22/d49/d69/d78/daf/d3d/f114 [0,4194304] 0 2023-12-12T11:52:05.783 INFO:tasks.workunit.client.1.smithi093.stdout:1/933: write d4/d1a/d83/d9a/f138 [3575988,84949] 0 2023-12-12T11:52:05.783 INFO:tasks.workunit.client.1.smithi093.stdout:2/920: dread d5/d14/d2d/d4c/d54/dc5/faa [0,4194304] 0 2023-12-12T11:52:05.783 INFO:tasks.workunit.client.1.smithi093.stdout:2/921: creat d5/d14/d2d/d4c/d76/f136 x:0 0 0 2023-12-12T11:52:05.783 INFO:tasks.workunit.client.1.smithi093.stdout:2/922: write d5/d14/d2d/d4c/d54/dc5/d55/f8e [3118855,117773] 0 2023-12-12T11:52:05.783 INFO:tasks.workunit.client.1.smithi093.stdout:2/923: fsync d5/d14/d2d/d4c/d54/d67/f112 0 2023-12-12T11:52:05.783 INFO:tasks.workunit.client.1.smithi093.stdout:2/924: getdents d5/d14/d2d/d12/d25/d7a/d7e/da5/d12a 0 2023-12-12T11:52:05.783 INFO:tasks.workunit.client.1.smithi093.stdout:2/925: write d5/d14/d2d/d4c/d76/dc6/d118/f104 [3316165,126314] 0 2023-12-12T11:52:05.783 INFO:tasks.workunit.client.1.smithi093.stdout:5/796: mknod d0/d7/d85/da0/c115 0 2023-12-12T11:52:05.783 INFO:tasks.workunit.client.1.smithi093.stdout:7/875: rmdir da/d15/d2d/d2f 39 2023-12-12T11:52:05.783 INFO:tasks.workunit.client.1.smithi093.stdout:0/933: sync 2023-12-12T11:52:05.783 INFO:tasks.workunit.client.1.smithi093.stdout:7/876: readlink da/de/l2a 0 2023-12-12T11:52:05.784 INFO:tasks.workunit.client.1.smithi093.stdout:0/934: truncate d5/dd/d33/f3c 4405120 0 2023-12-12T11:52:05.784 INFO:tasks.workunit.client.1.smithi093.stdout:3/905: mknod df/d25/d6b/c124 0 2023-12-12T11:52:05.784 INFO:tasks.workunit.client.1.smithi093.stdout:3/906: fdatasync df/d22/d49/d69/d78/daf/d3d/d42/d8e/de1/fe5 0 2023-12-12T11:52:05.784 INFO:tasks.workunit.client.1.smithi093.stdout:3/907: truncate df/dc6/fdf 172384 0 2023-12-12T11:52:05.784 INFO:tasks.workunit.client.1.smithi093.stdout:3/908: chown df/d25/l50 2162 1 2023-12-12T11:52:05.784 INFO:tasks.workunit.client.0.smithi063.stdout:0/676: mkdir d0/d1a/d23/d2e/dd4/ddc 0 2023-12-12T11:52:05.784 INFO:tasks.workunit.client.0.smithi063.stdout:0/677: stat d0/d7/ff 0 2023-12-12T11:52:05.786 INFO:tasks.workunit.client.1.smithi093.stdout:1/934: rename d4/d1a/d1b/dbf/d110/d136 to d4/d1a/d73/dd4/d13a 0 2023-12-12T11:52:05.792 INFO:tasks.workunit.client.1.smithi093.stdout:2/926: truncate d5/d14/d2d/d12/d44/f57 5755946 0 2023-12-12T11:52:05.792 INFO:tasks.workunit.client.1.smithi093.stdout:2/927: creat d5/d14/d2d/d8b/da2/f137 x:0 0 0 2023-12-12T11:52:05.792 INFO:tasks.workunit.client.1.smithi093.stdout:2/928: fdatasync d5/d14/d2d/d4c/d54/d67/d69/d6c/f5a 0 2023-12-12T11:52:05.792 INFO:tasks.workunit.client.0.smithi063.stdout:1/727: dwrite d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2/f7a [4194304,4194304] 0 2023-12-12T11:52:05.792 INFO:tasks.workunit.client.0.smithi063.stdout:1/728: creat d3/d3a/dd7/d16/d24/d48/d75/ff1 x:0 0 0 2023-12-12T11:52:05.792 INFO:tasks.workunit.client.0.smithi063.stdout:1/729: dread - d3/d3a/dd7/d16/d24/d4d/d35/d98/fdb zero size 2023-12-12T11:52:05.794 INFO:tasks.workunit.client.0.smithi063.stdout:2/573: creat d0/d1a/d1e/d64/fbc x:0 0 0 2023-12-12T11:52:05.794 INFO:tasks.workunit.client.0.smithi063.stdout:2/574: readlink d0/l12 0 2023-12-12T11:52:05.794 INFO:tasks.workunit.client.0.smithi063.stdout:2/575: readlink d0/d1a/d1e/l71 0 2023-12-12T11:52:05.795 INFO:tasks.workunit.client.1.smithi093.stdout:5/797: symlink d0/d7/d8/l116 0 2023-12-12T11:52:05.795 INFO:tasks.workunit.client.1.smithi093.stdout:5/798: write d0/d7/d36/db9/d66/f110 [896029,117658] 0 2023-12-12T11:52:05.797 INFO:tasks.workunit.client.1.smithi093.stdout:7/877: symlink da/d15/d19/d90/l12e 0 2023-12-12T11:52:05.797 INFO:tasks.workunit.client.1.smithi093.stdout:7/878: chown da/d15/ddd/fee 1144824340 1 2023-12-12T11:52:05.801 INFO:tasks.workunit.client.0.smithi063.stdout:3/611: rename d4/df/d1a/d1c/c8d to d4/df/d1a/d1c/d57/cba 0 2023-12-12T11:52:05.801 INFO:tasks.workunit.client.0.smithi063.stdout:2/576: read d0/d1a/d48/f3f [6158926,129084] 0 2023-12-12T11:52:05.803 INFO:tasks.workunit.client.1.smithi093.stdout:0/935: unlink d5/d21/d2f/d54/f73 0 2023-12-12T11:52:05.808 INFO:tasks.workunit.client.0.smithi063.stdout:5/700: truncate d7/d28/d43/d49/f97 436619 0 2023-12-12T11:52:05.813 INFO:tasks.workunit.client.1.smithi093.stdout:5/799: dread d0/d7/d36/d29/d76/fc1 [0,4194304] 0 2023-12-12T11:52:05.820 INFO:tasks.workunit.client.0.smithi063.stdout:9/548: getdents d7/d11/d4b/d75 0 2023-12-12T11:52:05.820 INFO:tasks.workunit.client.0.smithi063.stdout:9/549: stat d7/d11/fa0 0 2023-12-12T11:52:05.824 INFO:tasks.workunit.client.1.smithi093.stdout:3/909: unlink df/l1e 0 2023-12-12T11:52:05.827 INFO:tasks.workunit.client.0.smithi063.stdout:8/748: dwrite d4/de/d3b/d62/d36/d7f/f87 [0,4194304] 0 2023-12-12T11:52:05.829 INFO:tasks.workunit.client.0.smithi063.stdout:1/730: creat d3/d3a/dd7/d16/ff2 x:0 0 0 2023-12-12T11:52:05.829 INFO:tasks.workunit.client.0.smithi063.stdout:1/731: fsync f2 0 2023-12-12T11:52:05.835 INFO:tasks.workunit.client.0.smithi063.stdout:0/678: link d0/d7/d27/d1f/dc4/d67/l7d d0/d1a/d23/d2e/dd7/ldd 0 2023-12-12T11:52:05.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.842+0000 7fd63cda2700 1 -- 172.21.15.63:0/3193236303 --> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd61c000bf0 con 0x7fd61806af10 2023-12-12T11:52:05.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.843+0000 7fd62f7fe700 1 -- 172.21.15.63:0/3193236303 <== mgr.24471 v2:172.21.15.93:6828/3441331233 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fd61c000bf0 con 0x7fd61806af10 2023-12-12T11:52:05.846 INFO:tasks.workunit.client.1.smithi093.stdout:2/929: rename d5/d14/d2d/d4c/d76/dc6/d118/d56/d6f to d5/d14/d2d/d8b/da3/d138 0 2023-12-12T11:52:05.846 INFO:tasks.workunit.client.1.smithi093.stdout:3/910: rename df/d25/d2c/d85 to df/d25/d2c/d85/dac/dc2/d125 22 2023-12-12T11:52:05.846 INFO:tasks.workunit.client.1.smithi093.stdout:3/911: creat df/d25/dd2/f126 x:0 0 0 2023-12-12T11:52:05.846 INFO:tasks.workunit.client.1.smithi093.stdout:3/912: write df/d25/d2c/f9b [2228551,16144] 0 2023-12-12T11:52:05.847 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:52:05.847 INFO:teuthology.orchestra.run.smithi063.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dbb46fd2dbbe029cfba763f2b7c769e980f86b63e74be0c72e188909e20b81f3", 2023-12-12T11:52:05.847 INFO:teuthology.orchestra.run.smithi063.stdout: "in_progress": true, 2023-12-12T11:52:05.848 INFO:teuthology.orchestra.run.smithi063.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-12T11:52:05.848 INFO:teuthology.orchestra.run.smithi063.stdout: "services_complete": [], 2023-12-12T11:52:05.848 INFO:teuthology.orchestra.run.smithi063.stdout: "progress": "1/21 daemons upgraded", 2023-12-12T11:52:05.848 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "", 2023-12-12T11:52:05.848 INFO:teuthology.orchestra.run.smithi063.stdout: "is_paused": false 2023-12-12T11:52:05.848 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:52:05.848 INFO:tasks.workunit.client.1.smithi093.stdout:7/879: creat da/d8e/f12f x:0 0 0 2023-12-12T11:52:05.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.848+0000 7fd63cda2700 1 -- 172.21.15.63:0/3193236303 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7fd61806af10 msgr2=0x7fd61806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:05.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.848+0000 7fd63cda2700 1 --2- 172.21.15.63:0/3193236303 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7fd61806af10 0x7fd61806d3c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd628000c00 tx=0x7fd628009e30 comp rx=0 tx=0).stop 2023-12-12T11:52:05.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.849+0000 7fd63cda2700 1 -- 172.21.15.63:0/3193236303 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6380fde00 msgr2=0x7fd63810b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:05.852 INFO:tasks.workunit.client.0.smithi063.stdout:1/732: dread d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2/f7a [4194304,4194304] 0 2023-12-12T11:52:05.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.849+0000 7fd63cda2700 1 --2- 172.21.15.63:0/3193236303 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6380fde00 0x7fd63810b690 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd62000b790 tx=0x7fd620009250 comp rx=0 tx=0).stop 2023-12-12T11:52:05.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.849+0000 7fd63cda2700 1 -- 172.21.15.63:0/3193236303 shutdown_connections 2023-12-12T11:52:05.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.849+0000 7fd63cda2700 1 --2- 172.21.15.63:0/3193236303 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7fd61806af10 0x7fd61806d3c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:05.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.849+0000 7fd63cda2700 1 --2- 172.21.15.63:0/3193236303 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd6380fcbf0 0x7fd63810b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:05.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.849+0000 7fd63cda2700 1 --2- 172.21.15.63:0/3193236303 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6380fde00 0x7fd63810b690 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:05.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.849+0000 7fd63cda2700 1 -- 172.21.15.63:0/3193236303 >> 172.21.15.63:0/3193236303 conn(0x7fd6380f82d0 msgr2=0x7fd6380ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:52:05.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.850+0000 7fd63cda2700 1 -- 172.21.15.63:0/3193236303 shutdown_connections 2023-12-12T11:52:05.853 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:05.850+0000 7fd63cda2700 1 -- 172.21.15.63:0/3193236303 wait complete. 2023-12-12T11:52:05.856 INFO:tasks.workunit.client.1.smithi093.stdout:8/950: sync 2023-12-12T11:52:05.859 INFO:tasks.workunit.client.1.smithi093.stdout:0/936: mknod d5/d21/d27/d3a/c120 0 2023-12-12T11:52:05.861 INFO:tasks.workunit.client.0.smithi063.stdout:0/679: creat d0/d1a/d23/d34/fde x:0 0 0 2023-12-12T11:52:05.861 INFO:tasks.workunit.client.0.smithi063.stdout:2/577: dread d0/d1a/d1e/f60 [0,4194304] 0 2023-12-12T11:52:05.861 INFO:tasks.workunit.client.0.smithi063.stdout:2/578: creat d0/fbd x:0 0 0 2023-12-12T11:52:05.862 INFO:tasks.workunit.client.0.smithi063.stdout:6/711: dwrite d9/d10/d5c/d5e/fd8 [0,4194304] 0 2023-12-12T11:52:05.863 INFO:tasks.workunit.client.0.smithi063.stdout:2/579: read d0/d1a/d48/d56/f58 [194393,24285] 0 2023-12-12T11:52:05.863 INFO:tasks.workunit.client.0.smithi063.stdout:2/580: dread - d0/d69/f6e zero size 2023-12-12T11:52:05.863 INFO:tasks.workunit.client.0.smithi063.stdout:2/581: readlink d0/d1a/d26/l52 0 2023-12-12T11:52:05.864 INFO:tasks.workunit.client.1.smithi093.stdout:5/800: link d0/d7/d8/d9e/f78 d0/d7/d59/f117 0 2023-12-12T11:52:05.867 INFO:tasks.workunit.client.1.smithi093.stdout:1/935: rmdir d4/d1a/d1b/d26/d31/ddb 39 2023-12-12T11:52:05.867 INFO:tasks.workunit.client.1.smithi093.stdout:1/936: chown d4/d1a/d1b/d26/d31/fba 14853675 1 2023-12-12T11:52:05.867 INFO:tasks.workunit.client.1.smithi093.stdout:1/937: fsync d4/d1a/f131 0 2023-12-12T11:52:05.867 INFO:tasks.workunit.client.1.smithi093.stdout:1/938: truncate d4/d81/dfc/f10d 65056 0 2023-12-12T11:52:05.873 INFO:tasks.workunit.client.0.smithi063.stdout:8/749: getdents d4/d24/d38/d45 0 2023-12-12T11:52:05.873 INFO:tasks.workunit.client.0.smithi063.stdout:8/750: getdents d4/d24/d38/ddc/de2 0 2023-12-12T11:52:05.884 INFO:tasks.workunit.client.0.smithi063.stdout:9/550: write d7/d15/f31 [1313053,45266] 0 2023-12-12T11:52:05.885 INFO:tasks.workunit.client.1.smithi093.stdout:7/880: symlink da/d15/d19/d4c/l130 0 2023-12-12T11:52:05.889 INFO:tasks.workunit.client.0.smithi063.stdout:1/733: rename d3/d3a/d52/c77 to d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2/daf/cf3 0 2023-12-12T11:52:05.889 INFO:tasks.workunit.client.0.smithi063.stdout:1/734: readlink d3/d3a/dd7/d16/d24/d48/d75/d83/d81/ld1 0 2023-12-12T11:52:05.889 INFO:tasks.workunit.client.0.smithi063.stdout:2/582: write d0/d1a/d1e/f2e [3627897,106397] 0 2023-12-12T11:52:05.889 INFO:tasks.workunit.client.0.smithi063.stdout:2/583: chown d0/d1a/d1e/f60 1935773 1 2023-12-12T11:52:05.891 INFO:tasks.workunit.client.1.smithi093.stdout:5/801: write d0/f5 [2419743,2202] 0 2023-12-12T11:52:05.892 INFO:tasks.workunit.client.1.smithi093.stdout:5/802: chown d0/dec/c9b 995670692 1 2023-12-12T11:52:05.893 INFO:tasks.workunit.client.1.smithi093.stdout:8/951: rename d3/d1a/d1f/d29/d63/f65 to d3/d73/f135 0 2023-12-12T11:52:05.893 INFO:tasks.workunit.client.1.smithi093.stdout:8/952: chown d3/d73/fb6 0 1 2023-12-12T11:52:05.893 INFO:tasks.workunit.client.1.smithi093.stdout:7/881: unlink da/d2e/c76 0 2023-12-12T11:52:05.894 INFO:tasks.workunit.client.1.smithi093.stdout:1/939: creat d4/dc/d128/f13b x:0 0 0 2023-12-12T11:52:05.894 INFO:tasks.workunit.client.0.smithi063.stdout:0/680: mkdir d0/d1a/d23/ddf 0 2023-12-12T11:52:05.894 INFO:tasks.workunit.client.1.smithi093.stdout:0/937: dread d5/d78/da4/fcc [0,4194304] 0 2023-12-12T11:52:05.896 INFO:tasks.workunit.client.1.smithi093.stdout:9/932: sync 2023-12-12T11:52:05.898 INFO:tasks.workunit.client.1.smithi093.stdout:7/882: mkdir da/d15/ddd/d131 0 2023-12-12T11:52:05.900 INFO:tasks.workunit.client.1.smithi093.stdout:8/953: mknod d3/d1a/d1f/d59/ddb/c136 0 2023-12-12T11:52:05.902 INFO:tasks.workunit.client.1.smithi093.stdout:0/938: getdents d5/d21/d2f/dae 0 2023-12-12T11:52:05.902 INFO:tasks.workunit.client.0.smithi063.stdout:3/612: dwrite d4/df/d1a/d1c/d3b/d50/d61/f94 [0,4194304] 0 2023-12-12T11:52:05.905 INFO:tasks.workunit.client.1.smithi093.stdout:8/954: getdents d3/d1a/d1f/daf 0 2023-12-12T11:52:05.908 INFO:tasks.workunit.client.1.smithi093.stdout:1/940: write d4/d1c/f21 [551677,2877] 0 2023-12-12T11:52:05.910 INFO:tasks.workunit.client.1.smithi093.stdout:3/913: dwrite df/f86 [4194304,4194304] 0 2023-12-12T11:52:05.910 INFO:tasks.workunit.client.1.smithi093.stdout:2/930: dwrite d5/d14/d2d/d4c/d76/dc6/d118/d4e/f8a [0,4194304] 0 2023-12-12T11:52:05.910 INFO:tasks.workunit.client.1.smithi093.stdout:2/931: fdatasync d5/d14/d2d/d4c/d54/d67/d69/dde/fd1 0 2023-12-12T11:52:05.914 INFO:tasks.workunit.client.1.smithi093.stdout:8/955: getdents d3/d8/d88 0 2023-12-12T11:52:05.915 INFO:tasks.workunit.client.1.smithi093.stdout:8/956: truncate d3/d8/d88/fb4 1349433 0 2023-12-12T11:52:05.918 INFO:tasks.workunit.client.0.smithi063.stdout:8/751: mkdir d4/d24/d38/d45/d5b/d92/deb 0 2023-12-12T11:52:05.918 INFO:tasks.workunit.client.0.smithi063.stdout:8/752: chown d4/d24/db3/fd2 1 1 2023-12-12T11:52:05.929 INFO:tasks.workunit.client.1.smithi093.stdout:0/939: rmdir d5/dd/d14/d99 39 2023-12-12T11:52:05.930 INFO:tasks.workunit.client.1.smithi093.stdout:0/940: dread - d5/dd/d14/d26/d58/dab/f10a zero size 2023-12-12T11:52:05.930 INFO:tasks.workunit.client.0.smithi063.stdout:2/584: link d0/d1a/d1e/l7a d0/d1a/d48/d56/lbe 0 2023-12-12T11:52:05.934 INFO:tasks.workunit.client.0.smithi063.stdout:6/712: rename d9/d10/d7a/ff7 to d9/d68/d94/ff9 0 2023-12-12T11:52:05.939 INFO:tasks.workunit.client.0.smithi063.stdout:3/613: write d4/df/d1a/d1c/d3b/d50/d9f/fa9 [1480737,56852] 0 2023-12-12T11:52:05.941 INFO:tasks.workunit.client.0.smithi063.stdout:0/681: dread d0/d7/d27/d1f/f2c [0,4194304] 0 2023-12-12T11:52:05.941 INFO:tasks.workunit.client.0.smithi063.stdout:5/701: dwrite d7/f1a [0,4194304] 0 2023-12-12T11:52:05.941 INFO:tasks.workunit.client.0.smithi063.stdout:5/702: stat d7/d10/d2b/d3c/l37 0 2023-12-12T11:52:05.942 INFO:tasks.workunit.client.1.smithi093.stdout:5/803: dwrite d0/d7/d36/db9/d66/d7c/db5/fdd [0,4194304] 0 2023-12-12T11:52:05.942 INFO:tasks.workunit.client.1.smithi093.stdout:5/804: dread - d0/d7/d8/de/f86 zero size 2023-12-12T11:52:05.942 INFO:tasks.workunit.client.1.smithi093.stdout:1/941: symlink d4/d1a/d73/dd4/d13a/l13c 0 2023-12-12T11:52:05.942 INFO:tasks.workunit.client.0.smithi063.stdout:6/713: write d9/f43 [980877,7496] 0 2023-12-12T11:52:05.947 INFO:tasks.workunit.client.1.smithi093.stdout:0/941: dread d5/fa [4194304,4194304] 0 2023-12-12T11:52:05.949 INFO:tasks.workunit.client.0.smithi063.stdout:8/753: mknod d4/d24/d38/dd8/cec 0 2023-12-12T11:52:05.954 INFO:tasks.workunit.client.1.smithi093.stdout:2/932: creat d5/d14/d2d/d4c/f139 x:0 0 0 2023-12-12T11:52:05.954 INFO:tasks.workunit.client.1.smithi093.stdout:2/933: fsync d5/f19 0 2023-12-12T11:52:05.955 INFO:tasks.workunit.client.0.smithi063.stdout:9/551: rename d7/d20/d3f/f97 to d7/d11/d94/fb7 0 2023-12-12T11:52:05.958 INFO:tasks.workunit.client.1.smithi093.stdout:9/933: rename d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/d42/dd3 to d1/d23/d24/d29/d43/d56/de9/d138 0 2023-12-12T11:52:05.961 INFO:tasks.workunit.client.0.smithi063.stdout:3/614: mkdir d4/df/d1a/d1c/d3b/d52/d78/dbb 0 2023-12-12T11:52:05.963 INFO:tasks.workunit.client.0.smithi063.stdout:0/682: chown d0/d7/d27/fc5 1102 1 2023-12-12T11:52:05.967 INFO:tasks.workunit.client.0.smithi063.stdout:8/754: unlink d4/d24/d38/d45/d5b/d92/d65/fea 0 2023-12-12T11:52:05.972 INFO:tasks.workunit.client.1.smithi093.stdout:5/805: mknod d0/d7/d59/c118 0 2023-12-12T11:52:05.973 INFO:tasks.workunit.client.1.smithi093.stdout:2/934: rmdir d5/d14/d2d/d12/d25/d7a/d7e/da5 39 2023-12-12T11:52:05.974 INFO:tasks.workunit.client.0.smithi063.stdout:9/552: rmdir d7/d20/d45/d46/d51/d64 39 2023-12-12T11:52:05.977 INFO:tasks.workunit.client.0.smithi063.stdout:6/714: rename d9/d10/f58 to d9/d10/d2a/dc3/ffa 0 2023-12-12T11:52:05.977 INFO:tasks.workunit.client.0.smithi063.stdout:6/715: chown d9/d10/f93 1062712261 1 2023-12-12T11:52:05.987 INFO:tasks.workunit.client.1.smithi093.stdout:2/935: dread d5/d14/d2d/d12/d25/d7a/f81 [0,4194304] 0 2023-12-12T11:52:05.988 INFO:tasks.workunit.client.1.smithi093.stdout:8/957: rename d3/d1a/d1f/d59/ddb/d11a to d3/d1a/d1f/d29/d3a/da0/dcb/d109/d137 0 2023-12-12T11:52:05.992 INFO:tasks.workunit.client.1.smithi093.stdout:5/806: truncate d0/d7/d36/db9/d66/d7c/fd3 180137 0 2023-12-12T11:52:05.993 INFO:tasks.workunit.client.1.smithi093.stdout:5/807: chown d0/d7/d8/de/f28 47 1 2023-12-12T11:52:05.993 INFO:tasks.workunit.client.1.smithi093.stdout:3/914: dwrite df/d22/d49/d69/d78/daf/d3d/def/fa1 [0,4194304] 0 2023-12-12T11:52:05.993 INFO:tasks.workunit.client.1.smithi093.stdout:9/934: dread d1/d23/d24/d29/d43/d58/f78 [0,4194304] 0 2023-12-12T11:52:05.994 INFO:tasks.workunit.client.0.smithi063.stdout:3/615: getdents d4/d23 0 2023-12-12T11:52:05.994 INFO:tasks.workunit.client.0.smithi063.stdout:5/703: write d7/f1a [3716700,79862] 0 2023-12-12T11:52:05.994 INFO:tasks.workunit.client.0.smithi063.stdout:9/553: dread d7/d11/d4b/f68 [0,4194304] 0 2023-12-12T11:52:05.994 INFO:tasks.workunit.client.0.smithi063.stdout:9/554: write d7/d15/f23 [4725914,79053] 0 2023-12-12T11:52:05.995 INFO:tasks.workunit.client.1.smithi093.stdout:7/883: dwrite da/de/d46/fbe [0,4194304] 0 2023-12-12T11:52:05.996 INFO:tasks.workunit.client.0.smithi063.stdout:1/735: dwrite d3/d3a/dd7/d16/d17/d4b/fd8 [0,4194304] 0 2023-12-12T11:52:05.996 INFO:tasks.workunit.client.0.smithi063.stdout:1/736: dread - d3/d3a/fbe zero size 2023-12-12T11:52:05.996 INFO:tasks.workunit.client.0.smithi063.stdout:1/737: chown d3/d3a/dd7/d16/d4f/da7/dca/d6f/fd3 232 1 2023-12-12T11:52:05.997 INFO:tasks.workunit.client.1.smithi093.stdout:1/942: rename d4/d1a/d1b/d26/d31/ddb/de2/c139 to d4/dc/d7a/d9c/c13d 0 2023-12-12T11:52:06.000 INFO:tasks.workunit.client.1.smithi093.stdout:8/958: mkdir d3/d138 0 2023-12-12T11:52:06.003 INFO:tasks.workunit.client.0.smithi063.stdout:3/616: rmdir d4/df/d1a/d1c/d57 39 2023-12-12T11:52:06.003 INFO:tasks.workunit.client.1.smithi093.stdout:8/959: read d3/d1a/d1f/d29/d3a/d40/f61 [207924,42574] 0 2023-12-12T11:52:06.005 INFO:tasks.workunit.client.0.smithi063.stdout:3/617: stat d4/d23/d6b/l8b 0 2023-12-12T11:52:06.005 INFO:tasks.workunit.client.1.smithi093.stdout:5/808: truncate d0/d7/d59/fa1 870046 0 2023-12-12T11:52:06.006 INFO:tasks.workunit.client.1.smithi093.stdout:5/809: creat d0/d7/d36/db9/d66/d7c/f119 x:0 0 0 2023-12-12T11:52:06.008 INFO:tasks.workunit.client.0.smithi063.stdout:2/585: dwrite d0/d1a/d1e/d64/f89 [0,4194304] 0 2023-12-12T11:52:06.011 INFO:tasks.workunit.client.1.smithi093.stdout:9/935: mkdir d1/d23/d6b/d139 0 2023-12-12T11:52:06.011 INFO:tasks.workunit.client.1.smithi093.stdout:9/936: write d1/d23/d24/d29/d43/d56/d85/dc3/dce/d3e/f112 [1208222,9226] 0 2023-12-12T11:52:06.011 INFO:tasks.workunit.client.1.smithi093.stdout:9/937: chown d1/d23/dd5 7979407 1 2023-12-12T11:52:06.011 INFO:tasks.workunit.client.1.smithi093.stdout:9/938: chown d1/d23/d24/d29/d43/d58/ffb 110982933 1 2023-12-12T11:52:06.012 INFO:tasks.workunit.client.0.smithi063.stdout:9/555: creat d7/d20/d45/d46/d51/d64/fb8 x:0 0 0 2023-12-12T11:52:06.015 INFO:tasks.workunit.client.0.smithi063.stdout:6/716: write d9/d10/d5c/d5e/f63 [8211771,107110] 0 2023-12-12T11:52:06.021 INFO:tasks.workunit.client.0.smithi063.stdout:1/738: dread d3/d3a/dd7/d16/d4f/fcf [0,4194304] 0 2023-12-12T11:52:06.021 INFO:tasks.workunit.client.0.smithi063.stdout:1/739: stat d3/d3a/dd7/d16/d17 0 2023-12-12T11:52:06.030 INFO:tasks.workunit.client.1.smithi093.stdout:7/884: rmdir da/de/d46 39 2023-12-12T11:52:06.032 INFO:tasks.workunit.client.0.smithi063.stdout:3/618: mkdir d4/df/d1a/d1c/d3b/d52/d78/da5/dbc 0 2023-12-12T11:52:06.032 INFO:tasks.workunit.client.0.smithi063.stdout:3/619: read - d4/df/d1a/d1c/d34/fa6 zero size 2023-12-12T11:52:06.037 INFO:tasks.workunit.client.0.smithi063.stdout:0/683: dwrite d0/d1a/d66/fbb [0,4194304] 0 2023-12-12T11:52:06.037 INFO:tasks.workunit.client.0.smithi063.stdout:0/684: fsync d0/f21 0 2023-12-12T11:52:06.041 INFO:tasks.workunit.client.1.smithi093.stdout:0/942: rename d5/d21/d27/d3a/f4a to d5/d41/d77/d79/d9b/f121 0 2023-12-12T11:52:06.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:05 smithi063 ceph-mon[107117]: pgmap v17: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 227 MiB/s rd, 274 MiB/s wr, 418 op/s 2023-12-12T11:52:06.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:05 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/3679428897' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:52:06.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:05 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:06.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:05 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:06.046 INFO:tasks.workunit.client.1.smithi093.stdout:1/943: mkdir d4/dc/d7a/d9c/da7/d13e 0 2023-12-12T11:52:06.047 INFO:tasks.workunit.client.0.smithi063.stdout:2/586: getdents d0/d1a/d1e 0 2023-12-12T11:52:06.052 INFO:tasks.workunit.client.0.smithi063.stdout:6/717: dread d9/d2c/d61/dcd/ff6 [0,4194304] 0 2023-12-12T11:52:06.052 INFO:tasks.workunit.client.0.smithi063.stdout:6/718: creat d9/d10/d7a/ffb x:0 0 0 2023-12-12T11:52:06.062 INFO:tasks.workunit.client.0.smithi063.stdout:8/755: dwrite d4/de/f43 [0,4194304] 0 2023-12-12T11:52:06.063 INFO:tasks.workunit.client.1.smithi093.stdout:5/810: mknod d0/d7/d36/d38/dce/de9/c11a 0 2023-12-12T11:52:06.065 INFO:tasks.workunit.client.1.smithi093.stdout:8/960: dwrite d3/d8/f96 [0,4194304] 0 2023-12-12T11:52:06.067 INFO:tasks.workunit.client.0.smithi063.stdout:5/704: dwrite d7/d10/f14 [0,4194304] 0 2023-12-12T11:52:06.068 INFO:tasks.workunit.client.0.smithi063.stdout:5/705: readlink d7/d28/d6e/dad/dba/lc1 0 2023-12-12T11:52:06.068 INFO:tasks.workunit.client.0.smithi063.stdout:5/706: write d7/f1a [2506318,47645] 0 2023-12-12T11:52:06.069 INFO:tasks.workunit.client.0.smithi063.stdout:0/685: mkdir d0/d1a/d23/d2e/dd4/ddc/de0 0 2023-12-12T11:52:06.069 INFO:tasks.workunit.client.0.smithi063.stdout:0/686: creat d0/d1a/d23/fe1 x:0 0 0 2023-12-12T11:52:06.070 INFO:tasks.workunit.client.1.smithi093.stdout:9/939: rmdir d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d73 39 2023-12-12T11:52:06.078 INFO:tasks.workunit.client.0.smithi063.stdout:8/756: mkdir d4/d24/d38/dd8/ded 0 2023-12-12T11:52:06.081 INFO:tasks.workunit.client.1.smithi093.stdout:2/936: rename d5/d14/d2d/d12/d25/d7a/d7e/f123 to d5/d31/dbc/f13a 0 2023-12-12T11:52:06.084 INFO:tasks.workunit.client.1.smithi093.stdout:0/943: mkdir d5/dd/d14/d26/d58/d64/d6f/d90/ddf/d122 0 2023-12-12T11:52:06.084 INFO:tasks.workunit.client.1.smithi093.stdout:0/944: readlink d5/d21/d27/d3a/d9a/dc8/ld5 0 2023-12-12T11:52:06.089 INFO:tasks.workunit.client.0.smithi063.stdout:0/687: chown d0/d7/d27/l8f 16333 1 2023-12-12T11:52:06.089 INFO:tasks.workunit.client.0.smithi063.stdout:5/707: read d7/de/f25 [1409694,66656] 0 2023-12-12T11:52:06.089 INFO:tasks.workunit.client.0.smithi063.stdout:0/688: creat d0/d1a/d23/d34/d42/fe2 x:0 0 0 2023-12-12T11:52:06.094 INFO:tasks.workunit.client.1.smithi093.stdout:9/940: mkdir d1/d23/d6b/d139/d13a 0 2023-12-12T11:52:06.095 INFO:tasks.workunit.client.0.smithi063.stdout:0/689: write d0/d7/d27/d19/f51 [5763450,105277] 0 2023-12-12T11:52:06.101 INFO:tasks.workunit.client.1.smithi093.stdout:8/961: dwrite d3/d1a/d1f/f3f [4194304,4194304] 0 2023-12-12T11:52:06.101 INFO:tasks.workunit.client.1.smithi093.stdout:8/962: chown d3/d1a/d1f/d29/d30/c64 32597 1 2023-12-12T11:52:06.101 INFO:tasks.workunit.client.1.smithi093.stdout:7/885: truncate da/de/f30 3713459 0 2023-12-12T11:52:06.101 INFO:tasks.workunit.client.1.smithi093.stdout:0/945: write d5/dd/d14/d26/d58/d64/f97 [7384533,82662] 0 2023-12-12T11:52:06.102 INFO:tasks.workunit.client.0.smithi063.stdout:9/556: dwrite d7/f54 [0,4194304] 0 2023-12-12T11:52:06.102 INFO:tasks.workunit.client.1.smithi093.stdout:7/886: write da/d15/d2d/f34 [5327624,126058] 0 2023-12-12T11:52:06.102 INFO:tasks.workunit.client.1.smithi093.stdout:7/887: creat da/d15/d59/de0/f132 x:0 0 0 2023-12-12T11:52:06.106 INFO:tasks.workunit.client.0.smithi063.stdout:0/690: mknod d0/d7/d27/d1f/dc4/d67/dcb/ce3 0 2023-12-12T11:52:06.106 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.102+0000 7f4f59cde700 1 -- 172.21.15.63:0/3249253395 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f540ffd70 msgr2=0x7f4f541021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:06.106 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.102+0000 7f4f59cde700 1 --2- 172.21.15.63:0/3249253395 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f540ffd70 0x7f4f541021d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4f48004880 tx=0x7f4f48009e30 comp rx=0 tx=0).stop 2023-12-12T11:52:06.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.103+0000 7f4f59cde700 1 -- 172.21.15.63:0/3249253395 shutdown_connections 2023-12-12T11:52:06.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.103+0000 7f4f59cde700 1 --2- 172.21.15.63:0/3249253395 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f540ffd70 0x7f4f541021d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:06.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.103+0000 7f4f59cde700 1 --2- 172.21.15.63:0/3249253395 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4f54066090 0x7f4f540ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:06.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.103+0000 7f4f59cde700 1 -- 172.21.15.63:0/3249253395 >> 172.21.15.63:0/3249253395 conn(0x7f4f540f7190 msgr2=0x7f4f540f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:52:06.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.103+0000 7f4f59cde700 1 -- 172.21.15.63:0/3249253395 shutdown_connections 2023-12-12T11:52:06.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.103+0000 7f4f59cde700 1 -- 172.21.15.63:0/3249253395 wait complete. 2023-12-12T11:52:06.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.105+0000 7f4f59cde700 1 Processor -- start 2023-12-12T11:52:06.108 INFO:tasks.workunit.client.0.smithi063.stdout:5/708: write d7/d10/d2b/d3c/f36 [627171,58440] 0 2023-12-12T11:52:06.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.106+0000 7f4f59cde700 1 -- start start 2023-12-12T11:52:06.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.108+0000 7f4f59cde700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4f54066090 0x7f4f5410fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:06.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.108+0000 7f4f59cde700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f540ffd70 0x7f4f5410ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:06.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.108+0000 7f4f537fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4f54066090 0x7f4f5410fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:06.111 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.108+0000 7f4f537fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4f54066090 0x7f4f5410fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:40920/0 (socket says 172.21.15.63:40920) 2023-12-12T11:52:06.111 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.108+0000 7f4f537fe700 1 -- 172.21.15.63:0/237558996 learned_addr learned my addr 172.21.15.63:0/237558996 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:52:06.111 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.109+0000 7f4f59cde700 1 -- 172.21.15.63:0/237558996 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f541105f0 con 0x7f4f540ffd70 2023-12-12T11:52:06.111 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.109+0000 7f4f59cde700 1 -- 172.21.15.63:0/237558996 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5410b3e0 con 0x7f4f54066090 2023-12-12T11:52:06.112 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.109+0000 7f4f537fe700 1 -- 172.21.15.63:0/237558996 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f540ffd70 msgr2=0x7f4f5410ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:06.112 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.109+0000 7f4f537fe700 1 --2- 172.21.15.63:0/237558996 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f540ffd70 0x7f4f5410ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:06.112 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.109+0000 7f4f537fe700 1 -- 172.21.15.63:0/237558996 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f48005040 con 0x7f4f54066090 2023-12-12T11:52:06.112 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.110+0000 7f4f537fe700 1 --2- 172.21.15.63:0/237558996 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4f54066090 0x7f4f5410fa60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4f440041d0 tx=0x7f4f4400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:52:06.112 INFO:tasks.workunit.client.0.smithi063.stdout:3/620: dread d4/df/d1a/d1c/d3b/d52/d74/fa8 [0,4194304] 0 2023-12-12T11:52:06.113 INFO:tasks.workunit.client.0.smithi063.stdout:3/621: write d4/df/d1a/d1c/d57/f6c [1975271,84027] 0 2023-12-12T11:52:06.113 INFO:tasks.workunit.client.0.smithi063.stdout:3/622: chown d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/f8e 6691 1 2023-12-12T11:52:06.113 INFO:tasks.workunit.client.0.smithi063.stdout:3/623: chown d4/df/d1a/d1c/d3b/d52/d78/da5/d4c 9389 1 2023-12-12T11:52:06.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.110+0000 7f4f3bfff700 1 -- 172.21.15.63:0/237558996 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f44007cc0 con 0x7f4f54066090 2023-12-12T11:52:06.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.111+0000 7f4f3bfff700 1 -- 172.21.15.63:0/237558996 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4f4400f040 con 0x7f4f54066090 2023-12-12T11:52:06.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.111+0000 7f4f3bfff700 1 -- 172.21.15.63:0/237558996 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f4400cae0 con 0x7f4f54066090 2023-12-12T11:52:06.114 INFO:tasks.workunit.client.1.smithi093.stdout:3/915: rename df/d22/d49/d69/d78/daf/d3d/d59/d72/l11b to df/d25/d2c/d85/dac/l127 0 2023-12-12T11:52:06.114 INFO:tasks.workunit.client.1.smithi093.stdout:2/937: creat d5/d14/d2d/d12/d25/d7a/d7e/da0/df4/f13b x:0 0 0 2023-12-12T11:52:06.114 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.111+0000 7f4f59cde700 1 -- 172.21.15.63:0/237558996 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f5410b660 con 0x7f4f54066090 2023-12-12T11:52:06.114 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.111+0000 7f4f59cde700 1 -- 172.21.15.63:0/237558996 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f5410bba0 con 0x7f4f54066090 2023-12-12T11:52:06.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.114+0000 7f4f3bfff700 1 -- 172.21.15.63:0/237558996 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 24) v1 ==== 88724+0+0 (secure 0 0 0) 0x7f4f4400cc40 con 0x7f4f54066090 2023-12-12T11:52:06.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.116+0000 7f4f59cde700 1 -- 172.21.15.63:0/237558996 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f5404bb80 con 0x7f4f54066090 2023-12-12T11:52:06.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.116+0000 7f4f3bfff700 1 --2- 172.21.15.63:0/237558996 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f4f3c06afd0 0x7f4f3c06d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:06.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.117+0000 7f4f3bfff700 1 -- 172.21.15.63:0/237558996 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f4f440892f0 con 0x7f4f54066090 2023-12-12T11:52:06.120 INFO:tasks.workunit.client.1.smithi093.stdout:2/938: dread d5/d14/d2d/d8b/da3/d138/fb0 [0,4194304] 0 2023-12-12T11:52:06.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.118+0000 7f4f52ffd700 1 --2- 172.21.15.63:0/237558996 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f4f3c06afd0 0x7f4f3c06d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:06.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.119+0000 7f4f52ffd700 1 --2- 172.21.15.63:0/237558996 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f4f3c06afd0 0x7f4f3c06d480 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4f48000c00 tx=0x7f4f48009e30 comp rx=0 tx=0).ready entity=mgr.24471 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:52:06.122 INFO:tasks.workunit.client.0.smithi063.stdout:3/624: write d4/df/d1a/d1c/d3b/d50/f97 [83295,34808] 0 2023-12-12T11:52:06.123 INFO:tasks.workunit.client.1.smithi093.stdout:5/811: getdents d0/d7/d36/d87 0 2023-12-12T11:52:06.123 INFO:tasks.workunit.client.1.smithi093.stdout:5/812: fsync d0/d7/d36/d87/ff4 0 2023-12-12T11:52:06.126 INFO:tasks.workunit.client.0.smithi063.stdout:2/587: write d0/f5f [1012887,101392] 0 2023-12-12T11:52:06.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.126+0000 7f4f3bfff700 1 -- 172.21.15.63:0/237558996 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f4f4404ece0 con 0x7f4f54066090 2023-12-12T11:52:06.131 INFO:tasks.workunit.client.0.smithi063.stdout:9/557: write d7/d11/d12/f60 [54910,65801] 0 2023-12-12T11:52:06.131 INFO:tasks.workunit.client.0.smithi063.stdout:9/558: fsync d7/d11/d4b/d75/f9b 0 2023-12-12T11:52:06.132 INFO:tasks.workunit.client.0.smithi063.stdout:1/740: dwrite d3/f9 [0,4194304] 0 2023-12-12T11:52:06.132 INFO:tasks.workunit.client.0.smithi063.stdout:1/741: chown d3/d3a/dd7/d16/d4f/d9a 10 1 2023-12-12T11:52:06.134 INFO:tasks.workunit.client.0.smithi063.stdout:5/709: dread d7/d28/f3f [0,4194304] 0 2023-12-12T11:52:06.144 INFO:tasks.workunit.client.1.smithi093.stdout:1/944: sync 2023-12-12T11:52:06.144 INFO:tasks.workunit.client.1.smithi093.stdout:1/945: readlink d4/d1c/d2a/la3 0 2023-12-12T11:52:06.151 INFO:tasks.workunit.client.1.smithi093.stdout:9/941: rename d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/l45 to d1/d23/d6b/l13b 0 2023-12-12T11:52:06.154 INFO:tasks.workunit.client.0.smithi063.stdout:0/691: unlink d0/d7/d27/d1f/l5b 0 2023-12-12T11:52:06.154 INFO:tasks.workunit.client.0.smithi063.stdout:0/692: fsync d0/d1a/d23/d34/fd5 0 2023-12-12T11:52:06.157 INFO:tasks.workunit.client.1.smithi093.stdout:0/946: getdents d5/d21 0 2023-12-12T11:52:06.157 INFO:tasks.workunit.client.1.smithi093.stdout:0/947: write d5/dd/d14/d26/f59 [1565947,81151] 0 2023-12-12T11:52:06.157 INFO:tasks.workunit.client.1.smithi093.stdout:0/948: fdatasync d5/dd/d33/f5e 0 2023-12-12T11:52:06.158 INFO:tasks.workunit.client.1.smithi093.stdout:5/813: dwrite d0/d7/d36/d68/ff3 [0,4194304] 0 2023-12-12T11:52:06.158 INFO:tasks.workunit.client.1.smithi093.stdout:5/814: creat d0/dd2/f11b x:0 0 0 2023-12-12T11:52:06.160 INFO:tasks.workunit.client.0.smithi063.stdout:3/625: unlink d4/df/l2f 0 2023-12-12T11:52:06.165 INFO:tasks.workunit.client.1.smithi093.stdout:7/888: rename da/d15/d2d/f6e to da/d15/d19/d4c/f133 0 2023-12-12T11:52:06.166 INFO:tasks.workunit.client.1.smithi093.stdout:9/942: mkdir d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d13c 0 2023-12-12T11:52:06.169 INFO:tasks.workunit.client.0.smithi063.stdout:1/742: link d3/d3a/dd7/d16/d17/d4b/d8c/fe5 d3/ff4 0 2023-12-12T11:52:06.169 INFO:tasks.workunit.client.0.smithi063.stdout:4/697: sync 2023-12-12T11:52:06.169 INFO:tasks.workunit.client.0.smithi063.stdout:7/583: sync 2023-12-12T11:52:06.178 INFO:tasks.workunit.client.1.smithi093.stdout:5/815: unlink d0/d7/d59/d48/f5f 0 2023-12-12T11:52:06.179 INFO:tasks.workunit.client.1.smithi093.stdout:5/816: read d0/d7/d36/db9/f63 [2761951,19530] 0 2023-12-12T11:52:06.187 INFO:tasks.workunit.client.0.smithi063.stdout:3/626: dread d4/d23/f24 [0,4194304] 0 2023-12-12T11:52:06.188 INFO:tasks.workunit.client.1.smithi093.stdout:2/939: rename d5/d14/d2d/d4c/d54/d67/d69/d6c/f89 to d5/d14/d2d/d12/d25/d7a/d7e/f13c 0 2023-12-12T11:52:06.188 INFO:tasks.workunit.client.1.smithi093.stdout:2/940: write d5/d14/d2d/d12/d25/f2a [8970406,107414] 0 2023-12-12T11:52:06.188 INFO:tasks.workunit.client.1.smithi093.stdout:1/946: read d4/d81/f107 [2645023,14128] 0 2023-12-12T11:52:06.190 INFO:tasks.workunit.client.0.smithi063.stdout:9/559: write d7/fd [1082793,124137] 0 2023-12-12T11:52:06.194 INFO:tasks.workunit.client.0.smithi063.stdout:9/560: fdatasync d7/d15/d39/f82 0 2023-12-12T11:52:06.194 INFO:tasks.workunit.client.0.smithi063.stdout:0/693: symlink d0/d1a/d23/d34/d42/le4 0 2023-12-12T11:52:06.203 INFO:tasks.workunit.client.1.smithi093.stdout:2/941: link d5/d14/d2d/d12/d25/d7a/d7e/da0/f114 d5/d14/d2d/d4c/d76/dc6/d118/f13d 0 2023-12-12T11:52:06.203 INFO:tasks.workunit.client.1.smithi093.stdout:2/942: getdents d5/d14/d2d/d96/dad 0 2023-12-12T11:52:06.203 INFO:tasks.workunit.client.1.smithi093.stdout:2/943: write d5/d14/d2d/d4c/d76/dc6/d118/de2/ff8 [827098,10070] 0 2023-12-12T11:52:06.204 INFO:tasks.workunit.client.1.smithi093.stdout:9/943: rename d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/dae/f130 to d1/d23/d6b/d92/d9f/f13d 0 2023-12-12T11:52:06.206 INFO:tasks.workunit.client.1.smithi093.stdout:1/947: mkdir d4/d1a/d83/d9a/da9/d12c/d13f 0 2023-12-12T11:52:06.207 INFO:tasks.workunit.client.0.smithi063.stdout:5/710: dwrite d7/d10/d2b/d3c/d42/d76/f78 [0,4194304] 0 2023-12-12T11:52:06.209 INFO:tasks.workunit.client.1.smithi093.stdout:2/944: dread d5/d14/d2d/d4c/d54/d67/d69/d6c/f5a [0,4194304] 0 2023-12-12T11:52:06.210 INFO:tasks.workunit.client.0.smithi063.stdout:9/561: dread d7/fa [0,4194304] 0 2023-12-12T11:52:06.212 INFO:tasks.workunit.client.0.smithi063.stdout:4/698: unlink d2/d17/d7f/da2/fa8 0 2023-12-12T11:52:06.212 INFO:tasks.workunit.client.0.smithi063.stdout:7/584: truncate de/f1e 241683 0 2023-12-12T11:52:06.215 INFO:tasks.workunit.client.1.smithi093.stdout:1/948: rename d4/d1a/d1b/d26/d65/dc8/ffa to d4/d1a/d1b/d26/d31/f140 0 2023-12-12T11:52:06.217 INFO:tasks.workunit.client.0.smithi063.stdout:3/627: unlink d4/df/d1a/d1c/d3b/d50/fb3 0 2023-12-12T11:52:06.218 INFO:tasks.workunit.client.1.smithi093.stdout:7/889: dwrite da/d15/f128 [0,4194304] 0 2023-12-12T11:52:06.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:05 smithi093 ceph-mon[115914]: pgmap v17: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 227 MiB/s rd, 274 MiB/s wr, 418 op/s 2023-12-12T11:52:06.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:05 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/3679428897' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:52:06.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:05 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:06.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:05 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:06.225 INFO:tasks.workunit.client.1.smithi093.stdout:2/945: dread d5/d14/d2d/d12/d25/d7a/d7e/da5/fdc [0,4194304] 0 2023-12-12T11:52:06.226 INFO:tasks.workunit.client.1.smithi093.stdout:1/949: creat d4/dc/d7a/d9c/da7/d13e/f141 x:0 0 0 2023-12-12T11:52:06.226 INFO:tasks.workunit.client.1.smithi093.stdout:1/950: truncate d4/d1a/d1b/d26/d31/f102 216192 0 2023-12-12T11:52:06.226 INFO:tasks.workunit.client.1.smithi093.stdout:1/951: creat d4/d1a/d83/d9a/df7/f142 x:0 0 0 2023-12-12T11:52:06.227 INFO:tasks.workunit.client.1.smithi093.stdout:8/963: dwrite d3/d1a/d1f/f27 [0,4194304] 0 2023-12-12T11:52:06.227 INFO:tasks.workunit.client.1.smithi093.stdout:8/964: write d3/d1a/d1f/d29/d3a/d40/dbf/fff [746134,110441] 0 2023-12-12T11:52:06.234 INFO:tasks.workunit.client.0.smithi063.stdout:0/694: creat d0/d1a/d23/d2e/fe5 x:0 0 0 2023-12-12T11:52:06.234 INFO:tasks.workunit.client.0.smithi063.stdout:0/695: readlink d0/l6 0 2023-12-12T11:52:06.234 INFO:tasks.workunit.client.0.smithi063.stdout:2/588: rename d0/d41/d90 to d0/d1a/d3a/d85/dbf 0 2023-12-12T11:52:06.235 INFO:tasks.workunit.client.0.smithi063.stdout:2/589: read d0/d1a/d48/d56/f58 [337329,115886] 0 2023-12-12T11:52:06.235 INFO:tasks.workunit.client.1.smithi093.stdout:7/890: creat da/d15/ddd/d131/f134 x:0 0 0 2023-12-12T11:52:06.235 INFO:tasks.workunit.client.1.smithi093.stdout:7/891: dread - da/d2e/d89/f110 zero size 2023-12-12T11:52:06.235 INFO:tasks.workunit.client.0.smithi063.stdout:5/711: mkdir d7/d28/d94/dd6 0 2023-12-12T11:52:06.236 INFO:tasks.workunit.client.0.smithi063.stdout:2/590: write d0/d1a/d26/f8f [102535,122534] 0 2023-12-12T11:52:06.236 INFO:tasks.workunit.client.0.smithi063.stdout:2/591: stat d0/c7c 0 2023-12-12T11:52:06.236 INFO:tasks.workunit.client.1.smithi093.stdout:2/946: stat d5/d14/d2d/cd9 0 2023-12-12T11:52:06.239 INFO:tasks.workunit.client.0.smithi063.stdout:9/562: link d7/lb d7/d20/d3f/d40/lb9 0 2023-12-12T11:52:06.239 INFO:tasks.workunit.client.0.smithi063.stdout:4/699: symlink d2/d48/d69/le3 0 2023-12-12T11:52:06.240 INFO:tasks.workunit.client.1.smithi093.stdout:1/952: dread d4/d1c/f6d [0,4194304] 0 2023-12-12T11:52:06.244 INFO:tasks.workunit.client.0.smithi063.stdout:7/585: creat de/d33/dd2/d4a/fdd x:0 0 0 2023-12-12T11:52:06.244 INFO:tasks.workunit.client.0.smithi063.stdout:7/586: chown de/d34/d68 0 1 2023-12-12T11:52:06.245 INFO:tasks.workunit.client.1.smithi093.stdout:8/965: getdents d3/d1a/d1f/d29/d3a/d40 0 2023-12-12T11:52:06.245 INFO:tasks.workunit.client.0.smithi063.stdout:0/696: write d0/d7/d27/fcd [4882873,8025] 0 2023-12-12T11:52:06.246 INFO:tasks.workunit.client.1.smithi093.stdout:7/892: creat da/d15/d2d/d2f/f135 x:0 0 0 2023-12-12T11:52:06.248 INFO:tasks.workunit.client.1.smithi093.stdout:1/953: mknod d4/dc/d7a/d9c/c143 0 2023-12-12T11:52:06.256 INFO:tasks.workunit.client.1.smithi093.stdout:7/893: symlink da/d15/d19/d90/d7d/l136 0 2023-12-12T11:52:06.256 INFO:tasks.workunit.client.1.smithi093.stdout:7/894: dread - da/f111 zero size 2023-12-12T11:52:06.257 INFO:tasks.workunit.client.0.smithi063.stdout:1/743: dwrite d3/d3a/dd7/d12/f27 [4194304,4194304] 0 2023-12-12T11:52:06.257 INFO:tasks.workunit.client.1.smithi093.stdout:3/916: dwrite df/dc6/fdf [0,4194304] 0 2023-12-12T11:52:06.257 INFO:tasks.workunit.client.1.smithi093.stdout:3/917: dread - df/d22/d49/f10f zero size 2023-12-12T11:52:06.262 INFO:tasks.workunit.client.0.smithi063.stdout:2/592: rename d0/d1a/d26/l52 to d0/d1a/d48/d56/lc0 0 2023-12-12T11:52:06.262 INFO:tasks.workunit.client.0.smithi063.stdout:2/593: stat d0/d1a/d57/fac 0 2023-12-12T11:52:06.262 INFO:tasks.workunit.client.0.smithi063.stdout:5/712: mknod d7/d10/d2b/d3c/d42/d62/cd7 0 2023-12-12T11:52:06.263 INFO:tasks.workunit.client.0.smithi063.stdout:5/713: fdatasync d7/d10/d2b/d3c/d63/fc7 0 2023-12-12T11:52:06.263 INFO:tasks.workunit.client.1.smithi093.stdout:0/949: dwrite d5/d41/d77/d79/d9b/f9e [0,4194304] 0 2023-12-12T11:52:06.263 INFO:tasks.workunit.client.0.smithi063.stdout:4/700: creat d2/d48/d4f/fe4 x:0 0 0 2023-12-12T11:52:06.268 INFO:tasks.workunit.client.0.smithi063.stdout:9/563: dread d7/d11/d12/d30/d3e/d55/f81 [0,4194304] 0 2023-12-12T11:52:06.270 INFO:tasks.workunit.client.1.smithi093.stdout:5/817: dwrite d0/d7/d36/db9/d66/d7c/db5/fdd [4194304,4194304] 0 2023-12-12T11:52:06.270 INFO:tasks.workunit.client.1.smithi093.stdout:5/818: chown d0/d7/d8/de/c46 293647 1 2023-12-12T11:52:06.287 INFO:tasks.workunit.client.1.smithi093.stdout:7/895: mknod da/d8e/c137 0 2023-12-12T11:52:06.288 INFO:tasks.workunit.client.0.smithi063.stdout:2/594: dread d0/d1a/d1e/f60 [0,4194304] 0 2023-12-12T11:52:06.292 INFO:tasks.workunit.client.0.smithi063.stdout:0/697: dread d0/d7/d27/d1f/f48 [0,4194304] 0 2023-12-12T11:52:06.292 INFO:tasks.workunit.client.0.smithi063.stdout:0/698: write d0/d1a/d66/f6e [567136,11415] 0 2023-12-12T11:52:06.294 INFO:tasks.workunit.client.0.smithi063.stdout:0/699: write d0/d1a/d66/f6e [134218,56987] 0 2023-12-12T11:52:06.303 INFO:tasks.workunit.client.1.smithi093.stdout:3/918: mkdir df/d22/d49/d69/d78/daf/d3d/d42/d9d/d128 0 2023-12-12T11:52:06.306 INFO:tasks.workunit.client.1.smithi093.stdout:0/950: write d5/dd/d14/d26/d58/dab/fb6 [363296,2880] 0 2023-12-12T11:52:06.306 INFO:tasks.workunit.client.1.smithi093.stdout:0/951: readlink d5/dd/l11 0 2023-12-12T11:52:06.307 INFO:tasks.workunit.client.1.smithi093.stdout:9/944: dwrite d1/d23/d6b/d92/ddd/f126 [0,4194304] 0 2023-12-12T11:52:06.308 INFO:tasks.workunit.client.1.smithi093.stdout:1/954: getdents d4/dc/d7a/d9c/da7 0 2023-12-12T11:52:06.308 INFO:tasks.workunit.client.1.smithi093.stdout:1/955: fsync d4/d1a/d83/d9a/df7/f119 0 2023-12-12T11:52:06.310 INFO:tasks.workunit.client.0.smithi063.stdout:3/628: dwrite d4/df/d1a/d1c/d3b/d52/d74/fa8 [0,4194304] 0 2023-12-12T11:52:06.314 INFO:tasks.workunit.client.0.smithi063.stdout:7/587: rename de/d39/d60/d97 to de/d33/d41/d44/d8b/dde 0 2023-12-12T11:52:06.314 INFO:tasks.workunit.client.0.smithi063.stdout:7/588: fdatasync de/d33/d41/d44/d8b/dde/daf/fd0 0 2023-12-12T11:52:06.316 INFO:tasks.workunit.client.1.smithi093.stdout:2/947: dwrite d5/d14/f3c [0,4194304] 0 2023-12-12T11:52:06.316 INFO:tasks.workunit.client.1.smithi093.stdout:2/948: truncate d5/d31/f45 1525411 0 2023-12-12T11:52:06.334 INFO:tasks.workunit.client.0.smithi063.stdout:5/714: dread d7/f1a [0,4194304] 0 2023-12-12T11:52:06.337 INFO:tasks.workunit.client.0.smithi063.stdout:4/701: dwrite d2/d8/fbb [0,4194304] 0 2023-12-12T11:52:06.337 INFO:tasks.workunit.client.0.smithi063.stdout:4/702: fsync d2/d17/d61/f71 0 2023-12-12T11:52:06.341 INFO:tasks.workunit.client.1.smithi093.stdout:8/966: dwrite d3/d1a/d1f/d75/fd0 [0,4194304] 0 2023-12-12T11:52:06.342 INFO:tasks.workunit.client.1.smithi093.stdout:8/967: readlink d3/d1a/d1f/d29/d3a/da0/laa 0 2023-12-12T11:52:06.342 INFO:tasks.workunit.client.1.smithi093.stdout:8/968: write d3/d1a/fea [74543,39884] 0 2023-12-12T11:52:06.343 INFO:tasks.workunit.client.0.smithi063.stdout:0/700: creat d0/d1a/d23/d2e/dd7/fe6 x:0 0 0 2023-12-12T11:52:06.343 INFO:tasks.workunit.client.0.smithi063.stdout:0/701: chown d0/d7/ff 16237334 1 2023-12-12T11:52:06.344 INFO:tasks.workunit.client.0.smithi063.stdout:9/564: dread d7/d15/f1d [0,4194304] 0 2023-12-12T11:52:06.344 INFO:tasks.workunit.client.0.smithi063.stdout:9/565: write d7/f1e [5078006,85376] 0 2023-12-12T11:52:06.348 INFO:tasks.workunit.client.0.smithi063.stdout:1/744: dwrite d3/d3a/dd7/d16/d24/d4d/d35/d98/fef [0,4194304] 0 2023-12-12T11:52:06.355 INFO:tasks.workunit.client.0.smithi063.stdout:2/595: getdents d0 0 2023-12-12T11:52:06.358 INFO:tasks.workunit.client.0.smithi063.stdout:0/702: dread d0/d1a/d23/f74 [0,4194304] 0 2023-12-12T11:52:06.360 INFO:tasks.workunit.client.1.smithi093.stdout:0/952: mknod d5/d21/d27/d3a/d9a/db5/db8/dd4/c123 0 2023-12-12T11:52:06.360 INFO:tasks.workunit.client.0.smithi063.stdout:5/715: dread d7/d10/f14 [0,4194304] 0 2023-12-12T11:52:06.360 INFO:tasks.workunit.client.0.smithi063.stdout:5/716: chown d7/d28/d6e 70278 1 2023-12-12T11:52:06.369 INFO:tasks.workunit.client.1.smithi093.stdout:9/945: mknod d1/d23/d6b/d92/db2/c13e 0 2023-12-12T11:52:06.371 INFO:tasks.workunit.client.0.smithi063.stdout:2/596: dread d0/f4 [0,4194304] 0 2023-12-12T11:52:06.372 INFO:tasks.workunit.client.1.smithi093.stdout:1/956: truncate d4/dc/d7a/d9c/da7/fc3 4131946 0 2023-12-12T11:52:06.373 INFO:tasks.workunit.client.1.smithi093.stdout:1/957: write d4/d1a/d1b/d26/d31/ddb/f12b [1615462,64939] 0 2023-12-12T11:52:06.374 INFO:tasks.workunit.client.1.smithi093.stdout:3/919: dwrite df/d22/d49/d69/d78/daf/d3d/d42/f57 [0,4194304] 0 2023-12-12T11:52:06.374 INFO:tasks.workunit.client.1.smithi093.stdout:3/920: chown df/d22/d49/d69/d78/daf/d3d/d42/d9d/lf3 6 1 2023-12-12T11:52:06.375 INFO:tasks.workunit.client.1.smithi093.stdout:5/819: dwrite d0/d7/d36/db9/d66/f9a [0,4194304] 0 2023-12-12T11:52:06.383 INFO:tasks.workunit.client.1.smithi093.stdout:0/953: write d5/d78/fbd [2312692,60724] 0 2023-12-12T11:52:06.386 INFO:tasks.workunit.client.1.smithi093.stdout:2/949: mknod d5/d14/d2d/d4c/d54/dc5/d61/c13e 0 2023-12-12T11:52:06.388 INFO:tasks.workunit.client.1.smithi093.stdout:8/969: symlink d3/d1a/d1f/l139 0 2023-12-12T11:52:06.388 INFO:tasks.workunit.client.1.smithi093.stdout:2/950: write d5/d14/d2d/d4c/d54/d67/d69/f8f [268998,33906] 0 2023-12-12T11:52:06.389 INFO:tasks.workunit.client.0.smithi063.stdout:3/629: rmdir d4/df/d1a/d1c 39 2023-12-12T11:52:06.392 INFO:tasks.workunit.client.1.smithi093.stdout:7/896: getdents da/d15 0 2023-12-12T11:52:06.398 INFO:tasks.workunit.client.1.smithi093.stdout:9/946: mknod d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d57/d9e/c13f 0 2023-12-12T11:52:06.401 INFO:tasks.workunit.client.1.smithi093.stdout:1/958: mknod d4/d1a/d83/d9a/df7/c144 0 2023-12-12T11:52:06.405 INFO:tasks.workunit.client.0.smithi063.stdout:4/703: rename d2/d47/c5c to d2/ce5 0 2023-12-12T11:52:06.408 INFO:tasks.workunit.client.0.smithi063.stdout:9/566: unlink d7/d15/f63 0 2023-12-12T11:52:06.409 INFO:tasks.workunit.client.1.smithi093.stdout:5/820: dwrite d0/dec/f95 [0,4194304] 0 2023-12-12T11:52:06.410 INFO:tasks.workunit.client.1.smithi093.stdout:5/821: fdatasync d0/d7/d36/db9/dca/fe4 0 2023-12-12T11:52:06.411 INFO:tasks.workunit.client.0.smithi063.stdout:6/719: sync 2023-12-12T11:52:06.411 INFO:tasks.workunit.client.0.smithi063.stdout:6/720: dread - d9/d2c/f54 zero size 2023-12-12T11:52:06.415 INFO:tasks.workunit.client.0.smithi063.stdout:9/567: dread d7/d20/d3f/d40/d4e/f6b [0,4194304] 0 2023-12-12T11:52:06.420 INFO:tasks.workunit.client.0.smithi063.stdout:0/703: creat d0/d7/d27/d1f/dc4/d67/dcb/fe7 x:0 0 0 2023-12-12T11:52:06.425 INFO:tasks.workunit.client.0.smithi063.stdout:5/717: mknod d7/d10/d2b/d3c/d5a/dbb/dbc/cd8 0 2023-12-12T11:52:06.425 INFO:tasks.workunit.client.0.smithi063.stdout:5/718: chown d7/d28/d43/dd1 144825813 1 2023-12-12T11:52:06.425 INFO:tasks.workunit.client.0.smithi063.stdout:5/719: chown d7/d10/d2b/d3c/d5a/dbb/fc3 3 1 2023-12-12T11:52:06.426 INFO:tasks.workunit.client.1.smithi093.stdout:8/970: mkdir d3/d1a/d1f/d29/d13a 0 2023-12-12T11:52:06.427 INFO:tasks.workunit.client.0.smithi063.stdout:8/757: sync 2023-12-12T11:52:06.429 INFO:tasks.workunit.client.1.smithi093.stdout:2/951: rmdir d5/d14/d2d/d12/d25/d7a/d7e/da5/dbd 0 2023-12-12T11:52:06.429 INFO:tasks.workunit.client.1.smithi093.stdout:5/822: dread d0/d7/d36/d29/f9d [0,4194304] 0 2023-12-12T11:52:06.429 INFO:tasks.workunit.client.1.smithi093.stdout:8/971: read d3/d8/d88/f106 [417309,80172] 0 2023-12-12T11:52:06.430 INFO:tasks.workunit.client.0.smithi063.stdout:4/704: mkdir d2/d47/d6d/d88/de6 0 2023-12-12T11:52:06.431 INFO:tasks.workunit.client.1.smithi093.stdout:7/897: mkdir da/d15/d19/d90/d7d/d138 0 2023-12-12T11:52:06.431 INFO:tasks.workunit.client.1.smithi093.stdout:7/898: creat da/d15/d19/d4c/f139 x:0 0 0 2023-12-12T11:52:06.433 INFO:tasks.workunit.client.0.smithi063.stdout:1/745: rename d3/d3a/dd7/d16/d24/d48/f6a to d3/d3a/dd7/d16/d17/d4b/d8c/dd9/ff5 0 2023-12-12T11:52:06.436 INFO:tasks.workunit.client.1.smithi093.stdout:1/959: truncate d4/f11a 184549 0 2023-12-12T11:52:06.439 INFO:tasks.workunit.client.0.smithi063.stdout:6/721: mkdir d9/d10/dfc 0 2023-12-12T11:52:06.440 INFO:tasks.workunit.client.0.smithi063.stdout:6/722: chown d9/c6f 192 1 2023-12-12T11:52:06.440 INFO:tasks.workunit.client.0.smithi063.stdout:9/568: unlink d7/d11/l7d 0 2023-12-12T11:52:06.440 INFO:tasks.workunit.client.0.smithi063.stdout:5/720: mkdir d7/d10/d2b/d3c/d5a/dd9 0 2023-12-12T11:52:06.440 INFO:tasks.workunit.client.1.smithi093.stdout:3/921: rename df/f54 to df/d25/d2c/d85/f129 0 2023-12-12T11:52:06.441 INFO:tasks.workunit.client.1.smithi093.stdout:2/952: read d5/d14/d2d/d12/d44/d11b/fd5 [7704718,712] 0 2023-12-12T11:52:06.445 INFO:tasks.workunit.client.0.smithi063.stdout:0/704: dread d0/f21 [0,4194304] 0 2023-12-12T11:52:06.445 INFO:tasks.workunit.client.0.smithi063.stdout:3/630: creat d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/fbd x:0 0 0 2023-12-12T11:52:06.446 INFO:tasks.workunit.client.0.smithi063.stdout:8/758: link d4/de/d11/f14 d4/de/d3b/d62/d36/d57/d84/fee 0 2023-12-12T11:52:06.447 INFO:tasks.workunit.client.0.smithi063.stdout:4/705: creat d2/d17/d7f/d86/fe7 x:0 0 0 2023-12-12T11:52:06.447 INFO:tasks.workunit.client.0.smithi063.stdout:4/706: fdatasync d2/d47/d6d/f8f 0 2023-12-12T11:52:06.449 INFO:tasks.workunit.client.1.smithi093.stdout:0/954: rmdir d5/dd/d33 39 2023-12-12T11:52:06.449 INFO:tasks.workunit.client.1.smithi093.stdout:0/955: write d5/dd/d62/f69 [4447083,32426] 0 2023-12-12T11:52:06.450 INFO:tasks.workunit.client.1.smithi093.stdout:0/956: chown d5/d78 0 1 2023-12-12T11:52:06.451 INFO:tasks.workunit.client.0.smithi063.stdout:2/597: rename d0/d1a/d1e/l71 to d0/d41/daf/lc1 0 2023-12-12T11:52:06.451 INFO:tasks.workunit.client.0.smithi063.stdout:2/598: dread - d0/d41/daf/fb9 zero size 2023-12-12T11:52:06.460 INFO:tasks.workunit.client.0.smithi063.stdout:9/569: symlink d7/d11/d12/d30/lba 0 2023-12-12T11:52:06.464 INFO:tasks.workunit.client.0.smithi063.stdout:5/721: symlink d7/d10/d2b/d3c/lda 0 2023-12-12T11:52:06.465 INFO:tasks.workunit.client.0.smithi063.stdout:0/705: dread d0/d7/f31 [0,4194304] 0 2023-12-12T11:52:06.469 INFO:tasks.workunit.client.0.smithi063.stdout:8/759: mkdir d4/de/d11/def 0 2023-12-12T11:52:06.471 INFO:tasks.workunit.client.1.smithi093.stdout:7/899: dread da/de/d46/d4f/f62 [0,4194304] 0 2023-12-12T11:52:06.472 INFO:tasks.workunit.client.0.smithi063.stdout:4/707: link d2/d47/d6d/f97 d2/d17/d7f/fe8 0 2023-12-12T11:52:06.476 INFO:tasks.workunit.client.0.smithi063.stdout:6/723: read d9/d10/f1e [2236790,80339] 0 2023-12-12T11:52:06.478 INFO:tasks.workunit.client.0.smithi063.stdout:5/722: creat d7/d28/d43/fdb x:0 0 0 2023-12-12T11:52:06.478 INFO:tasks.workunit.client.0.smithi063.stdout:9/570: mkdir d7/d11/d12/d30/d3e/dbb 0 2023-12-12T11:52:06.478 INFO:tasks.workunit.client.0.smithi063.stdout:9/571: truncate d7/d11/d4b/f68 1258078 0 2023-12-12T11:52:06.480 INFO:tasks.workunit.client.0.smithi063.stdout:8/760: symlink d4/d24/d38/d45/lf0 0 2023-12-12T11:52:06.480 INFO:tasks.workunit.client.0.smithi063.stdout:8/761: write d4/d55/d52/d8e/fc1 [258954,78721] 0 2023-12-12T11:52:06.485 INFO:tasks.workunit.client.0.smithi063.stdout:9/572: mknod d7/d20/d45/d46/d51/d64/d6f/cbc 0 2023-12-12T11:52:06.485 INFO:tasks.workunit.client.0.smithi063.stdout:9/573: chown d7/d11/d12/d30/c36 1 1 2023-12-12T11:52:06.491 INFO:tasks.workunit.client.0.smithi063.stdout:8/762: link d4/de/d11/fcc d4/d24/d38/d45/d5b/ff1 0 2023-12-12T11:52:06.493 INFO:tasks.workunit.client.1.smithi093.stdout:9/947: rmdir d1 39 2023-12-12T11:52:06.494 INFO:tasks.workunit.client.0.smithi063.stdout:0/706: dread d0/d1a/d66/f87 [0,4194304] 0 2023-12-12T11:52:06.497 INFO:tasks.workunit.client.1.smithi093.stdout:2/953: dwrite d5/d14/d2d/d8b/da3/d138/fb0 [0,4194304] 0 2023-12-12T11:52:06.497 INFO:tasks.workunit.client.0.smithi063.stdout:6/724: getdents d9/d2c 0 2023-12-12T11:52:06.497 INFO:tasks.workunit.client.0.smithi063.stdout:6/725: dread - d9/d68/d94/ff1 zero size 2023-12-12T11:52:06.497 INFO:tasks.workunit.client.0.smithi063.stdout:4/708: dread d2/d17/d41/f52 [0,4194304] 0 2023-12-12T11:52:06.499 INFO:tasks.workunit.client.0.smithi063.stdout:5/723: getdents d7/d10/d2b 0 2023-12-12T11:52:06.501 INFO:tasks.workunit.client.1.smithi093.stdout:3/922: symlink df/d22/d49/d69/d78/daf/d3d/d42/d8e/de1/l12a 0 2023-12-12T11:52:06.503 INFO:tasks.workunit.client.0.smithi063.stdout:8/763: symlink d4/de/d3b/lf2 0 2023-12-12T11:52:06.506 INFO:tasks.workunit.client.0.smithi063.stdout:0/707: rename d0/d1a/d23/d34/d42/f80 to d0/d7/d27/d1f/dc4/d67/fe8 0 2023-12-12T11:52:06.507 INFO:tasks.workunit.client.1.smithi093.stdout:9/948: write d1/d23/d24/d29/d43/d56/d68/fd1 [3080467,21129] 0 2023-12-12T11:52:06.508 INFO:tasks.workunit.client.1.smithi093.stdout:0/957: link d5/d21/d27/d3a/ff5 d5/dd/d14/d99/dfb/f124 0 2023-12-12T11:52:06.520 INFO:tasks.workunit.client.0.smithi063.stdout:8/764: unlink d4/d55/d52/f71 0 2023-12-12T11:52:06.520 INFO:tasks.workunit.client.0.smithi063.stdout:8/765: fdatasync d4/f7 0 2023-12-12T11:52:06.521 INFO:tasks.workunit.client.1.smithi093.stdout:0/958: dread d5/d21/d2f/d54/d7e/fff [4194304,4194304] 0 2023-12-12T11:52:06.521 INFO:tasks.workunit.client.1.smithi093.stdout:0/959: truncate d5/d21/fe5 7910246 0 2023-12-12T11:52:06.522 INFO:tasks.workunit.client.1.smithi093.stdout:0/960: read d5/dd/d62/fb7 [119780,12175] 0 2023-12-12T11:52:06.525 INFO:tasks.workunit.client.1.smithi093.stdout:5/823: rename d0/d7/d36/d68/ff6 to d0/d7/d36/db9/f11c 0 2023-12-12T11:52:06.525 INFO:tasks.workunit.client.1.smithi093.stdout:5/824: creat d0/d7/d36/d68/f11d x:0 0 0 2023-12-12T11:52:06.525 INFO:tasks.workunit.client.1.smithi093.stdout:5/825: chown d0/d7/d59/lbe 549826 1 2023-12-12T11:52:06.526 INFO:tasks.workunit.client.1.smithi093.stdout:5/826: write d0/d7/d36/d29/d44/fae [917418,127691] 0 2023-12-12T11:52:06.526 INFO:tasks.workunit.client.0.smithi063.stdout:0/708: mkdir d0/d8e/da7/dcf/de9 0 2023-12-12T11:52:06.529 INFO:tasks.workunit.client.1.smithi093.stdout:2/954: symlink d5/d31/dbc/l13f 0 2023-12-12T11:52:06.529 INFO:tasks.workunit.client.1.smithi093.stdout:2/955: creat d5/d14/d2d/d4c/d54/d67/d69/dde/f140 x:0 0 0 2023-12-12T11:52:06.533 INFO:tasks.workunit.client.0.smithi063.stdout:8/766: mkdir d4/d24/d38/dd8/df3 0 2023-12-12T11:52:06.534 INFO:tasks.workunit.client.0.smithi063.stdout:8/767: readlink d4/de/l10 0 2023-12-12T11:52:06.534 INFO:tasks.workunit.client.0.smithi063.stdout:8/768: chown d4/de/d3b/d62/fa6 22722 1 2023-12-12T11:52:06.534 INFO:tasks.workunit.client.0.smithi063.stdout:8/769: fdatasync d4/d24/d38/d45/d5b/d92/d65/f8d 0 2023-12-12T11:52:06.534 INFO:tasks.workunit.client.0.smithi063.stdout:8/770: creat d4/de/d3b/d62/d36/dc6/ff4 x:0 0 0 2023-12-12T11:52:06.534 INFO:tasks.workunit.client.0.smithi063.stdout:8/771: write d4/d55/d52/d8e/fc1 [1172035,107775] 0 2023-12-12T11:52:06.537 INFO:tasks.workunit.client.0.smithi063.stdout:0/709: mkdir d0/d7/d27/d1f/dc4/d67/dcb/dea 0 2023-12-12T11:52:06.545 INFO:tasks.workunit.client.1.smithi093.stdout:9/949: symlink d1/d23/d24/d29/d43/l140 0 2023-12-12T11:52:06.546 INFO:tasks.workunit.client.1.smithi093.stdout:8/972: rename d3/cba to d3/d1a/d1f/d50/c13b 0 2023-12-12T11:52:06.546 INFO:tasks.workunit.client.1.smithi093.stdout:9/950: dread - d1/d23/d24/d29/d43/d56/de9/d138/f12a zero size 2023-12-12T11:52:06.546 INFO:tasks.workunit.client.1.smithi093.stdout:9/951: write d1/d23/d24/d29/d43/f12f [1316024,95547] 0 2023-12-12T11:52:06.546 INFO:tasks.workunit.client.1.smithi093.stdout:9/952: write d1/d23/d6b/d92/f10b [201006,91017] 0 2023-12-12T11:52:06.547 INFO:tasks.workunit.client.0.smithi063.stdout:0/710: creat d0/d1a/d23/d2e/d84/feb x:0 0 0 2023-12-12T11:52:06.549 INFO:tasks.workunit.client.1.smithi093.stdout:3/923: dwrite df/d22/d49/d69/d8c/fae [0,4194304] 0 2023-12-12T11:52:06.556 INFO:tasks.workunit.client.1.smithi093.stdout:8/973: link d3/f80 d3/d1a/d1f/d29/d13a/f13c 0 2023-12-12T11:52:06.556 INFO:tasks.workunit.client.1.smithi093.stdout:8/974: creat d3/d8/d88/dc5/f13d x:0 0 0 2023-12-12T11:52:06.556 INFO:tasks.workunit.client.1.smithi093.stdout:8/975: creat d3/d1a/d1f/d29/d63/f13e x:0 0 0 2023-12-12T11:52:06.565 INFO:tasks.workunit.client.0.smithi063.stdout:0/711: truncate d0/d7/d27/d1f/f3f 784481 0 2023-12-12T11:52:06.565 INFO:tasks.workunit.client.1.smithi093.stdout:1/960: rename d4/c79 to d4/d1a/da6/c145 0 2023-12-12T11:52:06.583 INFO:tasks.workunit.client.1.smithi093.stdout:3/924: truncate df/d22/d49/fe9 514026 0 2023-12-12T11:52:06.583 INFO:tasks.workunit.client.1.smithi093.stdout:3/925: creat df/d25/dd2/f12b x:0 0 0 2023-12-12T11:52:06.583 INFO:tasks.workunit.client.1.smithi093.stdout:3/926: fdatasync df/d25/d2c/d85/f129 0 2023-12-12T11:52:06.585 INFO:tasks.workunit.client.0.smithi063.stdout:6/726: dread d9/f1f [4194304,4194304] 0 2023-12-12T11:52:06.585 INFO:tasks.workunit.client.0.smithi063.stdout:6/727: fdatasync d9/d10/d2a/de7/f9b 0 2023-12-12T11:52:06.587 INFO:tasks.workunit.client.1.smithi093.stdout:5/827: write d0/dec/f95 [3612519,107612] 0 2023-12-12T11:52:06.589 INFO:tasks.workunit.client.0.smithi063.stdout:0/712: write d0/d1a/d23/f74 [329228,42879] 0 2023-12-12T11:52:06.589 INFO:tasks.workunit.client.0.smithi063.stdout:4/709: write d2/d47/d6d/f8e [822887,117629] 0 2023-12-12T11:52:06.589 INFO:tasks.workunit.client.1.smithi093.stdout:8/976: read d3/d1a/d1f/d59/fd8 [3216016,108194] 0 2023-12-12T11:52:06.590 INFO:tasks.workunit.client.1.smithi093.stdout:0/961: dwrite d5/dd/d14/f100 [0,4194304] 0 2023-12-12T11:52:06.590 INFO:tasks.workunit.client.1.smithi093.stdout:0/962: dread - d5/dd/d14/d99/fbc zero size 2023-12-12T11:52:06.595 INFO:tasks.workunit.client.0.smithi063.stdout:2/599: dwrite d0/d1a/d3a/f9f [0,4194304] 0 2023-12-12T11:52:06.595 INFO:tasks.workunit.client.0.smithi063.stdout:2/600: creat d0/d1a/d57/fc2 x:0 0 0 2023-12-12T11:52:06.600 INFO:tasks.workunit.client.1.smithi093.stdout:7/900: rename da/de/d78/lbb to da/d15/d59/df0/l13a 0 2023-12-12T11:52:06.600 INFO:tasks.workunit.client.0.smithi063.stdout:0/713: mknod d0/d1a/d23/d34/d42/d99/cec 0 2023-12-12T11:52:06.600 INFO:tasks.workunit.client.0.smithi063.stdout:0/714: dread - d0/d7/d27/d1f/dc4/d67/fd8 zero size 2023-12-12T11:52:06.600 INFO:tasks.workunit.client.0.smithi063.stdout:0/715: dread - d0/d1a/d66/fa4 zero size 2023-12-12T11:52:06.606 INFO:tasks.workunit.client.1.smithi093.stdout:1/961: mkdir d4/d1a/d83/d9a/df7/d146 0 2023-12-12T11:52:06.607 INFO:tasks.workunit.client.1.smithi093.stdout:1/962: fsync d4/fa 0 2023-12-12T11:52:06.612 INFO:tasks.workunit.client.1.smithi093.stdout:9/953: mknod d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d57/d63/c141 0 2023-12-12T11:52:06.612 INFO:tasks.workunit.client.1.smithi093.stdout:9/954: dread - d1/d23/d24/d29/d43/ff9 zero size 2023-12-12T11:52:06.612 INFO:tasks.workunit.client.1.smithi093.stdout:9/955: write d1/d23/d6b/d92/db2/f128 [305113,55595] 0 2023-12-12T11:52:06.616 INFO:tasks.workunit.client.0.smithi063.stdout:0/716: dread d0/d1a/d66/f8a [4194304,4194304] 0 2023-12-12T11:52:06.616 INFO:tasks.workunit.client.0.smithi063.stdout:0/717: dread - d0/fda zero size 2023-12-12T11:52:06.617 INFO:tasks.workunit.client.0.smithi063.stdout:3/631: dwrite d4/df/d1a/d1c/f28 [0,4194304] 0 2023-12-12T11:52:06.621 INFO:tasks.workunit.client.1.smithi093.stdout:3/927: symlink df/d22/d49/d69/d78/daf/d3d/d6f/l12c 0 2023-12-12T11:52:06.623 INFO:tasks.workunit.client.0.smithi063.stdout:2/601: creat d0/d1a/dba/fc3 x:0 0 0 2023-12-12T11:52:06.624 INFO:tasks.workunit.client.1.smithi093.stdout:8/977: mkdir d3/d1a/d1f/d29/d30/d13f 0 2023-12-12T11:52:06.624 INFO:tasks.workunit.client.1.smithi093.stdout:8/978: dread - d3/d1a/d1f/d59/d69/ff2 zero size 2023-12-12T11:52:06.629 INFO:tasks.workunit.client.1.smithi093.stdout:9/956: dread d1/d23/d24/d29/d43/d56/d68/fd1 [0,4194304] 0 2023-12-12T11:52:06.634 INFO:tasks.workunit.client.1.smithi093.stdout:7/901: mknod da/d15/d59/d80/c13b 0 2023-12-12T11:52:06.643 INFO:tasks.workunit.client.0.smithi063.stdout:0/718: rename d0/d1a/d23/d34/fde to d0/d1a/d66/fed 0 2023-12-12T11:52:06.647 INFO:tasks.workunit.client.0.smithi063.stdout:8/772: dwrite d4/de/d1e/f7b [0,4194304] 0 2023-12-12T11:52:06.647 INFO:tasks.workunit.client.0.smithi063.stdout:1/746: dwrite d3/d3a/dd7/d16/d17/d4b/fd8 [0,4194304] 0 2023-12-12T11:52:06.647 INFO:tasks.workunit.client.0.smithi063.stdout:8/773: chown d4/de/d3b/d62/d36/d7f/fe7 962226808 1 2023-12-12T11:52:06.650 INFO:tasks.workunit.client.1.smithi093.stdout:2/956: dwrite d5/d14/d2d/d12/d25/f29 [0,4194304] 0 2023-12-12T11:52:06.653 INFO:tasks.workunit.client.0.smithi063.stdout:3/632: creat d4/df/d1a/d1c/d3b/d50/d61/fbe x:0 0 0 2023-12-12T11:52:06.657 INFO:tasks.workunit.client.0.smithi063.stdout:2/602: dread d0/d1a/d26/f29 [0,4194304] 0 2023-12-12T11:52:06.661 INFO:tasks.workunit.client.0.smithi063.stdout:0/719: unlink d0/d7/f9b 0 2023-12-12T11:52:06.661 INFO:tasks.workunit.client.0.smithi063.stdout:0/720: fsync d0/d7/f31 0 2023-12-12T11:52:06.665 INFO:tasks.workunit.client.0.smithi063.stdout:0/721: write d0/d1a/d23/d34/d42/d99/fbf [465386,70808] 0 2023-12-12T11:52:06.666 INFO:tasks.workunit.client.1.smithi093.stdout:3/928: truncate df/d25/d2c/d85/f8f 1335743 0 2023-12-12T11:52:06.667 INFO:tasks.workunit.client.0.smithi063.stdout:1/747: creat d3/d3a/d52/ddf/ff6 x:0 0 0 2023-12-12T11:52:06.669 INFO:tasks.workunit.client.1.smithi093.stdout:8/979: rmdir d3/d1a/d1f/d59/d69/dbc/dc2 39 2023-12-12T11:52:06.670 INFO:tasks.workunit.client.0.smithi063.stdout:0/722: symlink d0/d8e/lee 0 2023-12-12T11:52:06.672 INFO:tasks.workunit.client.0.smithi063.stdout:8/774: write d4/de/d3b/d62/d36/d57/d84/fbc [4712625,101042] 0 2023-12-12T11:52:06.674 INFO:tasks.workunit.client.1.smithi093.stdout:9/957: rename d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/f6a to d1/d23/d24/d29/d43/d56/de9/f142 0 2023-12-12T11:52:06.676 INFO:tasks.workunit.client.0.smithi063.stdout:1/748: creat d3/d3a/dd7/d16/d17/d4b/d8c/dd9/ff7 x:0 0 0 2023-12-12T11:52:06.682 INFO:tasks.workunit.client.0.smithi063.stdout:2/603: dread d0/d1a/d26/f37 [0,4194304] 0 2023-12-12T11:52:06.685 INFO:tasks.workunit.client.1.smithi093.stdout:5/828: dwrite d0/d7/d8/f13 [0,4194304] 0 2023-12-12T11:52:06.687 INFO:tasks.workunit.client.1.smithi093.stdout:1/963: dwrite d4/d1a/d73/f60 [4194304,4194304] 0 2023-12-12T11:52:06.687 INFO:tasks.workunit.client.1.smithi093.stdout:1/964: stat d4/d1a/d1b/dbf/l105 0 2023-12-12T11:52:06.687 INFO:tasks.workunit.client.1.smithi093.stdout:1/965: chown d4/d1a/le0 7011941 1 2023-12-12T11:52:06.687 INFO:tasks.workunit.client.1.smithi093.stdout:1/966: getdents d4/d1a/d73/dd4/dd5 0 2023-12-12T11:52:06.687 INFO:tasks.workunit.client.0.smithi063.stdout:8/775: getdents d4/de/d3b/d62/d6e/d76 0 2023-12-12T11:52:06.687 INFO:tasks.workunit.client.0.smithi063.stdout:8/776: fdatasync d4/de/f13 0 2023-12-12T11:52:06.692 INFO:tasks.workunit.client.0.smithi063.stdout:6/728: dwrite d9/d68/f78 [0,4194304] 0 2023-12-12T11:52:06.694 INFO:tasks.workunit.client.1.smithi093.stdout:8/980: read d3/d1a/d1f/d59/d69/f7f [1167811,50945] 0 2023-12-12T11:52:06.695 INFO:tasks.workunit.client.1.smithi093.stdout:7/902: creat da/de/d46/f13c x:0 0 0 2023-12-12T11:52:06.695 INFO:tasks.workunit.client.1.smithi093.stdout:7/903: fdatasync da/d15/d19/f10c 0 2023-12-12T11:52:06.696 INFO:tasks.workunit.client.1.smithi093.stdout:8/981: write d3/d8/d88/f10a [616730,46656] 0 2023-12-12T11:52:06.697 INFO:tasks.workunit.client.0.smithi063.stdout:6/729: read d9/d68/f9d [671386,10206] 0 2023-12-12T11:52:06.705 INFO:tasks.workunit.client.0.smithi063.stdout:0/723: getdents d0/d1a/d23/d2e 0 2023-12-12T11:52:06.711 INFO:tasks.workunit.client.1.smithi093.stdout:7/904: dread da/d15/d19/d4c/f133 [0,4194304] 0 2023-12-12T11:52:06.712 INFO:tasks.workunit.client.1.smithi093.stdout:3/929: dwrite df/d25/d2c/f5f [0,4194304] 0 2023-12-12T11:52:06.713 INFO:tasks.workunit.client.0.smithi063.stdout:4/710: dwrite d2/d47/f7d [0,4194304] 0 2023-12-12T11:52:06.713 INFO:tasks.workunit.client.0.smithi063.stdout:1/749: dread d3/d3a/dd7/d16/d17/f90 [0,4194304] 0 2023-12-12T11:52:06.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.710+0000 7f4f59cde700 1 -- 172.21.15.63:0/237558996 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4f5410bf00 con 0x7f4f54066090 2023-12-12T11:52:06.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.712+0000 7f4f3bfff700 1 -- 172.21.15.63:0/237558996 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f4f440536c0 con 0x7f4f54066090 2023-12-12T11:52:06.716 INFO:teuthology.orchestra.run.smithi063.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-12T11:52:06.716 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-12T11:52:06.716 INFO:teuthology.orchestra.run.smithi063.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-12T11:52:06.718 INFO:tasks.workunit.client.0.smithi063.stdout:2/604: link d0/d41/daf/lb1 d0/d1a/d1e/d64/lc4 0 2023-12-12T11:52:06.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.718+0000 7f4f59cde700 1 -- 172.21.15.63:0/237558996 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f4f3c06afd0 msgr2=0x7f4f3c06d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:06.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.719+0000 7f4f59cde700 1 --2- 172.21.15.63:0/237558996 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f4f3c06afd0 0x7f4f3c06d480 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4f48000c00 tx=0x7f4f48009e30 comp rx=0 tx=0).stop 2023-12-12T11:52:06.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.719+0000 7f4f59cde700 1 -- 172.21.15.63:0/237558996 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4f54066090 msgr2=0x7f4f5410fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:06.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.719+0000 7f4f59cde700 1 --2- 172.21.15.63:0/237558996 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4f54066090 0x7f4f5410fa60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4f440041d0 tx=0x7f4f4400b040 comp rx=0 tx=0).stop 2023-12-12T11:52:06.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.719+0000 7f4f59cde700 1 -- 172.21.15.63:0/237558996 shutdown_connections 2023-12-12T11:52:06.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.719+0000 7f4f59cde700 1 --2- 172.21.15.63:0/237558996 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f4f3c06afd0 0x7f4f3c06d480 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:06.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.719+0000 7f4f59cde700 1 --2- 172.21.15.63:0/237558996 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4f54066090 0x7f4f5410fa60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:06.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.719+0000 7f4f59cde700 1 --2- 172.21.15.63:0/237558996 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f540ffd70 0x7f4f5410ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:06.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.719+0000 7f4f59cde700 1 -- 172.21.15.63:0/237558996 >> 172.21.15.63:0/237558996 conn(0x7f4f540f7190 msgr2=0x7f4f540f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:52:06.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.720+0000 7f4f59cde700 1 -- 172.21.15.63:0/237558996 shutdown_connections 2023-12-12T11:52:06.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:06.720+0000 7f4f59cde700 1 -- 172.21.15.63:0/237558996 wait complete. 2023-12-12T11:52:06.731 INFO:tasks.workunit.client.1.smithi093.stdout:2/957: truncate d5/d14/d2d/d4c/d76/dc6/d118/d4e/f8a 1081339 0 2023-12-12T11:52:06.736 INFO:tasks.workunit.client.1.smithi093.stdout:9/958: mknod d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/dc0/c143 0 2023-12-12T11:52:06.736 INFO:tasks.workunit.client.1.smithi093.stdout:9/959: readlink d1/d23/d24/d29/d43/d56/d85/lbf 0 2023-12-12T11:52:06.751 INFO:tasks.workunit.client.1.smithi093.stdout:5/829: rename d0/dfc/l100 to d0/d7/d36/d29/d76/l11e 0 2023-12-12T11:52:06.751 INFO:tasks.workunit.client.1.smithi093.stdout:5/830: write d0/d7/d59/d48/f56 [1204680,96930] 0 2023-12-12T11:52:06.751 INFO:tasks.workunit.client.1.smithi093.stdout:5/831: write d0/d7/d36/d68/f7a [1100176,89317] 0 2023-12-12T11:52:06.752 INFO:tasks.workunit.client.1.smithi093.stdout:5/832: write d0/d7/d36/db9/d66/f110 [1774093,93730] 0 2023-12-12T11:52:06.752 INFO:tasks.workunit.client.1.smithi093.stdout:5/833: chown d0/d7/d59/d48/f50 483563 1 2023-12-12T11:52:06.768 INFO:tasks.workunit.client.0.smithi063.stdout:4/711: rename d2/d17/d41/c63 to d2/d48/d69/ce9 0 2023-12-12T11:52:06.770 INFO:tasks.workunit.client.0.smithi063.stdout:2/605: rename d0/d1a/d57/l73 to d0/d1a/d48/d56/lc5 0 2023-12-12T11:52:06.778 INFO:tasks.workunit.client.1.smithi093.stdout:7/905: unlink da/l48 0 2023-12-12T11:52:06.782 INFO:tasks.workunit.client.1.smithi093.stdout:2/958: rmdir d5/d14/d2d/d4c/d76/dc6/d118/d4e/dae 39 2023-12-12T11:52:06.782 INFO:tasks.workunit.client.1.smithi093.stdout:9/960: rmdir d1/d23/d24/d29/d43/d56/de9/d10f 0 2023-12-12T11:52:06.782 INFO:tasks.workunit.client.1.smithi093.stdout:5/834: mkdir d0/d7/d8/d10c/d11f 0 2023-12-12T11:52:06.782 INFO:tasks.workunit.client.1.smithi093.stdout:9/961: fsync d1/fa 0 2023-12-12T11:52:06.782 INFO:tasks.workunit.client.1.smithi093.stdout:9/962: chown d1/d23/d24/d29/d43/d58/fac 6801938 1 2023-12-12T11:52:06.783 INFO:tasks.workunit.client.1.smithi093.stdout:7/906: creat da/de/d81/f13d x:0 0 0 2023-12-12T11:52:06.783 INFO:tasks.workunit.client.1.smithi093.stdout:3/930: unlink df/d25/dd2/f12b 0 2023-12-12T11:52:06.784 INFO:tasks.workunit.client.1.smithi093.stdout:3/931: chown df/d22/d49/d69/d78/daf/d3d/d6f/l71 1201 1 2023-12-12T11:52:06.786 INFO:tasks.workunit.client.1.smithi093.stdout:2/959: stat d5/d14/d2d/d12/d25/d7a/d7e/da5/dfc/l100 0 2023-12-12T11:52:06.786 INFO:tasks.workunit.client.1.smithi093.stdout:2/960: write d5/d14/d2d/d12/d44/f4d [404972,53944] 0 2023-12-12T11:52:06.787 INFO:tasks.workunit.client.1.smithi093.stdout:2/961: truncate d5/d14/f40 702531 0 2023-12-12T11:52:06.787 INFO:tasks.workunit.client.1.smithi093.stdout:2/962: write d5/d31/dbc/fd4 [1606775,64159] 0 2023-12-12T11:52:06.788 INFO:tasks.workunit.client.1.smithi093.stdout:5/835: unlink d0/d7/d36/db9/d66/d7c/f119 0 2023-12-12T11:52:06.789 INFO:tasks.workunit.client.1.smithi093.stdout:5/836: write d0/d7/d59/fa1 [1513949,58056] 0 2023-12-12T11:52:06.789 INFO:tasks.workunit.client.1.smithi093.stdout:5/837: read - d0/d7/d59/fcf zero size 2023-12-12T11:52:06.789 INFO:tasks.workunit.client.1.smithi093.stdout:7/907: mkdir da/de/d13e 0 2023-12-12T11:52:06.790 INFO:tasks.workunit.client.1.smithi093.stdout:7/908: dread - da/d15/d19/d4c/f114 zero size 2023-12-12T11:52:06.790 INFO:tasks.workunit.client.0.smithi063.stdout:4/712: dread d2/d17/d7f/fa9 [0,4194304] 0 2023-12-12T11:52:06.792 INFO:tasks.workunit.client.0.smithi063.stdout:4/713: write d2/d48/d4f/fe4 [264295,89973] 0 2023-12-12T11:52:06.793 INFO:tasks.workunit.client.1.smithi093.stdout:3/932: symlink df/d22/d49/d69/d78/daf/d3d/l12d 0 2023-12-12T11:52:06.794 INFO:tasks.workunit.client.1.smithi093.stdout:2/963: truncate d5/d14/f4f 4914060 0 2023-12-12T11:52:06.794 INFO:tasks.workunit.client.1.smithi093.stdout:2/964: creat d5/d14/d2d/d4c/d54/dc5/d55/d75/f141 x:0 0 0 2023-12-12T11:52:06.794 INFO:tasks.workunit.client.1.smithi093.stdout:2/965: write d5/d14/d2d/d4c/d76/dc6/f116 [964928,112947] 0 2023-12-12T11:52:06.794 INFO:tasks.workunit.client.1.smithi093.stdout:2/966: dread - d5/d14/d2d/d4c/d54/d67/d69/dde/f129 zero size 2023-12-12T11:52:06.794 INFO:tasks.workunit.client.0.smithi063.stdout:4/714: mknod d2/d8/d76/cea 0 2023-12-12T11:52:06.795 INFO:tasks.workunit.client.0.smithi063.stdout:4/715: creat d2/d17/d4e/feb x:0 0 0 2023-12-12T11:52:06.795 INFO:tasks.workunit.client.0.smithi063.stdout:4/716: readlink d2/d47/l3b 0 2023-12-12T11:52:06.796 INFO:tasks.workunit.client.1.smithi093.stdout:5/838: mkdir d0/d7/d36/db9/d66/d7c/db5/d120 0 2023-12-12T11:52:06.796 INFO:tasks.workunit.client.1.smithi093.stdout:7/909: creat da/d15/d19/d4c/d6d/f13f x:0 0 0 2023-12-12T11:52:06.798 INFO:tasks.workunit.client.1.smithi093.stdout:5/839: mknod d0/d7/d8/de/dab/de5/c121 0 2023-12-12T11:52:06.801 INFO:tasks.workunit.client.1.smithi093.stdout:7/910: truncate da/de/d78/fb8 722210 0 2023-12-12T11:52:06.801 INFO:tasks.workunit.client.0.smithi063.stdout:3/633: dwrite d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/da1/fa2 [0,4194304] 0 2023-12-12T11:52:06.801 INFO:tasks.workunit.client.0.smithi063.stdout:3/634: readlink d4/df/d1a/d1c/d3b/d50/d61/l73 0 2023-12-12T11:52:06.802 INFO:tasks.workunit.client.0.smithi063.stdout:0/724: getdents d0/d8e 0 2023-12-12T11:52:06.802 INFO:tasks.workunit.client.1.smithi093.stdout:8/982: dwrite d3/d1a/d1f/f27 [0,4194304] 0 2023-12-12T11:52:06.803 INFO:tasks.workunit.client.1.smithi093.stdout:1/967: dwrite d4/d1a/d73/f60 [0,4194304] 0 2023-12-12T11:52:06.803 INFO:tasks.workunit.client.0.smithi063.stdout:2/606: dread d0/d1a/d1e/f4b [0,4194304] 0 2023-12-12T11:52:06.804 INFO:tasks.workunit.client.0.smithi063.stdout:8/777: dwrite d4/de/d3b/d62/d36/f3a [4194304,4194304] 0 2023-12-12T11:52:06.804 INFO:tasks.workunit.client.0.smithi063.stdout:8/778: dread - d4/d24/d38/d45/d5b/ff1 zero size 2023-12-12T11:52:06.804 INFO:tasks.workunit.client.0.smithi063.stdout:8/779: read d4/de/d3b/d62/d36/d57/d84/fee [5604866,37802] 0 2023-12-12T11:52:06.805 INFO:tasks.workunit.client.1.smithi093.stdout:5/840: mkdir d0/dd2/d122 0 2023-12-12T11:52:06.806 INFO:tasks.workunit.client.0.smithi063.stdout:4/717: dread d2/d17/d41/f5b [0,4194304] 0 2023-12-12T11:52:06.806 INFO:tasks.workunit.client.0.smithi063.stdout:4/718: truncate d2/d48/fac 4435722 0 2023-12-12T11:52:06.807 INFO:tasks.workunit.client.0.smithi063.stdout:1/750: dwrite d3/d3a/dd7/d16/d4f/d9a/fab [0,4194304] 0 2023-12-12T11:52:06.809 INFO:tasks.workunit.client.0.smithi063.stdout:6/730: dwrite d9/d10/d25/fb1 [0,4194304] 0 2023-12-12T11:52:06.814 INFO:tasks.workunit.client.0.smithi063.stdout:8/780: dread d4/f4e [0,4194304] 0 2023-12-12T11:52:06.822 INFO:tasks.workunit.client.1.smithi093.stdout:8/983: write d3/d1a/d1f/f3f [5653243,63409] 0 2023-12-12T11:52:06.828 INFO:tasks.workunit.client.0.smithi063.stdout:3/635: symlink d4/df/lbf 0 2023-12-12T11:52:06.830 INFO:tasks.workunit.client.1.smithi093.stdout:2/967: dread d5/d14/d2d/d4c/d76/dc6/f103 [0,4194304] 0 2023-12-12T11:52:06.830 INFO:tasks.workunit.client.1.smithi093.stdout:1/968: dread d4/fd [0,4194304] 0 2023-12-12T11:52:06.836 INFO:tasks.workunit.client.0.smithi063.stdout:0/725: mkdir d0/d1a/d23/d2e/dd4/ddc/de0/def 0 2023-12-12T11:52:06.837 INFO:tasks.workunit.client.0.smithi063.stdout:0/726: fsync d0/d7/d27/fc9 0 2023-12-12T11:52:06.837 INFO:tasks.workunit.client.0.smithi063.stdout:0/727: write d0/d7/d27/d1f/dc4/d67/fd8 [136695,75548] 0 2023-12-12T11:52:06.843 INFO:tasks.workunit.client.1.smithi093.stdout:8/984: dread d3/d8/d88/dc5/fd4 [0,4194304] 0 2023-12-12T11:52:06.858 INFO:tasks.workunit.client.1.smithi093.stdout:5/841: dwrite d0/d7/d36/d29/d44/fae [0,4194304] 0 2023-12-12T11:52:06.858 INFO:tasks.workunit.client.1.smithi093.stdout:9/963: dwrite d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/f25 [4194304,4194304] 0 2023-12-12T11:52:06.858 INFO:tasks.workunit.client.1.smithi093.stdout:5/842: write d0/d7/d36/d29/d44/f94 [801971,33379] 0 2023-12-12T11:52:06.858 INFO:tasks.workunit.client.1.smithi093.stdout:5/843: write d0/d7/d36/d87/f107 [807936,114242] 0 2023-12-12T11:52:06.860 INFO:tasks.workunit.client.0.smithi063.stdout:1/751: mkdir d3/d3a/dd7/d16/d4f/da7/df8 0 2023-12-12T11:52:06.867 INFO:tasks.workunit.client.0.smithi063.stdout:6/731: link d9/f4b d9/d68/d8f/ffd 0 2023-12-12T11:52:06.867 INFO:tasks.workunit.client.0.smithi063.stdout:3/636: creat d4/df/d1a/d1c/d34/fc0 x:0 0 0 2023-12-12T11:52:06.869 INFO:tasks.workunit.client.1.smithi093.stdout:1/969: rename d4/d1a/d73/dd4/l125 to d4/d1a/d1b/d26/d65/dc8/d104/l147 0 2023-12-12T11:52:06.871 INFO:tasks.workunit.client.1.smithi093.stdout:8/985: creat d3/d138/f140 x:0 0 0 2023-12-12T11:52:06.871 INFO:tasks.workunit.client.1.smithi093.stdout:8/986: chown d3/d1a/d1f/d59/d69/dbc/dc2/l12c 3 1 2023-12-12T11:52:06.872 INFO:tasks.workunit.client.1.smithi093.stdout:8/987: read d3/d8/d88/fb4 [1312802,61014] 0 2023-12-12T11:52:06.873 INFO:tasks.workunit.client.0.smithi063.stdout:4/719: rmdir d2/d47/d6d 39 2023-12-12T11:52:06.876 INFO:tasks.workunit.client.0.smithi063.stdout:1/752: getdents d3/d3a/dd7/d16/d4f/d9a 0 2023-12-12T11:52:06.876 INFO:tasks.workunit.client.0.smithi063.stdout:1/753: fdatasync d3/d3a/dd7/d16/d24/d30/f9c 0 2023-12-12T11:52:06.876 INFO:tasks.workunit.client.1.smithi093.stdout:7/911: dwrite da/d2e/d89/ff9 [0,4194304] 0 2023-12-12T11:52:06.880 INFO:tasks.workunit.client.1.smithi093.stdout:9/964: creat d1/d23/d6b/d92/ddd/f144 x:0 0 0 2023-12-12T11:52:06.880 INFO:tasks.workunit.client.1.smithi093.stdout:5/844: dread d0/d7/d8/f5d [0,4194304] 0 2023-12-12T11:52:06.883 INFO:tasks.workunit.client.0.smithi063.stdout:2/607: dwrite d0/fbd [0,4194304] 0 2023-12-12T11:52:06.884 INFO:tasks.workunit.client.0.smithi063.stdout:8/781: dwrite d4/de/d3b/d62/d36/f3a [0,4194304] 0 2023-12-12T11:52:06.884 INFO:tasks.workunit.client.1.smithi093.stdout:2/968: getdents d5/d14/d2d/d8b/da3/de5 0 2023-12-12T11:52:06.885 INFO:tasks.workunit.client.0.smithi063.stdout:9/574: sync 2023-12-12T11:52:06.886 INFO:tasks.workunit.client.0.smithi063.stdout:6/732: symlink d9/d10/d2a/de7/lfe 0 2023-12-12T11:52:06.891 INFO:tasks.workunit.client.0.smithi063.stdout:7/589: sync 2023-12-12T11:52:06.891 INFO:tasks.workunit.client.0.smithi063.stdout:4/720: mkdir d2/d47/dec 0 2023-12-12T11:52:06.891 INFO:tasks.workunit.client.0.smithi063.stdout:3/637: symlink d4/df/d1a/d1c/d3b/d52/d78/da5/dbc/lc1 0 2023-12-12T11:52:06.892 INFO:tasks.workunit.client.0.smithi063.stdout:3/638: truncate f0 8105104 0 2023-12-12T11:52:06.892 INFO:tasks.workunit.client.0.smithi063.stdout:3/639: write d4/df/d1a/d1c/d3b/d50/d9f/fa9 [2477046,10038] 0 2023-12-12T11:52:06.892 INFO:tasks.workunit.client.1.smithi093.stdout:8/988: dread d3/f129 [0,4194304] 0 2023-12-12T11:52:06.893 INFO:tasks.workunit.client.0.smithi063.stdout:0/728: dread d0/d7/d27/f33 [0,4194304] 0 2023-12-12T11:52:06.896 INFO:tasks.workunit.client.1.smithi093.stdout:7/912: creat da/d8e/da9/f140 x:0 0 0 2023-12-12T11:52:06.900 INFO:tasks.workunit.client.1.smithi093.stdout:5/845: rename d0/d7/d85/da0 to d0/d7/d36/d68/def/d123 0 2023-12-12T11:52:06.900 INFO:tasks.workunit.client.1.smithi093.stdout:5/846: chown d0/dd2 149345 1 2023-12-12T11:52:06.903 INFO:tasks.workunit.client.0.smithi063.stdout:2/608: write d0/d69/f97 [2568567,466] 0 2023-12-12T11:52:06.904 INFO:tasks.workunit.client.0.smithi063.stdout:8/782: mkdir d4/d24/d38/dd8/df5 0 2023-12-12T11:52:06.910 INFO:tasks.workunit.client.0.smithi063.stdout:9/575: creat d7/d20/d45/d46/d51/d64/d6f/dad/fbd x:0 0 0 2023-12-12T11:52:06.913 INFO:tasks.workunit.client.1.smithi093.stdout:7/913: read da/de/d46/d4f/f64 [1694446,84927] 0 2023-12-12T11:52:06.913 INFO:tasks.workunit.client.1.smithi093.stdout:8/989: symlink d3/d1a/d1f/d29/d3a/d68/d8a/l141 0 2023-12-12T11:52:06.914 INFO:tasks.workunit.client.0.smithi063.stdout:6/733: symlink d9/d10/d2a/de7/lff 0 2023-12-12T11:52:06.914 INFO:tasks.workunit.client.0.smithi063.stdout:6/734: write d9/d68/d8f/fd2 [255670,3351] 0 2023-12-12T11:52:06.916 INFO:tasks.workunit.client.1.smithi093.stdout:2/969: rename d5/d31/dbc/l11d to d5/d14/d2d/d4c/d54/d67/d69/dde/l142 0 2023-12-12T11:52:06.917 INFO:tasks.workunit.client.0.smithi063.stdout:2/609: write d0/d1a/d1e/f70 [4055369,95636] 0 2023-12-12T11:52:06.917 INFO:tasks.workunit.client.0.smithi063.stdout:7/590: symlink de/d22/d6e/d8a/da3/ldf 0 2023-12-12T11:52:06.917 INFO:tasks.workunit.client.0.smithi063.stdout:7/591: stat de/d33/dd2/d4a 0 2023-12-12T11:52:06.918 INFO:tasks.workunit.client.1.smithi093.stdout:5/847: mkdir d0/d124 0 2023-12-12T11:52:06.919 INFO:tasks.workunit.client.1.smithi093.stdout:5/848: stat d0/d7/d36/d68/ff3 0 2023-12-12T11:52:06.919 INFO:tasks.workunit.client.1.smithi093.stdout:5/849: readlink d0/d7/d36/d68/def/d123/la6 0 2023-12-12T11:52:06.919 INFO:tasks.workunit.client.1.smithi093.stdout:5/850: write d0/d7/d36/db9/d66/d7c/db5/dcc/fb1 [4857467,81829] 0 2023-12-12T11:52:06.921 INFO:tasks.workunit.client.1.smithi093.stdout:9/965: dwrite d1/d23/d6b/f8c [4194304,4194304] 0 2023-12-12T11:52:06.924 INFO:tasks.workunit.client.1.smithi093.stdout:2/970: rename d5/d14/d5e/c128 to d5/d14/d2d/d96/dca/c143 0 2023-12-12T11:52:06.925 INFO:tasks.workunit.client.0.smithi063.stdout:8/783: mkdir d4/de/d3b/d62/d36/d57/d84/df6 0 2023-12-12T11:52:06.928 INFO:tasks.workunit.client.0.smithi063.stdout:9/576: rename d7/d11/d12/d30/d3e/d55/l89 to d7/d20/d65/lbe 0 2023-12-12T11:52:06.928 INFO:tasks.workunit.client.0.smithi063.stdout:5/724: sync 2023-12-12T11:52:06.928 INFO:tasks.workunit.client.0.smithi063.stdout:5/725: readlink d7/d28/d6e/dad/dba/lc1 0 2023-12-12T11:52:06.928 INFO:tasks.workunit.client.0.smithi063.stdout:5/726: fdatasync d7/d10/d2b/d3c/d27/f8e 0 2023-12-12T11:52:06.929 INFO:tasks.workunit.client.1.smithi093.stdout:5/851: creat d0/d7/d85/f125 x:0 0 0 2023-12-12T11:52:06.930 INFO:tasks.workunit.client.1.smithi093.stdout:9/966: dread d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d73/fab [0,4194304] 0 2023-12-12T11:52:06.930 INFO:tasks.workunit.client.1.smithi093.stdout:9/967: write d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/f106 [783552,123162] 0 2023-12-12T11:52:06.930 INFO:tasks.workunit.client.1.smithi093.stdout:9/968: fdatasync d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/db1/ff3 0 2023-12-12T11:52:06.930 INFO:tasks.workunit.client.1.smithi093.stdout:9/969: write d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d5c/fec [1007873,87109] 0 2023-12-12T11:52:06.932 INFO:tasks.workunit.client.0.smithi063.stdout:2/610: link d0/c51 d0/d1a/d3a/cc6 0 2023-12-12T11:52:06.935 INFO:tasks.workunit.client.0.smithi063.stdout:7/592: mknod de/d22/d6e/da2/ce0 0 2023-12-12T11:52:06.937 INFO:tasks.workunit.client.1.smithi093.stdout:0/963: sync 2023-12-12T11:52:06.938 INFO:tasks.workunit.client.0.smithi063.stdout:7/593: read de/d39/d4b/d7b/fbe [299367,105053] 0 2023-12-12T11:52:06.939 INFO:tasks.workunit.client.1.smithi093.stdout:2/971: mknod d5/d14/d2d/d4c/d54/d67/d69/c144 0 2023-12-12T11:52:06.941 INFO:tasks.workunit.client.0.smithi063.stdout:3/640: getdents d4/df/d1a/d1c/d3b/d50 0 2023-12-12T11:52:06.941 INFO:tasks.workunit.client.0.smithi063.stdout:3/641: chown d4/df/d1a/f31 248 1 2023-12-12T11:52:06.941 INFO:tasks.workunit.client.0.smithi063.stdout:3/642: write d4/df/d1a/d1c/d3b/d50/f5a [4893711,39912] 0 2023-12-12T11:52:06.946 INFO:tasks.workunit.client.0.smithi063.stdout:5/727: link d7/d10/d2b/d3c/d27/c60 d7/d10/d2b/d3c/d42/d62/d69/dcb/cdc 0 2023-12-12T11:52:06.947 INFO:tasks.workunit.client.1.smithi093.stdout:5/852: dread d0/d7/d59/d48/f56 [0,4194304] 0 2023-12-12T11:52:06.947 INFO:tasks.workunit.client.1.smithi093.stdout:5/853: chown d0/d7/d8/f8b 7073 1 2023-12-12T11:52:06.947 INFO:tasks.workunit.client.1.smithi093.stdout:0/964: mkdir d5/dd/d62/d10c/d11b/d125 0 2023-12-12T11:52:06.947 INFO:tasks.workunit.client.1.smithi093.stdout:0/965: fdatasync d5/d21/d27/d3a/f67 0 2023-12-12T11:52:06.948 INFO:tasks.workunit.client.0.smithi063.stdout:6/735: rmdir d9/d10/d5c 39 2023-12-12T11:52:06.951 INFO:tasks.workunit.client.1.smithi093.stdout:5/854: symlink d0/d7/d36/db9/d66/d7c/db5/d10e/l126 0 2023-12-12T11:52:06.952 INFO:tasks.workunit.client.0.smithi063.stdout:2/611: mkdir d0/d1a/d1e/d64/dc7 0 2023-12-12T11:52:06.952 INFO:tasks.workunit.client.0.smithi063.stdout:2/612: write d0/d1a/d48/d56/d77/f8d [890182,112349] 0 2023-12-12T11:52:06.952 INFO:tasks.workunit.client.0.smithi063.stdout:2/613: chown d0/la 196410 1 2023-12-12T11:52:06.954 INFO:tasks.workunit.client.0.smithi063.stdout:8/784: dread d4/f42 [0,4194304] 0 2023-12-12T11:52:06.956 INFO:tasks.workunit.client.1.smithi093.stdout:0/966: symlink d5/dd/d14/d26/d58/dab/d116/l126 0 2023-12-12T11:52:06.956 INFO:tasks.workunit.client.1.smithi093.stdout:2/972: dread d5/d14/f4f [0,4194304] 0 2023-12-12T11:52:06.959 INFO:tasks.workunit.client.0.smithi063.stdout:7/594: mknod de/ce1 0 2023-12-12T11:52:06.960 INFO:tasks.workunit.client.0.smithi063.stdout:9/577: dread d7/d20/d65/fa2 [0,4194304] 0 2023-12-12T11:52:06.960 INFO:tasks.workunit.client.0.smithi063.stdout:9/578: chown d7/d11/fa0 2 1 2023-12-12T11:52:06.960 INFO:tasks.workunit.client.0.smithi063.stdout:9/579: chown d7/d20/d3f/d40/d76/f8c 29780677 1 2023-12-12T11:52:06.960 INFO:tasks.workunit.client.1.smithi093.stdout:5/855: rmdir d0/d7/d36/d29/d44 39 2023-12-12T11:52:06.960 INFO:tasks.workunit.client.1.smithi093.stdout:5/856: dread - d0/d7/d8/de/dab/de5/ffd zero size 2023-12-12T11:52:06.962 INFO:tasks.workunit.client.0.smithi063.stdout:3/643: mkdir d4/d23/d7b/dc2 0 2023-12-12T11:52:06.963 INFO:tasks.workunit.client.1.smithi093.stdout:0/967: symlink d5/dd/d33/l127 0 2023-12-12T11:52:06.968 INFO:tasks.workunit.client.1.smithi093.stdout:2/973: creat d5/d14/d2d/d12/f145 x:0 0 0 2023-12-12T11:52:06.969 INFO:tasks.workunit.client.0.smithi063.stdout:6/736: link d9/d10/d5c/c7e d9/d2c/c100 0 2023-12-12T11:52:06.969 INFO:tasks.workunit.client.0.smithi063.stdout:6/737: readlink d9/d10/d2a/de7/d86/le0 0 2023-12-12T11:52:06.971 INFO:tasks.workunit.client.0.smithi063.stdout:6/738: write d9/d68/fb2 [791834,116666] 0 2023-12-12T11:52:06.972 INFO:tasks.workunit.client.1.smithi093.stdout:9/970: dwrite d1/d23/d24/fa1 [0,4194304] 0 2023-12-12T11:52:06.976 INFO:tasks.workunit.client.0.smithi063.stdout:8/785: creat d4/d24/d38/dd8/df3/ff7 x:0 0 0 2023-12-12T11:52:06.976 INFO:tasks.workunit.client.0.smithi063.stdout:9/580: dread d7/fa [0,4194304] 0 2023-12-12T11:52:06.979 INFO:tasks.workunit.client.1.smithi093.stdout:2/974: link d5/c111 d5/d31/c146 0 2023-12-12T11:52:06.987 INFO:tasks.workunit.client.0.smithi063.stdout:7/595: creat de/d33/dd2/fe2 x:0 0 0 2023-12-12T11:52:06.988 INFO:tasks.workunit.client.1.smithi093.stdout:3/933: sync 2023-12-12T11:52:06.991 INFO:tasks.workunit.client.0.smithi063.stdout:2/614: getdents d0/d69 0 2023-12-12T11:52:06.991 INFO:tasks.workunit.client.0.smithi063.stdout:3/644: dread d4/df/d1a/d1c/d3b/d50/d61/f93 [0,4194304] 0 2023-12-12T11:52:06.992 INFO:tasks.workunit.client.0.smithi063.stdout:8/786: rename d4/de/l28 to d4/d55/d52/d8e/de8/lf8 0 2023-12-12T11:52:06.992 INFO:tasks.workunit.client.0.smithi063.stdout:8/787: readlink d4/d24/d38/d45/d5b/d92/laa 0 2023-12-12T11:52:06.995 INFO:tasks.workunit.client.0.smithi063.stdout:9/581: link d7/d11/d4b/d75/f9b d7/d8a/fbf 0 2023-12-12T11:52:07.018 INFO:tasks.workunit.client.0.smithi063.stdout:8/788: write d4/de/d1e/f5c [959555,105959] 0 2023-12-12T11:52:07.064 INFO:tasks.workunit.client.1.smithi093.stdout:0/968: dwrite d5/d41/d77/d79/d9b/f121 [0,4194304] 0 2023-12-12T11:52:07.067 INFO:tasks.workunit.client.0.smithi063.stdout:5/728: dwrite d7/d10/d2b/fb6 [0,4194304] 0 2023-12-12T11:52:07.071 INFO:tasks.workunit.client.0.smithi063.stdout:9/582: write d7/d15/f8f [2085274,17542] 0 2023-12-12T11:52:07.083 INFO:tasks.workunit.client.0.smithi063.stdout:2/615: dwrite d0/d1a/d48/d56/da2/fb2 [0,4194304] 0 2023-12-12T11:52:07.083 INFO:tasks.workunit.client.1.smithi093.stdout:3/934: dwrite df/d22/d49/d69/d78/daf/d3d/d59/d9c/fa2 [0,4194304] 0 2023-12-12T11:52:07.087 INFO:tasks.workunit.client.0.smithi063.stdout:8/789: dwrite d4/d24/d38/d45/fdb [0,4194304] 0 2023-12-12T11:52:07.125 INFO:tasks.workunit.client.0.smithi063.stdout:7/596: mkdir de/d22/d6e/d8a/de3 0 2023-12-12T11:52:07.127 INFO:tasks.workunit.client.0.smithi063.stdout:4/721: write d2/d48/d4f/f68 [67909,19454] 0 2023-12-12T11:52:07.127 INFO:tasks.workunit.client.0.smithi063.stdout:4/722: fsync d2/d47/d6d/f8f 0 2023-12-12T11:52:07.128 INFO:tasks.workunit.client.0.smithi063.stdout:3/645: creat d4/d23/d6b/d90/fc3 x:0 0 0 2023-12-12T11:52:07.131 INFO:tasks.workunit.client.1.smithi093.stdout:2/975: mknod d5/d14/d5e/dfa/c147 0 2023-12-12T11:52:07.135 INFO:tasks.workunit.client.1.smithi093.stdout:5/857: getdents d0/d7/d85 0 2023-12-12T11:52:07.143 INFO:tasks.workunit.client.1.smithi093.stdout:0/969: creat d5/dd/d14/d26/d58/d64/d6f/de8/f128 x:0 0 0 2023-12-12T11:52:07.151 INFO:tasks.workunit.client.0.smithi063.stdout:2/616: dwrite d0/d1a/d26/f7b [0,4194304] 0 2023-12-12T11:52:07.151 INFO:tasks.workunit.client.0.smithi063.stdout:2/617: truncate d0/d1a/d1e/d64/fbc 619632 0 2023-12-12T11:52:07.152 INFO:tasks.workunit.client.0.smithi063.stdout:2/618: fsync d0/f20 0 2023-12-12T11:52:07.158 INFO:tasks.workunit.client.1.smithi093.stdout:8/990: dwrite d3/d1a/d1f/d75/fdc [0,4194304] 0 2023-12-12T11:52:07.160 INFO:tasks.workunit.client.0.smithi063.stdout:9/583: creat d7/d20/d3f/d40/fc0 x:0 0 0 2023-12-12T11:52:07.160 INFO:tasks.workunit.client.0.smithi063.stdout:9/584: truncate d7/d11/d12/f37 4747242 0 2023-12-12T11:52:07.160 INFO:tasks.workunit.client.0.smithi063.stdout:9/585: write d7/d8a/fbf [4367381,79044] 0 2023-12-12T11:52:07.160 INFO:tasks.workunit.client.0.smithi063.stdout:9/586: readlink d7/d20/lae 0 2023-12-12T11:52:07.160 INFO:tasks.workunit.client.0.smithi063.stdout:9/587: stat d7/d15/db2 0 2023-12-12T11:52:07.161 INFO:tasks.workunit.client.0.smithi063.stdout:5/729: symlink d7/d10/d2b/d3c/d42/d62/d69/dcb/ldd 0 2023-12-12T11:52:07.173 INFO:tasks.workunit.client.1.smithi093.stdout:1/970: sync 2023-12-12T11:52:07.188 INFO:tasks.workunit.client.1.smithi093.stdout:0/970: dwrite d5/d21/d27/d3a/d9a/db5/db8/dd4/f102 [0,4194304] 0 2023-12-12T11:52:07.216 INFO:tasks.workunit.client.0.smithi063.stdout:2/619: dwrite d0/d1a/d48/f4a [0,4194304] 0 2023-12-12T11:52:07.216 INFO:tasks.workunit.client.0.smithi063.stdout:2/620: creat d0/d1a/dba/fc8 x:0 0 0 2023-12-12T11:52:07.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:06 smithi093 ceph-mon[115914]: Reconfiguring alertmanager.smithi063 (dependencies changed)... 2023-12-12T11:52:07.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:06 smithi093 ceph-mon[115914]: Reconfiguring daemon alertmanager.smithi063 on smithi063 2023-12-12T11:52:07.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:06 smithi093 ceph-mon[115914]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:52:07.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:06 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/237558996' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:52:07.224 INFO:tasks.workunit.client.1.smithi093.stdout:3/935: rename df/d22/d49/d69/d78/dad/f10d to df/d22/d49/d69/d78/db9/f12e 0 2023-12-12T11:52:07.241 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:06 smithi063 ceph-mon[107117]: Reconfiguring alertmanager.smithi063 (dependencies changed)... 2023-12-12T11:52:07.241 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:06 smithi063 ceph-mon[107117]: Reconfiguring daemon alertmanager.smithi063 on smithi063 2023-12-12T11:52:07.241 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:06 smithi063 ceph-mon[107117]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:52:07.241 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:06 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/237558996' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:52:07.255 INFO:tasks.workunit.client.0.smithi063.stdout:5/730: dwrite d7/d10/d2b/d3c/d5a/f6a [0,4194304] 0 2023-12-12T11:52:07.256 INFO:tasks.workunit.client.0.smithi063.stdout:5/731: chown d7/d10/d2b/d3c/d63/c83 187 1 2023-12-12T11:52:07.307 INFO:tasks.workunit.client.0.smithi063.stdout:5/732: dwrite d7/d10/d2b/d3c/d42/d76/f9e [0,4194304] 0 2023-12-12T11:52:07.317 INFO:tasks.workunit.client.0.smithi063.stdout:3/646: creat d4/df/d1a/d1c/d3b/d52/d78/dbb/fc4 x:0 0 0 2023-12-12T11:52:07.326 INFO:tasks.workunit.client.0.smithi063.stdout:9/588: getdents d7/d11/d94 0 2023-12-12T11:52:07.345 INFO:tasks.workunit.client.1.smithi093.stdout:2/976: mknod d5/d14/d2d/d4c/c148 0 2023-12-12T11:52:07.356 INFO:tasks.workunit.client.1.smithi093.stdout:8/991: rmdir d3/d1a/d1f/d29/d3a/db1/df9 0 2023-12-12T11:52:07.358 INFO:tasks.workunit.client.1.smithi093.stdout:1/971: creat d4/d1a/d83/f148 x:0 0 0 2023-12-12T11:52:07.371 INFO:tasks.workunit.client.1.smithi093.stdout:0/971: getdents d5/dd/d62 0 2023-12-12T11:52:07.374 INFO:tasks.workunit.client.0.smithi063.stdout:5/733: mkdir d7/d28/d6e/dad/dde 0 2023-12-12T11:52:07.374 INFO:tasks.workunit.client.0.smithi063.stdout:5/734: fdatasync d7/d28/d67/f90 0 2023-12-12T11:52:07.377 INFO:tasks.workunit.client.0.smithi063.stdout:3/647: creat d4/df/d1a/d1c/d3b/d52/d74/fc5 x:0 0 0 2023-12-12T11:52:07.378 INFO:tasks.workunit.client.1.smithi093.stdout:1/972: dread d4/dc/f28 [0,4194304] 0 2023-12-12T11:52:07.379 INFO:tasks.workunit.client.1.smithi093.stdout:2/977: creat d5/d14/d2d/d4c/d76/dc6/d118/d56/f149 x:0 0 0 2023-12-12T11:52:07.381 INFO:tasks.workunit.client.0.smithi063.stdout:9/589: dwrite d7/d20/d3f/d40/f44 [0,4194304] 0 2023-12-12T11:52:07.396 INFO:tasks.workunit.client.1.smithi093.stdout:8/992: rmdir d3/d1a/d1f/d29/d63 39 2023-12-12T11:52:07.396 INFO:tasks.workunit.client.1.smithi093.stdout:1/973: read d4/d1a/d1b/d26/f4d [1672122,100122] 0 2023-12-12T11:52:07.397 INFO:tasks.workunit.client.1.smithi093.stdout:1/974: stat d4/d1a/d1b/d26/d31/l4e 0 2023-12-12T11:52:07.397 INFO:tasks.workunit.client.1.smithi093.stdout:8/993: write d3/d1a/d1f/d59/fcd [749003,96615] 0 2023-12-12T11:52:07.397 INFO:tasks.workunit.client.1.smithi093.stdout:8/994: chown d3/d1a/d1f/d29/d3a/d40/dbf/fff 21 1 2023-12-12T11:52:07.397 INFO:tasks.workunit.client.0.smithi063.stdout:5/735: dread d7/d28/d6e/f39 [0,4194304] 0 2023-12-12T11:52:07.397 INFO:tasks.workunit.client.0.smithi063.stdout:5/736: truncate d7/d10/d2b/d3c/d42/f7d 304641 0 2023-12-12T11:52:07.399 INFO:tasks.workunit.client.1.smithi093.stdout:8/995: getdents d3/d1a/d1f/d29 0 2023-12-12T11:52:07.408 INFO:tasks.workunit.client.0.smithi063.stdout:9/590: dread d7/f1e [0,4194304] 0 2023-12-12T11:52:07.414 INFO:tasks.workunit.client.0.smithi063.stdout:9/591: unlink d7/d11/d4b/d75/f9b 0 2023-12-12T11:52:07.416 INFO:tasks.workunit.client.0.smithi063.stdout:9/592: symlink d7/d20/d45/d46/d51/d64/d6f/d85/lc1 0 2023-12-12T11:52:07.416 INFO:tasks.workunit.client.0.smithi063.stdout:9/593: write d7/d20/d3f/d40/d4e/f67 [116903,49526] 0 2023-12-12T11:52:07.418 INFO:tasks.workunit.client.1.smithi093.stdout:8/996: dread d3/d1a/f83 [0,4194304] 0 2023-12-12T11:52:07.418 INFO:tasks.workunit.client.1.smithi093.stdout:8/997: chown d3/d1a/d1f/d29/d30/fd2 20387236 1 2023-12-12T11:52:07.418 INFO:tasks.workunit.client.0.smithi063.stdout:9/594: link d7/d11/d4b/c62 d7/d20/d45/d46/d51/d64/d6f/dad/cc2 0 2023-12-12T11:52:07.425 INFO:tasks.workunit.client.1.smithi093.stdout:5/858: unlink d0/d7/d59/faf 0 2023-12-12T11:52:07.426 INFO:tasks.workunit.client.1.smithi093.stdout:5/859: unlink d0/dec/c9b 0 2023-12-12T11:52:07.428 INFO:tasks.workunit.client.1.smithi093.stdout:2/978: dwrite d5/d14/d2d/d12/d25/d7a/d7e/da0/fa9 [4194304,4194304] 0 2023-12-12T11:52:07.428 INFO:tasks.workunit.client.1.smithi093.stdout:2/979: write d5/d14/d2d/d4c/d76/dc6/f116 [1874411,77929] 0 2023-12-12T11:52:07.430 INFO:tasks.workunit.client.0.smithi063.stdout:3/648: dwrite d4/d23/d6b/f95 [0,4194304] 0 2023-12-12T11:52:07.430 INFO:tasks.workunit.client.0.smithi063.stdout:3/649: chown d4/d23/d6b 23745492 1 2023-12-12T11:52:07.433 INFO:tasks.workunit.client.0.smithi063.stdout:3/650: read d4/df/d1a/f31 [2032806,107328] 0 2023-12-12T11:52:07.433 INFO:tasks.workunit.client.0.smithi063.stdout:3/651: write d4/df/d1a/d1c/f29 [2347219,58466] 0 2023-12-12T11:52:07.457 INFO:tasks.workunit.client.0.smithi063.stdout:8/790: rename d4/d24/d38/f88 to d4/d55/d52/ff9 0 2023-12-12T11:52:07.457 INFO:tasks.workunit.client.0.smithi063.stdout:8/791: readlink d4/de/d3b/l72 0 2023-12-12T11:52:07.457 INFO:tasks.workunit.client.0.smithi063.stdout:8/792: readlink d4/d24/d38/d45/d5b/lb6 0 2023-12-12T11:52:07.457 INFO:tasks.workunit.client.0.smithi063.stdout:8/793: write d4/de/d3b/d62/f6f [963873,37558] 0 2023-12-12T11:52:07.464 INFO:tasks.workunit.client.0.smithi063.stdout:9/595: dread d7/d11/d12/f37 [0,4194304] 0 2023-12-12T11:52:07.468 INFO:tasks.workunit.client.0.smithi063.stdout:9/596: mkdir d7/d20/d45/d46/d51/dc3 0 2023-12-12T11:52:07.468 INFO:tasks.workunit.client.0.smithi063.stdout:9/597: write d7/d15/f17 [229164,82456] 0 2023-12-12T11:52:07.468 INFO:tasks.workunit.client.0.smithi063.stdout:9/598: chown d7/d11/d4b/f68 1 1 2023-12-12T11:52:07.468 INFO:tasks.workunit.client.0.smithi063.stdout:9/599: fdatasync d7/f2b 0 2023-12-12T11:52:07.473 INFO:tasks.workunit.client.0.smithi063.stdout:9/600: rmdir d7/d11/d12/d30 39 2023-12-12T11:52:07.480 INFO:tasks.workunit.client.0.smithi063.stdout:7/597: mkdir de/d22/d6e/de4 0 2023-12-12T11:52:07.483 INFO:tasks.workunit.client.1.smithi093.stdout:2/980: dread d5/d14/d2d/fcb [0,4194304] 0 2023-12-12T11:52:07.485 INFO:tasks.workunit.client.0.smithi063.stdout:3/652: dwrite d4/df/d1a/d1c/d3b/d52/d78/da5/f89 [0,4194304] 0 2023-12-12T11:52:07.489 INFO:tasks.workunit.client.1.smithi093.stdout:5/860: dwrite d0/d7/d36/d29/d44/f74 [0,4194304] 0 2023-12-12T11:52:07.489 INFO:tasks.workunit.client.1.smithi093.stdout:5/861: dread - d0/d7/d36/db9/d66/d7c/db5/fbd zero size 2023-12-12T11:52:07.489 INFO:tasks.workunit.client.1.smithi093.stdout:5/862: write d0/d7/d8/d9e/f31 [2033332,81343] 0 2023-12-12T11:52:07.489 INFO:tasks.workunit.client.1.smithi093.stdout:5/863: fsync d0/d7/d59/d48/f89 0 2023-12-12T11:52:07.489 INFO:tasks.workunit.client.1.smithi093.stdout:5/864: chown d0/d7/d36/f90 7538652 1 2023-12-12T11:52:07.490 INFO:tasks.workunit.client.1.smithi093.stdout:2/981: truncate d5/d14/d2d/d4c/d54/d67/d69/d6c/f93 3759947 0 2023-12-12T11:52:07.498 INFO:tasks.workunit.client.1.smithi093.stdout:5/865: mkdir d0/d7/d85/d127 0 2023-12-12T11:52:07.498 INFO:tasks.workunit.client.1.smithi093.stdout:5/866: stat d0/d7/d36/d87/ff4 0 2023-12-12T11:52:07.506 INFO:tasks.workunit.client.0.smithi063.stdout:7/598: creat de/d39/fe5 x:0 0 0 2023-12-12T11:52:07.507 INFO:tasks.workunit.client.1.smithi093.stdout:9/971: creat d1/d23/d24/d29/d43/d56/f145 x:0 0 0 2023-12-12T11:52:07.507 INFO:tasks.workunit.client.1.smithi093.stdout:9/972: truncate d1/d23/d6b/d92/db2/f109 108626 0 2023-12-12T11:52:07.507 INFO:tasks.workunit.client.1.smithi093.stdout:9/973: write d1/d23/d24/d29/d43/d56/d68/f87 [966497,33303] 0 2023-12-12T11:52:07.508 INFO:tasks.workunit.client.0.smithi063.stdout:7/599: mkdir de/d33/d41/d44/d8b/dde/de6 0 2023-12-12T11:52:07.508 INFO:tasks.workunit.client.0.smithi063.stdout:7/600: fdatasync de/d22/fc0 0 2023-12-12T11:52:07.511 INFO:tasks.workunit.client.0.smithi063.stdout:5/737: symlink d7/d10/d2b/d3c/ldf 0 2023-12-12T11:52:07.512 INFO:tasks.workunit.client.1.smithi093.stdout:9/974: mknod d1/d23/d24/d29/d43/d56/d85/dc3/dce/df5/c146 0 2023-12-12T11:52:07.513 INFO:tasks.workunit.client.1.smithi093.stdout:9/975: mknod d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d5c/c147 0 2023-12-12T11:52:07.513 INFO:tasks.workunit.client.1.smithi093.stdout:9/976: dread - d1/d23/d24/d89/fff zero size 2023-12-12T11:52:07.514 INFO:tasks.workunit.client.1.smithi093.stdout:9/977: symlink d1/d23/d24/d29/d43/d56/d85/dc3/dce/de1/l148 0 2023-12-12T11:52:07.516 INFO:tasks.workunit.client.1.smithi093.stdout:9/978: creat d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d57/f149 x:0 0 0 2023-12-12T11:52:07.519 INFO:tasks.workunit.client.1.smithi093.stdout:3/936: creat df/d22/d49/d69/d78/daf/d3d/f12f x:0 0 0 2023-12-12T11:52:07.521 INFO:tasks.workunit.client.0.smithi063.stdout:4/723: symlink d2/d48/led 0 2023-12-12T11:52:07.521 INFO:tasks.workunit.client.0.smithi063.stdout:4/724: truncate d2/d17/f59 4942498 0 2023-12-12T11:52:07.521 INFO:tasks.workunit.client.0.smithi063.stdout:4/725: truncate d2/d17/d7f/fe8 542146 0 2023-12-12T11:52:07.521 INFO:tasks.workunit.client.0.smithi063.stdout:4/726: dread - d2/d17/d4e/f91 zero size 2023-12-12T11:52:07.521 INFO:tasks.workunit.client.0.smithi063.stdout:4/727: write d2/d8/fc2 [32851,13156] 0 2023-12-12T11:52:07.522 INFO:tasks.workunit.client.1.smithi093.stdout:3/937: rename df/d22/d49/d69/d78/dad/df2/f118 to df/d22/d49/d69/d78/dad/df2/f130 0 2023-12-12T11:52:07.522 INFO:tasks.workunit.client.1.smithi093.stdout:3/938: chown df/d22/d49/d69/d78/daf/d3d/d42/l62 38 1 2023-12-12T11:52:07.524 INFO:tasks.workunit.client.1.smithi093.stdout:1/975: unlink d4/d1a/d1b/d26/d65/f7b 0 2023-12-12T11:52:07.525 INFO:tasks.workunit.client.0.smithi063.stdout:4/728: symlink d2/lee 0 2023-12-12T11:52:07.526 INFO:tasks.workunit.client.1.smithi093.stdout:3/939: truncate df/d25/dd2/ffb 333965 0 2023-12-12T11:52:07.529 INFO:tasks.workunit.client.0.smithi063.stdout:9/601: dwrite d7/d11/fa0 [0,4194304] 0 2023-12-12T11:52:07.530 INFO:tasks.workunit.client.0.smithi063.stdout:9/602: write d7/d20/d3f/d40/d4e/f67 [1043572,107172] 0 2023-12-12T11:52:07.530 INFO:tasks.workunit.client.0.smithi063.stdout:9/603: fsync d7/d20/d3f/d40/d76/f8c 0 2023-12-12T11:52:07.530 INFO:tasks.workunit.client.1.smithi093.stdout:1/976: getdents d4/d1a 0 2023-12-12T11:52:07.531 INFO:tasks.workunit.client.1.smithi093.stdout:1/977: chown d4/d1a/d83/d9a/da9/lda 0 1 2023-12-12T11:52:07.531 INFO:tasks.workunit.client.0.smithi063.stdout:4/729: creat d2/d48/d69/fef x:0 0 0 2023-12-12T11:52:07.531 INFO:tasks.workunit.client.0.smithi063.stdout:4/730: dread - d2/d17/d7f/fb5 zero size 2023-12-12T11:52:07.531 INFO:tasks.workunit.client.0.smithi063.stdout:4/731: truncate d2/d47/d6d/f97 1292580 0 2023-12-12T11:52:07.531 INFO:tasks.workunit.client.0.smithi063.stdout:4/732: chown d2/d48/d4f/lb6 161104318 1 2023-12-12T11:52:07.535 INFO:tasks.workunit.client.1.smithi093.stdout:1/978: creat d4/d1a/da6/f149 x:0 0 0 2023-12-12T11:52:07.535 INFO:tasks.workunit.client.1.smithi093.stdout:9/979: dread d1/d23/d24/d29/d43/f51 [0,4194304] 0 2023-12-12T11:52:07.537 INFO:tasks.workunit.client.1.smithi093.stdout:1/979: mknod d4/d1a/d1b/dbf/d110/c14a 0 2023-12-12T11:52:07.540 INFO:tasks.workunit.client.1.smithi093.stdout:1/980: mkdir d4/d14b 0 2023-12-12T11:52:07.549 INFO:tasks.workunit.client.1.smithi093.stdout:3/940: write df/d22/d49/d69/d78/fc0 [448989,83207] 0 2023-12-12T11:52:07.550 INFO:tasks.workunit.client.0.smithi063.stdout:2/621: rename d0/d69/l88 to d0/d1a/d48/d56/lc9 0 2023-12-12T11:52:07.550 INFO:tasks.workunit.client.0.smithi063.stdout:2/622: write d0/d1a/dba/fc8 [392054,50583] 0 2023-12-12T11:52:07.550 INFO:tasks.workunit.client.0.smithi063.stdout:2/623: chown d0/ld 734150950 1 2023-12-12T11:52:07.552 INFO:tasks.workunit.client.1.smithi093.stdout:2/982: dwrite d5/d14/d2d/d4c/d76/dc6/d118/d4e/fee [0,4194304] 0 2023-12-12T11:52:07.552 INFO:tasks.workunit.client.1.smithi093.stdout:2/983: fdatasync d5/d14/d2d/d12/d25/d7a/d7e/da5/f101 0 2023-12-12T11:52:07.557 INFO:tasks.workunit.client.0.smithi063.stdout:3/653: rename d4/df/d1a/d1c/d41/c55 to d4/df/d1a/d1c/d34/d54/cc6 0 2023-12-12T11:52:07.559 INFO:tasks.workunit.client.0.smithi063.stdout:9/604: rename d7/d11/d12/d30 to d7/d15/dc4 0 2023-12-12T11:52:07.560 INFO:tasks.workunit.client.0.smithi063.stdout:3/654: symlink d4/df/d1a/d1c/d3b/d52/db6/lc7 0 2023-12-12T11:52:07.561 INFO:tasks.workunit.client.1.smithi093.stdout:1/981: rename d4/d1a/d1b/f123 to d4/dc/d7a/d9c/da7/f14c 0 2023-12-12T11:52:07.563 INFO:tasks.workunit.client.1.smithi093.stdout:7/914: sync 2023-12-12T11:52:07.563 INFO:tasks.workunit.client.1.smithi093.stdout:7/915: dread - da/d8e/f12f zero size 2023-12-12T11:52:07.564 INFO:tasks.workunit.client.1.smithi093.stdout:7/916: chown da/d15/d19/d4c/f139 902 1 2023-12-12T11:52:07.566 INFO:tasks.workunit.client.1.smithi093.stdout:0/972: sync 2023-12-12T11:52:07.566 INFO:tasks.workunit.client.1.smithi093.stdout:8/998: sync 2023-12-12T11:52:07.567 INFO:tasks.workunit.client.0.smithi063.stdout:9/605: creat d7/fc5 x:0 0 0 2023-12-12T11:52:07.567 INFO:tasks.workunit.client.0.smithi063.stdout:9/606: write d7/ff [4790152,68072] 0 2023-12-12T11:52:07.567 INFO:tasks.workunit.client.0.smithi063.stdout:9/607: fsync d7/f54 0 2023-12-12T11:52:07.567 INFO:tasks.workunit.client.0.smithi063.stdout:6/739: sync 2023-12-12T11:52:07.567 INFO:tasks.workunit.client.0.smithi063.stdout:1/754: sync 2023-12-12T11:52:07.567 INFO:tasks.workunit.client.0.smithi063.stdout:0/729: sync 2023-12-12T11:52:07.568 INFO:tasks.workunit.client.1.smithi093.stdout:5/867: dwrite d0/d7/d85/fea [0,4194304] 0 2023-12-12T11:52:07.568 INFO:tasks.workunit.client.1.smithi093.stdout:5/868: stat d0/d7/d85/d127 0 2023-12-12T11:52:07.568 INFO:tasks.workunit.client.1.smithi093.stdout:1/982: mknod d4/d81/c14d 0 2023-12-12T11:52:07.568 INFO:tasks.workunit.client.1.smithi093.stdout:1/983: chown d4/d1c/d2a/f2c 14 1 2023-12-12T11:52:07.568 INFO:tasks.workunit.client.1.smithi093.stdout:1/984: fdatasync d4/d1c/f21 0 2023-12-12T11:52:07.569 INFO:tasks.workunit.client.1.smithi093.stdout:5/869: write d0/d7/d36/d68/fe0 [96042,47027] 0 2023-12-12T11:52:07.569 INFO:tasks.workunit.client.1.smithi093.stdout:1/985: write d4/d1a/d1b/dbf/fd3 [690042,68079] 0 2023-12-12T11:52:07.569 INFO:tasks.workunit.client.1.smithi093.stdout:1/986: readlink d4/d1a/l4f 0 2023-12-12T11:52:07.570 INFO:tasks.workunit.client.1.smithi093.stdout:7/917: mknod da/d8e/daa/dd6/c141 0 2023-12-12T11:52:07.575 INFO:tasks.workunit.client.1.smithi093.stdout:8/999: mknod d3/d1a/d1f/d29/d3a/d40/c142 0 2023-12-12T11:52:07.578 INFO:tasks.workunit.client.0.smithi063.stdout:3/655: symlink d4/df/d1a/d1c/d3b/d52/d78/da5/d98/lc8 0 2023-12-12T11:52:07.582 INFO:tasks.workunit.client.0.smithi063.stdout:9/608: creat d7/d15/db2/fc6 x:0 0 0 2023-12-12T11:52:07.583 INFO:tasks.workunit.client.0.smithi063.stdout:9/609: write d7/d20/d3f/d40/d4e/f8d [284341,74785] 0 2023-12-12T11:52:07.583 INFO:tasks.workunit.client.0.smithi063.stdout:9/610: truncate d7/d11/f4c 1147967 0 2023-12-12T11:52:07.583 INFO:tasks.workunit.client.1.smithi093.stdout:1/987: rename d4/d1a/d73/f97 to d4/d1a/d83/d112/f14e 0 2023-12-12T11:52:07.583 INFO:tasks.workunit.client.1.smithi093.stdout:1/988: getdents d4/d14b 0 2023-12-12T11:52:07.586 INFO:tasks.workunit.client.1.smithi093.stdout:7/918: mkdir da/d8e/da9/d142 0 2023-12-12T11:52:07.589 INFO:tasks.workunit.client.1.smithi093.stdout:7/919: creat da/d15/d59/d80/f143 x:0 0 0 2023-12-12T11:52:07.589 INFO:tasks.workunit.client.1.smithi093.stdout:7/920: truncate da/de/d78/ffd 3494 0 2023-12-12T11:52:07.590 INFO:tasks.workunit.client.0.smithi063.stdout:7/601: dwrite de/d3f/dc3/fd8 [0,4194304] 0 2023-12-12T11:52:07.590 INFO:tasks.workunit.client.0.smithi063.stdout:7/602: fdatasync de/fab 0 2023-12-12T11:52:07.590 INFO:tasks.workunit.client.0.smithi063.stdout:6/740: creat d9/d10/d2a/de7/d86/dc2/ded/f101 x:0 0 0 2023-12-12T11:52:07.592 INFO:tasks.workunit.client.1.smithi093.stdout:1/989: symlink d4/d85/l14f 0 2023-12-12T11:52:07.592 INFO:tasks.workunit.client.0.smithi063.stdout:1/755: mkdir d3/d3a/dd7/d16/d24/d4d/df9 0 2023-12-12T11:52:07.595 INFO:tasks.workunit.client.1.smithi093.stdout:9/980: dwrite d1/d23/d6b/d92/fd2 [0,4194304] 0 2023-12-12T11:52:07.595 INFO:tasks.workunit.client.1.smithi093.stdout:9/981: stat d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d57/f66 0 2023-12-12T11:52:07.596 INFO:tasks.workunit.client.0.smithi063.stdout:2/624: dread d0/f49 [0,4194304] 0 2023-12-12T11:52:07.601 INFO:tasks.workunit.client.0.smithi063.stdout:9/611: dread d7/d15/f2e [0,4194304] 0 2023-12-12T11:52:07.605 INFO:tasks.workunit.client.0.smithi063.stdout:4/733: rename d2/d8 to d2/d47/d6d/d88/df0 0 2023-12-12T11:52:07.608 INFO:tasks.workunit.client.0.smithi063.stdout:3/656: symlink d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/lc9 0 2023-12-12T11:52:07.610 INFO:tasks.workunit.client.0.smithi063.stdout:5/738: dwrite d7/f1a [0,4194304] 0 2023-12-12T11:52:07.610 INFO:tasks.workunit.client.0.smithi063.stdout:5/739: truncate d7/d10/d2b/d3c/d42/d62/fa1 4237787 0 2023-12-12T11:52:07.617 INFO:tasks.workunit.client.1.smithi093.stdout:0/973: dwrite d5/d41/d77/d79/d9b/f9d [0,4194304] 0 2023-12-12T11:52:07.621 INFO:tasks.workunit.client.0.smithi063.stdout:7/603: creat de/d39/d60/d80/fe7 x:0 0 0 2023-12-12T11:52:07.626 INFO:tasks.workunit.client.0.smithi063.stdout:4/734: dread d2/d17/d61/f71 [0,4194304] 0 2023-12-12T11:52:07.626 INFO:tasks.workunit.client.0.smithi063.stdout:6/741: truncate d9/d10/d2a/de7/d86/fbe 1515244 0 2023-12-12T11:52:07.628 INFO:tasks.workunit.client.1.smithi093.stdout:5/870: dread d0/d7/d59/d48/f4c [0,4194304] 0 2023-12-12T11:52:07.631 INFO:tasks.workunit.client.1.smithi093.stdout:9/982: write d1/d23/d6b/d92/ddd/f126 [4169603,937] 0 2023-12-12T11:52:07.632 INFO:tasks.workunit.client.1.smithi093.stdout:9/983: chown d1/d23/d24/d29/d43/d56/fba 14 1 2023-12-12T11:52:07.632 INFO:tasks.workunit.client.0.smithi063.stdout:1/756: symlink d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2/d7e/lfa 0 2023-12-12T11:52:07.636 INFO:tasks.workunit.client.0.smithi063.stdout:2/625: mknod d0/d1a/d26/cca 0 2023-12-12T11:52:07.636 INFO:tasks.workunit.client.0.smithi063.stdout:2/626: fdatasync d0/d41/f66 0 2023-12-12T11:52:07.639 INFO:tasks.workunit.client.0.smithi063.stdout:9/612: mknod d7/d20/d45/cc7 0 2023-12-12T11:52:07.642 INFO:tasks.workunit.client.0.smithi063.stdout:3/657: truncate d4/f25 2511811 0 2023-12-12T11:52:07.642 INFO:tasks.workunit.client.0.smithi063.stdout:3/658: fdatasync d4/d23/d6b/f95 0 2023-12-12T11:52:07.645 INFO:tasks.workunit.client.0.smithi063.stdout:5/740: mkdir d7/d10/d2b/d3c/d42/d62/d69/dcb/de0 0 2023-12-12T11:52:07.646 INFO:tasks.workunit.client.0.smithi063.stdout:8/794: dwrite d4/de/d1e/f3c [0,4194304] 0 2023-12-12T11:52:07.649 INFO:tasks.workunit.client.1.smithi093.stdout:9/984: dread d1/d23/d24/d29/d43/fcf [0,4194304] 0 2023-12-12T11:52:07.649 INFO:tasks.workunit.client.0.smithi063.stdout:0/730: dwrite d0/d7/d27/d1f/dc4/d67/fe8 [0,4194304] 0 2023-12-12T11:52:07.650 INFO:tasks.workunit.client.1.smithi093.stdout:3/941: dwrite df/d22/d49/d69/d78/daf/d102/f120 [0,4194304] 0 2023-12-12T11:52:07.650 INFO:tasks.workunit.client.1.smithi093.stdout:3/942: creat df/d22/d49/d69/d78/dad/df2/f131 x:0 0 0 2023-12-12T11:52:07.658 INFO:tasks.workunit.client.0.smithi063.stdout:7/604: rename de/d33/d41/d44/d8b/dde/daf/fda to de/d33/d41/d44/d8b/dde/dc7/fe8 0 2023-12-12T11:52:07.659 INFO:tasks.workunit.client.1.smithi093.stdout:1/990: dwrite d4/d1a/d1b/d26/ff0 [4194304,4194304] 0 2023-12-12T11:52:07.660 INFO:tasks.workunit.client.1.smithi093.stdout:3/943: dread df/d30/d33/f117 [0,4194304] 0 2023-12-12T11:52:07.660 INFO:tasks.workunit.client.1.smithi093.stdout:7/921: dwrite da/d15/d19/d4c/f7a [0,4194304] 0 2023-12-12T11:52:07.668 INFO:tasks.workunit.client.1.smithi093.stdout:0/974: symlink d5/dd/d14/l129 0 2023-12-12T11:52:07.668 INFO:tasks.workunit.client.1.smithi093.stdout:0/975: truncate d5/dd/d14/d26/d58/d64/d6f/de8/f128 569124 0 2023-12-12T11:52:07.668 INFO:tasks.workunit.client.1.smithi093.stdout:0/976: readlink d5/dd/d14/l29 0 2023-12-12T11:52:07.671 INFO:tasks.workunit.client.1.smithi093.stdout:5/871: creat d0/d7/d36/d68/def/d123/f128 x:0 0 0 2023-12-12T11:52:07.673 INFO:tasks.workunit.client.0.smithi063.stdout:6/742: creat d9/f102 x:0 0 0 2023-12-12T11:52:07.673 INFO:tasks.workunit.client.0.smithi063.stdout:6/743: fdatasync d9/d10/d2a/f3e 0 2023-12-12T11:52:07.677 INFO:tasks.workunit.client.0.smithi063.stdout:9/613: creat d7/d15/dc4/d3e/dbb/fc8 x:0 0 0 2023-12-12T11:52:07.677 INFO:tasks.workunit.client.0.smithi063.stdout:1/757: dwrite d3/d3a/dd7/d16/d17/d4b/fe4 [0,4194304] 0 2023-12-12T11:52:07.678 INFO:tasks.workunit.client.1.smithi093.stdout:7/922: read da/de/f3b [1662913,87595] 0 2023-12-12T11:52:07.681 INFO:tasks.workunit.client.0.smithi063.stdout:7/605: dread de/d34/d43/d45/f7d [0,4194304] 0 2023-12-12T11:52:07.684 INFO:tasks.workunit.client.0.smithi063.stdout:8/795: mkdir d4/d24/db3/dfa 0 2023-12-12T11:52:07.688 INFO:tasks.workunit.client.0.smithi063.stdout:3/659: dread d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/f66 [0,4194304] 0 2023-12-12T11:52:07.691 INFO:tasks.workunit.client.0.smithi063.stdout:2/627: dwrite d0/d1a/dba/fc3 [0,4194304] 0 2023-12-12T11:52:07.691 INFO:tasks.workunit.client.0.smithi063.stdout:0/731: symlink d0/d8e/lf0 0 2023-12-12T11:52:07.692 INFO:tasks.workunit.client.0.smithi063.stdout:3/660: write d4/df/d1a/d1c/f92 [444674,86386] 0 2023-12-12T11:52:07.694 INFO:tasks.workunit.client.1.smithi093.stdout:1/991: rename d4/d1a/d83/d9a/de7/cf5 to d4/d1a/d83/c150 0 2023-12-12T11:52:07.696 INFO:tasks.workunit.client.0.smithi063.stdout:6/744: mknod d9/d10/d2a/de7/d86/dc2/ded/c103 0 2023-12-12T11:52:07.698 INFO:tasks.workunit.client.1.smithi093.stdout:3/944: creat df/d22/de6/f132 x:0 0 0 2023-12-12T11:52:07.698 INFO:tasks.workunit.client.1.smithi093.stdout:3/945: stat df/d25/dd2/ffb 0 2023-12-12T11:52:07.700 INFO:tasks.workunit.client.0.smithi063.stdout:8/796: dread d4/de/d3b/d62/fa6 [0,4194304] 0 2023-12-12T11:52:07.702 INFO:tasks.workunit.client.1.smithi093.stdout:5/872: dread d0/d7/d36/d68/fe0 [0,4194304] 0 2023-12-12T11:52:07.703 INFO:tasks.workunit.client.0.smithi063.stdout:9/614: mknod d7/d15/dc4/cc9 0 2023-12-12T11:52:07.705 INFO:tasks.workunit.client.0.smithi063.stdout:1/758: creat d3/d3a/ffb x:0 0 0 2023-12-12T11:52:07.706 INFO:tasks.workunit.client.0.smithi063.stdout:1/759: creat d3/d3a/dd7/d16/ffc x:0 0 0 2023-12-12T11:52:07.713 INFO:tasks.workunit.client.1.smithi093.stdout:0/977: mknod d5/dd/d14/d26/d58/d64/d6f/d90/ddf/d122/c12a 0 2023-12-12T11:52:07.716 INFO:tasks.workunit.client.0.smithi063.stdout:2/628: read d0/d1a/dba/fc3 [2138899,8201] 0 2023-12-12T11:52:07.718 INFO:tasks.workunit.client.0.smithi063.stdout:7/606: mknod de/d33/d41/d44/d8b/dde/de6/ce9 0 2023-12-12T11:52:07.718 INFO:tasks.workunit.client.0.smithi063.stdout:7/607: read de/d39/d4b/d7b/fbe [232040,39583] 0 2023-12-12T11:52:07.719 INFO:tasks.workunit.client.1.smithi093.stdout:3/946: dread df/d30/d33/ff5 [0,4194304] 0 2023-12-12T11:52:07.722 INFO:tasks.workunit.client.1.smithi093.stdout:0/978: rename d5/dd/d33/f109 to d5/d41/d77/d79/df2/d111/f12b 0 2023-12-12T11:52:07.723 INFO:tasks.workunit.client.1.smithi093.stdout:0/979: fsync d5/dd/d62/f69 0 2023-12-12T11:52:07.727 INFO:tasks.workunit.client.1.smithi093.stdout:3/947: rename df/d22/d49/d69/d78/daf/l97 to df/d22/d49/d69/d78/daf/d3d/d59/d9c/l133 0 2023-12-12T11:52:07.730 INFO:tasks.workunit.client.1.smithi093.stdout:5/873: write d0/dd2/fda [7750836,80864] 0 2023-12-12T11:52:07.730 INFO:tasks.workunit.client.1.smithi093.stdout:5/874: chown d0/d7/d36/d68/la4 783 1 2023-12-12T11:52:07.730 INFO:tasks.workunit.client.0.smithi063.stdout:3/661: rmdir d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/da1 39 2023-12-12T11:52:07.731 INFO:tasks.workunit.client.1.smithi093.stdout:3/948: mkdir df/d92/dd4/d134 0 2023-12-12T11:52:07.731 INFO:tasks.workunit.client.1.smithi093.stdout:3/949: read df/f21 [17719,126874] 0 2023-12-12T11:52:07.732 INFO:tasks.workunit.client.0.smithi063.stdout:6/745: mknod d9/d2c/d61/c104 0 2023-12-12T11:52:07.732 INFO:tasks.workunit.client.0.smithi063.stdout:6/746: truncate d9/d10/d2a/fc7 311367 0 2023-12-12T11:52:07.735 INFO:tasks.workunit.client.1.smithi093.stdout:3/950: link df/d22/d49/d69/d78/daf/d102/f120 df/d30/f135 0 2023-12-12T11:52:07.735 INFO:tasks.workunit.client.1.smithi093.stdout:3/951: write df/d22/d49/d69/d78/daf/d3d/d42/d8e/de1/fe5 [218014,2478] 0 2023-12-12T11:52:07.739 INFO:tasks.workunit.client.0.smithi063.stdout:8/797: stat d4/d24/d38/lce 0 2023-12-12T11:52:07.739 INFO:tasks.workunit.client.0.smithi063.stdout:1/760: creat d3/d3a/dd7/d16/d17/ffd x:0 0 0 2023-12-12T11:52:07.739 INFO:tasks.workunit.client.0.smithi063.stdout:1/761: chown d3/d3a/dd7/d16/d24/d48/fe7 861 1 2023-12-12T11:52:07.740 INFO:tasks.workunit.client.1.smithi093.stdout:3/952: rename df/d25/f44 to df/d22/d49/d69/d78/daf/d3d/d59/d72/f136 0 2023-12-12T11:52:07.741 INFO:tasks.workunit.client.0.smithi063.stdout:7/608: truncate de/f19 3225172 0 2023-12-12T11:52:07.743 INFO:tasks.workunit.client.0.smithi063.stdout:3/662: getdents d4 0 2023-12-12T11:52:07.743 INFO:tasks.workunit.client.0.smithi063.stdout:3/663: chown d4/df/d1a/d1c/d57 143 1 2023-12-12T11:52:07.744 INFO:tasks.workunit.client.1.smithi093.stdout:3/953: mknod df/d22/d49/d69/dfa/d112/c137 0 2023-12-12T11:52:07.745 INFO:tasks.workunit.client.0.smithi063.stdout:6/747: symlink d9/d10/d7a/l105 0 2023-12-12T11:52:07.747 INFO:tasks.workunit.client.0.smithi063.stdout:8/798: rename d4/de/d1e/d6d/fb1 to d4/de/d3b/d62/d91/ffb 0 2023-12-12T11:52:07.747 INFO:tasks.workunit.client.0.smithi063.stdout:8/799: chown d4/d55/f34 110345715 1 2023-12-12T11:52:07.751 INFO:tasks.workunit.client.1.smithi093.stdout:3/954: truncate df/d22/d49/d69/fa7 3022791 0 2023-12-12T11:52:07.751 INFO:tasks.workunit.client.0.smithi063.stdout:3/664: creat d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d56/d79/fca x:0 0 0 2023-12-12T11:52:07.760 INFO:tasks.workunit.client.1.smithi093.stdout:1/992: dread d4/d1a/d1b/d26/d65/d6f/f89 [0,4194304] 0 2023-12-12T11:52:07.760 INFO:tasks.workunit.client.0.smithi063.stdout:1/762: rename d3/d3a/dd7/d16/f2d to d3/d3a/dd7/d16/d24/d48/d75/d83/ffe 0 2023-12-12T11:52:07.760 INFO:tasks.workunit.client.0.smithi063.stdout:3/665: symlink d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d56/d79/lcb 0 2023-12-12T11:52:07.760 INFO:tasks.workunit.client.0.smithi063.stdout:1/763: write d3/d3a/dd7/d12/f50 [110117,51464] 0 2023-12-12T11:52:07.761 INFO:tasks.workunit.client.1.smithi093.stdout:0/980: write d5/dd/d62/f83 [5502615,66413] 0 2023-12-12T11:52:07.761 INFO:tasks.workunit.client.1.smithi093.stdout:3/955: mknod df/d22/d49/d69/d78/daf/d3d/d42/d8e/de1/c138 0 2023-12-12T11:52:07.761 INFO:tasks.workunit.client.1.smithi093.stdout:3/956: chown df/d22/d49/d69/d78/daf/d3d/d6f/db1/cc3 3889 1 2023-12-12T11:52:07.767 INFO:tasks.workunit.client.1.smithi093.stdout:9/985: dwrite d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d57/d63/fc8 [0,4194304] 0 2023-12-12T11:52:07.771 INFO:tasks.workunit.client.1.smithi093.stdout:1/993: rmdir d4/d81 39 2023-12-12T11:52:07.771 INFO:tasks.workunit.client.1.smithi093.stdout:0/981: creat d5/d21/d27/d3a/d9a/db5/f12c x:0 0 0 2023-12-12T11:52:07.772 INFO:tasks.workunit.client.1.smithi093.stdout:5/875: dread d0/d7/d36/f4a [0,4194304] 0 2023-12-12T11:52:07.772 INFO:tasks.workunit.client.1.smithi093.stdout:7/923: dwrite da/de/d46/fbe [4194304,4194304] 0 2023-12-12T11:52:07.772 INFO:tasks.workunit.client.1.smithi093.stdout:2/984: sync 2023-12-12T11:52:07.774 INFO:tasks.workunit.client.0.smithi063.stdout:7/609: rename de/d22/f31 to de/d34/d68/d89/fea 0 2023-12-12T11:52:07.774 INFO:tasks.workunit.client.0.smithi063.stdout:7/610: chown de/ce1 13599 1 2023-12-12T11:52:07.774 INFO:tasks.workunit.client.0.smithi063.stdout:7/611: chown de/d34/d68/da1 0 1 2023-12-12T11:52:07.774 INFO:tasks.workunit.client.0.smithi063.stdout:0/732: dread d0/d7/d27/f81 [0,4194304] 0 2023-12-12T11:52:07.774 INFO:tasks.workunit.client.0.smithi063.stdout:0/733: chown d0/d7/d27/d1f/f2c 477247436 1 2023-12-12T11:52:07.775 INFO:tasks.workunit.client.1.smithi093.stdout:7/924: read da/de/f72 [1784678,84829] 0 2023-12-12T11:52:07.775 INFO:tasks.workunit.client.1.smithi093.stdout:7/925: fsync da/d15/d19/d4c/d6d/f13f 0 2023-12-12T11:52:07.775 INFO:tasks.workunit.client.1.smithi093.stdout:7/926: truncate da/d15/d2d/d2f/dc6/f108 609666 0 2023-12-12T11:52:07.775 INFO:tasks.workunit.client.1.smithi093.stdout:7/927: dread - da/d15/d59/d80/f143 zero size 2023-12-12T11:52:07.776 INFO:tasks.workunit.client.0.smithi063.stdout:1/764: creat d3/d3a/dd7/d16/d4f/d9a/fff x:0 0 0 2023-12-12T11:52:07.776 INFO:tasks.workunit.client.1.smithi093.stdout:3/957: getdents df/d22/d49/d69/d78/dad/df2 0 2023-12-12T11:52:07.781 INFO:tasks.workunit.client.1.smithi093.stdout:0/982: creat d5/dd/d62/d10c/f12d x:0 0 0 2023-12-12T11:52:07.781 INFO:tasks.workunit.client.1.smithi093.stdout:9/986: write d1/fa [3556645,84832] 0 2023-12-12T11:52:07.781 INFO:tasks.workunit.client.1.smithi093.stdout:9/987: truncate d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/d42/f136 137021 0 2023-12-12T11:52:07.782 INFO:tasks.workunit.client.1.smithi093.stdout:9/988: write d1/d23/d6b/d92/ddd/f126 [3760375,109245] 0 2023-12-12T11:52:07.782 INFO:tasks.workunit.client.1.smithi093.stdout:5/876: creat d0/d7/d36/db9/d66/d7c/db5/d10e/f129 x:0 0 0 2023-12-12T11:52:07.785 INFO:tasks.workunit.client.1.smithi093.stdout:1/994: dread d4/d1a/d83/d9a/faf [0,4194304] 0 2023-12-12T11:52:07.788 INFO:tasks.workunit.client.1.smithi093.stdout:7/928: rename da/d15/d19/d4c/l82 to da/d15/d59/de0/l144 0 2023-12-12T11:52:07.788 INFO:tasks.workunit.client.0.smithi063.stdout:4/735: dwrite d2/f40 [0,4194304] 0 2023-12-12T11:52:07.791 INFO:tasks.workunit.client.1.smithi093.stdout:3/958: creat df/f139 x:0 0 0 2023-12-12T11:52:07.792 INFO:tasks.workunit.client.0.smithi063.stdout:5/741: dwrite d7/d10/d2b/d3c/d5a/f72 [0,4194304] 0 2023-12-12T11:52:07.792 INFO:tasks.workunit.client.0.smithi063.stdout:5/742: dread - d7/d10/d2b/d3c/d27/fb9 zero size 2023-12-12T11:52:07.794 INFO:tasks.workunit.client.0.smithi063.stdout:8/800: dread d4/de/d3b/d62/d6e/d76/f7a [0,4194304] 0 2023-12-12T11:52:07.794 INFO:tasks.workunit.client.0.smithi063.stdout:2/629: dwrite d0/d41/f66 [0,4194304] 0 2023-12-12T11:52:07.794 INFO:tasks.workunit.client.0.smithi063.stdout:2/630: chown d0/f5f 303310 1 2023-12-12T11:52:07.794 INFO:tasks.workunit.client.0.smithi063.stdout:8/801: truncate d4/d24/d38/d45/d5b/d92/d65/fe9 340087 0 2023-12-12T11:52:07.794 INFO:tasks.workunit.client.1.smithi093.stdout:0/983: truncate d5/dd/d14/d26/d58/d64/ffd 3090434 0 2023-12-12T11:52:07.794 INFO:tasks.workunit.client.1.smithi093.stdout:0/984: write d5/dd/d14/d26/d58/dab/fb6 [4570044,88039] 0 2023-12-12T11:52:07.801 INFO:tasks.workunit.client.0.smithi063.stdout:0/734: mkdir d0/d1a/d23/d2e/dd4/ddc/df1 0 2023-12-12T11:52:07.801 INFO:tasks.workunit.client.0.smithi063.stdout:7/612: mknod de/d22/d6e/de4/ceb 0 2023-12-12T11:52:07.801 INFO:tasks.workunit.client.0.smithi063.stdout:1/765: rmdir d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8 39 2023-12-12T11:52:07.801 INFO:tasks.workunit.client.0.smithi063.stdout:1/766: write d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2/f7a [9238706,50433] 0 2023-12-12T11:52:07.805 INFO:tasks.workunit.client.1.smithi093.stdout:9/989: getdents d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d3d/d57/d63 0 2023-12-12T11:52:07.805 INFO:tasks.workunit.client.1.smithi093.stdout:2/985: truncate d5/d14/d2d/d4c/d76/dc6/d118/f5b 1081149 0 2023-12-12T11:52:07.805 INFO:tasks.workunit.client.1.smithi093.stdout:5/877: write d0/d7/d59/d62/fa5 [2147490,44085] 0 2023-12-12T11:52:07.805 INFO:tasks.workunit.client.1.smithi093.stdout:5/878: fdatasync d0/d7/d36/f90 0 2023-12-12T11:52:07.809 INFO:tasks.workunit.client.0.smithi063.stdout:4/736: mknod d2/d17/d41/dd7/cf1 0 2023-12-12T11:52:07.814 INFO:tasks.workunit.client.0.smithi063.stdout:5/743: rename d7/d28/f3f to d7/d28/d43/fe1 0 2023-12-12T11:52:07.816 INFO:tasks.workunit.client.0.smithi063.stdout:2/631: unlink d0/d1a/d3a/fa8 0 2023-12-12T11:52:07.816 INFO:tasks.workunit.client.0.smithi063.stdout:2/632: creat d0/d1a/d3a/d59/fcb x:0 0 0 2023-12-12T11:52:07.817 INFO:tasks.workunit.client.0.smithi063.stdout:8/802: creat d4/de/d1e/d6d/ffc x:0 0 0 2023-12-12T11:52:07.817 INFO:tasks.workunit.client.0.smithi063.stdout:8/803: fdatasync d4/de/d3b/fa4 0 2023-12-12T11:52:07.820 INFO:tasks.workunit.client.1.smithi093.stdout:9/990: creat d1/d23/d6b/f14a x:0 0 0 2023-12-12T11:52:07.820 INFO:tasks.workunit.client.1.smithi093.stdout:9/991: chown d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/d32/f6d 281338 1 2023-12-12T11:52:07.824 INFO:tasks.workunit.client.1.smithi093.stdout:5/879: unlink d0/d7/d8/f10d 0 2023-12-12T11:52:07.826 INFO:tasks.workunit.client.0.smithi063.stdout:1/767: write d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2/f7a [5047836,31405] 0 2023-12-12T11:52:07.826 INFO:tasks.workunit.client.0.smithi063.stdout:1/768: chown d3/d3a/dd7/d16/d17/l39 65414487 1 2023-12-12T11:52:07.829 INFO:tasks.workunit.client.0.smithi063.stdout:0/735: creat d0/ddb/ff2 x:0 0 0 2023-12-12T11:52:07.831 INFO:tasks.workunit.client.1.smithi093.stdout:7/929: rmdir da/d15/d19/d4c/d6d 39 2023-12-12T11:52:07.832 INFO:tasks.workunit.client.0.smithi063.stdout:6/748: dwrite d9/d10/d5c/d5e/fd8 [0,4194304] 0 2023-12-12T11:52:07.832 INFO:tasks.workunit.client.0.smithi063.stdout:6/749: write d9/d10/d2a/dc3/fc5 [162697,3773] 0 2023-12-12T11:52:07.834 INFO:tasks.workunit.client.0.smithi063.stdout:4/737: mkdir d2/d17/d41/df2 0 2023-12-12T11:52:07.837 INFO:tasks.workunit.client.1.smithi093.stdout:9/992: creat d1/d23/d24/dfd/f14b x:0 0 0 2023-12-12T11:52:07.837 INFO:tasks.workunit.client.1.smithi093.stdout:9/993: fsync d1/d23/d6b/d92/fd2 0 2023-12-12T11:52:07.840 INFO:tasks.workunit.client.1.smithi093.stdout:5/880: truncate d0/fd7 405959 0 2023-12-12T11:52:07.840 INFO:tasks.workunit.client.1.smithi093.stdout:5/881: chown d0/f15 617192 1 2023-12-12T11:52:07.845 INFO:tasks.workunit.client.1.smithi093.stdout:7/930: creat da/d15/d59/f145 x:0 0 0 2023-12-12T11:52:07.846 INFO:tasks.workunit.client.0.smithi063.stdout:5/744: creat d7/d10/d2b/d3c/d42/d62/d69/dcb/de0/fe2 x:0 0 0 2023-12-12T11:52:07.848 INFO:tasks.workunit.client.1.smithi093.stdout:9/994: creat d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/f14c x:0 0 0 2023-12-12T11:52:07.848 INFO:tasks.workunit.client.1.smithi093.stdout:9/995: fsync d1/d23/d6b/f8c 0 2023-12-12T11:52:07.848 INFO:tasks.workunit.client.0.smithi063.stdout:5/745: creat d7/d10/d2b/d3c/d42/d62/d69/fe3 x:0 0 0 2023-12-12T11:52:07.848 INFO:tasks.workunit.client.0.smithi063.stdout:5/746: fdatasync d7/d10/d2b/d3c/d42/d62/d69/fbf 0 2023-12-12T11:52:07.849 INFO:tasks.workunit.client.0.smithi063.stdout:7/613: read fb [336274,35189] 0 2023-12-12T11:52:07.850 INFO:tasks.workunit.client.0.smithi063.stdout:2/633: mkdir d0/d41/dcc 0 2023-12-12T11:52:07.853 INFO:tasks.workunit.client.0.smithi063.stdout:0/736: mknod d0/cf3 0 2023-12-12T11:52:07.854 INFO:tasks.workunit.client.1.smithi093.stdout:9/996: unlink d1/d23/d6b/d92/f118 0 2023-12-12T11:52:07.854 INFO:tasks.workunit.client.1.smithi093.stdout:9/997: fsync d1/d23/d24/d29/d43/d56/d85/fc2 0 2023-12-12T11:52:07.857 INFO:tasks.workunit.client.0.smithi063.stdout:6/750: rename d9/d2c/d61/le2 to d9/d10/d2a/de7/l106 0 2023-12-12T11:52:07.857 INFO:tasks.workunit.client.0.smithi063.stdout:6/751: chown d9/d10/d25/fb1 1337337 1 2023-12-12T11:52:07.857 INFO:tasks.workunit.client.0.smithi063.stdout:6/752: chown d9/d2c/d61/fdc 29 1 2023-12-12T11:52:07.858 INFO:tasks.workunit.client.0.smithi063.stdout:6/753: creat d9/d68/d94/f107 x:0 0 0 2023-12-12T11:52:07.859 INFO:tasks.workunit.client.1.smithi093.stdout:5/882: read d0/d7/d59/d48/f6c [107039,58340] 0 2023-12-12T11:52:07.859 INFO:tasks.workunit.client.1.smithi093.stdout:5/883: truncate d0/d7/d36/db9/d66/d7c/db5/fbd 892189 0 2023-12-12T11:52:07.864 INFO:tasks.workunit.client.1.smithi093.stdout:7/931: getdents da/de/d46/d4f 0 2023-12-12T11:52:07.864 INFO:tasks.workunit.client.1.smithi093.stdout:7/932: chown da/d8e/daa/db3/ldb 186 1 2023-12-12T11:52:07.864 INFO:tasks.workunit.client.0.smithi063.stdout:4/738: mkdir d2/d47/d6d/d88/de6/df3 0 2023-12-12T11:52:07.866 INFO:tasks.workunit.client.0.smithi063.stdout:1/769: write d3/d3a/dd7/d16/d24/d4d/d35/d98/fef [3832618,56214] 0 2023-12-12T11:52:07.866 INFO:tasks.workunit.client.1.smithi093.stdout:5/884: truncate d0/d7/d36/d29/d44/f94 81142 0 2023-12-12T11:52:07.870 INFO:tasks.workunit.client.0.smithi063.stdout:5/747: unlink d7/de/f59 0 2023-12-12T11:52:07.870 INFO:tasks.workunit.client.0.smithi063.stdout:5/748: stat d7/d10/d2b/d3c/d63 0 2023-12-12T11:52:07.870 INFO:tasks.workunit.client.0.smithi063.stdout:5/749: dread - d7/d28/d94/f9f zero size 2023-12-12T11:52:07.876 INFO:tasks.workunit.client.1.smithi093.stdout:5/885: rename d0/d7/d8/f5d to d0/d7/d36/d29/f12a 0 2023-12-12T11:52:07.876 INFO:tasks.workunit.client.1.smithi093.stdout:5/886: creat d0/d7/d36/d68/def/d123/f12b x:0 0 0 2023-12-12T11:52:07.876 INFO:tasks.workunit.client.1.smithi093.stdout:5/887: dread - d0/d7/d36/db9/d66/d7c/db5/ff9 zero size 2023-12-12T11:52:07.877 INFO:tasks.workunit.client.1.smithi093.stdout:9/998: dread d1/d23/d24/d29/d43/d56/d85/dc3/dce/d1f/f27 [0,4194304] 0 2023-12-12T11:52:07.878 INFO:tasks.workunit.client.0.smithi063.stdout:2/634: truncate d0/d1a/d3a/d85/da6/fb6 388514 0 2023-12-12T11:52:07.880 INFO:tasks.workunit.client.0.smithi063.stdout:4/739: creat d2/d17/d61/dc5/ff4 x:0 0 0 2023-12-12T11:52:07.882 INFO:tasks.workunit.client.1.smithi093.stdout:0/985: dwrite d5/dd/d14/d26/d58/d64/d6f/d90/fe0 [4194304,4194304] 0 2023-12-12T11:52:07.883 INFO:tasks.workunit.client.1.smithi093.stdout:5/888: truncate d0/d7/d59/d48/f50 3013719 0 2023-12-12T11:52:07.883 INFO:tasks.workunit.client.1.smithi093.stdout:5/889: readlink d0/d7/d36/d29/d76/l11e 0 2023-12-12T11:52:07.883 INFO:tasks.workunit.client.0.smithi063.stdout:0/737: dread d0/d7/d27/d1f/f2c [0,4194304] 0 2023-12-12T11:52:07.883 INFO:tasks.workunit.client.0.smithi063.stdout:0/738: write d0/d7/d27/d1f/dc4/fb4 [910388,52842] 0 2023-12-12T11:52:07.885 INFO:tasks.workunit.client.0.smithi063.stdout:5/750: creat d7/d10/d2b/d3c/d42/d62/db4/fe4 x:0 0 0 2023-12-12T11:52:07.885 INFO:tasks.workunit.client.0.smithi063.stdout:5/751: chown d7/d28/d6e/f39 740226544 1 2023-12-12T11:52:07.886 INFO:tasks.workunit.client.1.smithi093.stdout:9/999: mkdir d1/d23/d24/d29/da3/d14d 0 2023-12-12T11:52:07.887 INFO:tasks.workunit.client.0.smithi063.stdout:6/754: read d9/d10/d5c/d5e/fd8 [1651903,81035] 0 2023-12-12T11:52:07.887 INFO:tasks.workunit.client.0.smithi063.stdout:6/755: fdatasync d9/fc 0 2023-12-12T11:52:07.887 INFO:tasks.workunit.client.1.smithi093.stdout:5/890: dread d0/d7/d36/db9/d66/d7c/db5/fbd [0,4194304] 0 2023-12-12T11:52:07.889 INFO:tasks.workunit.client.0.smithi063.stdout:4/740: mkdir d2/d17/d9d/df5 0 2023-12-12T11:52:07.889 INFO:tasks.workunit.client.0.smithi063.stdout:4/741: chown d2/d47/d6d/f8e 25567 1 2023-12-12T11:52:07.889 INFO:tasks.workunit.client.0.smithi063.stdout:4/742: creat d2/d17/d7f/da2/ff6 x:0 0 0 2023-12-12T11:52:07.890 INFO:tasks.workunit.client.1.smithi093.stdout:0/986: rename d5/d21/d27/f5f to d5/d21/d27/f12e 0 2023-12-12T11:52:07.890 INFO:tasks.workunit.client.1.smithi093.stdout:0/987: chown d5/d41/d77/d79/df2/d111/f12b 12 1 2023-12-12T11:52:07.891 INFO:tasks.workunit.client.1.smithi093.stdout:0/988: write d5/dd/d14/d26/f8e [1392543,53241] 0 2023-12-12T11:52:07.891 INFO:tasks.workunit.client.1.smithi093.stdout:0/989: chown d5/dd/d62/fec 6618 1 2023-12-12T11:52:07.891 INFO:tasks.workunit.client.1.smithi093.stdout:0/990: chown d5/d21/d27/d3a/d9a/db5/db8 4848 1 2023-12-12T11:52:07.891 INFO:tasks.workunit.client.1.smithi093.stdout:0/991: chown d5/d21/d2f/d54/c5b 2460445 1 2023-12-12T11:52:07.892 INFO:tasks.workunit.client.0.smithi063.stdout:5/752: rename d7/fa7 to d7/d10/d2b/d3c/d5a/fe5 0 2023-12-12T11:52:07.895 INFO:tasks.workunit.client.1.smithi093.stdout:0/992: rename d5/dd/d33/f3c to d5/dd/d62/d10c/d11b/d125/f12f 0 2023-12-12T11:52:07.895 INFO:tasks.workunit.client.1.smithi093.stdout:0/993: truncate d5/d41/d77/d79/d9b/f121 4904474 0 2023-12-12T11:52:07.897 INFO:tasks.workunit.client.1.smithi093.stdout:0/994: creat d5/dd/d62/d10c/d11b/d125/f130 x:0 0 0 2023-12-12T11:52:07.898 INFO:tasks.workunit.client.0.smithi063.stdout:6/756: creat d9/d10/d2a/de7/d86/f108 x:0 0 0 2023-12-12T11:52:07.898 INFO:tasks.workunit.client.0.smithi063.stdout:5/753: rename d7/d10/d2b/d3c/d27/c70 to d7/d10/d2b/d3c/d27/ce6 0 2023-12-12T11:52:07.899 INFO:tasks.workunit.client.0.smithi063.stdout:6/757: dread - d9/d68/d94/ff9 zero size 2023-12-12T11:52:07.899 INFO:tasks.workunit.client.0.smithi063.stdout:6/758: creat d9/f109 x:0 0 0 2023-12-12T11:52:07.903 INFO:tasks.workunit.client.1.smithi093.stdout:5/891: write d0/d7/f1c [3287475,50252] 0 2023-12-12T11:52:07.903 INFO:tasks.workunit.client.1.smithi093.stdout:5/892: dread - d0/d7/d36/d87/f105 zero size 2023-12-12T11:52:07.903 INFO:tasks.workunit.client.0.smithi063.stdout:5/754: link d7/d10/f14 d7/d10/d2b/d3c/d42/d62/db4/fe7 0 2023-12-12T11:52:07.904 INFO:tasks.workunit.client.0.smithi063.stdout:6/759: unlink d9/d2c/d61/l95 0 2023-12-12T11:52:07.904 INFO:tasks.workunit.client.0.smithi063.stdout:6/760: write d9/d10/fdb [716515,22422] 0 2023-12-12T11:52:07.907 INFO:tasks.workunit.client.0.smithi063.stdout:5/755: rename d7/d10/d2b/d3c/c8d to d7/d28/ce8 0 2023-12-12T11:52:07.908 INFO:tasks.workunit.client.0.smithi063.stdout:5/756: fdatasync d7/de/f84 0 2023-12-12T11:52:07.908 INFO:tasks.workunit.client.0.smithi063.stdout:7/614: write de/d33/dd2/d61/f86 [2275772,65372] 0 2023-12-12T11:52:07.909 INFO:tasks.workunit.client.0.smithi063.stdout:7/615: creat de/d33/d71/fec x:0 0 0 2023-12-12T11:52:07.909 INFO:tasks.workunit.client.0.smithi063.stdout:7/616: fsync de/d22/d6e/d8a/da3/f5d 0 2023-12-12T11:52:07.909 INFO:tasks.workunit.client.0.smithi063.stdout:6/761: link d9/d10/d2a/de7/d86/fbe d9/d2c/d61/dcd/f10a 0 2023-12-12T11:52:07.911 INFO:tasks.workunit.client.0.smithi063.stdout:5/757: truncate d7/d28/d67/f90 1493426 0 2023-12-12T11:52:07.912 INFO:tasks.workunit.client.0.smithi063.stdout:5/758: chown d7/d10/d2b/d3c/d5a/dbb/lca 1455 1 2023-12-12T11:52:07.913 INFO:tasks.workunit.client.1.smithi093.stdout:3/959: dwrite df/d22/d49/d69/d78/daf/d3d/def/fa1 [0,4194304] 0 2023-12-12T11:52:07.913 INFO:tasks.workunit.client.1.smithi093.stdout:3/960: dread - df/d22/d49/d69/d78/daf/d3d/d59/d72/fd9 zero size 2023-12-12T11:52:07.914 INFO:tasks.workunit.client.0.smithi063.stdout:0/739: dread d0/d7/d27/f81 [0,4194304] 0 2023-12-12T11:52:07.916 INFO:tasks.workunit.client.0.smithi063.stdout:6/762: rename d9/d10/d2a/de7/d8a/fbd to d9/d68/de4/f10b 0 2023-12-12T11:52:07.917 INFO:tasks.workunit.client.1.smithi093.stdout:2/986: dwrite d5/d14/d2d/d4c/d54/d67/d69/d6c/f93 [0,4194304] 0 2023-12-12T11:52:07.917 INFO:tasks.workunit.client.1.smithi093.stdout:2/987: dread - d5/d14/d2d/d4c/d54/d67/d69/dde/f129 zero size 2023-12-12T11:52:07.918 INFO:tasks.workunit.client.1.smithi093.stdout:3/961: link df/d22/d49/d69/d78/daf/d3d/d42/d8e/de1/f10a df/d22/d49/d69/d78/daf/d3d/d59/d72/d79/f13a 0 2023-12-12T11:52:07.918 INFO:tasks.workunit.client.1.smithi093.stdout:3/962: dread - df/d22/d49/d69/d78/dad/f105 zero size 2023-12-12T11:52:07.919 INFO:tasks.workunit.client.1.smithi093.stdout:5/893: write d0/d7/d85/fea [3943753,26410] 0 2023-12-12T11:52:07.922 INFO:tasks.workunit.client.0.smithi063.stdout:7/617: unlink de/d33/dd2/d61/c9f 0 2023-12-12T11:52:07.923 INFO:tasks.workunit.client.0.smithi063.stdout:7/618: chown de/d34/d43/d45/l9c 896483765 1 2023-12-12T11:52:07.923 INFO:tasks.workunit.client.0.smithi063.stdout:7/619: readlink l7 0 2023-12-12T11:52:07.924 INFO:tasks.workunit.client.1.smithi093.stdout:2/988: mkdir d5/d14/d2d/d12/d14a 0 2023-12-12T11:52:07.924 INFO:tasks.workunit.client.1.smithi093.stdout:3/963: mkdir df/d22/d49/d69/d78/daf/d13b 0 2023-12-12T11:52:07.924 INFO:tasks.workunit.client.1.smithi093.stdout:2/989: fsync d5/d14/d2d/d12/d25/d7a/d7e/da0/df4/f13b 0 2023-12-12T11:52:07.926 INFO:tasks.workunit.client.1.smithi093.stdout:3/964: creat df/d22/d49/d69/d78/dea/f13c x:0 0 0 2023-12-12T11:52:07.926 INFO:tasks.workunit.client.1.smithi093.stdout:2/990: creat d5/d14/d2d/d8b/f14b x:0 0 0 2023-12-12T11:52:07.931 INFO:tasks.workunit.client.1.smithi093.stdout:1/995: dwrite d4/d1a/d1b/dbf/fd3 [8388608,4194304] 0 2023-12-12T11:52:07.931 INFO:tasks.workunit.client.1.smithi093.stdout:1/996: creat d4/d1a/da6/f151 x:0 0 0 2023-12-12T11:52:07.931 INFO:tasks.workunit.client.1.smithi093.stdout:1/997: chown d4/lb 15087 1 2023-12-12T11:52:07.931 INFO:tasks.workunit.client.1.smithi093.stdout:1/998: write d4/d1a/d1b/d26/ff0 [8788988,73894] 0 2023-12-12T11:52:07.936 INFO:tasks.workunit.client.1.smithi093.stdout:2/991: creat d5/d14/d2d/d12/d25/f14c x:0 0 0 2023-12-12T11:52:07.937 INFO:tasks.workunit.client.0.smithi063.stdout:5/759: write d7/d28/f47 [2614381,52105] 0 2023-12-12T11:52:07.938 INFO:tasks.workunit.client.0.smithi063.stdout:3/666: dwrite d4/f76 [4194304,4194304] 0 2023-12-12T11:52:07.941 INFO:tasks.workunit.client.0.smithi063.stdout:2/635: dwrite d0/d1a/d26/f7b [0,4194304] 0 2023-12-12T11:52:07.953 INFO:tasks.workunit.client.1.smithi093.stdout:1/999: rmdir d4/d1a 39 2023-12-12T11:52:07.955 INFO:tasks.workunit.client.0.smithi063.stdout:5/760: mkdir d7/d10/d2b/d3c/d5a/de9 0 2023-12-12T11:52:07.955 INFO:tasks.workunit.client.0.smithi063.stdout:5/761: readlink d7/d10/d2b/d3c/d42/l4e 0 2023-12-12T11:52:07.962 INFO:tasks.workunit.client.0.smithi063.stdout:5/762: truncate d7/d28/d6e/f39 181454 0 2023-12-12T11:52:07.965 INFO:tasks.workunit.client.1.smithi093.stdout:2/992: rename d5/d14/d2d/d12/d25/d7a/c82 to d5/d14/d2d/d4c/d54/dc5/d55/d75/c14d 0 2023-12-12T11:52:07.965 INFO:tasks.workunit.client.1.smithi093.stdout:2/993: chown d5/d14/d2d/d12/d44 406 1 2023-12-12T11:52:07.965 INFO:tasks.workunit.client.1.smithi093.stdout:2/994: stat d5/d14/d2d/d8b/l9f 0 2023-12-12T11:52:07.965 INFO:tasks.workunit.client.1.smithi093.stdout:2/995: chown d5/d31/dbc/f13a 5069 1 2023-12-12T11:52:07.967 INFO:tasks.workunit.client.0.smithi063.stdout:5/763: mknod d7/d28/d94/cea 0 2023-12-12T11:52:07.976 INFO:tasks.workunit.client.0.smithi063.stdout:5/764: rmdir d7/d10/d2b/d3c/d5a/dbb 39 2023-12-12T11:52:07.979 INFO:tasks.workunit.client.1.smithi093.stdout:2/996: dread d5/f19 [4194304,4194304] 0 2023-12-12T11:52:07.981 INFO:tasks.workunit.client.0.smithi063.stdout:2/636: dread d0/d1a/d48/f34 [0,4194304] 0 2023-12-12T11:52:07.983 INFO:tasks.workunit.client.0.smithi063.stdout:2/637: truncate d0/f49 1418630 0 2023-12-12T11:52:07.983 INFO:tasks.workunit.client.0.smithi063.stdout:2/638: stat d0/d1a/d48/d56/d77 0 2023-12-12T11:52:07.986 INFO:tasks.workunit.client.0.smithi063.stdout:8/804: dwrite d4/de/d11/f14 [0,4194304] 0 2023-12-12T11:52:07.988 INFO:tasks.workunit.client.0.smithi063.stdout:6/763: dread d9/d10/d7a/f91 [0,4194304] 0 2023-12-12T11:52:07.988 INFO:tasks.workunit.client.0.smithi063.stdout:2/639: creat d0/d1a/d48/d56/fcd x:0 0 0 2023-12-12T11:52:07.988 INFO:tasks.workunit.client.0.smithi063.stdout:2/640: write d0/f17 [1320927,24398] 0 2023-12-12T11:52:07.990 INFO:tasks.workunit.client.0.smithi063.stdout:8/805: truncate d4/de/d3b/d62/d36/fab 901326 0 2023-12-12T11:52:07.990 INFO:tasks.workunit.client.0.smithi063.stdout:8/806: write d4/de/d1e/f64 [3897008,115093] 0 2023-12-12T11:52:07.992 INFO:tasks.workunit.client.1.smithi093.stdout:7/933: dwrite da/d15/f26 [0,4194304] 0 2023-12-12T11:52:07.995 INFO:tasks.workunit.client.1.smithi093.stdout:2/997: truncate d5/d14/d2d/d12/d25/f29 1832693 0 2023-12-12T11:52:07.996 INFO:tasks.workunit.client.1.smithi093.stdout:7/934: read da/de/fb1 [1418923,20112] 0 2023-12-12T11:52:07.996 INFO:tasks.workunit.client.1.smithi093.stdout:7/935: creat da/d8e/da9/f146 x:0 0 0 2023-12-12T11:52:07.996 INFO:tasks.workunit.client.0.smithi063.stdout:2/641: unlink d0/d1a/d48/d56/la0 0 2023-12-12T11:52:07.997 INFO:tasks.workunit.client.0.smithi063.stdout:2/642: stat d0/d1a/d1e/l1f 0 2023-12-12T11:52:07.997 INFO:tasks.workunit.client.0.smithi063.stdout:2/643: creat d0/d1a/fce x:0 0 0 2023-12-12T11:52:07.997 INFO:tasks.workunit.client.0.smithi063.stdout:2/644: fdatasync d0/ff 0 2023-12-12T11:52:08.001 INFO:tasks.workunit.client.0.smithi063.stdout:7/620: dwrite de/d22/d66/fa7 [0,4194304] 0 2023-12-12T11:52:08.003 INFO:tasks.workunit.client.0.smithi063.stdout:8/807: unlink d4/f42 0 2023-12-12T11:52:08.014 INFO:tasks.workunit.client.0.smithi063.stdout:2/645: rmdir d0/d1a/d48/d56/d77 39 2023-12-12T11:52:08.014 INFO:tasks.workunit.client.1.smithi093.stdout:3/965: dread df/d22/d49/d69/d78/daf/d3d/d59/d9c/fa2 [0,4194304] 0 2023-12-12T11:52:08.015 INFO:tasks.workunit.client.0.smithi063.stdout:0/740: dwrite d0/d1a/d66/f87 [0,4194304] 0 2023-12-12T11:52:08.017 INFO:tasks.workunit.client.0.smithi063.stdout:7/621: link de/d33/d41/d44/l69 de/d34/d68/da1/led 0 2023-12-12T11:52:08.019 INFO:tasks.workunit.client.0.smithi063.stdout:3/667: dwrite d4/d23/d6b/f95 [0,4194304] 0 2023-12-12T11:52:08.022 INFO:tasks.workunit.client.0.smithi063.stdout:8/808: creat d4/d24/d38/d45/d5b/ffd x:0 0 0 2023-12-12T11:52:08.022 INFO:tasks.workunit.client.0.smithi063.stdout:8/809: write d4/de/d3b/d62/d36/d57/fc7 [689402,14022] 0 2023-12-12T11:52:08.037 INFO:tasks.workunit.client.0.smithi063.stdout:7/622: getdents de/d22/d4d 0 2023-12-12T11:52:08.046 INFO:tasks.workunit.client.0.smithi063.stdout:3/668: write d4/df/d1a/f20 [3576543,40649] 0 2023-12-12T11:52:08.055 INFO:tasks.workunit.client.0.smithi063.stdout:0/741: dread d0/d1a/d23/d34/d42/f5d [0,4194304] 0 2023-12-12T11:52:08.061 INFO:tasks.workunit.client.0.smithi063.stdout:5/765: dwrite d7/de/fd5 [0,4194304] 0 2023-12-12T11:52:08.064 INFO:tasks.workunit.client.1.smithi093.stdout:7/936: dwrite da/d2e/f93 [0,4194304] 0 2023-12-12T11:52:08.073 INFO:tasks.workunit.client.1.smithi093.stdout:2/998: creat d5/d14/d2d/d8b/da3/f14e x:0 0 0 2023-12-12T11:52:08.073 INFO:tasks.workunit.client.1.smithi093.stdout:2/999: write d5/d14/d2d/d8b/da3/f14e [322433,56545] 0 2023-12-12T11:52:08.077 INFO:tasks.workunit.client.0.smithi063.stdout:5/766: rename d7/d10/d2b/d3c/l37 to d7/d10/d2b/d3c/d42/d62/d69/dcb/de0/leb 0 2023-12-12T11:52:08.079 INFO:tasks.workunit.client.0.smithi063.stdout:0/742: dread d0/d1a/d23/d2e/f64 [0,4194304] 0 2023-12-12T11:52:08.080 INFO:tasks.workunit.client.1.smithi093.stdout:3/966: dwrite df/d25/d2c/d85/f8f [0,4194304] 0 2023-12-12T11:52:08.081 INFO:tasks.workunit.client.0.smithi063.stdout:2/646: dwrite d0/d1a/d1e/d64/fbc [0,4194304] 0 2023-12-12T11:52:08.081 INFO:tasks.workunit.client.0.smithi063.stdout:2/647: dread - d0/d1a/d57/fc2 zero size 2023-12-12T11:52:08.081 INFO:tasks.workunit.client.0.smithi063.stdout:2/648: fdatasync d0/d1a/d48/f3f 0 2023-12-12T11:52:08.081 INFO:tasks.workunit.client.0.smithi063.stdout:2/649: creat d0/d1a/d48/d56/fcf x:0 0 0 2023-12-12T11:52:08.081 INFO:tasks.workunit.client.1.smithi093.stdout:5/894: dwrite d0/d7/d59/d48/f50 [0,4194304] 0 2023-12-12T11:52:08.082 INFO:tasks.workunit.client.1.smithi093.stdout:5/895: dread - d0/d7/d8/d9e/f78 zero size 2023-12-12T11:52:08.082 INFO:tasks.workunit.client.0.smithi063.stdout:6/764: dwrite d9/d10/d5c/fbf [0,4194304] 0 2023-12-12T11:52:08.083 INFO:tasks.workunit.client.0.smithi063.stdout:5/767: rmdir d7/d10/d2b/d3c/d42/d62/d69/dcb 39 2023-12-12T11:52:08.088 INFO:tasks.workunit.client.0.smithi063.stdout:0/743: rename d0/d1a/d23/d34/d42/ld6 to d0/d7/d27/d1f/lf4 0 2023-12-12T11:52:08.093 INFO:tasks.workunit.client.0.smithi063.stdout:5/768: write d7/d28/d43/d49/f4a [991398,108973] 0 2023-12-12T11:52:08.095 INFO:tasks.workunit.client.1.smithi093.stdout:3/967: write df/d25/d2c/f5f [4000985,37225] 0 2023-12-12T11:52:08.098 INFO:tasks.workunit.client.1.smithi093.stdout:7/937: getdents da/d15/d2d 0 2023-12-12T11:52:08.123 INFO:tasks.workunit.client.1.smithi093.stdout:5/896: mkdir d0/d7/d12c 0 2023-12-12T11:52:08.130 INFO:tasks.workunit.client.1.smithi093.stdout:3/968: creat df/d22/d49/d69/d78/daf/d3d/d42/f13d x:0 0 0 2023-12-12T11:52:08.131 INFO:tasks.workunit.client.0.smithi063.stdout:5/769: dread d7/d10/d2b/d3c/d42/d62/f6c [0,4194304] 0 2023-12-12T11:52:08.142 INFO:tasks.workunit.client.1.smithi093.stdout:5/897: creat d0/d7/d36/d38/f12d x:0 0 0 2023-12-12T11:52:08.144 INFO:tasks.workunit.client.1.smithi093.stdout:3/969: mknod df/d25/c13e 0 2023-12-12T11:52:08.146 INFO:tasks.workunit.client.0.smithi063.stdout:3/669: dwrite d4/df/d1a/d1c/f29 [0,4194304] 0 2023-12-12T11:52:08.146 INFO:tasks.workunit.client.0.smithi063.stdout:3/670: chown d4/d23/d6b/d90/fc3 3044 1 2023-12-12T11:52:08.148 INFO:tasks.workunit.client.0.smithi063.stdout:2/650: dwrite d0/d1a/d48/f34 [4194304,4194304] 0 2023-12-12T11:52:08.148 INFO:tasks.workunit.client.0.smithi063.stdout:2/651: chown d0/d1a/d48/d56/lbe 6 1 2023-12-12T11:52:08.148 INFO:tasks.workunit.client.0.smithi063.stdout:2/652: creat d0/d1a/d3a/d85/da6/fd0 x:0 0 0 2023-12-12T11:52:08.148 INFO:tasks.workunit.client.0.smithi063.stdout:2/653: readlink d0/d1a/d3a/d59/l92 0 2023-12-12T11:52:08.149 INFO:tasks.workunit.client.0.smithi063.stdout:5/770: unlink d7/c18 0 2023-12-12T11:52:08.151 INFO:tasks.workunit.client.1.smithi093.stdout:5/898: getdents d0/d7/d8/de/dab/de5 0 2023-12-12T11:52:08.166 INFO:tasks.workunit.client.0.smithi063.stdout:2/654: dread d0/d1a/d1e/f4b [0,4194304] 0 2023-12-12T11:52:08.166 INFO:tasks.workunit.client.0.smithi063.stdout:2/655: readlink d0/d1a/d48/d56/lc0 0 2023-12-12T11:52:08.166 INFO:tasks.workunit.client.0.smithi063.stdout:2/656: fdatasync d0/f5 0 2023-12-12T11:52:08.173 INFO:tasks.workunit.client.0.smithi063.stdout:8/810: dwrite d4/f9c [0,4194304] 0 2023-12-12T11:52:08.174 INFO:tasks.workunit.client.0.smithi063.stdout:8/811: dread - d4/de/d11/fcc zero size 2023-12-12T11:52:08.177 INFO:tasks.workunit.client.1.smithi093.stdout:7/938: dwrite da/d15/d59/fe5 [0,4194304] 0 2023-12-12T11:52:08.177 INFO:tasks.workunit.client.0.smithi063.stdout:0/744: dwrite d0/d1a/d23/d2e/fe5 [0,4194304] 0 2023-12-12T11:52:08.177 INFO:tasks.workunit.client.0.smithi063.stdout:0/745: truncate d0/d7/d27/fc5 896389 0 2023-12-12T11:52:08.178 INFO:tasks.workunit.client.0.smithi063.stdout:0/746: chown d0/d1a/l8b 5 1 2023-12-12T11:52:08.180 INFO:tasks.workunit.client.0.smithi063.stdout:6/765: link d9/d10/d2a/de7/d86/dc2/ded/df5/lf4 d9/d10/d2a/de7/d86/dc2/l10c 0 2023-12-12T11:52:08.180 INFO:tasks.workunit.client.0.smithi063.stdout:3/671: rmdir d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d56 39 2023-12-12T11:52:08.180 INFO:tasks.workunit.client.0.smithi063.stdout:3/672: chown d4/df/d1a/d1c/d3b/d50/d61/fbe 46 1 2023-12-12T11:52:08.180 INFO:tasks.workunit.client.0.smithi063.stdout:3/673: dread - d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/fbd zero size 2023-12-12T11:52:08.180 INFO:tasks.workunit.client.0.smithi063.stdout:6/766: write d9/d2c/d61/f7d [660680,52440] 0 2023-12-12T11:52:08.184 INFO:tasks.workunit.client.1.smithi093.stdout:7/939: symlink da/de/d46/l147 0 2023-12-12T11:52:08.185 INFO:tasks.workunit.client.0.smithi063.stdout:0/747: dread d0/d1a/d23/d2e/f5a [0,4194304] 0 2023-12-12T11:52:08.185 INFO:tasks.workunit.client.1.smithi093.stdout:3/970: dwrite df/d22/d49/d69/d78/daf/d3d/d6f/fd5 [0,4194304] 0 2023-12-12T11:52:08.186 INFO:tasks.workunit.client.0.smithi063.stdout:5/771: truncate d7/d10/d2b/d3c/d63/f7a 122209 0 2023-12-12T11:52:08.189 INFO:tasks.workunit.client.1.smithi093.stdout:7/940: symlink da/d15/d19/l148 0 2023-12-12T11:52:08.191 INFO:tasks.workunit.client.0.smithi063.stdout:2/657: rename d0/fa3 to d0/d1a/d3a/d59/fd1 0 2023-12-12T11:52:08.198 INFO:tasks.workunit.client.1.smithi093.stdout:3/971: unlink df/d25/d2c/d85/fcf 0 2023-12-12T11:52:08.200 INFO:tasks.workunit.client.0.smithi063.stdout:3/674: truncate d4/df/d1a/f31 3159035 0 2023-12-12T11:52:08.201 INFO:tasks.workunit.client.1.smithi093.stdout:3/972: write df/d30/d33/ff5 [1288128,25951] 0 2023-12-12T11:52:08.201 INFO:tasks.workunit.client.1.smithi093.stdout:3/973: fsync df/d22/d49/d69/d78/daf/d3d/d42/d8e/ff8 0 2023-12-12T11:52:08.201 INFO:tasks.workunit.client.1.smithi093.stdout:3/974: write df/d22/de6/f132 [237029,75482] 0 2023-12-12T11:52:08.201 INFO:tasks.workunit.client.1.smithi093.stdout:3/975: dread - df/d22/d49/d69/d78/dea/f13c zero size 2023-12-12T11:52:08.201 INFO:tasks.workunit.client.1.smithi093.stdout:3/976: readlink df/d22/d49/d69/d78/daf/d3d/d42/l62 0 2023-12-12T11:52:08.201 INFO:tasks.workunit.client.1.smithi093.stdout:3/977: write df/d92/dd4/f121 [732105,73498] 0 2023-12-12T11:52:08.202 INFO:tasks.workunit.client.1.smithi093.stdout:0/995: sync 2023-12-12T11:52:08.202 INFO:tasks.workunit.client.0.smithi063.stdout:6/767: rename d9/le to d9/d68/d94/l10d 0 2023-12-12T11:52:08.203 INFO:tasks.workunit.client.0.smithi063.stdout:8/812: getdents d4/de/d3b/d62/d6e 0 2023-12-12T11:52:08.203 INFO:tasks.workunit.client.0.smithi063.stdout:8/813: write d4/d55/d52/d8e/fbe [4206835,29830] 0 2023-12-12T11:52:08.205 INFO:tasks.workunit.client.0.smithi063.stdout:3/675: creat d4/d23/d7b/dc2/fcc x:0 0 0 2023-12-12T11:52:08.208 INFO:tasks.workunit.client.0.smithi063.stdout:6/768: write d9/d10/d2a/de7/d8a/fcb [693659,45079] 0 2023-12-12T11:52:08.209 INFO:tasks.workunit.client.0.smithi063.stdout:8/814: creat d4/d24/d38/dd8/ffe x:0 0 0 2023-12-12T11:52:08.211 INFO:tasks.workunit.client.0.smithi063.stdout:0/748: rename d0/d7/d27/f90 to d0/d1a/d23/d34/ff5 0 2023-12-12T11:52:08.215 INFO:tasks.workunit.client.1.smithi093.stdout:5/899: dwrite d0/d7/d85/fea [0,4194304] 0 2023-12-12T11:52:08.216 INFO:tasks.workunit.client.0.smithi063.stdout:2/658: read d0/d1a/d48/d56/f65 [2824832,30275] 0 2023-12-12T11:52:08.218 INFO:tasks.workunit.client.0.smithi063.stdout:5/772: rename d7/d10/d2b/d3c/d27/c31 to d7/d10/d2b/d3c/d5a/dbb/dbc/cec 0 2023-12-12T11:52:08.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:07 smithi093 ceph-mon[115914]: pgmap v18: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 165 MiB/s rd, 193 MiB/s wr, 297 op/s 2023-12-12T11:52:08.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:07 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:52:08.221 INFO:tasks.workunit.client.0.smithi063.stdout:0/749: truncate d0/d7/f55 3161485 0 2023-12-12T11:52:08.224 INFO:tasks.workunit.client.0.smithi063.stdout:2/659: mknod d0/cd2 0 2023-12-12T11:52:08.226 INFO:tasks.workunit.client.0.smithi063.stdout:5/773: creat d7/d10/d2b/d3c/fed x:0 0 0 2023-12-12T11:52:08.233 INFO:tasks.workunit.client.1.smithi093.stdout:7/941: dwrite da/d8e/dbc/fd9 [0,4194304] 0 2023-12-12T11:52:08.244 INFO:tasks.workunit.client.1.smithi093.stdout:7/942: mknod da/d8e/da9/d142/c149 0 2023-12-12T11:52:08.248 INFO:tasks.workunit.client.0.smithi063.stdout:0/750: link d0/d7/d27/f3b d0/d1a/d23/ff6 0 2023-12-12T11:52:08.252 INFO:tasks.workunit.client.1.smithi093.stdout:7/943: rename da/d15/d19/d4c/l130 to da/d15/d59/de0/l14a 0 2023-12-12T11:52:08.260 INFO:tasks.workunit.client.0.smithi063.stdout:2/660: getdents d0/d1a/d1e/d64 0 2023-12-12T11:52:08.260 INFO:tasks.workunit.client.0.smithi063.stdout:2/661: read - d0/d1a/d48/d56/d77/f8b zero size 2023-12-12T11:52:08.260 INFO:tasks.workunit.client.0.smithi063.stdout:2/662: chown d0/d1a/d48/d56 348838 1 2023-12-12T11:52:08.267 INFO:tasks.workunit.client.1.smithi093.stdout:7/944: creat da/d8e/daf/f14b x:0 0 0 2023-12-12T11:52:08.274 INFO:tasks.workunit.client.0.smithi063.stdout:0/751: creat d0/d1a/d23/d34/ff7 x:0 0 0 2023-12-12T11:52:08.274 INFO:tasks.workunit.client.1.smithi093.stdout:7/945: mkdir da/d8e/dbc/d14c 0 2023-12-12T11:52:08.278 INFO:tasks.workunit.client.1.smithi093.stdout:7/946: unlink da/d15/d19/d4c/dc1/ccd 0 2023-12-12T11:52:08.278 INFO:tasks.workunit.client.1.smithi093.stdout:7/947: fdatasync da/de/d46/d4f/f62 0 2023-12-12T11:52:08.278 INFO:tasks.workunit.client.1.smithi093.stdout:7/948: fsync da/de/f30 0 2023-12-12T11:52:08.279 INFO:tasks.workunit.client.1.smithi093.stdout:7/949: write da/d8e/daf/f14b [969649,95323] 0 2023-12-12T11:52:08.281 INFO:tasks.workunit.client.0.smithi063.stdout:0/752: unlink d0/d7/d27/d19/f51 0 2023-12-12T11:52:08.283 INFO:tasks.workunit.client.0.smithi063.stdout:0/753: mknod d0/d1a/d23/d2e/dd4/ddc/de0/cf8 0 2023-12-12T11:52:08.283 INFO:tasks.workunit.client.0.smithi063.stdout:0/754: dread - d0/fd9 zero size 2023-12-12T11:52:08.285 INFO:tasks.workunit.client.0.smithi063.stdout:0/755: creat d0/d7/d27/d19/ff9 x:0 0 0 2023-12-12T11:52:08.292 INFO:tasks.workunit.client.0.smithi063.stdout:5/774: dwrite d7/d10/d2b/d3c/d27/f81 [0,4194304] 0 2023-12-12T11:52:08.293 INFO:tasks.workunit.client.0.smithi063.stdout:4/743: sync 2023-12-12T11:52:08.294 INFO:tasks.workunit.client.0.smithi063.stdout:1/770: sync 2023-12-12T11:52:08.294 INFO:tasks.workunit.client.0.smithi063.stdout:9/615: sync 2023-12-12T11:52:08.294 INFO:tasks.workunit.client.0.smithi063.stdout:9/616: fdatasync d7/d15/f1d 0 2023-12-12T11:52:08.294 INFO:tasks.workunit.client.0.smithi063.stdout:1/771: dread - d3/d3a/dd7/d16/d24/d4d/d35/d98/fc0 zero size 2023-12-12T11:52:08.294 INFO:tasks.workunit.client.0.smithi063.stdout:7/623: sync 2023-12-12T11:52:08.298 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:07 smithi063 ceph-mon[107117]: pgmap v18: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 165 MiB/s rd, 193 MiB/s wr, 297 op/s 2023-12-12T11:52:08.299 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:07 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:52:08.299 INFO:tasks.workunit.client.1.smithi093.stdout:7/950: dread da/de/fb1 [0,4194304] 0 2023-12-12T11:52:08.299 INFO:tasks.workunit.client.1.smithi093.stdout:3/978: dwrite df/d22/d49/d69/d78/dad/f105 [0,4194304] 0 2023-12-12T11:52:08.299 INFO:tasks.workunit.client.0.smithi063.stdout:9/617: stat d7/d11/d12/c2c 0 2023-12-12T11:52:08.299 INFO:tasks.workunit.client.0.smithi063.stdout:9/618: fsync d7/d20/d3f/d40/f44 0 2023-12-12T11:52:08.300 INFO:tasks.workunit.client.0.smithi063.stdout:8/815: dwrite d4/d24/fd7 [4194304,4194304] 0 2023-12-12T11:52:08.300 INFO:tasks.workunit.client.0.smithi063.stdout:1/772: mknod d3/d3a/dd7/d16/d24/d48/d75/d83/d81/c100 0 2023-12-12T11:52:08.303 INFO:tasks.workunit.client.0.smithi063.stdout:7/624: creat de/d34/d43/d45/fee x:0 0 0 2023-12-12T11:52:08.303 INFO:tasks.workunit.client.0.smithi063.stdout:7/625: write de/d39/d4b/d7b/fbe [1439555,116978] 0 2023-12-12T11:52:08.303 INFO:tasks.workunit.client.0.smithi063.stdout:7/626: write de/d39/d60/da4/fb7 [854914,84614] 0 2023-12-12T11:52:08.303 INFO:tasks.workunit.client.0.smithi063.stdout:7/627: stat de 0 2023-12-12T11:52:08.303 INFO:tasks.workunit.client.0.smithi063.stdout:7/628: stat de/d39/d60/d80 0 2023-12-12T11:52:08.304 INFO:tasks.workunit.client.0.smithi063.stdout:4/744: getdents d2/d17/d61 0 2023-12-12T11:52:08.306 INFO:tasks.workunit.client.1.smithi093.stdout:3/979: mknod df/d22/d49/d69/d78/dad/df2/c13f 0 2023-12-12T11:52:08.306 INFO:tasks.workunit.client.1.smithi093.stdout:3/980: dread - df/d22/d49/d69/d78/daf/d3d/d42/d8e/de1/f10a zero size 2023-12-12T11:52:08.306 INFO:tasks.workunit.client.1.smithi093.stdout:3/981: fsync df/d22/d49/d69/d78/daf/d3d/d59/d72/d79/f13a 0 2023-12-12T11:52:08.307 INFO:tasks.workunit.client.0.smithi063.stdout:8/816: creat d4/de/d3b/d62/d6e/d76/fff x:0 0 0 2023-12-12T11:52:08.308 INFO:tasks.workunit.client.0.smithi063.stdout:1/773: rename d3/d3a/dd7/d16/d17/d4b/fd8 to d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2/f101 0 2023-12-12T11:52:08.309 INFO:tasks.workunit.client.1.smithi093.stdout:5/900: write d0/d7/d36/d38/f40 [2775191,121484] 0 2023-12-12T11:52:08.310 INFO:tasks.workunit.client.1.smithi093.stdout:7/951: dread da/d15/d19/d4c/f10e [0,4194304] 0 2023-12-12T11:52:08.312 INFO:tasks.workunit.client.0.smithi063.stdout:1/774: creat d3/d3a/dd7/d16/d17/f102 x:0 0 0 2023-12-12T11:52:08.312 INFO:tasks.workunit.client.0.smithi063.stdout:7/629: symlink de/d22/lef 0 2023-12-12T11:52:08.312 INFO:tasks.workunit.client.0.smithi063.stdout:7/630: truncate de/d22/d4d/f91 2712244 0 2023-12-12T11:52:08.312 INFO:tasks.workunit.client.0.smithi063.stdout:7/631: getdents de/dc8 0 2023-12-12T11:52:08.313 INFO:tasks.workunit.client.1.smithi093.stdout:7/952: symlink da/d15/d59/df0/l14d 0 2023-12-12T11:52:08.313 INFO:tasks.workunit.client.1.smithi093.stdout:7/953: fsync da/d15/d19/d4c/f7a 0 2023-12-12T11:52:08.313 INFO:tasks.workunit.client.1.smithi093.stdout:7/954: chown da/de/d46/d4f/lc4 1492270656 1 2023-12-12T11:52:08.314 INFO:tasks.workunit.client.0.smithi063.stdout:5/775: write d7/d10/d2b/f58 [820398,65234] 0 2023-12-12T11:52:08.314 INFO:tasks.workunit.client.0.smithi063.stdout:5/776: readlink d7/d10/d2b/d3c/d5a/dbb/dbc/lcf 0 2023-12-12T11:52:08.317 INFO:tasks.workunit.client.0.smithi063.stdout:5/777: rename d7/d10/d2b/d3c/c77 to d7/d28/d67/cee 0 2023-12-12T11:52:08.317 INFO:tasks.workunit.client.0.smithi063.stdout:5/778: readlink d7/d10/d2b/d3c/d5a/dbb/lca 0 2023-12-12T11:52:08.322 INFO:tasks.workunit.client.0.smithi063.stdout:5/779: unlink d7/d10/d2b/f91 0 2023-12-12T11:52:08.323 INFO:tasks.workunit.client.1.smithi093.stdout:7/955: rename da/d2e to da/d8e/da9/d142/d14e 0 2023-12-12T11:52:08.323 INFO:tasks.workunit.client.1.smithi093.stdout:0/996: dwrite d5/d41/d77/d79/d9b/f9e [0,4194304] 0 2023-12-12T11:52:08.323 INFO:tasks.workunit.client.1.smithi093.stdout:0/997: chown d5/d21/d2f/d54/fb9 510924417 1 2023-12-12T11:52:08.323 INFO:tasks.workunit.client.1.smithi093.stdout:7/956: chown da/de/d46/d4f/f62 12528 1 2023-12-12T11:52:08.323 INFO:tasks.workunit.client.1.smithi093.stdout:0/998: fdatasync d5/d41/d77/fe4 0 2023-12-12T11:52:08.323 INFO:tasks.workunit.client.1.smithi093.stdout:3/982: dread df/f86 [4194304,4194304] 0 2023-12-12T11:52:08.324 INFO:tasks.workunit.client.1.smithi093.stdout:0/999: getdents d5/d21/d2f 0 2023-12-12T11:52:08.325 INFO:tasks.workunit.client.0.smithi063.stdout:7/632: dread de/f3c [0,4194304] 0 2023-12-12T11:52:08.325 INFO:tasks.workunit.client.0.smithi063.stdout:7/633: stat de/d22/d6e/de4 0 2023-12-12T11:52:08.326 INFO:tasks.workunit.client.1.smithi093.stdout:3/983: mkdir df/d22/d49/d69/d78/daf/d3d/d42/dd6/d140 0 2023-12-12T11:52:08.326 INFO:tasks.workunit.client.1.smithi093.stdout:3/984: truncate df/d25/fb4 509221 0 2023-12-12T11:52:08.327 INFO:tasks.workunit.client.1.smithi093.stdout:3/985: creat df/d92/dd4/f141 x:0 0 0 2023-12-12T11:52:08.327 INFO:tasks.workunit.client.1.smithi093.stdout:3/986: write df/f1c [1955890,23928] 0 2023-12-12T11:52:08.327 INFO:tasks.workunit.client.1.smithi093.stdout:3/987: stat df/dc6/f104 0 2023-12-12T11:52:08.334 INFO:tasks.workunit.client.0.smithi063.stdout:5/780: creat d7/d10/d2b/d3c/d5a/fef x:0 0 0 2023-12-12T11:52:08.335 INFO:tasks.workunit.client.0.smithi063.stdout:8/817: write d4/d24/fd7 [2396464,47687] 0 2023-12-12T11:52:08.336 INFO:tasks.workunit.client.0.smithi063.stdout:2/663: dwrite d0/d1a/d3a/d85/dbf/fa1 [0,4194304] 0 2023-12-12T11:52:08.336 INFO:tasks.workunit.client.0.smithi063.stdout:2/664: fsync d0/d1a/d3a/f84 0 2023-12-12T11:52:08.336 INFO:tasks.workunit.client.0.smithi063.stdout:2/665: chown d0/d41/daf 8 1 2023-12-12T11:52:08.336 INFO:tasks.workunit.client.0.smithi063.stdout:4/745: dread d2/d47/d6d/d88/df0/fcd [0,4194304] 0 2023-12-12T11:52:08.338 INFO:tasks.workunit.client.1.smithi093.stdout:7/957: read da/d15/d19/d90/ff7 [1698550,56000] 0 2023-12-12T11:52:08.338 INFO:tasks.workunit.client.1.smithi093.stdout:7/958: chown da/d15/d2d 90873 1 2023-12-12T11:52:08.338 INFO:tasks.workunit.client.1.smithi093.stdout:7/959: write da/d15/f1c [8666842,113825] 0 2023-12-12T11:52:08.338 INFO:tasks.workunit.client.0.smithi063.stdout:6/769: write d9/d10/d2a/de7/d86/fbe [1457044,51831] 0 2023-12-12T11:52:08.338 INFO:tasks.workunit.client.0.smithi063.stdout:6/770: fdatasync d9/f109 0 2023-12-12T11:52:08.339 INFO:tasks.workunit.client.1.smithi093.stdout:7/960: write da/de/f38 [439877,115730] 0 2023-12-12T11:52:08.345 INFO:tasks.workunit.client.0.smithi063.stdout:8/818: link d4/d55/fa0 d4/de/d3b/d62/d36/dc5/f100 0 2023-12-12T11:52:08.355 INFO:tasks.workunit.client.1.smithi093.stdout:3/988: unlink df/d22/d49/d69/d78/db9/f110 0 2023-12-12T11:52:08.355 INFO:tasks.workunit.client.1.smithi093.stdout:3/989: chown df/f1c 26 1 2023-12-12T11:52:08.355 INFO:tasks.workunit.client.1.smithi093.stdout:3/990: rename df to df/d25/d6b/d142 22 2023-12-12T11:52:08.357 INFO:tasks.workunit.client.0.smithi063.stdout:2/666: mknod d0/d1a/cd3 0 2023-12-12T11:52:08.357 INFO:tasks.workunit.client.0.smithi063.stdout:2/667: dread - d0/d1a/d57/fac zero size 2023-12-12T11:52:08.357 INFO:tasks.workunit.client.0.smithi063.stdout:2/668: write d0/d1a/dba/fc3 [1626886,83815] 0 2023-12-12T11:52:08.368 INFO:tasks.workunit.client.0.smithi063.stdout:4/746: rename d2/d17/d9d/d85/c9c to d2/d47/d6d/d88/de6/cf7 0 2023-12-12T11:52:08.378 INFO:tasks.workunit.client.1.smithi093.stdout:7/961: unlink da/f70 0 2023-12-12T11:52:08.378 INFO:tasks.workunit.client.1.smithi093.stdout:7/962: readlink da/d15/lb5 0 2023-12-12T11:52:08.378 INFO:tasks.workunit.client.1.smithi093.stdout:5/901: dwrite d0/d7/d85/fea [0,4194304] 0 2023-12-12T11:52:08.383 INFO:tasks.workunit.client.0.smithi063.stdout:8/819: mkdir d4/d24/d38/d45/d5b/d92/d65/d101 0 2023-12-12T11:52:08.383 INFO:tasks.workunit.client.0.smithi063.stdout:1/775: dwrite d3/d3a/dd7/d16/d24/f73 [0,4194304] 0 2023-12-12T11:52:08.384 INFO:tasks.workunit.client.0.smithi063.stdout:7/634: dwrite de/d33/d71/f96 [0,4194304] 0 2023-12-12T11:52:08.384 INFO:tasks.workunit.client.0.smithi063.stdout:7/635: fsync de/d3f/f6d 0 2023-12-12T11:52:08.384 INFO:tasks.workunit.client.0.smithi063.stdout:7/636: truncate de/d34/d43/d45/fee 237080 0 2023-12-12T11:52:08.386 INFO:tasks.workunit.client.0.smithi063.stdout:9/619: dwrite d7/d15/f31 [0,4194304] 0 2023-12-12T11:52:08.390 INFO:tasks.workunit.client.1.smithi093.stdout:7/963: creat da/d15/d2d/d2f/dc6/f14f x:0 0 0 2023-12-12T11:52:08.391 INFO:tasks.workunit.client.0.smithi063.stdout:4/747: truncate d2/d48/fc8 150198 0 2023-12-12T11:52:08.399 INFO:tasks.workunit.client.0.smithi063.stdout:8/820: write d4/d24/d38/d45/fdb [788777,121755] 0 2023-12-12T11:52:08.399 INFO:tasks.workunit.client.0.smithi063.stdout:8/821: write d4/de/d3b/d62/d36/fab [1555510,98262] 0 2023-12-12T11:52:08.399 INFO:tasks.workunit.client.0.smithi063.stdout:8/822: dread - d4/de/d11/fcc zero size 2023-12-12T11:52:08.402 INFO:tasks.workunit.client.0.smithi063.stdout:2/669: dread d0/ff [0,4194304] 0 2023-12-12T11:52:08.403 INFO:tasks.workunit.client.0.smithi063.stdout:5/781: dwrite d7/de/f9c [0,4194304] 0 2023-12-12T11:52:08.408 INFO:tasks.workunit.client.0.smithi063.stdout:2/670: dread d0/d69/f8a [0,4194304] 0 2023-12-12T11:52:08.421 INFO:tasks.workunit.client.1.smithi093.stdout:5/902: symlink d0/l12e 0 2023-12-12T11:52:08.421 INFO:tasks.workunit.client.1.smithi093.stdout:5/903: truncate d0/d7/d36/d29/d44/f94 420924 0 2023-12-12T11:52:08.422 INFO:tasks.workunit.client.0.smithi063.stdout:6/771: dwrite d9/d10/f93 [0,4194304] 0 2023-12-12T11:52:08.422 INFO:tasks.workunit.client.0.smithi063.stdout:6/772: readlink d9/d10/l79 0 2023-12-12T11:52:08.433 INFO:tasks.workunit.client.0.smithi063.stdout:1/776: mkdir d3/d3a/dd7/d16/d24/d48/d75/d83/d5b/d6b/d103 0 2023-12-12T11:52:08.433 INFO:tasks.workunit.client.0.smithi063.stdout:1/777: dread - d3/d3a/dd7/d16/d24/d4d/d35/d98/fc0 zero size 2023-12-12T11:52:08.439 INFO:tasks.workunit.client.0.smithi063.stdout:5/782: dwrite d7/d10/d2b/d3c/fbd [0,4194304] 0 2023-12-12T11:52:08.444 INFO:tasks.workunit.client.0.smithi063.stdout:6/773: dread d9/d68/fb2 [0,4194304] 0 2023-12-12T11:52:08.447 INFO:tasks.workunit.client.0.smithi063.stdout:7/637: symlink de/d34/d68/da1/dcd/lf0 0 2023-12-12T11:52:08.448 INFO:tasks.workunit.client.0.smithi063.stdout:7/638: fsync de/d33/dd2/f2d 0 2023-12-12T11:52:08.448 INFO:tasks.workunit.client.0.smithi063.stdout:7/639: stat de/d39/fb1 0 2023-12-12T11:52:08.452 INFO:tasks.workunit.client.0.smithi063.stdout:2/671: dwrite d0/d69/f9d [0,4194304] 0 2023-12-12T11:52:08.452 INFO:tasks.workunit.client.0.smithi063.stdout:2/672: fdatasync d0/f49 0 2023-12-12T11:52:08.452 INFO:tasks.workunit.client.0.smithi063.stdout:2/673: chown d0/d1a/d3a/cc6 3337897 1 2023-12-12T11:52:08.452 INFO:tasks.workunit.client.0.smithi063.stdout:2/674: chown d0/d1a/fce 3805777 1 2023-12-12T11:52:08.453 INFO:tasks.workunit.client.1.smithi093.stdout:7/964: mkdir da/d15/ddd/d131/d150 0 2023-12-12T11:52:08.453 INFO:tasks.workunit.client.0.smithi063.stdout:9/620: rmdir d7/d8a 39 2023-12-12T11:52:08.455 INFO:tasks.workunit.client.1.smithi093.stdout:5/904: creat d0/d7/d36/f12f x:0 0 0 2023-12-12T11:52:08.459 INFO:tasks.workunit.client.0.smithi063.stdout:4/748: mkdir d2/d17/df8 0 2023-12-12T11:52:08.459 INFO:tasks.workunit.client.0.smithi063.stdout:4/749: dread - d2/d47/f46 zero size 2023-12-12T11:52:08.462 INFO:tasks.workunit.client.0.smithi063.stdout:8/823: rmdir d4/de/d3b 39 2023-12-12T11:52:08.462 INFO:tasks.workunit.client.0.smithi063.stdout:8/824: stat d4/de/d3b/d62/d36/f3a 0 2023-12-12T11:52:08.463 INFO:tasks.workunit.client.0.smithi063.stdout:6/774: dread d9/d10/d5c/d5e/fd8 [0,4194304] 0 2023-12-12T11:52:08.483 INFO:tasks.workunit.client.0.smithi063.stdout:5/783: creat d7/d10/d2b/d3c/d42/ff0 x:0 0 0 2023-12-12T11:52:08.490 INFO:tasks.workunit.client.0.smithi063.stdout:7/640: link de/f4c de/d39/d4b/d7b/d7f/ff1 0 2023-12-12T11:52:08.490 INFO:tasks.workunit.client.0.smithi063.stdout:7/641: fsync de/d39/d4b/d7b/fbe 0 2023-12-12T11:52:08.490 INFO:tasks.workunit.client.0.smithi063.stdout:7/642: chown de/d33/d41/d44/d8b/lb3 13 1 2023-12-12T11:52:08.494 INFO:tasks.workunit.client.1.smithi093.stdout:3/991: sync 2023-12-12T11:52:08.496 INFO:tasks.workunit.client.0.smithi063.stdout:2/675: stat d0/d1a/d1e/l6a 0 2023-12-12T11:52:08.496 INFO:tasks.workunit.client.0.smithi063.stdout:2/676: write d0/d1a/d3a/d59/f8e [21507,21628] 0 2023-12-12T11:52:08.497 INFO:tasks.workunit.client.1.smithi093.stdout:3/992: symlink df/d22/d49/d69/d78/daf/d3d/d59/l143 0 2023-12-12T11:52:08.497 INFO:tasks.workunit.client.1.smithi093.stdout:3/993: read df/d22/d49/d69/d78/dad/fa9 [4065595,50711] 0 2023-12-12T11:52:08.502 INFO:tasks.workunit.client.0.smithi063.stdout:6/775: mknod d9/d10/d25/c10e 0 2023-12-12T11:52:08.502 INFO:tasks.workunit.client.0.smithi063.stdout:1/778: getdents d3/d3a/dd7/d16 0 2023-12-12T11:52:08.502 INFO:tasks.workunit.client.0.smithi063.stdout:5/784: mkdir d7/d28/df1 0 2023-12-12T11:52:08.502 INFO:tasks.workunit.client.0.smithi063.stdout:5/785: dread - d7/d10/f92 zero size 2023-12-12T11:52:08.502 INFO:tasks.workunit.client.0.smithi063.stdout:5/786: fdatasync d7/d10/d2b/d3c/d63/fc7 0 2023-12-12T11:52:08.502 INFO:tasks.workunit.client.0.smithi063.stdout:5/787: stat d7/d28/d67/lb5 0 2023-12-12T11:52:08.502 INFO:tasks.workunit.client.0.smithi063.stdout:7/643: creat de/d39/d4b/ff2 x:0 0 0 2023-12-12T11:52:08.503 INFO:tasks.workunit.client.1.smithi093.stdout:3/994: mknod df/d22/d49/d69/d78/daf/d3d/d42/d8e/c144 0 2023-12-12T11:52:08.503 INFO:tasks.workunit.client.1.smithi093.stdout:7/965: dwrite da/d8e/da9/f146 [0,4194304] 0 2023-12-12T11:52:08.503 INFO:tasks.workunit.client.1.smithi093.stdout:7/966: creat da/d15/d19/d4c/dc1/f151 x:0 0 0 2023-12-12T11:52:08.503 INFO:tasks.workunit.client.0.smithi063.stdout:2/677: symlink d0/d41/daf/ld4 0 2023-12-12T11:52:08.503 INFO:tasks.workunit.client.0.smithi063.stdout:2/678: chown d0/f6 6570 1 2023-12-12T11:52:08.503 INFO:tasks.workunit.client.0.smithi063.stdout:2/679: write d0/d1a/d3a/fb7 [298897,125095] 0 2023-12-12T11:52:08.504 INFO:tasks.workunit.client.0.smithi063.stdout:6/776: creat d9/d10/d2a/de7/f10f x:0 0 0 2023-12-12T11:52:08.504 INFO:tasks.workunit.client.0.smithi063.stdout:6/777: creat d9/d2c/d61/dcd/f110 x:0 0 0 2023-12-12T11:52:08.505 INFO:tasks.workunit.client.1.smithi093.stdout:5/905: dwrite d0/d7/d36/db9/d66/f7d [4194304,4194304] 0 2023-12-12T11:52:08.507 INFO:tasks.workunit.client.0.smithi063.stdout:1/779: mkdir d3/d3a/dd7/d16/d17/d104 0 2023-12-12T11:52:08.508 INFO:tasks.workunit.client.0.smithi063.stdout:1/780: getdents d3/d3a/dd7/d16 0 2023-12-12T11:52:08.508 INFO:tasks.workunit.client.0.smithi063.stdout:7/644: creat de/d34/d68/ff3 x:0 0 0 2023-12-12T11:52:08.508 INFO:tasks.workunit.client.0.smithi063.stdout:7/645: dread - de/d33/d71/fd9 zero size 2023-12-12T11:52:08.508 INFO:tasks.workunit.client.0.smithi063.stdout:4/750: dread d2/d47/d6d/f97 [0,4194304] 0 2023-12-12T11:52:08.508 INFO:tasks.workunit.client.0.smithi063.stdout:9/621: dwrite d7/d11/d94/fb7 [0,4194304] 0 2023-12-12T11:52:08.508 INFO:tasks.workunit.client.0.smithi063.stdout:4/751: write d2/d48/d69/fef [444624,19755] 0 2023-12-12T11:52:08.510 INFO:tasks.workunit.client.0.smithi063.stdout:6/778: getdents d9/de5 0 2023-12-12T11:52:08.518 INFO:tasks.workunit.client.0.smithi063.stdout:6/779: truncate d9/d2c/d61/fb3 1805347 0 2023-12-12T11:52:08.519 INFO:tasks.workunit.client.0.smithi063.stdout:9/622: rmdir d7/d20/d45/d46/d51/d64/d6f/dad 39 2023-12-12T11:52:08.520 INFO:tasks.workunit.client.0.smithi063.stdout:8/825: dwrite d4/d24/d38/d45/d5b/d92/fd4 [0,4194304] 0 2023-12-12T11:52:08.521 INFO:tasks.workunit.client.1.smithi093.stdout:5/906: getdents d0/d7/d59/d62 0 2023-12-12T11:52:08.523 INFO:tasks.workunit.client.0.smithi063.stdout:6/780: stat d9/d10/d5c/ce3 0 2023-12-12T11:52:08.524 INFO:tasks.workunit.client.0.smithi063.stdout:2/680: dread d0/d1a/d48/f30 [0,4194304] 0 2023-12-12T11:52:08.524 INFO:tasks.workunit.client.0.smithi063.stdout:2/681: chown d0/d1a/d1e/d64/dc7 0 1 2023-12-12T11:52:08.527 INFO:tasks.workunit.client.1.smithi093.stdout:3/995: write df/f2e [6973759,102527] 0 2023-12-12T11:52:08.527 INFO:tasks.workunit.client.1.smithi093.stdout:3/996: fdatasync df/d22/f89 0 2023-12-12T11:52:08.527 INFO:tasks.workunit.client.1.smithi093.stdout:3/997: chown df/d22/d49/d69/dfa/d112 1386 1 2023-12-12T11:52:08.527 INFO:tasks.workunit.client.1.smithi093.stdout:3/998: fdatasync df/d30/f135 0 2023-12-12T11:52:08.540 INFO:tasks.workunit.client.0.smithi063.stdout:9/623: getdents d7/d20/d45/d46/d51/d64/d6f/d85 0 2023-12-12T11:52:08.546 INFO:tasks.workunit.client.1.smithi093.stdout:3/999: rename df/d22/d49/d69/d78/dea/f13c to df/d22/d49/d69/d78/daf/d3d/d42/d8e/f145 0 2023-12-12T11:52:08.547 INFO:tasks.workunit.client.1.smithi093.stdout:7/967: dwrite da/f8a [0,4194304] 0 2023-12-12T11:52:08.548 INFO:tasks.workunit.client.0.smithi063.stdout:8/826: dread d4/d55/fa0 [0,4194304] 0 2023-12-12T11:52:08.550 INFO:tasks.workunit.client.1.smithi093.stdout:7/968: link da/c13 da/d8e/c152 0 2023-12-12T11:52:08.553 INFO:tasks.workunit.client.0.smithi063.stdout:6/781: link d9/d68/cd7 d9/d10/d5c/d5e/c111 0 2023-12-12T11:52:08.554 INFO:tasks.workunit.client.1.smithi093.stdout:7/969: write da/d8e/daf/f14b [659834,33683] 0 2023-12-12T11:52:08.554 INFO:tasks.workunit.client.1.smithi093.stdout:7/970: creat da/d15/d59/d80/f153 x:0 0 0 2023-12-12T11:52:08.555 INFO:tasks.workunit.client.0.smithi063.stdout:7/646: dread de/d33/d41/f7c [4194304,4194304] 0 2023-12-12T11:52:08.555 INFO:tasks.workunit.client.0.smithi063.stdout:6/782: mkdir d9/d2c/d112 0 2023-12-12T11:52:08.556 INFO:tasks.workunit.client.0.smithi063.stdout:9/624: write d7/d20/d3f/d40/d4e/f67 [557521,101517] 0 2023-12-12T11:52:08.557 INFO:tasks.workunit.client.0.smithi063.stdout:1/781: dwrite d3/d3a/dd7/d12/f49 [0,4194304] 0 2023-12-12T11:52:08.557 INFO:tasks.workunit.client.0.smithi063.stdout:1/782: read - d3/d3a/dd7/d16/d4f/da7/dca/f87 zero size 2023-12-12T11:52:08.559 INFO:tasks.workunit.client.1.smithi093.stdout:7/971: truncate da/de/f44 468068 0 2023-12-12T11:52:08.560 INFO:tasks.workunit.client.0.smithi063.stdout:7/647: rename de/l2c to de/d34/d43/d45/lf4 0 2023-12-12T11:52:08.560 INFO:tasks.workunit.client.0.smithi063.stdout:7/648: chown de/d33/dd2 2 1 2023-12-12T11:52:08.562 INFO:tasks.workunit.client.0.smithi063.stdout:1/783: rmdir d3/d3a/dd7/d16/d24/d48/d75/d83/d81 39 2023-12-12T11:52:08.563 INFO:tasks.workunit.client.0.smithi063.stdout:9/625: getdents d7/d15/dc4/d3e/dbb 0 2023-12-12T11:52:08.564 INFO:tasks.workunit.client.0.smithi063.stdout:1/784: stat d3/d3a/dd7/d16/lee 0 2023-12-12T11:52:08.570 INFO:tasks.workunit.client.0.smithi063.stdout:1/785: rmdir d3/d3a/dd7/d16/d17 39 2023-12-12T11:52:08.573 INFO:tasks.workunit.client.1.smithi093.stdout:7/972: dread da/d15/fec [0,4194304] 0 2023-12-12T11:52:08.574 INFO:tasks.workunit.client.0.smithi063.stdout:1/786: dread - d3/d3a/dd7/d16/d24/d48/d75/fd4 zero size 2023-12-12T11:52:08.574 INFO:tasks.workunit.client.0.smithi063.stdout:1/787: chown d3/d3a/dd7/d16/l43 11279585 1 2023-12-12T11:52:08.574 INFO:tasks.workunit.client.0.smithi063.stdout:1/788: stat d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2/d7e/f9d 0 2023-12-12T11:52:08.578 INFO:tasks.workunit.client.1.smithi093.stdout:7/973: creat da/de/d78/f154 x:0 0 0 2023-12-12T11:52:08.578 INFO:tasks.workunit.client.1.smithi093.stdout:7/974: write da/d8e/da9/d142/d14e/f109 [1011286,64724] 0 2023-12-12T11:52:08.578 INFO:tasks.workunit.client.1.smithi093.stdout:7/975: truncate da/d15/d59/d80/ffb 125587 0 2023-12-12T11:52:08.579 INFO:tasks.workunit.client.1.smithi093.stdout:5/907: write d0/d7/d36/db9/f63 [2849071,104609] 0 2023-12-12T11:52:08.579 INFO:tasks.workunit.client.1.smithi093.stdout:5/908: write d0/f109 [694366,9381] 0 2023-12-12T11:52:08.579 INFO:tasks.workunit.client.1.smithi093.stdout:5/909: fdatasync d0/d7/d8/d9e/d6a/fb3 0 2023-12-12T11:52:08.581 INFO:tasks.workunit.client.1.smithi093.stdout:7/976: mkdir da/de/d78/d155 0 2023-12-12T11:52:08.586 INFO:tasks.workunit.client.0.smithi063.stdout:8/827: dread d4/de/d3b/d62/d91/ffb [0,4194304] 0 2023-12-12T11:52:08.587 INFO:tasks.workunit.client.0.smithi063.stdout:3/676: sync 2023-12-12T11:52:08.589 INFO:tasks.workunit.client.0.smithi063.stdout:9/626: dread d7/d20/d3f/d40/f44 [0,4194304] 0 2023-12-12T11:52:08.590 INFO:tasks.workunit.client.1.smithi093.stdout:5/910: dread d0/d7/d36/d68/def/d123/fdb [0,4194304] 0 2023-12-12T11:52:08.595 INFO:tasks.workunit.client.1.smithi093.stdout:5/911: mkdir d0/d7/d36/db9/dca/d130 0 2023-12-12T11:52:08.596 INFO:tasks.workunit.client.0.smithi063.stdout:0/756: sync 2023-12-12T11:52:08.596 INFO:tasks.workunit.client.0.smithi063.stdout:4/752: dwrite d2/d47/fd8 [0,4194304] 0 2023-12-12T11:52:08.597 INFO:tasks.workunit.client.0.smithi063.stdout:4/753: dread - d2/d47/d6d/f9a zero size 2023-12-12T11:52:08.597 INFO:tasks.workunit.client.0.smithi063.stdout:4/754: dread - d2/d47/d6d/f8f zero size 2023-12-12T11:52:08.597 INFO:tasks.workunit.client.0.smithi063.stdout:8/828: mknod d4/de/d1e/d6d/c102 0 2023-12-12T11:52:08.597 INFO:tasks.workunit.client.0.smithi063.stdout:8/829: readlink d4/de/d3b/lf2 0 2023-12-12T11:52:08.597 INFO:tasks.workunit.client.1.smithi093.stdout:7/977: write da/d8e/da9/d142/d14e/f109 [75641,38482] 0 2023-12-12T11:52:08.597 INFO:tasks.workunit.client.1.smithi093.stdout:7/978: fdatasync da/d8e/da9/d142/d14e/d89/f110 0 2023-12-12T11:52:08.599 INFO:tasks.workunit.client.1.smithi093.stdout:5/912: mknod d0/d7/d59/de7/c131 0 2023-12-12T11:52:08.600 INFO:tasks.workunit.client.0.smithi063.stdout:4/755: mkdir d2/d48/df9 0 2023-12-12T11:52:08.601 INFO:tasks.workunit.client.0.smithi063.stdout:4/756: write d2/d17/d4e/fcf [875330,87206] 0 2023-12-12T11:52:08.601 INFO:tasks.workunit.client.0.smithi063.stdout:4/757: readlink d2/d47/d6d/lda 0 2023-12-12T11:52:08.601 INFO:tasks.workunit.client.0.smithi063.stdout:4/758: stat d2/fdc 0 2023-12-12T11:52:08.605 INFO:tasks.workunit.client.0.smithi063.stdout:2/682: dwrite d0/f20 [4194304,4194304] 0 2023-12-12T11:52:08.606 INFO:tasks.workunit.client.1.smithi093.stdout:5/913: link d0/c67 d0/d7/d36/d29/d76/c132 0 2023-12-12T11:52:08.607 INFO:tasks.workunit.client.1.smithi093.stdout:5/914: mknod d0/c133 0 2023-12-12T11:52:08.608 INFO:tasks.workunit.client.1.smithi093.stdout:5/915: write d0/dd2/ff5 [214441,44264] 0 2023-12-12T11:52:08.608 INFO:tasks.workunit.client.1.smithi093.stdout:5/916: creat d0/d7/d36/f134 x:0 0 0 2023-12-12T11:52:08.609 INFO:tasks.workunit.client.0.smithi063.stdout:4/759: mknod d2/d48/df9/cfa 0 2023-12-12T11:52:08.615 INFO:tasks.workunit.client.0.smithi063.stdout:3/677: write d4/df/d1a/d1c/d3b/d50/d61/f93 [37885,120671] 0 2023-12-12T11:52:08.617 INFO:tasks.workunit.client.0.smithi063.stdout:3/678: creat d4/df/d1a/d1c/fcd x:0 0 0 2023-12-12T11:52:08.617 INFO:tasks.workunit.client.0.smithi063.stdout:3/679: truncate d4/df/d1a/d1c/d3b/d52/d74/fa8 4846910 0 2023-12-12T11:52:08.619 INFO:tasks.workunit.client.0.smithi063.stdout:3/680: link d4/d23/d6b/cb8 d4/df/d1a/cce 0 2023-12-12T11:52:08.619 INFO:tasks.workunit.client.0.smithi063.stdout:3/681: fsync d4/f3f 0 2023-12-12T11:52:08.619 INFO:tasks.workunit.client.0.smithi063.stdout:3/682: symlink d4/lcf 0 2023-12-12T11:52:08.620 INFO:tasks.workunit.client.1.smithi093.stdout:5/917: write d0/d7/d85/fea [496919,27168] 0 2023-12-12T11:52:08.622 INFO:tasks.workunit.client.1.smithi093.stdout:5/918: unlink d0/d7/d8/de/dab/de5/c121 0 2023-12-12T11:52:08.623 INFO:tasks.workunit.client.1.smithi093.stdout:5/919: write d0/dd2/ff5 [21258,121277] 0 2023-12-12T11:52:08.625 INFO:tasks.workunit.client.1.smithi093.stdout:5/920: link d0/d7/d36/db9/d66/d7c/fd3 d0/dd2/f135 0 2023-12-12T11:52:08.627 INFO:tasks.workunit.client.0.smithi063.stdout:6/783: dwrite d9/f74 [0,4194304] 0 2023-12-12T11:52:08.631 INFO:tasks.workunit.client.1.smithi093.stdout:7/979: dwrite da/d8e/daf/f121 [0,4194304] 0 2023-12-12T11:52:08.635 INFO:tasks.workunit.client.0.smithi063.stdout:4/760: read d2/d17/d9d/fbc [842612,58454] 0 2023-12-12T11:52:08.635 INFO:tasks.workunit.client.0.smithi063.stdout:4/761: mknod d2/d48/df9/cfb 0 2023-12-12T11:52:08.635 INFO:tasks.workunit.client.1.smithi093.stdout:5/921: rmdir d0/d7/d36/db9/d66/d7c/db5/d10e 39 2023-12-12T11:52:08.635 INFO:tasks.workunit.client.1.smithi093.stdout:5/922: write d0/d7/d8/f8b [986768,103164] 0 2023-12-12T11:52:08.638 INFO:tasks.workunit.client.0.smithi063.stdout:1/789: dread d3/d3a/dd7/d16/d24/d48/d75/f86 [0,4194304] 0 2023-12-12T11:52:08.639 INFO:tasks.workunit.client.0.smithi063.stdout:7/649: dwrite de/d34/f55 [0,4194304] 0 2023-12-12T11:52:08.641 INFO:tasks.workunit.client.0.smithi063.stdout:3/683: read d4/df/d1a/d1c/d41/f51 [2001949,35562] 0 2023-12-12T11:52:08.645 INFO:tasks.workunit.client.1.smithi093.stdout:5/923: rename d0/d7/d59/c118 to d0/d7/d36/d68/def/c136 0 2023-12-12T11:52:08.645 INFO:tasks.workunit.client.1.smithi093.stdout:5/924: dread - d0/d7/d36/d87/f105 zero size 2023-12-12T11:52:08.645 INFO:tasks.workunit.client.1.smithi093.stdout:5/925: write d0/d7/d8/d9e/f78 [243574,18254] 0 2023-12-12T11:52:08.645 INFO:tasks.workunit.client.0.smithi063.stdout:6/784: write d9/d10/f15 [5018730,38562] 0 2023-12-12T11:52:08.646 INFO:tasks.workunit.client.0.smithi063.stdout:1/790: rmdir d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2 39 2023-12-12T11:52:08.646 INFO:tasks.workunit.client.1.smithi093.stdout:5/926: write d0/f109 [119811,104965] 0 2023-12-12T11:52:08.646 INFO:tasks.workunit.client.1.smithi093.stdout:5/927: write d0/d7/d36/d68/fe0 [857933,4147] 0 2023-12-12T11:52:08.646 INFO:tasks.workunit.client.1.smithi093.stdout:7/980: dread da/d15/d19/d90/d7d/f88 [8388608,4194304] 0 2023-12-12T11:52:08.651 INFO:tasks.workunit.client.0.smithi063.stdout:3/684: mknod d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/da1/cd0 0 2023-12-12T11:52:08.654 INFO:tasks.workunit.client.1.smithi093.stdout:5/928: rename d0/d7/d36/d68/def/d123/cde to d0/dec/c137 0 2023-12-12T11:52:08.654 INFO:tasks.workunit.client.1.smithi093.stdout:5/929: chown d0/d7/d36/db9/d66/d7c 3430 1 2023-12-12T11:52:08.659 INFO:tasks.workunit.client.1.smithi093.stdout:5/930: rename d0/f5 to d0/d7/d36/d29/f138 0 2023-12-12T11:52:08.659 INFO:tasks.workunit.client.1.smithi093.stdout:7/981: dread da/de/d46/d4f/f64 [0,4194304] 0 2023-12-12T11:52:08.659 INFO:tasks.workunit.client.1.smithi093.stdout:5/931: chown d0/d7/d36/fc4 3621 1 2023-12-12T11:52:08.668 INFO:tasks.workunit.client.1.smithi093.stdout:7/982: creat da/d8e/dbc/d14c/f156 x:0 0 0 2023-12-12T11:52:08.668 INFO:tasks.workunit.client.1.smithi093.stdout:7/983: chown da/d8e/da9/d142/d14e/d89/la3 114 1 2023-12-12T11:52:08.668 INFO:tasks.workunit.client.1.smithi093.stdout:7/984: chown da/d15/d2d/d2f/dc6/f108 1015904436 1 2023-12-12T11:52:08.669 INFO:tasks.workunit.client.1.smithi093.stdout:5/932: getdents d0/d7/d8/d10c 0 2023-12-12T11:52:08.671 INFO:tasks.workunit.client.1.smithi093.stdout:7/985: mkdir da/d15/d59/de0/d157 0 2023-12-12T11:52:08.672 INFO:tasks.workunit.client.1.smithi093.stdout:7/986: fsync da/de/d78/ffd 0 2023-12-12T11:52:08.675 INFO:tasks.workunit.client.1.smithi093.stdout:5/933: rename d0/dd2/f135 to d0/d7/d36/db9/dca/f139 0 2023-12-12T11:52:08.676 INFO:tasks.workunit.client.0.smithi063.stdout:8/830: dwrite d4/de/fb4 [0,4194304] 0 2023-12-12T11:52:08.676 INFO:tasks.workunit.client.0.smithi063.stdout:8/831: write d4/de/d3b/d62/d36/d57/f89 [796604,39526] 0 2023-12-12T11:52:08.676 INFO:tasks.workunit.client.0.smithi063.stdout:0/757: dwrite d0/d1a/d23/fe1 [0,4194304] 0 2023-12-12T11:52:08.681 INFO:tasks.workunit.client.1.smithi093.stdout:7/987: mkdir da/de/d46/d158 0 2023-12-12T11:52:08.682 INFO:tasks.workunit.client.0.smithi063.stdout:3/685: write d4/df/f19 [1882756,51206] 0 2023-12-12T11:52:08.691 INFO:tasks.workunit.client.0.smithi063.stdout:7/650: dwrite de/d39/d4b/d7b/d7f/ff1 [0,4194304] 0 2023-12-12T11:52:08.691 INFO:tasks.workunit.client.0.smithi063.stdout:7/651: chown de/d34/d43/c74 33531 1 2023-12-12T11:52:08.693 INFO:tasks.workunit.client.1.smithi093.stdout:7/988: rename da/de/lf to da/d15/d19/d90/d7d/d138/l159 0 2023-12-12T11:52:08.693 INFO:tasks.workunit.client.1.smithi093.stdout:5/934: write d0/d7/d59/d48/fc3 [1370032,126763] 0 2023-12-12T11:52:08.701 INFO:tasks.workunit.client.0.smithi063.stdout:0/758: link d0/d8e/lf0 d0/d8e/da7/dcf/de9/lfa 0 2023-12-12T11:52:08.701 INFO:tasks.workunit.client.0.smithi063.stdout:0/759: truncate d0/f65 951424 0 2023-12-12T11:52:08.701 INFO:tasks.workunit.client.0.smithi063.stdout:0/760: fdatasync d0/d1a/d66/fed 0 2023-12-12T11:52:08.701 INFO:tasks.workunit.client.0.smithi063.stdout:0/761: truncate d0/d1a/d66/fa4 730215 0 2023-12-12T11:52:08.706 INFO:tasks.workunit.client.1.smithi093.stdout:7/989: mkdir da/d15/d19/d90/d15a 0 2023-12-12T11:52:08.708 INFO:tasks.workunit.client.1.smithi093.stdout:5/935: dread d0/d7/d59/f2d [0,4194304] 0 2023-12-12T11:52:08.709 INFO:tasks.workunit.client.0.smithi063.stdout:3/686: creat d4/d23/d7b/fd1 x:0 0 0 2023-12-12T11:52:08.710 INFO:tasks.workunit.client.0.smithi063.stdout:6/785: dwrite d9/fc6 [0,4194304] 0 2023-12-12T11:52:08.715 INFO:tasks.workunit.client.0.smithi063.stdout:7/652: creat de/ff5 x:0 0 0 2023-12-12T11:52:08.717 INFO:tasks.workunit.client.1.smithi093.stdout:7/990: symlink da/de/l15b 0 2023-12-12T11:52:08.719 INFO:tasks.workunit.client.0.smithi063.stdout:0/762: truncate d0/d1a/d23/fbe 465268 0 2023-12-12T11:52:08.721 INFO:tasks.workunit.client.1.smithi093.stdout:7/991: link da/d15/d19/d90/d7d/fe9 da/d15/ddd/d131/f15c 0 2023-12-12T11:52:08.721 INFO:tasks.workunit.client.1.smithi093.stdout:7/992: write da/d15/d59/df0/ff6 [742040,81622] 0 2023-12-12T11:52:08.723 INFO:tasks.workunit.client.0.smithi063.stdout:3/687: mknod d4/df/d1a/d1c/d3b/d52/d78/dbb/cd2 0 2023-12-12T11:52:08.725 INFO:tasks.workunit.client.0.smithi063.stdout:7/653: symlink de/d34/d68/da1/lf6 0 2023-12-12T11:52:08.725 INFO:tasks.workunit.client.0.smithi063.stdout:7/654: chown de/d34/d68/da1/dcd 0 1 2023-12-12T11:52:08.725 INFO:tasks.workunit.client.0.smithi063.stdout:7/655: write de/d39/d4b/f70 [3415972,47223] 0 2023-12-12T11:52:08.728 INFO:tasks.workunit.client.0.smithi063.stdout:3/688: unlink d4/df/d1a/c91 0 2023-12-12T11:52:08.728 INFO:tasks.workunit.client.0.smithi063.stdout:3/689: dread - d4/df/d1a/d1c/d41/f99 zero size 2023-12-12T11:52:08.729 INFO:tasks.workunit.client.0.smithi063.stdout:3/690: creat d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/fd3 x:0 0 0 2023-12-12T11:52:08.730 INFO:tasks.workunit.client.0.smithi063.stdout:7/656: rename de/d34/d68/da1/dcd/lf0 to de/d34/lf7 0 2023-12-12T11:52:08.730 INFO:tasks.workunit.client.0.smithi063.stdout:7/657: write de/d39/d60/f95 [4784780,103442] 0 2023-12-12T11:52:08.730 INFO:tasks.workunit.client.0.smithi063.stdout:7/658: fdatasync de/d34/f55 0 2023-12-12T11:52:08.730 INFO:tasks.workunit.client.0.smithi063.stdout:7/659: fdatasync de/d39/d4b/d7b/fbe 0 2023-12-12T11:52:08.731 INFO:tasks.workunit.client.1.smithi093.stdout:5/936: dread d0/d7/d36/d29/f9d [0,4194304] 0 2023-12-12T11:52:08.732 INFO:tasks.workunit.client.0.smithi063.stdout:7/660: mkdir de/d33/d41/d44/d8b/dde/df8 0 2023-12-12T11:52:08.734 INFO:tasks.workunit.client.0.smithi063.stdout:1/791: dwrite d3/d3a/dd7/d16/d4f/d9a/fab [0,4194304] 0 2023-12-12T11:52:08.734 INFO:tasks.workunit.client.0.smithi063.stdout:1/792: chown d3/d3a/dd7/d16/d17/d4b/d8c/dd9 248179 1 2023-12-12T11:52:08.734 INFO:tasks.workunit.client.0.smithi063.stdout:1/793: write d3/d3a/dd7/d16/d4f/da7/dca/d6f/fd3 [990768,80920] 0 2023-12-12T11:52:08.735 INFO:tasks.workunit.client.1.smithi093.stdout:5/937: mknod d0/dd2/d122/c13a 0 2023-12-12T11:52:08.735 INFO:tasks.workunit.client.1.smithi093.stdout:7/993: dread da/d8e/da9/f146 [0,4194304] 0 2023-12-12T11:52:08.735 INFO:tasks.workunit.client.1.smithi093.stdout:7/994: chown da/de/d46/d4f/f56 65036757 1 2023-12-12T11:52:08.737 INFO:tasks.workunit.client.0.smithi063.stdout:7/661: link l7 de/dc8/lf9 0 2023-12-12T11:52:08.739 INFO:tasks.workunit.client.0.smithi063.stdout:1/794: creat d3/f105 x:0 0 0 2023-12-12T11:52:08.739 INFO:tasks.workunit.client.0.smithi063.stdout:1/795: readlink d3/d3a/dd7/d16/d24/d4d/d35/l6e 0 2023-12-12T11:52:08.739 INFO:tasks.workunit.client.1.smithi093.stdout:5/938: dread d0/d7/d36/db9/d66/d7c/fd3 [0,4194304] 0 2023-12-12T11:52:08.740 INFO:tasks.workunit.client.1.smithi093.stdout:5/939: creat d0/d7/d36/d68/def/d123/f13b x:0 0 0 2023-12-12T11:52:08.741 INFO:tasks.workunit.client.0.smithi063.stdout:1/796: dread - d3/d3a/dd7/d16/d4f/da7/dca/f5f zero size 2023-12-12T11:52:08.742 INFO:tasks.workunit.client.0.smithi063.stdout:1/797: chown d3/d3a/dd7/d16/d24/d4d/d35/d98/fb5 1934876686 1 2023-12-12T11:52:08.742 INFO:tasks.workunit.client.0.smithi063.stdout:1/798: truncate d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2/fe9 943662 0 2023-12-12T11:52:08.742 INFO:tasks.workunit.client.0.smithi063.stdout:0/763: write d0/d1a/d23/ff6 [183616,53247] 0 2023-12-12T11:52:08.742 INFO:tasks.workunit.client.0.smithi063.stdout:0/764: truncate d0/d1a/d23/d34/d42/f73 932188 0 2023-12-12T11:52:08.742 INFO:tasks.workunit.client.0.smithi063.stdout:8/832: dwrite d4/f22 [0,4194304] 0 2023-12-12T11:52:08.745 INFO:tasks.workunit.client.1.smithi093.stdout:7/995: symlink da/d15/d19/d4c/l15d 0 2023-12-12T11:52:08.745 INFO:tasks.workunit.client.1.smithi093.stdout:7/996: creat da/d15/ddd/d131/f15e x:0 0 0 2023-12-12T11:52:08.747 INFO:tasks.workunit.client.0.smithi063.stdout:1/799: dread d3/d3a/dd7/d16/d24/d48/d75/d83/d5b/d6b/f72 [0,4194304] 0 2023-12-12T11:52:08.750 INFO:tasks.workunit.client.0.smithi063.stdout:3/691: dread d4/df/d1a/d1c/d3b/d50/d61/f93 [0,4194304] 0 2023-12-12T11:52:08.750 INFO:tasks.workunit.client.0.smithi063.stdout:0/765: mkdir d0/d1a/d66/dfb 0 2023-12-12T11:52:08.751 INFO:tasks.workunit.client.0.smithi063.stdout:1/800: mkdir d3/d3a/dd7/d16/d24/d48/d75/d83/d5b/d106 0 2023-12-12T11:52:08.752 INFO:tasks.workunit.client.1.smithi093.stdout:5/940: write d0/d7/d36/db9/d66/f7d [5680270,85511] 0 2023-12-12T11:52:08.755 INFO:tasks.workunit.client.0.smithi063.stdout:3/692: creat d4/df/d1a/d1c/d57/fd4 x:0 0 0 2023-12-12T11:52:08.755 INFO:tasks.workunit.client.0.smithi063.stdout:3/693: write d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/fd3 [667602,81610] 0 2023-12-12T11:52:08.756 INFO:tasks.workunit.client.1.smithi093.stdout:5/941: mkdir d0/d7/d36/db9/dca/d130/d13c 0 2023-12-12T11:52:08.760 INFO:tasks.workunit.client.0.smithi063.stdout:6/786: dwrite d9/d68/d94/ff9 [0,4194304] 0 2023-12-12T11:52:08.760 INFO:tasks.workunit.client.0.smithi063.stdout:6/787: chown d9/d68/d8f 578 1 2023-12-12T11:52:08.767 INFO:tasks.workunit.client.1.smithi093.stdout:5/942: mknod d0/d7/d36/db9/d66/c13d 0 2023-12-12T11:52:08.767 INFO:tasks.workunit.client.1.smithi093.stdout:5/943: write d0/d7/d36/d87/f107 [1151112,128263] 0 2023-12-12T11:52:08.767 INFO:tasks.workunit.client.1.smithi093.stdout:5/944: chown d0/d7/d8/c70 6235905 1 2023-12-12T11:52:08.767 INFO:tasks.workunit.client.1.smithi093.stdout:5/945: creat d0/d7/d36/db9/dca/f13e x:0 0 0 2023-12-12T11:52:08.768 INFO:tasks.workunit.client.1.smithi093.stdout:7/997: write da/d15/d59/fe5 [4053882,42586] 0 2023-12-12T11:52:08.772 INFO:tasks.workunit.client.0.smithi063.stdout:6/788: symlink d9/d10/d2a/de7/d86/dc2/l113 0 2023-12-12T11:52:08.778 INFO:tasks.workunit.client.1.smithi093.stdout:7/998: mknod da/d15/d19/d90/d15a/c15f 0 2023-12-12T11:52:08.780 INFO:tasks.workunit.client.0.smithi063.stdout:6/789: rename d9/d10/d5c/c83 to d9/d68/de4/c114 0 2023-12-12T11:52:08.780 INFO:tasks.workunit.client.0.smithi063.stdout:6/790: chown d9/d2c/d61/f97 11423106 1 2023-12-12T11:52:08.780 INFO:tasks.workunit.client.0.smithi063.stdout:6/791: stat d9/l4e 0 2023-12-12T11:52:08.781 INFO:tasks.workunit.client.0.smithi063.stdout:6/792: chown d9/d10/d2a/la3 5426045 1 2023-12-12T11:52:08.814 INFO:tasks.workunit.client.1.smithi093.stdout:7/999: dread da/d8e/da9/d142/d14e/f79 [0,4194304] 0 2023-12-12T11:52:08.827 INFO:tasks.workunit.client.0.smithi063.stdout:1/801: dwrite d3/f56 [0,4194304] 0 2023-12-12T11:52:08.832 INFO:tasks.workunit.client.0.smithi063.stdout:3/694: dwrite d4/df/d1a/f5e [0,4194304] 0 2023-12-12T11:52:08.832 INFO:tasks.workunit.client.0.smithi063.stdout:3/695: stat d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/fbd 0 2023-12-12T11:52:08.833 INFO:tasks.workunit.client.0.smithi063.stdout:8/833: dwrite d4/d55/d52/d8e/fc1 [0,4194304] 0 2023-12-12T11:52:08.834 INFO:tasks.workunit.client.0.smithi063.stdout:1/802: mkdir d3/d3a/dd7/d12/d107 0 2023-12-12T11:52:08.834 INFO:tasks.workunit.client.0.smithi063.stdout:1/803: dread - d3/d3a/dd7/d16/d4f/d9a/fba zero size 2023-12-12T11:52:08.834 INFO:tasks.workunit.client.0.smithi063.stdout:1/804: fsync d3/d3a/dd7/d16/d24/d4d/f2c 0 2023-12-12T11:52:08.845 INFO:tasks.workunit.client.0.smithi063.stdout:0/766: dread d0/d1a/d23/fbe [0,4194304] 0 2023-12-12T11:52:08.845 INFO:tasks.workunit.client.0.smithi063.stdout:0/767: readlink d0/d1a/l37 0 2023-12-12T11:52:08.863 INFO:tasks.workunit.client.0.smithi063.stdout:8/834: creat d4/d24/d38/f103 x:0 0 0 2023-12-12T11:52:08.864 INFO:tasks.workunit.client.0.smithi063.stdout:8/835: write d4/de/d3b/d62/d36/d57/d84/fee [4464077,73768] 0 2023-12-12T11:52:08.864 INFO:tasks.workunit.client.0.smithi063.stdout:8/836: stat d4/de/d11/f18 0 2023-12-12T11:52:08.864 INFO:tasks.workunit.client.0.smithi063.stdout:1/805: creat d3/d3a/dd7/d16/d17/d4b/f108 x:0 0 0 2023-12-12T11:52:08.865 INFO:tasks.workunit.client.0.smithi063.stdout:1/806: fdatasync d3/d3a/dd7/d16/d24/d48/d75/ff1 0 2023-12-12T11:52:08.867 INFO:tasks.workunit.client.0.smithi063.stdout:0/768: creat d0/d1a/d23/d2e/ffc x:0 0 0 2023-12-12T11:52:08.868 INFO:tasks.workunit.client.0.smithi063.stdout:3/696: dread d4/d23/f49 [0,4194304] 0 2023-12-12T11:52:08.868 INFO:tasks.workunit.client.0.smithi063.stdout:3/697: chown d4/df/d1a/d1c/d3b/d50/d9f 12922041 1 2023-12-12T11:52:08.871 INFO:tasks.workunit.client.0.smithi063.stdout:8/837: rename d4/d55/cde to d4/d24/db3/c104 0 2023-12-12T11:52:08.881 INFO:tasks.workunit.client.0.smithi063.stdout:1/807: symlink d3/d3a/d52/ddf/l109 0 2023-12-12T11:52:08.881 INFO:tasks.workunit.client.0.smithi063.stdout:0/769: mkdir d0/d1a/d23/dfd 0 2023-12-12T11:52:08.886 INFO:tasks.workunit.client.0.smithi063.stdout:7/662: dwrite de/d39/d4b/f70 [0,4194304] 0 2023-12-12T11:52:08.887 INFO:tasks.workunit.client.0.smithi063.stdout:1/808: link d3/d3a/dd7/d12/fb3 d3/d3a/dd7/d16/d24/d30/f10a 0 2023-12-12T11:52:08.897 INFO:tasks.workunit.client.0.smithi063.stdout:7/663: mknod de/d39/d88/db4/cfa 0 2023-12-12T11:52:08.900 INFO:tasks.workunit.client.0.smithi063.stdout:1/809: getdents d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2/d7e 0 2023-12-12T11:52:08.900 INFO:tasks.workunit.client.0.smithi063.stdout:1/810: stat d3/d3a/dd7/d16/d24/d48/d75/d83/d5b/lc1 0 2023-12-12T11:52:08.906 INFO:tasks.workunit.client.0.smithi063.stdout:0/770: creat d0/d7/d27/d1f/dc4/ffe x:0 0 0 2023-12-12T11:52:08.906 INFO:tasks.workunit.client.0.smithi063.stdout:0/771: fsync d0/d1a/d23/d34/d42/d99/fbf 0 2023-12-12T11:52:08.910 INFO:tasks.workunit.client.1.smithi093.stdout:5/946: sync 2023-12-12T11:52:08.910 INFO:tasks.workunit.client.1.smithi093.stdout:5/947: write d0/d7/d59/d48/f89 [556469,75611] 0 2023-12-12T11:52:08.912 INFO:tasks.workunit.client.0.smithi063.stdout:7/664: unlink de/d22/d6e/d8a/da3/f5d 0 2023-12-12T11:52:08.915 INFO:tasks.workunit.client.0.smithi063.stdout:0/772: unlink d0/d1a/d23/l2a 0 2023-12-12T11:52:08.916 INFO:tasks.workunit.client.1.smithi093.stdout:5/948: link d0/d7/d8/de/l10a d0/d7/d36/db9/d66/l13f 0 2023-12-12T11:52:08.918 INFO:tasks.workunit.client.0.smithi063.stdout:0/773: creat d0/d1a/fff x:0 0 0 2023-12-12T11:52:08.918 INFO:tasks.workunit.client.0.smithi063.stdout:0/774: creat d0/d1a/d23/d2e/f100 x:0 0 0 2023-12-12T11:52:08.919 INFO:tasks.workunit.client.0.smithi063.stdout:7/665: getdents de/d39/d60/da4 0 2023-12-12T11:52:08.924 INFO:tasks.workunit.client.0.smithi063.stdout:0/775: rename d0/d7/d27/d1f/dc4/d67/lac to d0/d8e/l101 0 2023-12-12T11:52:08.924 INFO:tasks.workunit.client.0.smithi063.stdout:0/776: write d0/d7/d27/d19/f86 [509905,23835] 0 2023-12-12T11:52:08.924 INFO:tasks.workunit.client.0.smithi063.stdout:1/811: dread d3/d3a/dd7/fd [0,4194304] 0 2023-12-12T11:52:08.925 INFO:tasks.workunit.client.0.smithi063.stdout:1/812: chown d3/d3a/dd7/d16/d4f/da7/dca/f5f 230 1 2023-12-12T11:52:08.925 INFO:tasks.workunit.client.0.smithi063.stdout:1/813: creat d3/d3a/d52/f10b x:0 0 0 2023-12-12T11:52:08.925 INFO:tasks.workunit.client.0.smithi063.stdout:1/814: stat d3/d3a/dd7/d16/d24/f78 0 2023-12-12T11:52:08.925 INFO:tasks.workunit.client.1.smithi093.stdout:5/949: dread d0/f109 [0,4194304] 0 2023-12-12T11:52:08.927 INFO:tasks.workunit.client.0.smithi063.stdout:0/777: symlink d0/l102 0 2023-12-12T11:52:08.928 INFO:tasks.workunit.client.0.smithi063.stdout:7/666: dread de/f21 [0,4194304] 0 2023-12-12T11:52:08.933 INFO:tasks.workunit.client.0.smithi063.stdout:3/698: dread d4/f25 [0,4194304] 0 2023-12-12T11:52:08.933 INFO:tasks.workunit.client.0.smithi063.stdout:3/699: fdatasync d4/df/d1a/d1c/d41/f84 0 2023-12-12T11:52:08.933 INFO:tasks.workunit.client.0.smithi063.stdout:6/793: dwrite d9/d2c/d61/fb3 [0,4194304] 0 2023-12-12T11:52:08.934 INFO:tasks.workunit.client.0.smithi063.stdout:0/778: link d0/d1a/d23/d34/d42/d99/lc8 d0/d1a/d23/dfd/l103 0 2023-12-12T11:52:08.937 INFO:tasks.workunit.client.0.smithi063.stdout:7/667: mkdir de/d3f/dc3/dfb 0 2023-12-12T11:52:08.943 INFO:tasks.workunit.client.0.smithi063.stdout:6/794: mkdir d9/d68/d8f/d115 0 2023-12-12T11:52:08.947 INFO:tasks.workunit.client.1.smithi093.stdout:5/950: dread d0/d7/d36/d68/ff3 [0,4194304] 0 2023-12-12T11:52:08.948 INFO:tasks.workunit.client.1.smithi093.stdout:5/951: read - d0/d7/d36/db9/d66/d7c/db5/ff9 zero size 2023-12-12T11:52:08.948 INFO:tasks.workunit.client.0.smithi063.stdout:7/668: creat de/d33/dd2/ffc x:0 0 0 2023-12-12T11:52:08.951 INFO:tasks.workunit.client.0.smithi063.stdout:6/795: creat d9/d10/d2a/de7/f116 x:0 0 0 2023-12-12T11:52:08.953 INFO:tasks.workunit.client.1.smithi093.stdout:5/952: truncate d0/d7/d8/d9e/f31 871515 0 2023-12-12T11:52:08.953 INFO:tasks.workunit.client.1.smithi093.stdout:5/953: chown d0/d7/d8/c2c 2120676154 1 2023-12-12T11:52:08.953 INFO:tasks.workunit.client.1.smithi093.stdout:5/954: chown d0/d7/d59/d48/f89 1858749 1 2023-12-12T11:52:08.955 INFO:tasks.workunit.client.0.smithi063.stdout:0/779: symlink d0/d7/d27/d44/l104 0 2023-12-12T11:52:08.957 INFO:tasks.workunit.client.0.smithi063.stdout:7/669: symlink de/d39/d4b/d7b/d7f/lfd 0 2023-12-12T11:52:08.961 INFO:tasks.workunit.client.0.smithi063.stdout:4/762: sync 2023-12-12T11:52:08.961 INFO:tasks.workunit.client.0.smithi063.stdout:5/788: sync 2023-12-12T11:52:08.961 INFO:tasks.workunit.client.0.smithi063.stdout:9/627: sync 2023-12-12T11:52:08.961 INFO:tasks.workunit.client.0.smithi063.stdout:2/683: sync 2023-12-12T11:52:08.961 INFO:tasks.workunit.client.0.smithi063.stdout:4/763: write d2/d48/d69/f82 [203005,128743] 0 2023-12-12T11:52:08.961 INFO:tasks.workunit.client.0.smithi063.stdout:4/764: fsync d2/d47/d6d/d88/df0/fbb 0 2023-12-12T11:52:08.964 INFO:tasks.workunit.client.0.smithi063.stdout:6/796: link d9/d10/d2a/de7/d86/dc2/lec d9/d2c/d61/l117 0 2023-12-12T11:52:08.965 INFO:tasks.workunit.client.1.smithi093.stdout:5/955: getdents d0/dec 0 2023-12-12T11:52:08.968 INFO:tasks.workunit.client.1.smithi093.stdout:5/956: truncate d0/d7/d59/f60 4263645 0 2023-12-12T11:52:08.970 INFO:tasks.workunit.client.0.smithi063.stdout:0/780: unlink d0/d1a/d23/d34/d42/fe2 0 2023-12-12T11:52:08.970 INFO:tasks.workunit.client.0.smithi063.stdout:0/781: stat d0/d1a/d23/ff6 0 2023-12-12T11:52:08.970 INFO:tasks.workunit.client.0.smithi063.stdout:0/782: write d0/d1a/d23/d2e/f64 [622129,71244] 0 2023-12-12T11:52:08.970 INFO:tasks.workunit.client.0.smithi063.stdout:0/783: write d0/d7/d27/d44/f85 [3187597,94952] 0 2023-12-12T11:52:08.970 INFO:tasks.workunit.client.0.smithi063.stdout:0/784: fsync d0/d1a/d23/d2e/fe5 0 2023-12-12T11:52:08.972 INFO:tasks.workunit.client.0.smithi063.stdout:7/670: mkdir de/d33/dd2/d4a/dfe 0 2023-12-12T11:52:08.972 INFO:tasks.workunit.client.0.smithi063.stdout:7/671: chown de/d39/d60 8698 1 2023-12-12T11:52:08.973 INFO:tasks.workunit.client.0.smithi063.stdout:2/684: unlink d0/d1a/d26/f7b 0 2023-12-12T11:52:08.973 INFO:tasks.workunit.client.0.smithi063.stdout:2/685: dread - d0/d1a/d3a/d85/da6/fb5 zero size 2023-12-12T11:52:08.978 INFO:tasks.workunit.client.0.smithi063.stdout:5/789: truncate d7/d28/d6e/f7c 2849748 0 2023-12-12T11:52:08.986 INFO:tasks.workunit.client.0.smithi063.stdout:6/797: mkdir d9/d10/d2a/de7/d86/dc2/ded/df5/d118 0 2023-12-12T11:52:08.986 INFO:tasks.workunit.client.0.smithi063.stdout:6/798: chown d9/d10/d2a/de7/f116 55558 1 2023-12-12T11:52:08.988 INFO:tasks.workunit.client.0.smithi063.stdout:7/672: unlink de/d22/d6e/d8a/da3/ldf 0 2023-12-12T11:52:08.998 INFO:tasks.workunit.client.0.smithi063.stdout:6/799: rmdir d9/d68/d8f 39 2023-12-12T11:52:09.002 INFO:tasks.workunit.client.0.smithi063.stdout:7/673: dread de/d3f/f72 [0,4194304] 0 2023-12-12T11:52:09.006 INFO:tasks.workunit.client.0.smithi063.stdout:1/815: dwrite d3/fb1 [4194304,4194304] 0 2023-12-12T11:52:09.013 INFO:tasks.workunit.client.0.smithi063.stdout:7/674: rename de/d22/d66/f6c to de/d34/d43/fff 0 2023-12-12T11:52:09.015 INFO:tasks.workunit.client.0.smithi063.stdout:2/686: dread d0/f17 [0,4194304] 0 2023-12-12T11:52:09.019 INFO:tasks.workunit.client.0.smithi063.stdout:8/838: dwrite d4/de/d3b/d62/d36/dc5/f100 [0,4194304] 0 2023-12-12T11:52:09.019 INFO:tasks.workunit.client.0.smithi063.stdout:8/839: write d4/d24/d38/dd8/ffe [477528,27522] 0 2023-12-12T11:52:09.019 INFO:tasks.workunit.client.0.smithi063.stdout:8/840: creat d4/de/d11/f105 x:0 0 0 2023-12-12T11:52:09.022 INFO:tasks.workunit.client.0.smithi063.stdout:7/675: creat de/d33/d41/d44/d8b/dde/de6/f100 x:0 0 0 2023-12-12T11:52:09.022 INFO:tasks.workunit.client.0.smithi063.stdout:7/676: chown de/d34/d43/d45 6649 1 2023-12-12T11:52:09.025 INFO:tasks.workunit.client.0.smithi063.stdout:6/800: dread d9/d10/d2a/de7/d8a/f9a [0,4194304] 0 2023-12-12T11:52:09.027 INFO:tasks.workunit.client.0.smithi063.stdout:2/687: rename d0/d41/dcc to d0/d1a/d3a/d85/dd5 0 2023-12-12T11:52:09.027 INFO:tasks.workunit.client.0.smithi063.stdout:2/688: write d0/d1a/d3a/d85/da6/fd0 [756501,50192] 0 2023-12-12T11:52:09.031 INFO:tasks.workunit.client.0.smithi063.stdout:7/677: truncate de/d34/d43/d45/f7d 3489093 0 2023-12-12T11:52:09.033 INFO:tasks.workunit.client.0.smithi063.stdout:3/700: dwrite d4/df/d1a/d1c/d57/fd4 [0,4194304] 0 2023-12-12T11:52:09.033 INFO:tasks.workunit.client.0.smithi063.stdout:3/701: fdatasync d4/f2a 0 2023-12-12T11:52:09.034 INFO:tasks.workunit.client.0.smithi063.stdout:3/702: chown d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/da1/fa2 4581691 1 2023-12-12T11:52:09.035 INFO:tasks.workunit.client.0.smithi063.stdout:6/801: symlink d9/d10/dfc/l119 0 2023-12-12T11:52:09.038 INFO:tasks.workunit.client.0.smithi063.stdout:2/689: mknod d0/d1a/d3a/d59/cd6 0 2023-12-12T11:52:09.039 INFO:tasks.workunit.client.0.smithi063.stdout:3/703: creat d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/dac/fd5 x:0 0 0 2023-12-12T11:52:09.041 INFO:tasks.workunit.client.0.smithi063.stdout:2/690: rename d0/d41/c5a to d0/d1a/d3a/d85/da6/cd7 0 2023-12-12T11:52:09.043 INFO:tasks.workunit.client.0.smithi063.stdout:3/704: mknod d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/dac/cd6 0 2023-12-12T11:52:09.043 INFO:tasks.workunit.client.0.smithi063.stdout:3/705: dread - d4/df/d1a/d1c/d3b/d52/d78/dbb/fc4 zero size 2023-12-12T11:52:09.044 INFO:tasks.workunit.client.0.smithi063.stdout:2/691: mkdir d0/d1a/d3a/d85/da6/dd8 0 2023-12-12T11:52:09.045 INFO:tasks.workunit.client.0.smithi063.stdout:5/790: dwrite d7/fb0 [0,4194304] 0 2023-12-12T11:52:09.045 INFO:tasks.workunit.client.0.smithi063.stdout:5/791: readlink d7/d10/d2b/d3c/d27/lc0 0 2023-12-12T11:52:09.049 INFO:tasks.workunit.client.0.smithi063.stdout:4/765: dwrite d2/d47/d6d/d88/df0/fbb [0,4194304] 0 2023-12-12T11:52:09.049 INFO:tasks.workunit.client.0.smithi063.stdout:3/706: creat d4/df/d1a/d1c/d3b/d52/d78/da5/d98/fd7 x:0 0 0 2023-12-12T11:52:09.049 INFO:tasks.workunit.client.0.smithi063.stdout:4/766: write d2/d47/d6d/d88/df0/fcd [4354796,75198] 0 2023-12-12T11:52:09.049 INFO:tasks.workunit.client.0.smithi063.stdout:3/707: read - d4/d23/d7b/dc2/fcc zero size 2023-12-12T11:52:09.054 INFO:tasks.workunit.client.0.smithi063.stdout:2/692: link d0/d1a/d3a/d59/fb0 d0/d1a/d3a/fd9 0 2023-12-12T11:52:09.059 INFO:tasks.workunit.client.0.smithi063.stdout:5/792: mkdir d7/d10/d2b/d3c/d42/d76/df2 0 2023-12-12T11:52:09.060 INFO:tasks.workunit.client.0.smithi063.stdout:4/767: rename d2/d47/daa/fb0 to d2/d17/d41/ffc 0 2023-12-12T11:52:09.063 INFO:tasks.workunit.client.0.smithi063.stdout:3/708: symlink d4/d23/d6b/ld8 0 2023-12-12T11:52:09.063 INFO:tasks.workunit.client.0.smithi063.stdout:3/709: write d4/df/d1a/d1c/d3b/d52/d78/da5/d98/fd7 [344652,91234] 0 2023-12-12T11:52:09.064 INFO:tasks.workunit.client.1.smithi093.stdout:5/957: sync 2023-12-12T11:52:09.069 INFO:tasks.workunit.client.0.smithi063.stdout:3/710: rename d4/df/d1a/d1c/c21 to d4/df/d1a/d1c/cd9 0 2023-12-12T11:52:09.070 INFO:tasks.workunit.client.0.smithi063.stdout:3/711: truncate d4/df/d1a/d1c/d3b/d50/f8f 5461048 0 2023-12-12T11:52:09.070 INFO:tasks.workunit.client.0.smithi063.stdout:3/712: chown d4/df/d1a/f2e 79875 1 2023-12-12T11:52:09.073 INFO:tasks.workunit.client.0.smithi063.stdout:3/713: truncate d4/df/d1a/d1c/d3b/f5b 3338759 0 2023-12-12T11:52:09.073 INFO:tasks.workunit.client.0.smithi063.stdout:3/714: dread - d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/dac/fd5 zero size 2023-12-12T11:52:09.073 INFO:tasks.workunit.client.0.smithi063.stdout:3/715: chown d4/df/d1a/d1c/d3b/d50/d61/f93 32609 1 2023-12-12T11:52:09.076 INFO:tasks.workunit.client.0.smithi063.stdout:3/716: mkdir d4/d23/d6b/dda 0 2023-12-12T11:52:09.078 INFO:tasks.workunit.client.0.smithi063.stdout:3/717: truncate d4/df/d1a/d1c/f28 540388 0 2023-12-12T11:52:09.080 INFO:tasks.workunit.client.1.smithi093.stdout:5/958: write d0/d7/d36/d29/f12a [6896079,93592] 0 2023-12-12T11:52:09.081 INFO:tasks.workunit.client.1.smithi093.stdout:5/959: creat d0/d7/d36/f140 x:0 0 0 2023-12-12T11:52:09.081 INFO:tasks.workunit.client.0.smithi063.stdout:0/785: dwrite d0/d1a/d23/d34/ff5 [0,4194304] 0 2023-12-12T11:52:09.083 INFO:tasks.workunit.client.1.smithi093.stdout:5/960: link d0/d7/d36/d38/lba d0/d7/d36/db9/dca/d130/d13c/l141 0 2023-12-12T11:52:09.083 INFO:tasks.workunit.client.1.smithi093.stdout:5/961: dread - d0/d7/d36/d68/f11d zero size 2023-12-12T11:52:09.090 INFO:tasks.workunit.client.0.smithi063.stdout:3/718: mknod d4/df/d1a/d1c/d3b/d50/d61/cdb 0 2023-12-12T11:52:09.100 INFO:tasks.workunit.client.0.smithi063.stdout:7/678: dread de/f3c [0,4194304] 0 2023-12-12T11:52:09.100 INFO:tasks.workunit.client.0.smithi063.stdout:7/679: creat de/d33/d41/d44/d8b/f101 x:0 0 0 2023-12-12T11:52:09.118 INFO:tasks.workunit.client.0.smithi063.stdout:2/693: dread d0/d1a/d1e/f2e [4194304,4194304] 0 2023-12-12T11:52:09.119 INFO:tasks.workunit.client.0.smithi063.stdout:7/680: dread de/d3f/f6d [0,4194304] 0 2023-12-12T11:52:09.119 INFO:tasks.workunit.client.0.smithi063.stdout:7/681: dread - de/d33/dd2/f2f zero size 2023-12-12T11:52:09.119 INFO:tasks.workunit.client.0.smithi063.stdout:7/682: dread - de/d33/d71/fd9 zero size 2023-12-12T11:52:09.122 INFO:tasks.workunit.client.0.smithi063.stdout:5/793: dwrite d7/d10/d2b/d3c/d42/f96 [0,4194304] 0 2023-12-12T11:52:09.122 INFO:tasks.workunit.client.0.smithi063.stdout:5/794: chown d7/c22 215817313 1 2023-12-12T11:52:09.122 INFO:tasks.workunit.client.0.smithi063.stdout:5/795: write d7/d28/d94/f9f [712257,91398] 0 2023-12-12T11:52:09.122 INFO:tasks.workunit.client.0.smithi063.stdout:5/796: fdatasync d7/d10/d2b/d3c/d63/f7a 0 2023-12-12T11:52:09.123 INFO:tasks.workunit.client.0.smithi063.stdout:5/797: write d7/d10/d2b/d3c/d63/f7a [1088331,46187] 0 2023-12-12T11:52:09.132 INFO:tasks.workunit.client.0.smithi063.stdout:2/694: write d0/d1a/d48/d56/da2/fb2 [1720723,44888] 0 2023-12-12T11:52:09.163 INFO:tasks.workunit.client.1.smithi093.stdout:5/962: mkdir d0/d7/d36/d38/dce/de9/d142 0 2023-12-12T11:52:09.163 INFO:tasks.workunit.client.1.smithi093.stdout:5/963: fdatasync d0/d7/d59/f60 0 2023-12-12T11:52:09.163 INFO:tasks.workunit.client.0.smithi063.stdout:4/768: write d2/d17/f3e [4142489,84692] 0 2023-12-12T11:52:09.166 INFO:tasks.workunit.client.0.smithi063.stdout:1/816: dwrite d3/d3a/dd7/d16/d24/d4d/f68 [0,4194304] 0 2023-12-12T11:52:09.169 INFO:tasks.workunit.client.0.smithi063.stdout:0/786: mknod d0/d7/d27/d1f/dc4/c105 0 2023-12-12T11:52:09.169 INFO:tasks.workunit.client.0.smithi063.stdout:0/787: chown d0/ddb 700022 1 2023-12-12T11:52:09.175 INFO:tasks.workunit.client.0.smithi063.stdout:3/719: dwrite d4/df/d1a/d1c/d3b/d52/d78/da5/d98/fd7 [0,4194304] 0 2023-12-12T11:52:09.175 INFO:tasks.workunit.client.0.smithi063.stdout:8/841: dwrite d4/de/d1e/f64 [0,4194304] 0 2023-12-12T11:52:09.176 INFO:tasks.workunit.client.0.smithi063.stdout:7/683: rename de/dc8/lf9 to de/dc8/l102 0 2023-12-12T11:52:09.176 INFO:tasks.workunit.client.0.smithi063.stdout:7/684: dread - de/d33/dd2/d4a/fdd zero size 2023-12-12T11:52:09.176 INFO:tasks.workunit.client.0.smithi063.stdout:7/685: creat de/d39/d4b/d7b/f103 x:0 0 0 2023-12-12T11:52:09.182 INFO:tasks.workunit.client.0.smithi063.stdout:2/695: truncate d0/d1a/d1e/f70 3301358 0 2023-12-12T11:52:09.186 INFO:tasks.workunit.client.0.smithi063.stdout:4/769: dread d2/d17/d41/f75 [0,4194304] 0 2023-12-12T11:52:09.186 INFO:tasks.workunit.client.0.smithi063.stdout:0/788: rmdir d0/d8e 39 2023-12-12T11:52:09.186 INFO:tasks.workunit.client.0.smithi063.stdout:0/789: stat d0/d7/d27/d1f/dc4/f82 0 2023-12-12T11:52:09.186 INFO:tasks.workunit.client.0.smithi063.stdout:1/817: dread d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2/f7a [8388608,4194304] 0 2023-12-12T11:52:09.189 INFO:tasks.workunit.client.0.smithi063.stdout:3/720: mknod d4/df/d1a/d1c/d57/cdc 0 2023-12-12T11:52:09.189 INFO:tasks.workunit.client.0.smithi063.stdout:3/721: truncate d4/f44 1062263 0 2023-12-12T11:52:09.190 INFO:tasks.workunit.client.0.smithi063.stdout:8/842: rename d4/d24/fd7 to d4/d55/f106 0 2023-12-12T11:52:09.190 INFO:tasks.workunit.client.0.smithi063.stdout:8/843: dread - d4/d24/d38/d45/d5b/fa7 zero size 2023-12-12T11:52:09.192 INFO:tasks.workunit.client.0.smithi063.stdout:7/686: link de/d39/d88/db4/cfa de/d39/d60/c104 0 2023-12-12T11:52:09.192 INFO:tasks.workunit.client.1.smithi093.stdout:5/964: dwrite d0/d7/d36/f140 [0,4194304] 0 2023-12-12T11:52:09.193 INFO:tasks.workunit.client.0.smithi063.stdout:2/696: mknod d0/d1a/d3a/d59/cda 0 2023-12-12T11:52:09.194 INFO:tasks.workunit.client.0.smithi063.stdout:3/722: mknod d4/d23/cdd 0 2023-12-12T11:52:09.194 INFO:tasks.workunit.client.0.smithi063.stdout:3/723: write d4/df/d1a/d1c/d3b/d50/d61/f93 [3182782,49409] 0 2023-12-12T11:52:09.194 INFO:tasks.workunit.client.0.smithi063.stdout:3/724: fsync d4/df/d1a/d1c/d34/fc0 0 2023-12-12T11:52:09.197 INFO:tasks.workunit.client.0.smithi063.stdout:0/790: rename d0/c93 to d0/d1a/d23/d2e/dd4/c106 0 2023-12-12T11:52:09.200 INFO:tasks.workunit.client.1.smithi093.stdout:5/965: creat d0/d7/d12c/f143 x:0 0 0 2023-12-12T11:52:09.202 INFO:tasks.workunit.client.0.smithi063.stdout:2/697: mkdir d0/d1a/d3a/d59/ddb 0 2023-12-12T11:52:09.202 INFO:tasks.workunit.client.0.smithi063.stdout:2/698: fdatasync d0/d1a/d3a/d59/fd1 0 2023-12-12T11:52:09.204 INFO:tasks.workunit.client.1.smithi093.stdout:5/966: creat d0/d7/d36/d29/d44/f144 x:0 0 0 2023-12-12T11:52:09.204 INFO:tasks.workunit.client.1.smithi093.stdout:5/967: fdatasync d0/d7/d36/d29/d44/f144 0 2023-12-12T11:52:09.204 INFO:tasks.workunit.client.1.smithi093.stdout:5/968: stat d0/d7/d8 0 2023-12-12T11:52:09.204 INFO:tasks.workunit.client.0.smithi063.stdout:3/725: getdents d4/df/d1a/d1c/d3b/d52/d78/da5 0 2023-12-12T11:52:09.205 INFO:tasks.workunit.client.0.smithi063.stdout:1/818: rename d3/d3a/dd7/d16/d4f/da7/dca/la0 to d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2/daf/l10c 0 2023-12-12T11:52:09.206 INFO:tasks.workunit.client.0.smithi063.stdout:0/791: getdents d0/d1a/d66 0 2023-12-12T11:52:09.208 INFO:tasks.workunit.client.0.smithi063.stdout:7/687: getdents de/d22/d66 0 2023-12-12T11:52:09.211 INFO:tasks.workunit.client.0.smithi063.stdout:2/699: mkdir d0/d1a/d57/ddc 0 2023-12-12T11:52:09.214 INFO:tasks.workunit.client.0.smithi063.stdout:3/726: truncate d4/df/d1a/f2b 3976326 0 2023-12-12T11:52:09.217 INFO:tasks.workunit.client.1.smithi093.stdout:5/969: rename d0/d7/d8/de/dab/de5 to d0/d7/d36/db9/d145 0 2023-12-12T11:52:09.220 INFO:tasks.workunit.client.0.smithi063.stdout:0/792: creat d0/d1a/d23/f107 x:0 0 0 2023-12-12T11:52:09.220 INFO:tasks.workunit.client.0.smithi063.stdout:0/793: read - d0/d1a/d23/d2e/d84/feb zero size 2023-12-12T11:52:09.220 INFO:tasks.workunit.client.0.smithi063.stdout:0/794: chown d0/fda 95 1 2023-12-12T11:52:09.220 INFO:tasks.workunit.client.0.smithi063.stdout:0/795: chown d0/d1a/d23/d34/d42/l3c 636109 1 2023-12-12T11:52:09.231 INFO:tasks.workunit.client.0.smithi063.stdout:8/844: rename d4/de/d3b to d4/d24/d38/d45/d5b/d107 0 2023-12-12T11:52:09.233 INFO:tasks.workunit.client.0.smithi063.stdout:0/796: creat d0/d1a/d23/d34/d42/d99/f108 x:0 0 0 2023-12-12T11:52:09.233 INFO:tasks.workunit.client.0.smithi063.stdout:0/797: fsync d0/d1a/d23/d2e/d84/feb 0 2023-12-12T11:52:09.237 INFO:tasks.workunit.client.0.smithi063.stdout:2/700: rmdir d0/d1a/dba 39 2023-12-12T11:52:09.246 INFO:tasks.workunit.client.0.smithi063.stdout:1/819: rename d3/d3a/dd7/d16/d4f/da7/faa to d3/d3a/dd7/d16/d24/d48/d75/d83/f10d 0 2023-12-12T11:52:09.256 INFO:tasks.workunit.client.0.smithi063.stdout:8/845: rmdir d4/d24/d38/dd8/ded 0 2023-12-12T11:52:09.257 INFO:tasks.workunit.client.0.smithi063.stdout:1/820: link d3/d3a/dd7/d16/d4f/d9a/fff d3/d3a/dd7/d16/d24/d48/d75/d83/d5b/d6b/d103/f10e 0 2023-12-12T11:52:09.258 INFO:tasks.workunit.client.0.smithi063.stdout:8/846: creat d4/d24/db3/dfa/f108 x:0 0 0 2023-12-12T11:52:09.262 INFO:tasks.workunit.client.0.smithi063.stdout:1/821: truncate d3/d3a/dd7/d12/f49 2810184 0 2023-12-12T11:52:09.274 INFO:tasks.workunit.client.1.smithi093.stdout:5/970: sync 2023-12-12T11:52:09.274 INFO:tasks.workunit.client.1.smithi093.stdout:5/971: readlink d0/d7/d59/d62/l73 0 2023-12-12T11:52:09.275 INFO:tasks.workunit.client.0.smithi063.stdout:3/727: dwrite d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/fd3 [0,4194304] 0 2023-12-12T11:52:09.287 INFO:tasks.workunit.client.0.smithi063.stdout:1/822: dread d3/d3a/dd7/f20 [0,4194304] 0 2023-12-12T11:52:09.287 INFO:tasks.workunit.client.0.smithi063.stdout:7/688: dwrite de/d22/d6e/f83 [0,4194304] 0 2023-12-12T11:52:09.290 INFO:tasks.workunit.client.1.smithi093.stdout:5/972: dread d0/d7/d8/d9e/d6a/fb3 [0,4194304] 0 2023-12-12T11:52:09.291 INFO:tasks.workunit.client.0.smithi063.stdout:7/689: unlink de/d33/dd2/d4a/lc5 0 2023-12-12T11:52:09.292 INFO:tasks.workunit.client.1.smithi093.stdout:5/973: mkdir d0/d7/d146 0 2023-12-12T11:52:09.293 INFO:tasks.workunit.client.0.smithi063.stdout:7/690: symlink de/d33/dd2/d4a/dfe/l105 0 2023-12-12T11:52:09.293 INFO:tasks.workunit.client.0.smithi063.stdout:7/691: chown c5 5 1 2023-12-12T11:52:09.293 INFO:tasks.workunit.client.1.smithi093.stdout:5/974: symlink d0/d7/d12c/l147 0 2023-12-12T11:52:09.293 INFO:tasks.workunit.client.1.smithi093.stdout:5/975: chown d0/d124 1702 1 2023-12-12T11:52:09.294 INFO:tasks.workunit.client.0.smithi063.stdout:7/692: rmdir de/d33 39 2023-12-12T11:52:09.296 INFO:tasks.workunit.client.1.smithi093.stdout:5/976: creat d0/d7/d59/d62/de1/f148 x:0 0 0 2023-12-12T11:52:09.296 INFO:tasks.workunit.client.1.smithi093.stdout:5/977: fdatasync d0/d7/d36/d68/f11d 0 2023-12-12T11:52:09.296 INFO:tasks.workunit.client.1.smithi093.stdout:5/978: chown d0/d7/d36/db9/d145 3948 1 2023-12-12T11:52:09.297 INFO:tasks.workunit.client.1.smithi093.stdout:5/979: mkdir d0/d7/d59/de7/d149 0 2023-12-12T11:52:09.298 INFO:tasks.workunit.client.1.smithi093.stdout:5/980: mknod d0/d7/d36/d38/dce/de9/d142/c14a 0 2023-12-12T11:52:09.298 INFO:tasks.workunit.client.1.smithi093.stdout:5/981: stat d0/d7/d36/db9/dca/fe4 0 2023-12-12T11:52:09.300 INFO:tasks.workunit.client.0.smithi063.stdout:0/798: dwrite d0/d7/d27/d1f/dc4/d67/fc0 [0,4194304] 0 2023-12-12T11:52:09.307 INFO:tasks.workunit.client.0.smithi063.stdout:2/701: dwrite d0/ff [0,4194304] 0 2023-12-12T11:52:09.307 INFO:tasks.workunit.client.0.smithi063.stdout:2/702: readlink d0/l12 0 2023-12-12T11:52:09.320 INFO:tasks.workunit.client.0.smithi063.stdout:9/628: sync 2023-12-12T11:52:09.322 INFO:tasks.workunit.client.0.smithi063.stdout:9/629: creat d7/d20/d3f/d40/fca x:0 0 0 2023-12-12T11:52:09.326 INFO:tasks.workunit.client.0.smithi063.stdout:9/630: getdents d7/d11/d12 0 2023-12-12T11:52:09.326 INFO:tasks.workunit.client.0.smithi063.stdout:2/703: dread d0/d1a/d3a/f9f [0,4194304] 0 2023-12-12T11:52:09.327 INFO:tasks.workunit.client.0.smithi063.stdout:2/704: chown d0/d1a/d1e/f31 5193 1 2023-12-12T11:52:09.328 INFO:tasks.workunit.client.0.smithi063.stdout:9/631: creat d7/d11/d4b/d75/fcb x:0 0 0 2023-12-12T11:52:09.340 INFO:tasks.workunit.client.0.smithi063.stdout:3/728: dread d4/f3f [4194304,4194304] 0 2023-12-12T11:52:09.342 INFO:tasks.workunit.client.0.smithi063.stdout:3/729: write d4/f3f [801836,130722] 0 2023-12-12T11:52:09.344 INFO:tasks.workunit.client.0.smithi063.stdout:3/730: fsync d4/df/d1a/d1c/d57/fd4 0 2023-12-12T11:52:09.346 INFO:tasks.workunit.client.0.smithi063.stdout:3/731: truncate f0 6782221 0 2023-12-12T11:52:09.346 INFO:tasks.workunit.client.0.smithi063.stdout:3/732: creat d4/df/d1a/d1c/d57/fde x:0 0 0 2023-12-12T11:52:09.346 INFO:tasks.workunit.client.0.smithi063.stdout:3/733: stat d4/f15 0 2023-12-12T11:52:09.350 INFO:tasks.workunit.client.0.smithi063.stdout:3/734: mknod d4/df/d1a/d1c/cdf 0 2023-12-12T11:52:09.350 INFO:tasks.workunit.client.0.smithi063.stdout:3/735: getdents d4/df/d1a/d1c/d41 0 2023-12-12T11:52:09.352 INFO:tasks.workunit.client.0.smithi063.stdout:3/736: mkdir d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/de0 0 2023-12-12T11:52:09.353 INFO:tasks.workunit.client.0.smithi063.stdout:3/737: chown d4/df/lbf 0 1 2023-12-12T11:52:09.353 INFO:tasks.workunit.client.0.smithi063.stdout:3/738: write d4/f2a [403944,106181] 0 2023-12-12T11:52:09.353 INFO:tasks.workunit.client.0.smithi063.stdout:2/705: write d0/d1a/d48/f4a [1541203,60448] 0 2023-12-12T11:52:09.353 INFO:tasks.workunit.client.0.smithi063.stdout:3/739: write d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/f66 [2774492,11793] 0 2023-12-12T11:52:09.353 INFO:tasks.workunit.client.0.smithi063.stdout:3/740: write d4/df/d1a/f2e [1024762,90365] 0 2023-12-12T11:52:09.354 INFO:tasks.workunit.client.1.smithi093.stdout:5/982: dwrite d0/d7/d36/f134 [0,4194304] 0 2023-12-12T11:52:09.354 INFO:tasks.workunit.client.1.smithi093.stdout:5/983: write d0/d7/d36/d68/f7a [1964073,105351] 0 2023-12-12T11:52:09.354 INFO:tasks.workunit.client.0.smithi063.stdout:2/706: link d0/f6 d0/d1a/d3a/d85/da6/dd8/fdd 0 2023-12-12T11:52:09.358 INFO:tasks.workunit.client.1.smithi093.stdout:5/984: rmdir d0/d7/d12c 39 2023-12-12T11:52:09.360 INFO:tasks.workunit.client.1.smithi093.stdout:5/985: mknod d0/d7/d59/de7/d149/c14b 0 2023-12-12T11:52:09.360 INFO:tasks.workunit.client.1.smithi093.stdout:5/986: chown d0/d7/d59/de7/d149/c14b 16398 1 2023-12-12T11:52:09.361 INFO:tasks.workunit.client.1.smithi093.stdout:5/987: mkdir d0/d7/d36/d29/d76/d14c 0 2023-12-12T11:52:09.363 INFO:tasks.workunit.client.1.smithi093.stdout:5/988: getdents d0/d7/d36/d29/d44 0 2023-12-12T11:52:09.364 INFO:tasks.workunit.client.1.smithi093.stdout:5/989: readlink d0/d7/d8/l116 0 2023-12-12T11:52:09.365 INFO:tasks.workunit.client.0.smithi063.stdout:7/693: dwrite de/d22/d6e/d8a/fb6 [0,4194304] 0 2023-12-12T11:52:09.365 INFO:tasks.workunit.client.1.smithi093.stdout:5/990: creat d0/d7/d59/f14d x:0 0 0 2023-12-12T11:52:09.367 INFO:tasks.workunit.client.1.smithi093.stdout:5/991: unlink d0/d7/d36/d38/f43 0 2023-12-12T11:52:09.367 INFO:tasks.workunit.client.1.smithi093.stdout:5/992: chown d0/d7/d36/d87/fcd 0 1 2023-12-12T11:52:09.367 INFO:tasks.workunit.client.1.smithi093.stdout:5/993: write d0/d7/d59/d62/fa5 [4968051,115618] 0 2023-12-12T11:52:09.367 INFO:tasks.workunit.client.1.smithi093.stdout:5/994: write d0/d7/d8/d9e/f31 [1144119,89498] 0 2023-12-12T11:52:09.372 INFO:tasks.workunit.client.1.smithi093.stdout:5/995: mknod d0/dd2/d122/c14e 0 2023-12-12T11:52:09.372 INFO:tasks.workunit.client.1.smithi093.stdout:5/996: chown d0/d7/d59/d62/l73 117 1 2023-12-12T11:52:09.372 INFO:tasks.workunit.client.1.smithi093.stdout:5/997: fdatasync d0/d7/d36/f2a 0 2023-12-12T11:52:09.372 INFO:tasks.workunit.client.1.smithi093.stdout:5/998: read - d0/d7/d36/d68/def/d123/f13b zero size 2023-12-12T11:52:09.377 INFO:tasks.workunit.client.1.smithi093.stdout:5/999: dread d0/d7/d36/d29/d44/f94 [0,4194304] 0 2023-12-12T11:52:09.380 INFO:tasks.workunit.client.0.smithi063.stdout:3/741: write d4/df/d1a/d1c/d3b/d50/f8f [1581379,79541] 0 2023-12-12T11:52:09.381 INFO:tasks.workunit.client.0.smithi063.stdout:7/694: write de/d33/d71/f96 [2921153,17544] 0 2023-12-12T11:52:09.389 INFO:tasks.workunit.client.0.smithi063.stdout:7/695: link de/d34/d43/d45/lf4 de/d39/d4b/d7b/l106 0 2023-12-12T11:52:09.391 INFO:tasks.workunit.client.0.smithi063.stdout:7/696: rename de/d39/d4b/l6a to de/d34/d43/d45/l107 0 2023-12-12T11:52:09.394 INFO:tasks.workunit.client.1.smithi093.stderr:+ rm -rf -- ./tmp.F0BQwUqlR3 2023-12-12T11:52:09.397 INFO:tasks.workunit.client.0.smithi063.stdout:1/823: dwrite d3/d3a/dd7/d16/f5c [0,4194304] 0 2023-12-12T11:52:09.398 INFO:tasks.workunit.client.0.smithi063.stdout:0/799: dwrite d0/fd9 [0,4194304] 0 2023-12-12T11:52:09.410 INFO:tasks.workunit.client.0.smithi063.stdout:3/742: dread d4/df/d1a/d1c/d3b/d52/d78/da5/f89 [0,4194304] 0 2023-12-12T11:52:09.411 INFO:tasks.workunit.client.0.smithi063.stdout:2/707: dwrite d0/f4 [0,4194304] 0 2023-12-12T11:52:09.411 INFO:tasks.workunit.client.0.smithi063.stdout:2/708: chown d0/fb3 93 1 2023-12-12T11:52:09.413 INFO:tasks.workunit.client.0.smithi063.stdout:9/632: dwrite d7/d15/db2/fc6 [0,4194304] 0 2023-12-12T11:52:09.422 INFO:tasks.workunit.client.0.smithi063.stdout:9/633: unlink d7/d11/l16 0 2023-12-12T11:52:09.424 INFO:tasks.workunit.client.0.smithi063.stdout:0/800: dread d0/d7/d27/f33 [0,4194304] 0 2023-12-12T11:52:09.428 INFO:tasks.workunit.client.0.smithi063.stdout:0/801: symlink d0/l109 0 2023-12-12T11:52:09.440 INFO:tasks.workunit.client.0.smithi063.stdout:1/824: write d3/d3a/dd7/d16/d24/f78 [3573364,26491] 0 2023-12-12T11:52:09.440 INFO:tasks.workunit.client.0.smithi063.stdout:1/825: stat d3/d3a/dd7/d16/d24 0 2023-12-12T11:52:09.449 INFO:tasks.workunit.client.0.smithi063.stdout:9/634: write d7/d11/f53 [1434696,116628] 0 2023-12-12T11:52:09.449 INFO:tasks.workunit.client.0.smithi063.stdout:9/635: creat d7/d15/db2/fcc x:0 0 0 2023-12-12T11:52:09.450 INFO:tasks.workunit.client.0.smithi063.stdout:1/826: dread d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2/d7e/f9d [0,4194304] 0 2023-12-12T11:52:09.451 INFO:tasks.workunit.client.0.smithi063.stdout:9/636: getdents d7/d8a 0 2023-12-12T11:52:09.452 INFO:tasks.workunit.client.0.smithi063.stdout:1/827: creat d3/d3a/dd7/d16/d4f/da7/dca/d6f/f10f x:0 0 0 2023-12-12T11:52:09.452 INFO:tasks.workunit.client.0.smithi063.stdout:1/828: write d3/d3a/dd7/d16/d4f/d9a/fff [123447,46654] 0 2023-12-12T11:52:09.453 INFO:tasks.workunit.client.0.smithi063.stdout:9/637: mkdir d7/d20/d45/d46/d51/dcd 0 2023-12-12T11:52:09.454 INFO:tasks.workunit.client.0.smithi063.stdout:9/638: fdatasync d7/d15/dc4/f48 0 2023-12-12T11:52:09.454 INFO:tasks.workunit.client.0.smithi063.stdout:9/639: write d7/d15/f17 [2830297,121345] 0 2023-12-12T11:52:09.454 INFO:tasks.workunit.client.0.smithi063.stdout:1/829: creat d3/d3a/dd7/d12/d107/f110 x:0 0 0 2023-12-12T11:52:09.454 INFO:tasks.workunit.client.0.smithi063.stdout:1/830: chown d3/d3a/d52/ddf 3985093 1 2023-12-12T11:52:09.455 INFO:tasks.workunit.client.0.smithi063.stdout:2/709: dwrite d0/d1a/d3a/f9e [0,4194304] 0 2023-12-12T11:52:09.458 INFO:tasks.workunit.client.0.smithi063.stdout:9/640: mkdir d7/d15/dc4/dce 0 2023-12-12T11:52:09.458 INFO:tasks.workunit.client.0.smithi063.stdout:1/831: mknod d3/d3a/dd7/d16/d24/d48/d75/d83/d81/c111 0 2023-12-12T11:52:09.461 INFO:tasks.workunit.client.0.smithi063.stdout:9/641: creat d7/d15/dc4/fcf x:0 0 0 2023-12-12T11:52:09.466 INFO:tasks.workunit.client.0.smithi063.stdout:7/697: dwrite de/ff5 [0,4194304] 0 2023-12-12T11:52:09.467 INFO:tasks.workunit.client.0.smithi063.stdout:1/832: truncate d3/d3a/dd7/d16/d24/d48/d75/d83/d5b/d6b/f99 112430 0 2023-12-12T11:52:09.469 INFO:tasks.workunit.client.0.smithi063.stdout:9/642: unlink d7/d11/d4b/d75/f98 0 2023-12-12T11:52:09.480 INFO:tasks.workunit.client.0.smithi063.stdout:0/802: dwrite d0/d1a/fff [0,4194304] 0 2023-12-12T11:52:09.491 INFO:tasks.workunit.client.0.smithi063.stdout:3/743: dwrite d4/f44 [0,4194304] 0 2023-12-12T11:52:09.491 INFO:tasks.workunit.client.0.smithi063.stdout:1/833: mkdir d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2/d112 0 2023-12-12T11:52:09.494 INFO:tasks.workunit.client.0.smithi063.stdout:9/643: symlink d7/d20/d3f/d40/d4e/ld0 0 2023-12-12T11:52:09.503 INFO:tasks.workunit.client.0.smithi063.stdout:0/803: creat d0/d8e/da7/dcf/f10a x:0 0 0 2023-12-12T11:52:09.517 INFO:tasks.workunit.client.0.smithi063.stdout:7/698: dwrite de/d33/fbb [0,4194304] 0 2023-12-12T11:52:09.519 INFO:tasks.workunit.client.0.smithi063.stdout:7/699: write de/d33/dd2/d4a/d65/fc6 [2964,125335] 0 2023-12-12T11:52:09.574 INFO:tasks.workunit.client.0.smithi063.stdout:1/834: dwrite d3/d3a/d52/fb7 [0,4194304] 0 2023-12-12T11:52:09.577 INFO:tasks.workunit.client.0.smithi063.stdout:3/744: link d4/df/d1a/d1c/d3b/d52/d74/fa8 d4/df/d1a/d1c/d3b/d50/d9f/fe1 0 2023-12-12T11:52:09.578 INFO:tasks.workunit.client.0.smithi063.stdout:9/644: symlink d7/d15/dc4/d3e/d55/ld1 0 2023-12-12T11:52:09.581 INFO:tasks.workunit.client.0.smithi063.stdout:7/700: read de/d39/d60/f95 [4012250,62671] 0 2023-12-12T11:52:09.581 INFO:tasks.workunit.client.0.smithi063.stdout:7/701: chown de/d33/d41/d44/d8b/dde/daf 744612192 1 2023-12-12T11:52:09.592 INFO:tasks.workunit.client.0.smithi063.stdout:0/804: creat d0/d1a/d23/d2e/dd4/ddc/de0/f10b x:0 0 0 2023-12-12T11:52:09.592 INFO:tasks.workunit.client.0.smithi063.stdout:0/805: dread - d0/d7/d27/fc9 zero size 2023-12-12T11:52:09.592 INFO:tasks.workunit.client.0.smithi063.stdout:0/806: readlink d0/d7/d27/d1f/dc4/d67/lc6 0 2023-12-12T11:52:09.592 INFO:tasks.workunit.client.0.smithi063.stdout:1/835: read d3/f9 [1887512,43249] 0 2023-12-12T11:52:09.592 INFO:tasks.workunit.client.0.smithi063.stdout:1/836: read - d3/d3a/dd7/d16/d24/d48/fe7 zero size 2023-12-12T11:52:09.595 INFO:tasks.workunit.client.0.smithi063.stdout:3/745: write d4/d23/d6b/d90/fc3 [739137,10072] 0 2023-12-12T11:52:09.600 INFO:tasks.workunit.client.0.smithi063.stdout:9/645: creat d7/d20/d45/d46/d51/d64/d6f/d85/fd2 x:0 0 0 2023-12-12T11:52:09.604 INFO:tasks.workunit.client.0.smithi063.stdout:7/702: unlink de/d33/d41/d44/l75 0 2023-12-12T11:52:09.610 INFO:tasks.workunit.client.0.smithi063.stdout:0/807: write d0/d7/d27/d1f/f48 [2848688,76248] 0 2023-12-12T11:52:09.613 INFO:tasks.workunit.client.0.smithi063.stdout:5/798: sync 2023-12-12T11:52:09.613 INFO:tasks.workunit.client.0.smithi063.stdout:6/802: sync 2023-12-12T11:52:09.623 INFO:tasks.workunit.client.0.smithi063.stdout:9/646: link d7/l99 d7/d8a/ld3 0 2023-12-12T11:52:09.627 INFO:tasks.workunit.client.0.smithi063.stdout:5/799: write d7/d28/d94/f9f [76733,93639] 0 2023-12-12T11:52:09.643 INFO:tasks.workunit.client.0.smithi063.stdout:4/770: sync 2023-12-12T11:52:09.643 INFO:tasks.workunit.client.0.smithi063.stdout:6/803: link d9/f109 d9/d10/d2a/de7/d86/dc2/f11a 0 2023-12-12T11:52:09.644 INFO:tasks.workunit.client.0.smithi063.stdout:0/808: chown d0/d7/d27/l20 4809 1 2023-12-12T11:52:09.644 INFO:tasks.workunit.client.0.smithi063.stdout:0/809: write d0/d1a/d66/f6f [2740897,63227] 0 2023-12-12T11:52:09.647 INFO:tasks.workunit.client.0.smithi063.stdout:9/647: symlink d7/d20/d3f/ld4 0 2023-12-12T11:52:09.648 INFO:tasks.workunit.client.0.smithi063.stdout:5/800: creat d7/d28/d67/ff3 x:0 0 0 2023-12-12T11:52:09.653 INFO:tasks.workunit.client.0.smithi063.stdout:1/837: dwrite d3/d3a/dd7/d16/d24/d48/f57 [0,4194304] 0 2023-12-12T11:52:09.653 INFO:tasks.workunit.client.0.smithi063.stdout:1/838: stat d3/d3a/dd7/d16/d4f/da7 0 2023-12-12T11:52:09.654 INFO:tasks.workunit.client.0.smithi063.stdout:3/746: dwrite d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/f9e [0,4194304] 0 2023-12-12T11:52:09.657 INFO:tasks.workunit.client.0.smithi063.stdout:0/810: creat d0/d1a/d23/d34/d42/f10c x:0 0 0 2023-12-12T11:52:09.660 INFO:tasks.workunit.client.0.smithi063.stdout:5/801: creat d7/d28/df1/ff4 x:0 0 0 2023-12-12T11:52:09.660 INFO:tasks.workunit.client.0.smithi063.stdout:7/703: write de/f19 [3214568,125055] 0 2023-12-12T11:52:09.663 INFO:tasks.workunit.client.0.smithi063.stdout:0/811: dread d0/d7/d27/d1f/dc4/d67/fd8 [0,4194304] 0 2023-12-12T11:52:09.667 INFO:tasks.workunit.client.0.smithi063.stdout:5/802: mknod d7/d10/d2b/cf5 0 2023-12-12T11:52:09.672 INFO:tasks.workunit.client.0.smithi063.stdout:0/812: getdents d0/d8e/da7 0 2023-12-12T11:52:09.673 INFO:tasks.workunit.client.0.smithi063.stdout:7/704: getdents de/d34/d68 0 2023-12-12T11:52:09.673 INFO:tasks.workunit.client.0.smithi063.stdout:7/705: fsync de/d33/fbb 0 2023-12-12T11:52:09.675 INFO:tasks.workunit.client.0.smithi063.stdout:9/648: write d7/d20/d3f/d40/d4e/f80 [2474200,8535] 0 2023-12-12T11:52:09.675 INFO:tasks.workunit.client.0.smithi063.stdout:9/649: fsync d7/d11/f25 0 2023-12-12T11:52:09.685 INFO:tasks.workunit.client.0.smithi063.stdout:3/747: dread d4/df/d1a/d1c/d41/f58 [4194304,4194304] 0 2023-12-12T11:52:09.693 INFO:tasks.workunit.client.0.smithi063.stdout:9/650: rmdir d7/d15/d39 39 2023-12-12T11:52:09.693 INFO:tasks.workunit.client.0.smithi063.stdout:9/651: write d7/d11/f53 [2671587,67511] 0 2023-12-12T11:52:09.698 INFO:tasks.workunit.client.0.smithi063.stdout:9/652: symlink d7/d20/d45/d46/d51/d64/d6f/ld5 0 2023-12-12T11:52:09.698 INFO:tasks.workunit.client.0.smithi063.stdout:3/748: dread d4/f2a [0,4194304] 0 2023-12-12T11:52:09.701 INFO:tasks.workunit.client.0.smithi063.stdout:9/653: mkdir d7/d8a/dd6 0 2023-12-12T11:52:09.702 INFO:tasks.workunit.client.0.smithi063.stdout:0/813: write d0/d1a/d66/f87 [1777225,39405] 0 2023-12-12T11:52:09.702 INFO:tasks.workunit.client.0.smithi063.stdout:3/749: mkdir d4/df/d1a/d1c/d41/de2 0 2023-12-12T11:52:09.705 INFO:tasks.workunit.client.0.smithi063.stdout:7/706: dread de/d33/dd2/f2d [0,4194304] 0 2023-12-12T11:52:09.706 INFO:tasks.workunit.client.0.smithi063.stdout:2/710: sync 2023-12-12T11:52:09.706 INFO:tasks.workunit.client.0.smithi063.stdout:8/847: sync 2023-12-12T11:52:09.708 INFO:tasks.workunit.client.0.smithi063.stdout:6/804: dwrite d9/d68/fc4 [4194304,4194304] 0 2023-12-12T11:52:09.708 INFO:tasks.workunit.client.0.smithi063.stdout:6/805: chown d9/d10/l2e 95052899 1 2023-12-12T11:52:09.714 INFO:tasks.workunit.client.0.smithi063.stdout:5/803: dread d7/d10/f1b [0,4194304] 0 2023-12-12T11:52:09.715 INFO:tasks.workunit.client.0.smithi063.stdout:5/804: fdatasync d7/d10/d2b/d3c/d42/d62/d69/f73 0 2023-12-12T11:52:09.716 INFO:tasks.workunit.client.0.smithi063.stdout:4/771: dwrite d2/f10 [12582912,4194304] 0 2023-12-12T11:52:09.719 INFO:tasks.workunit.client.0.smithi063.stdout:0/814: creat d0/d1a/d23/d2e/dad/f10d x:0 0 0 2023-12-12T11:52:09.732 INFO:tasks.workunit.client.0.smithi063.stdout:7/707: unlink de/d39/fb1 0 2023-12-12T11:52:09.732 INFO:tasks.workunit.client.0.smithi063.stdout:7/708: stat de/c1c 0 2023-12-12T11:52:09.740 INFO:tasks.workunit.client.0.smithi063.stdout:8/848: creat d4/d24/d38/d45/d5b/d107/d62/d6e/f109 x:0 0 0 2023-12-12T11:52:09.740 INFO:tasks.workunit.client.0.smithi063.stdout:1/839: dwrite d3/d3a/dd7/d16/d24/d4d/ff0 [0,4194304] 0 2023-12-12T11:52:09.742 INFO:tasks.workunit.client.0.smithi063.stdout:2/711: dread d0/ff [4194304,4194304] 0 2023-12-12T11:52:09.742 INFO:tasks.workunit.client.0.smithi063.stdout:2/712: creat d0/d1a/d3a/d85/da6/fde x:0 0 0 2023-12-12T11:52:09.745 INFO:tasks.workunit.client.0.smithi063.stdout:0/815: mkdir d0/d1a/d66/d10e 0 2023-12-12T11:52:09.745 INFO:tasks.workunit.client.0.smithi063.stdout:0/816: truncate d0/d8e/da7/dcf/f10a 494436 0 2023-12-12T11:52:09.762 INFO:tasks.workunit.client.0.smithi063.stdout:8/849: symlink d4/d24/d38/d45/d5b/d107/d62/d36/d7f/l10a 0 2023-12-12T11:52:09.762 INFO:tasks.workunit.client.0.smithi063.stdout:8/850: fdatasync d4/d24/f31 0 2023-12-12T11:52:09.765 INFO:tasks.workunit.client.0.smithi063.stdout:4/772: dread d2/f6 [0,4194304] 0 2023-12-12T11:52:09.765 INFO:tasks.workunit.client.0.smithi063.stdout:4/773: chown d2/d48/d4f/cba 193628332 1 2023-12-12T11:52:09.770 INFO:tasks.workunit.client.0.smithi063.stdout:1/840: read d3/d3a/dd7/d16/d4f/da7/dca/d6f/fd3 [385604,64328] 0 2023-12-12T11:52:09.771 INFO:tasks.workunit.client.0.smithi063.stdout:0/817: rename d0/d7/d27/d19/ff9 to d0/d1a/d23/d2e/dd4/ddc/f10f 0 2023-12-12T11:52:09.771 INFO:tasks.workunit.client.0.smithi063.stdout:0/818: dread - d0/d1a/d23/fa8 zero size 2023-12-12T11:52:09.772 INFO:tasks.workunit.client.0.smithi063.stdout:1/841: mkdir d3/d3a/d52/ddf/d113 0 2023-12-12T11:52:09.776 INFO:tasks.workunit.client.0.smithi063.stdout:8/851: dread d4/d55/f35 [0,4194304] 0 2023-12-12T11:52:09.776 INFO:tasks.workunit.client.0.smithi063.stdout:8/852: fsync d4/de/d1e/f5c 0 2023-12-12T11:52:09.786 INFO:tasks.workunit.client.0.smithi063.stdout:3/750: write d4/df/d1a/d1c/d3b/f5b [1633552,49921] 0 2023-12-12T11:52:09.787 INFO:tasks.workunit.client.0.smithi063.stdout:8/853: creat d4/d24/d38/d45/d5b/d107/d62/d36/d7f/f10b x:0 0 0 2023-12-12T11:52:09.787 INFO:tasks.workunit.client.0.smithi063.stdout:1/842: truncate d3/fb1 3373747 0 2023-12-12T11:52:09.792 INFO:tasks.workunit.client.0.smithi063.stdout:5/805: dwrite d7/d10/d2b/d3c/d42/d62/d69/dcb/de0/fe2 [0,4194304] 0 2023-12-12T11:52:09.793 INFO:tasks.workunit.client.0.smithi063.stdout:8/854: symlink d4/d24/d38/d45/d5b/d107/d62/d36/d57/d84/df6/l10c 0 2023-12-12T11:52:09.796 INFO:tasks.workunit.client.0.smithi063.stdout:7/709: dwrite de/d34/d68/d89/f8d [0,4194304] 0 2023-12-12T11:52:09.796 INFO:tasks.workunit.client.0.smithi063.stdout:6/806: dwrite d9/d10/d5c/fad [0,4194304] 0 2023-12-12T11:52:09.796 INFO:tasks.workunit.client.0.smithi063.stdout:6/807: chown d9/f59 11086 1 2023-12-12T11:52:09.797 INFO:tasks.workunit.client.0.smithi063.stdout:1/843: rename d3/d3a/dd7/d16/d24/d48/d75/d83/d5b/d6b/f99 to d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2/f114 0 2023-12-12T11:52:09.802 INFO:tasks.workunit.client.0.smithi063.stdout:3/751: mkdir d4/df/d1a/de3 0 2023-12-12T11:52:09.803 INFO:tasks.workunit.client.0.smithi063.stdout:3/752: fsync d4/df/d1a/d1c/f28 0 2023-12-12T11:52:09.803 INFO:tasks.workunit.client.0.smithi063.stdout:3/753: write d4/df/d1a/d1c/d57/fde [277180,76630] 0 2023-12-12T11:52:09.803 INFO:tasks.workunit.client.0.smithi063.stdout:3/754: stat d4/df/d1a/d1c/d3b/c7a 0 2023-12-12T11:52:09.814 INFO:tasks.workunit.client.0.smithi063.stdout:7/710: dread de/d33/dd2/d4a/d65/fc6 [0,4194304] 0 2023-12-12T11:52:09.815 INFO:tasks.workunit.client.0.smithi063.stdout:7/711: read de/f21 [133068,107840] 0 2023-12-12T11:52:09.821 INFO:tasks.workunit.client.0.smithi063.stdout:5/806: unlink d7/d10/d2b/d3c/lda 0 2023-12-12T11:52:09.822 INFO:tasks.workunit.client.0.smithi063.stdout:5/807: dread - d7/d10/d2b/d3c/d5a/dbb/fc2 zero size 2023-12-12T11:52:09.822 INFO:tasks.workunit.client.0.smithi063.stdout:5/808: truncate d7/d10/d2b/d3c/d42/ff0 279338 0 2023-12-12T11:52:09.822 INFO:tasks.workunit.client.0.smithi063.stdout:5/809: stat d7/d10/d2b/f85 0 2023-12-12T11:52:09.833 INFO:tasks.workunit.client.0.smithi063.stdout:3/755: dread d4/df/d1a/f31 [0,4194304] 0 2023-12-12T11:52:09.834 INFO:tasks.workunit.client.0.smithi063.stdout:3/756: getdents d4/df/d1a/d1c/d41/de2 0 2023-12-12T11:52:09.835 INFO:tasks.workunit.client.0.smithi063.stdout:6/808: rmdir d9/d10/d2a 39 2023-12-12T11:52:09.839 INFO:tasks.workunit.client.0.smithi063.stdout:2/713: dwrite d0/d1a/d3a/d59/f93 [0,4194304] 0 2023-12-12T11:52:09.839 INFO:tasks.workunit.client.0.smithi063.stdout:2/714: write d0/f17 [2054382,21070] 0 2023-12-12T11:52:09.839 INFO:tasks.workunit.client.0.smithi063.stdout:2/715: fdatasync d0/d1a/d48/d56/fcf 0 2023-12-12T11:52:09.842 INFO:tasks.workunit.client.0.smithi063.stdout:8/855: getdents d4/d24/db3 0 2023-12-12T11:52:09.843 INFO:tasks.workunit.client.0.smithi063.stdout:8/856: fsync d4/f9c 0 2023-12-12T11:52:09.843 INFO:tasks.workunit.client.0.smithi063.stdout:8/857: write d4/d55/d52/ff9 [1043325,94400] 0 2023-12-12T11:52:09.844 INFO:tasks.workunit.client.0.smithi063.stdout:3/757: rmdir d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/da1 39 2023-12-12T11:52:09.854 INFO:tasks.workunit.client.0.smithi063.stdout:3/758: link f0 d4/df/d1a/d1c/d3b/d50/d61/fe4 0 2023-12-12T11:52:09.858 INFO:tasks.workunit.client.0.smithi063.stdout:2/716: dread d0/d1a/d3a/d85/faa [0,4194304] 0 2023-12-12T11:52:09.858 INFO:tasks.workunit.client.0.smithi063.stdout:0/819: dwrite d0/fda [0,4194304] 0 2023-12-12T11:52:09.858 INFO:tasks.workunit.client.0.smithi063.stdout:7/712: dread de/d33/dd2/d61/f86 [0,4194304] 0 2023-12-12T11:52:09.863 INFO:tasks.workunit.client.0.smithi063.stdout:0/820: mkdir d0/d8e/da7/dcf/de9/d110 0 2023-12-12T11:52:09.864 INFO:tasks.workunit.client.0.smithi063.stdout:0/821: stat d0/d7/d27/l8f 0 2023-12-12T11:52:09.864 INFO:tasks.workunit.client.0.smithi063.stdout:0/822: chown d0/fd9 9170827 1 2023-12-12T11:52:09.866 INFO:tasks.workunit.client.0.smithi063.stdout:2/717: rmdir d0/d1a/d3a 39 2023-12-12T11:52:09.870 INFO:tasks.workunit.client.0.smithi063.stdout:2/718: mknod d0/d69/cdf 0 2023-12-12T11:52:09.885 INFO:tasks.workunit.client.0.smithi063.stdout:9/654: dwrite d7/d11/d94/fb4 [0,4194304] 0 2023-12-12T11:52:09.885 INFO:tasks.workunit.client.0.smithi063.stdout:9/655: readlink d7/d20/d45/d8e/la4 0 2023-12-12T11:52:09.886 INFO:tasks.workunit.client.0.smithi063.stdout:4/774: dwrite d2/d48/fe0 [4194304,4194304] 0 2023-12-12T11:52:09.886 INFO:tasks.workunit.client.0.smithi063.stdout:4/775: fsync d2/d47/f31 0 2023-12-12T11:52:09.886 INFO:tasks.workunit.client.0.smithi063.stdout:4/776: write d2/d17/d7f/da2/ff6 [851486,110627] 0 2023-12-12T11:52:09.887 INFO:tasks.workunit.client.0.smithi063.stdout:4/777: write d2/d48/d69/f82 [3321456,90626] 0 2023-12-12T11:52:09.892 INFO:tasks.workunit.client.0.smithi063.stdout:9/656: rename d7/d20/d45/fb6 to d7/d15/dc4/fd7 0 2023-12-12T11:52:09.904 INFO:tasks.workunit.client.0.smithi063.stdout:9/657: write d7/fd [520455,44993] 0 2023-12-12T11:52:09.910 INFO:tasks.workunit.client.0.smithi063.stdout:7/713: dread de/d34/f4f [0,4194304] 0 2023-12-12T11:52:09.914 INFO:tasks.workunit.client.0.smithi063.stdout:5/810: dwrite d7/d28/d43/d49/fa9 [0,4194304] 0 2023-12-12T11:52:09.914 INFO:tasks.workunit.client.0.smithi063.stdout:5/811: stat d7/d10/d2b/d3c/d42/d62/cd7 0 2023-12-12T11:52:09.914 INFO:tasks.workunit.client.0.smithi063.stdout:0/823: dwrite d0/d7/d27/d1f/dc4/d67/fe8 [0,4194304] 0 2023-12-12T11:52:09.915 INFO:tasks.workunit.client.0.smithi063.stdout:0/824: truncate d0/d1a/d23/d34/d42/f3e 9261389 0 2023-12-12T11:52:09.915 INFO:tasks.workunit.client.0.smithi063.stdout:0/825: chown d0/d1a/d66/f6f 63 1 2023-12-12T11:52:09.918 INFO:tasks.workunit.client.0.smithi063.stdout:5/812: read d7/d10/d2b/d3c/d27/f8e [73481,78012] 0 2023-12-12T11:52:09.925 INFO:tasks.workunit.client.0.smithi063.stdout:4/778: unlink d2/d47/d6d/d88/df0/l33 0 2023-12-12T11:52:09.925 INFO:tasks.workunit.client.0.smithi063.stdout:4/779: chown d2/d47/d6d/f8f 1885601097 1 2023-12-12T11:52:09.925 INFO:tasks.workunit.client.0.smithi063.stdout:4/780: truncate d2/d48/d69/dd2/fd4 736569 0 2023-12-12T11:52:09.926 INFO:tasks.workunit.client.0.smithi063.stdout:7/714: mkdir de/d22/d6e/d8a/da3/d108 0 2023-12-12T11:52:09.926 INFO:tasks.workunit.client.0.smithi063.stdout:7/715: truncate de/d33/f5c 408730 0 2023-12-12T11:52:09.927 INFO:tasks.workunit.client.0.smithi063.stdout:0/826: dread d0/d1a/d66/fa4 [0,4194304] 0 2023-12-12T11:52:09.927 INFO:tasks.workunit.client.0.smithi063.stdout:0/827: stat d0/d7/d27/d19/l94 0 2023-12-12T11:52:09.927 INFO:tasks.workunit.client.0.smithi063.stdout:0/828: chown d0/d1a/d23/f107 224862 1 2023-12-12T11:52:09.927 INFO:tasks.workunit.client.0.smithi063.stdout:0/829: fsync d0/d7/d27/fcd 0 2023-12-12T11:52:09.930 INFO:tasks.workunit.client.0.smithi063.stdout:8/858: dwrite d4/d24/d38/d45/d5b/d107/d62/d36/fab [0,4194304] 0 2023-12-12T11:52:09.930 INFO:tasks.workunit.client.0.smithi063.stdout:9/658: fdatasync d7/fd 0 2023-12-12T11:52:09.930 INFO:tasks.workunit.client.0.smithi063.stdout:5/813: link d7/d10/d2b/d3c/d27/c60 d7/d10/d2b/d3c/cf6 0 2023-12-12T11:52:09.932 INFO:tasks.workunit.client.0.smithi063.stdout:4/781: creat d2/d17/d9d/ffd x:0 0 0 2023-12-12T11:52:09.934 INFO:tasks.workunit.client.0.smithi063.stdout:3/759: dwrite d4/df/d1a/d1c/d41/f51 [0,4194304] 0 2023-12-12T11:52:09.934 INFO:tasks.workunit.client.0.smithi063.stdout:6/809: dwrite d9/d10/d2a/de7/d8a/f9a [0,4194304] 0 2023-12-12T11:52:09.934 INFO:tasks.workunit.client.0.smithi063.stdout:3/760: write d4/f3f [2206242,24406] 0 2023-12-12T11:52:09.945 INFO:tasks.workunit.client.0.smithi063.stdout:5/814: dread d7/de/f30 [0,4194304] 0 2023-12-12T11:52:09.945 INFO:tasks.workunit.client.0.smithi063.stdout:5/815: chown d7/d10/d2b/d3c/d42/ff0 152352 1 2023-12-12T11:52:09.945 INFO:tasks.workunit.client.0.smithi063.stdout:5/816: fdatasync d7/d10/d2b/d3c/d27/f8e 0 2023-12-12T11:52:09.945 INFO:tasks.workunit.client.0.smithi063.stdout:5/817: chown d7/d28/cc5 1945144 1 2023-12-12T11:52:09.973 INFO:tasks.workunit.client.0.smithi063.stdout:7/716: getdents de/d34/d43 0 2023-12-12T11:52:09.973 INFO:tasks.workunit.client.0.smithi063.stdout:7/717: dread - de/d33/d41/d44/d8b/dde/de6/f100 zero size 2023-12-12T11:52:09.973 INFO:tasks.workunit.client.0.smithi063.stdout:7/718: chown de/d33/d71/fd9 12 1 2023-12-12T11:52:09.973 INFO:tasks.workunit.client.0.smithi063.stdout:7/719: fdatasync de/d33/dd2/d61/f86 0 2023-12-12T11:52:09.973 INFO:tasks.workunit.client.0.smithi063.stdout:7/720: fsync de/d22/d66/fa7 0 2023-12-12T11:52:09.973 INFO:tasks.workunit.client.0.smithi063.stdout:7/721: dread - de/d34/d68/ff3 zero size 2023-12-12T11:52:09.974 INFO:tasks.workunit.client.0.smithi063.stdout:7/722: dread - de/d34/d68/ff3 zero size 2023-12-12T11:52:09.976 INFO:tasks.workunit.client.0.smithi063.stdout:5/818: dwrite d7/de/f84 [0,4194304] 0 2023-12-12T11:52:09.976 INFO:tasks.workunit.client.0.smithi063.stdout:5/819: chown d7/d10/d2b/d3c/d42/d62/db4 288680218 1 2023-12-12T11:52:09.977 INFO:tasks.workunit.client.0.smithi063.stdout:0/830: symlink d0/d1a/d66/l111 0 2023-12-12T11:52:09.980 INFO:tasks.workunit.client.0.smithi063.stdout:7/723: dread de/f21 [0,4194304] 0 2023-12-12T11:52:10.012 INFO:tasks.workunit.client.0.smithi063.stdout:8/859: rmdir d4/d55/d52/d8e/de8 39 2023-12-12T11:52:10.012 INFO:tasks.workunit.client.0.smithi063.stdout:8/860: chown d4/d24/d38/d45/d5b/d107/d62/d36/d7f/f10b 0 1 2023-12-12T11:52:10.017 INFO:tasks.workunit.client.0.smithi063.stdout:9/659: creat d7/d8a/dd6/fd8 x:0 0 0 2023-12-12T11:52:10.022 INFO:tasks.workunit.client.0.smithi063.stdout:4/782: rmdir d2/d48/d69/d98 39 2023-12-12T11:52:10.034 INFO:tasks.workunit.client.0.smithi063.stdout:3/761: creat d4/d23/fe5 x:0 0 0 2023-12-12T11:52:10.039 INFO:tasks.workunit.client.0.smithi063.stdout:0/831: mkdir d0/d1a/d66/d10e/d112 0 2023-12-12T11:52:10.041 INFO:tasks.workunit.client.0.smithi063.stdout:7/724: mknod de/d39/d4b/d7b/d7f/c109 0 2023-12-12T11:52:10.042 INFO:tasks.workunit.client.0.smithi063.stdout:7/725: fdatasync de/d34/d68/d89/fea 0 2023-12-12T11:52:10.051 INFO:tasks.workunit.client.0.smithi063.stdout:9/660: unlink d7/d20/l3b 0 2023-12-12T11:52:10.054 INFO:tasks.workunit.client.0.smithi063.stdout:5/820: write d7/d10/f14 [2617664,82445] 0 2023-12-12T11:52:10.058 INFO:tasks.workunit.client.0.smithi063.stdout:6/810: rmdir d9/d10/d25 39 2023-12-12T11:52:10.058 INFO:tasks.workunit.client.0.smithi063.stdout:6/811: write d9/d2c/f39 [901487,93914] 0 2023-12-12T11:52:10.059 INFO:tasks.workunit.client.0.smithi063.stdout:8/861: dwrite d4/de/f41 [0,4194304] 0 2023-12-12T11:52:10.060 INFO:tasks.workunit.client.0.smithi063.stdout:3/762: stat d4/d23/d6b/cb8 0 2023-12-12T11:52:10.060 INFO:tasks.workunit.client.0.smithi063.stdout:3/763: creat d4/df/d1a/d1c/d34/fe6 x:0 0 0 2023-12-12T11:52:10.060 INFO:tasks.workunit.client.0.smithi063.stdout:3/764: dread - d4/d23/d7b/fd1 zero size 2023-12-12T11:52:10.060 INFO:tasks.workunit.client.0.smithi063.stdout:3/765: truncate d4/d23/d6b/d90/fc3 1688661 0 2023-12-12T11:52:10.060 INFO:tasks.workunit.client.0.smithi063.stdout:3/766: read - d4/d23/d7b/dc2/fcc zero size 2023-12-12T11:52:10.061 INFO:tasks.workunit.client.0.smithi063.stdout:0/832: creat d0/d7/d27/f113 x:0 0 0 2023-12-12T11:52:10.061 INFO:tasks.workunit.client.0.smithi063.stdout:5/821: dread d7/d10/d2b/d3c/d27/f8e [0,4194304] 0 2023-12-12T11:52:10.063 INFO:tasks.workunit.client.0.smithi063.stdout:7/726: creat de/d33/f10a x:0 0 0 2023-12-12T11:52:10.065 INFO:tasks.workunit.client.0.smithi063.stdout:9/661: mknod d7/d20/d45/d46/d51/d64/cd9 0 2023-12-12T11:52:10.066 INFO:tasks.workunit.client.0.smithi063.stdout:4/783: creat d2/d47/d6d/d88/df0/d76/ffe x:0 0 0 2023-12-12T11:52:10.071 INFO:tasks.workunit.client.0.smithi063.stdout:6/812: creat d9/d10/dfc/f11b x:0 0 0 2023-12-12T11:52:10.071 INFO:tasks.workunit.client.0.smithi063.stdout:6/813: write d9/d68/f9d [1977358,43439] 0 2023-12-12T11:52:10.075 INFO:tasks.workunit.client.0.smithi063.stdout:8/862: write d4/d24/d38/d45/f9f [6766608,8031] 0 2023-12-12T11:52:10.077 INFO:tasks.workunit.client.0.smithi063.stdout:3/767: symlink d4/df/d1a/d1c/d57/le7 0 2023-12-12T11:52:10.078 INFO:tasks.workunit.client.0.smithi063.stdout:0/833: symlink d0/d8e/da7/dcf/de9/d110/l114 0 2023-12-12T11:52:10.079 INFO:tasks.workunit.client.0.smithi063.stdout:9/662: dread d7/d15/dc4/f48 [0,4194304] 0 2023-12-12T11:52:10.084 INFO:tasks.workunit.client.0.smithi063.stdout:7/727: rename de/d39/d4b/d7b/fbe to de/d39/d88/db4/f10b 0 2023-12-12T11:52:10.084 INFO:tasks.workunit.client.0.smithi063.stdout:7/728: chown de/d39/c3a 195269 1 2023-12-12T11:52:10.084 INFO:tasks.workunit.client.0.smithi063.stdout:7/729: write de/d39/d4b/ff2 [235723,89247] 0 2023-12-12T11:52:10.088 INFO:tasks.workunit.client.0.smithi063.stdout:3/768: dread d4/df/d1a/d1c/d3b/d50/f97 [0,4194304] 0 2023-12-12T11:52:10.088 INFO:tasks.workunit.client.0.smithi063.stdout:3/769: write d4/df/d1a/d1c/d41/f99 [1039977,117504] 0 2023-12-12T11:52:10.089 INFO:tasks.workunit.client.0.smithi063.stdout:6/814: symlink d9/d68/d8f/d115/l11c 0 2023-12-12T11:52:10.106 INFO:tasks.workunit.client.0.smithi063.stdout:8/863: creat d4/f10d x:0 0 0 2023-12-12T11:52:10.106 INFO:tasks.workunit.client.0.smithi063.stdout:8/864: chown d4/de/d1e/d6d 12320967 1 2023-12-12T11:52:10.112 INFO:tasks.workunit.client.0.smithi063.stdout:9/663: truncate d7/f54 1947934 0 2023-12-12T11:52:10.117 INFO:tasks.workunit.client.0.smithi063.stdout:5/822: rmdir d7/d28/d94 39 2023-12-12T11:52:10.119 INFO:tasks.workunit.client.0.smithi063.stdout:7/730: mkdir de/d39/d60/d10c 0 2023-12-12T11:52:10.119 INFO:tasks.workunit.client.0.smithi063.stdout:7/731: fsync de/d33/fd4 0 2023-12-12T11:52:10.126 INFO:tasks.workunit.client.0.smithi063.stdout:3/770: creat d4/df/d1a/d1c/d41/de2/fe8 x:0 0 0 2023-12-12T11:52:10.126 INFO:tasks.workunit.client.0.smithi063.stdout:3/771: read - d4/df/d1a/d1c/d34/fe6 zero size 2023-12-12T11:52:10.126 INFO:tasks.workunit.client.0.smithi063.stdout:9/664: dread d7/f27 [0,4194304] 0 2023-12-12T11:52:10.130 INFO:tasks.workunit.client.0.smithi063.stdout:5/823: write d7/de/f9c [1117912,24653] 0 2023-12-12T11:52:10.131 INFO:tasks.workunit.client.0.smithi063.stdout:6/815: unlink d9/d10/d7a/l105 0 2023-12-12T11:52:10.131 INFO:tasks.workunit.client.0.smithi063.stdout:0/834: dwrite d0/d1a/d23/d34/d42/fbd [0,4194304] 0 2023-12-12T11:52:10.131 INFO:tasks.workunit.client.0.smithi063.stdout:1/844: sync 2023-12-12T11:52:10.132 INFO:tasks.workunit.client.0.smithi063.stdout:0/835: fdatasync d0/d1a/d23/d34/d42/f73 0 2023-12-12T11:52:10.132 INFO:tasks.workunit.client.0.smithi063.stdout:5/824: read d7/d28/d6e/dad/dba/fc9 [418862,73102] 0 2023-12-12T11:52:10.139 INFO:tasks.workunit.client.0.smithi063.stdout:7/732: symlink de/d3f/dc3/l10d 0 2023-12-12T11:52:10.140 INFO:tasks.workunit.client.0.smithi063.stdout:4/784: getdents d2/d48/d4f 0 2023-12-12T11:52:10.143 INFO:tasks.workunit.client.0.smithi063.stdout:9/665: mknod d7/d20/d45/d46/d51/cda 0 2023-12-12T11:52:10.149 INFO:tasks.workunit.client.0.smithi063.stdout:6/816: link d9/d10/d25/cc8 d9/d10/d25/c11d 0 2023-12-12T11:52:10.150 INFO:tasks.workunit.client.0.smithi063.stdout:1/845: rename d3/d3a/d52/ddf/d113 to d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2/d115 0 2023-12-12T11:52:10.156 INFO:tasks.workunit.client.0.smithi063.stdout:6/817: dread d9/d10/d2a/dc3/fc5 [0,4194304] 0 2023-12-12T11:52:10.156 INFO:tasks.workunit.client.0.smithi063.stdout:6/818: creat d9/d10/d2a/de7/d86/dc2/ded/f11e x:0 0 0 2023-12-12T11:52:10.157 INFO:tasks.workunit.client.0.smithi063.stdout:2/719: sync 2023-12-12T11:52:10.164 INFO:tasks.workunit.client.0.smithi063.stdout:4/785: mkdir d2/d47/d6d/dff 0 2023-12-12T11:52:10.164 INFO:tasks.workunit.client.0.smithi063.stdout:4/786: fdatasync d2/d48/d69/fef 0 2023-12-12T11:52:10.164 INFO:tasks.workunit.client.0.smithi063.stdout:4/787: fsync d2/d48/fac 0 2023-12-12T11:52:10.164 INFO:tasks.workunit.client.0.smithi063.stdout:7/733: write de/f13 [1285699,22837] 0 2023-12-12T11:52:10.169 INFO:tasks.workunit.client.0.smithi063.stdout:9/666: rename f6 to d7/d20/d45/d46/d51/d64/fdb 0 2023-12-12T11:52:10.170 INFO:tasks.workunit.client.0.smithi063.stdout:1/846: symlink d3/d3a/dd7/d16/d4f/da7/df8/l116 0 2023-12-12T11:52:10.171 INFO:tasks.workunit.client.0.smithi063.stdout:0/836: rmdir d0/d7/d27/d1f/dc4/d67/dcb 39 2023-12-12T11:52:10.171 INFO:tasks.workunit.client.0.smithi063.stdout:0/837: chown d0/d1a/d23/d34/d42/f10c 719 1 2023-12-12T11:52:10.173 INFO:tasks.workunit.client.0.smithi063.stdout:6/819: symlink d9/d10/d2a/de7/d86/dc2/l11f 0 2023-12-12T11:52:10.175 INFO:tasks.workunit.client.0.smithi063.stdout:9/667: dread d7/d20/d3f/d40/d76/f8c [0,4194304] 0 2023-12-12T11:52:10.175 INFO:tasks.workunit.client.0.smithi063.stdout:9/668: chown d7/d15/dc4/d3e/dbb 11093534 1 2023-12-12T11:52:10.176 INFO:tasks.workunit.client.0.smithi063.stdout:5/825: write d7/f1a [1540602,124721] 0 2023-12-12T11:52:10.177 INFO:tasks.workunit.client.0.smithi063.stdout:1/847: rename d3/d3a/dd7/d16/l44 to d3/d3a/dd7/d16/d24/d48/d75/d83/d5b/d6b/d103/l117 0 2023-12-12T11:52:10.179 INFO:tasks.workunit.client.0.smithi063.stdout:3/772: dwrite d4/df/f19 [0,4194304] 0 2023-12-12T11:52:10.181 INFO:tasks.workunit.client.0.smithi063.stdout:5/826: mknod d7/d10/d2b/d3c/d27/dcd/cf7 0 2023-12-12T11:52:10.181 INFO:tasks.workunit.client.0.smithi063.stdout:5/827: chown d7/d28/d43/d49/c50 1531986 1 2023-12-12T11:52:10.182 INFO:tasks.workunit.client.0.smithi063.stdout:1/848: rmdir d3/d3a/dd7/d16/d4f/da7/dca 39 2023-12-12T11:52:10.187 INFO:tasks.workunit.client.0.smithi063.stdout:0/838: mkdir d0/d7/d115 0 2023-12-12T11:52:10.187 INFO:tasks.workunit.client.0.smithi063.stdout:2/720: read d0/f4 [463487,81708] 0 2023-12-12T11:52:10.187 INFO:tasks.workunit.client.0.smithi063.stdout:4/788: write d2/d48/fac [914960,98318] 0 2023-12-12T11:52:10.187 INFO:tasks.workunit.client.0.smithi063.stdout:4/789: chown d2/d47/d6d/d88/df0/d76/cea 2419 1 2023-12-12T11:52:10.187 INFO:tasks.workunit.client.0.smithi063.stdout:4/790: chown d2/d47/d6d/d88/df0/l36 53 1 2023-12-12T11:52:10.188 INFO:tasks.workunit.client.0.smithi063.stdout:9/669: rmdir d7/d20/d3f/d40/d76 39 2023-12-12T11:52:10.191 INFO:tasks.workunit.client.0.smithi063.stdout:5/828: symlink d7/de/lf8 0 2023-12-12T11:52:10.196 INFO:tasks.workunit.client.0.smithi063.stdout:1/849: write d3/d3a/dd7/d16/d4f/d9a/fab [1786311,22189] 0 2023-12-12T11:52:10.201 INFO:tasks.workunit.client.0.smithi063.stdout:2/721: unlink d0/d1a/d3a/d59/f7e 0 2023-12-12T11:52:10.201 INFO:tasks.workunit.client.0.smithi063.stdout:4/791: mknod d2/d48/d69/c100 0 2023-12-12T11:52:10.203 INFO:tasks.workunit.client.0.smithi063.stdout:5/829: rename d7/d10/d2b/d3c/d5a/dbb/dbc/lcf to d7/d10/d2b/d3c/d5a/dd9/lf9 0 2023-12-12T11:52:10.205 INFO:tasks.workunit.client.0.smithi063.stdout:1/850: symlink d3/d3a/dd7/d16/d24/d48/d75/l118 0 2023-12-12T11:52:10.205 INFO:tasks.workunit.client.0.smithi063.stdout:1/851: dread - d3/d3a/dd7/d16/ffc zero size 2023-12-12T11:52:10.215 INFO:tasks.workunit.client.0.smithi063.stdout:2/722: unlink d0/d1a/d1e/d64/l72 0 2023-12-12T11:52:10.215 INFO:tasks.workunit.client.0.smithi063.stdout:2/723: chown d0/d1a/d48/d56/lc9 714519381 1 2023-12-12T11:52:10.217 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:09 smithi063 ceph-mon[107117]: pgmap v19: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 245 MiB/s rd, 277 MiB/s wr, 434 op/s 2023-12-12T11:52:10.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:09 smithi093 ceph-mon[115914]: pgmap v19: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 245 MiB/s rd, 277 MiB/s wr, 434 op/s 2023-12-12T11:52:10.230 INFO:tasks.workunit.client.0.smithi063.stdout:5/830: mknod d7/d10/d2b/cfa 0 2023-12-12T11:52:10.230 INFO:tasks.workunit.client.0.smithi063.stdout:1/852: dread d3/d3a/dd7/d16/d24/d4d/f3e [0,4194304] 0 2023-12-12T11:52:10.230 INFO:tasks.workunit.client.0.smithi063.stdout:1/853: write d3/fc5 [244949,29252] 0 2023-12-12T11:52:10.230 INFO:tasks.workunit.client.0.smithi063.stdout:4/792: creat d2/d17/df8/f101 x:0 0 0 2023-12-12T11:52:10.233 INFO:tasks.workunit.client.0.smithi063.stdout:1/854: rmdir d3/d3a/d54 39 2023-12-12T11:52:10.236 INFO:tasks.workunit.client.0.smithi063.stdout:1/855: symlink d3/d3a/dd7/d16/d24/d4d/df9/l119 0 2023-12-12T11:52:10.242 INFO:tasks.workunit.client.0.smithi063.stdout:1/856: creat d3/d3a/dd7/f11a x:0 0 0 2023-12-12T11:52:10.245 INFO:tasks.workunit.client.0.smithi063.stdout:1/857: creat d3/d3a/dd7/d12/d107/f11b x:0 0 0 2023-12-12T11:52:10.245 INFO:tasks.workunit.client.0.smithi063.stdout:9/670: dwrite d7/d15/dc4/d3e/dbb/fc8 [0,4194304] 0 2023-12-12T11:52:10.250 INFO:tasks.workunit.client.0.smithi063.stdout:9/671: truncate d7/d15/f8f 2998031 0 2023-12-12T11:52:10.250 INFO:tasks.workunit.client.0.smithi063.stdout:9/672: chown d7/d20/d3f/d40/f44 3620 1 2023-12-12T11:52:10.253 INFO:tasks.workunit.client.0.smithi063.stdout:9/673: unlink d7/d20/d45/d46/d51/d64/d6f/d85/lc1 0 2023-12-12T11:52:10.253 INFO:tasks.workunit.client.0.smithi063.stdout:9/674: chown d7/d11/c49 62 1 2023-12-12T11:52:10.253 INFO:tasks.workunit.client.0.smithi063.stdout:9/675: chown d7/d20/d45/fa5 38 1 2023-12-12T11:52:10.253 INFO:tasks.workunit.client.0.smithi063.stdout:9/676: chown d7/d20/d3f/d40/f44 328 1 2023-12-12T11:52:10.253 INFO:tasks.workunit.client.0.smithi063.stdout:9/677: fsync d7/d20/d45/d46/d51/d64/fb8 0 2023-12-12T11:52:10.255 INFO:tasks.workunit.client.0.smithi063.stdout:9/678: mkdir d7/d20/d3f/d40/ddc 0 2023-12-12T11:52:10.255 INFO:tasks.workunit.client.0.smithi063.stdout:9/679: fdatasync d7/f1e 0 2023-12-12T11:52:10.258 INFO:tasks.workunit.client.0.smithi063.stdout:6/820: dwrite d9/d10/d2a/de7/f72 [0,4194304] 0 2023-12-12T11:52:10.258 INFO:tasks.workunit.client.0.smithi063.stdout:9/680: mknod d7/d20/cdd 0 2023-12-12T11:52:10.260 INFO:tasks.workunit.client.0.smithi063.stdout:3/773: dwrite d4/f76 [0,4194304] 0 2023-12-12T11:52:10.262 INFO:tasks.workunit.client.0.smithi063.stdout:6/821: rename d9/d10/d2a/de7/d86/dc2/f11a to d9/d68/d94/f120 0 2023-12-12T11:52:10.262 INFO:tasks.workunit.client.0.smithi063.stdout:6/822: read - d9/d10/d2a/de7/d86/dc2/ded/f11e zero size 2023-12-12T11:52:10.262 INFO:tasks.workunit.client.0.smithi063.stdout:6/823: fdatasync d9/d68/f90 0 2023-12-12T11:52:10.262 INFO:tasks.workunit.client.0.smithi063.stdout:6/824: write d9/d68/d94/f107 [714655,116503] 0 2023-12-12T11:52:10.262 INFO:tasks.workunit.client.0.smithi063.stdout:0/839: dwrite d0/d1a/d23/d2e/f5e [0,4194304] 0 2023-12-12T11:52:10.272 INFO:tasks.workunit.client.0.smithi063.stdout:6/825: mkdir d9/d10/d2a/de7/d86/dc2/ded/df5/d121 0 2023-12-12T11:52:10.272 INFO:tasks.workunit.client.0.smithi063.stdout:6/826: creat d9/d10/d2a/de7/d86/dc2/ded/f122 x:0 0 0 2023-12-12T11:52:10.279 INFO:tasks.workunit.client.0.smithi063.stdout:3/774: write d4/df/f19 [2781230,17361] 0 2023-12-12T11:52:10.279 INFO:tasks.workunit.client.0.smithi063.stdout:1/858: dread d3/d3a/dd7/d16/d24/d4d/f68 [0,4194304] 0 2023-12-12T11:52:10.279 INFO:tasks.workunit.client.0.smithi063.stdout:1/859: fsync d3/d3a/dd7/d16/d17/d4b/f108 0 2023-12-12T11:52:10.283 INFO:tasks.workunit.client.0.smithi063.stdout:2/724: dwrite d0/f5f [0,4194304] 0 2023-12-12T11:52:10.283 INFO:tasks.workunit.client.0.smithi063.stdout:6/827: creat d9/d2c/d61/f123 x:0 0 0 2023-12-12T11:52:10.298 INFO:tasks.workunit.client.0.smithi063.stdout:0/840: rename d0/d7/d27/d1f/dc4/d67 to d0/d1a/d23/d2e/dad/d116 0 2023-12-12T11:52:10.303 INFO:tasks.workunit.client.0.smithi063.stdout:5/831: dwrite d7/d10/d2b/d3c/d42/d62/fa1 [4194304,4194304] 0 2023-12-12T11:52:10.303 INFO:tasks.workunit.client.0.smithi063.stdout:5/832: chown d7/d10/d2b/d3c/d42/d76 934 1 2023-12-12T11:52:10.304 INFO:tasks.workunit.client.0.smithi063.stdout:3/775: mkdir d4/d23/d6b/d90/de9 0 2023-12-12T11:52:10.304 INFO:tasks.workunit.client.0.smithi063.stdout:3/776: fsync d4/df/d1a/d1c/d57/f6c 0 2023-12-12T11:52:10.306 INFO:tasks.workunit.client.0.smithi063.stdout:5/833: read d7/d10/d2b/d3c/d42/d62/d69/fbf [737009,71020] 0 2023-12-12T11:52:10.306 INFO:tasks.workunit.client.0.smithi063.stdout:5/834: chown d7/d10/d2b/d3c/d42 156 1 2023-12-12T11:52:10.311 INFO:tasks.workunit.client.0.smithi063.stdout:4/793: dwrite d2/d47/d6d/d88/df0/d76/ffe [0,4194304] 0 2023-12-12T11:52:10.314 INFO:tasks.workunit.client.0.smithi063.stdout:0/841: symlink d0/d1a/d66/l117 0 2023-12-12T11:52:10.314 INFO:tasks.workunit.client.0.smithi063.stdout:0/842: truncate d0/d1a/d23/d34/fd5 4679144 0 2023-12-12T11:52:10.314 INFO:tasks.workunit.client.0.smithi063.stdout:0/843: truncate d0/d1a/d23/fbe 1245592 0 2023-12-12T11:52:10.323 INFO:tasks.workunit.client.0.smithi063.stdout:9/681: getdents d7/d20/d3f/d40 0 2023-12-12T11:52:10.323 INFO:tasks.workunit.client.0.smithi063.stdout:9/682: write d7/d11/d94/fb4 [4732155,1912] 0 2023-12-12T11:52:10.323 INFO:tasks.workunit.client.0.smithi063.stdout:9/683: dread - d7/d20/d3f/d40/d76/f9d zero size 2023-12-12T11:52:10.323 INFO:tasks.workunit.client.0.smithi063.stdout:9/684: readlink d7/d20/d3f/ld4 0 2023-12-12T11:52:10.323 INFO:tasks.workunit.client.0.smithi063.stdout:9/685: fsync d7/d15/db2/fcc 0 2023-12-12T11:52:10.323 INFO:tasks.workunit.client.0.smithi063.stdout:1/860: dwrite d3/d3a/dd7/d12/d107/f110 [0,4194304] 0 2023-12-12T11:52:10.323 INFO:tasks.workunit.client.0.smithi063.stdout:1/861: readlink d3/d3a/dd7/d12/l15 0 2023-12-12T11:52:10.323 INFO:tasks.workunit.client.0.smithi063.stdout:1/862: write d3/d3a/dd7/d16/d4f/d9a/fc6 [818631,48711] 0 2023-12-12T11:52:10.324 INFO:tasks.workunit.client.0.smithi063.stdout:3/777: mkdir d4/d23/d7b/dea 0 2023-12-12T11:52:10.333 INFO:tasks.workunit.client.0.smithi063.stdout:4/794: rename d2/d47/l3b to d2/d17/d4e/l102 0 2023-12-12T11:52:10.333 INFO:tasks.workunit.client.0.smithi063.stdout:3/778: rename d4/df to d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d56/deb 22 2023-12-12T11:52:10.333 INFO:tasks.workunit.client.0.smithi063.stdout:3/779: write d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/fae [271350,70985] 0 2023-12-12T11:52:10.334 INFO:tasks.workunit.client.0.smithi063.stdout:0/844: symlink d0/d1a/d23/d2e/l118 0 2023-12-12T11:52:10.340 INFO:tasks.workunit.client.0.smithi063.stdout:1/863: creat d3/d3a/dd7/d16/d24/d48/d75/d83/d5b/d106/f11c x:0 0 0 2023-12-12T11:52:10.342 INFO:tasks.workunit.client.0.smithi063.stdout:5/835: rmdir d7/d10/d2b/d3c/d27 39 2023-12-12T11:52:10.342 INFO:tasks.workunit.client.0.smithi063.stdout:2/725: dwrite d0/d1a/d48/f34 [4194304,4194304] 0 2023-12-12T11:52:10.345 INFO:tasks.workunit.client.0.smithi063.stdout:4/795: unlink d2/d17/d41/ffc 0 2023-12-12T11:52:10.348 INFO:tasks.workunit.client.0.smithi063.stdout:3/780: creat d4/df/d1a/d1c/d3b/d52/d78/da5/dbc/fec x:0 0 0 2023-12-12T11:52:10.355 INFO:tasks.workunit.client.0.smithi063.stdout:5/836: dread d7/d10/d2b/d3c/d42/d76/fae [0,4194304] 0 2023-12-12T11:52:10.359 INFO:tasks.workunit.client.0.smithi063.stdout:0/845: link d0/d1a/d23/d34/d42/f5d d0/d1a/d23/f119 0 2023-12-12T11:52:10.359 INFO:tasks.workunit.client.0.smithi063.stdout:0/846: dread - d0/d1a/d23/d34/d42/f10c zero size 2023-12-12T11:52:10.362 INFO:tasks.workunit.client.0.smithi063.stdout:1/864: unlink d3/c8 0 2023-12-12T11:52:10.364 INFO:tasks.workunit.client.0.smithi063.stdout:2/726: symlink d0/d1a/d48/d56/le0 0 2023-12-12T11:52:10.364 INFO:tasks.workunit.client.0.smithi063.stdout:4/796: dread d2/d47/f31 [0,4194304] 0 2023-12-12T11:52:10.364 INFO:tasks.workunit.client.0.smithi063.stdout:4/797: stat d2/d47/d6d/d88/df0/fcd 0 2023-12-12T11:52:10.368 INFO:tasks.workunit.client.0.smithi063.stdout:5/837: rename d7/d10/d2b/f4b to d7/d28/d6e/dad/dba/ffb 0 2023-12-12T11:52:10.370 INFO:tasks.workunit.client.0.smithi063.stdout:4/798: truncate d2/d17/f3c 167335 0 2023-12-12T11:52:10.373 INFO:tasks.workunit.client.0.smithi063.stdout:1/865: rename d3/d3a/dd7/d12/c1f to d3/d3a/dd7/d16/db8/c11d 0 2023-12-12T11:52:10.373 INFO:tasks.workunit.client.0.smithi063.stdout:1/866: readlink d3/d3a/dd7/d16/d24/d48/d75/d83/l7b 0 2023-12-12T11:52:10.373 INFO:tasks.workunit.client.0.smithi063.stdout:1/867: dread - d3/d3a/dd7/d16/d24/d48/d75/fe8 zero size 2023-12-12T11:52:10.377 INFO:tasks.workunit.client.0.smithi063.stdout:4/799: getdents d2/d47/d6d/d88/df0/db3/dc1 0 2023-12-12T11:52:10.379 INFO:tasks.workunit.client.0.smithi063.stdout:2/727: rename d0/f17 to d0/d1a/d3a/d85/dd5/fe1 0 2023-12-12T11:52:10.379 INFO:tasks.workunit.client.0.smithi063.stdout:2/728: getdents d0/d1a/d3a/d59/ddb 0 2023-12-12T11:52:10.382 INFO:tasks.workunit.client.0.smithi063.stdout:2/729: chown d0/d41/daf 2991 1 2023-12-12T11:52:10.384 INFO:tasks.workunit.client.0.smithi063.stdout:4/800: symlink d2/d17/d41/df2/l103 0 2023-12-12T11:52:10.386 INFO:tasks.workunit.client.0.smithi063.stdout:1/868: dread d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2/d7e/f9d [0,4194304] 0 2023-12-12T11:52:10.392 INFO:tasks.workunit.client.0.smithi063.stdout:4/801: link d2/d48/c89 d2/d47/d6d/d88/df0/ddf/c104 0 2023-12-12T11:52:10.393 INFO:tasks.workunit.client.0.smithi063.stdout:4/802: readlink d2/d17/l29 0 2023-12-12T11:52:10.393 INFO:tasks.workunit.client.0.smithi063.stdout:4/803: truncate d2/d47/d6d/d88/df0/d76/ffe 4507947 0 2023-12-12T11:52:10.393 INFO:tasks.workunit.client.0.smithi063.stdout:4/804: fsync d2/d17/d7f/fb5 0 2023-12-12T11:52:10.393 INFO:tasks.workunit.client.0.smithi063.stdout:4/805: dread - d2/d17/d9d/ffd zero size 2023-12-12T11:52:10.396 INFO:tasks.workunit.client.0.smithi063.stdout:2/730: dread d0/d1a/d48/d56/da2/fb2 [0,4194304] 0 2023-12-12T11:52:10.396 INFO:tasks.workunit.client.0.smithi063.stdout:2/731: fsync d0/ff 0 2023-12-12T11:52:10.397 INFO:tasks.workunit.client.0.smithi063.stdout:1/869: link d3/d3a/dd7/d12/l15 d3/d3a/d52/ddf/l11e 0 2023-12-12T11:52:10.401 INFO:tasks.workunit.client.0.smithi063.stdout:1/870: truncate d3/d3a/dd7/d16/d17/d4b/fe4 1734974 0 2023-12-12T11:52:10.404 INFO:tasks.workunit.client.0.smithi063.stdout:2/732: rmdir d0/d1a/d3a/d59 39 2023-12-12T11:52:10.405 INFO:tasks.workunit.client.0.smithi063.stdout:1/871: symlink d3/d3a/dd7/d16/d4f/da7/l11f 0 2023-12-12T11:52:10.405 INFO:tasks.workunit.client.0.smithi063.stdout:1/872: fsync d3/d3a/dd7/d16/d24/d4d/f2c 0 2023-12-12T11:52:10.409 INFO:tasks.workunit.client.0.smithi063.stdout:1/873: rename d3/d3a/dd7/d16/ffc to d3/d3a/dd7/d16/d24/d48/d75/d83/d5b/d106/f120 0 2023-12-12T11:52:10.414 INFO:tasks.workunit.client.0.smithi063.stdout:1/874: mkdir d3/d3a/dd7/d16/d24/d48/d75/d121 0 2023-12-12T11:52:10.416 INFO:tasks.workunit.client.0.smithi063.stdout:1/875: creat d3/d3a/dd7/d16/d17/d104/f122 x:0 0 0 2023-12-12T11:52:10.419 INFO:tasks.workunit.client.0.smithi063.stdout:1/876: link d3/d3a/dd7/d16/d24/d48/d75/fe8 d3/d3a/dd7/d16/d24/d48/d75/d83/d5b/d106/f123 0 2023-12-12T11:52:10.424 INFO:tasks.workunit.client.0.smithi063.stdout:1/877: creat d3/d3a/dd7/d16/d4f/da7/df8/f124 x:0 0 0 2023-12-12T11:52:10.424 INFO:tasks.workunit.client.0.smithi063.stdout:1/878: stat d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2/f114 0 2023-12-12T11:52:10.424 INFO:tasks.workunit.client.0.smithi063.stdout:1/879: write d3/d3a/dd7/f20 [5139363,70155] 0 2023-12-12T11:52:10.426 INFO:tasks.workunit.client.0.smithi063.stdout:5/838: dwrite d7/d10/d2b/d3c/d42/d62/d69/dcb/de0/fe2 [0,4194304] 0 2023-12-12T11:52:10.430 INFO:tasks.workunit.client.0.smithi063.stdout:5/839: truncate d7/d10/d2b/d3c/d42/d76/f78 2729821 0 2023-12-12T11:52:10.435 INFO:tasks.workunit.client.0.smithi063.stdout:9/686: dwrite d7/d15/dc4/d3e/d55/f81 [0,4194304] 0 2023-12-12T11:52:10.436 INFO:tasks.workunit.client.0.smithi063.stdout:3/781: dread d4/f44 [0,4194304] 0 2023-12-12T11:52:10.436 INFO:tasks.workunit.client.0.smithi063.stdout:9/687: write d7/d20/d3f/d40/fc0 [155598,120922] 0 2023-12-12T11:52:10.436 INFO:tasks.workunit.client.0.smithi063.stdout:5/840: mknod d7/d28/d67/cfc 0 2023-12-12T11:52:10.436 INFO:tasks.workunit.client.0.smithi063.stdout:5/841: chown d7/d28/d94/laf 873584 1 2023-12-12T11:52:10.437 INFO:tasks.workunit.client.0.smithi063.stdout:5/842: creat d7/d28/df1/ffd x:0 0 0 2023-12-12T11:52:10.440 INFO:tasks.workunit.client.0.smithi063.stdout:3/782: creat d4/df/d1a/d1c/d3b/d52/fed x:0 0 0 2023-12-12T11:52:10.442 INFO:tasks.workunit.client.0.smithi063.stdout:9/688: creat d7/d20/d3f/d40/d76/fde x:0 0 0 2023-12-12T11:52:10.443 INFO:tasks.workunit.client.0.smithi063.stdout:9/689: write d7/fa [2631058,16465] 0 2023-12-12T11:52:10.448 INFO:tasks.workunit.client.0.smithi063.stdout:4/806: dwrite d2/d17/d4e/f91 [0,4194304] 0 2023-12-12T11:52:10.452 INFO:tasks.workunit.client.0.smithi063.stdout:5/843: mknod d7/d28/d94/dd6/cfe 0 2023-12-12T11:52:10.452 INFO:tasks.workunit.client.0.smithi063.stdout:3/783: unlink d4/df/d1a/d1c/d57/le7 0 2023-12-12T11:52:10.452 INFO:tasks.workunit.client.0.smithi063.stdout:5/844: fsync d7/d10/d2b/d3c/d42/d76/fd3 0 2023-12-12T11:52:10.455 INFO:tasks.workunit.client.0.smithi063.stdout:9/690: symlink d7/d20/d45/d46/d51/dc3/ldf 0 2023-12-12T11:52:10.464 INFO:tasks.workunit.client.0.smithi063.stdout:0/847: dwrite d0/d1a/d23/fa8 [0,4194304] 0 2023-12-12T11:52:10.488 INFO:tasks.workunit.client.0.smithi063.stdout:0/848: dread d0/d7/d27/d19/fc1 [4194304,4194304] 0 2023-12-12T11:52:10.488 INFO:tasks.workunit.client.0.smithi063.stdout:0/849: fsync d0/d1a/d23/fbe 0 2023-12-12T11:52:10.538 INFO:tasks.workunit.client.0.smithi063.stdout:4/807: link d2/d17/d9d/fbc d2/d17/df8/f105 0 2023-12-12T11:52:10.538 INFO:tasks.workunit.client.0.smithi063.stdout:4/808: write d2/d47/d6d/d88/fa6 [2899334,121696] 0 2023-12-12T11:52:10.539 INFO:tasks.workunit.client.0.smithi063.stdout:4/809: write d2/d48/f6e [461283,28862] 0 2023-12-12T11:52:10.544 INFO:tasks.workunit.client.0.smithi063.stdout:9/691: dwrite d7/d11/d4b/f6d [0,4194304] 0 2023-12-12T11:52:10.544 INFO:tasks.workunit.client.0.smithi063.stdout:1/880: dwrite d3/d3a/dd7/d16/d17/d4b/fe4 [0,4194304] 0 2023-12-12T11:52:10.548 INFO:tasks.workunit.client.0.smithi063.stdout:3/784: mknod d4/df/d1a/d1c/d3b/d52/d74/cee 0 2023-12-12T11:52:10.552 INFO:tasks.workunit.client.0.smithi063.stdout:5/845: dwrite d7/d10/f92 [0,4194304] 0 2023-12-12T11:52:10.568 INFO:tasks.workunit.client.0.smithi063.stdout:0/850: truncate d0/d1a/d23/f7e 842052 0 2023-12-12T11:52:10.571 INFO:tasks.workunit.client.0.smithi063.stdout:4/810: creat d2/d47/d6d/d88/de6/df3/f106 x:0 0 0 2023-12-12T11:52:10.575 INFO:tasks.workunit.client.0.smithi063.stdout:9/692: creat d7/d20/daf/fe0 x:0 0 0 2023-12-12T11:52:10.578 INFO:tasks.workunit.client.0.smithi063.stdout:1/881: creat d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2/d115/f125 x:0 0 0 2023-12-12T11:52:10.581 INFO:tasks.workunit.client.0.smithi063.stdout:3/785: link d4/df/f19 d4/d23/d6b/dda/fef 0 2023-12-12T11:52:10.587 INFO:tasks.workunit.client.0.smithi063.stdout:5/846: rename d7/d28/d6e/f39 to d7/d10/d2b/fff 0 2023-12-12T11:52:10.587 INFO:tasks.workunit.client.0.smithi063.stdout:5/847: dread - d7/d28/d43/fdb zero size 2023-12-12T11:52:10.592 INFO:tasks.workunit.client.0.smithi063.stdout:4/811: creat d2/d17/d41/dd7/f107 x:0 0 0 2023-12-12T11:52:10.599 INFO:tasks.workunit.client.0.smithi063.stdout:9/693: symlink d7/d15/db2/le1 0 2023-12-12T11:52:10.603 INFO:tasks.workunit.client.0.smithi063.stdout:4/812: write d2/d48/d4f/fe4 [88761,115504] 0 2023-12-12T11:52:10.605 INFO:tasks.workunit.client.0.smithi063.stdout:3/786: rename d4/df/d1a/d1c/d34/c60 to d4/df/d1a/d1c/d57/cf0 0 2023-12-12T11:52:10.609 INFO:tasks.workunit.client.0.smithi063.stdout:9/694: symlink d7/d15/le2 0 2023-12-12T11:52:10.612 INFO:tasks.workunit.client.0.smithi063.stdout:4/813: getdents d2/d17/d4e/dd9 0 2023-12-12T11:52:10.612 INFO:tasks.workunit.client.0.smithi063.stdout:4/814: stat d2/d17/d7f/fa4 0 2023-12-12T11:52:10.614 INFO:tasks.workunit.client.0.smithi063.stdout:0/851: dwrite d0/d7/d27/fc9 [0,4194304] 0 2023-12-12T11:52:10.617 INFO:tasks.workunit.client.0.smithi063.stdout:5/848: rename d7/de/l1d to d7/d10/d2b/d3c/d5a/de9/l100 0 2023-12-12T11:52:10.617 INFO:tasks.workunit.client.0.smithi063.stdout:5/849: creat d7/d10/d2b/d3c/d42/d62/d69/dcb/de0/f101 x:0 0 0 2023-12-12T11:52:10.623 INFO:tasks.workunit.client.0.smithi063.stdout:9/695: mkdir d7/d8a/dd6/de3 0 2023-12-12T11:52:10.624 INFO:tasks.workunit.client.0.smithi063.stdout:4/815: creat d2/d17/d4e/dd9/f108 x:0 0 0 2023-12-12T11:52:10.630 INFO:tasks.workunit.client.0.smithi063.stdout:9/696: dread d7/d15/dc4/f8b [0,4194304] 0 2023-12-12T11:52:10.633 INFO:tasks.workunit.client.0.smithi063.stdout:4/816: mknod d2/d17/d9d/df5/c109 0 2023-12-12T11:52:10.633 INFO:tasks.workunit.client.0.smithi063.stdout:4/817: write d2/d47/d6d/d88/df0/fcd [3917492,123871] 0 2023-12-12T11:52:10.643 INFO:tasks.workunit.client.0.smithi063.stdout:9/697: rename d7/d20/lae to d7/d20/d45/d46/d51/d64/d6f/le4 0 2023-12-12T11:52:10.643 INFO:tasks.workunit.client.0.smithi063.stdout:4/818: mkdir d2/d17/d7f/d10a 0 2023-12-12T11:52:10.643 INFO:tasks.workunit.client.0.smithi063.stdout:5/850: dread d7/de/f1e [0,4194304] 0 2023-12-12T11:52:10.643 INFO:tasks.workunit.client.0.smithi063.stdout:4/819: truncate d2/d47/d6d/d88/df0/fa 1460255 0 2023-12-12T11:52:10.643 INFO:tasks.workunit.client.0.smithi063.stdout:1/882: dwrite d3/d3a/dd7/d16/d24/d48/f84 [0,4194304] 0 2023-12-12T11:52:10.643 INFO:tasks.workunit.client.0.smithi063.stdout:1/883: write d3/d3a/dd7/f11a [907812,13741] 0 2023-12-12T11:52:10.650 INFO:tasks.workunit.client.0.smithi063.stdout:5/851: truncate d7/d10/d2b/f58 1235160 0 2023-12-12T11:52:10.650 INFO:tasks.workunit.client.0.smithi063.stdout:5/852: creat d7/de/f102 x:0 0 0 2023-12-12T11:52:10.659 INFO:tasks.workunit.client.0.smithi063.stdout:8/865: sync 2023-12-12T11:52:10.659 INFO:tasks.workunit.client.0.smithi063.stdout:8/866: stat d4/de/d11 0 2023-12-12T11:52:10.661 INFO:tasks.workunit.client.0.smithi063.stdout:4/820: rmdir d2/d48 39 2023-12-12T11:52:10.662 INFO:tasks.workunit.client.0.smithi063.stdout:1/884: unlink d3/d3a/dd7/d16/d24/d48/d75/d83/d81/c100 0 2023-12-12T11:52:10.667 INFO:tasks.workunit.client.0.smithi063.stdout:0/852: dwrite d0/d1a/d23/d2e/ffc [0,4194304] 0 2023-12-12T11:52:10.672 INFO:tasks.workunit.client.0.smithi063.stdout:1/885: rmdir d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2/d112 0 2023-12-12T11:52:10.678 INFO:tasks.workunit.client.0.smithi063.stdout:6/828: sync 2023-12-12T11:52:10.678 INFO:tasks.workunit.client.0.smithi063.stdout:2/733: sync 2023-12-12T11:52:10.678 INFO:tasks.workunit.client.0.smithi063.stdout:7/734: sync 2023-12-12T11:52:10.678 INFO:tasks.workunit.client.0.smithi063.stdout:6/829: write d9/d10/d25/fb1 [4902097,98155] 0 2023-12-12T11:52:10.687 INFO:tasks.workunit.client.0.smithi063.stdout:0/853: link d0/d1a/d23/d34/d42/l18 d0/d1a/d23/d2e/dd4/ddc/de0/l11a 0 2023-12-12T11:52:10.692 INFO:tasks.workunit.client.0.smithi063.stdout:8/867: write d4/de/f30 [3415405,24962] 0 2023-12-12T11:52:10.692 INFO:tasks.workunit.client.0.smithi063.stdout:6/830: dread d9/d10/d2a/de7/d86/fbe [0,4194304] 0 2023-12-12T11:52:10.693 INFO:tasks.workunit.client.0.smithi063.stdout:1/886: link d3/d3a/dd7/d16/d24/d48/d75/d83/d81/c111 d3/d3a/c126 0 2023-12-12T11:52:10.701 INFO:tasks.workunit.client.0.smithi063.stdout:4/821: write d2/f6 [1467875,110709] 0 2023-12-12T11:52:10.701 INFO:tasks.workunit.client.0.smithi063.stdout:4/822: dread - d2/d17/d4e/feb zero size 2023-12-12T11:52:10.701 INFO:tasks.workunit.client.0.smithi063.stdout:4/823: dread - d2/d17/d4e/feb zero size 2023-12-12T11:52:10.701 INFO:tasks.workunit.client.0.smithi063.stdout:4/824: fsync d2/d48/d4f/f68 0 2023-12-12T11:52:10.710 INFO:tasks.workunit.client.0.smithi063.stdout:8/868: mkdir d4/de/d1e/d6d/d10e 0 2023-12-12T11:52:10.710 INFO:tasks.workunit.client.0.smithi063.stdout:8/869: creat d4/de/d1e/d6d/f10f x:0 0 0 2023-12-12T11:52:10.715 INFO:tasks.workunit.client.0.smithi063.stdout:4/825: rmdir d2/d47/d6d 39 2023-12-12T11:52:10.716 INFO:tasks.workunit.client.0.smithi063.stdout:4/826: fsync d2/d47/f7d 0 2023-12-12T11:52:10.716 INFO:tasks.workunit.client.0.smithi063.stdout:4/827: read d2/d47/d6d/d88/df0/fc2 [43286,118786] 0 2023-12-12T11:52:10.717 INFO:tasks.workunit.client.0.smithi063.stdout:1/887: write d3/d3a/dd7/d12/d107/f110 [319999,120135] 0 2023-12-12T11:52:10.729 INFO:tasks.workunit.client.0.smithi063.stdout:9/698: dwrite d7/d11/f53 [4194304,4194304] 0 2023-12-12T11:52:10.730 INFO:tasks.workunit.client.0.smithi063.stdout:4/828: read d2/d47/d6d/d88/df0/d76/f7a [2791999,102911] 0 2023-12-12T11:52:10.730 INFO:tasks.workunit.client.0.smithi063.stdout:0/854: rmdir d0/d1a 39 2023-12-12T11:52:10.730 INFO:tasks.workunit.client.0.smithi063.stdout:4/829: write d2/d17/df8/f105 [111055,114152] 0 2023-12-12T11:52:10.730 INFO:tasks.workunit.client.0.smithi063.stdout:4/830: truncate d2/d48/d4f/f68 1452337 0 2023-12-12T11:52:10.735 INFO:tasks.workunit.client.0.smithi063.stdout:8/870: link d4/de/d11/f105 d4/d24/d38/dd8/f110 0 2023-12-12T11:52:10.738 INFO:tasks.workunit.client.0.smithi063.stdout:1/888: link d3/d3a/d52/l70 d3/d3a/dd7/d16/d4f/da7/l127 0 2023-12-12T11:52:10.753 INFO:tasks.workunit.client.0.smithi063.stdout:0/855: mkdir d0/d1a/d23/d2e/dad/d116/dcb/dea/d11b 0 2023-12-12T11:52:10.753 INFO:tasks.workunit.client.0.smithi063.stdout:0/856: fdatasync d0/d1a/d23/d2e/dad/d116/dcb/fe7 0 2023-12-12T11:52:10.756 INFO:tasks.workunit.client.0.smithi063.stdout:0/857: creat d0/d1a/d23/d2e/dd4/ddc/f11c x:0 0 0 2023-12-12T11:52:10.759 INFO:tasks.workunit.client.0.smithi063.stdout:0/858: creat d0/d1a/d23/d2e/f11d x:0 0 0 2023-12-12T11:52:10.762 INFO:tasks.workunit.client.0.smithi063.stdout:0/859: mkdir d0/d7/d27/d1f/d11e 0 2023-12-12T11:52:10.774 INFO:tasks.workunit.client.0.smithi063.stdout:2/734: dwrite d0/f4c [0,4194304] 0 2023-12-12T11:52:10.774 INFO:tasks.workunit.client.0.smithi063.stdout:2/735: write d0/d1a/d3a/d59/f78 [854617,119150] 0 2023-12-12T11:52:10.785 INFO:tasks.workunit.client.0.smithi063.stdout:2/736: dread d0/fb3 [0,4194304] 0 2023-12-12T11:52:10.790 INFO:tasks.workunit.client.0.smithi063.stdout:2/737: creat d0/d41/fe2 x:0 0 0 2023-12-12T11:52:10.792 INFO:tasks.workunit.client.0.smithi063.stdout:2/738: link d0/d1a/d48/f34 d0/d1a/d1e/d64/fe3 0 2023-12-12T11:52:10.794 INFO:tasks.workunit.client.0.smithi063.stdout:2/739: rename d0/d1a/d3a/d59/fb0 to d0/d41/fe4 0 2023-12-12T11:52:10.795 INFO:tasks.workunit.client.0.smithi063.stdout:2/740: symlink d0/d1a/d3a/d59/ddb/le5 0 2023-12-12T11:52:10.796 INFO:tasks.workunit.client.0.smithi063.stdout:2/741: dread - d0/d1a/d3a/d85/da6/fde zero size 2023-12-12T11:52:10.796 INFO:tasks.workunit.client.0.smithi063.stdout:2/742: fdatasync d0/d1a/fce 0 2023-12-12T11:52:10.796 INFO:tasks.workunit.client.0.smithi063.stdout:2/743: write d0/d69/f8a [1957777,49561] 0 2023-12-12T11:52:10.796 INFO:tasks.workunit.client.0.smithi063.stdout:2/744: creat d0/d1a/d3a/d59/fe6 x:0 0 0 2023-12-12T11:52:10.799 INFO:tasks.workunit.client.0.smithi063.stdout:9/699: dwrite d7/d11/d12/f4a [0,4194304] 0 2023-12-12T11:52:10.802 INFO:tasks.workunit.client.0.smithi063.stdout:4/831: dwrite d2/d47/d6d/d88/df0/d76/ffe [4194304,4194304] 0 2023-12-12T11:52:10.802 INFO:tasks.workunit.client.0.smithi063.stdout:4/832: chown d2/d17 1 1 2023-12-12T11:52:10.802 INFO:tasks.workunit.client.0.smithi063.stdout:9/700: link d7/d15/f17 d7/d20/d45/d46/d51/d64/d6f/d85/fe5 0 2023-12-12T11:52:10.815 INFO:tasks.workunit.client.0.smithi063.stdout:2/745: write d0/fbd [2706251,11512] 0 2023-12-12T11:52:10.817 INFO:tasks.workunit.client.0.smithi063.stdout:5/853: dwrite d7/d10/d2b/d3c/d27/f8e [0,4194304] 0 2023-12-12T11:52:10.818 INFO:tasks.workunit.client.0.smithi063.stdout:7/735: dwrite de/d33/d41/d44/d8b/f101 [0,4194304] 0 2023-12-12T11:52:10.832 INFO:tasks.workunit.client.0.smithi063.stdout:2/746: creat d0/d1a/d1e/fe7 x:0 0 0 2023-12-12T11:52:10.834 INFO:tasks.workunit.client.0.smithi063.stdout:5/854: unlink d7/d10/d2b/d3c/fbd 0 2023-12-12T11:52:10.834 INFO:tasks.workunit.client.0.smithi063.stdout:5/855: write d7/d10/d2b/d3c/d5a/fe5 [909542,4963] 0 2023-12-12T11:52:10.839 INFO:tasks.workunit.client.0.smithi063.stdout:5/856: creat d7/f103 x:0 0 0 2023-12-12T11:52:10.842 INFO:tasks.workunit.client.0.smithi063.stdout:5/857: rename d7/d10/d2b/d3c/d63/f7a to d7/f104 0 2023-12-12T11:52:10.842 INFO:tasks.workunit.client.0.smithi063.stdout:5/858: chown d7/d10/d2b/d3c/d5a/dbb/fc2 46246 1 2023-12-12T11:52:10.843 INFO:tasks.workunit.client.0.smithi063.stdout:5/859: mkdir d7/d28/d6e/dad/d105 0 2023-12-12T11:52:10.843 INFO:tasks.workunit.client.0.smithi063.stdout:5/860: stat d7/d10/d2b/d3c/d5a/dbb/dbc/cd8 0 2023-12-12T11:52:10.846 INFO:tasks.workunit.client.0.smithi063.stdout:4/833: dwrite d2/d47/d6d/d88/df0/fcd [0,4194304] 0 2023-12-12T11:52:10.907 INFO:tasks.workunit.client.0.smithi063.stdout:2/747: dwrite d0/d69/f8c [0,4194304] 0 2023-12-12T11:52:10.908 INFO:tasks.workunit.client.0.smithi063.stdout:2/748: chown d0/d1a/d48/l42 19742 1 2023-12-12T11:52:10.908 INFO:tasks.workunit.client.0.smithi063.stdout:6/831: dwrite d9/d2c/f54 [0,4194304] 0 2023-12-12T11:52:10.908 INFO:tasks.workunit.client.0.smithi063.stdout:8/871: dwrite d4/d24/d38/d45/fdb [0,4194304] 0 2023-12-12T11:52:10.909 INFO:tasks.workunit.client.0.smithi063.stdout:8/872: truncate d4/d24/d38/d45/d5b/d107/d62/fe0 588383 0 2023-12-12T11:52:10.922 INFO:tasks.workunit.client.0.smithi063.stdout:2/749: unlink d0/d1a/d3a/d59/c99 0 2023-12-12T11:52:10.922 INFO:tasks.workunit.client.0.smithi063.stdout:4/834: dwrite d2/d17/d7f/fe8 [0,4194304] 0 2023-12-12T11:52:10.935 INFO:tasks.workunit.client.0.smithi063.stdout:6/832: mkdir d9/d2c/d61/d124 0 2023-12-12T11:52:10.943 INFO:tasks.workunit.client.0.smithi063.stdout:4/835: truncate d2/d48/fe0 704901 0 2023-12-12T11:52:10.949 INFO:tasks.workunit.client.0.smithi063.stdout:4/836: rmdir d2/d47/d6d/d88 39 2023-12-12T11:52:10.949 INFO:tasks.workunit.client.0.smithi063.stdout:4/837: chown d2/d47/lb9 1870 1 2023-12-12T11:52:10.950 INFO:tasks.workunit.client.0.smithi063.stdout:4/838: symlink d2/d47/daa/l10b 0 2023-12-12T11:52:10.951 INFO:tasks.workunit.client.0.smithi063.stdout:4/839: creat d2/d17/d9d/d85/f10c x:0 0 0 2023-12-12T11:52:10.974 INFO:tasks.workunit.client.0.smithi063.stdout:5/861: dread d7/de/fd5 [0,4194304] 0 2023-12-12T11:52:10.974 INFO:tasks.workunit.client.0.smithi063.stdout:5/862: creat d7/d10/d2b/d3c/d42/d62/db4/f106 x:0 0 0 2023-12-12T11:52:10.974 INFO:tasks.workunit.client.0.smithi063.stdout:2/750: read d0/f43 [1171797,83566] 0 2023-12-12T11:52:10.974 INFO:tasks.workunit.client.0.smithi063.stdout:8/873: dwrite d4/d24/d38/d45/d5b/d107/fa4 [0,4194304] 0 2023-12-12T11:52:10.975 INFO:tasks.workunit.client.0.smithi063.stdout:4/840: write d2/d48/d69/d98/fad [600957,129615] 0 2023-12-12T11:52:10.975 INFO:tasks.workunit.client.0.smithi063.stdout:6/833: dread d9/d10/d25/fe9 [0,4194304] 0 2023-12-12T11:52:10.975 INFO:tasks.workunit.client.0.smithi063.stdout:6/834: fdatasync f4 0 2023-12-12T11:52:10.976 INFO:tasks.workunit.client.0.smithi063.stdout:5/863: mknod d7/d28/d6e/c107 0 2023-12-12T11:52:10.979 INFO:tasks.workunit.client.0.smithi063.stdout:2/751: rename d0/d1a/d48/f3d to d0/d1a/d48/d56/d77/fe8 0 2023-12-12T11:52:10.981 INFO:tasks.workunit.client.0.smithi063.stdout:8/874: link d4/d24/d38/d45/c67 d4/d24/d38/d45/c111 0 2023-12-12T11:52:10.982 INFO:tasks.workunit.client.0.smithi063.stdout:6/835: getdents d9/d68/de4 0 2023-12-12T11:52:10.984 INFO:tasks.workunit.client.0.smithi063.stdout:5/864: creat d7/d10/f108 x:0 0 0 2023-12-12T11:52:10.989 INFO:tasks.workunit.client.0.smithi063.stdout:0/860: dwrite d0/d1a/d23/d2e/d84/feb [0,4194304] 0 2023-12-12T11:52:10.990 INFO:tasks.workunit.client.0.smithi063.stdout:0/861: chown d0/d1a/d23/d2e/dd4/ddc/de0 269770309 1 2023-12-12T11:52:10.992 INFO:tasks.workunit.client.0.smithi063.stdout:2/752: mknod d0/d69/ce9 0 2023-12-12T11:52:10.992 INFO:tasks.workunit.client.0.smithi063.stdout:2/753: dread - d0/d1a/d48/d56/fcd zero size 2023-12-12T11:52:10.992 INFO:tasks.workunit.client.0.smithi063.stdout:6/836: truncate d9/d2c/d61/dcd/f10a 201264 0 2023-12-12T11:52:10.992 INFO:tasks.workunit.client.0.smithi063.stdout:2/754: truncate d0/d1a/d3a/fd9 132070 0 2023-12-12T11:52:10.993 INFO:tasks.workunit.client.0.smithi063.stdout:9/701: dwrite d7/d20/d3f/d40/d4e/f9f [0,4194304] 0 2023-12-12T11:52:10.997 INFO:tasks.workunit.client.0.smithi063.stdout:0/862: unlink d0/d1a/d23/d34/d42/f3e 0 2023-12-12T11:52:11.002 INFO:tasks.workunit.client.0.smithi063.stdout:7/736: dwrite de/f13 [0,4194304] 0 2023-12-12T11:52:11.006 INFO:tasks.workunit.client.0.smithi063.stdout:9/702: mkdir d7/d8a/de6 0 2023-12-12T11:52:11.007 INFO:tasks.workunit.client.0.smithi063.stdout:2/755: getdents d0/d69 0 2023-12-12T11:52:11.009 INFO:tasks.workunit.client.0.smithi063.stdout:7/737: dread de/d33/dd2/d4a/d65/fc6 [0,4194304] 0 2023-12-12T11:52:11.011 INFO:tasks.workunit.client.0.smithi063.stdout:8/875: dread f1 [0,4194304] 0 2023-12-12T11:52:11.012 INFO:tasks.workunit.client.0.smithi063.stdout:2/756: write d0/d1a/d3a/f84 [622031,103324] 0 2023-12-12T11:52:11.015 INFO:tasks.workunit.client.0.smithi063.stdout:4/841: dwrite d2/d17/d4e/f51 [0,4194304] 0 2023-12-12T11:52:11.024 INFO:tasks.workunit.client.0.smithi063.stdout:6/837: dread d9/d2c/d61/fb3 [0,4194304] 0 2023-12-12T11:52:11.025 INFO:tasks.workunit.client.0.smithi063.stdout:6/838: getdents d9/d2c/d112 0 2023-12-12T11:52:11.025 INFO:tasks.workunit.client.0.smithi063.stdout:7/738: symlink de/d22/d6e/d8a/da3/d108/l10e 0 2023-12-12T11:52:11.026 INFO:tasks.workunit.client.0.smithi063.stdout:8/876: mknod d4/c112 0 2023-12-12T11:52:11.027 INFO:tasks.workunit.client.0.smithi063.stdout:8/877: fdatasync d4/d24/d38/dd8/df3/ff7 0 2023-12-12T11:52:11.028 INFO:tasks.workunit.client.0.smithi063.stdout:2/757: mknod d0/d1a/d3a/d85/da6/dd8/cea 0 2023-12-12T11:52:11.029 INFO:tasks.workunit.client.0.smithi063.stdout:4/842: mkdir d2/d47/d6d/d88/df0/ddf/d10d 0 2023-12-12T11:52:11.032 INFO:tasks.workunit.client.0.smithi063.stdout:0/863: dwrite d0/d1a/d23/d2e/dd4/ddc/de0/f10b [0,4194304] 0 2023-12-12T11:52:11.032 INFO:tasks.workunit.client.0.smithi063.stdout:0/864: chown d0/l102 40828403 1 2023-12-12T11:52:11.032 INFO:tasks.workunit.client.0.smithi063.stdout:0/865: write d0/d1a/d66/f87 [3234763,129579] 0 2023-12-12T11:52:11.032 INFO:tasks.workunit.client.0.smithi063.stdout:9/703: getdents d7/d20/d45/d46/d51/d64/d6f/d85 0 2023-12-12T11:52:11.032 INFO:tasks.workunit.client.0.smithi063.stdout:9/704: chown d7/d20/d3f/d40/d76/la9 3090 1 2023-12-12T11:52:11.033 INFO:tasks.workunit.client.0.smithi063.stdout:3/787: sync 2023-12-12T11:52:11.033 INFO:tasks.workunit.client.0.smithi063.stdout:3/788: chown d4/df/d1a/d1c/d3b/d50/d61/cdb 460642878 1 2023-12-12T11:52:11.033 INFO:tasks.workunit.client.0.smithi063.stdout:3/789: read d4/df/d1a/f2e [3898848,11818] 0 2023-12-12T11:52:11.033 INFO:tasks.workunit.client.0.smithi063.stdout:3/790: chown d4/df/d1a/d1c/f29 9589 1 2023-12-12T11:52:11.033 INFO:tasks.workunit.client.0.smithi063.stdout:3/791: write d4/df/d1a/d1c/d34/fe6 [1043171,5139] 0 2023-12-12T11:52:11.037 INFO:tasks.workunit.client.0.smithi063.stdout:8/878: link d4/d24/d38/d45/d5b/d107/d62/d6e/c74 d4/d24/d38/c113 0 2023-12-12T11:52:11.041 INFO:tasks.workunit.client.0.smithi063.stdout:4/843: mknod d2/d47/d6d/d88/df0/db3/c10e 0 2023-12-12T11:52:11.041 INFO:tasks.workunit.client.0.smithi063.stdout:4/844: chown d2/d17/d9d/df5 5 1 2023-12-12T11:52:11.041 INFO:tasks.workunit.client.0.smithi063.stdout:4/845: creat d2/d47/d6d/d88/de6/df3/f10f x:0 0 0 2023-12-12T11:52:11.041 INFO:tasks.workunit.client.0.smithi063.stdout:6/839: dread d9/fba [0,4194304] 0 2023-12-12T11:52:11.044 INFO:tasks.workunit.client.0.smithi063.stdout:7/739: dread de/d3f/f6d [0,4194304] 0 2023-12-12T11:52:11.047 INFO:tasks.workunit.client.0.smithi063.stdout:2/758: rmdir d0/d1a/d26 39 2023-12-12T11:52:11.050 INFO:tasks.workunit.client.0.smithi063.stdout:9/705: dread d7/d15/f17 [0,4194304] 0 2023-12-12T11:52:11.051 INFO:tasks.workunit.client.0.smithi063.stdout:9/706: write d7/d11/fb5 [565224,33242] 0 2023-12-12T11:52:11.053 INFO:tasks.workunit.client.0.smithi063.stdout:6/840: mkdir d9/d125 0 2023-12-12T11:52:11.055 INFO:tasks.workunit.client.0.smithi063.stdout:8/879: dread d4/de/fb4 [0,4194304] 0 2023-12-12T11:52:11.058 INFO:tasks.workunit.client.0.smithi063.stdout:3/792: write d4/df/d1a/d1c/d3b/d50/d9f/fe1 [4145726,23527] 0 2023-12-12T11:52:11.059 INFO:tasks.workunit.client.0.smithi063.stdout:7/740: creat de/d22/d6e/d8a/da3/f10f x:0 0 0 2023-12-12T11:52:11.064 INFO:tasks.workunit.client.0.smithi063.stdout:2/759: mkdir d0/d1a/d3a/d85/da6/deb 0 2023-12-12T11:52:11.069 INFO:tasks.workunit.client.0.smithi063.stdout:9/707: mkdir d7/d15/dc4/d3e/de7 0 2023-12-12T11:52:11.069 INFO:tasks.workunit.client.0.smithi063.stdout:3/793: link d4/df/d1a/d1c/f29 d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d56/d79/ff1 0 2023-12-12T11:52:11.070 INFO:tasks.workunit.client.0.smithi063.stdout:3/794: creat d4/d23/d7b/dea/ff2 x:0 0 0 2023-12-12T11:52:11.070 INFO:tasks.workunit.client.0.smithi063.stdout:3/795: write d4/df/d1a/d1c/d3b/d50/d61/f65 [1465942,109419] 0 2023-12-12T11:52:11.071 INFO:tasks.workunit.client.0.smithi063.stdout:6/841: creat d9/d10/d5c/d5e/f126 x:0 0 0 2023-12-12T11:52:11.071 INFO:tasks.workunit.client.0.smithi063.stdout:6/842: chown d9/d10/d2a/de7/d86/dc2/ded/df5/d121 3 1 2023-12-12T11:52:11.071 INFO:tasks.workunit.client.0.smithi063.stdout:6/843: chown d9/d10/d2a/f67 676 1 2023-12-12T11:52:11.071 INFO:tasks.workunit.client.0.smithi063.stdout:6/844: stat d9/d10/dfc/f11b 0 2023-12-12T11:52:11.071 INFO:tasks.workunit.client.0.smithi063.stdout:6/845: fdatasync d9/d2c/d61/f7d 0 2023-12-12T11:52:11.075 INFO:tasks.workunit.client.0.smithi063.stdout:4/846: write d2/f10 [3425098,32324] 0 2023-12-12T11:52:11.075 INFO:tasks.workunit.client.0.smithi063.stdout:4/847: stat d2/d17/d9d/d85/f10c 0 2023-12-12T11:52:11.078 INFO:tasks.workunit.client.0.smithi063.stdout:4/848: rename d2/d48/df9/cfa to d2/d48/d69/c110 0 2023-12-12T11:52:11.105 INFO:tasks.workunit.client.0.smithi063.stdout:7/741: dwrite de/d22/d66/fb2 [0,4194304] 0 2023-12-12T11:52:11.105 INFO:tasks.workunit.client.0.smithi063.stdout:7/742: chown de/d39/d4b/d7b/d7f 5 1 2023-12-12T11:52:11.108 INFO:tasks.workunit.client.0.smithi063.stdout:7/743: mknod de/d34/d68/da1/dcd/ddc/c110 0 2023-12-12T11:52:11.108 INFO:tasks.workunit.client.0.smithi063.stdout:7/744: stat de/d22/d66/fa7 0 2023-12-12T11:52:11.108 INFO:tasks.workunit.client.0.smithi063.stdout:7/745: fdatasync de/d39/d60/da4/fb7 0 2023-12-12T11:52:11.111 INFO:tasks.workunit.client.0.smithi063.stdout:7/746: getdents de/d22/d6e 0 2023-12-12T11:52:11.111 INFO:tasks.workunit.client.0.smithi063.stdout:7/747: creat de/d22/d6e/d8a/f111 x:0 0 0 2023-12-12T11:52:11.112 INFO:tasks.workunit.client.0.smithi063.stdout:7/748: chown de/d33/d71 2311575 1 2023-12-12T11:52:11.112 INFO:tasks.workunit.client.0.smithi063.stdout:7/749: write de/f3c [1273078,39016] 0 2023-12-12T11:52:11.112 INFO:tasks.workunit.client.0.smithi063.stdout:7/750: fdatasync de/d22/fc0 0 2023-12-12T11:52:11.126 INFO:tasks.workunit.client.0.smithi063.stdout:8/880: dwrite d4/d24/d38/d45/d5b/d107/d62/d36/dc6/fe6 [0,4194304] 0 2023-12-12T11:52:11.136 INFO:tasks.workunit.client.0.smithi063.stdout:8/881: mkdir d4/d55/d114 0 2023-12-12T11:52:11.140 INFO:tasks.workunit.client.0.smithi063.stdout:8/882: rename d4/d24/d38/c113 to d4/d24/d38/d45/d5b/d107/d62/d36/d57/d84/c115 0 2023-12-12T11:52:11.144 INFO:tasks.workunit.client.0.smithi063.stdout:8/883: truncate d4/de/fb4 3255105 0 2023-12-12T11:52:11.148 INFO:tasks.workunit.client.0.smithi063.stdout:8/884: rename d4/de/d1e/f33 to d4/d24/d38/dd8/df3/f116 0 2023-12-12T11:52:11.150 INFO:tasks.workunit.client.0.smithi063.stdout:4/849: dwrite d2/d47/f7d [0,4194304] 0 2023-12-12T11:52:11.154 INFO:tasks.workunit.client.0.smithi063.stdout:2/760: dwrite d0/d1a/d48/d56/f65 [0,4194304] 0 2023-12-12T11:52:11.154 INFO:tasks.workunit.client.0.smithi063.stdout:4/850: symlink d2/d47/daa/l111 0 2023-12-12T11:52:11.157 INFO:tasks.workunit.client.0.smithi063.stdout:6/846: dread d9/d10/d5c/d5e/fd8 [0,4194304] 0 2023-12-12T11:52:11.163 INFO:tasks.workunit.client.0.smithi063.stdout:7/751: read de/ff5 [2147337,46610] 0 2023-12-12T11:52:11.165 INFO:tasks.workunit.client.0.smithi063.stdout:3/796: dwrite d4/df/d1a/d1c/d3b/d52/d78/dbb/fc4 [0,4194304] 0 2023-12-12T11:52:11.165 INFO:tasks.workunit.client.0.smithi063.stdout:4/851: mknod d2/d17/d4e/c112 0 2023-12-12T11:52:11.177 INFO:tasks.workunit.client.0.smithi063.stdout:7/752: dread de/d39/d4b/ff2 [0,4194304] 0 2023-12-12T11:52:11.177 INFO:tasks.workunit.client.0.smithi063.stdout:3/797: unlink d4/df/d1a/d1c/d3b/d50/d61/f83 0 2023-12-12T11:52:11.177 INFO:tasks.workunit.client.0.smithi063.stdout:3/798: chown d4/df/d1a/d1c/f2d 21 1 2023-12-12T11:52:11.177 INFO:tasks.workunit.client.0.smithi063.stdout:4/852: symlink d2/d17/d81/l113 0 2023-12-12T11:52:11.177 INFO:tasks.workunit.client.0.smithi063.stdout:4/853: chown d2/d17/d4e/dd9/f108 10 1 2023-12-12T11:52:11.177 INFO:tasks.workunit.client.0.smithi063.stdout:3/799: mknod d4/cf3 0 2023-12-12T11:52:11.184 INFO:tasks.workunit.client.0.smithi063.stdout:9/708: dwrite d7/d11/d4b/f68 [0,4194304] 0 2023-12-12T11:52:11.184 INFO:tasks.workunit.client.0.smithi063.stdout:4/854: mknod d2/d17/d4e/dd9/c114 0 2023-12-12T11:52:11.189 INFO:tasks.workunit.client.0.smithi063.stdout:2/761: write d0/d1a/d3a/fd9 [858103,78533] 0 2023-12-12T11:52:11.190 INFO:tasks.workunit.client.0.smithi063.stdout:3/800: getdents d4/df/d1a/d1c/d3b/d52/d78/da5/d4c 0 2023-12-12T11:52:11.197 INFO:tasks.workunit.client.0.smithi063.stdout:4/855: creat d2/d47/d6d/d88/df0/f115 x:0 0 0 2023-12-12T11:52:11.201 INFO:tasks.workunit.client.0.smithi063.stdout:9/709: creat d7/d8a/de6/fe8 x:0 0 0 2023-12-12T11:52:11.205 INFO:tasks.workunit.client.0.smithi063.stdout:2/762: unlink d0/d1a/d3a/f84 0 2023-12-12T11:52:11.205 INFO:tasks.workunit.client.0.smithi063.stdout:2/763: creat d0/d1a/fec x:0 0 0 2023-12-12T11:52:11.206 INFO:tasks.workunit.client.0.smithi063.stdout:3/801: creat d4/d23/d6b/d90/de9/ff4 x:0 0 0 2023-12-12T11:52:11.208 INFO:tasks.workunit.client.0.smithi063.stdout:4/856: symlink d2/d17/d9d/l116 0 2023-12-12T11:52:11.213 INFO:tasks.workunit.client.0.smithi063.stdout:9/710: truncate d7/d15/f2e 3876613 0 2023-12-12T11:52:11.218 INFO:tasks.workunit.client.0.smithi063.stdout:2/764: mkdir d0/d1a/d3a/d59/ddb/ded 0 2023-12-12T11:52:11.218 INFO:tasks.workunit.client.0.smithi063.stdout:2/765: stat d0/d41/daf/fb9 0 2023-12-12T11:52:11.219 INFO:tasks.workunit.client.0.smithi063.stdout:2/766: fsync d0/f4 0 2023-12-12T11:52:11.246 INFO:tasks.workunit.client.0.smithi063.stdout:8/885: dwrite d4/f4e [0,4194304] 0 2023-12-12T11:52:11.252 INFO:tasks.workunit.client.0.smithi063.stdout:8/886: creat d4/d24/d38/d45/d5b/d107/f117 x:0 0 0 2023-12-12T11:52:11.284 INFO:tasks.workunit.client.0.smithi063.stdout:7/753: dwrite de/d22/d66/fb2 [4194304,4194304] 0 2023-12-12T11:52:11.284 INFO:tasks.workunit.client.0.smithi063.stdout:8/887: write d4/d24/d38/d45/d5b/d107/d62/d36/d7f/f87 [515998,9616] 0 2023-12-12T11:52:11.286 INFO:tasks.workunit.client.0.smithi063.stdout:6/847: dwrite d9/d10/d5c/fac [0,4194304] 0 2023-12-12T11:52:11.287 INFO:tasks.workunit.client.0.smithi063.stdout:9/711: dwrite d7/d11/d94/fb7 [0,4194304] 0 2023-12-12T11:52:11.287 INFO:tasks.workunit.client.0.smithi063.stdout:7/754: truncate de/d33/d41/d44/d8b/dde/dc7/fe8 2133055 0 2023-12-12T11:52:11.287 INFO:tasks.workunit.client.0.smithi063.stdout:7/755: write de/f1d [2361891,70514] 0 2023-12-12T11:52:11.287 INFO:tasks.workunit.client.0.smithi063.stdout:9/712: write d7/d11/f53 [3604855,83826] 0 2023-12-12T11:52:11.287 INFO:tasks.workunit.client.0.smithi063.stdout:7/756: read - de/d22/d6e/d8a/f111 zero size 2023-12-12T11:52:11.287 INFO:tasks.workunit.client.0.smithi063.stdout:9/713: fsync d7/d15/dc4/f8b 0 2023-12-12T11:52:11.288 INFO:tasks.workunit.client.0.smithi063.stdout:3/802: dwrite d4/df/d1a/f31 [0,4194304] 0 2023-12-12T11:52:11.288 INFO:tasks.workunit.client.0.smithi063.stdout:2/767: dwrite d0/d1a/dba/fc8 [0,4194304] 0 2023-12-12T11:52:11.288 INFO:tasks.workunit.client.0.smithi063.stdout:2/768: stat d0/d1a/d48/d56/d77/f8d 0 2023-12-12T11:52:11.299 INFO:tasks.workunit.client.0.smithi063.stdout:7/757: write de/d22/d66/fa7 [3622501,121381] 0 2023-12-12T11:52:11.302 INFO:tasks.workunit.client.0.smithi063.stdout:2/769: dread d0/d1a/d48/f34 [4194304,4194304] 0 2023-12-12T11:52:11.320 INFO:tasks.workunit.client.0.smithi063.stdout:6/848: readlink d9/d10/d2a/de7/l9e 0 2023-12-12T11:52:11.321 INFO:tasks.workunit.client.0.smithi063.stdout:6/849: chown d9/l38 51 1 2023-12-12T11:52:11.323 INFO:tasks.workunit.client.0.smithi063.stdout:9/714: mknod d7/d15/ce9 0 2023-12-12T11:52:11.327 INFO:tasks.workunit.client.0.smithi063.stdout:8/888: dwrite d4/d24/d38/d45/d5b/d107/d62/d36/dc6/fe6 [0,4194304] 0 2023-12-12T11:52:11.329 INFO:tasks.workunit.client.0.smithi063.stdout:7/758: symlink de/d22/d6e/d8a/da3/d108/l112 0 2023-12-12T11:52:11.331 INFO:tasks.workunit.client.0.smithi063.stdout:2/770: unlink d0/d1a/d1e/d64/lc4 0 2023-12-12T11:52:11.332 INFO:tasks.workunit.client.0.smithi063.stdout:6/850: dread d9/f43 [0,4194304] 0 2023-12-12T11:52:11.332 INFO:tasks.workunit.client.0.smithi063.stdout:6/851: chown c2 48 1 2023-12-12T11:52:11.334 INFO:tasks.workunit.client.0.smithi063.stdout:1/889: sync 2023-12-12T11:52:11.334 INFO:tasks.workunit.client.0.smithi063.stdout:8/889: dread d4/d24/d38/d45/d5b/d92/d65/fe9 [0,4194304] 0 2023-12-12T11:52:11.334 INFO:tasks.workunit.client.0.smithi063.stdout:8/890: fdatasync d4/d24/d38/d45/d5b/d107/d62/f6f 0 2023-12-12T11:52:11.334 INFO:tasks.workunit.client.0.smithi063.stdout:8/891: truncate d4/d24/d38/d45/d5b/ffd 664620 0 2023-12-12T11:52:11.337 INFO:tasks.workunit.client.0.smithi063.stdout:9/715: rmdir d7/d8a/dd6/de3 0 2023-12-12T11:52:11.337 INFO:tasks.workunit.client.0.smithi063.stdout:9/716: read d7/d11/f53 [3365353,109238] 0 2023-12-12T11:52:11.338 INFO:tasks.workunit.client.0.smithi063.stdout:3/803: truncate d4/df/d1a/d1c/d3b/d50/d61/fe4 6658846 0 2023-12-12T11:52:11.342 INFO:tasks.workunit.client.0.smithi063.stdout:3/804: fdatasync d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/fd3 0 2023-12-12T11:52:11.342 INFO:tasks.workunit.client.0.smithi063.stdout:8/892: dread d4/d24/d38/d45/d5b/d107/d62/d6e/d76/d93/fe4 [0,4194304] 0 2023-12-12T11:52:11.348 INFO:tasks.workunit.client.0.smithi063.stdout:2/771: rename d0/d1a/d3a/d85/da6/dd8/cea to d0/d1a/d3a/d59/ddb/ded/cee 0 2023-12-12T11:52:11.351 INFO:tasks.workunit.client.0.smithi063.stdout:6/852: creat d9/d10/d2a/de7/d86/dc2/ded/df5/d118/f127 x:0 0 0 2023-12-12T11:52:11.354 INFO:tasks.workunit.client.0.smithi063.stdout:1/890: unlink d3/d3a/dd7/d16/d24/d48/d75/d83/d5b/d106/f123 0 2023-12-12T11:52:11.354 INFO:tasks.workunit.client.0.smithi063.stdout:1/891: truncate d3/d3a/dd7/d12/fb9 350578 0 2023-12-12T11:52:11.356 INFO:tasks.workunit.client.0.smithi063.stdout:9/717: mknod d7/d15/db2/cea 0 2023-12-12T11:52:11.362 INFO:tasks.workunit.client.0.smithi063.stdout:6/853: creat d9/d10/d2a/de7/d8a/df8/f128 x:0 0 0 2023-12-12T11:52:11.365 INFO:tasks.workunit.client.0.smithi063.stdout:8/893: dread d4/d24/db3/fe3 [0,4194304] 0 2023-12-12T11:52:11.367 INFO:tasks.workunit.client.0.smithi063.stdout:1/892: mknod d3/d3a/dd7/d12/d107/c128 0 2023-12-12T11:52:11.369 INFO:tasks.workunit.client.0.smithi063.stdout:6/854: rename d9/d68/d8f/la7 to d9/d10/d2a/de7/d86/dc2/ded/df5/d121/l129 0 2023-12-12T11:52:11.369 INFO:tasks.workunit.client.0.smithi063.stdout:6/855: chown d9/d10/d5c/ceb 41725 1 2023-12-12T11:52:11.372 INFO:tasks.workunit.client.0.smithi063.stdout:8/894: creat d4/d24/d38/dd8/df5/f118 x:0 0 0 2023-12-12T11:52:11.375 INFO:tasks.workunit.client.0.smithi063.stdout:1/893: unlink d3/d3a/dd7/d16/d24/d4d/fc4 0 2023-12-12T11:52:11.375 INFO:tasks.workunit.client.0.smithi063.stdout:1/894: creat d3/d3a/dd7/f129 x:0 0 0 2023-12-12T11:52:11.377 INFO:tasks.workunit.client.0.smithi063.stdout:6/856: truncate d9/f74 3728283 0 2023-12-12T11:52:11.379 INFO:tasks.workunit.client.0.smithi063.stdout:6/857: readlink d9/d68/d8f/d115/l11c 0 2023-12-12T11:52:11.380 INFO:tasks.workunit.client.0.smithi063.stdout:9/718: dread d7/d15/dc4/d3e/dbb/fc8 [0,4194304] 0 2023-12-12T11:52:11.380 INFO:tasks.workunit.client.0.smithi063.stdout:8/895: creat d4/d55/f119 x:0 0 0 2023-12-12T11:52:11.380 INFO:tasks.workunit.client.0.smithi063.stdout:9/719: write d7/f2b [5142833,24498] 0 2023-12-12T11:52:11.380 INFO:tasks.workunit.client.0.smithi063.stdout:9/720: fdatasync d7/d11/d12/f4a 0 2023-12-12T11:52:11.391 INFO:tasks.workunit.client.0.smithi063.stdout:1/895: rename d3/d3a/dd7/d16/d17/d4b/d8c to d3/d3a/dd7/d16/d4f/d9a/d12a 0 2023-12-12T11:52:11.394 INFO:tasks.workunit.client.0.smithi063.stdout:8/896: mknod d4/d24/d38/d45/d5b/d107/d62/d36/c11a 0 2023-12-12T11:52:11.394 INFO:tasks.workunit.client.0.smithi063.stdout:8/897: dread - d4/d24/d38/d45/d5b/d107/d62/d36/dc6/fdf zero size 2023-12-12T11:52:11.402 INFO:tasks.workunit.client.0.smithi063.stdout:7/759: dwrite de/d22/d6e/d8a/fb6 [0,4194304] 0 2023-12-12T11:52:11.408 INFO:tasks.workunit.client.0.smithi063.stdout:7/760: symlink de/d22/d6e/de4/l113 0 2023-12-12T11:52:11.408 INFO:tasks.workunit.client.0.smithi063.stdout:7/761: read - de/d22/faa zero size 2023-12-12T11:52:11.408 INFO:tasks.workunit.client.0.smithi063.stdout:3/805: dwrite d4/df/d1a/d1c/d41/f58 [8388608,4194304] 0 2023-12-12T11:52:11.408 INFO:tasks.workunit.client.0.smithi063.stdout:3/806: chown d4/df/d1a/d1c/cd9 15999 1 2023-12-12T11:52:11.414 INFO:tasks.workunit.client.0.smithi063.stdout:3/807: truncate d4/df/d1a/d1c/d57/f6c 628103 0 2023-12-12T11:52:11.419 INFO:tasks.workunit.client.0.smithi063.stdout:3/808: truncate d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/f66 3831271 0 2023-12-12T11:52:11.422 INFO:tasks.workunit.client.0.smithi063.stdout:1/896: read d3/d3a/dd7/d16/d24/d48/d75/f86 [3849547,116133] 0 2023-12-12T11:52:11.424 INFO:tasks.workunit.client.0.smithi063.stdout:1/897: stat d3/d3a/dd7/d12/c1b 0 2023-12-12T11:52:11.426 INFO:tasks.workunit.client.0.smithi063.stdout:1/898: creat d3/d3a/dd7/d12/d107/f12b x:0 0 0 2023-12-12T11:52:11.432 INFO:tasks.workunit.client.0.smithi063.stdout:6/858: dwrite d9/d2c/d61/f7d [0,4194304] 0 2023-12-12T11:52:11.433 INFO:tasks.workunit.client.0.smithi063.stdout:6/859: fdatasync d9/d2c/d61/dcd/f10a 0 2023-12-12T11:52:11.433 INFO:tasks.workunit.client.0.smithi063.stdout:6/860: stat d9/d10/dfc/f11b 0 2023-12-12T11:52:11.433 INFO:tasks.workunit.client.0.smithi063.stdout:6/861: write d9/d10/d5c/d5e/f87 [931315,104149] 0 2023-12-12T11:52:11.433 INFO:tasks.workunit.client.0.smithi063.stdout:6/862: stat d9/d2c/d61/d124 0 2023-12-12T11:52:11.436 INFO:tasks.workunit.client.0.smithi063.stdout:1/899: getdents d3/d3a/dd7/d16/d24/d48/d75/d83/d5b 0 2023-12-12T11:52:11.440 INFO:tasks.workunit.client.0.smithi063.stdout:3/809: write d4/df/d1a/d1c/d3b/d52/d78/da5/f89 [3035945,94608] 0 2023-12-12T11:52:11.455 INFO:tasks.workunit.client.0.smithi063.stdout:1/900: mkdir d3/d3a/dd7/d12/d107/d12c 0 2023-12-12T11:52:11.459 INFO:tasks.workunit.client.0.smithi063.stdout:1/901: mkdir d3/d3a/dd7/d16/d24/d30/d12d 0 2023-12-12T11:52:11.464 INFO:tasks.workunit.client.0.smithi063.stdout:1/902: rename d3/d3a/dd7/d16/d4f/d9a/d12a/dc8 to d3/d3a/dd7/d16/d24/d4d/d35/d98/d12e 0 2023-12-12T11:52:11.473 INFO:tasks.workunit.client.0.smithi063.stdout:2/772: dwrite d0/d1a/d1e/d64/f68 [0,4194304] 0 2023-12-12T11:52:11.473 INFO:tasks.workunit.client.0.smithi063.stdout:2/773: fsync d0/d1a/d3a/f9f 0 2023-12-12T11:52:11.492 INFO:tasks.workunit.client.0.smithi063.stdout:1/903: dread d3/d3a/dd7/d16/d24/d4d/f1e [0,4194304] 0 2023-12-12T11:52:11.504 INFO:tasks.workunit.client.0.smithi063.stdout:7/762: dwrite de/f1a [0,4194304] 0 2023-12-12T11:52:11.504 INFO:tasks.workunit.client.0.smithi063.stdout:7/763: stat de/c1b 0 2023-12-12T11:52:11.504 INFO:tasks.workunit.client.0.smithi063.stdout:7/764: chown de/d34/d43/d45/ccc 11702782 1 2023-12-12T11:52:11.504 INFO:tasks.workunit.client.0.smithi063.stdout:7/765: stat de/d34/d68/d89/f8e 0 2023-12-12T11:52:11.504 INFO:tasks.workunit.client.0.smithi063.stdout:6/863: dwrite d9/fc [4194304,4194304] 0 2023-12-12T11:52:11.507 INFO:tasks.workunit.client.0.smithi063.stdout:7/766: symlink de/d34/d68/da1/dcb/l114 0 2023-12-12T11:52:11.508 INFO:tasks.workunit.client.0.smithi063.stdout:6/864: getdents d9/d10/d2a/de7/d86 0 2023-12-12T11:52:11.508 INFO:tasks.workunit.client.0.smithi063.stdout:6/865: write d9/d10/d2a/de7/f116 [713961,54842] 0 2023-12-12T11:52:11.512 INFO:tasks.workunit.client.0.smithi063.stdout:7/767: symlink de/d33/d41/d44/d8b/dde/de6/l115 0 2023-12-12T11:52:11.514 INFO:tasks.workunit.client.0.smithi063.stdout:6/866: mkdir d9/d68/de4/d12a 0 2023-12-12T11:52:11.516 INFO:tasks.workunit.client.0.smithi063.stdout:7/768: rmdir de/dc8 39 2023-12-12T11:52:11.516 INFO:tasks.workunit.client.0.smithi063.stdout:7/769: write de/d34/d68/ff3 [481795,22241] 0 2023-12-12T11:52:11.518 INFO:tasks.workunit.client.0.smithi063.stdout:6/867: symlink d9/d125/l12b 0 2023-12-12T11:52:11.524 INFO:tasks.workunit.client.0.smithi063.stdout:2/774: read d0/ff [771237,30177] 0 2023-12-12T11:52:11.527 INFO:tasks.workunit.client.0.smithi063.stdout:0/866: sync 2023-12-12T11:52:11.528 INFO:tasks.workunit.client.0.smithi063.stdout:5/865: sync 2023-12-12T11:52:11.528 INFO:tasks.workunit.client.0.smithi063.stdout:5/866: chown d7/d10/f14 22275714 1 2023-12-12T11:52:11.528 INFO:tasks.workunit.client.0.smithi063.stdout:3/810: dwrite d4/df/d1a/d1c/f28 [0,4194304] 0 2023-12-12T11:52:11.528 INFO:tasks.workunit.client.0.smithi063.stdout:3/811: write d4/df/d1a/d1c/d41/de2/fe8 [908620,54500] 0 2023-12-12T11:52:11.531 INFO:tasks.workunit.client.0.smithi063.stdout:2/775: creat d0/d1a/d3a/d85/dd5/fef x:0 0 0 2023-12-12T11:52:11.534 INFO:tasks.workunit.client.0.smithi063.stdout:6/868: dread d9/d10/d7a/f91 [0,4194304] 0 2023-12-12T11:52:11.534 INFO:tasks.workunit.client.0.smithi063.stdout:2/776: creat d0/d1a/d3a/d85/da6/ff0 x:0 0 0 2023-12-12T11:52:11.539 INFO:tasks.workunit.client.0.smithi063.stdout:2/777: symlink d0/d1a/d57/lf1 0 2023-12-12T11:52:11.544 INFO:tasks.workunit.client.0.smithi063.stdout:2/778: mkdir d0/d1a/d57/ddc/df2 0 2023-12-12T11:52:11.544 INFO:tasks.workunit.client.0.smithi063.stdout:2/779: write d0/d1a/d57/fc2 [648748,28036] 0 2023-12-12T11:52:11.561 INFO:tasks.workunit.client.0.smithi063.stdout:6/869: dread d9/d10/f15 [0,4194304] 0 2023-12-12T11:52:11.562 INFO:tasks.workunit.client.0.smithi063.stdout:6/870: truncate d9/d10/d2a/de7/d86/dc2/ded/f11e 726463 0 2023-12-12T11:52:11.564 INFO:tasks.workunit.client.0.smithi063.stdout:1/904: dwrite d3/d3a/dd7/d16/d24/d4d/ff0 [0,4194304] 0 2023-12-12T11:52:11.572 INFO:tasks.workunit.client.0.smithi063.stdout:6/871: creat d9/d2c/d112/f12c x:0 0 0 2023-12-12T11:52:11.573 INFO:tasks.workunit.client.0.smithi063.stdout:2/780: getdents d0/d1a/d57 0 2023-12-12T11:52:11.573 INFO:tasks.workunit.client.0.smithi063.stdout:3/812: dread d4/df/d1a/d1c/d3b/d50/d61/fe4 [0,4194304] 0 2023-12-12T11:52:11.578 INFO:tasks.workunit.client.0.smithi063.stdout:3/813: symlink d4/df/d1a/de3/lf5 0 2023-12-12T11:52:11.592 INFO:tasks.workunit.client.0.smithi063.stdout:7/770: dwrite de/d33/d41/d44/d8b/dde/dc7/f9a [0,4194304] 0 2023-12-12T11:52:11.599 INFO:tasks.workunit.client.0.smithi063.stdout:0/867: dwrite d0/d7/f47 [0,4194304] 0 2023-12-12T11:52:11.599 INFO:tasks.workunit.client.0.smithi063.stdout:0/868: readlink d0/d8e/l101 0 2023-12-12T11:52:11.601 INFO:tasks.workunit.client.0.smithi063.stdout:5/867: dwrite d7/d28/d6e/f8b [0,4194304] 0 2023-12-12T11:52:11.605 INFO:tasks.workunit.client.0.smithi063.stdout:5/868: unlink d7/d10/d2b/d3c/l75 0 2023-12-12T11:52:11.609 INFO:tasks.workunit.client.0.smithi063.stdout:5/869: unlink d7/de/fd5 0 2023-12-12T11:52:11.610 INFO:tasks.workunit.client.0.smithi063.stdout:5/870: truncate d7/d28/d6e/dad/dba/fc9 1660007 0 2023-12-12T11:52:11.615 INFO:tasks.workunit.client.0.smithi063.stdout:7/771: dread de/d33/d41/f7c [0,4194304] 0 2023-12-12T11:52:11.615 INFO:tasks.workunit.client.0.smithi063.stdout:7/772: read de/d33/dd2/d61/f86 [808349,104808] 0 2023-12-12T11:52:11.615 INFO:tasks.workunit.client.0.smithi063.stdout:7/773: truncate de/d22/d6e/d8a/da3/f10f 350602 0 2023-12-12T11:52:11.615 INFO:tasks.workunit.client.0.smithi063.stdout:7/774: readlink de/d34/d43/d45/l9c 0 2023-12-12T11:52:11.615 INFO:tasks.workunit.client.0.smithi063.stdout:7/775: truncate de/d34/d43/fff 675765 0 2023-12-12T11:52:11.618 INFO:tasks.workunit.client.0.smithi063.stdout:7/776: mkdir de/d34/d43/d116 0 2023-12-12T11:52:11.618 INFO:tasks.workunit.client.0.smithi063.stdout:7/777: chown de/d39/d4b/c99 71291 1 2023-12-12T11:52:11.620 INFO:tasks.workunit.client.0.smithi063.stdout:8/898: sync 2023-12-12T11:52:11.620 INFO:tasks.workunit.client.0.smithi063.stdout:9/721: sync 2023-12-12T11:52:11.630 INFO:tasks.workunit.client.0.smithi063.stdout:9/722: write d7/f27 [4803581,34788] 0 2023-12-12T11:52:11.630 INFO:tasks.workunit.client.0.smithi063.stdout:2/781: dwrite d0/d1a/d3a/f46 [0,4194304] 0 2023-12-12T11:52:11.631 INFO:tasks.workunit.client.0.smithi063.stdout:2/782: chown d0/d1a/d48/d56/lc0 9239534 1 2023-12-12T11:52:11.631 INFO:tasks.workunit.client.0.smithi063.stdout:2/783: fsync d0/d1a/d3a/d85/da6/fb6 0 2023-12-12T11:52:11.631 INFO:tasks.workunit.client.0.smithi063.stdout:2/784: creat d0/d1a/d1e/ff3 x:0 0 0 2023-12-12T11:52:11.631 INFO:tasks.workunit.client.0.smithi063.stdout:2/785: stat d0/l5b 0 2023-12-12T11:52:11.631 INFO:tasks.workunit.client.0.smithi063.stdout:2/786: chown d0/d1a/fb8 7 1 2023-12-12T11:52:11.631 INFO:tasks.workunit.client.0.smithi063.stdout:2/787: chown d0/d1a/c9a 122887107 1 2023-12-12T11:52:11.631 INFO:tasks.workunit.client.0.smithi063.stdout:4/857: sync 2023-12-12T11:52:11.631 INFO:tasks.workunit.client.0.smithi063.stdout:4/858: stat d2/d47/cb2 0 2023-12-12T11:52:11.631 INFO:tasks.workunit.client.0.smithi063.stdout:2/788: mkdir d0/d1a/d57/ddc/df2/df4 0 2023-12-12T11:52:11.634 INFO:tasks.workunit.client.0.smithi063.stdout:2/789: rename d0/l47 to d0/d1a/d3a/lf5 0 2023-12-12T11:52:11.634 INFO:tasks.workunit.client.0.smithi063.stdout:2/790: fdatasync d0/d1a/d3a/d85/da6/fd0 0 2023-12-12T11:52:11.634 INFO:tasks.workunit.client.0.smithi063.stdout:2/791: stat d0/l5b 0 2023-12-12T11:52:11.635 INFO:tasks.workunit.client.0.smithi063.stdout:4/859: read d2/d17/d41/f52 [1731,75730] 0 2023-12-12T11:52:11.636 INFO:tasks.workunit.client.0.smithi063.stdout:4/860: read d2/d47/d6d/d88/df0/f49 [1496401,95572] 0 2023-12-12T11:52:11.636 INFO:tasks.workunit.client.0.smithi063.stdout:4/861: dread - d2/d17/d9d/d85/f10c zero size 2023-12-12T11:52:11.640 INFO:tasks.workunit.client.0.smithi063.stdout:6/872: dwrite d9/f109 [0,4194304] 0 2023-12-12T11:52:11.646 INFO:tasks.workunit.client.0.smithi063.stdout:9/723: dread d7/d20/d45/d46/d51/d64/d6f/d85/fe5 [0,4194304] 0 2023-12-12T11:52:11.658 INFO:tasks.workunit.client.0.smithi063.stdout:9/724: getdents d7/d20 0 2023-12-12T11:52:11.659 INFO:tasks.workunit.client.0.smithi063.stdout:8/899: write d4/de/f43 [2360415,116783] 0 2023-12-12T11:52:11.659 INFO:tasks.workunit.client.0.smithi063.stdout:8/900: dread - d4/d24/d38/f103 zero size 2023-12-12T11:52:11.665 INFO:tasks.workunit.client.0.smithi063.stdout:2/792: dread d0/d1a/d1e/d64/f89 [0,4194304] 0 2023-12-12T11:52:11.666 INFO:tasks.workunit.client.0.smithi063.stdout:8/901: creat d4/d24/d38/d45/d5b/d107/d62/d6e/d76/f11b x:0 0 0 2023-12-12T11:52:11.666 INFO:tasks.workunit.client.0.smithi063.stdout:8/902: creat d4/f11c x:0 0 0 2023-12-12T11:52:11.673 INFO:tasks.workunit.client.0.smithi063.stdout:8/903: creat d4/d24/d38/d45/d5b/d92/f11d x:0 0 0 2023-12-12T11:52:11.677 INFO:tasks.workunit.client.0.smithi063.stdout:8/904: creat d4/d55/d52/f11e x:0 0 0 2023-12-12T11:52:11.678 INFO:tasks.workunit.client.0.smithi063.stdout:9/725: write d7/d15/dc4/f48 [385023,55452] 0 2023-12-12T11:52:11.679 INFO:tasks.workunit.client.0.smithi063.stdout:5/871: dwrite d7/de/f1e [0,4194304] 0 2023-12-12T11:52:11.682 INFO:tasks.workunit.client.0.smithi063.stdout:5/872: link d7/d28/d67/cfc d7/de/c109 0 2023-12-12T11:52:11.682 INFO:tasks.workunit.client.0.smithi063.stdout:5/873: stat d7/d10/d2b/d3c/d42/d62/db4/f106 0 2023-12-12T11:52:11.684 INFO:tasks.workunit.client.0.smithi063.stdout:3/814: dwrite d4/df/d1a/d1c/d3b/d50/d61/fe4 [4194304,4194304] 0 2023-12-12T11:52:11.685 INFO:tasks.workunit.client.0.smithi063.stdout:5/874: mknod d7/d10/d2b/d3c/d27/c10a 0 2023-12-12T11:52:11.685 INFO:tasks.workunit.client.0.smithi063.stdout:5/875: truncate d7/d10/d2b/d3c/f86 885905 0 2023-12-12T11:52:11.686 INFO:tasks.workunit.client.0.smithi063.stdout:3/815: mknod d4/df/d1a/d1c/d3b/d52/db6/cf6 0 2023-12-12T11:52:11.688 INFO:tasks.workunit.client.0.smithi063.stdout:5/876: creat d7/d10/d2b/d3c/d5a/dd9/f10b x:0 0 0 2023-12-12T11:52:11.691 INFO:tasks.workunit.client.0.smithi063.stdout:5/877: symlink d7/d28/d6e/dad/d105/l10c 0 2023-12-12T11:52:11.692 INFO:tasks.workunit.client.0.smithi063.stdout:2/793: dread d0/d1a/d1e/d64/fbc [0,4194304] 0 2023-12-12T11:52:11.692 INFO:tasks.workunit.client.0.smithi063.stdout:2/794: write d0/d69/f9d [4561917,24146] 0 2023-12-12T11:52:11.692 INFO:tasks.workunit.client.0.smithi063.stdout:2/795: chown d0/c50 533 1 2023-12-12T11:52:11.693 INFO:tasks.workunit.client.0.smithi063.stdout:5/878: symlink d7/dcc/l10d 0 2023-12-12T11:52:11.693 INFO:tasks.workunit.client.0.smithi063.stdout:5/879: fsync d7/d10/f1b 0 2023-12-12T11:52:11.693 INFO:tasks.workunit.client.0.smithi063.stdout:5/880: chown d7/de/f25 9976703 1 2023-12-12T11:52:11.697 INFO:tasks.workunit.client.0.smithi063.stdout:9/726: dread d7/d15/f8f [0,4194304] 0 2023-12-12T11:52:11.697 INFO:tasks.workunit.client.0.smithi063.stdout:9/727: write d7/d15/f17 [5450828,81425] 0 2023-12-12T11:52:11.699 INFO:tasks.workunit.client.0.smithi063.stdout:2/796: rename d0/d1a/d3a/d85/dbf/fa1 to d0/d1a/d57/ff6 0 2023-12-12T11:52:11.710 INFO:tasks.workunit.client.0.smithi063.stdout:3/816: dread d4/df/d1a/d1c/d3b/f5b [0,4194304] 0 2023-12-12T11:52:11.713 INFO:tasks.workunit.client.0.smithi063.stdout:9/728: creat d7/d20/feb x:0 0 0 2023-12-12T11:52:11.715 INFO:tasks.workunit.client.0.smithi063.stdout:2/797: unlink d0/d1a/d1e/l7f 0 2023-12-12T11:52:11.715 INFO:tasks.workunit.client.0.smithi063.stdout:2/798: chown d0/d1a/d48/l42 99630 1 2023-12-12T11:52:11.718 INFO:tasks.workunit.client.0.smithi063.stdout:3/817: mknod d4/df/d1a/d1c/d34/d54/cf7 0 2023-12-12T11:52:11.719 INFO:tasks.workunit.client.0.smithi063.stdout:3/818: fdatasync d4/df/d1a/d1c/d3b/d50/f5a 0 2023-12-12T11:52:11.725 INFO:tasks.workunit.client.0.smithi063.stdout:9/729: rename d7/d20/d45/d46/d51/d64/fdb to d7/d11/d4b/d75/fec 0 2023-12-12T11:52:11.725 INFO:tasks.workunit.client.0.smithi063.stdout:7/778: dwrite de/d34/d43/d45/fee [0,4194304] 0 2023-12-12T11:52:11.726 INFO:tasks.workunit.client.0.smithi063.stdout:6/873: dread d9/d10/d5c/d5e/fd8 [0,4194304] 0 2023-12-12T11:52:11.729 INFO:tasks.workunit.client.0.smithi063.stdout:2/799: unlink d0/d1a/d1e/f31 0 2023-12-12T11:52:11.729 INFO:tasks.workunit.client.0.smithi063.stdout:3/819: creat d4/df/d1a/d1c/d41/ff8 x:0 0 0 2023-12-12T11:52:11.731 INFO:tasks.workunit.client.0.smithi063.stdout:7/779: mknod de/d3f/dc3/c117 0 2023-12-12T11:52:11.732 INFO:tasks.workunit.client.0.smithi063.stdout:6/874: rename d9/d68/d8f/c9c to d9/d10/d25/c12d 0 2023-12-12T11:52:11.734 INFO:tasks.workunit.client.0.smithi063.stdout:2/800: unlink d0/d1a/c24 0 2023-12-12T11:52:11.734 INFO:tasks.workunit.client.0.smithi063.stdout:6/875: write d9/d10/d2a/de7/d86/dc2/ded/f11e [627264,104049] 0 2023-12-12T11:52:11.736 INFO:tasks.workunit.client.0.smithi063.stdout:7/780: mknod de/d22/d6e/d8a/de3/c118 0 2023-12-12T11:52:11.736 INFO:tasks.workunit.client.0.smithi063.stdout:7/781: stat de/d34/d68/d89/l9d 0 2023-12-12T11:52:11.738 INFO:tasks.workunit.client.0.smithi063.stdout:2/801: link d0/d1a/d1e/c87 d0/cf7 0 2023-12-12T11:52:11.738 INFO:tasks.workunit.client.0.smithi063.stdout:2/802: chown d0/d1a/d3a/cc6 959368 1 2023-12-12T11:52:11.739 INFO:tasks.workunit.client.0.smithi063.stdout:2/803: dread - d0/d1a/d3a/d59/fcb zero size 2023-12-12T11:52:11.739 INFO:tasks.workunit.client.0.smithi063.stdout:2/804: stat d0/d69/f8c 0 2023-12-12T11:52:11.739 INFO:tasks.workunit.client.0.smithi063.stdout:2/805: write d0/d41/fe4 [1446222,45453] 0 2023-12-12T11:52:11.741 INFO:tasks.workunit.client.0.smithi063.stdout:3/820: mkdir d4/df/d1a/df9 0 2023-12-12T11:52:11.743 INFO:tasks.workunit.client.0.smithi063.stdout:7/782: rename de/d33/dd2/d4a/fdd to de/d22/d4d/f119 0 2023-12-12T11:52:11.743 INFO:tasks.workunit.client.0.smithi063.stdout:7/783: write de/d39/d60/f95 [3101208,110157] 0 2023-12-12T11:52:11.744 INFO:tasks.workunit.client.0.smithi063.stdout:3/821: mknod d4/df/d1a/d1c/d3b/d52/d78/cfa 0 2023-12-12T11:52:11.747 INFO:tasks.workunit.client.0.smithi063.stdout:7/784: unlink de/d33/dd2/d4a/fce 0 2023-12-12T11:52:11.749 INFO:tasks.workunit.client.0.smithi063.stdout:9/730: dread d7/d11/d4b/f68 [0,4194304] 0 2023-12-12T11:52:11.750 INFO:tasks.workunit.client.0.smithi063.stdout:6/876: dread d9/d2c/d61/dcd/f10a [0,4194304] 0 2023-12-12T11:52:11.750 INFO:tasks.workunit.client.0.smithi063.stdout:6/877: dread - d9/d10/d2a/de7/d86/dc2/ded/f101 zero size 2023-12-12T11:52:11.751 INFO:tasks.workunit.client.0.smithi063.stdout:8/905: dwrite d4/d24/d38/d45/fdb [4194304,4194304] 0 2023-12-12T11:52:11.754 INFO:tasks.workunit.client.0.smithi063.stdout:5/881: dwrite d7/d10/d2b/d3c/d5a/dbb/fc2 [0,4194304] 0 2023-12-12T11:52:11.754 INFO:tasks.workunit.client.0.smithi063.stdout:9/731: mkdir d7/d15/dc4/d3e/de7/ded 0 2023-12-12T11:52:11.757 INFO:tasks.workunit.client.0.smithi063.stdout:4/862: dwrite d2/d17/d81/f8c [0,4194304] 0 2023-12-12T11:52:11.760 INFO:tasks.workunit.client.0.smithi063.stdout:4/863: creat d2/d48/d69/dd2/f117 x:0 0 0 2023-12-12T11:52:11.760 INFO:tasks.workunit.client.0.smithi063.stdout:7/785: getdents de/d33/d41/d44/d8b 0 2023-12-12T11:52:11.763 INFO:tasks.workunit.client.0.smithi063.stdout:8/906: link d4/d24/d38/d45/d5b/d107/d62/d36/d57/d84/c115 d4/d24/d38/d45/d5b/d92/d65/c11f 0 2023-12-12T11:52:11.763 INFO:tasks.workunit.client.0.smithi063.stdout:8/907: readlink d4/d24/d38/d45/d5b/d107/d62/d36/d7f/l10a 0 2023-12-12T11:52:11.763 INFO:tasks.workunit.client.0.smithi063.stdout:8/908: dread - d4/d24/d38/d45/d5b/d107/d62/d6e/f109 zero size 2023-12-12T11:52:11.776 INFO:tasks.workunit.client.0.smithi063.stdout:5/882: truncate d7/de/f30 388220 0 2023-12-12T11:52:11.776 INFO:tasks.workunit.client.0.smithi063.stdout:5/883: truncate d7/d28/df1/ffd 1035227 0 2023-12-12T11:52:11.776 INFO:tasks.workunit.client.0.smithi063.stdout:9/732: mknod d7/d20/d45/d46/d51/dc3/cee 0 2023-12-12T11:52:11.776 INFO:tasks.workunit.client.0.smithi063.stdout:9/733: chown d7/d15/dc4/d3e/d55/f81 5371 1 2023-12-12T11:52:11.787 INFO:tasks.workunit.client.0.smithi063.stdout:5/884: dread d7/d10/d2b/d3c/d42/d62/d69/fbf [0,4194304] 0 2023-12-12T11:52:11.787 INFO:tasks.workunit.client.0.smithi063.stdout:5/885: write d7/f15 [2087166,121943] 0 2023-12-12T11:52:11.809 INFO:tasks.workunit.client.0.smithi063.stdout:4/864: rmdir d2/d48/d69/d98 39 2023-12-12T11:52:11.809 INFO:tasks.workunit.client.0.smithi063.stdout:4/865: dread - d2/d47/d6d/d88/de6/df3/f10f zero size 2023-12-12T11:52:11.814 INFO:tasks.workunit.client.0.smithi063.stdout:8/909: creat d4/de/f120 x:0 0 0 2023-12-12T11:52:11.814 INFO:tasks.workunit.client.0.smithi063.stdout:8/910: readlink d4/d55/l5e 0 2023-12-12T11:52:11.817 INFO:tasks.workunit.client.0.smithi063.stdout:6/878: rename d9/d10/d2a/de7/d86/dc2/ded/df5/d118 to d9/d10/d2a/de7/d8a/df8/d12e 0 2023-12-12T11:52:11.822 INFO:tasks.workunit.client.0.smithi063.stdout:8/911: truncate f0 2452972 0 2023-12-12T11:52:11.822 INFO:tasks.workunit.client.0.smithi063.stdout:8/912: chown d4/d24/db3/dfa 10 1 2023-12-12T11:52:11.826 INFO:tasks.workunit.client.0.smithi063.stdout:5/886: rename d7/d10/d2b/d3c/d42/d76/fae to d7/d10/d2b/d3c/d42/d62/db4/f10e 0 2023-12-12T11:52:11.828 INFO:tasks.workunit.client.0.smithi063.stdout:3/822: dwrite d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/fae [0,4194304] 0 2023-12-12T11:52:11.832 INFO:tasks.workunit.client.0.smithi063.stdout:5/887: rename d7/d10/d2b/fb6 to d7/d10/d2b/d3c/d42/d62/d69/dcb/de0/f10f 0 2023-12-12T11:52:11.832 INFO:tasks.workunit.client.0.smithi063.stdout:5/888: chown d7/d10/d2b/d3c/fa4 7969 1 2023-12-12T11:52:11.832 INFO:tasks.workunit.client.0.smithi063.stdout:5/889: creat d7/d10/d2b/d3c/d42/f110 x:0 0 0 2023-12-12T11:52:11.841 INFO:tasks.workunit.client.0.smithi063.stdout:5/890: rename d7/cd to d7/d28/d6e/c111 0 2023-12-12T11:52:11.843 INFO:tasks.workunit.client.0.smithi063.stdout:6/879: dread d9/f3b [0,4194304] 0 2023-12-12T11:52:11.849 INFO:tasks.workunit.client.0.smithi063.stdout:9/734: dwrite d7/d15/dc4/d3e/d55/f81 [4194304,4194304] 0 2023-12-12T11:52:11.850 INFO:tasks.workunit.client.0.smithi063.stdout:8/913: dread d4/d24/d38/d45/d5b/d107/d62/d6e/d76/f7a [0,4194304] 0 2023-12-12T11:52:11.850 INFO:tasks.workunit.client.0.smithi063.stdout:8/914: write d4/d24/d38/dd8/df5/f118 [918274,118520] 0 2023-12-12T11:52:11.858 INFO:tasks.workunit.client.0.smithi063.stdout:9/735: mkdir d7/d20/d45/d46/def 0 2023-12-12T11:52:11.858 INFO:tasks.workunit.client.0.smithi063.stdout:5/891: dread d7/d10/d2b/d3c/d42/d62/d69/f73 [0,4194304] 0 2023-12-12T11:52:11.858 INFO:tasks.workunit.client.0.smithi063.stdout:5/892: readlink d7/d28/d67/lb5 0 2023-12-12T11:52:11.858 INFO:tasks.workunit.client.0.smithi063.stdout:3/823: write d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d56/d79/ff1 [3012137,62365] 0 2023-12-12T11:52:11.861 INFO:tasks.workunit.client.0.smithi063.stdout:3/824: mkdir d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d56/d79/dfb 0 2023-12-12T11:52:11.861 INFO:tasks.workunit.client.0.smithi063.stdout:3/825: fdatasync d4/df/d1a/d1c/d3b/d52/d78/dbb/fc4 0 2023-12-12T11:52:11.862 INFO:tasks.workunit.client.0.smithi063.stdout:9/736: write d7/f2b [6403487,125345] 0 2023-12-12T11:52:11.862 INFO:tasks.workunit.client.0.smithi063.stdout:9/737: chown d7/d15/dc4/d3e 5018093 1 2023-12-12T11:52:11.867 INFO:tasks.workunit.client.0.smithi063.stdout:3/826: truncate d4/df/d1a/d1c/d3b/d52/d78/da5/d98/fd7 360300 0 2023-12-12T11:52:11.870 INFO:tasks.workunit.client.0.smithi063.stdout:7/786: dwrite de/d39/f5e [0,4194304] 0 2023-12-12T11:52:11.871 INFO:tasks.workunit.client.0.smithi063.stdout:8/915: dread d4/d24/d38/d45/d5b/d107/d62/d36/d57/f7c [0,4194304] 0 2023-12-12T11:52:11.871 INFO:tasks.workunit.client.0.smithi063.stdout:8/916: dread - d4/d24/db3/dfa/f108 zero size 2023-12-12T11:52:11.871 INFO:tasks.workunit.client.0.smithi063.stdout:9/738: creat d7/d20/d3f/d40/da7/ff0 x:0 0 0 2023-12-12T11:52:11.893 INFO:tasks.workunit.client.0.smithi063.stdout:9/739: rmdir d7/d20/daf 39 2023-12-12T11:52:11.897 INFO:tasks.workunit.client.0.smithi063.stdout:7/787: rename de/d33 to de/d34/d68/d11a 0 2023-12-12T11:52:11.897 INFO:tasks.workunit.client.0.smithi063.stdout:7/788: stat de/d39/d88 0 2023-12-12T11:52:11.899 INFO:tasks.workunit.client.0.smithi063.stdout:9/740: creat d7/d20/d65/ff1 x:0 0 0 2023-12-12T11:52:11.901 INFO:tasks.workunit.client.0.smithi063.stdout:7/789: creat de/d22/d6e/dc4/f11b x:0 0 0 2023-12-12T11:52:11.904 INFO:tasks.workunit.client.0.smithi063.stdout:9/741: dread - d7/d11/d94/fa3 zero size 2023-12-12T11:52:11.904 INFO:tasks.workunit.client.0.smithi063.stdout:9/742: chown d7/d20/d65/fa2 0 1 2023-12-12T11:52:11.904 INFO:tasks.workunit.client.0.smithi063.stdout:8/917: write d4/d24/d38/d45/d5b/d107/d62/fe0 [1123734,45889] 0 2023-12-12T11:52:11.908 INFO:tasks.workunit.client.0.smithi063.stdout:7/790: link de/f28 de/d34/d68/da1/f11c 0 2023-12-12T11:52:11.908 INFO:tasks.workunit.client.0.smithi063.stdout:4/866: dwrite d2/d17/d4e/dd9/f108 [0,4194304] 0 2023-12-12T11:52:11.919 INFO:tasks.workunit.client.0.smithi063.stdout:4/867: mkdir d2/d47/d6d/d88/d118 0 2023-12-12T11:52:11.921 INFO:tasks.workunit.client.0.smithi063.stdout:7/791: symlink de/d34/d68/da1/dcd/l11d 0 2023-12-12T11:52:11.921 INFO:tasks.workunit.client.0.smithi063.stdout:7/792: readlink de/d34/d68/d11a/dd2/l67 0 2023-12-12T11:52:11.921 INFO:tasks.workunit.client.0.smithi063.stdout:7/793: chown de/d22/d66 88773 1 2023-12-12T11:52:11.922 INFO:tasks.workunit.client.0.smithi063.stdout:4/868: mknod d2/d47/d6d/d88/de6/c119 0 2023-12-12T11:52:11.932 INFO:tasks.workunit.client.0.smithi063.stdout:3/827: dwrite d4/d23/d7b/dc2/fcc [0,4194304] 0 2023-12-12T11:52:11.942 INFO:tasks.workunit.client.0.smithi063.stdout:3/828: mkdir d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d56/d79/dfc 0 2023-12-12T11:52:11.947 INFO:tasks.workunit.client.0.smithi063.stdout:0/869: sync 2023-12-12T11:52:11.947 INFO:tasks.workunit.client.0.smithi063.stdout:2/806: sync 2023-12-12T11:52:11.947 INFO:tasks.workunit.client.0.smithi063.stdout:1/905: sync 2023-12-12T11:52:11.947 INFO:tasks.workunit.client.0.smithi063.stdout:1/906: readlink d3/d3a/dd7/d12/l38 0 2023-12-12T11:52:11.947 INFO:tasks.workunit.client.0.smithi063.stdout:1/907: getdents d3/d3a/dd7/d16/d24/d30/d12d 0 2023-12-12T11:52:11.947 INFO:tasks.workunit.client.0.smithi063.stdout:7/794: write fb [1419830,61491] 0 2023-12-12T11:52:11.949 INFO:tasks.workunit.client.0.smithi063.stdout:7/795: symlink de/d34/d68/d11a/d41/d44/d8b/dde/dc7/l11e 0 2023-12-12T11:52:11.952 INFO:tasks.workunit.client.0.smithi063.stdout:7/796: link de/d39/c3a de/d22/d4d/c11f 0 2023-12-12T11:52:11.952 INFO:tasks.workunit.client.0.smithi063.stdout:7/797: truncate de/f13 4228977 0 2023-12-12T11:52:11.954 INFO:tasks.workunit.client.0.smithi063.stdout:7/798: getdents de/d34/d68/d11a/d41 0 2023-12-12T11:52:11.963 INFO:tasks.workunit.client.0.smithi063.stdout:9/743: write d7/d11/d12/f4a [843780,21565] 0 2023-12-12T11:52:11.964 INFO:tasks.workunit.client.0.smithi063.stdout:5/893: dwrite d7/d10/d2b/d3c/d27/fb9 [0,4194304] 0 2023-12-12T11:52:11.964 INFO:tasks.workunit.client.0.smithi063.stdout:7/799: mkdir de/d39/d60/da4/d120 0 2023-12-12T11:52:11.965 INFO:tasks.workunit.client.0.smithi063.stdout:0/870: write d0/d1a/d23/fe1 [478351,91846] 0 2023-12-12T11:52:11.974 INFO:tasks.workunit.client.0.smithi063.stdout:1/908: dread d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2/f101 [0,4194304] 0 2023-12-12T11:52:11.974 INFO:tasks.workunit.client.0.smithi063.stdout:1/909: dread - d3/d3a/d52/f10b zero size 2023-12-12T11:52:11.982 INFO:tasks.workunit.client.0.smithi063.stdout:5/894: dread d7/d10/d2b/d3c/d42/f7d [0,4194304] 0 2023-12-12T11:52:11.989 INFO:tasks.workunit.client.0.smithi063.stdout:1/910: creat d3/d3a/dd7/d16/f12f x:0 0 0 2023-12-12T11:52:11.993 INFO:tasks.workunit.client.0.smithi063.stdout:9/744: dread d7/d20/d65/f72 [0,4194304] 0 2023-12-12T11:52:11.995 INFO:tasks.workunit.client.0.smithi063.stdout:5/895: mkdir d7/d10/d2b/d3c/d42/d62/d69/d112 0 2023-12-12T11:52:12.001 INFO:tasks.workunit.client.0.smithi063.stdout:8/918: dwrite d4/d24/d38/d45/d5b/d107/d62/fa6 [0,4194304] 0 2023-12-12T11:52:12.010 INFO:tasks.workunit.client.0.smithi063.stdout:3/829: dread d4/d23/d6b/d90/fc3 [0,4194304] 0 2023-12-12T11:52:12.013 INFO:tasks.workunit.client.0.smithi063.stdout:7/800: dwrite de/d34/d68/d11a/dd2/d4a/d65/fc6 [0,4194304] 0 2023-12-12T11:52:12.021 INFO:tasks.workunit.client.0.smithi063.stdout:4/869: dwrite d2/d47/d6d/d88/df0/fbb [0,4194304] 0 2023-12-12T11:52:12.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:11 smithi063 ceph-mon[107117]: pgmap v20: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 160 MiB/s rd, 181 MiB/s wr, 285 op/s 2023-12-12T11:52:12.055 INFO:tasks.workunit.client.0.smithi063.stdout:4/870: dwrite d2/d47/d6d/d88/df0/f32 [0,4194304] 0 2023-12-12T11:52:12.055 INFO:tasks.workunit.client.0.smithi063.stdout:4/871: dread - d2/d17/d81/f8a zero size 2023-12-12T11:52:12.118 INFO:tasks.workunit.client.0.smithi063.stdout:9/745: creat d7/d20/d45/d8e/ff2 x:0 0 0 2023-12-12T11:52:12.130 INFO:tasks.workunit.client.0.smithi063.stdout:8/919: symlink d4/d24/d38/d45/d5b/d92/d65/d101/l121 0 2023-12-12T11:52:12.131 INFO:tasks.workunit.client.0.smithi063.stdout:8/920: read d4/d24/d38/dd8/df3/f116 [1338240,42022] 0 2023-12-12T11:52:12.160 INFO:tasks.workunit.client.0.smithi063.stdout:3/830: truncate d4/df/d1a/d1c/d3b/d50/fa4 900591 0 2023-12-12T11:52:12.185 INFO:tasks.workunit.client.0.smithi063.stdout:7/801: symlink de/d34/d68/d11a/d41/d44/d8b/dde/de6/l121 0 2023-12-12T11:52:12.305 INFO:tasks.workunit.client.0.smithi063.stdout:9/746: link d7/d11/f25 d7/d20/d45/d46/d51/d64/d6f/dad/ff3 0 2023-12-12T11:52:12.307 INFO:tasks.workunit.client.0.smithi063.stdout:8/921: symlink d4/d24/d38/ddc/de2/l122 0 2023-12-12T11:52:12.307 INFO:tasks.workunit.client.0.smithi063.stdout:8/922: truncate d4/d24/d38/d45/d5b/d107/d62/fc4 19742 0 2023-12-12T11:52:12.307 INFO:tasks.workunit.client.0.smithi063.stdout:8/923: truncate d4/d24/d38/d45/d5b/d107/d62/d36/dc6/fe6 5070068 0 2023-12-12T11:52:12.307 INFO:tasks.workunit.client.0.smithi063.stdout:8/924: read d4/d24/d38/d45/d5b/d107/d62/d6e/d76/f7a [7494661,98067] 0 2023-12-12T11:52:12.307 INFO:tasks.workunit.client.0.smithi063.stdout:8/925: creat d4/de/d1e/d6d/f123 x:0 0 0 2023-12-12T11:52:12.309 INFO:tasks.workunit.client.0.smithi063.stdout:3/831: mkdir d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/da1/dfd 0 2023-12-12T11:52:12.310 INFO:tasks.workunit.client.0.smithi063.stdout:5/896: mknod d7/d10/d2b/d3c/d42/d62/c113 0 2023-12-12T11:52:12.311 INFO:tasks.workunit.client.0.smithi063.stdout:9/747: mknod d7/d15/db2/cf4 0 2023-12-12T11:52:12.315 INFO:tasks.workunit.client.0.smithi063.stdout:8/926: truncate d4/f17 7196119 0 2023-12-12T11:52:12.315 INFO:tasks.workunit.client.0.smithi063.stdout:8/927: readlink d4/d24/d38/d45/d5b/d107/d62/d6e/d76/d93/le1 0 2023-12-12T11:52:12.315 INFO:tasks.workunit.client.0.smithi063.stdout:8/928: truncate d4/d24/d38/dd8/f110 696560 0 2023-12-12T11:52:12.315 INFO:tasks.workunit.client.0.smithi063.stdout:8/929: truncate d4/d24/d38/d45/d5b/d107/fa8 464081 0 2023-12-12T11:52:12.315 INFO:tasks.workunit.client.0.smithi063.stdout:8/930: chown d4/d24/d38/l47 3582765 1 2023-12-12T11:52:12.323 INFO:tasks.workunit.client.0.smithi063.stdout:9/748: rmdir d7/d15/dc4/d3e/de7/ded 0 2023-12-12T11:52:12.323 INFO:tasks.workunit.client.0.smithi063.stdout:9/749: truncate d7/d15/db2/fcc 75423 0 2023-12-12T11:52:12.323 INFO:tasks.workunit.client.0.smithi063.stdout:5/897: dread d7/de/f30 [0,4194304] 0 2023-12-12T11:52:12.323 INFO:tasks.workunit.client.0.smithi063.stdout:5/898: creat d7/d10/d2b/d3c/d27/f114 x:0 0 0 2023-12-12T11:52:12.323 INFO:tasks.workunit.client.0.smithi063.stdout:5/899: creat d7/d10/f115 x:0 0 0 2023-12-12T11:52:12.329 INFO:tasks.workunit.client.0.smithi063.stdout:9/750: dread d7/d20/d45/fa5 [0,4194304] 0 2023-12-12T11:52:12.388 INFO:tasks.workunit.client.0.smithi063.stdout:4/872: dwrite d2/f56 [0,4194304] 0 2023-12-12T11:52:12.388 INFO:tasks.workunit.client.0.smithi063.stdout:4/873: write d2/d47/d6d/d88/de6/df3/f10f [752690,108592] 0 2023-12-12T11:52:12.388 INFO:tasks.workunit.client.0.smithi063.stdout:4/874: fdatasync d2/d47/f53 0 2023-12-12T11:52:12.390 INFO:tasks.workunit.client.0.smithi063.stdout:4/875: mknod d2/d47/d6d/d88/df0/db3/c11a 0 2023-12-12T11:52:12.394 INFO:tasks.workunit.client.0.smithi063.stdout:9/751: symlink d7/d20/d45/lf5 0 2023-12-12T11:52:12.401 INFO:tasks.workunit.client.0.smithi063.stdout:1/911: rename d3/d3a/dd7/f20 to d3/d3a/d52/ddf/f130 0 2023-12-12T11:52:12.401 INFO:tasks.workunit.client.0.smithi063.stdout:1/912: chown d3/d3a/dd7/d16/d24/f73 444 1 2023-12-12T11:52:12.403 INFO:tasks.workunit.client.0.smithi063.stdout:5/900: symlink d7/d10/d2b/d3c/d5a/l116 0 2023-12-12T11:52:12.409 INFO:tasks.workunit.client.0.smithi063.stdout:1/913: write d3/fb1 [2752637,24920] 0 2023-12-12T11:52:12.409 INFO:tasks.workunit.client.0.smithi063.stdout:1/914: write d3/f105 [1006523,23567] 0 2023-12-12T11:52:12.413 INFO:tasks.workunit.client.0.smithi063.stdout:8/931: rename d4/d55 to d4/d24/d38/d45/d5b/d107/d124 0 2023-12-12T11:52:12.415 INFO:tasks.workunit.client.0.smithi063.stdout:9/752: rename d7/d11/d4b/d75/c7f to d7/d20/d3f/d40/ddc/cf6 0 2023-12-12T11:52:12.415 INFO:tasks.workunit.client.0.smithi063.stdout:5/901: rename d7/d10 to d7/d10/d2b/d3c/d63/d117 22 2023-12-12T11:52:12.416 INFO:tasks.workunit.client.0.smithi063.stdout:9/753: rmdir d7/d15/dc4/d3e/d55 39 2023-12-12T11:52:12.417 INFO:tasks.workunit.client.0.smithi063.stdout:4/876: mknod d2/d47/d6d/d88/df0/c11b 0 2023-12-12T11:52:12.425 INFO:tasks.workunit.client.0.smithi063.stdout:9/754: creat d7/d20/d45/d46/d51/d64/d6f/dad/ff7 x:0 0 0 2023-12-12T11:52:12.426 INFO:tasks.workunit.client.0.smithi063.stdout:4/877: unlink d2/d47/d6d/d88/fa0 0 2023-12-12T11:52:12.426 INFO:tasks.workunit.client.0.smithi063.stdout:4/878: unlink d2/d48/c89 0 2023-12-12T11:52:12.428 INFO:tasks.workunit.client.0.smithi063.stdout:3/832: link d4/f76 d4/d23/ffe 0 2023-12-12T11:52:12.428 INFO:tasks.workunit.client.0.smithi063.stdout:3/833: truncate d4/d23/d6b/f95 5221636 0 2023-12-12T11:52:12.428 INFO:tasks.workunit.client.0.smithi063.stdout:3/834: write d4/df/d1a/f20 [8765757,67482] 0 2023-12-12T11:52:12.433 INFO:tasks.workunit.client.0.smithi063.stdout:0/871: sync 2023-12-12T11:52:12.433 INFO:tasks.workunit.client.0.smithi063.stdout:6/880: sync 2023-12-12T11:52:12.433 INFO:tasks.workunit.client.0.smithi063.stdout:2/807: sync 2023-12-12T11:52:12.436 INFO:tasks.workunit.client.0.smithi063.stdout:2/808: unlink d0/d1a/d1e/d64/fe3 0 2023-12-12T11:52:12.450 INFO:tasks.workunit.client.0.smithi063.stdout:2/809: write d0/d1a/d48/f34 [3946148,96718] 0 2023-12-12T11:52:12.455 INFO:tasks.workunit.client.0.smithi063.stdout:2/810: rename d0/d1a/d3a/d85/da6/fb5 to d0/d41/ff8 0 2023-12-12T11:52:12.458 INFO:tasks.workunit.client.0.smithi063.stdout:3/835: dread d4/df/d1a/d1c/d3b/d50/d61/fe4 [0,4194304] 0 2023-12-12T11:52:12.462 INFO:tasks.workunit.client.0.smithi063.stdout:2/811: creat d0/d1a/dba/ff9 x:0 0 0 2023-12-12T11:52:12.462 INFO:tasks.workunit.client.0.smithi063.stdout:2/812: fdatasync d0/f5f 0 2023-12-12T11:52:12.464 INFO:tasks.workunit.client.0.smithi063.stdout:3/836: mkdir d4/d23/d6b/dff 0 2023-12-12T11:52:12.472 INFO:tasks.workunit.client.0.smithi063.stdout:2/813: creat d0/d1a/d57/ddc/df2/df4/ffa x:0 0 0 2023-12-12T11:52:12.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:11 smithi093 ceph-mon[115914]: pgmap v20: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 160 MiB/s rd, 181 MiB/s wr, 285 op/s 2023-12-12T11:52:12.474 INFO:tasks.workunit.client.0.smithi063.stdout:6/881: write d9/d10/d2a/fc7 [1045432,75300] 0 2023-12-12T11:52:12.474 INFO:tasks.workunit.client.0.smithi063.stdout:6/882: read - d9/d10/dfc/f11b zero size 2023-12-12T11:52:12.481 INFO:tasks.workunit.client.0.smithi063.stdout:8/932: dwrite d4/f22 [0,4194304] 0 2023-12-12T11:52:12.481 INFO:tasks.workunit.client.0.smithi063.stdout:2/814: creat d0/d1a/d57/ddc/df2/ffb x:0 0 0 2023-12-12T11:52:12.486 INFO:tasks.workunit.client.0.smithi063.stdout:6/883: link d9/d10/d2a/f3e d9/d10/d2a/de7/d8a/df8/f12f 0 2023-12-12T11:52:12.492 INFO:tasks.workunit.client.0.smithi063.stdout:3/837: rmdir d4/df/d1a/d1c/d3b/d52 39 2023-12-12T11:52:12.500 INFO:tasks.workunit.client.0.smithi063.stdout:9/755: dwrite d7/d15/d39/f47 [0,4194304] 0 2023-12-12T11:52:12.504 INFO:tasks.workunit.client.0.smithi063.stdout:9/756: rmdir d7/d20/d3f 39 2023-12-12T11:52:12.508 INFO:tasks.workunit.client.0.smithi063.stdout:1/915: dwrite d3/d3a/ffb [0,4194304] 0 2023-12-12T11:52:12.511 INFO:tasks.workunit.client.0.smithi063.stdout:5/902: dwrite d7/d10/d2b/d3c/d27/f114 [0,4194304] 0 2023-12-12T11:52:12.512 INFO:tasks.workunit.client.0.smithi063.stdout:9/757: mkdir d7/d11/d4b/d75/df8 0 2023-12-12T11:52:12.523 INFO:tasks.workunit.client.0.smithi063.stdout:0/872: dwrite d0/d1a/d23/d2e/ffc [0,4194304] 0 2023-12-12T11:52:12.524 INFO:tasks.workunit.client.0.smithi063.stdout:0/873: fdatasync d0/d7/d27/fc9 0 2023-12-12T11:52:12.524 INFO:tasks.workunit.client.0.smithi063.stdout:0/874: truncate d0/d1a/d66/f6e 1421830 0 2023-12-12T11:52:12.524 INFO:tasks.workunit.client.0.smithi063.stdout:0/875: chown d0/d1a/d23/d2e/dd4/ddc/f11c 9 1 2023-12-12T11:52:12.526 INFO:tasks.workunit.client.0.smithi063.stdout:4/879: dwrite d2/d17/d41/f5b [0,4194304] 0 2023-12-12T11:52:12.535 INFO:tasks.workunit.client.0.smithi063.stdout:6/884: read d9/d68/f90 [1058955,29473] 0 2023-12-12T11:52:12.535 INFO:tasks.workunit.client.0.smithi063.stdout:6/885: dread - d9/d10/d25/f56 zero size 2023-12-12T11:52:12.535 INFO:tasks.workunit.client.0.smithi063.stdout:6/886: chown d9/d10/d73 39342371 1 2023-12-12T11:52:12.536 INFO:tasks.workunit.client.0.smithi063.stdout:6/887: fdatasync d9/f27 0 2023-12-12T11:52:12.537 INFO:tasks.workunit.client.0.smithi063.stdout:8/933: write d4/d24/d38/d45/d5b/d107/d62/fa6 [3771792,61115] 0 2023-12-12T11:52:12.546 INFO:tasks.workunit.client.0.smithi063.stdout:5/903: dread d7/d10/f1b [0,4194304] 0 2023-12-12T11:52:12.546 INFO:tasks.workunit.client.0.smithi063.stdout:5/904: read - d7/d10/d2b/d3c/d42/d62/db4/f106 zero size 2023-12-12T11:52:12.547 INFO:tasks.workunit.client.0.smithi063.stdout:5/905: dread - d7/d10/d2b/d3c/d42/d62/d69/dcb/de0/f101 zero size 2023-12-12T11:52:12.550 INFO:tasks.workunit.client.0.smithi063.stdout:3/838: dwrite d4/df/f19 [0,4194304] 0 2023-12-12T11:52:12.555 INFO:tasks.workunit.client.0.smithi063.stdout:6/888: write d9/d10/d5c/fbf [427878,84740] 0 2023-12-12T11:52:12.565 INFO:tasks.workunit.client.0.smithi063.stdout:2/815: dwrite d0/d1a/d57/ddc/df2/df4/ffa [0,4194304] 0 2023-12-12T11:52:12.568 INFO:tasks.workunit.client.0.smithi063.stdout:3/839: write f0 [7561266,6760] 0 2023-12-12T11:52:12.568 INFO:tasks.workunit.client.0.smithi063.stdout:9/758: creat d7/d15/dc4/d3e/ff9 x:0 0 0 2023-12-12T11:52:12.577 INFO:tasks.workunit.client.0.smithi063.stdout:4/880: mkdir d2/d17/d9d/d85/da5/d11c 0 2023-12-12T11:52:12.577 INFO:tasks.workunit.client.0.smithi063.stdout:4/881: chown d2/d47/d6d/d88/fa6 19504580 1 2023-12-12T11:52:12.578 INFO:tasks.workunit.client.0.smithi063.stdout:1/916: getdents d3/d3a/dd7/d16/d24/d48/d75/d83/d81 0 2023-12-12T11:52:12.578 INFO:tasks.workunit.client.0.smithi063.stdout:1/917: chown f2 5147882 1 2023-12-12T11:52:12.583 INFO:tasks.workunit.client.0.smithi063.stdout:8/934: stat d4/d24/d38/l47 0 2023-12-12T11:52:12.588 INFO:tasks.workunit.client.0.smithi063.stdout:3/840: dread d4/d23/d7b/dc2/fcc [0,4194304] 0 2023-12-12T11:52:12.588 INFO:tasks.workunit.client.0.smithi063.stdout:3/841: chown d4/df/d1a/d1c/d3b/d50 90375810 1 2023-12-12T11:52:12.588 INFO:tasks.workunit.client.0.smithi063.stdout:3/842: fsync d4/df/d1a/d1c/f2d 0 2023-12-12T11:52:12.588 INFO:tasks.workunit.client.0.smithi063.stdout:3/843: fsync d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/fd3 0 2023-12-12T11:52:12.590 INFO:tasks.workunit.client.0.smithi063.stdout:0/876: dwrite d0/d1a/d23/d34/fd5 [0,4194304] 0 2023-12-12T11:52:12.598 INFO:tasks.workunit.client.0.smithi063.stdout:9/759: write d7/d11/fa0 [3608152,75152] 0 2023-12-12T11:52:12.598 INFO:tasks.workunit.client.0.smithi063.stdout:9/760: write d7/d15/dc4/f48 [2094857,8818] 0 2023-12-12T11:52:12.598 INFO:tasks.workunit.client.0.smithi063.stdout:9/761: readlink d7/d20/d45/d46/d51/d64/d6f/le4 0 2023-12-12T11:52:12.599 INFO:tasks.workunit.client.0.smithi063.stdout:4/882: dread d2/d17/d4e/fcf [0,4194304] 0 2023-12-12T11:52:12.599 INFO:tasks.workunit.client.0.smithi063.stdout:4/883: stat d2/d47/l34 0 2023-12-12T11:52:12.599 INFO:tasks.workunit.client.0.smithi063.stdout:4/884: readlink d2/d17/d4e/l102 0 2023-12-12T11:52:12.605 INFO:tasks.workunit.client.0.smithi063.stdout:2/816: rename d0/d1a/d48/d56/c9c to d0/cfc 0 2023-12-12T11:52:12.605 INFO:tasks.workunit.client.0.smithi063.stdout:6/889: rmdir d9/d10/d73 39 2023-12-12T11:52:12.606 INFO:tasks.workunit.client.0.smithi063.stdout:7/802: sync 2023-12-12T11:52:12.608 INFO:tasks.workunit.client.0.smithi063.stdout:5/906: getdents d7/d10/d2b/d3c/d42/d62/db4 0 2023-12-12T11:52:12.617 INFO:tasks.workunit.client.0.smithi063.stdout:7/803: mkdir de/d34/d68/d122 0 2023-12-12T11:52:12.617 INFO:tasks.workunit.client.0.smithi063.stdout:8/935: read d4/f17 [1892513,19498] 0 2023-12-12T11:52:12.622 INFO:tasks.workunit.client.0.smithi063.stdout:4/885: link d2/d47/d6d/d88/df0/c35 d2/d17/d4e/c11d 0 2023-12-12T11:52:12.622 INFO:tasks.workunit.client.0.smithi063.stdout:4/886: chown d2/d17/f3e 124 1 2023-12-12T11:52:12.622 INFO:tasks.workunit.client.0.smithi063.stdout:7/804: truncate de/d39/d4b/d7b/f9b 2025881 0 2023-12-12T11:52:12.626 INFO:tasks.workunit.client.0.smithi063.stdout:7/805: fsync de/d22/d4d/f91 0 2023-12-12T11:52:12.633 INFO:tasks.workunit.client.0.smithi063.stdout:8/936: rename d4/d24/d38/d45/d5b/d107/d124/d114 to d4/d24/d38/ddc/d125 0 2023-12-12T11:52:12.643 INFO:tasks.workunit.client.0.smithi063.stdout:8/937: mknod d4/d24/d38/d45/d5b/d107/d62/d91/c126 0 2023-12-12T11:52:12.647 INFO:tasks.workunit.client.0.smithi063.stdout:1/918: dwrite d3/d3a/dd7/d16/d24/d4d/d35/d98/fef [0,4194304] 0 2023-12-12T11:52:12.649 INFO:tasks.workunit.client.0.smithi063.stdout:4/887: symlink d2/d47/d6d/d88/df0/l11e 0 2023-12-12T11:52:12.653 INFO:tasks.workunit.client.0.smithi063.stdout:3/844: dwrite d4/df/d1a/d1c/d41/f58 [0,4194304] 0 2023-12-12T11:52:12.656 INFO:tasks.workunit.client.0.smithi063.stdout:0/877: dwrite d0/d1a/d23/d2e/d84/fa5 [0,4194304] 0 2023-12-12T11:52:12.666 INFO:tasks.workunit.client.0.smithi063.stdout:1/919: write d3/d3a/d52/fb7 [52550,86210] 0 2023-12-12T11:52:12.668 INFO:tasks.workunit.client.0.smithi063.stdout:3/845: creat d4/df/d1a/d1c/d3b/d52/d78/da5/dbc/f100 x:0 0 0 2023-12-12T11:52:12.672 INFO:tasks.workunit.client.0.smithi063.stdout:0/878: mkdir d0/d1a/d23/dfd/d11f 0 2023-12-12T11:52:12.672 INFO:tasks.workunit.client.0.smithi063.stdout:0/879: dread - d0/d1a/d23/d2e/dd4/ddc/f11c zero size 2023-12-12T11:52:12.683 INFO:tasks.workunit.client.0.smithi063.stdout:5/907: dwrite d7/f104 [0,4194304] 0 2023-12-12T11:52:12.689 INFO:tasks.workunit.client.0.smithi063.stdout:1/920: rmdir d3/d3a/dd7/d16/d24/d48/d75/d83 39 2023-12-12T11:52:12.692 INFO:tasks.workunit.client.0.smithi063.stdout:0/880: creat d0/d8e/f120 x:0 0 0 2023-12-12T11:52:12.694 INFO:tasks.workunit.client.0.smithi063.stdout:4/888: rename d2/d48/d69 to d2/d47/d6d/d88/d11f 0 2023-12-12T11:52:12.694 INFO:tasks.workunit.client.0.smithi063.stdout:4/889: fsync d2/d17/d7f/fe8 0 2023-12-12T11:52:12.694 INFO:tasks.workunit.client.0.smithi063.stdout:4/890: fsync d2/d47/fd8 0 2023-12-12T11:52:12.694 INFO:tasks.workunit.client.0.smithi063.stdout:9/762: dread d7/f54 [0,4194304] 0 2023-12-12T11:52:12.704 INFO:tasks.workunit.client.0.smithi063.stdout:8/938: dwrite d4/d24/d38/d45/d5b/d107/d62/d36/d57/f89 [0,4194304] 0 2023-12-12T11:52:12.705 INFO:tasks.workunit.client.0.smithi063.stdout:5/908: link d7/d10/d2b/d3c/lc6 d7/d10/d2b/d3c/d42/d62/d69/dcb/de0/l118 0 2023-12-12T11:52:12.709 INFO:tasks.workunit.client.0.smithi063.stdout:1/921: getdents d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2 0 2023-12-12T11:52:12.709 INFO:tasks.workunit.client.0.smithi063.stdout:1/922: chown d3/d3a/dd7/d16/d24/d4d/d35/c80 246708163 1 2023-12-12T11:52:12.712 INFO:tasks.workunit.client.0.smithi063.stdout:3/846: dread d4/df/d1a/f20 [4194304,4194304] 0 2023-12-12T11:52:12.712 INFO:tasks.workunit.client.0.smithi063.stdout:0/881: rename d0/d7/d27/d1f/dc4/fb4 to d0/d1a/d23/dfd/d11f/f121 0 2023-12-12T11:52:12.714 INFO:tasks.workunit.client.0.smithi063.stdout:6/890: dwrite d9/f109 [0,4194304] 0 2023-12-12T11:52:12.714 INFO:tasks.workunit.client.0.smithi063.stdout:6/891: stat d9/d10/d2a/de7/d8a/df8/d12e 0 2023-12-12T11:52:12.714 INFO:tasks.workunit.client.0.smithi063.stdout:6/892: dread - d9/d10/d73/f98 zero size 2023-12-12T11:52:12.715 INFO:tasks.workunit.client.0.smithi063.stdout:4/891: link d2/d47/d6d/d88/d11f/l74 d2/d47/d6d/d88/de6/df3/l120 0 2023-12-12T11:52:12.716 INFO:tasks.workunit.client.0.smithi063.stdout:9/763: symlink d7/d8a/de6/lfa 0 2023-12-12T11:52:12.718 INFO:tasks.workunit.client.0.smithi063.stdout:6/893: write d9/d10/d2a/de7/f116 [698110,342] 0 2023-12-12T11:52:12.718 INFO:tasks.workunit.client.0.smithi063.stdout:6/894: fsync d9/d10/f22 0 2023-12-12T11:52:12.722 INFO:tasks.workunit.client.0.smithi063.stdout:8/939: mknod d4/de/d11/c127 0 2023-12-12T11:52:12.729 INFO:tasks.workunit.client.0.smithi063.stdout:3/847: link d4/df/d1a/d1c/d3b/d52/d74/c9d d4/df/d1a/d1c/d3b/d52/d78/da5/dbc/c101 0 2023-12-12T11:52:12.731 INFO:tasks.workunit.client.0.smithi063.stdout:0/882: mknod d0/ddb/c122 0 2023-12-12T11:52:12.731 INFO:tasks.workunit.client.0.smithi063.stdout:1/923: write d3/d3a/dd7/d16/d24/d4d/d35/f51 [1688331,54247] 0 2023-12-12T11:52:12.731 INFO:tasks.workunit.client.0.smithi063.stdout:1/924: write d3/d3a/dd7/d16/d24/d48/d75/f86 [2253459,55541] 0 2023-12-12T11:52:12.733 INFO:tasks.workunit.client.0.smithi063.stdout:0/883: read d0/d1a/d66/f6e [897180,117729] 0 2023-12-12T11:52:12.733 INFO:tasks.workunit.client.0.smithi063.stdout:0/884: write d0/d1a/d23/d2e/f79 [26514,27342] 0 2023-12-12T11:52:12.734 INFO:tasks.workunit.client.0.smithi063.stdout:4/892: symlink d2/d17/d7f/da2/l121 0 2023-12-12T11:52:12.738 INFO:tasks.workunit.client.0.smithi063.stdout:9/764: creat d7/d20/d3f/d40/d4e/ffb x:0 0 0 2023-12-12T11:52:12.738 INFO:tasks.workunit.client.0.smithi063.stdout:4/893: read d2/d17/d7f/da2/ff6 [489861,60315] 0 2023-12-12T11:52:12.739 INFO:tasks.workunit.client.0.smithi063.stdout:4/894: write d2/d47/d6d/d88/df0/f26 [2752270,106333] 0 2023-12-12T11:52:12.739 INFO:tasks.workunit.client.0.smithi063.stdout:8/940: symlink d4/d24/d38/d45/dc2/l128 0 2023-12-12T11:52:12.749 INFO:tasks.workunit.client.0.smithi063.stdout:4/895: mknod d2/d17/d7f/da2/c122 0 2023-12-12T11:52:12.753 INFO:tasks.workunit.client.0.smithi063.stdout:8/941: symlink d4/d24/d38/d45/d5b/d107/d62/d36/dc6/l129 0 2023-12-12T11:52:12.753 INFO:tasks.workunit.client.0.smithi063.stdout:8/942: creat d4/d24/d38/d45/d5b/d92/f12a x:0 0 0 2023-12-12T11:52:12.755 INFO:tasks.workunit.client.0.smithi063.stdout:1/925: rename d3/d3a/dd7/d16/d24/d48/d75/d83/d5b to d3/d3a/dd7/d16/d4f/da7/d131 0 2023-12-12T11:52:12.757 INFO:tasks.workunit.client.0.smithi063.stdout:0/885: dread d0/d7/f31 [0,4194304] 0 2023-12-12T11:52:12.757 INFO:tasks.workunit.client.0.smithi063.stdout:0/886: fsync d0/d1a/d66/f6f 0 2023-12-12T11:52:12.758 INFO:tasks.workunit.client.0.smithi063.stdout:4/896: symlink d2/d47/d6d/d88/df0/d76/l123 0 2023-12-12T11:52:12.761 INFO:tasks.workunit.client.0.smithi063.stdout:8/943: symlink d4/d24/db3/dc9/l12b 0 2023-12-12T11:52:12.763 INFO:tasks.workunit.client.0.smithi063.stdout:7/806: dwrite de/f1a [4194304,4194304] 0 2023-12-12T11:52:12.770 INFO:tasks.workunit.client.0.smithi063.stdout:1/926: stat d3/d3a/dd7/d16/d24/d4d/d35/cdc 0 2023-12-12T11:52:12.770 INFO:tasks.workunit.client.0.smithi063.stdout:9/765: rename d7/d20/d45/d8e/la4 to d7/lfc 0 2023-12-12T11:52:12.771 INFO:tasks.workunit.client.0.smithi063.stdout:0/887: mknod d0/d1a/d23/d2e/d84/c123 0 2023-12-12T11:52:12.774 INFO:tasks.workunit.client.0.smithi063.stdout:7/807: write f4 [2070461,7220] 0 2023-12-12T11:52:12.778 INFO:tasks.workunit.client.0.smithi063.stdout:4/897: mknod d2/d17/d9d/df5/c124 0 2023-12-12T11:52:12.779 INFO:tasks.workunit.client.0.smithi063.stdout:1/927: creat d3/d3a/dd7/d16/d24/d30/d12d/f132 x:0 0 0 2023-12-12T11:52:12.779 INFO:tasks.workunit.client.0.smithi063.stdout:3/848: dread d4/f44 [0,4194304] 0 2023-12-12T11:52:12.779 INFO:tasks.workunit.client.0.smithi063.stdout:1/928: readlink d3/d3a/dd7/d16/d24/d48/d75/l118 0 2023-12-12T11:52:12.779 INFO:tasks.workunit.client.0.smithi063.stdout:1/929: write d3/d3a/dd7/d16/d4f/d9a/d12a/fe5 [745159,19859] 0 2023-12-12T11:52:12.780 INFO:tasks.workunit.client.0.smithi063.stdout:1/930: creat d3/d3a/dd7/d16/d4f/da7/df8/f133 x:0 0 0 2023-12-12T11:52:12.789 INFO:tasks.workunit.client.0.smithi063.stdout:4/898: rename d2/d17/l6c to d2/d47/dec/l125 0 2023-12-12T11:52:12.790 INFO:tasks.workunit.client.0.smithi063.stdout:4/899: fdatasync d2/d48/fc8 0 2023-12-12T11:52:12.791 INFO:tasks.workunit.client.0.smithi063.stdout:3/849: creat d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/f102 x:0 0 0 2023-12-12T11:52:12.792 INFO:tasks.workunit.client.0.smithi063.stdout:3/850: fdatasync d4/df/d1a/d1c/d3b/d50/d9f/fe1 0 2023-12-12T11:52:12.797 INFO:tasks.workunit.client.0.smithi063.stdout:1/931: creat d3/d3a/dd7/d16/d24/f134 x:0 0 0 2023-12-12T11:52:12.810 INFO:tasks.workunit.client.0.smithi063.stdout:3/851: creat d4/df/d1a/d1c/d3b/d52/d78/da5/d98/f103 x:0 0 0 2023-12-12T11:52:12.813 INFO:tasks.workunit.client.0.smithi063.stdout:6/895: dwrite d9/d10/d2a/de7/d8a/df8/d12e/f127 [0,4194304] 0 2023-12-12T11:52:12.819 INFO:tasks.workunit.client.0.smithi063.stdout:3/852: mknod d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/dac/c104 0 2023-12-12T11:52:12.824 INFO:tasks.workunit.client.0.smithi063.stdout:6/896: rename d9/d10/d2a/de7/d8a/lbc to d9/d10/d2a/dc3/l130 0 2023-12-12T11:52:12.825 INFO:tasks.workunit.client.0.smithi063.stdout:3/853: write d4/df/d1a/d1c/d34/fe6 [1005101,30253] 0 2023-12-12T11:52:12.826 INFO:tasks.workunit.client.0.smithi063.stdout:3/854: fdatasync d4/d23/d6b/f95 0 2023-12-12T11:52:12.826 INFO:tasks.workunit.client.0.smithi063.stdout:3/855: chown d4/df/d1a/d1c/d3b/d52/d78/dbb/fc4 1 1 2023-12-12T11:52:12.829 INFO:tasks.workunit.client.0.smithi063.stdout:1/932: dread d3/d3a/dd7/d16/d17/f90 [0,4194304] 0 2023-12-12T11:52:12.830 INFO:tasks.workunit.client.0.smithi063.stdout:3/856: dread - d4/d23/d6b/d90/de9/ff4 zero size 2023-12-12T11:52:12.830 INFO:tasks.workunit.client.0.smithi063.stdout:3/857: chown d4/d23/d6b/dff 6 1 2023-12-12T11:52:12.830 INFO:tasks.workunit.client.0.smithi063.stdout:3/858: creat d4/df/d1a/d1c/d41/f105 x:0 0 0 2023-12-12T11:52:12.837 INFO:tasks.workunit.client.0.smithi063.stdout:1/933: creat d3/d3a/dd7/d16/d24/d48/d75/f135 x:0 0 0 2023-12-12T11:52:12.837 INFO:tasks.workunit.client.0.smithi063.stdout:1/934: truncate d3/d3a/dd7/d16/d4f/da7/d131/d6b/d103/f10e 181633 0 2023-12-12T11:52:12.837 INFO:tasks.workunit.client.0.smithi063.stdout:1/935: chown d3/d3a/dd7/d12/fb9 433541 1 2023-12-12T11:52:12.843 INFO:tasks.workunit.client.0.smithi063.stdout:3/859: mknod d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/da1/dfd/c106 0 2023-12-12T11:52:12.844 INFO:tasks.workunit.client.0.smithi063.stdout:1/936: mknod d3/d3a/dd7/d16/db8/c136 0 2023-12-12T11:52:12.852 INFO:tasks.workunit.client.0.smithi063.stdout:5/909: dwrite d7/d28/d43/d49/f97 [0,4194304] 0 2023-12-12T11:52:12.855 INFO:tasks.workunit.client.0.smithi063.stdout:8/944: dwrite d4/f17 [4194304,4194304] 0 2023-12-12T11:52:12.855 INFO:tasks.workunit.client.0.smithi063.stdout:8/945: truncate d4/d24/d38/dd8/df5/f118 1775153 0 2023-12-12T11:52:12.855 INFO:tasks.workunit.client.0.smithi063.stdout:8/946: fdatasync d4/de/d1e/d6d/f10f 0 2023-12-12T11:52:12.858 INFO:tasks.workunit.client.0.smithi063.stdout:0/888: dread d0/d7/d27/d1f/f48 [0,4194304] 0 2023-12-12T11:52:12.867 INFO:tasks.workunit.client.0.smithi063.stdout:8/947: symlink d4/d24/d38/d45/d5b/d107/d62/d36/d57/l12c 0 2023-12-12T11:52:12.871 INFO:tasks.workunit.client.0.smithi063.stdout:9/766: dwrite d7/d20/d3f/d40/d4e/f8d [0,4194304] 0 2023-12-12T11:52:12.871 INFO:tasks.workunit.client.0.smithi063.stdout:1/937: dread d3/d3a/dd7/d16/d24/d4d/f68 [0,4194304] 0 2023-12-12T11:52:12.871 INFO:tasks.workunit.client.0.smithi063.stdout:1/938: chown d3/d3a/dd7/d16/d17/d4b/fe4 0 1 2023-12-12T11:52:12.871 INFO:tasks.workunit.client.0.smithi063.stdout:7/808: dwrite de/d34/d68/d11a/fd4 [0,4194304] 0 2023-12-12T11:52:12.876 INFO:tasks.workunit.client.0.smithi063.stdout:6/897: dwrite d9/d68/f78 [0,4194304] 0 2023-12-12T11:52:12.876 INFO:tasks.workunit.client.0.smithi063.stdout:6/898: write d9/d2c/d61/fa5 [1984929,108642] 0 2023-12-12T11:52:12.876 INFO:tasks.workunit.client.0.smithi063.stdout:6/899: chown d9/d68/d94/f107 63 1 2023-12-12T11:52:12.892 INFO:tasks.workunit.client.0.smithi063.stdout:6/900: dread d9/d10/f15 [4194304,4194304] 0 2023-12-12T11:52:12.892 INFO:tasks.workunit.client.0.smithi063.stdout:6/901: chown d9/d10/d2a/dc3/fc5 3407835 1 2023-12-12T11:52:12.892 INFO:tasks.workunit.client.0.smithi063.stdout:6/902: read d9/f43 [447851,62855] 0 2023-12-12T11:52:12.892 INFO:tasks.workunit.client.0.smithi063.stdout:6/903: chown d9/d10/c2d 970681 1 2023-12-12T11:52:12.892 INFO:tasks.workunit.client.0.smithi063.stdout:6/904: truncate d9/d10/d2a/de7/d86/dc2/ded/f122 991634 0 2023-12-12T11:52:12.893 INFO:tasks.workunit.client.0.smithi063.stdout:6/905: creat d9/d2c/d112/f131 x:0 0 0 2023-12-12T11:52:12.900 INFO:tasks.workunit.client.0.smithi063.stdout:8/948: rename d4/d24/d38/d45/d5b/l79 to d4/d24/db3/dc9/l12d 0 2023-12-12T11:52:12.905 INFO:tasks.workunit.client.0.smithi063.stdout:0/889: dwrite d0/d1a/d23/d34/f71 [0,4194304] 0 2023-12-12T11:52:12.906 INFO:tasks.workunit.client.0.smithi063.stdout:0/890: readlink d0/l28 0 2023-12-12T11:52:12.930 INFO:tasks.workunit.client.0.smithi063.stdout:1/939: truncate d3/d3a/f40 78216 0 2023-12-12T11:52:12.930 INFO:tasks.workunit.client.0.smithi063.stdout:1/940: chown d3/d3a/dd7/d16/d4f/da7/d131/d6b/d103/l117 33235237 1 2023-12-12T11:52:12.932 INFO:tasks.workunit.client.0.smithi063.stdout:7/809: creat de/d22/d66/f123 x:0 0 0 2023-12-12T11:52:12.946 INFO:tasks.workunit.client.0.smithi063.stdout:8/949: getdents d4/d24 0 2023-12-12T11:52:12.946 INFO:tasks.workunit.client.0.smithi063.stdout:8/950: stat d4/d24/d38/d45/d5b/d107/d62/d36/d57/d84/df6 0 2023-12-12T11:52:12.960 INFO:tasks.workunit.client.0.smithi063.stdout:9/767: getdents d7/d20/d45/d46/d51/d64/d6f/dad 0 2023-12-12T11:52:12.960 INFO:tasks.workunit.client.0.smithi063.stdout:9/768: dread - d7/d20/d65/ff1 zero size 2023-12-12T11:52:12.977 INFO:tasks.workunit.client.0.smithi063.stdout:1/941: dread d3/f1a [0,4194304] 0 2023-12-12T11:52:12.980 INFO:tasks.workunit.client.0.smithi063.stdout:0/891: dwrite d0/d7/d27/d44/f85 [0,4194304] 0 2023-12-12T11:52:12.980 INFO:tasks.workunit.client.0.smithi063.stdout:0/892: dread - d0/d1a/d23/d34/ff7 zero size 2023-12-12T11:52:13.000 INFO:tasks.workunit.client.0.smithi063.stdout:0/893: dread d0/d1a/d23/d2e/f5a [0,4194304] 0 2023-12-12T11:52:13.003 INFO:tasks.workunit.client.0.smithi063.stdout:8/951: dread d4/d24/d38/dd8/df3/f116 [0,4194304] 0 2023-12-12T11:52:13.022 INFO:tasks.workunit.client.0.smithi063.stdout:4/900: dwrite d2/d47/d6d/d88/df0/fa [0,4194304] 0 2023-12-12T11:52:13.022 INFO:tasks.workunit.client.0.smithi063.stdout:6/906: getdents d9/d68/d94 0 2023-12-12T11:52:13.024 INFO:tasks.workunit.client.0.smithi063.stdout:9/769: rename d7/d8a/fbf to d7/d11/d12/ffd 0 2023-12-12T11:52:13.029 INFO:tasks.workunit.client.0.smithi063.stdout:0/894: mkdir d0/d1a/d23/d2e/dd4/d124 0 2023-12-12T11:52:13.029 INFO:tasks.workunit.client.0.smithi063.stdout:8/952: truncate d4/d24/db3/fe3 5785657 0 2023-12-12T11:52:13.037 INFO:tasks.workunit.client.0.smithi063.stdout:9/770: dread d7/d15/dc4/f8b [0,4194304] 0 2023-12-12T11:52:13.042 INFO:tasks.workunit.client.0.smithi063.stdout:7/810: dwrite de/d39/d60/d80/fe7 [0,4194304] 0 2023-12-12T11:52:13.042 INFO:tasks.workunit.client.0.smithi063.stdout:7/811: read de/ff5 [2351875,98224] 0 2023-12-12T11:52:13.042 INFO:tasks.workunit.client.0.smithi063.stdout:7/812: fsync de/d39/f5e 0 2023-12-12T11:52:13.042 INFO:tasks.workunit.client.0.smithi063.stdout:7/813: readlink de/d34/d68/da1/led 0 2023-12-12T11:52:13.042 INFO:tasks.workunit.client.0.smithi063.stdout:6/907: link d9/c13 d9/d10/d7a/c132 0 2023-12-12T11:52:13.042 INFO:tasks.workunit.client.0.smithi063.stdout:6/908: chown d9/d2c/d61/l117 0 1 2023-12-12T11:52:13.042 INFO:tasks.workunit.client.0.smithi063.stdout:7/814: creat de/d3f/dc3/f124 x:0 0 0 2023-12-12T11:52:13.042 INFO:tasks.workunit.client.0.smithi063.stdout:7/815: dread - de/d39/d60/fd1 zero size 2023-12-12T11:52:13.051 INFO:tasks.workunit.client.0.smithi063.stdout:0/895: creat d0/d1a/d23/d2e/f125 x:0 0 0 2023-12-12T11:52:13.056 INFO:tasks.workunit.client.0.smithi063.stdout:9/771: write d7/d11/d4b/f68 [3933692,58283] 0 2023-12-12T11:52:13.063 INFO:tasks.workunit.client.0.smithi063.stdout:6/909: creat d9/d68/d94/f133 x:0 0 0 2023-12-12T11:52:13.068 INFO:tasks.workunit.client.0.smithi063.stdout:9/772: mknod d7/d15/dc4/d3e/de7/cfe 0 2023-12-12T11:52:13.070 INFO:tasks.workunit.client.0.smithi063.stdout:6/910: creat d9/d68/de4/f134 x:0 0 0 2023-12-12T11:52:13.070 INFO:tasks.workunit.client.0.smithi063.stdout:0/896: mkdir d0/d7/d126 0 2023-12-12T11:52:13.073 INFO:tasks.workunit.client.0.smithi063.stdout:9/773: creat d7/d20/d45/d46/def/fff x:0 0 0 2023-12-12T11:52:13.073 INFO:tasks.workunit.client.0.smithi063.stdout:9/774: chown d7/d15/dc4/d3e/d55/l74 1224567 1 2023-12-12T11:52:13.073 INFO:tasks.workunit.client.0.smithi063.stdout:9/775: chown d7/d20/d3f/d40/d76/fde 7 1 2023-12-12T11:52:13.073 INFO:tasks.workunit.client.0.smithi063.stdout:9/776: fdatasync d7/d11/d4b/f6d 0 2023-12-12T11:52:13.073 INFO:tasks.workunit.client.0.smithi063.stdout:9/777: stat d7/d11/d12 0 2023-12-12T11:52:13.077 INFO:tasks.workunit.client.0.smithi063.stdout:1/942: dwrite d3/d3a/dd7/d16/d24/d4d/ff0 [0,4194304] 0 2023-12-12T11:52:13.078 INFO:tasks.workunit.client.0.smithi063.stdout:0/897: creat d0/d1a/d23/d2e/dd7/f127 x:0 0 0 2023-12-12T11:52:13.080 INFO:tasks.workunit.client.0.smithi063.stdout:9/778: getdents d7/d20/d3f/d40/ddc 0 2023-12-12T11:52:13.087 INFO:tasks.workunit.client.0.smithi063.stdout:8/953: dwrite d4/d24/d38/d45/d5b/d92/f12a [0,4194304] 0 2023-12-12T11:52:13.087 INFO:tasks.workunit.client.0.smithi063.stdout:8/954: stat d4/d24/d38/d45/d5b/d107/d62/fc4 0 2023-12-12T11:52:13.090 INFO:tasks.workunit.client.0.smithi063.stdout:1/943: symlink d3/d3a/dd7/d16/d24/d4d/d35/d98/d12e/l137 0 2023-12-12T11:52:13.094 INFO:tasks.workunit.client.0.smithi063.stdout:0/898: mkdir d0/d7/d27/d19/d128 0 2023-12-12T11:52:13.094 INFO:tasks.workunit.client.0.smithi063.stdout:0/899: fsync d0/d1a/d23/d34/f71 0 2023-12-12T11:52:13.094 INFO:tasks.workunit.client.0.smithi063.stdout:0/900: stat d0/d1a/d23/d2e/dad/d116/lc6 0 2023-12-12T11:52:13.094 INFO:tasks.workunit.client.0.smithi063.stdout:0/901: chown d0/d1a/d23/d34/d42/f5d 3869246 1 2023-12-12T11:52:13.094 INFO:tasks.workunit.client.0.smithi063.stdout:0/902: fsync d0/d1a/d23/d2e/ffc 0 2023-12-12T11:52:13.099 INFO:tasks.workunit.client.0.smithi063.stdout:9/779: symlink d7/l100 0 2023-12-12T11:52:13.099 INFO:tasks.workunit.client.0.smithi063.stdout:9/780: write d7/d15/dc4/d3e/d55/f81 [916513,56817] 0 2023-12-12T11:52:13.102 INFO:tasks.workunit.client.0.smithi063.stdout:8/955: link d4/d24/d38/d45/d5b/d107/d62/d36/dc6/fdf d4/d24/d38/d45/d5b/d107/d62/f12e 0 2023-12-12T11:52:13.103 INFO:tasks.workunit.client.0.smithi063.stdout:1/944: getdents d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2/daf 0 2023-12-12T11:52:13.105 INFO:tasks.workunit.client.0.smithi063.stdout:8/956: read d4/d24/d38/d45/d5b/d107/d62/d36/d57/f63 [213528,92091] 0 2023-12-12T11:52:13.107 INFO:tasks.workunit.client.0.smithi063.stdout:1/945: rmdir d3/d3a/dd7/d16 39 2023-12-12T11:52:13.107 INFO:tasks.workunit.client.0.smithi063.stdout:1/946: dread - d3/d3a/dd7/d16/d4f/da7/d131/d6b/f85 zero size 2023-12-12T11:52:13.110 INFO:tasks.workunit.client.0.smithi063.stdout:8/957: truncate d4/d24/d38/d45/d5b/d107/d62/d36/d57/f7c 395464 0 2023-12-12T11:52:13.116 INFO:tasks.workunit.client.0.smithi063.stdout:8/958: creat d4/d24/d38/d45/d5b/f12f x:0 0 0 2023-12-12T11:52:13.116 INFO:tasks.workunit.client.0.smithi063.stdout:8/959: write d4/d24/d38/d45/d5b/d107/d62/d36/fab [4658344,39963] 0 2023-12-12T11:52:13.120 INFO:tasks.workunit.client.0.smithi063.stdout:8/960: rmdir d4/d24 39 2023-12-12T11:52:13.124 INFO:tasks.workunit.client.0.smithi063.stdout:0/903: rename d0/d8e to d0/d7/d129 0 2023-12-12T11:52:13.126 INFO:tasks.workunit.client.0.smithi063.stdout:8/961: truncate d4/d24/d38/d45/fdb 505745 0 2023-12-12T11:52:13.128 INFO:tasks.workunit.client.0.smithi063.stdout:0/904: rename d0/cae to d0/d7/d129/c12a 0 2023-12-12T11:52:13.134 INFO:tasks.workunit.client.0.smithi063.stdout:8/962: mkdir d4/d24/d38/d130 0 2023-12-12T11:52:13.135 INFO:tasks.workunit.client.0.smithi063.stdout:0/905: truncate d0/d1a/d23/d2e/fb6 2821549 0 2023-12-12T11:52:13.135 INFO:tasks.workunit.client.0.smithi063.stdout:5/910: sync 2023-12-12T11:52:13.140 INFO:tasks.workunit.client.0.smithi063.stdout:2/817: sync 2023-12-12T11:52:13.140 INFO:tasks.workunit.client.0.smithi063.stdout:3/860: sync 2023-12-12T11:52:13.142 INFO:tasks.workunit.client.0.smithi063.stdout:5/911: symlink d7/d10/d2b/d3c/d5a/l119 0 2023-12-12T11:52:13.148 INFO:tasks.workunit.client.0.smithi063.stdout:0/906: dread d0/d1a/d23/d2e/dad/d116/fc0 [0,4194304] 0 2023-12-12T11:52:13.148 INFO:tasks.workunit.client.0.smithi063.stdout:2/818: mknod d0/d1a/d57/ddc/df2/df4/cfd 0 2023-12-12T11:52:13.153 INFO:tasks.workunit.client.0.smithi063.stdout:8/963: read d4/d24/d38/d45/d5b/d107/d62/d36/d57/f78 [6576755,9854] 0 2023-12-12T11:52:13.153 INFO:tasks.workunit.client.0.smithi063.stdout:8/964: write d4/de/d11/f105 [1042263,57985] 0 2023-12-12T11:52:13.155 INFO:tasks.workunit.client.0.smithi063.stdout:0/907: mknod d0/d1a/d23/d2e/dad/d116/dcb/dea/d11b/c12b 0 2023-12-12T11:52:13.156 INFO:tasks.workunit.client.0.smithi063.stdout:0/908: fsync d0/d1a/d23/d2e/ffc 0 2023-12-12T11:52:13.158 INFO:tasks.workunit.client.0.smithi063.stdout:1/947: dwrite d3/d3a/dd7/d16/f3c [0,4194304] 0 2023-12-12T11:52:13.163 INFO:tasks.workunit.client.0.smithi063.stdout:2/819: rmdir d0/d1a/d3a/d85/da6/dd8 39 2023-12-12T11:52:13.163 INFO:tasks.workunit.client.0.smithi063.stdout:2/820: stat d0/d1a/d3a/d85/faa 0 2023-12-12T11:52:13.163 INFO:tasks.workunit.client.0.smithi063.stdout:2/821: chown d0/d1a/d3a/d59/l92 1 1 2023-12-12T11:52:13.183 INFO:tasks.workunit.client.0.smithi063.stdout:2/822: creat d0/d1a/d3a/d59/ddb/ded/ffe x:0 0 0 2023-12-12T11:52:13.184 INFO:tasks.workunit.client.0.smithi063.stdout:3/861: dwrite d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d56/d79/ff1 [0,4194304] 0 2023-12-12T11:52:13.198 INFO:tasks.workunit.client.0.smithi063.stdout:3/862: mkdir d4/df/d1a/d1c/d3b/d52/db6/d107 0 2023-12-12T11:52:13.199 INFO:tasks.workunit.client.0.smithi063.stdout:1/948: rename d3/d3a/dd7/d16/d24/d4d to d3/d3a/dd7/d16/db8/d138 0 2023-12-12T11:52:13.199 INFO:tasks.workunit.client.0.smithi063.stdout:1/949: fsync d3/f56 0 2023-12-12T11:52:13.201 INFO:tasks.workunit.client.0.smithi063.stdout:3/863: mknod d4/df/d1a/d1c/d3b/d52/d78/c108 0 2023-12-12T11:52:13.202 INFO:tasks.workunit.client.0.smithi063.stdout:3/864: dread - d4/d23/d6b/d90/de9/ff4 zero size 2023-12-12T11:52:13.203 INFO:tasks.workunit.client.0.smithi063.stdout:8/965: dwrite d4/d24/d38/d45/d5b/d107/d62/d36/d57/d84/fca [0,4194304] 0 2023-12-12T11:52:13.204 INFO:tasks.workunit.client.0.smithi063.stdout:8/966: dread - d4/d24/d38/dd8/df3/ff7 zero size 2023-12-12T11:52:13.204 INFO:tasks.workunit.client.0.smithi063.stdout:2/823: rename d0/d69/ce9 to d0/d1a/d57/ddc/cff 0 2023-12-12T11:52:13.204 INFO:tasks.workunit.client.0.smithi063.stdout:2/824: chown d0/d1a/d1e/d64/f89 0 1 2023-12-12T11:52:13.206 INFO:tasks.workunit.client.0.smithi063.stdout:1/950: getdents d3/d3a/dd7/d16/db8/d138 0 2023-12-12T11:52:13.207 INFO:tasks.workunit.client.0.smithi063.stdout:3/865: mkdir d4/d23/d7b/dea/d109 0 2023-12-12T11:52:13.212 INFO:tasks.workunit.client.0.smithi063.stdout:8/967: creat d4/de/d1e/f131 x:0 0 0 2023-12-12T11:52:13.213 INFO:tasks.workunit.client.0.smithi063.stdout:1/951: mknod d3/d3a/dd7/d16/d24/d30/d12d/c139 0 2023-12-12T11:52:13.213 INFO:tasks.workunit.client.0.smithi063.stdout:0/909: dwrite d0/d1a/d23/d34/d42/fbd [0,4194304] 0 2023-12-12T11:52:13.213 INFO:tasks.workunit.client.0.smithi063.stdout:0/910: fdatasync d0/d7/d27/d44/f97 0 2023-12-12T11:52:13.218 INFO:tasks.workunit.client.0.smithi063.stdout:3/866: mknod d4/df/d1a/d1c/d3b/d50/c10a 0 2023-12-12T11:52:13.220 INFO:tasks.workunit.client.0.smithi063.stdout:1/952: rename d3/d3a/dd7/d16/d4f/d9a/fff to d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2/d115/f13a 0 2023-12-12T11:52:13.220 INFO:tasks.workunit.client.0.smithi063.stdout:1/953: write d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2/fa9 [728360,14444] 0 2023-12-12T11:52:13.221 INFO:tasks.workunit.client.0.smithi063.stdout:1/954: write d3/d3a/dd7/d16/d17/d4b/fa6 [273671,29274] 0 2023-12-12T11:52:13.221 INFO:tasks.workunit.client.0.smithi063.stdout:1/955: chown d3/d3a/dd7/d16/d24/d48/d75/d83/fe3 94 1 2023-12-12T11:52:13.221 INFO:tasks.workunit.client.0.smithi063.stdout:0/911: mkdir d0/d7/d129/da7/d12c 0 2023-12-12T11:52:13.221 INFO:tasks.workunit.client.0.smithi063.stdout:0/912: fsync d0/d7/d27/d19/fc1 0 2023-12-12T11:52:13.223 INFO:tasks.workunit.client.0.smithi063.stdout:0/913: mknod d0/c12d 0 2023-12-12T11:52:13.247 INFO:tasks.workunit.client.0.smithi063.stdout:1/956: write d3/d3a/dd7/d12/fb9 [667483,3732] 0 2023-12-12T11:52:13.250 INFO:tasks.workunit.client.0.smithi063.stdout:1/957: unlink d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2/d7e/lfa 0 2023-12-12T11:52:13.264 INFO:tasks.workunit.client.0.smithi063.stdout:1/958: dread d3/d3a/dd7/f11a [0,4194304] 0 2023-12-12T11:52:13.266 INFO:tasks.workunit.client.0.smithi063.stdout:1/959: symlink d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2/daf/l13b 0 2023-12-12T11:52:13.272 INFO:tasks.workunit.client.0.smithi063.stdout:2/825: dwrite d0/d1a/d48/d56/da2/fb2 [0,4194304] 0 2023-12-12T11:52:13.272 INFO:tasks.workunit.client.0.smithi063.stdout:2/826: fdatasync d0/d1a/d3a/fd9 0 2023-12-12T11:52:13.272 INFO:tasks.workunit.client.0.smithi063.stdout:2/827: write d0/d1a/d48/f3f [5393089,85081] 0 2023-12-12T11:52:13.274 INFO:tasks.workunit.client.0.smithi063.stdout:0/914: dwrite d0/d1a/d23/d2e/f5e [0,4194304] 0 2023-12-12T11:52:13.278 INFO:tasks.workunit.client.0.smithi063.stdout:1/960: creat d3/d3a/dd7/d16/d24/d48/f13c x:0 0 0 2023-12-12T11:52:13.279 INFO:tasks.workunit.client.0.smithi063.stdout:3/867: dread d4/df/d1a/f20 [4194304,4194304] 0 2023-12-12T11:52:13.279 INFO:tasks.workunit.client.0.smithi063.stdout:3/868: readlink d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/lc9 0 2023-12-12T11:52:13.282 INFO:tasks.workunit.client.0.smithi063.stdout:2/828: rename d0/l67 to d0/d1a/d57/ddc/l100 0 2023-12-12T11:52:13.285 INFO:tasks.workunit.client.0.smithi063.stdout:1/961: stat d3/d3a/dd7/d16/d17/l14 0 2023-12-12T11:52:13.288 INFO:tasks.workunit.client.0.smithi063.stdout:8/968: dwrite d4/d24/d38/d45/d5b/d107/d62/d36/d57/fc7 [0,4194304] 0 2023-12-12T11:52:13.289 INFO:tasks.workunit.client.0.smithi063.stdout:8/969: write d4/d24/d38/d45/d5b/d107/d62/d36/d7f/fe7 [993465,95100] 0 2023-12-12T11:52:13.290 INFO:tasks.workunit.client.0.smithi063.stdout:3/869: symlink d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d56/d79/dfc/l10b 0 2023-12-12T11:52:13.290 INFO:tasks.workunit.client.0.smithi063.stdout:3/870: readlink d4/df/d1a/d1c/d34/d54/l7e 0 2023-12-12T11:52:13.293 INFO:tasks.workunit.client.0.smithi063.stdout:0/915: dread d0/d1a/d23/d34/d42/f5d [0,4194304] 0 2023-12-12T11:52:13.297 INFO:tasks.workunit.client.0.smithi063.stdout:8/970: dread d4/d24/d38/d45/d5b/d92/fb9 [0,4194304] 0 2023-12-12T11:52:13.298 INFO:tasks.workunit.client.0.smithi063.stdout:2/829: creat d0/d1a/d3a/d85/dd5/f101 x:0 0 0 2023-12-12T11:52:13.320 INFO:tasks.workunit.client.0.smithi063.stdout:3/871: symlink d4/d23/d6b/dda/l10c 0 2023-12-12T11:52:13.322 INFO:tasks.workunit.client.0.smithi063.stdout:0/916: creat d0/d1a/d23/ddf/f12e x:0 0 0 2023-12-12T11:52:13.327 INFO:tasks.workunit.client.0.smithi063.stdout:8/971: truncate d4/de/fb4 362876 0 2023-12-12T11:52:13.327 INFO:tasks.workunit.client.0.smithi063.stdout:8/972: creat d4/d24/d38/f132 x:0 0 0 2023-12-12T11:52:13.332 INFO:tasks.workunit.client.0.smithi063.stdout:3/872: creat d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/da1/f10d x:0 0 0 2023-12-12T11:52:13.334 INFO:tasks.workunit.client.0.smithi063.stdout:0/917: mknod d0/d1a/d66/c12f 0 2023-12-12T11:52:13.338 INFO:tasks.workunit.client.0.smithi063.stdout:2/830: dwrite d0/d1a/d26/f29 [0,4194304] 0 2023-12-12T11:52:13.338 INFO:tasks.workunit.client.0.smithi063.stdout:8/973: getdents d4/d24/d38/d45 0 2023-12-12T11:52:13.354 INFO:tasks.workunit.client.0.smithi063.stdout:8/974: mknod d4/d24/d38/d45/d5b/d107/d124/d52/d8e/c133 0 2023-12-12T11:52:13.359 INFO:tasks.workunit.client.0.smithi063.stdout:2/831: write d0/f20 [1297212,51086] 0 2023-12-12T11:52:13.388 INFO:tasks.workunit.client.0.smithi063.stdout:3/873: dwrite d4/df/d1a/d1c/d57/fde [0,4194304] 0 2023-12-12T11:52:13.388 INFO:tasks.workunit.client.0.smithi063.stdout:8/975: dread d4/de/d11/f18 [0,4194304] 0 2023-12-12T11:52:13.391 INFO:tasks.workunit.client.0.smithi063.stdout:3/874: rmdir d4/d23/d6b/d90 39 2023-12-12T11:52:13.391 INFO:tasks.workunit.client.0.smithi063.stdout:3/875: fsync d4/df/d1a/d1c/f28 0 2023-12-12T11:52:13.392 INFO:tasks.workunit.client.0.smithi063.stdout:3/876: creat d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/de0/f10e x:0 0 0 2023-12-12T11:52:13.392 INFO:tasks.workunit.client.0.smithi063.stdout:3/877: truncate d4/df/d1a/d1c/d3b/f5b 3875780 0 2023-12-12T11:52:13.393 INFO:tasks.workunit.client.0.smithi063.stdout:4/901: sync 2023-12-12T11:52:13.393 INFO:tasks.workunit.client.0.smithi063.stdout:3/878: creat d4/d23/d7b/dc2/f10f x:0 0 0 2023-12-12T11:52:13.393 INFO:tasks.workunit.client.0.smithi063.stdout:4/902: stat d2/d47/d6d/d88/fde 0 2023-12-12T11:52:13.393 INFO:tasks.workunit.client.0.smithi063.stdout:4/903: readlink d2/d47/d6d/d88/dbd/le1 0 2023-12-12T11:52:13.393 INFO:tasks.workunit.client.0.smithi063.stdout:4/904: fdatasync d2/d17/df8/f101 0 2023-12-12T11:52:13.394 INFO:tasks.workunit.client.0.smithi063.stdout:3/879: mknod d4/d23/d7b/c110 0 2023-12-12T11:52:13.394 INFO:tasks.workunit.client.0.smithi063.stdout:3/880: creat d4/df/d1a/d1c/d41/de2/f111 x:0 0 0 2023-12-12T11:52:13.401 INFO:tasks.workunit.client.0.smithi063.stdout:4/905: rename d2/d47/d6d/d88/de6/cf7 to d2/d47/d6d/d88/d11f/d98/c126 0 2023-12-12T11:52:13.402 INFO:tasks.workunit.client.0.smithi063.stdout:4/906: mkdir d2/d17/d9d/df5/d127 0 2023-12-12T11:52:13.403 INFO:tasks.workunit.client.0.smithi063.stdout:4/907: truncate d2/d17/d81/f8a 397412 0 2023-12-12T11:52:13.403 INFO:tasks.workunit.client.0.smithi063.stdout:4/908: chown d2/d47/d6d/d88 95 1 2023-12-12T11:52:13.403 INFO:tasks.workunit.client.0.smithi063.stdout:4/909: write d2/d48/fc8 [535883,127146] 0 2023-12-12T11:52:13.403 INFO:tasks.workunit.client.0.smithi063.stdout:4/910: truncate d2/d47/d6d/d88/de6/df3/f106 418355 0 2023-12-12T11:52:13.404 INFO:tasks.workunit.client.0.smithi063.stdout:4/911: rmdir d2/d47/d6d/d88/df0/ddf 39 2023-12-12T11:52:13.407 INFO:tasks.workunit.client.0.smithi063.stdout:4/912: creat d2/d17/dd5/f128 x:0 0 0 2023-12-12T11:52:13.410 INFO:tasks.workunit.client.0.smithi063.stdout:8/976: write f3 [1757137,60629] 0 2023-12-12T11:52:13.415 INFO:tasks.workunit.client.0.smithi063.stdout:2/832: dwrite d0/d1a/d26/f37 [0,4194304] 0 2023-12-12T11:52:13.416 INFO:tasks.workunit.client.0.smithi063.stdout:2/833: read - d0/d1a/d48/d56/fcf zero size 2023-12-12T11:52:13.416 INFO:tasks.workunit.client.0.smithi063.stdout:8/977: rename d4/d24/d38/l50 to d4/d24/db3/dfa/l134 0 2023-12-12T11:52:13.416 INFO:tasks.workunit.client.0.smithi063.stdout:8/978: fsync d4/d24/d38/d45/d5b/d92/d65/fe9 0 2023-12-12T11:52:13.416 INFO:tasks.workunit.client.0.smithi063.stdout:8/979: chown d4/d24/d38/d45/d5b/d107/d124/d52/d8e/cd0 31805 1 2023-12-12T11:52:13.417 INFO:tasks.workunit.client.0.smithi063.stdout:4/913: dread d2/d47/d6d/d88/d11f/fef [0,4194304] 0 2023-12-12T11:52:13.417 INFO:tasks.workunit.client.0.smithi063.stdout:4/914: write d2/d47/d6d/d88/de6/df3/f106 [1384549,57255] 0 2023-12-12T11:52:13.419 INFO:tasks.workunit.client.0.smithi063.stdout:2/834: rename d0/d1a/d3a/d59/cd6 to d0/d1a/d3a/d85/dd5/c102 0 2023-12-12T11:52:13.419 INFO:tasks.workunit.client.0.smithi063.stdout:2/835: chown d0/d1a/d1e/d64/c83 22718 1 2023-12-12T11:52:13.420 INFO:tasks.workunit.client.0.smithi063.stdout:0/918: dwrite d0/d1a/d23/f119 [0,4194304] 0 2023-12-12T11:52:13.420 INFO:tasks.workunit.client.0.smithi063.stdout:0/919: read - d0/d1a/d23/d2e/dd7/fe6 zero size 2023-12-12T11:52:13.421 INFO:tasks.workunit.client.0.smithi063.stdout:4/915: symlink d2/d47/d6d/d88/d11f/dd2/l129 0 2023-12-12T11:52:13.423 INFO:tasks.workunit.client.0.smithi063.stdout:2/836: creat d0/d1a/d3a/d85/dbf/f103 x:0 0 0 2023-12-12T11:52:13.425 INFO:tasks.workunit.client.0.smithi063.stdout:0/920: rename d0/d7/d27/d1f/lf4 to d0/d1a/d23/d2e/d84/l130 0 2023-12-12T11:52:13.430 INFO:tasks.workunit.client.0.smithi063.stdout:4/916: creat d2/d47/d6d/d88/f12a x:0 0 0 2023-12-12T11:52:13.430 INFO:tasks.workunit.client.0.smithi063.stdout:4/917: creat d2/d17/d4e/dd9/f12b x:0 0 0 2023-12-12T11:52:13.430 INFO:tasks.workunit.client.0.smithi063.stdout:4/918: creat d2/d17/d7f/d86/f12c x:0 0 0 2023-12-12T11:52:13.430 INFO:tasks.workunit.client.0.smithi063.stdout:2/837: stat d0/d1a/d26/l28 0 2023-12-12T11:52:13.430 INFO:tasks.workunit.client.0.smithi063.stdout:2/838: write d0/d41/fa7 [844309,14301] 0 2023-12-12T11:52:13.430 INFO:tasks.workunit.client.0.smithi063.stdout:2/839: write d0/d1a/d3a/d85/dd5/f101 [52043,8973] 0 2023-12-12T11:52:13.431 INFO:tasks.workunit.client.0.smithi063.stdout:0/921: rmdir d0/d1a/d23/d2e/dd4/ddc/de0 39 2023-12-12T11:52:13.435 INFO:tasks.workunit.client.0.smithi063.stdout:4/919: link d2/d47/f66 d2/d47/d6d/d88/df0/db3/dc1/f12d 0 2023-12-12T11:52:13.437 INFO:tasks.workunit.client.0.smithi063.stdout:2/840: mknod d0/d1a/d57/ddc/c104 0 2023-12-12T11:52:13.438 INFO:tasks.workunit.client.0.smithi063.stdout:2/841: write d0/d1a/d1e/fe7 [510156,47954] 0 2023-12-12T11:52:13.441 INFO:tasks.workunit.client.0.smithi063.stdout:2/842: mkdir d0/d1a/d3a/d105 0 2023-12-12T11:52:13.444 INFO:tasks.workunit.client.0.smithi063.stdout:4/920: mknod d2/c12e 0 2023-12-12T11:52:13.444 INFO:tasks.workunit.client.0.smithi063.stdout:4/921: creat d2/d47/d6d/d88/de6/df3/f12f x:0 0 0 2023-12-12T11:52:13.444 INFO:tasks.workunit.client.0.smithi063.stdout:4/922: chown d2/d47/d6d/d88/d118 102633 1 2023-12-12T11:52:13.444 INFO:tasks.workunit.client.0.smithi063.stdout:4/923: dread - d2/d47/d6d/d88/d11f/f95 zero size 2023-12-12T11:52:13.445 INFO:tasks.workunit.client.0.smithi063.stdout:2/843: mkdir d0/d1a/d3a/d85/d106 0 2023-12-12T11:52:13.459 INFO:tasks.workunit.client.0.smithi063.stdout:4/924: rename d2/d17/d4e/f91 to d2/d47/d6d/d88/df0/f130 0 2023-12-12T11:52:13.459 INFO:tasks.workunit.client.0.smithi063.stdout:4/925: write d2/d17/d7f/da2/ff6 [1237277,39924] 0 2023-12-12T11:52:13.459 INFO:tasks.workunit.client.0.smithi063.stdout:4/926: chown d2/d17/d4e/c7c 4924901 1 2023-12-12T11:52:13.472 INFO:tasks.workunit.client.0.smithi063.stdout:3/881: dwrite d4/df/d1a/d1c/d57/f6c [0,4194304] 0 2023-12-12T11:52:13.472 INFO:tasks.workunit.client.0.smithi063.stdout:3/882: truncate d4/df/d1a/d1c/d3b/d52/d78/da5/dbc/fec 256951 0 2023-12-12T11:52:13.472 INFO:tasks.workunit.client.0.smithi063.stdout:3/883: fsync d4/f25 0 2023-12-12T11:52:13.472 INFO:tasks.workunit.client.0.smithi063.stdout:3/884: creat d4/df/d1a/d1c/d3b/d52/d78/da5/d98/f112 x:0 0 0 2023-12-12T11:52:13.481 INFO:tasks.workunit.client.0.smithi063.stdout:3/885: link d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/f9e d4/df/d1a/d1c/d3b/d52/d78/f113 0 2023-12-12T11:52:13.486 INFO:tasks.workunit.client.0.smithi063.stdout:0/922: dwrite d0/d1a/d23/d2e/dad/d116/fd8 [0,4194304] 0 2023-12-12T11:52:13.490 INFO:tasks.workunit.client.0.smithi063.stdout:2/844: dread d0/d1a/dba/fc3 [0,4194304] 0 2023-12-12T11:52:13.495 INFO:tasks.workunit.client.0.smithi063.stdout:2/845: rename d0/d1a/d3a/d85/dd5 to d0/d1a/d3a/d85/da6/dd8/d107 0 2023-12-12T11:52:13.495 INFO:tasks.workunit.client.0.smithi063.stdout:2/846: creat d0/d1a/d3a/d59/ddb/ded/f108 x:0 0 0 2023-12-12T11:52:13.503 INFO:tasks.workunit.client.0.smithi063.stdout:4/927: dwrite d2/d17/d41/dd7/f107 [0,4194304] 0 2023-12-12T11:52:13.507 INFO:tasks.workunit.client.0.smithi063.stdout:2/847: dread d0/d1a/d3a/d85/faa [0,4194304] 0 2023-12-12T11:52:13.507 INFO:tasks.workunit.client.0.smithi063.stdout:2/848: write d0/d1a/d1e/f4b [5011152,622] 0 2023-12-12T11:52:13.508 INFO:tasks.workunit.client.0.smithi063.stdout:4/928: rmdir d2/d17/d4e/dd9 39 2023-12-12T11:52:13.510 INFO:tasks.workunit.client.0.smithi063.stdout:4/929: creat d2/d17/d4e/dd9/f131 x:0 0 0 2023-12-12T11:52:13.513 INFO:tasks.workunit.client.0.smithi063.stdout:4/930: truncate d2/f58 1347589 0 2023-12-12T11:52:13.513 INFO:tasks.workunit.client.0.smithi063.stdout:4/931: fdatasync d2/d47/d6d/d88/d11f/f82 0 2023-12-12T11:52:13.535 INFO:tasks.workunit.client.0.smithi063.stdout:7/816: sync 2023-12-12T11:52:13.535 INFO:tasks.workunit.client.0.smithi063.stdout:7/817: stat de/d22/d66 0 2023-12-12T11:52:13.538 INFO:tasks.workunit.client.0.smithi063.stdout:4/932: dread d2/d47/d6d/d88/df0/fcd [0,4194304] 0 2023-12-12T11:52:13.539 INFO:tasks.workunit.client.0.smithi063.stdout:3/886: dwrite d4/df/d1a/d1c/d3b/d52/d78/dbb/fc4 [4194304,4194304] 0 2023-12-12T11:52:13.539 INFO:tasks.workunit.client.0.smithi063.stdout:4/933: creat d2/d17/d9d/d85/da5/d11c/f132 x:0 0 0 2023-12-12T11:52:13.540 INFO:tasks.workunit.client.0.smithi063.stdout:4/934: readlink d2/d17/d41/l5f 0 2023-12-12T11:52:13.544 INFO:tasks.workunit.client.0.smithi063.stdout:3/887: write d4/df/d1a/d1c/d3b/d50/f8f [4596390,53408] 0 2023-12-12T11:52:13.544 INFO:tasks.workunit.client.0.smithi063.stdout:3/888: chown d4/df/d1a/de3 206321601 1 2023-12-12T11:52:13.548 INFO:tasks.workunit.client.0.smithi063.stdout:4/935: creat d2/d47/d6d/d88/df0/db3/f133 x:0 0 0 2023-12-12T11:52:13.551 INFO:tasks.workunit.client.0.smithi063.stdout:3/889: creat d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/f114 x:0 0 0 2023-12-12T11:52:13.556 INFO:tasks.workunit.client.0.smithi063.stdout:3/890: rename d4/df/d1a/d1c/d3b/d52/d78/cfa to d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/dac/c115 0 2023-12-12T11:52:13.565 INFO:tasks.workunit.client.0.smithi063.stdout:3/891: mkdir d4/df/d1a/d1c/d3b/d52/d78/da5/d98/d116 0 2023-12-12T11:52:13.572 INFO:tasks.workunit.client.0.smithi063.stdout:0/923: dwrite d0/d7/d27/d1f/f3f [0,4194304] 0 2023-12-12T11:52:13.572 INFO:tasks.workunit.client.0.smithi063.stdout:0/924: read - d0/d1a/d23/d2e/dad/f10d zero size 2023-12-12T11:52:13.574 INFO:tasks.workunit.client.0.smithi063.stdout:2/849: dwrite d0/f22 [0,4194304] 0 2023-12-12T11:52:13.574 INFO:tasks.workunit.client.0.smithi063.stdout:2/850: fsync d0/d1a/fec 0 2023-12-12T11:52:13.583 INFO:tasks.workunit.client.0.smithi063.stdout:3/892: truncate d4/df/d1a/d1c/f29 3218726 0 2023-12-12T11:52:13.583 INFO:tasks.workunit.client.0.smithi063.stdout:3/893: stat d4/f44 0 2023-12-12T11:52:13.594 INFO:tasks.workunit.client.0.smithi063.stdout:0/925: write d0/d1a/d23/d34/d42/f5d [1105246,99520] 0 2023-12-12T11:52:13.606 INFO:tasks.workunit.client.0.smithi063.stdout:7/818: dwrite de/d39/d60/da4/fb7 [0,4194304] 0 2023-12-12T11:52:13.611 INFO:tasks.workunit.client.0.smithi063.stdout:3/894: dread d4/df/d1a/f5e [0,4194304] 0 2023-12-12T11:52:13.617 INFO:tasks.workunit.client.0.smithi063.stdout:4/936: dwrite d2/d47/f30 [0,4194304] 0 2023-12-12T11:52:13.617 INFO:tasks.workunit.client.0.smithi063.stdout:4/937: dread - d2/d17/d9d/d85/da5/d11c/f132 zero size 2023-12-12T11:52:13.617 INFO:tasks.workunit.client.0.smithi063.stdout:4/938: fsync d2/d48/f6e 0 2023-12-12T11:52:13.617 INFO:tasks.workunit.client.0.smithi063.stdout:4/939: truncate d2/d48/d4f/fe4 1168111 0 2023-12-12T11:52:13.623 INFO:tasks.workunit.client.0.smithi063.stdout:2/851: dread d0/f4 [0,4194304] 0 2023-12-12T11:52:13.626 INFO:tasks.workunit.client.0.smithi063.stdout:3/895: creat d4/df/d1a/d1c/d3b/d52/d78/dbb/f117 x:0 0 0 2023-12-12T11:52:13.627 INFO:tasks.workunit.client.0.smithi063.stdout:7/819: write de/f1a [6032250,62417] 0 2023-12-12T11:52:13.627 INFO:tasks.workunit.client.0.smithi063.stdout:7/820: stat de/d22/d6e/d8a/da3/l82 0 2023-12-12T11:52:13.627 INFO:tasks.workunit.client.0.smithi063.stdout:7/821: fdatasync de/d34/d68/d11a/dd2/f2d 0 2023-12-12T11:52:13.627 INFO:tasks.workunit.client.0.smithi063.stdout:7/822: truncate de/d3f/f72 2320506 0 2023-12-12T11:52:13.633 INFO:tasks.workunit.client.0.smithi063.stdout:2/852: stat d0/d1a/d57/ddc/l100 0 2023-12-12T11:52:13.633 INFO:tasks.workunit.client.0.smithi063.stdout:3/896: link d4/d23/d7b/fd1 d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/da1/dfd/f118 0 2023-12-12T11:52:13.634 INFO:tasks.workunit.client.0.smithi063.stdout:3/897: chown d4/df/d1a/d1c/d3b/c7a 73 1 2023-12-12T11:52:13.635 INFO:tasks.workunit.client.0.smithi063.stdout:7/823: creat de/d34/d43/f125 x:0 0 0 2023-12-12T11:52:13.635 INFO:tasks.workunit.client.0.smithi063.stdout:7/824: stat de/d34/d68/d11a/dd2/d4a/d65 0 2023-12-12T11:52:13.638 INFO:tasks.workunit.client.0.smithi063.stdout:3/898: unlink d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/da1/dfd/c106 0 2023-12-12T11:52:13.638 INFO:tasks.workunit.client.0.smithi063.stdout:3/899: chown d4/d23/d6b/ld8 13932 1 2023-12-12T11:52:13.649 INFO:tasks.workunit.client.0.smithi063.stdout:0/926: dwrite d0/d7/ff [0,4194304] 0 2023-12-12T11:52:13.651 INFO:tasks.workunit.client.0.smithi063.stdout:3/900: rmdir d4/d23/d7b/dea/d109 0 2023-12-12T11:52:13.664 INFO:tasks.workunit.client.0.smithi063.stdout:0/927: truncate d0/d1a/d23/d34/f71 2224583 0 2023-12-12T11:52:13.667 INFO:tasks.workunit.client.0.smithi063.stdout:3/901: rename d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/da1/f10d to d4/df/d1a/d1c/d3b/d50/d61/f119 0 2023-12-12T11:52:13.668 INFO:tasks.workunit.client.0.smithi063.stdout:3/902: dread - d4/d23/d7b/fd1 zero size 2023-12-12T11:52:13.671 INFO:tasks.workunit.client.0.smithi063.stdout:0/928: getdents d0/d7/d129/da7/dcf/de9/d110 0 2023-12-12T11:52:13.671 INFO:tasks.workunit.client.0.smithi063.stdout:0/929: truncate d0/d1a/d23/ddf/f12e 195935 0 2023-12-12T11:52:13.674 INFO:tasks.workunit.client.0.smithi063.stdout:3/903: creat d4/df/d1a/d1c/d3b/d52/db6/f11a x:0 0 0 2023-12-12T11:52:13.674 INFO:tasks.workunit.client.0.smithi063.stdout:3/904: write d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/dac/fd5 [234930,85126] 0 2023-12-12T11:52:13.676 INFO:tasks.workunit.client.0.smithi063.stdout:6/911: sync 2023-12-12T11:52:13.679 INFO:tasks.workunit.client.0.smithi063.stdout:3/905: unlink d4/d23/d6b/cb8 0 2023-12-12T11:52:13.679 INFO:tasks.workunit.client.0.smithi063.stdout:5/912: sync 2023-12-12T11:52:13.681 INFO:tasks.workunit.client.0.smithi063.stdout:9/781: sync 2023-12-12T11:52:13.681 INFO:tasks.workunit.client.0.smithi063.stdout:1/962: sync 2023-12-12T11:52:13.681 INFO:tasks.workunit.client.0.smithi063.stdout:1/963: fsync d3/d3a/dd7/d16/db8/d138/f2c 0 2023-12-12T11:52:13.681 INFO:tasks.workunit.client.0.smithi063.stdout:8/980: sync 2023-12-12T11:52:13.681 INFO:tasks.workunit.client.0.smithi063.stdout:9/782: write d7/d20/d45/d8e/ff2 [863052,126011] 0 2023-12-12T11:52:13.681 INFO:tasks.workunit.client.0.smithi063.stdout:1/964: creat d3/d3a/dd7/d16/d24/d48/d75/f13d x:0 0 0 2023-12-12T11:52:13.684 INFO:tasks.workunit.client.0.smithi063.stdout:3/906: creat d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d56/f11b x:0 0 0 2023-12-12T11:52:13.684 INFO:tasks.workunit.client.0.smithi063.stdout:3/907: readlink d4/df/d1a/d1c/d3b/d50/d61/la7 0 2023-12-12T11:52:13.684 INFO:tasks.workunit.client.0.smithi063.stdout:3/908: dread - d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/de0/f10e zero size 2023-12-12T11:52:13.684 INFO:tasks.workunit.client.0.smithi063.stdout:3/909: dread - d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d56/f11b zero size 2023-12-12T11:52:13.696 INFO:tasks.workunit.client.0.smithi063.stdout:8/981: mknod d4/de/d11/c135 0 2023-12-12T11:52:13.698 INFO:tasks.workunit.client.0.smithi063.stdout:7/825: dwrite de/d34/d68/d11a/d71/fd9 [0,4194304] 0 2023-12-12T11:52:13.699 INFO:tasks.workunit.client.0.smithi063.stdout:9/783: symlink d7/d20/l101 0 2023-12-12T11:52:13.700 INFO:tasks.workunit.client.0.smithi063.stdout:3/910: creat d4/df/d1a/d1c/d3b/d52/d74/f11c x:0 0 0 2023-12-12T11:52:13.700 INFO:tasks.workunit.client.0.smithi063.stdout:0/930: write d0/d7/f98 [916403,108342] 0 2023-12-12T11:52:13.703 INFO:tasks.workunit.client.0.smithi063.stdout:6/912: dread d9/d10/d2a/de7/f9b [0,4194304] 0 2023-12-12T11:52:13.704 INFO:tasks.workunit.client.0.smithi063.stdout:5/913: getdents d7/d10/d2b/d3c/d42/d62/d69/dcb/de0 0 2023-12-12T11:52:13.707 INFO:tasks.workunit.client.0.smithi063.stdout:8/982: rename d4/d24/d38/d45/dc2/l128 to d4/d24/d38/dd8/df3/l136 0 2023-12-12T11:52:13.711 INFO:tasks.workunit.client.0.smithi063.stdout:9/784: symlink d7/d20/d45/d46/d51/d64/l102 0 2023-12-12T11:52:13.713 INFO:tasks.workunit.client.0.smithi063.stdout:3/911: rmdir d4/d23/d6b/dda 39 2023-12-12T11:52:13.713 INFO:tasks.workunit.client.0.smithi063.stdout:3/912: truncate d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/fbd 627273 0 2023-12-12T11:52:13.713 INFO:tasks.workunit.client.0.smithi063.stdout:3/913: chown d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/dac/fd5 267960635 1 2023-12-12T11:52:13.721 INFO:tasks.workunit.client.0.smithi063.stdout:0/931: creat d0/d7/d115/f131 x:0 0 0 2023-12-12T11:52:13.727 INFO:tasks.workunit.client.0.smithi063.stdout:5/914: symlink d7/d10/d2b/l11a 0 2023-12-12T11:52:13.733 INFO:tasks.workunit.client.0.smithi063.stdout:6/913: rename d9/d10/d2a/de7/d8a/df8/d12e/f127 to d9/d10/dfc/f135 0 2023-12-12T11:52:13.739 INFO:tasks.workunit.client.0.smithi063.stdout:3/914: mknod d4/d23/c11d 0 2023-12-12T11:52:13.749 INFO:tasks.workunit.client.0.smithi063.stdout:1/965: dwrite d3/d3a/dd7/d12/d107/f12b [0,4194304] 0 2023-12-12T11:52:13.760 INFO:tasks.workunit.client.0.smithi063.stdout:6/914: mknod d9/d68/d8f/d115/c136 0 2023-12-12T11:52:13.769 INFO:tasks.workunit.client.0.smithi063.stdout:5/915: dwrite d7/d28/d94/f9f [0,4194304] 0 2023-12-12T11:52:13.775 INFO:tasks.workunit.client.0.smithi063.stdout:1/966: mknod d3/d3a/c13e 0 2023-12-12T11:52:13.779 INFO:tasks.workunit.client.0.smithi063.stdout:6/915: rmdir d9/d10/d2a/de7/d8a 39 2023-12-12T11:52:13.780 INFO:tasks.workunit.client.0.smithi063.stdout:3/915: creat d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d56/d79/f11e x:0 0 0 2023-12-12T11:52:13.781 INFO:tasks.workunit.client.0.smithi063.stdout:3/916: creat d4/df/d1a/d1c/d3b/d52/d78/da5/dbc/f11f x:0 0 0 2023-12-12T11:52:13.792 INFO:tasks.workunit.client.0.smithi063.stdout:1/967: dread d3/d3a/dd7/d12/f27 [0,4194304] 0 2023-12-12T11:52:13.794 INFO:tasks.workunit.client.0.smithi063.stdout:0/932: dwrite d0/d7/d27/d1f/f3f [0,4194304] 0 2023-12-12T11:52:13.800 INFO:tasks.workunit.client.0.smithi063.stdout:5/916: mkdir d7/d10/d2b/d3c/d5a/dbb/d11b 0 2023-12-12T11:52:13.805 INFO:tasks.workunit.client.0.smithi063.stdout:6/916: dread d9/d68/d8f/ffd [4194304,4194304] 0 2023-12-12T11:52:13.812 INFO:tasks.workunit.client.0.smithi063.stdout:8/983: dwrite d4/d24/d38/d45/d5b/d107/d124/f34 [0,4194304] 0 2023-12-12T11:52:13.813 INFO:tasks.workunit.client.0.smithi063.stdout:6/917: unlink d9/d10/d7a/l81 0 2023-12-12T11:52:13.818 INFO:tasks.workunit.client.0.smithi063.stdout:8/984: mkdir d4/d24/d38/ddc/d125/d137 0 2023-12-12T11:52:13.819 INFO:tasks.workunit.client.0.smithi063.stdout:8/985: write d4/d24/d38/d45/d5b/d107/d62/fe0 [2178042,74101] 0 2023-12-12T11:52:13.821 INFO:tasks.workunit.client.0.smithi063.stdout:6/918: mkdir d9/d10/d25/d137 0 2023-12-12T11:52:13.822 INFO:tasks.workunit.client.0.smithi063.stdout:8/986: mknod d4/d24/d38/d45/d5b/d107/d62/d6e/d76/c138 0 2023-12-12T11:52:13.822 INFO:tasks.workunit.client.0.smithi063.stdout:5/917: dread d7/d10/d2b/d3c/d42/d62/d69/dcb/de0/f10f [0,4194304] 0 2023-12-12T11:52:13.822 INFO:tasks.workunit.client.0.smithi063.stdout:8/987: write d4/d24/d38/d45/d5b/d107/d62/f6f [1809932,119386] 0 2023-12-12T11:52:13.822 INFO:tasks.workunit.client.0.smithi063.stdout:8/988: read - d4/d24/d38/d45/d5b/f12f zero size 2023-12-12T11:52:13.823 INFO:tasks.workunit.client.0.smithi063.stdout:6/919: creat d9/de5/f138 x:0 0 0 2023-12-12T11:52:13.825 INFO:tasks.workunit.client.0.smithi063.stdout:5/918: creat d7/d10/d2b/d3c/d42/f11c x:0 0 0 2023-12-12T11:52:13.826 INFO:tasks.workunit.client.0.smithi063.stdout:8/989: symlink d4/d24/d38/d45/d5b/d107/d62/d6e/l139 0 2023-12-12T11:52:13.827 INFO:tasks.workunit.client.0.smithi063.stdout:8/990: mknod d4/de/d1e/d6d/d10e/c13a 0 2023-12-12T11:52:13.829 INFO:tasks.workunit.client.0.smithi063.stdout:3/917: dwrite d4/df/d1a/d1c/d3b/d50/d61/f65 [0,4194304] 0 2023-12-12T11:52:13.831 INFO:tasks.workunit.client.0.smithi063.stdout:8/991: mknod d4/d24/d38/d45/d5b/d107/d124/d52/d8e/c13b 0 2023-12-12T11:52:13.832 INFO:tasks.workunit.client.0.smithi063.stdout:8/992: chown d4/d24/d38/d45/d5b/d107/d124/fa0 12978595 1 2023-12-12T11:52:13.846 INFO:tasks.workunit.client.0.smithi063.stdout:3/918: getdents d4/df/d1a/d1c/d41/de2 0 2023-12-12T11:52:13.846 INFO:tasks.workunit.client.0.smithi063.stdout:3/919: creat d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/de0/f120 x:0 0 0 2023-12-12T11:52:13.849 INFO:tasks.workunit.client.0.smithi063.stdout:3/920: mkdir d4/df/d1a/d1c/d34/d121 0 2023-12-12T11:52:13.849 INFO:tasks.workunit.client.0.smithi063.stdout:3/921: stat d4/d23/d7b/dc2/fcc 0 2023-12-12T11:52:13.865 INFO:tasks.workunit.client.0.smithi063.stdout:1/968: dwrite d3/d3a/d52/fb7 [0,4194304] 0 2023-12-12T11:52:13.885 INFO:tasks.workunit.client.0.smithi063.stdout:1/969: mknod d3/d3a/dd7/d16/d24/d30/c13f 0 2023-12-12T11:52:13.886 INFO:tasks.workunit.client.0.smithi063.stdout:1/970: dread - d3/d3a/dd7/d16/d4f/d9a/d12a/dd9/ff5 zero size 2023-12-12T11:52:13.905 INFO:tasks.workunit.client.0.smithi063.stdout:5/919: dwrite d7/f103 [0,4194304] 0 2023-12-12T11:52:13.905 INFO:tasks.workunit.client.0.smithi063.stdout:5/920: chown d7/d10/d2b/d3c/d27 0 1 2023-12-12T11:52:13.908 INFO:tasks.workunit.client.0.smithi063.stdout:6/920: dwrite d9/f102 [0,4194304] 0 2023-12-12T11:52:13.918 INFO:tasks.workunit.client.0.smithi063.stdout:5/921: stat d7/d10/d2b/d3c/c5c 0 2023-12-12T11:52:13.925 INFO:tasks.workunit.client.0.smithi063.stdout:5/922: mkdir d7/d10/d2b/d3c/d5a/de9/d11d 0 2023-12-12T11:52:13.927 INFO:tasks.workunit.client.0.smithi063.stdout:6/921: dread d9/d2c/d61/fb3 [0,4194304] 0 2023-12-12T11:52:13.928 INFO:tasks.workunit.client.0.smithi063.stdout:5/923: truncate d7/d10/f1b 1318870 0 2023-12-12T11:52:13.929 INFO:tasks.workunit.client.0.smithi063.stdout:6/922: creat d9/d68/d8f/f139 x:0 0 0 2023-12-12T11:52:13.930 INFO:tasks.workunit.client.0.smithi063.stdout:6/923: symlink d9/d2c/l13a 0 2023-12-12T11:52:13.930 INFO:tasks.workunit.client.0.smithi063.stdout:6/924: readlink d9/d10/d25/l3f 0 2023-12-12T11:52:13.933 INFO:tasks.workunit.client.0.smithi063.stdout:6/925: link d9/d10/f93 d9/d10/d2a/dc3/f13b 0 2023-12-12T11:52:13.933 INFO:tasks.workunit.client.0.smithi063.stdout:6/926: stat d9/fba 0 2023-12-12T11:52:13.937 INFO:tasks.workunit.client.0.smithi063.stdout:6/927: link d9/d10/d25/c29 d9/d10/d2a/de7/d86/c13c 0 2023-12-12T11:52:13.937 INFO:tasks.workunit.client.0.smithi063.stdout:6/928: chown d9/d10/d2a/de7/f72 970807245 1 2023-12-12T11:52:13.940 INFO:tasks.workunit.client.0.smithi063.stdout:6/929: link d9/d2c/d61/fb5 d9/d10/d2a/dc3/f13d 0 2023-12-12T11:52:13.948 INFO:tasks.workunit.client.0.smithi063.stdout:6/930: creat d9/d10/f13e x:0 0 0 2023-12-12T11:52:13.954 INFO:tasks.workunit.client.0.smithi063.stdout:8/993: dwrite d4/d24/d38/d45/d5b/d107/d62/d36/f3a [4194304,4194304] 0 2023-12-12T11:52:13.954 INFO:tasks.workunit.client.0.smithi063.stdout:8/994: creat d4/d24/d38/d45/d5b/d107/f13c x:0 0 0 2023-12-12T11:52:13.955 INFO:tasks.workunit.client.0.smithi063.stdout:1/971: dwrite d3/d3a/dd7/d16/ff2 [0,4194304] 0 2023-12-12T11:52:13.955 INFO:tasks.workunit.client.0.smithi063.stdout:8/995: write d4/de/d1e/d6d/ffc [925620,27281] 0 2023-12-12T11:52:13.955 INFO:tasks.workunit.client.0.smithi063.stdout:8/996: creat d4/d24/d38/d45/d5b/d92/d65/f13d x:0 0 0 2023-12-12T11:52:13.955 INFO:tasks.workunit.client.0.smithi063.stdout:8/997: readlink d4/d24/d38/dd8/df3/l136 0 2023-12-12T11:52:13.955 INFO:tasks.workunit.client.0.smithi063.stdout:1/972: dread - d3/d3a/dd7/d16/d4f/da7/dca/fc3 zero size 2023-12-12T11:52:13.959 INFO:tasks.workunit.client.0.smithi063.stdout:6/931: link d9/fba d9/d10/d25/d137/f13f 0 2023-12-12T11:52:13.960 INFO:tasks.workunit.client.0.smithi063.stdout:6/932: read d9/d68/f90 [1037034,60295] 0 2023-12-12T11:52:13.960 INFO:tasks.workunit.client.0.smithi063.stdout:6/933: truncate d9/f3b 3887302 0 2023-12-12T11:52:13.960 INFO:tasks.workunit.client.0.smithi063.stdout:6/934: dread - d9/d10/d5c/f60 zero size 2023-12-12T11:52:13.970 INFO:tasks.workunit.client.0.smithi063.stdout:8/998: symlink d4/d24/d38/ddc/l13e 0 2023-12-12T11:52:13.971 INFO:tasks.workunit.client.0.smithi063.stdout:3/922: dwrite d4/df/d1a/f2e [0,4194304] 0 2023-12-12T11:52:13.983 INFO:tasks.workunit.client.0.smithi063.stdout:6/935: link d9/d68/de4/f134 d9/d2c/d112/f140 0 2023-12-12T11:52:13.990 INFO:tasks.workunit.client.0.smithi063.stdout:5/924: dwrite d7/d10/d2b/d3c/d27/f81 [0,4194304] 0 2023-12-12T11:52:13.991 INFO:tasks.workunit.client.0.smithi063.stdout:3/923: getdents d4/df/d1a/d1c/d34 0 2023-12-12T11:52:13.991 INFO:tasks.workunit.client.0.smithi063.stdout:3/924: chown d4/df/l10 3935608 1 2023-12-12T11:52:14.006 INFO:tasks.workunit.client.0.smithi063.stdout:1/973: dwrite d3/d3a/dd7/d16/d24/d48/d75/d83/f10d [0,4194304] 0 2023-12-12T11:52:14.006 INFO:tasks.workunit.client.0.smithi063.stdout:6/936: write d9/d10/d2a/de7/d8a/f9a [2708964,45766] 0 2023-12-12T11:52:14.013 INFO:tasks.workunit.client.0.smithi063.stdout:5/925: mkdir d7/d11e 0 2023-12-12T11:52:14.018 INFO:tasks.workunit.client.0.smithi063.stdout:0/933: sync 2023-12-12T11:52:14.018 INFO:tasks.workunit.client.0.smithi063.stdout:2/853: sync 2023-12-12T11:52:14.018 INFO:tasks.workunit.client.0.smithi063.stdout:9/785: sync 2023-12-12T11:52:14.018 INFO:tasks.workunit.client.0.smithi063.stdout:7/826: sync 2023-12-12T11:52:14.019 INFO:tasks.workunit.client.0.smithi063.stdout:7/827: fdatasync de/d22/d4d/f91 0 2023-12-12T11:52:14.019 INFO:tasks.workunit.client.0.smithi063.stdout:9/786: fdatasync d7/d11/d94/fb7 0 2023-12-12T11:52:14.019 INFO:tasks.workunit.client.0.smithi063.stdout:9/787: dread - d7/d20/d3f/d40/d4e/ffb zero size 2023-12-12T11:52:14.019 INFO:tasks.workunit.client.0.smithi063.stdout:2/854: creat d0/d1a/d3a/d85/da6/f109 x:0 0 0 2023-12-12T11:52:14.019 INFO:tasks.workunit.client.0.smithi063.stdout:4/940: sync 2023-12-12T11:52:14.019 INFO:tasks.workunit.client.0.smithi063.stdout:7/828: creat de/d22/d6e/d8a/f126 x:0 0 0 2023-12-12T11:52:14.023 INFO:tasks.workunit.client.0.smithi063.stdout:3/925: mkdir d4/d23/d6b/dda/d122 0 2023-12-12T11:52:14.024 INFO:tasks.workunit.client.0.smithi063.stdout:1/974: creat d3/d3a/dd7/d16/d4f/d9a/d12a/dd9/f140 x:0 0 0 2023-12-12T11:52:14.026 INFO:tasks.workunit.client.0.smithi063.stdout:6/937: creat d9/d10/d2a/de7/d86/f141 x:0 0 0 2023-12-12T11:52:14.026 INFO:tasks.workunit.client.0.smithi063.stdout:6/938: readlink d9/d2c/l33 0 2023-12-12T11:52:14.026 INFO:tasks.workunit.client.0.smithi063.stdout:6/939: stat d9/d2c/l33 0 2023-12-12T11:52:14.029 INFO:tasks.workunit.client.0.smithi063.stdout:5/926: mknod d7/d10/d2b/d3c/d42/d62/d69/c11f 0 2023-12-12T11:52:14.031 INFO:tasks.workunit.client.0.smithi063.stdout:0/934: write d0/d1a/d23/d2e/fb6 [318041,68221] 0 2023-12-12T11:52:14.031 INFO:tasks.workunit.client.0.smithi063.stdout:9/788: symlink d7/d20/d3f/d40/l103 0 2023-12-12T11:52:14.033 INFO:tasks.workunit.client.0.smithi063.stdout:4/941: chown d2/ce5 104340 1 2023-12-12T11:52:14.034 INFO:tasks.workunit.client.0.smithi063.stdout:2/855: dread d0/d1a/d57/f6d [0,4194304] 0 2023-12-12T11:52:14.034 INFO:tasks.workunit.client.0.smithi063.stdout:2/856: write d0/fb3 [1383447,33435] 0 2023-12-12T11:52:14.035 INFO:tasks.workunit.client.0.smithi063.stdout:2/857: chown d0/d1a/d3a/d85/dbf/f103 256935175 1 2023-12-12T11:52:14.038 INFO:tasks.workunit.client.0.smithi063.stdout:0/935: symlink d0/d1a/d23/d2e/l132 0 2023-12-12T11:52:14.041 INFO:tasks.workunit.client.0.smithi063.stdout:6/940: creat d9/d10/d2a/de7/d8a/f142 x:0 0 0 2023-12-12T11:52:14.042 INFO:tasks.workunit.client.0.smithi063.stdout:8/999: dwrite d4/d24/d38/d45/d5b/d107/d124/f35 [0,4194304] 0 2023-12-12T11:52:14.042 INFO:tasks.workunit.client.0.smithi063.stdout:9/789: rename d7/d11/d4b/f6d to d7/d11/d4b/d75/f104 0 2023-12-12T11:52:14.044 INFO:tasks.workunit.client.0.smithi063.stdout:2/858: symlink d0/d1a/d1e/d64/l10a 0 2023-12-12T11:52:14.045 INFO:tasks.workunit.client.0.smithi063.stdout:4/942: mkdir d2/d17/d7f/d10a/d134 0 2023-12-12T11:52:14.049 INFO:tasks.workunit.client.0.smithi063.stdout:0/936: mknod d0/d1a/d23/d34/d42/c133 0 2023-12-12T11:52:14.049 INFO:tasks.workunit.client.0.smithi063.stdout:0/937: write d0/d1a/d66/f6e [1638537,78835] 0 2023-12-12T11:52:14.051 INFO:tasks.workunit.client.0.smithi063.stdout:6/941: mkdir d9/d2c/d143 0 2023-12-12T11:52:14.061 INFO:tasks.workunit.client.0.smithi063.stdout:2/859: mkdir d0/d1a/d57/ddc/df2/df4/d10b 0 2023-12-12T11:52:14.062 INFO:tasks.workunit.client.0.smithi063.stdout:5/927: dread d7/d10/d2b/d3c/d42/d62/fa1 [0,4194304] 0 2023-12-12T11:52:14.062 INFO:tasks.workunit.client.0.smithi063.stdout:5/928: creat d7/d28/d67/f120 x:0 0 0 2023-12-12T11:52:14.062 INFO:tasks.workunit.client.0.smithi063.stdout:5/929: read - d7/d10/d2b/d3c/fed zero size 2023-12-12T11:52:14.069 INFO:tasks.workunit.client.0.smithi063.stdout:4/943: link d2/d17/d41/dd7/cf1 d2/d47/d6d/d88/d118/c135 0 2023-12-12T11:52:14.075 INFO:tasks.workunit.client.0.smithi063.stdout:0/938: mkdir d0/d1a/d23/d2e/dd4/ddc/df1/d134 0 2023-12-12T11:52:14.079 INFO:tasks.workunit.client.0.smithi063.stdout:6/942: unlink d9/d68/d8f/fd2 0 2023-12-12T11:52:14.093 INFO:tasks.workunit.client.0.smithi063.stdout:5/930: creat d7/d10/d2b/d3c/d63/f121 x:0 0 0 2023-12-12T11:52:14.093 INFO:tasks.workunit.client.0.smithi063.stdout:5/931: stat d7/d10/d2b/f34 0 2023-12-12T11:52:14.096 INFO:tasks.workunit.client.0.smithi063.stdout:5/932: symlink d7/d28/d94/l122 0 2023-12-12T11:52:14.107 INFO:tasks.workunit.client.0.smithi063.stdout:4/944: dread d2/d17/d4e/f51 [0,4194304] 0 2023-12-12T11:52:14.113 INFO:tasks.workunit.client.0.smithi063.stdout:1/975: dwrite d3/d3a/dd7/d16/d24/f2a [4194304,4194304] 0 2023-12-12T11:52:14.116 INFO:tasks.workunit.client.0.smithi063.stdout:4/945: rmdir d2/d17/df8 39 2023-12-12T11:52:14.120 INFO:tasks.workunit.client.0.smithi063.stdout:6/943: write d9/d10/d2a/f3e [391753,129831] 0 2023-12-12T11:52:14.122 INFO:tasks.workunit.client.0.smithi063.stdout:1/976: unlink d3/d3a/dd7/d16/d24/l74 0 2023-12-12T11:52:14.123 INFO:tasks.workunit.client.0.smithi063.stdout:1/977: read - d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2/d115/f125 zero size 2023-12-12T11:52:14.125 INFO:tasks.workunit.client.0.smithi063.stdout:7/829: dwrite de/d34/d68/d11a/dd2/d61/f62 [0,4194304] 0 2023-12-12T11:52:14.127 INFO:tasks.workunit.client.0.smithi063.stdout:1/978: mknod d3/d3a/dd7/d16/d24/d48/d75/c141 0 2023-12-12T11:52:14.127 INFO:tasks.workunit.client.0.smithi063.stdout:1/979: fdatasync d3/d3a/dd7/d16/d4f/d9a/d12a/f9f 0 2023-12-12T11:52:14.127 INFO:tasks.workunit.client.0.smithi063.stdout:1/980: dread - d3/d3a/dd7/d16/d24/f134 zero size 2023-12-12T11:52:14.128 INFO:tasks.workunit.client.0.smithi063.stdout:3/926: dwrite d4/df/d1a/d1c/d41/f51 [0,4194304] 0 2023-12-12T11:52:14.134 INFO:tasks.workunit.client.0.smithi063.stdout:7/830: symlink de/d22/d6e/dc4/l127 0 2023-12-12T11:52:14.135 INFO:tasks.workunit.client.0.smithi063.stdout:0/939: dread d0/d1a/d66/f87 [0,4194304] 0 2023-12-12T11:52:14.135 INFO:tasks.workunit.client.0.smithi063.stdout:2/860: dwrite d0/d1a/d3a/d85/da6/dd8/d107/fef [0,4194304] 0 2023-12-12T11:52:14.137 INFO:tasks.workunit.client.0.smithi063.stdout:6/944: getdents d9/d2c/d61/dcd 0 2023-12-12T11:52:14.144 INFO:tasks.workunit.client.0.smithi063.stdout:9/790: dwrite d7/d15/d39/f82 [0,4194304] 0 2023-12-12T11:52:14.148 INFO:tasks.workunit.client.0.smithi063.stdout:3/927: truncate d4/f3f 530670 0 2023-12-12T11:52:14.148 INFO:tasks.workunit.client.0.smithi063.stdout:7/831: mkdir de/d34/d68/d11a/d41/d44/d8b/d128 0 2023-12-12T11:52:14.153 INFO:tasks.workunit.client.0.smithi063.stdout:0/940: write d0/d7/f55 [2599814,94465] 0 2023-12-12T11:52:14.156 INFO:tasks.workunit.client.0.smithi063.stdout:6/945: dread d9/d10/d2a/de7/f72 [0,4194304] 0 2023-12-12T11:52:14.161 INFO:tasks.workunit.client.0.smithi063.stdout:4/946: dwrite d2/d48/d4f/fe4 [0,4194304] 0 2023-12-12T11:52:14.161 INFO:tasks.workunit.client.0.smithi063.stdout:4/947: truncate d2/d47/d6d/f8f 667428 0 2023-12-12T11:52:14.161 INFO:tasks.workunit.client.0.smithi063.stdout:2/861: write d0/fb3 [1038130,73039] 0 2023-12-12T11:52:14.165 INFO:tasks.workunit.client.0.smithi063.stdout:5/933: write d7/d10/d2b/d3c/d42/f7d [658202,126637] 0 2023-12-12T11:52:14.173 INFO:tasks.workunit.client.0.smithi063.stdout:9/791: symlink d7/d20/d65/l105 0 2023-12-12T11:52:14.175 INFO:tasks.workunit.client.0.smithi063.stdout:3/928: write d4/f44 [1127283,57973] 0 2023-12-12T11:52:14.175 INFO:tasks.workunit.client.0.smithi063.stdout:4/948: dread d2/d47/f53 [0,4194304] 0 2023-12-12T11:52:14.179 INFO:tasks.workunit.client.0.smithi063.stdout:7/832: rename de/d34/d68/d11a/dd2/ffc to de/d22/d6e/de4/f129 0 2023-12-12T11:52:14.180 INFO:tasks.workunit.client.0.smithi063.stdout:0/941: unlink d0/d1a/d23/d34/d42/f5d 0 2023-12-12T11:52:14.180 INFO:tasks.workunit.client.0.smithi063.stdout:0/942: chown d0/ddb 2075568 1 2023-12-12T11:52:14.180 INFO:tasks.workunit.client.0.smithi063.stdout:0/943: fsync d0/d7/d27/d19/f86 0 2023-12-12T11:52:14.184 INFO:tasks.workunit.client.0.smithi063.stdout:5/934: dread d7/d28/d6e/dad/dba/ffb [0,4194304] 0 2023-12-12T11:52:14.191 INFO:tasks.workunit.client.0.smithi063.stdout:2/862: link d0/d1a/d57/lf1 d0/d1a/d1e/d64/l10c 0 2023-12-12T11:52:14.198 INFO:tasks.workunit.client.0.smithi063.stdout:7/833: read de/d39/d60/da4/fb7 [41506,14129] 0 2023-12-12T11:52:14.199 INFO:tasks.workunit.client.0.smithi063.stdout:7/834: chown de/d22/d6e/d8a/de3 4 1 2023-12-12T11:52:14.199 INFO:tasks.workunit.client.0.smithi063.stdout:9/792: rename d7/d20/l101 to d7/d20/d3f/d40/d76/l106 0 2023-12-12T11:52:14.202 INFO:tasks.workunit.client.0.smithi063.stdout:0/944: mkdir d0/d1a/d23/d2e/dd7/d135 0 2023-12-12T11:52:14.203 INFO:tasks.workunit.client.0.smithi063.stdout:5/935: mknod d7/d10/d2b/d3c/d42/d62/d69/dcb/de0/c123 0 2023-12-12T11:52:14.206 INFO:tasks.workunit.client.0.smithi063.stdout:6/946: dwrite d9/d2c/d61/dcd/f110 [0,4194304] 0 2023-12-12T11:52:14.206 INFO:tasks.workunit.client.0.smithi063.stdout:6/947: write d9/d10/d2a/f34 [3371067,95542] 0 2023-12-12T11:52:14.210 INFO:tasks.workunit.client.0.smithi063.stdout:9/793: truncate d7/d15/d39/f47 2818580 0 2023-12-12T11:52:14.210 INFO:tasks.workunit.client.0.smithi063.stdout:3/929: rename d4/df/d1a/d1c/d3b/d50/d61/f119 to d4/df/d1a/d1c/d3b/f123 0 2023-12-12T11:52:14.213 INFO:tasks.workunit.client.0.smithi063.stdout:0/945: unlink d0/d1a/d23/d34/f71 0 2023-12-12T11:52:14.216 INFO:tasks.workunit.client.0.smithi063.stdout:5/936: unlink d7/d28/d94/f9f 0 2023-12-12T11:52:14.217 INFO:tasks.workunit.client.0.smithi063.stdout:5/937: truncate d7/d10/f1b 1389644 0 2023-12-12T11:52:14.223 INFO:tasks.workunit.client.0.smithi063.stdout:1/981: dwrite d3/d3a/dd7/d16/d4f/da7/df8/f133 [0,4194304] 0 2023-12-12T11:52:14.234 INFO:tasks.workunit.client.0.smithi063.stdout:5/938: dread d7/d10/d2b/d3c/d5a/fe5 [0,4194304] 0 2023-12-12T11:52:14.234 INFO:tasks.workunit.client.0.smithi063.stdout:5/939: chown d7/de/c8c 33945871 1 2023-12-12T11:52:14.238 INFO:tasks.workunit.client.0.smithi063.stdout:6/948: creat d9/d2c/d61/d124/f144 x:0 0 0 2023-12-12T11:52:14.240 INFO:tasks.workunit.client.0.smithi063.stdout:9/794: mknod d7/d15/dc4/c107 0 2023-12-12T11:52:14.246 INFO:tasks.workunit.client.0.smithi063.stdout:4/949: dwrite d2/d47/d6d/d88/df0/fbb [0,4194304] 0 2023-12-12T11:52:14.250 INFO:tasks.workunit.client.0.smithi063.stdout:3/930: mkdir d4/d23/d6b/dff/d124 0 2023-12-12T11:52:14.250 INFO:tasks.workunit.client.0.smithi063.stdout:3/931: truncate d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/f8e 381243 0 2023-12-12T11:52:14.254 INFO:tasks.workunit.client.0.smithi063.stdout:7/835: write de/d34/d68/d11a/fbb [1217184,124545] 0 2023-12-12T11:52:14.256 INFO:tasks.workunit.client.0.smithi063.stdout:2/863: dwrite d0/d1a/d3a/d85/da6/fde [0,4194304] 0 2023-12-12T11:52:14.258 INFO:tasks.workunit.client.0.smithi063.stdout:0/946: creat d0/d1a/d23/d2e/dad/d116/dcb/dea/f136 x:0 0 0 2023-12-12T11:52:14.266 INFO:tasks.workunit.client.0.smithi063.stdout:3/932: dread d4/df/d1a/f2e [0,4194304] 0 2023-12-12T11:52:14.268 INFO:tasks.workunit.client.0.smithi063.stdout:4/950: write d2/d17/d7f/fe8 [2070132,114380] 0 2023-12-12T11:52:14.274 INFO:tasks.workunit.client.0.smithi063.stdout:5/940: symlink d7/d28/d6e/dad/l124 0 2023-12-12T11:52:14.279 INFO:tasks.workunit.client.0.smithi063.stdout:6/949: rename d9/d10/f22 to d9/d10/dfc/f145 0 2023-12-12T11:52:14.284 INFO:tasks.workunit.client.0.smithi063.stdout:9/795: creat d7/d15/d39/f108 x:0 0 0 2023-12-12T11:52:14.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:13 smithi063 ceph-mon[107117]: pgmap v21: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 165 MiB/s rd, 188 MiB/s wr, 290 op/s 2023-12-12T11:52:14.298 INFO:tasks.workunit.client.0.smithi063.stdout:7/836: unlink de/c40 0 2023-12-12T11:52:14.301 INFO:tasks.workunit.client.0.smithi063.stdout:6/950: dread d9/d10/f93 [0,4194304] 0 2023-12-12T11:52:14.302 INFO:tasks.workunit.client.0.smithi063.stdout:2/864: symlink d0/d1a/d48/d56/da2/l10d 0 2023-12-12T11:52:14.305 INFO:tasks.workunit.client.0.smithi063.stdout:0/947: write d0/d7/d27/fb0 [145459,108890] 0 2023-12-12T11:52:14.306 INFO:tasks.workunit.client.0.smithi063.stdout:3/933: symlink d4/df/d1a/d1c/d3b/d52/db6/l125 0 2023-12-12T11:52:14.311 INFO:tasks.workunit.client.0.smithi063.stdout:4/951: mknod d2/d17/c136 0 2023-12-12T11:52:14.327 INFO:tasks.workunit.client.0.smithi063.stdout:5/941: creat d7/d28/d94/f125 x:0 0 0 2023-12-12T11:52:14.327 INFO:tasks.workunit.client.0.smithi063.stdout:2/865: mknod d0/d1a/d3a/d59/ddb/c10e 0 2023-12-12T11:52:14.327 INFO:tasks.workunit.client.0.smithi063.stdout:6/951: dread d9/d10/d5c/d5e/f8e [0,4194304] 0 2023-12-12T11:52:14.328 INFO:tasks.workunit.client.0.smithi063.stdout:6/952: write d9/d2c/d112/f140 [360234,3703] 0 2023-12-12T11:52:14.328 INFO:tasks.workunit.client.0.smithi063.stdout:6/953: chown d9/d10/d2a/de7/d8a/f9a 3 1 2023-12-12T11:52:14.328 INFO:tasks.workunit.client.0.smithi063.stdout:6/954: stat d9/d68/d94/ff9 0 2023-12-12T11:52:14.328 INFO:tasks.workunit.client.0.smithi063.stdout:6/955: dread - d9/d10/d7a/ffb zero size 2023-12-12T11:52:14.328 INFO:tasks.workunit.client.0.smithi063.stdout:6/956: read d9/d2c/d61/fa5 [941561,42418] 0 2023-12-12T11:52:14.334 INFO:tasks.workunit.client.0.smithi063.stdout:3/934: symlink d4/df/l126 0 2023-12-12T11:52:14.334 INFO:tasks.workunit.client.0.smithi063.stdout:3/935: creat d4/df/d1a/d1c/d3b/d52/d78/da5/dbc/f127 x:0 0 0 2023-12-12T11:52:14.344 INFO:tasks.workunit.client.0.smithi063.stdout:9/796: dwrite d7/d20/d45/f66 [0,4194304] 0 2023-12-12T11:52:14.349 INFO:tasks.workunit.client.0.smithi063.stdout:4/952: link d2/d47/d6d/d88/d11f/f82 d2/f137 0 2023-12-12T11:52:14.355 INFO:tasks.workunit.client.0.smithi063.stdout:0/948: getdents d0/d1a/d23/d2e/dd7 0 2023-12-12T11:52:14.357 INFO:tasks.workunit.client.0.smithi063.stdout:3/936: write d4/df/d1a/d1c/d3b/d50/fa4 [204804,69663] 0 2023-12-12T11:52:14.357 INFO:tasks.workunit.client.0.smithi063.stdout:3/937: readlink d4/df/d1a/d1c/d34/d54/l7e 0 2023-12-12T11:52:14.357 INFO:tasks.workunit.client.0.smithi063.stdout:3/938: write d4/df/d1a/d1c/f92 [1175200,24168] 0 2023-12-12T11:52:14.359 INFO:tasks.workunit.client.0.smithi063.stdout:4/953: dread d2/d47/f6b [0,4194304] 0 2023-12-12T11:52:14.359 INFO:tasks.workunit.client.0.smithi063.stdout:4/954: write d2/d17/d9d/d85/f10c [881110,16022] 0 2023-12-12T11:52:14.359 INFO:tasks.workunit.client.0.smithi063.stdout:4/955: dread - d2/d47/d6d/d88/df0/db3/f133 zero size 2023-12-12T11:52:14.359 INFO:tasks.workunit.client.0.smithi063.stdout:4/956: stat d2/d17/d9d/f99 0 2023-12-12T11:52:14.359 INFO:tasks.workunit.client.0.smithi063.stdout:5/942: dread d7/d28/d6e/f7c [0,4194304] 0 2023-12-12T11:52:14.362 INFO:tasks.workunit.client.0.smithi063.stdout:2/866: getdents d0/d1a/d48/d56/da2 0 2023-12-12T11:52:14.362 INFO:tasks.workunit.client.0.smithi063.stdout:2/867: write d0/d1a/d3a/f46 [4491763,14670] 0 2023-12-12T11:52:14.367 INFO:tasks.workunit.client.0.smithi063.stdout:5/943: write d7/d28/d67/f90 [1465938,72738] 0 2023-12-12T11:52:14.367 INFO:tasks.workunit.client.0.smithi063.stdout:5/944: truncate d7/d28/d67/f90 2444973 0 2023-12-12T11:52:14.372 INFO:tasks.workunit.client.0.smithi063.stdout:0/949: creat d0/d1a/f137 x:0 0 0 2023-12-12T11:52:14.373 INFO:tasks.workunit.client.0.smithi063.stdout:3/939: link d4/c32 d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/db2/c128 0 2023-12-12T11:52:14.377 INFO:tasks.workunit.client.0.smithi063.stdout:2/868: rename d0/d41/f66 to d0/d69/f10f 0 2023-12-12T11:52:14.377 INFO:tasks.workunit.client.0.smithi063.stdout:5/945: symlink d7/d28/d43/d49/l126 0 2023-12-12T11:52:14.377 INFO:tasks.workunit.client.0.smithi063.stdout:5/946: chown d7/d10/d2b/d3c/d42/d76/fd3 1763 1 2023-12-12T11:52:14.378 INFO:tasks.workunit.client.0.smithi063.stdout:5/947: chown d7/d10/d2b/d3c/d5a/de9 13965 1 2023-12-12T11:52:14.381 INFO:tasks.workunit.client.0.smithi063.stdout:0/950: mknod d0/d1a/d23/d2e/dd4/ddc/de0/def/c138 0 2023-12-12T11:52:14.382 INFO:tasks.workunit.client.0.smithi063.stdout:6/957: dwrite d9/d68/fb2 [0,4194304] 0 2023-12-12T11:52:14.383 INFO:tasks.workunit.client.0.smithi063.stdout:4/957: dread d2/d17/d7f/fa9 [0,4194304] 0 2023-12-12T11:52:14.385 INFO:tasks.workunit.client.0.smithi063.stdout:2/869: rename d0/l12 to d0/d1a/d3a/d85/d106/l110 0 2023-12-12T11:52:14.385 INFO:tasks.workunit.client.0.smithi063.stdout:2/870: readlink d0/d1a/d1e/d64/l10a 0 2023-12-12T11:52:14.387 INFO:tasks.workunit.client.0.smithi063.stdout:5/948: mkdir d7/de/d127 0 2023-12-12T11:52:14.387 INFO:tasks.workunit.client.0.smithi063.stdout:5/949: chown d7/d28/d6e/dad/dde 1767157750 1 2023-12-12T11:52:14.391 INFO:tasks.workunit.client.0.smithi063.stdout:0/951: symlink d0/d7/d129/l139 0 2023-12-12T11:52:14.391 INFO:tasks.workunit.client.0.smithi063.stdout:0/952: write d0/d1a/d23/d2e/f79 [752903,40501] 0 2023-12-12T11:52:14.394 INFO:tasks.workunit.client.0.smithi063.stdout:6/958: truncate d9/d10/d2a/dc3/f13b 2687958 0 2023-12-12T11:52:14.394 INFO:tasks.workunit.client.0.smithi063.stdout:3/940: dread d4/df/d1a/d1c/d57/fd4 [0,4194304] 0 2023-12-12T11:52:14.397 INFO:tasks.workunit.client.0.smithi063.stdout:4/958: creat d2/d48/d4f/f138 x:0 0 0 2023-12-12T11:52:14.399 INFO:tasks.workunit.client.0.smithi063.stdout:7/837: dwrite de/d34/d68/d11a/d41/d44/d8b/dde/daf/fd0 [0,4194304] 0 2023-12-12T11:52:14.400 INFO:tasks.workunit.client.0.smithi063.stdout:2/871: truncate d0/d69/f97 4650562 0 2023-12-12T11:52:14.402 INFO:tasks.workunit.client.0.smithi063.stdout:5/950: rename d7/d10/d2b/d3c/d42/cab to d7/d10/d2b/d3c/d42/d76/df2/c128 0 2023-12-12T11:52:14.404 INFO:tasks.workunit.client.0.smithi063.stdout:9/797: dwrite d7/d20/d45/d46/d51/d64/fb8 [0,4194304] 0 2023-12-12T11:52:14.405 INFO:tasks.workunit.client.0.smithi063.stdout:9/798: chown d7/d20/d3f/d40/ddc 520770 1 2023-12-12T11:52:14.405 INFO:tasks.workunit.client.0.smithi063.stdout:9/799: chown d7/d11/d12 4867753 1 2023-12-12T11:52:14.414 INFO:tasks.workunit.client.0.smithi063.stdout:6/959: symlink d9/d10/d2a/de7/d86/dc2/l146 0 2023-12-12T11:52:14.430 INFO:tasks.workunit.client.0.smithi063.stdout:7/838: symlink de/d22/d4d/l12a 0 2023-12-12T11:52:14.430 INFO:tasks.workunit.client.0.smithi063.stdout:2/872: dread d0/d1a/d1e/d64/fbc [0,4194304] 0 2023-12-12T11:52:14.430 INFO:tasks.workunit.client.0.smithi063.stdout:2/873: chown d0/d1a/d3a 5 1 2023-12-12T11:52:14.435 INFO:tasks.workunit.client.0.smithi063.stdout:5/951: dread d7/de/f84 [0,4194304] 0 2023-12-12T11:52:14.439 INFO:tasks.workunit.client.0.smithi063.stdout:0/953: rename d0/d7/d129/l139 to d0/d1a/d23/d2e/d84/l13a 0 2023-12-12T11:52:14.441 INFO:tasks.workunit.client.0.smithi063.stdout:6/960: creat d9/d68/d8f/d115/f147 x:0 0 0 2023-12-12T11:52:14.442 INFO:tasks.workunit.client.0.smithi063.stdout:2/874: symlink d0/d1a/d1e/l111 0 2023-12-12T11:52:14.446 INFO:tasks.workunit.client.0.smithi063.stdout:0/954: dread - d0/d1a/d23/f107 zero size 2023-12-12T11:52:14.447 INFO:tasks.workunit.client.0.smithi063.stdout:6/961: creat d9/d10/d25/f148 x:0 0 0 2023-12-12T11:52:14.448 INFO:tasks.workunit.client.0.smithi063.stdout:9/800: read d7/d15/f1d [2639121,20431] 0 2023-12-12T11:52:14.448 INFO:tasks.workunit.client.0.smithi063.stdout:9/801: chown d7/d20/d3f/d40/d4e/f80 44063 1 2023-12-12T11:52:14.450 INFO:tasks.workunit.client.0.smithi063.stdout:5/952: dread d7/d10/d2b/d3c/d42/d62/d69/fbf [0,4194304] 0 2023-12-12T11:52:14.457 INFO:tasks.workunit.client.0.smithi063.stdout:9/802: creat d7/d20/d45/d46/d51/d64/f109 x:0 0 0 2023-12-12T11:52:14.458 INFO:tasks.workunit.client.0.smithi063.stdout:5/953: rmdir d7/d28/d43/d49 39 2023-12-12T11:52:14.458 INFO:tasks.workunit.client.0.smithi063.stdout:5/954: chown d7/d10/d2b/d3c/c79 4 1 2023-12-12T11:52:14.463 INFO:tasks.workunit.client.0.smithi063.stdout:2/875: write d0/f6 [6053006,117999] 0 2023-12-12T11:52:14.463 INFO:tasks.workunit.client.0.smithi063.stdout:9/803: symlink d7/d15/l10a 0 2023-12-12T11:52:14.464 INFO:tasks.workunit.client.0.smithi063.stdout:4/959: dwrite d2/d17/df8/f105 [0,4194304] 0 2023-12-12T11:52:14.464 INFO:tasks.workunit.client.0.smithi063.stdout:4/960: stat d2/d47/d6d/d88/df0/c11b 0 2023-12-12T11:52:14.464 INFO:tasks.workunit.client.0.smithi063.stdout:5/955: mkdir d7/d10/d2b/d3c/d5a/dbb/dbc/d129 0 2023-12-12T11:52:14.468 INFO:tasks.workunit.client.0.smithi063.stdout:4/961: creat d2/d17/d7f/d86/f139 x:0 0 0 2023-12-12T11:52:14.468 INFO:tasks.workunit.client.0.smithi063.stdout:2/876: rmdir d0/d1a/d3a/d105 0 2023-12-12T11:52:14.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:13 smithi093 ceph-mon[115914]: pgmap v21: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 165 MiB/s rd, 188 MiB/s wr, 290 op/s 2023-12-12T11:52:14.472 INFO:tasks.workunit.client.0.smithi063.stdout:3/941: dwrite d4/d23/d6b/d90/fc3 [0,4194304] 0 2023-12-12T11:52:14.472 INFO:tasks.workunit.client.0.smithi063.stdout:3/942: stat d4/df/d1a/d1c/d3b/d50/f5a 0 2023-12-12T11:52:14.473 INFO:tasks.workunit.client.0.smithi063.stdout:2/877: fdatasync d0/f6 0 2023-12-12T11:52:14.475 INFO:tasks.workunit.client.0.smithi063.stdout:9/804: rename d7/d20/d45/d46/d51/d64/d6f/d85/lac to d7/d15/dc4/d3e/dbb/l10b 0 2023-12-12T11:52:14.475 INFO:tasks.workunit.client.0.smithi063.stdout:9/805: stat d7/d15/l10a 0 2023-12-12T11:52:14.475 INFO:tasks.workunit.client.0.smithi063.stdout:9/806: read d7/fa [1121668,70246] 0 2023-12-12T11:52:14.476 INFO:tasks.workunit.client.0.smithi063.stdout:9/807: truncate d7/d20/d65/fa2 4553855 0 2023-12-12T11:52:14.476 INFO:tasks.workunit.client.0.smithi063.stdout:9/808: dread - d7/d20/daf/fe0 zero size 2023-12-12T11:52:14.476 INFO:tasks.workunit.client.0.smithi063.stdout:9/809: readlink d7/d20/d3f/l70 0 2023-12-12T11:52:14.476 INFO:tasks.workunit.client.0.smithi063.stdout:9/810: write d7/d20/d3f/d40/d76/f9d [339338,97850] 0 2023-12-12T11:52:14.476 INFO:tasks.workunit.client.0.smithi063.stdout:9/811: creat d7/d15/d39/f10c x:0 0 0 2023-12-12T11:52:14.476 INFO:tasks.workunit.client.0.smithi063.stdout:9/812: write d7/d20/d45/d46/d51/d64/d6f/d85/fd2 [220289,115079] 0 2023-12-12T11:52:14.476 INFO:tasks.workunit.client.0.smithi063.stdout:9/813: chown d7/d20/daf 0 1 2023-12-12T11:52:14.477 INFO:tasks.workunit.client.0.smithi063.stdout:5/956: link d7/d10/d2b/d3c/d42/d76/df2/c128 d7/d28/d43/d49/c12a 0 2023-12-12T11:52:14.481 INFO:tasks.workunit.client.0.smithi063.stdout:6/962: dwrite d9/d10/d2a/de7/f75 [0,4194304] 0 2023-12-12T11:52:14.483 INFO:tasks.workunit.client.0.smithi063.stdout:4/962: rmdir d2/d47/d6d/dff 0 2023-12-12T11:52:14.483 INFO:tasks.workunit.client.0.smithi063.stdout:4/963: write d2/d17/d4e/fcf [892773,50202] 0 2023-12-12T11:52:14.483 INFO:tasks.workunit.client.0.smithi063.stdout:4/964: stat d2/d48/f6e 0 2023-12-12T11:52:14.483 INFO:tasks.workunit.client.0.smithi063.stdout:4/965: chown d2/d17/d9d/df5/d127 6 1 2023-12-12T11:52:14.487 INFO:tasks.workunit.client.0.smithi063.stdout:3/943: creat d4/d23/d6b/dda/f129 x:0 0 0 2023-12-12T11:52:14.489 INFO:tasks.workunit.client.0.smithi063.stdout:2/878: rename d0/d1a/d3a/d85/d106 to d0/d1a/d1e/d64/dc7/d112 0 2023-12-12T11:52:14.494 INFO:tasks.workunit.client.0.smithi063.stdout:6/963: mknod d9/d10/d2a/de7/d8a/df8/c149 0 2023-12-12T11:52:14.495 INFO:tasks.workunit.client.0.smithi063.stdout:9/814: getdents d7/d15 0 2023-12-12T11:52:14.495 INFO:tasks.workunit.client.0.smithi063.stdout:9/815: creat d7/d8a/de6/f10d x:0 0 0 2023-12-12T11:52:14.496 INFO:tasks.workunit.client.0.smithi063.stdout:1/982: sync 2023-12-12T11:52:14.501 INFO:tasks.workunit.client.0.smithi063.stdout:2/879: truncate d0/f5 582727 0 2023-12-12T11:52:14.502 INFO:tasks.workunit.client.0.smithi063.stdout:6/964: rmdir d9/d10/d5c 39 2023-12-12T11:52:14.502 INFO:tasks.workunit.client.0.smithi063.stdout:6/965: truncate d9/d68/d94/ff1 39005 0 2023-12-12T11:52:14.502 INFO:tasks.workunit.client.0.smithi063.stdout:6/966: stat d9/d10/d7a/fee 0 2023-12-12T11:52:14.502 INFO:tasks.workunit.client.0.smithi063.stdout:6/967: truncate d9/d10/f13e 199965 0 2023-12-12T11:52:14.503 INFO:tasks.workunit.client.0.smithi063.stdout:9/816: truncate d7/d15/db2/fc6 1165891 0 2023-12-12T11:52:14.506 INFO:tasks.workunit.client.0.smithi063.stdout:3/944: link d4/c39 d4/df/d1a/df9/c12a 0 2023-12-12T11:52:14.510 INFO:tasks.workunit.client.0.smithi063.stdout:2/880: symlink d0/l113 0 2023-12-12T11:52:14.510 INFO:tasks.workunit.client.0.smithi063.stdout:2/881: chown d0/d1a/d1e/d64/f68 11 1 2023-12-12T11:52:14.513 INFO:tasks.workunit.client.0.smithi063.stdout:6/968: rename d9/d2c/l13a to d9/d125/l14a 0 2023-12-12T11:52:14.514 INFO:tasks.workunit.client.0.smithi063.stdout:1/983: dread d3/d3a/dd7/fd [0,4194304] 0 2023-12-12T11:52:14.515 INFO:tasks.workunit.client.0.smithi063.stdout:4/966: write d2/d47/d6d/d88/d11f/dd2/fd4 [749964,2061] 0 2023-12-12T11:52:14.517 INFO:tasks.workunit.client.0.smithi063.stdout:5/957: write d7/d10/d2b/d3c/d27/f8e [4109711,10141] 0 2023-12-12T11:52:14.520 INFO:tasks.workunit.client.0.smithi063.stdout:3/945: rmdir d4/df/d1a/d1c/d3b/d52/d78/da5/d98/d116 0 2023-12-12T11:52:14.521 INFO:tasks.workunit.client.0.smithi063.stdout:7/839: dwrite de/d3f/dc3/fd8 [4194304,4194304] 0 2023-12-12T11:52:14.523 INFO:tasks.workunit.client.0.smithi063.stdout:9/817: rename d7/d15/d39/f10c to d7/d15/dc4/d3e/f10e 0 2023-12-12T11:52:14.524 INFO:tasks.workunit.client.0.smithi063.stdout:2/882: link d0/d1a/d3a/lf5 d0/d1a/d48/d56/d77/l114 0 2023-12-12T11:52:14.525 INFO:tasks.workunit.client.0.smithi063.stdout:4/967: stat d2/d47/d6d/d88/d118/c135 0 2023-12-12T11:52:14.533 INFO:tasks.workunit.client.0.smithi063.stdout:1/984: write d3/d3a/dd7/d16/db8/d138/f3e [889652,9531] 0 2023-12-12T11:52:14.533 INFO:tasks.workunit.client.0.smithi063.stdout:1/985: truncate d3/d3a/dd7/d16/d17/f102 68338 0 2023-12-12T11:52:14.536 INFO:tasks.workunit.client.0.smithi063.stdout:5/958: dread d7/de/f84 [0,4194304] 0 2023-12-12T11:52:14.537 INFO:tasks.workunit.client.0.smithi063.stdout:7/840: write de/d34/d68/d11a/d41/d44/d8b/f101 [3975739,65283] 0 2023-12-12T11:52:14.542 INFO:tasks.workunit.client.0.smithi063.stdout:3/946: dread d4/df/d1a/f2e [0,4194304] 0 2023-12-12T11:52:14.543 INFO:tasks.workunit.client.0.smithi063.stdout:3/947: getdents d4/df/d1a/d1c/d34 0 2023-12-12T11:52:14.548 INFO:tasks.workunit.client.0.smithi063.stdout:9/818: write d7/d11/f53 [5456131,99068] 0 2023-12-12T11:52:14.586 INFO:tasks.workunit.client.0.smithi063.stdout:5/959: dwrite d7/d10/d2b/d3c/d42/d62/d69/fbf [0,4194304] 0 2023-12-12T11:52:14.586 INFO:tasks.workunit.client.0.smithi063.stdout:5/960: fsync d7/d10/d2b/d3c/fed 0 2023-12-12T11:52:14.588 INFO:tasks.workunit.client.0.smithi063.stdout:6/969: dwrite d9/d10/f1e [0,4194304] 0 2023-12-12T11:52:14.592 INFO:tasks.workunit.client.0.smithi063.stdout:4/968: stat d2/d17/d41/lb8 0 2023-12-12T11:52:14.593 INFO:tasks.workunit.client.0.smithi063.stdout:2/883: unlink d0/d69/cdf 0 2023-12-12T11:52:14.596 INFO:tasks.workunit.client.0.smithi063.stdout:1/986: rename d3/d3a/f40 to d3/d3a/dd7/d16/d4f/da7/dca/d6f/da8/de2/daf/f142 0 2023-12-12T11:52:14.599 INFO:tasks.workunit.client.0.smithi063.stdout:3/948: dwrite d4/d23/ffe [0,4194304] 0 2023-12-12T11:52:14.600 INFO:tasks.workunit.client.0.smithi063.stdout:7/841: creat de/d34/d68/d122/f12b x:0 0 0 2023-12-12T11:52:14.602 INFO:tasks.workunit.client.0.smithi063.stdout:9/819: creat d7/d11/d4b/d75/df8/f10f x:0 0 0 2023-12-12T11:52:14.607 INFO:tasks.workunit.client.0.smithi063.stdout:2/884: dread d0/d1a/d3a/d85/da6/dd8/d107/fe1 [0,4194304] 0 2023-12-12T11:52:14.607 INFO:tasks.workunit.client.0.smithi063.stdout:2/885: readlink d0/d1a/d48/d56/lc0 0 2023-12-12T11:52:14.607 INFO:tasks.workunit.client.0.smithi063.stdout:2/886: write d0/d1a/d3a/d59/f93 [4368733,111514] 0 2023-12-12T11:52:14.607 INFO:tasks.workunit.client.0.smithi063.stdout:5/961: rmdir d7/d28 39 2023-12-12T11:52:14.611 INFO:tasks.workunit.client.0.smithi063.stdout:6/970: mkdir d9/d2c/d14b 0 2023-12-12T11:52:14.617 INFO:tasks.workunit.client.0.smithi063.stdout:1/987: mknod d3/d3a/dd7/d16/d4f/da7/d131/d6b/c143 0 2023-12-12T11:52:14.620 INFO:tasks.workunit.client.0.smithi063.stdout:3/949: mkdir d4/df/d1a/d1c/d3b/d52/d78/dbb/d12b 0 2023-12-12T11:52:14.620 INFO:tasks.workunit.client.0.smithi063.stdout:3/950: write d4/df/d1a/d1c/d3b/d52/d78/dbb/f117 [510086,102113] 0 2023-12-12T11:52:14.620 INFO:tasks.workunit.client.0.smithi063.stdout:3/951: creat d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d56/d79/f12c x:0 0 0 2023-12-12T11:52:14.622 INFO:tasks.workunit.client.0.smithi063.stdout:7/842: creat de/d39/d88/f12c x:0 0 0 2023-12-12T11:52:14.624 INFO:tasks.workunit.client.0.smithi063.stdout:9/820: rmdir d7/d20/d45/d46 39 2023-12-12T11:52:14.627 INFO:tasks.workunit.client.0.smithi063.stdout:2/887: unlink d0/d41/fa7 0 2023-12-12T11:52:14.627 INFO:tasks.workunit.client.0.smithi063.stdout:5/962: symlink d7/d10/d2b/d3c/d42/d62/db4/l12b 0 2023-12-12T11:52:14.631 INFO:tasks.workunit.client.0.smithi063.stdout:6/971: creat d9/d2c/f14c x:0 0 0 2023-12-12T11:52:14.632 INFO:tasks.workunit.client.0.smithi063.stdout:4/969: truncate d2/f40 2974671 0 2023-12-12T11:52:14.633 INFO:tasks.workunit.client.0.smithi063.stdout:1/988: symlink d3/d3a/d52/ddf/l144 0 2023-12-12T11:52:14.634 INFO:tasks.workunit.client.0.smithi063.stdout:1/989: chown d3/d3a/d52/fe6 6 1 2023-12-12T11:52:14.634 INFO:tasks.workunit.client.0.smithi063.stdout:1/990: chown d3/d3a/dd7/d16/d4f/da7/d131/d6b/f91 15 1 2023-12-12T11:52:14.634 INFO:tasks.workunit.client.0.smithi063.stdout:1/991: read - d3/d3a/dd7/d16/d24/d48/d75/fd4 zero size 2023-12-12T11:52:14.644 INFO:tasks.workunit.client.0.smithi063.stdout:7/843: read de/d34/d68/d11a/d71/fd9 [1066948,122480] 0 2023-12-12T11:52:14.644 INFO:tasks.workunit.client.0.smithi063.stdout:3/952: mknod d4/df/d1a/d1c/d41/c12d 0 2023-12-12T11:52:14.645 INFO:tasks.workunit.client.0.smithi063.stdout:5/963: truncate d7/d10/d2b/d3c/d5a/dbb/fc2 2685943 0 2023-12-12T11:52:14.645 INFO:tasks.workunit.client.0.smithi063.stdout:3/953: creat d4/df/d1a/d1c/d3b/d52/db6/f12e x:0 0 0 2023-12-12T11:52:14.645 INFO:tasks.workunit.client.0.smithi063.stdout:5/964: truncate d7/d10/d2b/d3c/d27/fb9 4273909 0 2023-12-12T11:52:14.645 INFO:tasks.workunit.client.0.smithi063.stdout:3/954: creat d4/df/d1a/d1c/d3b/d52/db6/f12f x:0 0 0 2023-12-12T11:52:14.645 INFO:tasks.workunit.client.0.smithi063.stdout:9/821: creat d7/d20/d3f/d40/ddc/f110 x:0 0 0 2023-12-12T11:52:14.645 INFO:tasks.workunit.client.0.smithi063.stdout:6/972: write d9/d68/d94/fa0 [3357548,37475] 0 2023-12-12T11:52:14.646 INFO:tasks.workunit.client.0.smithi063.stdout:6/973: chown d9/d10/f1e 181 1 2023-12-12T11:52:14.646 INFO:tasks.workunit.client.0.smithi063.stdout:1/992: unlink d3/d3a/dd7/d16/d4f/da7/d131/d6b/f72 0 2023-12-12T11:52:14.649 INFO:tasks.workunit.client.0.smithi063.stdout:7/844: rename de/d39/d4b/d7b/d7f/c109 to de/d39/d4b/d7b/c12d 0 2023-12-12T11:52:14.655 INFO:tasks.workunit.client.0.smithi063.stdout:5/965: symlink d7/d10/d2b/d3c/d5a/dbb/d11b/l12c 0 2023-12-12T11:52:14.658 INFO:tasks.workunit.client.0.smithi063.stdout:3/955: link d4/df/d1a/d1c/d3b/d50/fa4 d4/d23/d6b/dff/d124/f130 0 2023-12-12T11:52:14.662 INFO:tasks.workunit.client.0.smithi063.stdout:6/974: dread d9/d10/f93 [0,4194304] 0 2023-12-12T11:52:14.662 INFO:tasks.workunit.client.0.smithi063.stdout:6/975: readlink d9/d10/d2a/dc3/ldd 0 2023-12-12T11:52:14.664 INFO:tasks.workunit.client.0.smithi063.stdout:9/822: dread d7/d15/dc4/d3e/d55/f81 [4194304,4194304] 0 2023-12-12T11:52:14.667 INFO:tasks.workunit.client.0.smithi063.stdout:1/993: mknod d3/c145 0 2023-12-12T11:52:14.670 INFO:tasks.workunit.client.0.smithi063.stdout:5/966: symlink d7/d10/d2b/d3c/d5a/dbb/l12d 0 2023-12-12T11:52:14.671 INFO:tasks.workunit.client.0.smithi063.stdout:7/845: truncate de/d34/d68/d11a/d71/fd9 3589748 0 2023-12-12T11:52:14.671 INFO:tasks.workunit.client.0.smithi063.stdout:7/846: write de/d39/d88/f12c [181208,54365] 0 2023-12-12T11:52:14.673 INFO:tasks.workunit.client.0.smithi063.stdout:3/956: mkdir d4/df/d1a/d1c/d3b/d50/d9f/d131 0 2023-12-12T11:52:14.678 INFO:tasks.workunit.client.0.smithi063.stdout:6/976: unlink d9/d10/d2a/c88 0 2023-12-12T11:52:14.680 INFO:tasks.workunit.client.0.smithi063.stdout:1/994: unlink d3/d3a/dd7/d12/l38 0 2023-12-12T11:52:14.681 INFO:tasks.workunit.client.0.smithi063.stdout:9/823: dread d7/d15/d39/f82 [0,4194304] 0 2023-12-12T11:52:14.681 INFO:tasks.workunit.client.0.smithi063.stdout:9/824: chown d7/d20/d45/cc7 326 1 2023-12-12T11:52:14.681 INFO:tasks.workunit.client.0.smithi063.stdout:9/825: chown d7/d20/cdd 205 1 2023-12-12T11:52:14.682 INFO:tasks.workunit.client.0.smithi063.stdout:9/826: write d7/d8a/de6/fe8 [880549,127498] 0 2023-12-12T11:52:14.683 INFO:tasks.workunit.client.0.smithi063.stdout:3/957: dread d4/df/f80 [0,4194304] 0 2023-12-12T11:52:14.684 INFO:tasks.workunit.client.0.smithi063.stdout:5/967: stat d7/d10/d2b/d3c/d42/d62/d69/dcb/de0/l118 0 2023-12-12T11:52:14.686 INFO:tasks.workunit.client.0.smithi063.stdout:7/847: symlink de/d34/d68/d11a/d41/d44/d8b/dde/l12e 0 2023-12-12T11:52:14.686 INFO:tasks.workunit.client.0.smithi063.stdout:6/977: dread d9/d10/fdb [0,4194304] 0 2023-12-12T11:52:14.704 INFO:tasks.workunit.client.0.smithi063.stdout:9/827: truncate d7/d11/fa0 263716 0 2023-12-12T11:52:14.704 INFO:tasks.workunit.client.0.smithi063.stdout:9/828: chown d7/d20/d45/d8e/ff2 21131 1 2023-12-12T11:52:14.704 INFO:tasks.workunit.client.0.smithi063.stdout:7/848: mknod de/d39/d60/da4/d120/c12f 0 2023-12-12T11:52:14.705 INFO:tasks.workunit.client.0.smithi063.stdout:6/978: symlink d9/d2c/d61/l14d 0 2023-12-12T11:52:14.709 INFO:tasks.workunit.client.0.smithi063.stdout:9/829: symlink d7/d8a/dd6/l111 0 2023-12-12T11:52:14.709 INFO:tasks.workunit.client.0.smithi063.stdout:9/830: chown d7/d20/d45/d46/d51/d64/d6f/dad/ff7 15253 1 2023-12-12T11:52:14.710 INFO:tasks.workunit.client.0.smithi063.stdout:7/849: mkdir de/d39/d4b/d130 0 2023-12-12T11:52:14.711 INFO:tasks.workunit.client.0.smithi063.stdout:7/850: stat de/d22/d4d 0 2023-12-12T11:52:14.712 INFO:tasks.workunit.client.0.smithi063.stdout:6/979: mkdir d9/d2c/d61/d124/d14e 0 2023-12-12T11:52:14.712 INFO:tasks.workunit.client.0.smithi063.stdout:6/980: chown d9/d68/f9d 34 1 2023-12-12T11:52:14.713 INFO:tasks.workunit.client.0.smithi063.stdout:1/995: rename d3/d3a/dd7/d16/d24/d48/d75 to d3/d3a/dd7/d12/d146 0 2023-12-12T11:52:14.713 INFO:tasks.workunit.client.0.smithi063.stdout:1/996: dread - d3/d3a/dd7/d16/d4f/d9a/d12a/dd9/ff7 zero size 2023-12-12T11:52:14.716 INFO:tasks.workunit.client.0.smithi063.stdout:7/851: truncate de/f1a 730233 0 2023-12-12T11:52:14.716 INFO:tasks.workunit.client.0.smithi063.stdout:7/852: write de/d39/d60/f95 [2739403,25194] 0 2023-12-12T11:52:14.720 INFO:tasks.workunit.client.0.smithi063.stdout:5/968: write d7/d10/d2b/f34 [4066733,75926] 0 2023-12-12T11:52:14.721 INFO:tasks.workunit.client.0.smithi063.stdout:1/997: creat d3/d3a/dd7/d16/db8/d138/d35/f147 x:0 0 0 2023-12-12T11:52:14.722 INFO:tasks.workunit.client.0.smithi063.stdout:9/831: mkdir d7/d11/d94/d112 0 2023-12-12T11:52:14.722 INFO:tasks.workunit.client.0.smithi063.stdout:9/832: truncate d7/d20/d45/d46/d51/d64/d6f/dad/fbd 33341 0 2023-12-12T11:52:14.723 INFO:tasks.workunit.client.0.smithi063.stdout:6/981: rmdir d9/d10/d2a/de7/d8a 39 2023-12-12T11:52:14.723 INFO:tasks.workunit.client.0.smithi063.stdout:6/982: chown d9/d10/d25 792 1 2023-12-12T11:52:14.723 INFO:tasks.workunit.client.0.smithi063.stdout:6/983: truncate d9/f74 4406984 0 2023-12-12T11:52:14.724 INFO:tasks.workunit.client.0.smithi063.stdout:0/955: sync 2023-12-12T11:52:14.725 INFO:tasks.workunit.client.0.smithi063.stdout:7/853: rename de/d34/d68/l87 to de/d34/d68/d11a/d41/d44/d8b/dde/daf/l131 0 2023-12-12T11:52:14.725 INFO:tasks.workunit.client.0.smithi063.stdout:7/854: creat de/d39/f132 x:0 0 0 2023-12-12T11:52:14.727 INFO:tasks.workunit.client.0.smithi063.stdout:5/969: truncate d7/d10/d2b/d3c/d42/d76/f9e 3759240 0 2023-12-12T11:52:14.729 INFO:tasks.workunit.client.0.smithi063.stdout:9/833: creat d7/d15/dc4/d3e/d55/f113 x:0 0 0 2023-12-12T11:52:14.729 INFO:tasks.workunit.client.0.smithi063.stdout:9/834: creat d7/d20/d45/d8e/f114 x:0 0 0 2023-12-12T11:52:14.730 INFO:tasks.workunit.client.0.smithi063.stdout:6/984: mknod d9/d10/d2a/de7/d8a/c14f 0 2023-12-12T11:52:14.731 INFO:tasks.workunit.client.0.smithi063.stdout:0/956: fsync d0/d1a/d23/fb3 0 2023-12-12T11:52:14.733 INFO:tasks.workunit.client.0.smithi063.stdout:1/998: rename d3/d3a/dd7/d16/db8/d138/f3e to d3/d3a/d52/f148 0 2023-12-12T11:52:14.733 INFO:tasks.workunit.client.0.smithi063.stdout:1/999: dread - d3/d3a/fbe zero size 2023-12-12T11:52:14.736 INFO:tasks.workunit.client.0.smithi063.stdout:3/958: dwrite d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/da1/dfd/f118 [0,4194304] 0 2023-12-12T11:52:14.736 INFO:tasks.workunit.client.0.smithi063.stdout:3/959: chown d4/df/d1a/d1c/d34/d54/c67 109393 1 2023-12-12T11:52:14.736 INFO:tasks.workunit.client.0.smithi063.stdout:3/960: write d4/d23/d7b/dea/ff2 [816864,73917] 0 2023-12-12T11:52:14.736 INFO:tasks.workunit.client.0.smithi063.stdout:7/855: mknod de/d34/d68/d11a/d41/d44/d8b/dde/df8/c133 0 2023-12-12T11:52:14.738 INFO:tasks.workunit.client.0.smithi063.stdout:5/970: rmdir d7/d28/d6e/dad 39 2023-12-12T11:52:14.742 INFO:tasks.workunit.client.0.smithi063.stdout:6/985: rmdir d9/d2c/d61/dcd 39 2023-12-12T11:52:14.744 INFO:tasks.workunit.client.0.smithi063.stdout:0/957: mkdir d0/d1a/d23/d2e/dd4/ddc/df1/d13b 0 2023-12-12T11:52:14.745 INFO:tasks.workunit.client.0.smithi063.stdout:6/986: read d9/d10/d2a/fc7 [243014,49901] 0 2023-12-12T11:52:14.751 INFO:tasks.workunit.client.0.smithi063.stdout:3/961: link d4/d23/d6b/l8b d4/df/d1a/d1c/d3b/d50/l132 0 2023-12-12T11:52:14.752 INFO:tasks.workunit.client.0.smithi063.stdout:7/856: getdents de/d34/d68/d11a/dd2/d4a/dfe 0 2023-12-12T11:52:14.754 INFO:tasks.workunit.client.0.smithi063.stdout:5/971: dread d7/d10/d2b/f55 [0,4194304] 0 2023-12-12T11:52:14.754 INFO:tasks.workunit.client.0.smithi063.stdout:5/972: chown d7/d28/f47 1260142116 1 2023-12-12T11:52:14.754 INFO:tasks.workunit.client.0.smithi063.stdout:6/987: creat d9/d10/d2a/de7/d8a/df8/f150 x:0 0 0 2023-12-12T11:52:14.755 INFO:tasks.workunit.client.0.smithi063.stdout:6/988: fdatasync d9/d2c/d61/f123 0 2023-12-12T11:52:14.755 INFO:tasks.workunit.client.0.smithi063.stdout:9/835: read d7/d11/fa0 [31611,24947] 0 2023-12-12T11:52:14.765 INFO:tasks.workunit.client.0.smithi063.stdout:5/973: rename d7/d10/d2b/d3c/d5a/dbb/lca to d7/d28/d43/l12e 0 2023-12-12T11:52:14.765 INFO:tasks.workunit.client.0.smithi063.stdout:5/974: fdatasync d7/d10/d2b/d3c/d42/d76/f78 0 2023-12-12T11:52:14.768 INFO:tasks.workunit.client.0.smithi063.stdout:6/989: mknod d9/c151 0 2023-12-12T11:52:14.787 INFO:tasks.workunit.client.0.smithi063.stdout:5/975: rmdir d7/d10/d2b/d3c/d42/d62 39 2023-12-12T11:52:14.787 INFO:tasks.workunit.client.0.smithi063.stdout:5/976: creat d7/d28/d67/f12f x:0 0 0 2023-12-12T11:52:14.787 INFO:tasks.workunit.client.0.smithi063.stdout:5/977: readlink d7/d10/lb7 0 2023-12-12T11:52:14.788 INFO:tasks.workunit.client.0.smithi063.stdout:5/978: chown d7/d28/d43/fe1 516156420 1 2023-12-12T11:52:14.795 INFO:tasks.workunit.client.0.smithi063.stdout:5/979: rename d7/d10/d2b/d3c/d27/f54 to d7/d10/d2b/d3c/d42/d62/d69/dcb/de0/f130 0 2023-12-12T11:52:14.797 INFO:tasks.workunit.client.0.smithi063.stdout:5/980: link d7/d28/d43/f9a d7/d10/d2b/f131 0 2023-12-12T11:52:14.797 INFO:tasks.workunit.client.0.smithi063.stdout:5/981: chown d7/d10/d2b/d3c/c38 8216999 1 2023-12-12T11:52:14.799 INFO:tasks.workunit.client.0.smithi063.stdout:3/962: dwrite d4/df/d1a/d1c/d3b/d52/db6/f12f [0,4194304] 0 2023-12-12T11:52:14.799 INFO:tasks.workunit.client.0.smithi063.stdout:3/963: write d4/df/d1a/d1c/d41/f84 [3506744,88984] 0 2023-12-12T11:52:14.799 INFO:tasks.workunit.client.0.smithi063.stdout:3/964: creat d4/df/d1a/d1c/d3b/d52/d78/da5/dbc/f133 x:0 0 0 2023-12-12T11:52:14.804 INFO:tasks.workunit.client.0.smithi063.stdout:3/965: mkdir d4/df/d1a/d1c/d3b/d52/d78/d134 0 2023-12-12T11:52:14.810 INFO:tasks.workunit.client.0.smithi063.stdout:7/857: dread de/f1e [0,4194304] 0 2023-12-12T11:52:14.810 INFO:tasks.workunit.client.0.smithi063.stdout:7/858: chown de/d34/d68/d11a/dd2/f2f 39904 1 2023-12-12T11:52:14.810 INFO:tasks.workunit.client.0.smithi063.stdout:7/859: fsync de/d39/d60/da4/fb7 0 2023-12-12T11:52:14.814 INFO:tasks.workunit.client.0.smithi063.stdout:5/982: dread d7/d10/d2b/d3c/d42/d62/f6c [0,4194304] 0 2023-12-12T11:52:14.818 INFO:tasks.workunit.client.0.smithi063.stdout:7/860: mkdir de/d34/d68/d11a/d41/d44/d8b/dde/d134 0 2023-12-12T11:52:14.818 INFO:tasks.workunit.client.0.smithi063.stdout:9/836: rmdir d7/d20/d45/d8e 39 2023-12-12T11:52:14.818 INFO:tasks.workunit.client.0.smithi063.stdout:9/837: chown d7/d20/c9e 5789059 1 2023-12-12T11:52:14.822 INFO:tasks.workunit.client.0.smithi063.stdout:7/861: mkdir de/d34/d68/d89/d135 0 2023-12-12T11:52:14.824 INFO:tasks.workunit.client.0.smithi063.stdout:9/838: symlink d7/d15/d39/l115 0 2023-12-12T11:52:14.826 INFO:tasks.workunit.client.0.smithi063.stdout:6/990: dwrite d9/d2c/f54 [0,4194304] 0 2023-12-12T11:52:14.826 INFO:tasks.workunit.client.0.smithi063.stdout:6/991: creat d9/de5/f152 x:0 0 0 2023-12-12T11:52:14.826 INFO:tasks.workunit.client.0.smithi063.stdout:7/862: unlink de/d22/lef 0 2023-12-12T11:52:14.845 INFO:tasks.workunit.client.0.smithi063.stdout:3/966: dwrite d4/d23/fe5 [0,4194304] 0 2023-12-12T11:52:14.845 INFO:tasks.workunit.client.0.smithi063.stdout:5/983: dread d7/d10/d2b/d3c/d27/fb9 [0,4194304] 0 2023-12-12T11:52:14.851 INFO:tasks.workunit.client.0.smithi063.stdout:7/863: dwrite de/d22/d6e/d8a/f126 [0,4194304] 0 2023-12-12T11:52:14.879 INFO:tasks.workunit.client.0.smithi063.stdout:9/839: mkdir d7/d15/dc4/d3e/d55/d116 0 2023-12-12T11:52:14.879 INFO:tasks.workunit.client.0.smithi063.stdout:9/840: stat d7/d15/dc4/l7e 0 2023-12-12T11:52:14.883 INFO:tasks.workunit.client.0.smithi063.stdout:6/992: rename d9/d10/d2a/cdf to d9/d2c/d112/c153 0 2023-12-12T11:52:14.883 INFO:tasks.workunit.client.0.smithi063.stdout:6/993: creat d9/d2c/d61/f154 x:0 0 0 2023-12-12T11:52:14.886 INFO:tasks.workunit.client.0.smithi063.stdout:3/967: mknod d4/d23/d7b/dc2/c135 0 2023-12-12T11:52:14.887 INFO:tasks.workunit.client.0.smithi063.stdout:5/984: link d7/d28/d6e/dad/dba/fc9 d7/d10/d2b/d3c/d5a/dbb/dbc/d129/f132 0 2023-12-12T11:52:14.889 INFO:tasks.workunit.client.0.smithi063.stdout:7/864: dwrite de/d34/d68/d11a/d41/f7c [4194304,4194304] 0 2023-12-12T11:52:14.891 INFO:tasks.workunit.client.0.smithi063.stdout:6/994: rmdir d9 39 2023-12-12T11:52:14.903 INFO:tasks.workunit.client.0.smithi063.stdout:9/841: dread d7/d11/d12/f3d [4194304,4194304] 0 2023-12-12T11:52:14.908 INFO:tasks.workunit.client.0.smithi063.stdout:6/995: dread d9/fd [4194304,4194304] 0 2023-12-12T11:52:14.908 INFO:tasks.workunit.client.0.smithi063.stdout:6/996: creat d9/d2c/d112/f155 x:0 0 0 2023-12-12T11:52:14.908 INFO:tasks.workunit.client.0.smithi063.stdout:6/997: chown d9/d68/le8 3 1 2023-12-12T11:52:14.910 INFO:tasks.workunit.client.0.smithi063.stdout:6/998: symlink d9/d10/d7a/l156 0 2023-12-12T11:52:14.914 INFO:tasks.workunit.client.0.smithi063.stdout:5/985: dread d7/d10/d2b/d3c/d42/ff0 [0,4194304] 0 2023-12-12T11:52:14.915 INFO:tasks.workunit.client.0.smithi063.stdout:5/986: chown d7/d10/d2b/d3c/d42/d62/d69/dcb 45648 1 2023-12-12T11:52:14.915 INFO:tasks.workunit.client.0.smithi063.stdout:5/987: chown d7/d28/la0 11 1 2023-12-12T11:52:14.915 INFO:tasks.workunit.client.0.smithi063.stdout:7/865: rename de/d34 to de/d22/d6e/de4/d136 0 2023-12-12T11:52:14.925 INFO:tasks.workunit.client.0.smithi063.stdout:7/866: unlink de/d22/d6e/f78 0 2023-12-12T11:52:14.926 INFO:tasks.workunit.client.0.smithi063.stdout:7/867: truncate de/d22/d6e/de4/d136/d68/d11a/dd2/fe2 780520 0 2023-12-12T11:52:14.928 INFO:tasks.workunit.client.0.smithi063.stdout:7/868: chown de/d39/d60/d80/fe7 8 1 2023-12-12T11:52:14.938 INFO:tasks.workunit.client.0.smithi063.stdout:3/968: dwrite d4/df/d1a/d1c/f92 [0,4194304] 0 2023-12-12T11:52:14.938 INFO:tasks.workunit.client.0.smithi063.stdout:3/969: truncate d4/df/d1a/d1c/d3b/d52/d78/da5/d98/f103 779584 0 2023-12-12T11:52:14.940 INFO:tasks.workunit.client.0.smithi063.stdout:9/842: dread d7/d11/d94/fb7 [0,4194304] 0 2023-12-12T11:52:14.940 INFO:tasks.workunit.client.0.smithi063.stdout:7/869: creat de/d3f/dc3/dfb/f137 x:0 0 0 2023-12-12T11:52:14.944 INFO:tasks.workunit.client.0.smithi063.stdout:3/970: mkdir d4/df/d1a/d1c/d3b/d52/db6/d136 0 2023-12-12T11:52:14.951 INFO:tasks.workunit.client.0.smithi063.stdout:6/999: dwrite d9/d10/d5c/d5e/f8e [0,4194304] 0 2023-12-12T11:52:14.984 INFO:tasks.workunit.client.0.smithi063.stdout:5/988: dwrite d7/de/f84 [0,4194304] 0 2023-12-12T11:52:14.984 INFO:tasks.workunit.client.0.smithi063.stdout:9/843: dread d7/d11/d4b/d75/fec [0,4194304] 0 2023-12-12T11:52:14.985 INFO:tasks.workunit.client.0.smithi063.stdout:9/844: read d7/d20/d45/d46/d51/d64/d6f/d85/fd2 [107107,92717] 0 2023-12-12T11:52:14.991 INFO:tasks.workunit.client.0.smithi063.stdout:5/989: stat d7/d28/l98 0 2023-12-12T11:52:14.992 INFO:tasks.workunit.client.0.smithi063.stdout:9/845: creat d7/d20/d45/d46/d51/d64/d6f/f117 x:0 0 0 2023-12-12T11:52:14.992 INFO:tasks.workunit.client.0.smithi063.stdout:9/846: fsync d7/d20/d3f/d40/fca 0 2023-12-12T11:52:14.999 INFO:tasks.workunit.client.0.smithi063.stdout:3/971: dwrite d4/df/d1a/d1c/d3b/d50/d9f/fe1 [4194304,4194304] 0 2023-12-12T11:52:14.999 INFO:tasks.workunit.client.0.smithi063.stdout:7/870: dwrite de/d22/d6e/de4/d136/d68/d89/f8d [0,4194304] 0 2023-12-12T11:52:15.002 INFO:tasks.workunit.client.0.smithi063.stdout:9/847: write d7/f54 [1720418,14143] 0 2023-12-12T11:52:15.005 INFO:tasks.workunit.client.0.smithi063.stdout:2/888: sync 2023-12-12T11:52:15.009 INFO:tasks.workunit.client.0.smithi063.stdout:0/958: sync 2023-12-12T11:52:15.009 INFO:tasks.workunit.client.0.smithi063.stdout:4/970: sync 2023-12-12T11:52:15.013 INFO:tasks.workunit.client.0.smithi063.stdout:9/848: mknod d7/d20/d45/d46/d51/d64/d6f/c118 0 2023-12-12T11:52:15.013 INFO:tasks.workunit.client.0.smithi063.stdout:9/849: fdatasync d7/d11/d12/f37 0 2023-12-12T11:52:15.013 INFO:tasks.workunit.client.0.smithi063.stdout:9/850: write d7/d15/dc4/d3e/ff9 [1010756,18113] 0 2023-12-12T11:52:15.014 INFO:tasks.workunit.client.0.smithi063.stdout:2/889: symlink d0/d1a/d3a/d59/ddb/ded/l115 0 2023-12-12T11:52:15.015 INFO:tasks.workunit.client.0.smithi063.stdout:3/972: mkdir d4/d23/d6b/d90/d137 0 2023-12-12T11:52:15.015 INFO:tasks.workunit.client.0.smithi063.stdout:3/973: chown d4/df/d1a/d1c/d3b/d52/db6/f11a 5293 1 2023-12-12T11:52:15.015 INFO:tasks.workunit.client.0.smithi063.stdout:3/974: creat d4/df/d1a/d1c/d3b/d52/d78/da5/d98/f138 x:0 0 0 2023-12-12T11:52:15.019 INFO:tasks.workunit.client.0.smithi063.stdout:9/851: rename d7/d11/d12/f79 to d7/d15/d39/f119 0 2023-12-12T11:52:15.019 INFO:tasks.workunit.client.0.smithi063.stdout:4/971: truncate d2/d47/d6d/d88/d11f/f82 33024 0 2023-12-12T11:52:15.019 INFO:tasks.workunit.client.0.smithi063.stdout:9/852: write d7/d11/d4b/d75/fec [1905799,87733] 0 2023-12-12T11:52:15.020 INFO:tasks.workunit.client.0.smithi063.stdout:9/853: read d7/d20/d45/d46/d51/d64/d6f/d85/fd2 [258696,67870] 0 2023-12-12T11:52:15.021 INFO:tasks.workunit.client.0.smithi063.stdout:2/890: mkdir d0/d1a/d3a/d59/ddb/ded/d116 0 2023-12-12T11:52:15.026 INFO:tasks.workunit.client.0.smithi063.stdout:0/959: creat d0/d1a/d23/dfd/f13c x:0 0 0 2023-12-12T11:52:15.028 INFO:tasks.workunit.client.0.smithi063.stdout:9/854: mknod d7/d20/d3f/d40/ddc/c11a 0 2023-12-12T11:52:15.032 INFO:tasks.workunit.client.0.smithi063.stdout:5/990: dwrite d7/d28/df1/ffd [0,4194304] 0 2023-12-12T11:52:15.033 INFO:tasks.workunit.client.0.smithi063.stdout:5/991: chown d7/d28/d6e/l66 15181936 1 2023-12-12T11:52:15.033 INFO:tasks.workunit.client.0.smithi063.stdout:5/992: write d7/d10/d2b/d3c/d42/d62/d69/dcb/de0/f130 [2160383,21674] 0 2023-12-12T11:52:15.033 INFO:tasks.workunit.client.0.smithi063.stdout:2/891: creat d0/d1a/d1e/f117 x:0 0 0 2023-12-12T11:52:15.033 INFO:tasks.workunit.client.0.smithi063.stdout:2/892: write d0/d1a/d3a/d59/f8e [855613,124313] 0 2023-12-12T11:52:15.034 INFO:tasks.workunit.client.0.smithi063.stdout:0/960: link d0/d1a/d23/d2e/d96/cce d0/d1a/d23/d2e/dd4/ddc/de0/def/c13d 0 2023-12-12T11:52:15.035 INFO:tasks.workunit.client.0.smithi063.stdout:0/961: write d0/d7/d115/f131 [924307,45739] 0 2023-12-12T11:52:15.042 INFO:tasks.workunit.client.0.smithi063.stdout:3/975: write d4/d23/f24 [4097240,115339] 0 2023-12-12T11:52:15.042 INFO:tasks.workunit.client.0.smithi063.stdout:3/976: chown d4/d23/d7b/fd1 597611 1 2023-12-12T11:52:15.050 INFO:tasks.workunit.client.0.smithi063.stdout:0/962: rmdir d0/d7/d27/d1f/dc4 39 2023-12-12T11:52:15.050 INFO:tasks.workunit.client.0.smithi063.stdout:0/963: chown d0/d1a/d23/d2e/d96 1690 1 2023-12-12T11:52:15.050 INFO:tasks.workunit.client.0.smithi063.stdout:7/871: dwrite de/ff5 [0,4194304] 0 2023-12-12T11:52:15.050 INFO:tasks.workunit.client.0.smithi063.stdout:7/872: dread - de/d22/d6e/de4/d136/d68/d11a/f10a zero size 2023-12-12T11:52:15.051 INFO:tasks.workunit.client.0.smithi063.stdout:7/873: fsync de/d39/d88/f12c 0 2023-12-12T11:52:15.052 INFO:tasks.workunit.client.0.smithi063.stdout:9/855: truncate d7/fa 1802589 0 2023-12-12T11:52:15.092 INFO:tasks.workunit.client.0.smithi063.stdout:5/993: dwrite d7/f103 [0,4194304] 0 2023-12-12T11:52:15.104 INFO:tasks.workunit.client.0.smithi063.stdout:2/893: dread d0/d1a/d3a/d85/faa [0,4194304] 0 2023-12-12T11:52:15.104 INFO:tasks.workunit.client.0.smithi063.stdout:4/972: dwrite d2/d47/f66 [0,4194304] 0 2023-12-12T11:52:15.104 INFO:tasks.workunit.client.0.smithi063.stdout:4/973: chown d2/d17/d4e/dd9/f131 594 1 2023-12-12T11:52:15.104 INFO:tasks.workunit.client.0.smithi063.stdout:2/894: write d0/d1a/d3a/d59/fd1 [737841,100165] 0 2023-12-12T11:52:15.104 INFO:tasks.workunit.client.0.smithi063.stdout:2/895: stat d0/d1a/c9a 0 2023-12-12T11:52:15.104 INFO:tasks.workunit.client.0.smithi063.stdout:2/896: stat d0/d1a/d3a/d85/da6/dd8/d107/fe1 0 2023-12-12T11:52:15.106 INFO:tasks.workunit.client.0.smithi063.stdout:0/964: dread d0/d1a/d23/d34/d42/d99/fbf [0,4194304] 0 2023-12-12T11:52:15.108 INFO:tasks.workunit.client.0.smithi063.stdout:9/856: dwrite d7/d20/d3f/d40/d4e/f67 [0,4194304] 0 2023-12-12T11:52:15.108 INFO:tasks.workunit.client.0.smithi063.stdout:9/857: chown d7/d15/d39/c7b 4744083 1 2023-12-12T11:52:15.118 INFO:tasks.workunit.client.0.smithi063.stdout:3/977: dwrite d4/df/d1a/d1c/d57/f6c [0,4194304] 0 2023-12-12T11:52:15.122 INFO:tasks.workunit.client.0.smithi063.stdout:2/897: rmdir d0/d1a/d3a/d59/ddb/ded 39 2023-12-12T11:52:15.122 INFO:tasks.workunit.client.0.smithi063.stdout:4/974: rename d2/d17/d9d/d85 to d2/d47/d6d/d88/dbd/d13a 0 2023-12-12T11:52:15.122 INFO:tasks.workunit.client.0.smithi063.stdout:2/898: truncate d0/d1a/d48/f4a 5157740 0 2023-12-12T11:52:15.122 INFO:tasks.workunit.client.0.smithi063.stdout:2/899: fdatasync d0/d1a/d1e/f2e 0 2023-12-12T11:52:15.122 INFO:tasks.workunit.client.0.smithi063.stdout:2/900: truncate d0/d1a/d57/f6d 912127 0 2023-12-12T11:52:15.123 INFO:tasks.workunit.client.0.smithi063.stdout:4/975: mknod d2/d17/d9d/df5/c13b 0 2023-12-12T11:52:15.124 INFO:tasks.workunit.client.0.smithi063.stdout:2/901: symlink d0/d1a/d57/ddc/df2/df4/l118 0 2023-12-12T11:52:15.124 INFO:tasks.workunit.client.0.smithi063.stdout:2/902: creat d0/d1a/dba/f119 x:0 0 0 2023-12-12T11:52:15.126 INFO:tasks.workunit.client.0.smithi063.stdout:2/903: mkdir d0/d1a/d3a/d85/da6/deb/d11a 0 2023-12-12T11:52:15.127 INFO:tasks.workunit.client.0.smithi063.stdout:2/904: mkdir d0/d1a/d26/d11b 0 2023-12-12T11:52:15.131 INFO:tasks.workunit.client.0.smithi063.stdout:7/874: dwrite de/f4c [4194304,4194304] 0 2023-12-12T11:52:15.131 INFO:tasks.workunit.client.0.smithi063.stdout:7/875: truncate de/d22/fc0 392621 0 2023-12-12T11:52:15.176 INFO:tasks.workunit.client.0.smithi063.stdout:7/876: write de/d22/d6e/de4/d136/f4f [663513,44083] 0 2023-12-12T11:52:15.176 INFO:tasks.workunit.client.0.smithi063.stdout:7/877: fdatasync de/d22/d6e/de4/d136/d68/d89/f8e 0 2023-12-12T11:52:15.191 INFO:tasks.workunit.client.0.smithi063.stdout:5/994: dwrite d7/d10/d2b/d3c/d42/d62/d69/dcb/de0/fe2 [0,4194304] 0 2023-12-12T11:52:15.191 INFO:tasks.workunit.client.0.smithi063.stdout:5/995: truncate d7/d28/df1/ffd 4530213 0 2023-12-12T11:52:15.191 INFO:tasks.workunit.client.0.smithi063.stdout:0/965: dwrite d0/d1a/d66/fbb [0,4194304] 0 2023-12-12T11:52:15.197 INFO:tasks.workunit.client.0.smithi063.stdout:5/996: truncate d7/d28/d43/d49/f4a 9698 0 2023-12-12T11:52:15.198 INFO:tasks.workunit.client.0.smithi063.stdout:7/878: dread de/d39/d88/f12c [0,4194304] 0 2023-12-12T11:52:15.198 INFO:tasks.workunit.client.0.smithi063.stdout:7/879: chown de/d39/d60/da4/d120 7714741 1 2023-12-12T11:52:15.198 INFO:tasks.workunit.client.0.smithi063.stdout:7/880: dread - de/d22/faa zero size 2023-12-12T11:52:15.199 INFO:tasks.workunit.client.0.smithi063.stdout:7/881: chown de/d22/d6e/de4/d136/d68/d11a/dd2/f2d 304189 1 2023-12-12T11:52:15.199 INFO:tasks.workunit.client.0.smithi063.stdout:0/966: creat d0/d1a/d23/d2e/dd4/f13e x:0 0 0 2023-12-12T11:52:15.200 INFO:tasks.workunit.client.0.smithi063.stdout:3/978: dwrite d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d56/d79/f12c [0,4194304] 0 2023-12-12T11:52:15.216 INFO:tasks.workunit.client.0.smithi063.stdout:3/979: dread d4/df/d1a/d1c/d3b/d52/d78/da5/f89 [0,4194304] 0 2023-12-12T11:52:15.216 INFO:tasks.workunit.client.0.smithi063.stdout:2/905: dwrite d0/d1a/d57/fac [0,4194304] 0 2023-12-12T11:52:15.230 INFO:tasks.workunit.client.0.smithi063.stdout:2/906: dread d0/d1a/d1e/d64/f68 [0,4194304] 0 2023-12-12T11:52:15.259 INFO:tasks.workunit.client.0.smithi063.stdout:9/858: dwrite d7/d11/d94/fb4 [0,4194304] 0 2023-12-12T11:52:15.259 INFO:tasks.workunit.client.0.smithi063.stdout:5/997: creat d7/d10/d2b/d3c/d42/d62/d69/dcb/de0/f133 x:0 0 0 2023-12-12T11:52:15.261 INFO:tasks.workunit.client.0.smithi063.stdout:0/967: creat d0/d7/d27/d19/d128/f13f x:0 0 0 2023-12-12T11:52:15.265 INFO:tasks.workunit.client.0.smithi063.stdout:3/980: link d4/d23/c11d d4/df/d1a/df9/c139 0 2023-12-12T11:52:15.273 INFO:tasks.workunit.client.0.smithi063.stdout:2/907: symlink d0/d1a/d1e/d64/l11c 0 2023-12-12T11:52:15.273 INFO:tasks.workunit.client.0.smithi063.stdout:2/908: chown d0/d1a/d48/d56/d77/f8d 7050 1 2023-12-12T11:52:15.274 INFO:tasks.workunit.client.0.smithi063.stdout:9/859: mkdir d7/d20/d45/d46/d51/d64/d6f/d85/d11b 0 2023-12-12T11:52:15.274 INFO:tasks.workunit.client.0.smithi063.stdout:9/860: fsync d7/d20/d45/d46/d51/d64/d6f/f117 0 2023-12-12T11:52:15.275 INFO:tasks.workunit.client.0.smithi063.stdout:0/968: dread d0/d1a/d66/f8a [0,4194304] 0 2023-12-12T11:52:15.275 INFO:tasks.workunit.client.0.smithi063.stdout:5/998: creat d7/d28/d6e/dad/f134 x:0 0 0 2023-12-12T11:52:15.275 INFO:tasks.workunit.client.0.smithi063.stdout:5/999: readlink d7/d10/d2b/d3c/d42/d62/d69/dcb/de0/l118 0 2023-12-12T11:52:15.278 INFO:tasks.workunit.client.0.smithi063.stdout:3/981: mkdir d4/d23/d6b/d13a 0 2023-12-12T11:52:15.281 INFO:tasks.workunit.client.0.smithi063.stdout:2/909: rename d0/d1a/d1e/l6a to d0/d1a/d57/ddc/df2/df4/l11d 0 2023-12-12T11:52:15.281 INFO:tasks.workunit.client.0.smithi063.stdout:2/910: chown d0/d1a/d26/d11b 1798415 1 2023-12-12T11:52:15.282 INFO:tasks.workunit.client.0.smithi063.stdout:9/861: mkdir d7/d20/d45/d46/d11c 0 2023-12-12T11:52:15.282 INFO:tasks.workunit.client.0.smithi063.stdout:9/862: truncate d7/d20/d45/d46/d51/d64/f109 66076 0 2023-12-12T11:52:15.285 INFO:tasks.workunit.client.0.smithi063.stdout:3/982: symlink d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/l13b 0 2023-12-12T11:52:15.285 INFO:tasks.workunit.client.0.smithi063.stdout:3/983: write d4/df/d1a/d1c/d3b/d52/db6/f11a [387267,49934] 0 2023-12-12T11:52:15.287 INFO:tasks.workunit.client.0.smithi063.stdout:2/911: creat d0/d1a/d57/ddc/df2/df4/d10b/f11e x:0 0 0 2023-12-12T11:52:15.291 INFO:tasks.workunit.client.0.smithi063.stdout:0/969: mkdir d0/d1a/d23/ddf/d140 0 2023-12-12T11:52:15.292 INFO:tasks.workunit.client.0.smithi063.stdout:3/984: rename d4/df/d1a/d1c/d34/f85 to d4/d23/d6b/d13a/f13c 0 2023-12-12T11:52:15.292 INFO:tasks.workunit.client.0.smithi063.stdout:3/985: stat d4/df/d1a/d1c/d3b/d50/f8f 0 2023-12-12T11:52:15.296 INFO:tasks.workunit.client.0.smithi063.stdout:3/986: rename d4/d23/d7b/dc2 to d4/df/d1a/d1c/d57/d13d 0 2023-12-12T11:52:15.297 INFO:tasks.workunit.client.0.smithi063.stdout:9/863: write d7/d11/d12/ffd [1665909,129899] 0 2023-12-12T11:52:15.299 INFO:tasks.workunit.client.0.smithi063.stdout:3/987: rename d4/df/d1a/d1c/d3b/d50/f5a to d4/df/d1a/d1c/d3b/d52/d78/da5/f13e 0 2023-12-12T11:52:15.300 INFO:tasks.workunit.client.0.smithi063.stdout:3/988: fdatasync d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/f9e 0 2023-12-12T11:52:15.300 INFO:tasks.workunit.client.0.smithi063.stdout:3/989: fdatasync d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/d69/f102 0 2023-12-12T11:52:15.300 INFO:tasks.workunit.client.0.smithi063.stdout:3/990: truncate d4/d23/f49 5238971 0 2023-12-12T11:52:15.303 INFO:tasks.workunit.client.0.smithi063.stdout:9/864: getdents d7/d20/d45/d8e 0 2023-12-12T11:52:15.328 INFO:tasks.workunit.client.0.smithi063.stdout:0/970: dread d0/d1a/d23/d2e/ffc [0,4194304] 0 2023-12-12T11:52:15.345 INFO:tasks.workunit.client.0.smithi063.stdout:2/912: dwrite d0/d1a/d3a/d59/f96 [0,4194304] 0 2023-12-12T11:52:15.345 INFO:tasks.workunit.client.0.smithi063.stdout:2/913: creat d0/d1a/d48/d56/f11f x:0 0 0 2023-12-12T11:52:15.352 INFO:tasks.workunit.client.0.smithi063.stdout:3/991: dwrite d4/f15 [4194304,4194304] 0 2023-12-12T11:52:15.354 INFO:tasks.workunit.client.0.smithi063.stdout:0/971: dread d0/d1a/d23/ff6 [0,4194304] 0 2023-12-12T11:52:15.359 INFO:tasks.workunit.client.0.smithi063.stdout:0/972: symlink d0/d1a/d23/d2e/dad/d116/dcb/dea/d11b/l141 0 2023-12-12T11:52:15.359 INFO:tasks.workunit.client.0.smithi063.stdout:2/914: dread d0/d1a/d3a/d85/da6/dd8/d107/fe1 [0,4194304] 0 2023-12-12T11:52:15.359 INFO:tasks.workunit.client.0.smithi063.stdout:0/973: creat d0/d7/d115/f142 x:0 0 0 2023-12-12T11:52:15.363 INFO:tasks.workunit.client.0.smithi063.stdout:0/974: symlink d0/d1a/d23/d2e/dd4/ddc/df1/l143 0 2023-12-12T11:52:15.363 INFO:tasks.workunit.client.0.smithi063.stdout:2/915: read d0/d1a/d48/d56/d77/f8d [94168,66551] 0 2023-12-12T11:52:15.363 INFO:tasks.workunit.client.0.smithi063.stdout:2/916: stat d0/d1a/d3a/d59/ddb/ded/f108 0 2023-12-12T11:52:15.364 INFO:tasks.workunit.client.0.smithi063.stdout:0/975: mknod d0/d1a/d23/d2e/dad/d116/dcb/dea/c144 0 2023-12-12T11:52:15.366 INFO:tasks.workunit.client.0.smithi063.stdout:0/976: symlink d0/d7/d27/d1f/dc4/l145 0 2023-12-12T11:52:15.367 INFO:tasks.workunit.client.0.smithi063.stdout:2/917: getdents d0/d1a/d57/ddc/df2 0 2023-12-12T11:52:15.369 INFO:tasks.workunit.client.0.smithi063.stdout:0/977: rmdir d0/d1a/d23/d2e/dad 39 2023-12-12T11:52:15.369 INFO:tasks.workunit.client.0.smithi063.stdout:0/978: readlink d0/d1a/d23/d34/d42/l3c 0 2023-12-12T11:52:15.373 INFO:tasks.workunit.client.0.smithi063.stdout:9/865: dwrite d7/d15/f23 [0,4194304] 0 2023-12-12T11:52:15.376 INFO:tasks.workunit.client.0.smithi063.stdout:2/918: mkdir d0/d1a/d48/d56/d120 0 2023-12-12T11:52:15.377 INFO:tasks.workunit.client.0.smithi063.stdout:0/979: rmdir d0/d7/d129 39 2023-12-12T11:52:15.377 INFO:tasks.workunit.client.0.smithi063.stdout:0/980: dread - d0/d1a/d23/d34/ff7 zero size 2023-12-12T11:52:15.380 INFO:tasks.workunit.client.0.smithi063.stdout:9/866: rmdir d7/d20/d45/d46/d51 39 2023-12-12T11:52:15.383 INFO:tasks.workunit.client.0.smithi063.stdout:0/981: symlink d0/d1a/d23/d34/l146 0 2023-12-12T11:52:15.388 INFO:tasks.workunit.client.0.smithi063.stdout:0/982: rmdir d0/d1a/d23/ddf/d140 0 2023-12-12T11:52:15.395 INFO:tasks.workunit.client.0.smithi063.stdout:0/983: mknod d0/d7/d27/d19/d128/c147 0 2023-12-12T11:52:15.398 INFO:tasks.workunit.client.0.smithi063.stdout:4/976: sync 2023-12-12T11:52:15.399 INFO:tasks.workunit.client.0.smithi063.stdout:9/867: dread d7/f2b [0,4194304] 0 2023-12-12T11:52:15.399 INFO:tasks.workunit.client.0.smithi063.stdout:9/868: creat d7/d8a/dd6/f11d x:0 0 0 2023-12-12T11:52:15.418 INFO:tasks.workunit.client.0.smithi063.stdout:2/919: dread d0/d1a/d57/f6d [0,4194304] 0 2023-12-12T11:52:15.420 INFO:tasks.workunit.client.0.smithi063.stdout:2/920: creat d0/d1a/d3a/d85/da6/deb/d11a/f121 x:0 0 0 2023-12-12T11:52:15.423 INFO:tasks.workunit.client.0.smithi063.stdout:2/921: symlink d0/d1a/d3a/d85/l122 0 2023-12-12T11:52:15.427 INFO:tasks.workunit.client.0.smithi063.stdout:3/992: dwrite d4/df/d1a/d1c/d3b/d52/d78/dbb/f117 [0,4194304] 0 2023-12-12T11:52:15.435 INFO:tasks.workunit.client.0.smithi063.stdout:3/993: creat d4/d23/d6b/dff/d124/f13f x:0 0 0 2023-12-12T11:52:15.440 INFO:tasks.workunit.client.0.smithi063.stdout:3/994: rename d4/df/d1a/df9/c139 to d4/d23/d6b/dff/d124/c140 0 2023-12-12T11:52:15.447 INFO:tasks.workunit.client.0.smithi063.stdout:9/869: dread d7/d20/d65/f72 [4194304,4194304] 0 2023-12-12T11:52:15.447 INFO:tasks.workunit.client.0.smithi063.stdout:9/870: creat d7/d15/dc4/f11e x:0 0 0 2023-12-12T11:52:15.458 INFO:tasks.workunit.client.0.smithi063.stdout:0/984: dwrite d0/f21 [0,4194304] 0 2023-12-12T11:52:15.458 INFO:tasks.workunit.client.0.smithi063.stdout:0/985: readlink d0/d7/d27/d1f/dc4/l145 0 2023-12-12T11:52:15.468 INFO:tasks.workunit.client.0.smithi063.stdout:4/977: dwrite d2/d48/d4f/fa3 [4194304,4194304] 0 2023-12-12T11:52:15.468 INFO:tasks.workunit.client.0.smithi063.stdout:4/978: truncate d2/d47/d6d/d88/d11f/f82 741267 0 2023-12-12T11:52:15.468 INFO:tasks.workunit.client.0.smithi063.stdout:0/986: rename d0/d1a/d23/d2e to d0/d1a/d23/d34/d148 0 2023-12-12T11:52:15.473 INFO:tasks.workunit.client.0.smithi063.stdout:7/882: sync 2023-12-12T11:52:15.473 INFO:tasks.workunit.client.0.smithi063.stdout:7/883: chown de/d22/d6e/d8a/f111 3697445 1 2023-12-12T11:52:15.473 INFO:tasks.workunit.client.0.smithi063.stdout:9/871: read d7/f1e [2330549,129740] 0 2023-12-12T11:52:15.482 INFO:tasks.workunit.client.0.smithi063.stdout:4/979: mkdir d2/d17/d9d/df5/d13c 0 2023-12-12T11:52:15.488 INFO:tasks.workunit.client.0.smithi063.stdout:4/980: creat d2/d47/d6d/d88/df0/db3/dc1/f13d x:0 0 0 2023-12-12T11:52:15.488 INFO:tasks.workunit.client.0.smithi063.stdout:4/981: getdents d2/d17/d9d/df5/d13c 0 2023-12-12T11:52:15.488 INFO:tasks.workunit.client.0.smithi063.stdout:4/982: fdatasync d2/d17/d9d/ffd 0 2023-12-12T11:52:15.489 INFO:tasks.workunit.client.0.smithi063.stdout:4/983: creat d2/d47/d6d/d88/df0/d76/f13e x:0 0 0 2023-12-12T11:52:15.489 INFO:tasks.workunit.client.0.smithi063.stdout:4/984: creat d2/d47/d6d/d88/de6/df3/f13f x:0 0 0 2023-12-12T11:52:15.491 INFO:tasks.workunit.client.0.smithi063.stdout:7/884: dread de/f3c [0,4194304] 0 2023-12-12T11:52:15.496 INFO:tasks.workunit.client.0.smithi063.stdout:3/995: dwrite d4/df/d1a/d1c/d34/fe6 [0,4194304] 0 2023-12-12T11:52:15.496 INFO:tasks.workunit.client.0.smithi063.stdout:3/996: readlink d4/df/d1a/d1c/d34/l4a 0 2023-12-12T11:52:15.497 INFO:tasks.workunit.client.0.smithi063.stdout:3/997: dread - d4/df/d1a/d1c/d41/ff8 zero size 2023-12-12T11:52:15.502 INFO:tasks.workunit.client.0.smithi063.stdout:4/985: creat d2/d47/d6d/d88/dbd/d13a/da5/f140 x:0 0 0 2023-12-12T11:52:15.504 INFO:tasks.workunit.client.0.smithi063.stdout:7/885: symlink de/d39/d60/d80/l138 0 2023-12-12T11:52:15.509 INFO:tasks.workunit.client.0.smithi063.stdout:3/998: getdents d4/df/d1a/d1c/d34/d54 0 2023-12-12T11:52:15.509 INFO:tasks.workunit.client.0.smithi063.stdout:3/999: write d4/df/d1a/d1c/d3b/d52/d78/da5/d4c/de0/f120 [705228,23329] 0 2023-12-12T11:52:15.512 INFO:tasks.workunit.client.0.smithi063.stdout:4/986: mknod d2/d47/d6d/d88/de6/c141 0 2023-12-12T11:52:15.514 INFO:tasks.workunit.client.0.smithi063.stdout:7/886: creat de/d22/d6e/d8a/da3/d108/f139 x:0 0 0 2023-12-12T11:52:15.514 INFO:tasks.workunit.client.0.smithi063.stdout:7/887: truncate de/d3f/dc3/dfb/f137 706176 0 2023-12-12T11:52:15.520 INFO:tasks.workunit.client.0.smithi063.stdout:0/987: dwrite d0/d1a/d23/d34/d148/dd4/ddc/f11c [0,4194304] 0 2023-12-12T11:52:15.531 INFO:tasks.workunit.client.0.smithi063.stdout:0/988: unlink d0/d1a/d23/d34/d148/d84/l130 0 2023-12-12T11:52:15.538 INFO:tasks.workunit.client.0.smithi063.stdout:9/872: dwrite d7/d11/d4b/d75/df8/f10f [0,4194304] 0 2023-12-12T11:52:15.538 INFO:tasks.workunit.client.0.smithi063.stdout:9/873: creat d7/d20/d3f/d40/d76/f11f x:0 0 0 2023-12-12T11:52:15.542 INFO:tasks.workunit.client.0.smithi063.stdout:9/874: mkdir d7/d8a/d120 0 2023-12-12T11:52:15.546 INFO:tasks.workunit.client.0.smithi063.stdout:9/875: symlink d7/d20/d45/d46/d51/dc3/l121 0 2023-12-12T11:52:15.548 INFO:tasks.workunit.client.0.smithi063.stdout:9/876: rmdir d7/d20/daf 39 2023-12-12T11:52:15.566 INFO:tasks.workunit.client.0.smithi063.stdout:0/989: dread d0/d1a/d66/f87 [0,4194304] 0 2023-12-12T11:52:15.569 INFO:tasks.workunit.client.0.smithi063.stdout:0/990: symlink d0/d1a/d23/d34/d148/dd7/l149 0 2023-12-12T11:52:15.575 INFO:tasks.workunit.client.0.smithi063.stdout:0/991: link d0/d1a/d23/d34/d148/c38 d0/ddb/c14a 0 2023-12-12T11:52:15.575 INFO:tasks.workunit.client.0.smithi063.stdout:0/992: chown d0/d1a/d66/dfb 6664 1 2023-12-12T11:52:15.576 INFO:tasks.workunit.client.0.smithi063.stdout:7/888: dwrite de/d39/d88/db4/f10b [0,4194304] 0 2023-12-12T11:52:15.581 INFO:tasks.workunit.client.0.smithi063.stdout:4/987: dwrite d2/d47/d6d/d88/df0/d76/f13e [0,4194304] 0 2023-12-12T11:52:15.581 INFO:tasks.workunit.client.0.smithi063.stdout:7/889: rename de/d22/d6e/de4/d136/d68/d11a/dd2/d4a/l63 to de/d22/d6e/de4/d136/l13a 0 2023-12-12T11:52:15.581 INFO:tasks.workunit.client.0.smithi063.stdout:7/890: truncate de/d3f/dc3/dfb/f137 1021241 0 2023-12-12T11:52:15.582 INFO:tasks.workunit.client.0.smithi063.stdout:0/993: mkdir d0/d7/d27/d44/d14b 0 2023-12-12T11:52:15.583 INFO:tasks.workunit.client.0.smithi063.stdout:0/994: readlink d0/d1a/d23/d34/d42/d99/lcc 0 2023-12-12T11:52:15.588 INFO:tasks.workunit.client.0.smithi063.stdout:4/988: mknod d2/d47/d6d/d88/d11f/dd2/c142 0 2023-12-12T11:52:15.589 INFO:tasks.workunit.client.0.smithi063.stdout:0/995: link d0/d7/d27/fc5 d0/d1a/d23/d34/d148/dd4/ddc/df1/f14c 0 2023-12-12T11:52:15.589 INFO:tasks.workunit.client.0.smithi063.stdout:0/996: truncate d0/d1a/d23/d34/d42/f10c 810791 0 2023-12-12T11:52:15.591 INFO:tasks.workunit.client.0.smithi063.stdout:0/997: creat d0/d1a/d23/d34/d148/dd4/ddc/df1/d13b/f14d x:0 0 0 2023-12-12T11:52:15.598 INFO:tasks.workunit.client.0.smithi063.stdout:7/891: dread de/d22/d6e/de4/d136/d68/d11a/d41/d44/d8b/dde/dc7/f9a [0,4194304] 0 2023-12-12T11:52:15.598 INFO:tasks.workunit.client.0.smithi063.stdout:7/892: readlink de/d22/d6e/de4/d136/d68/d11a/d41/d44/d8b/dde/lc2 0 2023-12-12T11:52:15.603 INFO:tasks.workunit.client.0.smithi063.stdout:7/893: unlink de/d22/d6e/de4/d136/d68/da1/lf6 0 2023-12-12T11:52:15.610 INFO:tasks.workunit.client.0.smithi063.stdout:7/894: creat de/d22/d6e/d8a/de3/f13b x:0 0 0 2023-12-12T11:52:15.611 INFO:tasks.workunit.client.0.smithi063.stdout:0/998: dread d0/d1a/d23/d34/d148/fe5 [0,4194304] 0 2023-12-12T11:52:15.614 INFO:tasks.workunit.client.0.smithi063.stdout:0/999: rmdir d0/d1a/d23/d34/d148/dd4/ddc/df1/d134 0 2023-12-12T11:52:15.629 INFO:tasks.workunit.client.0.smithi063.stdout:4/989: dwrite d2/d47/d6d/d88/df0/f115 [0,4194304] 0 2023-12-12T11:52:15.629 INFO:tasks.workunit.client.0.smithi063.stdout:4/990: write d2/d17/d7f/fb5 [857015,127792] 0 2023-12-12T11:52:15.635 INFO:tasks.workunit.client.0.smithi063.stdout:4/991: dread d2/f137 [0,4194304] 0 2023-12-12T11:52:15.635 INFO:tasks.workunit.client.0.smithi063.stdout:4/992: chown d2/d17/d7f/da2/cab 2163 1 2023-12-12T11:52:15.692 INFO:tasks.workunit.client.0.smithi063.stdout:4/993: creat d2/d47/d6d/d88/dbd/f143 x:0 0 0 2023-12-12T11:52:15.710 INFO:tasks.workunit.client.0.smithi063.stdout:4/994: rename d2/d17/d4e/c7c to d2/d47/d6d/d88/c144 0 2023-12-12T11:52:15.715 INFO:tasks.workunit.client.0.smithi063.stdout:4/995: rmdir d2/d17/d9d 39 2023-12-12T11:52:15.716 INFO:tasks.workunit.client.0.smithi063.stdout:4/996: rmdir d2/d47/dec 39 2023-12-12T11:52:15.729 INFO:tasks.workunit.client.0.smithi063.stdout:2/922: sync 2023-12-12T11:52:15.730 INFO:tasks.workunit.client.0.smithi063.stdout:2/923: rmdir d0/d1a/d3a/d59/ddb/ded 39 2023-12-12T11:52:15.791 INFO:tasks.workunit.client.0.smithi063.stdout:4/997: dwrite d2/d17/df8/f101 [0,4194304] 0 2023-12-12T11:52:15.822 INFO:tasks.workunit.client.0.smithi063.stdout:9/877: sync 2023-12-12T11:52:15.841 INFO:tasks.workunit.client.0.smithi063.stdout:9/878: dread d7/d11/d12/f3d [4194304,4194304] 0 2023-12-12T11:52:15.845 INFO:tasks.workunit.client.0.smithi063.stdout:9/879: mknod d7/d20/d3f/d40/da7/c122 0 2023-12-12T11:52:15.847 INFO:tasks.workunit.client.0.smithi063.stdout:9/880: mkdir d7/d20/d3f/d40/d4e/d123 0 2023-12-12T11:52:15.847 INFO:tasks.workunit.client.0.smithi063.stdout:9/881: fsync d7/d15/f31 0 2023-12-12T11:52:15.856 INFO:tasks.workunit.client.0.smithi063.stdout:4/998: dwrite d2/d17/dd5/f128 [0,4194304] 0 2023-12-12T11:52:15.856 INFO:tasks.workunit.client.0.smithi063.stdout:4/999: fsync d2/d17/d81/f8c 0 2023-12-12T11:52:15.885 INFO:tasks.workunit.client.0.smithi063.stdout:9/882: dread d7/d15/f17 [0,4194304] 0 2023-12-12T11:52:15.898 INFO:tasks.workunit.client.0.smithi063.stdout:9/883: dread d7/d11/fa0 [0,4194304] 0 2023-12-12T11:52:15.906 INFO:tasks.workunit.client.0.smithi063.stdout:9/884: unlink d7/fd 0 2023-12-12T11:52:15.913 INFO:tasks.workunit.client.0.smithi063.stdout:9/885: rename d7/d15/dc4/d3e/dbb to d7/d20/d3f/d40/da7/d124 0 2023-12-12T11:52:15.913 INFO:tasks.workunit.client.0.smithi063.stdout:9/886: creat d7/d20/d3f/d40/ddc/f125 x:0 0 0 2023-12-12T11:52:15.913 INFO:tasks.workunit.client.0.smithi063.stdout:9/887: creat d7/d8a/dd6/f126 x:0 0 0 2023-12-12T11:52:15.913 INFO:tasks.workunit.client.0.smithi063.stdout:9/888: truncate d7/d15/dc4/f8b 1260423 0 2023-12-12T11:52:15.925 INFO:tasks.workunit.client.0.smithi063.stdout:7/895: sync 2023-12-12T11:52:15.931 INFO:tasks.workunit.client.0.smithi063.stdout:7/896: link de/d22/d6e/d8a/cd7 de/d22/d6e/da2/c13c 0 2023-12-12T11:52:15.932 INFO:tasks.workunit.client.0.smithi063.stdout:7/897: chown de/d39/d60/c104 0 1 2023-12-12T11:52:15.932 INFO:tasks.workunit.client.0.smithi063.stdout:7/898: chown de/d3f/f72 16 1 2023-12-12T11:52:15.932 INFO:tasks.workunit.client.0.smithi063.stdout:7/899: dread - de/d22/d6e/de4/d136/d68/d11a/d71/fec zero size 2023-12-12T11:52:15.932 INFO:tasks.workunit.client.0.smithi063.stdout:7/900: creat de/d22/d66/f13d x:0 0 0 2023-12-12T11:52:15.937 INFO:tasks.workunit.client.0.smithi063.stdout:7/901: symlink de/d22/d6e/l13e 0 2023-12-12T11:52:15.939 INFO:tasks.workunit.client.0.smithi063.stdout:7/902: stat de/d39/d88/db4/cfa 0 2023-12-12T11:52:15.943 INFO:tasks.workunit.client.0.smithi063.stdout:7/903: mkdir de/d22/d6e/de4/d136/d43/d45/d13f 0 2023-12-12T11:52:15.946 INFO:tasks.workunit.client.0.smithi063.stdout:7/904: mknod de/d39/d4b/c140 0 2023-12-12T11:52:15.948 INFO:tasks.workunit.client.0.smithi063.stdout:7/905: creat de/d39/d60/f141 x:0 0 0 2023-12-12T11:52:15.951 INFO:tasks.workunit.client.0.smithi063.stdout:7/906: rename de/d22/d6e/de4/d136/d68/d11a/d41/d44/d8b/dde/df8/c133 to de/d22/d6e/d8a/de3/c142 0 2023-12-12T11:52:15.951 INFO:tasks.workunit.client.0.smithi063.stdout:7/907: dread - de/d39/fe5 zero size 2023-12-12T11:52:15.951 INFO:tasks.workunit.client.0.smithi063.stdout:7/908: dread - de/d22/d4d/f119 zero size 2023-12-12T11:52:15.952 INFO:tasks.workunit.client.0.smithi063.stdout:7/909: link de/d3f/dc3/f124 de/d22/d6e/de4/d136/d43/f143 0 2023-12-12T11:52:15.953 INFO:tasks.workunit.client.0.smithi063.stdout:7/910: truncate de/d3f/dc3/dfb/f137 323243 0 2023-12-12T11:52:15.966 INFO:tasks.workunit.client.0.smithi063.stdout:9/889: dwrite d7/d11/fa0 [0,4194304] 0 2023-12-12T11:52:15.969 INFO:tasks.workunit.client.0.smithi063.stdout:9/890: rename d7/d15/d39/f47 to d7/d20/d45/d46/d51/d64/d6f/f127 0 2023-12-12T11:52:15.970 INFO:tasks.workunit.client.0.smithi063.stdout:9/891: truncate d7/d11/d94/fb4 4015983 0 2023-12-12T11:52:15.970 INFO:tasks.workunit.client.0.smithi063.stdout:9/892: readlink d7/d20/d45/d46/d51/d64/l102 0 2023-12-12T11:52:15.989 INFO:tasks.workunit.client.0.smithi063.stdout:2/924: sync 2023-12-12T11:52:15.997 INFO:tasks.workunit.client.0.smithi063.stdout:2/925: mknod d0/d1a/d57/ddc/df2/c123 0 2023-12-12T11:52:16.020 INFO:tasks.workunit.client.0.smithi063.stdout:7/911: dwrite de/d39/d60/da4/fb7 [0,4194304] 0 2023-12-12T11:52:16.021 INFO:tasks.workunit.client.0.smithi063.stdout:9/893: dwrite d7/d15/dc4/f8b [0,4194304] 0 2023-12-12T11:52:16.021 INFO:tasks.workunit.client.0.smithi063.stdout:9/894: fdatasync d7/d20/d45/d46/d51/d64/d6f/f117 0 2023-12-12T11:52:16.021 INFO:tasks.workunit.client.0.smithi063.stdout:9/895: chown d7/d15/l10a 6932 1 2023-12-12T11:52:16.021 INFO:tasks.workunit.client.0.smithi063.stdout:9/896: chown d7/d20/d45/d46/d51/d64/d6f/ld5 4660800 1 2023-12-12T11:52:16.025 INFO:tasks.workunit.client.0.smithi063.stdout:7/912: creat de/d39/d60/d10c/f144 x:0 0 0 2023-12-12T11:52:16.029 INFO:tasks.workunit.client.0.smithi063.stdout:7/913: creat de/d22/d6e/de4/d136/d43/d45/f145 x:0 0 0 2023-12-12T11:52:16.030 INFO:tasks.workunit.client.0.smithi063.stdout:7/914: write de/d22/d66/fa7 [2291153,124596] 0 2023-12-12T11:52:16.030 INFO:tasks.workunit.client.0.smithi063.stdout:7/915: read - de/d22/d4d/f119 zero size 2023-12-12T11:52:16.035 INFO:tasks.workunit.client.0.smithi063.stdout:7/916: unlink de/d22/d6e/de4/d136/d68/d11a/d71/fec 0 2023-12-12T11:52:16.035 INFO:tasks.workunit.client.0.smithi063.stdout:7/917: chown de/d3f/dc3/f124 11 1 2023-12-12T11:52:16.042 INFO:tasks.workunit.client.0.smithi063.stdout:7/918: truncate de/d22/fc0 184678 0 2023-12-12T11:52:16.042 INFO:tasks.workunit.client.0.smithi063.stdout:7/919: chown de/d22/d6e/d8a/da3/l53 16 1 2023-12-12T11:52:16.043 INFO:tasks.workunit.client.0.smithi063.stdout:7/920: truncate de/d39/d88/db4/f10b 2089536 0 2023-12-12T11:52:16.055 INFO:tasks.workunit.client.0.smithi063.stdout:9/897: dwrite d7/d20/feb [0,4194304] 0 2023-12-12T11:52:16.061 INFO:tasks.workunit.client.0.smithi063.stdout:7/921: dread de/d22/d6e/de4/d136/d68/d11a/d71/fd9 [0,4194304] 0 2023-12-12T11:52:16.064 INFO:tasks.workunit.client.0.smithi063.stdout:9/898: mknod d7/d20/d3f/d40/c128 0 2023-12-12T11:52:16.066 INFO:tasks.workunit.client.0.smithi063.stdout:7/922: stat de/dc8/l102 0 2023-12-12T11:52:16.113 INFO:tasks.workunit.client.0.smithi063.stdout:9/899: dwrite d7/d11/f25 [4194304,4194304] 0 2023-12-12T11:52:16.113 INFO:tasks.workunit.client.0.smithi063.stdout:9/900: stat d7/d8a/dd6/l111 0 2023-12-12T11:52:16.115 INFO:tasks.workunit.client.0.smithi063.stdout:9/901: getdents d7/d20/d65 0 2023-12-12T11:52:16.119 INFO:tasks.workunit.client.0.smithi063.stdout:9/902: creat d7/d20/d45/d46/d11c/f129 x:0 0 0 2023-12-12T11:52:16.122 INFO:tasks.workunit.client.0.smithi063.stdout:9/903: rename d7/lfc to d7/d20/d45/d46/d51/d64/d6f/d85/d11b/l12a 0 2023-12-12T11:52:16.122 INFO:tasks.workunit.client.0.smithi063.stdout:9/904: chown d7/d20/d3f/d40/fc0 212577222 1 2023-12-12T11:52:16.122 INFO:tasks.workunit.client.0.smithi063.stdout:9/905: read - d7/d20/d45/d46/d51/d64/d6f/dad/ff7 zero size 2023-12-12T11:52:16.122 INFO:tasks.workunit.client.0.smithi063.stdout:9/906: chown d7/d20 66039189 1 2023-12-12T11:52:16.123 INFO:tasks.workunit.client.0.smithi063.stdout:9/907: fsync d7/d8a/dd6/fd8 0 2023-12-12T11:52:16.125 INFO:tasks.workunit.client.0.smithi063.stdout:9/908: creat d7/d11/f12b x:0 0 0 2023-12-12T11:52:16.171 INFO:tasks.workunit.client.0.smithi063.stdout:9/909: dwrite d7/d20/d45/d46/d51/d64/fb8 [4194304,4194304] 0 2023-12-12T11:52:16.171 INFO:tasks.workunit.client.0.smithi063.stdout:9/910: chown d7/d15/d39/ca1 1 1 2023-12-12T11:52:16.233 INFO:tasks.workunit.client.0.smithi063.stdout:9/911: dwrite d7/d11/fa0 [0,4194304] 0 2023-12-12T11:52:16.233 INFO:tasks.workunit.client.0.smithi063.stdout:9/912: creat d7/d20/d3f/d40/d76/f12c x:0 0 0 2023-12-12T11:52:16.237 INFO:tasks.workunit.client.0.smithi063.stdout:9/913: rename d7/d15/dc4/lba to d7/d20/d45/d46/d51/d64/d6f/d85/d11b/l12d 0 2023-12-12T11:52:16.267 INFO:tasks.workunit.client.0.smithi063.stdout:2/926: sync 2023-12-12T11:52:16.271 INFO:tasks.workunit.client.0.smithi063.stdout:2/927: unlink d0/d1a/d3a/d59/cda 0 2023-12-12T11:52:16.275 INFO:tasks.workunit.client.0.smithi063.stdout:2/928: rename d0/d1a/d48/f30 to d0/d1a/d1e/d64/f124 0 2023-12-12T11:52:16.290 INFO:tasks.workunit.client.0.smithi063.stdout:9/914: dwrite d7/d15/f31 [4194304,4194304] 0 2023-12-12T11:52:16.290 INFO:tasks.workunit.client.0.smithi063.stdout:9/915: stat d7/d11/f53 0 2023-12-12T11:52:16.293 INFO:tasks.workunit.client.0.smithi063.stdout:9/916: mknod d7/d15/dc4/d3e/d55/c12e 0 2023-12-12T11:52:16.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:16 smithi063 ceph-mon[107117]: pgmap v22: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 208 MiB/s rd, 237 MiB/s wr, 397 op/s 2023-12-12T11:52:16.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:16 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:16.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:16 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:16.317 INFO:tasks.workunit.client.0.smithi063.stdout:9/917: dread d7/f27 [0,4194304] 0 2023-12-12T11:52:16.320 INFO:tasks.workunit.client.0.smithi063.stdout:9/918: mknod d7/d20/d3f/d40/da7/c12f 0 2023-12-12T11:52:16.323 INFO:tasks.workunit.client.0.smithi063.stdout:9/919: symlink d7/d20/d45/d46/def/l130 0 2023-12-12T11:52:16.325 INFO:tasks.workunit.client.0.smithi063.stdout:2/929: dwrite d0/d1a/d3a/f9e [0,4194304] 0 2023-12-12T11:52:16.325 INFO:tasks.workunit.client.0.smithi063.stdout:9/920: creat d7/d20/daf/f131 x:0 0 0 2023-12-12T11:52:16.325 INFO:tasks.workunit.client.0.smithi063.stdout:9/921: write d7/d20/d3f/d40/ddc/f125 [513756,93896] 0 2023-12-12T11:52:16.331 INFO:tasks.workunit.client.0.smithi063.stdout:2/930: rename d0/d1a/d48/d56/le0 to d0/d1a/dba/l125 0 2023-12-12T11:52:16.373 INFO:tasks.workunit.client.0.smithi063.stdout:9/922: dwrite d7/d8a/dd6/f126 [0,4194304] 0 2023-12-12T11:52:16.406 INFO:tasks.workunit.client.0.smithi063.stdout:7/923: sync 2023-12-12T11:52:16.407 INFO:tasks.workunit.client.0.smithi063.stdout:7/924: rename de/d22/d6e/de4/d136/d68/d89 to de/d39/d60/d80/d146 0 2023-12-12T11:52:16.410 INFO:tasks.workunit.client.0.smithi063.stdout:7/925: link de/d22/d6e/de4/d136/d43/d45/fee de/d39/d88/db4/f147 0 2023-12-12T11:52:16.433 INFO:tasks.workunit.client.0.smithi063.stdout:9/923: dwrite d7/f54 [0,4194304] 0 2023-12-12T11:52:16.433 INFO:tasks.workunit.client.0.smithi063.stdout:7/926: dread de/d22/d6e/de4/d136/d68/d11a/fd4 [0,4194304] 0 2023-12-12T11:52:16.444 INFO:tasks.workunit.client.0.smithi063.stdout:9/924: dread d7/d8a/de6/fe8 [0,4194304] 0 2023-12-12T11:52:16.447 INFO:tasks.workunit.client.0.smithi063.stdout:9/925: mkdir d7/d20/d45/d132 0 2023-12-12T11:52:16.452 INFO:tasks.workunit.client.0.smithi063.stdout:9/926: getdents d7/d15/d39 0 2023-12-12T11:52:16.455 INFO:tasks.workunit.client.0.smithi063.stdout:9/927: rmdir d7/d20/d3f/d40/d76 39 2023-12-12T11:52:16.456 INFO:tasks.workunit.client.0.smithi063.stdout:9/928: chown d7/d20/d45/d46/d51/d64/d6f/d85/d11b 104102681 1 2023-12-12T11:52:16.456 INFO:tasks.workunit.client.0.smithi063.stdout:9/929: dread - d7/d8a/de6/f10d zero size 2023-12-12T11:52:16.458 INFO:tasks.workunit.client.0.smithi063.stdout:9/930: symlink d7/d11/l133 0 2023-12-12T11:52:16.463 INFO:tasks.workunit.client.0.smithi063.stdout:9/931: getdents d7/d20 0 2023-12-12T11:52:16.463 INFO:tasks.workunit.client.0.smithi063.stdout:9/932: readlink d7/d20/d3f/ld4 0 2023-12-12T11:52:16.467 INFO:tasks.workunit.client.0.smithi063.stdout:9/933: creat d7/d11/d94/d112/f134 x:0 0 0 2023-12-12T11:52:16.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:16 smithi093 ceph-mon[115914]: pgmap v22: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 208 MiB/s rd, 237 MiB/s wr, 397 op/s 2023-12-12T11:52:16.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:16 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:16.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:16 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:16.490 INFO:tasks.workunit.client.0.smithi063.stdout:7/927: dwrite de/f3c [0,4194304] 0 2023-12-12T11:52:16.530 INFO:tasks.workunit.client.0.smithi063.stdout:7/928: dwrite de/d39/d88/db4/f147 [0,4194304] 0 2023-12-12T11:52:16.530 INFO:tasks.workunit.client.0.smithi063.stdout:7/929: fdatasync de/f1e 0 2023-12-12T11:52:16.532 INFO:tasks.workunit.client.0.smithi063.stdout:7/930: rmdir de/d39/d60/da4 39 2023-12-12T11:52:16.532 INFO:tasks.workunit.client.0.smithi063.stdout:7/931: write de/d39/fe5 [1037996,110713] 0 2023-12-12T11:52:16.533 INFO:tasks.workunit.client.0.smithi063.stdout:7/932: symlink de/d39/d60/d80/d146/d135/l148 0 2023-12-12T11:52:16.549 INFO:tasks.workunit.client.0.smithi063.stdout:7/933: dread de/f1e [0,4194304] 0 2023-12-12T11:52:16.550 INFO:tasks.workunit.client.0.smithi063.stdout:7/934: rename de/d22/la0 to de/d39/d4b/l149 0 2023-12-12T11:52:16.553 INFO:tasks.workunit.client.0.smithi063.stdout:7/935: rename de/f21 to de/d39/d4b/d130/f14a 0 2023-12-12T11:52:16.553 INFO:tasks.workunit.client.0.smithi063.stdout:7/936: getdents de/d22/d6e/de4/d136/d43/d116 0 2023-12-12T11:52:16.613 INFO:tasks.workunit.client.0.smithi063.stdout:7/937: dwrite de/d22/d6e/de4/d136/d68/d11a/dd2/d4a/d65/fc6 [0,4194304] 0 2023-12-12T11:52:16.617 INFO:tasks.workunit.client.0.smithi063.stdout:7/938: truncate de/d22/d6e/de4/d136/d68/d11a/fbb 2304609 0 2023-12-12T11:52:16.618 INFO:tasks.workunit.client.0.smithi063.stdout:2/931: sync 2023-12-12T11:52:16.621 INFO:tasks.workunit.client.0.smithi063.stdout:7/939: creat de/d22/d6e/de4/d136/d68/d11a/dd2/f14b x:0 0 0 2023-12-12T11:52:16.625 INFO:tasks.workunit.client.0.smithi063.stdout:2/932: truncate d0/f43 2109499 0 2023-12-12T11:52:16.628 INFO:tasks.workunit.client.0.smithi063.stdout:2/933: truncate d0/fbd 3857758 0 2023-12-12T11:52:16.695 INFO:tasks.workunit.client.0.smithi063.stdout:9/934: sync 2023-12-12T11:52:16.698 INFO:tasks.workunit.client.0.smithi063.stdout:9/935: mknod d7/d20/d3f/d40/c135 0 2023-12-12T11:52:16.698 INFO:tasks.workunit.client.0.smithi063.stdout:9/936: chown d7/d20/d45/d46/d51/d64/d6f/d85/d11b 2993499 1 2023-12-12T11:52:16.713 INFO:tasks.workunit.client.0.smithi063.stdout:9/937: read d7/d11/d4b/d75/f104 [3668739,79057] 0 2023-12-12T11:52:16.714 INFO:tasks.workunit.client.0.smithi063.stdout:9/938: stat d7/d20/d3f/d40/d76/f9d 0 2023-12-12T11:52:16.823 INFO:tasks.workunit.client.0.smithi063.stdout:9/939: dwrite d7/d11/d4b/d75/df8/f10f [0,4194304] 0 2023-12-12T11:52:16.874 INFO:tasks.workunit.client.0.smithi063.stdout:9/940: creat d7/d20/d45/d8e/f136 x:0 0 0 2023-12-12T11:52:16.874 INFO:tasks.workunit.client.0.smithi063.stdout:9/941: truncate d7/f2b 8601785 0 2023-12-12T11:52:16.874 INFO:tasks.workunit.client.0.smithi063.stdout:9/942: dread - d7/d20/d3f/d40/ddc/f110 zero size 2023-12-12T11:52:16.875 INFO:tasks.workunit.client.0.smithi063.stdout:9/943: link d7/d15/d39/ca1 d7/d20/d45/d46/d11c/c137 0 2023-12-12T11:52:16.880 INFO:tasks.workunit.client.0.smithi063.stdout:9/944: dread d7/d20/d45/d46/d51/d64/f109 [0,4194304] 0 2023-12-12T11:52:16.880 INFO:tasks.workunit.client.0.smithi063.stdout:9/945: creat d7/d11/d94/d112/f138 x:0 0 0 2023-12-12T11:52:16.882 INFO:tasks.workunit.client.0.smithi063.stdout:9/946: mkdir d7/d20/d3f/d40/d4e/d123/d139 0 2023-12-12T11:52:16.884 INFO:tasks.workunit.client.0.smithi063.stdout:9/947: truncate d7/f1e 4326948 0 2023-12-12T11:52:16.887 INFO:tasks.workunit.client.0.smithi063.stdout:9/948: link d7/d15/dc4/d3e/f5b d7/d15/f13a 0 2023-12-12T11:52:16.887 INFO:tasks.workunit.client.0.smithi063.stdout:9/949: write d7/d11/d12/f1a [2382821,127898] 0 2023-12-12T11:52:16.887 INFO:tasks.workunit.client.0.smithi063.stdout:9/950: creat d7/d20/d45/d46/d51/d64/d6f/f13b x:0 0 0 2023-12-12T11:52:16.887 INFO:tasks.workunit.client.0.smithi063.stdout:9/951: creat d7/d20/d3f/d40/da7/f13c x:0 0 0 2023-12-12T11:52:16.888 INFO:tasks.workunit.client.0.smithi063.stdout:9/952: chown d7/d11/l133 22054 1 2023-12-12T11:52:16.890 INFO:tasks.workunit.client.0.smithi063.stdout:9/953: link d7/d11/d4b/cb3 d7/d8a/d120/c13d 0 2023-12-12T11:52:16.906 INFO:tasks.workunit.client.0.smithi063.stdout:9/954: dread d7/d15/dc4/f8b [0,4194304] 0 2023-12-12T11:52:16.908 INFO:tasks.workunit.client.0.smithi063.stdout:9/955: rmdir d7/d20/d3f/d40/d4e 39 2023-12-12T11:52:16.908 INFO:tasks.workunit.client.0.smithi063.stdout:9/956: chown d7/d20/d45/d46/d11c/f129 420650119 1 2023-12-12T11:52:16.909 INFO:tasks.workunit.client.0.smithi063.stdout:9/957: creat d7/d20/d45/d46/d51/f13e x:0 0 0 2023-12-12T11:52:16.981 INFO:tasks.workunit.client.0.smithi063.stdout:9/958: dwrite d7/d11/d94/d112/f138 [0,4194304] 0 2023-12-12T11:52:16.989 INFO:tasks.workunit.client.0.smithi063.stdout:9/959: unlink d7/d20/daf/f131 0 2023-12-12T11:52:16.989 INFO:tasks.workunit.client.0.smithi063.stdout:9/960: chown d7/d15/f23 3529434 1 2023-12-12T11:52:16.992 INFO:tasks.workunit.client.0.smithi063.stdout:9/961: getdents d7/d20/d3f/d40/da7 0 2023-12-12T11:52:17.080 INFO:tasks.workunit.client.0.smithi063.stdout:9/962: mkdir d7/d8a/de6/d13f 0 2023-12-12T11:52:17.101 INFO:tasks.workunit.client.0.smithi063.stdout:7/940: sync 2023-12-12T11:52:17.101 INFO:tasks.workunit.client.0.smithi063.stdout:2/934: sync 2023-12-12T11:52:17.101 INFO:tasks.workunit.client.0.smithi063.stdout:2/935: fsync d0/fb3 0 2023-12-12T11:52:17.101 INFO:tasks.workunit.client.0.smithi063.stdout:2/936: chown d0/d1a/d48/c61 101 1 2023-12-12T11:52:17.102 INFO:tasks.workunit.client.0.smithi063.stdout:7/941: creat de/d39/d60/d80/f14c x:0 0 0 2023-12-12T11:52:17.102 INFO:tasks.workunit.client.0.smithi063.stdout:7/942: fdatasync de/d22/d6e/de4/d136/d68/d11a/d71/fd9 0 2023-12-12T11:52:17.130 INFO:tasks.workunit.client.0.smithi063.stdout:7/943: dread de/d22/d6e/de4/d136/d68/d11a/dd2/d61/f62 [0,4194304] 0 2023-12-12T11:52:17.183 INFO:tasks.workunit.client.0.smithi063.stdout:2/937: dwrite d0/d1a/d48/d56/da2/fb2 [0,4194304] 0 2023-12-12T11:52:17.183 INFO:tasks.workunit.client.0.smithi063.stdout:2/938: read - d0/d1a/d3a/d85/da6/f109 zero size 2023-12-12T11:52:17.184 INFO:tasks.workunit.client.0.smithi063.stdout:2/939: write d0/d1a/d3a/fb7 [173026,60542] 0 2023-12-12T11:52:17.196 INFO:tasks.workunit.client.0.smithi063.stdout:9/963: link d7/d20/feb d7/d15/dc4/dce/f140 0 2023-12-12T11:52:17.196 INFO:tasks.workunit.client.0.smithi063.stdout:9/964: fsync d7/d20/d45/d46/d51/d64/d6f/f117 0 2023-12-12T11:52:17.197 INFO:tasks.workunit.client.0.smithi063.stdout:7/944: rmdir de/d22/d6e/de4/d136/d68/da1 39 2023-12-12T11:52:17.199 INFO:tasks.workunit.client.0.smithi063.stdout:2/940: symlink d0/d69/l126 0 2023-12-12T11:52:17.199 INFO:tasks.workunit.client.0.smithi063.stdout:2/941: readlink d0/d69/l126 0 2023-12-12T11:52:17.201 INFO:tasks.workunit.client.0.smithi063.stdout:9/965: creat d7/d20/d45/d132/f141 x:0 0 0 2023-12-12T11:52:17.203 INFO:tasks.workunit.client.0.smithi063.stdout:7/945: truncate de/d39/d60/f95 1794601 0 2023-12-12T11:52:17.204 INFO:tasks.workunit.client.0.smithi063.stdout:9/966: write d7/ff [4549223,75020] 0 2023-12-12T11:52:17.206 INFO:tasks.workunit.client.0.smithi063.stdout:9/967: mknod d7/d11/d4b/d75/df8/c142 0 2023-12-12T11:52:17.207 INFO:tasks.workunit.client.0.smithi063.stdout:9/968: write d7/d11/d4b/d75/fcb [556153,127997] 0 2023-12-12T11:52:17.207 INFO:tasks.workunit.client.0.smithi063.stdout:9/969: chown d7/d8a/d120 1715826 1 2023-12-12T11:52:17.244 INFO:tasks.workunit.client.0.smithi063.stdout:9/970: dwrite d7/d11/d4b/d75/df8/f10f [0,4194304] 0 2023-12-12T11:52:17.244 INFO:tasks.workunit.client.0.smithi063.stdout:9/971: creat d7/d20/daf/f143 x:0 0 0 2023-12-12T11:52:17.248 INFO:tasks.workunit.client.0.smithi063.stdout:9/972: mknod d7/d11/c144 0 2023-12-12T11:52:17.256 INFO:tasks.workunit.client.0.smithi063.stdout:7/946: symlink de/d22/d6e/d8a/da3/l14d 0 2023-12-12T11:52:17.256 INFO:tasks.workunit.client.0.smithi063.stdout:7/947: truncate de/d22/d4d/f91 3642619 0 2023-12-12T11:52:17.256 INFO:tasks.workunit.client.0.smithi063.stdout:7/948: chown de/d22/d6e/d8a/da3/l53 0 1 2023-12-12T11:52:17.263 INFO:tasks.workunit.client.0.smithi063.stdout:7/949: rename de/d3f/dc3 to de/d22/d6e/de4/d136/d68/d14e 0 2023-12-12T11:52:17.265 INFO:tasks.workunit.client.0.smithi063.stdout:7/950: creat de/d22/d6e/de4/d136/d68/f14f x:0 0 0 2023-12-12T11:52:17.266 INFO:tasks.workunit.client.0.smithi063.stdout:7/951: write de/d22/d6e/de4/d136/d43/d45/f145 [942981,37320] 0 2023-12-12T11:52:17.266 INFO:tasks.workunit.client.0.smithi063.stdout:7/952: fsync de/d22/d6e/de4/d136/d68/d11a/fd4 0 2023-12-12T11:52:17.287 INFO:tasks.workunit.client.0.smithi063.stdout:9/973: dwrite d7/d15/d39/f82 [0,4194304] 0 2023-12-12T11:52:17.289 INFO:tasks.workunit.client.0.smithi063.stdout:9/974: creat d7/d11/d12/f145 x:0 0 0 2023-12-12T11:52:17.289 INFO:tasks.workunit.client.0.smithi063.stdout:9/975: write d7/d20/f29 [13575,95468] 0 2023-12-12T11:52:17.293 INFO:tasks.workunit.client.0.smithi063.stdout:9/976: mkdir d7/d20/d45/d132/d146 0 2023-12-12T11:52:17.293 INFO:tasks.workunit.client.0.smithi063.stdout:9/977: chown d7/d20/d45/fa5 1639 1 2023-12-12T11:52:17.293 INFO:tasks.workunit.client.0.smithi063.stdout:9/978: write d7/d11/fb5 [598825,79828] 0 2023-12-12T11:52:17.293 INFO:tasks.workunit.client.0.smithi063.stdout:9/979: readlink d7/d15/d39/l59 0 2023-12-12T11:52:17.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:17 smithi063 ceph-mon[107117]: Reconfiguring grafana.smithi063 (dependencies changed)... 2023-12-12T11:52:17.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:17 smithi063 ceph-mon[107117]: Reconfiguring daemon grafana.smithi063 on smithi063 2023-12-12T11:52:17.297 INFO:tasks.workunit.client.0.smithi063.stdout:9/980: mknod d7/d15/d39/c147 0 2023-12-12T11:52:17.297 INFO:tasks.workunit.client.0.smithi063.stdout:9/981: truncate d7/d15/dc4/dce/f140 5075220 0 2023-12-12T11:52:17.300 INFO:tasks.workunit.client.0.smithi063.stdout:9/982: unlink d7/d20/d3f/d40/l103 0 2023-12-12T11:52:17.302 INFO:tasks.workunit.client.0.smithi063.stdout:9/983: rename d7/d15/d39/f119 to d7/d20/d45/d46/d51/dcd/f148 0 2023-12-12T11:52:17.305 INFO:tasks.workunit.client.0.smithi063.stdout:9/984: mkdir d7/d15/dc4/d3e/d55/d116/d149 0 2023-12-12T11:52:17.305 INFO:tasks.workunit.client.0.smithi063.stdout:9/985: read - d7/d15/dc4/d3e/f5b zero size 2023-12-12T11:52:17.306 INFO:tasks.workunit.client.0.smithi063.stdout:9/986: symlink d7/d15/dc4/d3e/d55/l14a 0 2023-12-12T11:52:17.307 INFO:tasks.workunit.client.0.smithi063.stdout:9/987: write d7/d15/dc4/dce/f140 [4404332,79916] 0 2023-12-12T11:52:17.309 INFO:tasks.workunit.client.0.smithi063.stdout:9/988: creat d7/d20/d45/d46/d51/dcd/f14b x:0 0 0 2023-12-12T11:52:17.312 INFO:tasks.workunit.client.0.smithi063.stdout:7/953: dwrite fb [0,4194304] 0 2023-12-12T11:52:17.319 INFO:tasks.workunit.client.0.smithi063.stdout:7/954: creat de/d22/d6e/de4/d136/d68/d14e/f150 x:0 0 0 2023-12-12T11:52:17.319 INFO:tasks.workunit.client.0.smithi063.stdout:7/955: write de/d22/d6e/de4/d136/d68/d14e/f150 [712585,33739] 0 2023-12-12T11:52:17.369 INFO:tasks.workunit.client.0.smithi063.stdout:9/989: dwrite d7/d20/d3f/d40/d76/f9d [0,4194304] 0 2023-12-12T11:52:17.371 INFO:tasks.workunit.client.0.smithi063.stdout:9/990: symlink d7/d20/d45/d46/d51/d64/d6f/l14c 0 2023-12-12T11:52:17.380 INFO:tasks.workunit.client.0.smithi063.stdout:7/956: dwrite de/d22/d6e/de4/d136/d68/d11a/fd4 [0,4194304] 0 2023-12-12T11:52:17.380 INFO:tasks.workunit.client.0.smithi063.stdout:7/957: write de/d39/fe5 [1814178,71511] 0 2023-12-12T11:52:17.397 INFO:tasks.workunit.client.0.smithi063.stdout:7/958: dread de/f1e [0,4194304] 0 2023-12-12T11:52:17.399 INFO:tasks.workunit.client.0.smithi063.stdout:7/959: link de/d22/d4d/l12a de/d39/d60/d80/d146/l151 0 2023-12-12T11:52:17.403 INFO:tasks.workunit.client.0.smithi063.stdout:9/991: dwrite d7/ff [4194304,4194304] 0 2023-12-12T11:52:17.405 INFO:tasks.workunit.client.0.smithi063.stdout:9/992: rename d7/d15/dc4/d3e/de7 to d7/d20/d3f/d14d 0 2023-12-12T11:52:17.414 INFO:tasks.workunit.client.0.smithi063.stdout:7/960: dread de/d22/d6e/de4/d136/d68/d11a/d41/f7c [4194304,4194304] 0 2023-12-12T11:52:17.416 INFO:tasks.workunit.client.0.smithi063.stdout:7/961: unlink de/d22/d6e/de4/d136/d68/d11a/dd2/d61/f62 0 2023-12-12T11:52:17.456 INFO:tasks.workunit.client.0.smithi063.stdout:9/993: dwrite d7/d20/d3f/d40/d4e/f6b [0,4194304] 0 2023-12-12T11:52:17.456 INFO:tasks.workunit.client.0.smithi063.stdout:9/994: write d7/d20/d45/d46/d51/d64/d6f/f117 [490102,88978] 0 2023-12-12T11:52:17.456 INFO:tasks.workunit.client.0.smithi063.stdout:9/995: fsync d7/d15/dc4/d3e/d55/f113 0 2023-12-12T11:52:17.458 INFO:tasks.workunit.client.0.smithi063.stdout:7/962: dwrite de/d39/d60/d80/d146/f8d [4194304,4194304] 0 2023-12-12T11:52:17.463 INFO:tasks.workunit.client.0.smithi063.stdout:9/996: dread d7/d20/d3f/d40/fc0 [0,4194304] 0 2023-12-12T11:52:17.463 INFO:tasks.workunit.client.0.smithi063.stdout:9/997: truncate d7/d20/d3f/d40/d76/f11f 897592 0 2023-12-12T11:52:17.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:17 smithi093 ceph-mon[115914]: Reconfiguring grafana.smithi063 (dependencies changed)... 2023-12-12T11:52:17.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:17 smithi093 ceph-mon[115914]: Reconfiguring daemon grafana.smithi063 on smithi063 2023-12-12T11:52:17.475 INFO:tasks.workunit.client.0.smithi063.stdout:7/963: dread de/d39/d88/db4/f147 [0,4194304] 0 2023-12-12T11:52:17.498 INFO:tasks.workunit.client.0.smithi063.stdout:7/964: getdents de/d39/d4b/d7b 0 2023-12-12T11:52:17.500 INFO:tasks.workunit.client.0.smithi063.stdout:9/998: getdents d7/d8a/de6 0 2023-12-12T11:52:17.504 INFO:tasks.workunit.client.0.smithi063.stdout:7/965: unlink de/d39/d4b/d7b/l106 0 2023-12-12T11:52:17.504 INFO:tasks.workunit.client.0.smithi063.stdout:7/966: creat de/d22/d6e/dc4/f152 x:0 0 0 2023-12-12T11:52:17.504 INFO:tasks.workunit.client.0.smithi063.stdout:7/967: dread - de/d22/faa zero size 2023-12-12T11:52:17.505 INFO:tasks.workunit.client.0.smithi063.stdout:9/999: rename d7/d20/d45/d46/d51/d64/d6f/c118 to d7/d11/d4b/d75/c14e 0 2023-12-12T11:52:17.507 INFO:tasks.workunit.client.0.smithi063.stdout:7/968: link de/d22/d4d/lc9 de/d22/d6e/de4/d136/d68/d11a/d41/d44/d8b/d128/l153 0 2023-12-12T11:52:17.510 INFO:tasks.workunit.client.0.smithi063.stdout:7/969: rename de/d22/d6e/de4/d136/d68/d11a/dd2/lbc to de/d39/d4b/d7b/l154 0 2023-12-12T11:52:17.511 INFO:tasks.workunit.client.0.smithi063.stdout:7/970: unlink de/d39/d60/da4/fb7 0 2023-12-12T11:52:17.513 INFO:tasks.workunit.client.0.smithi063.stdout:7/971: unlink de/d22/d6e/d8a/de3/c142 0 2023-12-12T11:52:17.521 INFO:tasks.workunit.client.0.smithi063.stdout:7/972: dread de/d39/d60/d80/d146/f8e [0,4194304] 0 2023-12-12T11:52:17.523 INFO:tasks.workunit.client.0.smithi063.stdout:7/973: mkdir de/d22/d6e/dc4/d155 0 2023-12-12T11:52:17.526 INFO:tasks.workunit.client.0.smithi063.stdout:7/974: mkdir de/d39/d60/d156 0 2023-12-12T11:52:17.529 INFO:tasks.workunit.client.0.smithi063.stdout:7/975: rmdir de/d22/d6e/de4/d136/d68/d11a/d41/d44/d8b/dde/d134 0 2023-12-12T11:52:17.543 INFO:tasks.workunit.client.0.smithi063.stdout:2/942: sync 2023-12-12T11:52:17.546 INFO:tasks.workunit.client.0.smithi063.stdout:2/943: rename d0/d1a/dba to d0/d1a/d26/d127 0 2023-12-12T11:52:17.578 INFO:tasks.workunit.client.0.smithi063.stdout:7/976: dwrite de/d22/d6e/de4/d136/d68/d122/f12b [0,4194304] 0 2023-12-12T11:52:17.585 INFO:tasks.workunit.client.0.smithi063.stdout:7/977: unlink de/d22/d6e/d8a/cc1 0 2023-12-12T11:52:17.586 INFO:tasks.workunit.client.0.smithi063.stdout:7/978: mkdir de/d22/d6e/de4/d136/d68/d11a/d41/d44/d8b/d157 0 2023-12-12T11:52:17.591 INFO:tasks.workunit.client.0.smithi063.stdout:2/944: dwrite d0/d1a/fec [0,4194304] 0 2023-12-12T11:52:17.603 INFO:tasks.workunit.client.0.smithi063.stdout:7/979: dread de/d22/d6e/de4/d136/d43/d45/f7d [0,4194304] 0 2023-12-12T11:52:17.605 INFO:tasks.workunit.client.0.smithi063.stdout:7/980: rmdir de/d22/d6e/de4/d136 39 2023-12-12T11:52:17.611 INFO:tasks.workunit.client.0.smithi063.stdout:7/981: dread de/d22/d6e/de4/d136/d68/d14e/f150 [0,4194304] 0 2023-12-12T11:52:17.642 INFO:tasks.workunit.client.0.smithi063.stdout:2/945: dwrite d0/d1a/d1e/d64/f68 [4194304,4194304] 0 2023-12-12T11:52:17.642 INFO:tasks.workunit.client.0.smithi063.stdout:2/946: readlink d0/d1a/d26/l53 0 2023-12-12T11:52:17.655 INFO:tasks.workunit.client.0.smithi063.stdout:2/947: dread d0/d1a/d26/f37 [0,4194304] 0 2023-12-12T11:52:17.702 INFO:tasks.workunit.client.0.smithi063.stdout:2/948: dwrite d0/d1a/d57/fc2 [0,4194304] 0 2023-12-12T11:52:17.716 INFO:tasks.workunit.client.0.smithi063.stdout:2/949: dread d0/d1a/d3a/d85/da6/dd8/d107/fef [0,4194304] 0 2023-12-12T11:52:17.718 INFO:tasks.workunit.client.0.smithi063.stdout:2/950: truncate d0/d1a/d1e/f70 235840 0 2023-12-12T11:52:17.720 INFO:tasks.workunit.client.0.smithi063.stdout:2/951: creat d0/d1a/d57/f128 x:0 0 0 2023-12-12T11:52:17.720 INFO:tasks.workunit.client.0.smithi063.stdout:2/952: write d0/d1a/d3a/fb7 [1057992,121291] 0 2023-12-12T11:52:17.720 INFO:tasks.workunit.client.0.smithi063.stdout:2/953: chown d0/d1a/d57/ddc/df2/ffb 1248834 1 2023-12-12T11:52:17.732 INFO:tasks.workunit.client.0.smithi063.stdout:2/954: dread d0/d69/f9d [0,4194304] 0 2023-12-12T11:52:17.732 INFO:tasks.workunit.client.0.smithi063.stdout:2/955: write d0/d1a/d48/d56/f11f [948940,69125] 0 2023-12-12T11:52:17.926 INFO:tasks.workunit.client.0.smithi063.stdout:2/956: sync 2023-12-12T11:52:17.927 INFO:tasks.workunit.client.0.smithi063.stdout:7/982: sync 2023-12-12T11:52:17.927 INFO:tasks.workunit.client.0.smithi063.stdout:2/957: mkdir d0/d1a/d48/d56/d77/d129 0 2023-12-12T11:52:17.930 INFO:tasks.workunit.client.0.smithi063.stdout:2/958: mkdir d0/d1a/d3a/d59/ddb/d12a 0 2023-12-12T11:52:17.937 INFO:tasks.workunit.client.0.smithi063.stdout:2/959: mkdir d0/d1a/d48/d12b 0 2023-12-12T11:52:17.937 INFO:tasks.workunit.client.0.smithi063.stdout:2/960: chown d0/d1a/d3a/d85/da6 1808 1 2023-12-12T11:52:17.941 INFO:tasks.workunit.client.0.smithi063.stdout:2/961: unlink d0/d1a/d26/fae 0 2023-12-12T11:52:17.944 INFO:tasks.workunit.client.0.smithi063.stdout:2/962: unlink d0/d1a/d3a/f9f 0 2023-12-12T11:52:17.944 INFO:tasks.workunit.client.0.smithi063.stdout:2/963: fsync d0/d69/f8a 0 2023-12-12T11:52:17.949 INFO:tasks.workunit.client.0.smithi063.stdout:2/964: rmdir d0/d1a/d3a/d59 39 2023-12-12T11:52:17.958 INFO:tasks.workunit.client.0.smithi063.stdout:7/983: dwrite de/d22/d6e/de4/d136/d43/f143 [0,4194304] 0 2023-12-12T11:52:17.972 INFO:tasks.workunit.client.0.smithi063.stdout:7/984: unlink de/d22/d4d/f119 0 2023-12-12T11:52:17.979 INFO:tasks.workunit.client.0.smithi063.stdout:7/985: write de/d22/d6e/de4/d136/d68/d11a/dd2/fe2 [1371602,75665] 0 2023-12-12T11:52:17.982 INFO:tasks.workunit.client.0.smithi063.stdout:7/986: link de/d22/d6e/de4/d136/d68/d11a/dd2/f2d de/d39/d60/d10c/f158 0 2023-12-12T11:52:17.982 INFO:tasks.workunit.client.0.smithi063.stdout:7/987: stat de/d39 0 2023-12-12T11:52:17.987 INFO:tasks.workunit.client.0.smithi063.stdout:7/988: mkdir de/d22/d6e/de4/d136/d68/d11a/d41/d44/d8b/d128/d159 0 2023-12-12T11:52:17.988 INFO:tasks.workunit.client.0.smithi063.stdout:7/989: creat de/d22/d6e/da2/f15a x:0 0 0 2023-12-12T11:52:17.989 INFO:tasks.workunit.client.0.smithi063.stdout:7/990: mkdir de/d22/d6e/d8a/d15b 0 2023-12-12T11:52:17.992 INFO:tasks.workunit.client.0.smithi063.stdout:7/991: unlink de/d22/d6e/de4/d136/d43/d45/f145 0 2023-12-12T11:52:18.042 INFO:tasks.workunit.client.0.smithi063.stdout:2/965: dwrite d0/f43 [0,4194304] 0 2023-12-12T11:52:18.042 INFO:tasks.workunit.client.0.smithi063.stdout:2/966: stat d0/d1a/d3a/d85/da6/ff0 0 2023-12-12T11:52:18.042 INFO:tasks.workunit.client.0.smithi063.stdout:7/992: dwrite de/d22/d6e/de4/d136/d68/d11a/fd4 [0,4194304] 0 2023-12-12T11:52:18.046 INFO:tasks.workunit.client.0.smithi063.stdout:2/967: unlink d0/d1a/d3a/d85/da6/ff0 0 2023-12-12T11:52:18.048 INFO:tasks.workunit.client.0.smithi063.stdout:7/993: truncate de/f1d 2379194 0 2023-12-12T11:52:18.055 INFO:tasks.workunit.client.0.smithi063.stdout:7/994: link de/d3f/f72 de/d39/d60/d80/d146/f15c 0 2023-12-12T11:52:18.061 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:18 smithi063 ceph-mon[107117]: pgmap v23: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 134 MiB/s rd, 154 MiB/s wr, 257 op/s 2023-12-12T11:52:18.063 INFO:tasks.workunit.client.0.smithi063.stdout:2/968: dread d0/f43 [0,4194304] 0 2023-12-12T11:52:18.065 INFO:tasks.workunit.client.0.smithi063.stdout:2/969: creat d0/d41/f12c x:0 0 0 2023-12-12T11:52:18.070 INFO:tasks.workunit.client.0.smithi063.stdout:7/995: write de/d22/d6e/de4/d136/d68/d11a/d41/d44/d8b/dde/daf/fd0 [280967,98941] 0 2023-12-12T11:52:18.078 INFO:tasks.workunit.client.0.smithi063.stdout:7/996: link de/d39/d60/da4/cac de/d22/d6e/de4/d136/d68/d11a/d41/d44/d8b/dde/de6/c15d 0 2023-12-12T11:52:18.080 INFO:tasks.workunit.client.0.smithi063.stdout:2/970: rename d0/d1a/d3a to d0/d1a/d26/d12d 0 2023-12-12T11:52:18.080 INFO:tasks.workunit.client.0.smithi063.stdout:2/971: stat d0/d1a/d57/ddc 0 2023-12-12T11:52:18.080 INFO:tasks.workunit.client.0.smithi063.stdout:7/997: truncate de/f28 4101632 0 2023-12-12T11:52:18.082 INFO:tasks.workunit.client.0.smithi063.stdout:2/972: mknod d0/d1a/d48/d56/d77/d129/c12e 0 2023-12-12T11:52:18.085 INFO:tasks.workunit.client.0.smithi063.stdout:2/973: mkdir d0/d1a/d48/d56/d120/d12f 0 2023-12-12T11:52:18.088 INFO:tasks.workunit.client.0.smithi063.stdout:2/974: rmdir d0/d1a/d48/d12b 0 2023-12-12T11:52:18.088 INFO:tasks.workunit.client.0.smithi063.stdout:2/975: chown d0/d1a/d26/d12d/d59/f78 3016 1 2023-12-12T11:52:18.088 INFO:tasks.workunit.client.0.smithi063.stdout:2/976: stat d0/d1a/d48/d56/d120 0 2023-12-12T11:52:18.089 INFO:tasks.workunit.client.0.smithi063.stdout:2/977: write d0/d1a/d57/f6d [1369050,130069] 0 2023-12-12T11:52:18.090 INFO:tasks.workunit.client.0.smithi063.stdout:7/998: rmdir de/d22/d6e/de4/d136/d68/d11a/d41/d44/d8b/dde/df8 0 2023-12-12T11:52:18.090 INFO:tasks.workunit.client.0.smithi063.stdout:7/999: write de/d39/d60/f141 [728906,28118] 0 2023-12-12T11:52:18.092 INFO:tasks.workunit.client.0.smithi063.stdout:2/978: creat d0/d1a/d26/d12d/d59/ddb/ded/d116/f130 x:0 0 0 2023-12-12T11:52:18.093 INFO:tasks.workunit.client.0.smithi063.stdout:2/979: chown d0/d1a/d57/ddc 1 1 2023-12-12T11:52:18.125 INFO:tasks.workunit.client.0.smithi063.stdout:2/980: dwrite d0/d1a/d26/d12d/d85/da6/fde [0,4194304] 0 2023-12-12T11:52:18.162 INFO:tasks.workunit.client.0.smithi063.stdout:2/981: dwrite d0/d1a/fb8 [0,4194304] 0 2023-12-12T11:52:18.164 INFO:tasks.workunit.client.0.smithi063.stdout:2/982: rename d0/d1a/fec to d0/d1a/d57/f131 0 2023-12-12T11:52:18.164 INFO:tasks.workunit.client.0.smithi063.stdout:2/983: truncate d0/d41/fe2 919919 0 2023-12-12T11:52:18.167 INFO:tasks.workunit.client.0.smithi063.stdout:2/984: creat d0/d1a/d26/d11b/f132 x:0 0 0 2023-12-12T11:52:18.219 INFO:tasks.workunit.client.0.smithi063.stdout:2/985: dwrite d0/d1a/d26/d12d/d85/fad [0,4194304] 0 2023-12-12T11:52:18.219 INFO:tasks.workunit.client.0.smithi063.stdout:2/986: truncate d0/d1a/d48/d56/f11f 1160386 0 2023-12-12T11:52:18.225 INFO:tasks.workunit.client.0.smithi063.stdout:2/987: creat d0/d1a/d1e/d64/dc7/d112/f133 x:0 0 0 2023-12-12T11:52:18.228 INFO:tasks.workunit.client.0.smithi063.stdout:2/988: rename d0/c51 to d0/d1a/d1e/d64/dc7/d112/c134 0 2023-12-12T11:52:18.228 INFO:tasks.workunit.client.0.smithi063.stdout:2/989: dread - d0/d1a/d48/d56/fcf zero size 2023-12-12T11:52:18.228 INFO:tasks.workunit.client.0.smithi063.stdout:2/990: write d0/f4 [1630315,11938] 0 2023-12-12T11:52:18.229 INFO:tasks.workunit.client.0.smithi063.stdout:2/991: mkdir d0/d1a/d57/ddc/df2/df4/d10b/d135 0 2023-12-12T11:52:18.244 INFO:tasks.workunit.client.0.smithi063.stdout:2/992: dread d0/d1a/d57/ddc/df2/df4/ffa [0,4194304] 0 2023-12-12T11:52:18.244 INFO:tasks.workunit.client.0.smithi063.stdout:2/993: stat d0/d1a/d26/d127/f119 0 2023-12-12T11:52:18.257 INFO:tasks.workunit.client.0.smithi063.stdout:2/994: dread d0/d1a/d1e/d64/fbc [0,4194304] 0 2023-12-12T11:52:18.257 INFO:tasks.workunit.client.0.smithi063.stdout:2/995: rmdir d0/d1a/d26/d12d/d85/da6/deb 39 2023-12-12T11:52:18.294 INFO:tasks.workunit.client.0.smithi063.stdout:2/996: dwrite d0/d1a/d1e/d64/f124 [0,4194304] 0 2023-12-12T11:52:18.296 INFO:tasks.workunit.client.0.smithi063.stdout:2/997: mknod d0/d1a/d26/d12d/d85/c136 0 2023-12-12T11:52:18.337 INFO:tasks.workunit.client.0.smithi063.stdout:2/998: dwrite d0/f4c [0,4194304] 0 2023-12-12T11:52:18.337 INFO:tasks.workunit.client.0.smithi063.stdout:2/999: fdatasync d0/d1a/d1e/fe7 0 2023-12-12T11:52:18.345 INFO:tasks.workunit.client.0.smithi063.stderr:+ rm -rf -- ./tmp.Dod4sLe1dI 2023-12-12T11:52:18.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:18 smithi093 ceph-mon[115914]: pgmap v23: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 134 MiB/s rd, 154 MiB/s wr, 257 op/s 2023-12-12T11:52:20.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:20 smithi063 ceph-mon[107117]: pgmap v24: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 167 MiB/s rd, 198 MiB/s wr, 354 op/s 2023-12-12T11:52:20.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:20 smithi093 ceph-mon[115914]: pgmap v24: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 167 MiB/s rd, 198 MiB/s wr, 354 op/s 2023-12-12T11:52:21.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:21 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:21.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:21 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:21.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:21 smithi063 ceph-mon[107117]: Reconfiguring prometheus.smithi063 (dependencies changed)... 2023-12-12T11:52:21.720 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:21 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:21.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:21 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:21.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:21 smithi093 ceph-mon[115914]: Reconfiguring prometheus.smithi063 (dependencies changed)... 2023-12-12T11:52:22.368 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:22 smithi063 ceph-mon[107117]: Reconfiguring daemon prometheus.smithi063 on smithi063 2023-12-12T11:52:22.368 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:22 smithi063 ceph-mon[107117]: pgmap v25: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 86 MiB/s rd, 113 MiB/s wr, 218 op/s 2023-12-12T11:52:22.368 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:22 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:52:22.720 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:22 smithi093 ceph-mon[115914]: Reconfiguring daemon prometheus.smithi063 on smithi063 2023-12-12T11:52:22.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:22 smithi093 ceph-mon[115914]: pgmap v25: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 86 MiB/s rd, 113 MiB/s wr, 218 op/s 2023-12-12T11:52:22.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:22 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:52:24.539 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:24 smithi063 ceph-mon[107117]: pgmap v26: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 86 MiB/s rd, 113 MiB/s wr, 219 op/s 2023-12-12T11:52:24.720 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:24 smithi093 ceph-mon[115914]: pgmap v26: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 86 MiB/s rd, 113 MiB/s wr, 219 op/s 2023-12-12T11:52:25.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:25 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:25.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:25 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:25.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:25 smithi093 ceph-mon[115914]: Reconfiguring node-exporter.smithi093 (dependencies changed)... 2023-12-12T11:52:25.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:25 smithi093 ceph-mon[115914]: Reconfiguring daemon node-exporter.smithi093 on smithi093 2023-12-12T11:52:25.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:25 smithi093 ceph-mon[115914]: pgmap v27: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 83 MiB/s rd, 109 MiB/s wr, 286 op/s 2023-12-12T11:52:26.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:25 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:26.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:25 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:26.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:25 smithi063 ceph-mon[107117]: Reconfiguring node-exporter.smithi093 (dependencies changed)... 2023-12-12T11:52:26.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:25 smithi063 ceph-mon[107117]: Reconfiguring daemon node-exporter.smithi093 on smithi093 2023-12-12T11:52:26.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:25 smithi063 ceph-mon[107117]: pgmap v27: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 83 MiB/s rd, 109 MiB/s wr, 286 op/s 2023-12-12T11:52:28.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:27 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:28.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:27 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:28.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:27 smithi063 ceph-mon[107117]: pgmap v28: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 34 MiB/s rd, 47 MiB/s wr, 170 op/s 2023-12-12T11:52:28.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:27 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-12T11:52:28.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:27 smithi063 ceph-mon[107117]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-12T11:52:28.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:27 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-12T11:52:28.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:27 smithi063 ceph-mon[107117]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-12T11:52:28.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:27 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-12T11:52:28.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:27 smithi063 ceph-mon[107117]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-12T11:52:28.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:27 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:52:28.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:27 smithi063 ceph-mon[107117]: Upgrade: Need to upgrade myself (mgr.smithi093.nbtltu) 2023-12-12T11:52:28.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:27 smithi063 ceph-mon[107117]: Upgrade: Need to upgrade myself (mgr.smithi093.nbtltu) 2023-12-12T11:52:28.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:27 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:28.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:27 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:28.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:27 smithi093 ceph-mon[115914]: pgmap v28: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 34 MiB/s rd, 47 MiB/s wr, 170 op/s 2023-12-12T11:52:28.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:27 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-12T11:52:28.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:27 smithi093 ceph-mon[115914]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-12T11:52:28.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:27 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-12T11:52:28.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:27 smithi093 ceph-mon[115914]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-12T11:52:28.223 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:27 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-12T11:52:28.223 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:27 smithi093 ceph-mon[115914]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-12T11:52:28.223 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:27 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:52:28.223 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:27 smithi093 ceph-mon[115914]: Upgrade: Need to upgrade myself (mgr.smithi093.nbtltu) 2023-12-12T11:52:28.223 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:27 smithi093 ceph-mon[115914]: Upgrade: Need to upgrade myself (mgr.smithi093.nbtltu) 2023-12-12T11:52:29.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:29 smithi063 ceph-mon[107117]: Upgrade: Updating mgr.smithi063.zjnfdi 2023-12-12T11:52:29.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:29 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:29.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:29 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi063.zjnfdi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-12T11:52:29.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:29 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-12T11:52:29.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:29 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:52:29.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:29 smithi063 ceph-mon[107117]: Deploying daemon mgr.smithi063.zjnfdi on smithi063 2023-12-12T11:52:29.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:29 smithi063 ceph-mon[107117]: pgmap v29: 65 pgs: 65 active+clean; 1.9 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 34 MiB/s rd, 47 MiB/s wr, 245 op/s 2023-12-12T11:52:29.841 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-12T11:52:29.842 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2023-12-12T11:52:29.909 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:29 smithi093 ceph-mon[115914]: Upgrade: Updating mgr.smithi063.zjnfdi 2023-12-12T11:52:29.910 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:29 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:29.910 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:29 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi063.zjnfdi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-12T11:52:29.910 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:29 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-12T11:52:29.910 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:29 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:52:29.910 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:29 smithi093 ceph-mon[115914]: Deploying daemon mgr.smithi063.zjnfdi on smithi063 2023-12-12T11:52:29.910 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:29 smithi093 ceph-mon[115914]: pgmap v29: 65 pgs: 65 active+clean; 1.9 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 34 MiB/s rd, 47 MiB/s wr, 245 op/s 2023-12-12T11:52:32.233 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:31 smithi063 ceph-mon[107117]: pgmap v30: 65 pgs: 65 active+clean; 1.9 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.8 MiB/s wr, 148 op/s 2023-12-12T11:52:32.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:31 smithi093 ceph-mon[115914]: pgmap v30: 65 pgs: 65 active+clean; 1.9 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.8 MiB/s wr, 148 op/s 2023-12-12T11:52:33.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:33 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:33.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:33 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:33.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:33 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:52:33.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:33 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:33.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:33 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:33.798 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:33 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:52:34.501 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:34 smithi063 ceph-mon[107117]: pgmap v31: 65 pgs: 65 active+clean; 1.8 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.8 MiB/s wr, 150 op/s 2023-12-12T11:52:34.720 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:34 smithi093 ceph-mon[115914]: pgmap v31: 65 pgs: 65 active+clean; 1.8 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.8 MiB/s wr, 150 op/s 2023-12-12T11:52:36.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:36 smithi093 ceph-mon[115914]: pgmap v32: 65 pgs: 65 active+clean; 909 MiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 1.4 MiB/s rd, 4.3 MiB/s wr, 197 op/s 2023-12-12T11:52:36.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:36 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:36.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:36 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:36.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:36 smithi063 ceph-mon[107117]: pgmap v32: 65 pgs: 65 active+clean; 909 MiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 1.4 MiB/s rd, 4.3 MiB/s wr, 197 op/s 2023-12-12T11:52:36.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:36 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:36.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:36 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:36.976 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.973+0000 7fc123444700 1 -- 172.21.15.63:0/2145740643 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc11c070570 msgr2=0x7fc11c0709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:36.976 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.973+0000 7fc123444700 1 --2- 172.21.15.63:0/2145740643 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc11c070570 0x7fc11c0709c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc10c004940 tx=0x7fc10c009e30 comp rx=0 tx=0).stop 2023-12-12T11:52:36.976 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.973+0000 7fc123444700 1 -- 172.21.15.63:0/2145740643 shutdown_connections 2023-12-12T11:52:36.976 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.973+0000 7fc123444700 1 --2- 172.21.15.63:0/2145740643 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc11c070570 0x7fc11c0709c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:36.976 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.973+0000 7fc123444700 1 --2- 172.21.15.63:0/2145740643 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc11c071bc0 0x7fc11c070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:36.976 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.973+0000 7fc123444700 1 -- 172.21.15.63:0/2145740643 >> 172.21.15.63:0/2145740643 conn(0x7fc11c0f82d0 msgr2=0x7fc11c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:52:36.976 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.974+0000 7fc123444700 1 -- 172.21.15.63:0/2145740643 shutdown_connections 2023-12-12T11:52:36.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.974+0000 7fc123444700 1 -- 172.21.15.63:0/2145740643 wait complete. 2023-12-12T11:52:36.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.975+0000 7fc123444700 1 Processor -- start 2023-12-12T11:52:36.979 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.975+0000 7fc123444700 1 -- start start 2023-12-12T11:52:36.979 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.976+0000 7fc123444700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc11c070570 0x7fc11c113b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:36.979 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.976+0000 7fc123444700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc11c071bc0 0x7fc11c1140b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:36.979 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.976+0000 7fc123444700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c114740 con 0x7fc11c071bc0 2023-12-12T11:52:36.979 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.976+0000 7fc123444700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c114f80 con 0x7fc11c070570 2023-12-12T11:52:36.979 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.976+0000 7fc1209df700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc11c071bc0 0x7fc11c1140b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:36.979 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.976+0000 7fc1211e0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc11c070570 0x7fc11c113b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:36.979 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.976+0000 7fc1211e0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc11c070570 0x7fc11c113b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:38984/0 (socket says 172.21.15.63:38984) 2023-12-12T11:52:36.979 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.976+0000 7fc1211e0700 1 -- 172.21.15.63:0/1313734974 learned_addr learned my addr 172.21.15.63:0/1313734974 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:52:36.980 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.977+0000 7fc1209df700 1 -- 172.21.15.63:0/1313734974 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc11c070570 msgr2=0x7fc11c113b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:36.980 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.977+0000 7fc1209df700 1 --2- 172.21.15.63:0/1313734974 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc11c070570 0x7fc11c113b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:36.980 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.977+0000 7fc1209df700 1 -- 172.21.15.63:0/1313734974 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10c005040 con 0x7fc11c071bc0 2023-12-12T11:52:36.980 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.977+0000 7fc1209df700 1 --2- 172.21.15.63:0/1313734974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc11c071bc0 0x7fc11c1140b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc10c000c00 tx=0x7fc10c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:52:36.980 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.978+0000 7fc111ffb700 1 -- 172.21.15.63:0/1313734974 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc10c00e040 con 0x7fc11c071bc0 2023-12-12T11:52:36.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.978+0000 7fc111ffb700 1 -- 172.21.15.63:0/1313734974 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc10c004290 con 0x7fc11c071bc0 2023-12-12T11:52:36.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.978+0000 7fc111ffb700 1 -- 172.21.15.63:0/1313734974 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc10c01c3f0 con 0x7fc11c071bc0 2023-12-12T11:52:36.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.978+0000 7fc123444700 1 -- 172.21.15.63:0/1313734974 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc11c115200 con 0x7fc11c071bc0 2023-12-12T11:52:36.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.978+0000 7fc123444700 1 -- 172.21.15.63:0/1313734974 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc11c115740 con 0x7fc11c071bc0 2023-12-12T11:52:36.982 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.980+0000 7fc123444700 1 -- 172.21.15.63:0/1313734974 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc11c04bb80 con 0x7fc11c071bc0 2023-12-12T11:52:36.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.983+0000 7fc111ffb700 1 -- 172.21.15.63:0/1313734974 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 24) v1 ==== 88724+0+0 (secure 0 0 0) 0x7fc10c00bc50 con 0x7fc11c071bc0 2023-12-12T11:52:36.986 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.984+0000 7fc111ffb700 1 --2- 172.21.15.63:0/1313734974 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7fc10806ae40 0x7fc10806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:36.987 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.984+0000 7fc111ffb700 1 -- 172.21.15.63:0/1313734974 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fc10c08b6b0 con 0x7fc11c071bc0 2023-12-12T11:52:36.987 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.985+0000 7fc1211e0700 1 --2- 172.21.15.63:0/1313734974 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7fc10806ae40 0x7fc10806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:36.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.986+0000 7fc1211e0700 1 --2- 172.21.15.63:0/1313734974 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7fc10806ae40 0x7fc10806d2f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc118009b30 tx=0x7fc118008040 comp rx=0 tx=0).ready entity=mgr.24471 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:52:36.993 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:36.989+0000 7fc111ffb700 1 -- 172.21.15.63:0/1313734974 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fc10c059460 con 0x7fc11c071bc0 2023-12-12T11:52:37.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.365+0000 7fc123444700 1 -- 172.21.15.63:0/1313734974 --> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc11c115c60 con 0x7fc10806ae40 2023-12-12T11:52:37.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.366+0000 7fc111ffb700 1 -- 172.21.15.63:0/1313734974 <== mgr.24471 v2:172.21.15.93:6828/3441331233 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7fc11c115c60 con 0x7fc10806ae40 2023-12-12T11:52:37.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.371+0000 7fc123444700 1 -- 172.21.15.63:0/1313734974 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7fc10806ae40 msgr2=0x7fc10806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:37.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.371+0000 7fc123444700 1 --2- 172.21.15.63:0/1313734974 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7fc10806ae40 0x7fc10806d2f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc118009b30 tx=0x7fc118008040 comp rx=0 tx=0).stop 2023-12-12T11:52:37.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.371+0000 7fc123444700 1 -- 172.21.15.63:0/1313734974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc11c071bc0 msgr2=0x7fc11c1140b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:37.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.371+0000 7fc123444700 1 --2- 172.21.15.63:0/1313734974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc11c071bc0 0x7fc11c1140b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc10c000c00 tx=0x7fc10c009e30 comp rx=0 tx=0).stop 2023-12-12T11:52:37.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.371+0000 7fc123444700 1 -- 172.21.15.63:0/1313734974 shutdown_connections 2023-12-12T11:52:37.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.371+0000 7fc123444700 1 --2- 172.21.15.63:0/1313734974 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7fc10806ae40 0x7fc10806d2f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:37.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.371+0000 7fc123444700 1 --2- 172.21.15.63:0/1313734974 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc11c070570 0x7fc11c113b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:37.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.371+0000 7fc123444700 1 --2- 172.21.15.63:0/1313734974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc11c071bc0 0x7fc11c1140b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:37.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.371+0000 7fc123444700 1 -- 172.21.15.63:0/1313734974 >> 172.21.15.63:0/1313734974 conn(0x7fc11c0f82d0 msgr2=0x7fc11c0fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:52:37.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.372+0000 7fc123444700 1 -- 172.21.15.63:0/1313734974 shutdown_connections 2023-12-12T11:52:37.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.372+0000 7fc123444700 1 -- 172.21.15.63:0/1313734974 wait complete. 2023-12-12T11:52:37.404 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-12T11:52:37.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.618+0000 7fdb0f9c9700 1 -- 172.21.15.63:0/3208169023 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdb080fde00 msgr2=0x7fdb080fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:37.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.618+0000 7fdb0f9c9700 1 --2- 172.21.15.63:0/3208169023 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdb080fde00 0x7fdb080fe250 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdb04004940 tx=0x7fdb04009e30 comp rx=0 tx=0).stop 2023-12-12T11:52:37.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.618+0000 7fdb0f9c9700 1 -- 172.21.15.63:0/3208169023 shutdown_connections 2023-12-12T11:52:37.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.618+0000 7fdb0f9c9700 1 --2- 172.21.15.63:0/3208169023 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdb080fde00 0x7fdb080fe250 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:37.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.618+0000 7fdb0f9c9700 1 --2- 172.21.15.63:0/3208169023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb080fcbf0 0x7fdb080fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:37.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.618+0000 7fdb0f9c9700 1 -- 172.21.15.63:0/3208169023 >> 172.21.15.63:0/3208169023 conn(0x7fdb080f82d0 msgr2=0x7fdb080fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:52:37.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.618+0000 7fdb0f9c9700 1 -- 172.21.15.63:0/3208169023 shutdown_connections 2023-12-12T11:52:37.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.618+0000 7fdb0f9c9700 1 -- 172.21.15.63:0/3208169023 wait complete. 2023-12-12T11:52:37.623 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.620+0000 7fdb0f9c9700 1 Processor -- start 2023-12-12T11:52:37.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.621+0000 7fdb0f9c9700 1 -- start start 2023-12-12T11:52:37.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.621+0000 7fdb0f9c9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb080fcbf0 0x7fdb0810f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:37.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.621+0000 7fdb0f9c9700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdb080fde00 0x7fdb0810fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:37.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.622+0000 7fdb0f9c9700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb08110350 con 0x7fdb080fcbf0 2023-12-12T11:52:37.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.622+0000 7fdb0f9c9700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb08110b90 con 0x7fdb080fde00 2023-12-12T11:52:37.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.622+0000 7fdb0cf64700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdb080fde00 0x7fdb0810fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:37.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.622+0000 7fdb0cf64700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdb080fde00 0x7fdb0810fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:38998/0 (socket says 172.21.15.63:38998) 2023-12-12T11:52:37.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.622+0000 7fdb0cf64700 1 -- 172.21.15.63:0/2311265040 learned_addr learned my addr 172.21.15.63:0/2311265040 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:52:37.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.622+0000 7fdb0cf64700 1 -- 172.21.15.63:0/2311265040 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb080fcbf0 msgr2=0x7fdb0810f780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-12T11:52:37.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.622+0000 7fdb0cf64700 1 --2- 172.21.15.63:0/2311265040 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb080fcbf0 0x7fdb0810f780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:37.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.622+0000 7fdb0cf64700 1 -- 172.21.15.63:0/2311265040 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb04005040 con 0x7fdb080fde00 2023-12-12T11:52:37.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.623+0000 7fdb0cf64700 1 --2- 172.21.15.63:0/2311265040 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdb080fde00 0x7fdb0810fcc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400b3b0 tx=0x7fdb04009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:52:37.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.623+0000 7fdafdffb700 1 -- 172.21.15.63:0/2311265040 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb0400e040 con 0x7fdb080fde00 2023-12-12T11:52:37.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.623+0000 7fdafdffb700 1 -- 172.21.15.63:0/2311265040 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdb04004290 con 0x7fdb080fde00 2023-12-12T11:52:37.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.623+0000 7fdb0f9c9700 1 -- 172.21.15.63:0/2311265040 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb08110e10 con 0x7fdb080fde00 2023-12-12T11:52:37.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.623+0000 7fdafdffb700 1 -- 172.21.15.63:0/2311265040 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb0401c3f0 con 0x7fdb080fde00 2023-12-12T11:52:37.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.623+0000 7fdb0f9c9700 1 -- 172.21.15.63:0/2311265040 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb08111350 con 0x7fdb080fde00 2023-12-12T11:52:37.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.625+0000 7fdb0f9c9700 1 -- 172.21.15.63:0/2311265040 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb08101ea0 con 0x7fdb080fde00 2023-12-12T11:52:37.630 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.628+0000 7fdafdffb700 1 -- 172.21.15.63:0/2311265040 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 24) v1 ==== 88724+0+0 (secure 0 0 0) 0x7fdb04013420 con 0x7fdb080fde00 2023-12-12T11:52:37.631 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.629+0000 7fdafdffb700 1 --2- 172.21.15.63:0/2311265040 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7fdaf406ae90 0x7fdaf406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:37.631 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.629+0000 7fdafdffb700 1 -- 172.21.15.63:0/2311265040 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fdb0408add0 con 0x7fdb080fde00 2023-12-12T11:52:37.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.631+0000 7fdb0d765700 1 --2- 172.21.15.63:0/2311265040 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7fdaf406ae90 0x7fdaf406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:37.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.632+0000 7fdb0d765700 1 --2- 172.21.15.63:0/2311265040 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7fdaf406ae90 0x7fdaf406d340 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdb080fdc60 tx=0x7fdb00009370 comp rx=0 tx=0).ready entity=mgr.24471 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:52:37.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:37.636+0000 7fdafdffb700 1 -- 172.21.15.63:0/2311265040 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fdb0408e030 con 0x7fdb080fde00 2023-12-12T11:52:37.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:37 smithi093 ceph-mon[115914]: pgmap v33: 65 pgs: 65 active+clean; 909 MiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 19 KiB/s rd, 1.4 MiB/s wr, 125 op/s 2023-12-12T11:52:37.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:37 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:52:38.034 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-12T11:52:38.034 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-12T11:52:38.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:37 smithi063 ceph-mon[107117]: pgmap v33: 65 pgs: 65 active+clean; 909 MiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 19 KiB/s rd, 1.4 MiB/s wr, 125 op/s 2023-12-12T11:52:38.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:37 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:52:38.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.114+0000 7fdb0f9c9700 1 -- 172.21.15.63:0/2311265040 --> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb0802b180 con 0x7fdaf406ae90 2023-12-12T11:52:38.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.118+0000 7fdafdffb700 1 -- 172.21.15.63:0/2311265040 <== mgr.24471 v2:172.21.15.93:6828/3441331233 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fdb0802b180 con 0x7fdaf406ae90 2023-12-12T11:52:38.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.122+0000 7fdb0f9c9700 1 -- 172.21.15.63:0/2311265040 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7fdaf406ae90 msgr2=0x7fdaf406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:38.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.122+0000 7fdb0f9c9700 1 --2- 172.21.15.63:0/2311265040 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7fdaf406ae90 0x7fdaf406d340 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdb080fdc60 tx=0x7fdb00009370 comp rx=0 tx=0).stop 2023-12-12T11:52:38.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.122+0000 7fdb0f9c9700 1 -- 172.21.15.63:0/2311265040 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdb080fde00 msgr2=0x7fdb0810fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:38.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.122+0000 7fdb0f9c9700 1 --2- 172.21.15.63:0/2311265040 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdb080fde00 0x7fdb0810fcc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400b3b0 tx=0x7fdb04009e30 comp rx=0 tx=0).stop 2023-12-12T11:52:38.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.122+0000 7fdb0f9c9700 1 -- 172.21.15.63:0/2311265040 shutdown_connections 2023-12-12T11:52:38.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.122+0000 7fdb0f9c9700 1 --2- 172.21.15.63:0/2311265040 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7fdaf406ae90 0x7fdaf406d340 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:38.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.122+0000 7fdb0f9c9700 1 --2- 172.21.15.63:0/2311265040 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb080fcbf0 0x7fdb0810f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:38.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.122+0000 7fdb0f9c9700 1 --2- 172.21.15.63:0/2311265040 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdb080fde00 0x7fdb0810fcc0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:38.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.122+0000 7fdb0f9c9700 1 -- 172.21.15.63:0/2311265040 >> 172.21.15.63:0/2311265040 conn(0x7fdb080f82d0 msgr2=0x7fdb080ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:52:38.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.123+0000 7fdb0f9c9700 1 -- 172.21.15.63:0/2311265040 shutdown_connections 2023-12-12T11:52:38.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.123+0000 7fdb0f9c9700 1 -- 172.21.15.63:0/2311265040 wait complete. 2023-12-12T11:52:38.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.344+0000 7f65b0a30700 1 -- 172.21.15.63:0/2150878181 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65ac0fcbf0 msgr2=0x7f65ac0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:38.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.344+0000 7f65b0a30700 1 --2- 172.21.15.63:0/2150878181 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65ac0fcbf0 0x7f65ac0fd000 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f659c004940 tx=0x7f659c009e30 comp rx=0 tx=0).stop 2023-12-12T11:52:38.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.345+0000 7f65b0a30700 1 -- 172.21.15.63:0/2150878181 shutdown_connections 2023-12-12T11:52:38.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.345+0000 7f65b0a30700 1 --2- 172.21.15.63:0/2150878181 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65ac0fde00 0x7f65ac0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:38.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.345+0000 7f65b0a30700 1 --2- 172.21.15.63:0/2150878181 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65ac0fcbf0 0x7f65ac0fd000 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:38.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.345+0000 7f65b0a30700 1 -- 172.21.15.63:0/2150878181 >> 172.21.15.63:0/2150878181 conn(0x7f65ac0f82d0 msgr2=0x7f65ac0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:52:38.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.345+0000 7f65b0a30700 1 -- 172.21.15.63:0/2150878181 shutdown_connections 2023-12-12T11:52:38.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.345+0000 7f65b0a30700 1 -- 172.21.15.63:0/2150878181 wait complete. 2023-12-12T11:52:38.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.346+0000 7f65b0a30700 1 Processor -- start 2023-12-12T11:52:38.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.346+0000 7f65b0a30700 1 -- start start 2023-12-12T11:52:38.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.347+0000 7f65b0a30700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65ac0fcbf0 0x7f65ac071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:38.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.347+0000 7f65b0a30700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65ac0fde00 0x7f65ac06ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:38.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.347+0000 7f65b0a30700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac1111b0 con 0x7f65ac0fcbf0 2023-12-12T11:52:38.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.347+0000 7f65b0a30700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac111320 con 0x7f65ac0fde00 2023-12-12T11:52:38.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.347+0000 7f65a9d9b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65ac0fde00 0x7f65ac06ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:38.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.347+0000 7f65a9d9b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65ac0fde00 0x7f65ac06ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:45934/0 (socket says 172.21.15.63:45934) 2023-12-12T11:52:38.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.347+0000 7f65a9d9b700 1 -- 172.21.15.63:0/3629152943 learned_addr learned my addr 172.21.15.63:0/3629152943 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:52:38.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.348+0000 7f65aa59c700 1 --2- 172.21.15.63:0/3629152943 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65ac0fcbf0 0x7f65ac071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:38.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.348+0000 7f65a9d9b700 1 -- 172.21.15.63:0/3629152943 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65ac0fcbf0 msgr2=0x7f65ac071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:38.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.348+0000 7f65a9d9b700 1 --2- 172.21.15.63:0/3629152943 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65ac0fcbf0 0x7f65ac071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:38.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.348+0000 7f65a9d9b700 1 -- 172.21.15.63:0/3629152943 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659c005040 con 0x7f65ac0fde00 2023-12-12T11:52:38.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.349+0000 7f65a9d9b700 1 --2- 172.21.15.63:0/3629152943 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65ac0fde00 0x7f65ac06ff90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f65a000eb40 tx=0x7f65a000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:52:38.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.349+0000 7f659affd700 1 -- 172.21.15.63:0/3629152943 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65a0007cc0 con 0x7f65ac0fde00 2023-12-12T11:52:38.352 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.350+0000 7f65b0a30700 1 -- 172.21.15.63:0/3629152943 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65ac070590 con 0x7f65ac0fde00 2023-12-12T11:52:38.352 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.350+0000 7f65b0a30700 1 -- 172.21.15.63:0/3629152943 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ac070ad0 con 0x7f65ac0fde00 2023-12-12T11:52:38.352 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.350+0000 7f659affd700 1 -- 172.21.15.63:0/3629152943 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f65a000f040 con 0x7f65ac0fde00 2023-12-12T11:52:38.353 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.350+0000 7f659affd700 1 -- 172.21.15.63:0/3629152943 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65a0009570 con 0x7f65ac0fde00 2023-12-12T11:52:38.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.352+0000 7f65b0a30700 1 -- 172.21.15.63:0/3629152943 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65ac04bb80 con 0x7f65ac0fde00 2023-12-12T11:52:38.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.354+0000 7f659affd700 1 -- 172.21.15.63:0/3629152943 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 24) v1 ==== 88724+0+0 (secure 0 0 0) 0x7f65a00096d0 con 0x7f65ac0fde00 2023-12-12T11:52:38.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.355+0000 7f659affd700 1 --2- 172.21.15.63:0/3629152943 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f659406ae40 0x7f659406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:38.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.355+0000 7f659affd700 1 -- 172.21.15.63:0/3629152943 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f65a00896e0 con 0x7f65ac0fde00 2023-12-12T11:52:38.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.356+0000 7f65aa59c700 1 --2- 172.21.15.63:0/3629152943 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f659406ae40 0x7f659406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:38.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.356+0000 7f65aa59c700 1 --2- 172.21.15.63:0/3629152943 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f659406ae40 0x7f659406d2f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f659c00b0d0 tx=0x7f659c009e30 comp rx=0 tx=0).ready entity=mgr.24471 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:52:38.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.359+0000 7f659affd700 1 -- 172.21.15.63:0/3629152943 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f65a0057600 con 0x7f65ac0fde00 2023-12-12T11:52:38.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.733+0000 7f65b0a30700 1 -- 172.21.15.63:0/3629152943 --> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f65ac102750 con 0x7f659406ae40 2023-12-12T11:52:38.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.744+0000 7f659affd700 1 -- 172.21.15.63:0/3629152943 <== mgr.24471 v2:172.21.15.93:6828/3441331233 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f65ac102750 con 0x7f659406ae40 2023-12-12T11:52:38.746 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-12T11:52:38.747 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (24s) 0s ago 8m 14.5M - 0.25.0 c8568f914cd2 f237d9f64783 2023-12-12T11:52:38.747 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (8m) 0s ago 8m 7818k - 17.2.7-123-gbef78a51 ae6196193935 ee4415610fae 2023-12-12T11:52:38.747 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi093 smithi093 running (7m) 3s ago 7m 7810k - 17.2.7-123-gbef78a51 ae6196193935 f64e68742cfe 2023-12-12T11:52:38.747 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (18s) 0s ago 7m 69.4M - 9.4.7 954c08fa6188 51300a1a5b87 2023-12-12T11:52:38.747 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.aevpzg smithi063 running (3m) 0s ago 3m 6043M - 17.2.7-123-gbef78a51 ae6196193935 df9a6781f836 2023-12-12T11:52:38.747 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.bdqbnp smithi063 running (3m) 0s ago 3m 13.9M - 17.2.7-123-gbef78a51 ae6196193935 0c7e1d21eee9 2023-12-12T11:52:38.747 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.rhaqsh smithi093 running (3m) 3s ago 3m 13.7M - 17.2.7-123-gbef78a51 ae6196193935 257aee771d87 2023-12-12T11:52:38.747 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.swdqms smithi093 running (3m) 3s ago 3m 13.6M - 17.2.7-123-gbef78a51 ae6196193935 f46d7173d3b1 2023-12-12T11:52:38.747 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.zjnfdi smithi063 *:8443,9283,8765 running (6s) 0s ago 9m 50.4M - 19.0.0-96-gf1fbf3c5 8cf689f388db dab6fa4aaa54 2023-12-12T11:52:38.748 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi093.nbtltu smithi093 *:8443,9283 running (79s) 3s ago 7m 509M - 19.0.0-96-gf1fbf3c5 8cf689f388db 58a1ec037be4 2023-12-12T11:52:38.748 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (9m) 0s ago 9m 87.1M 2048M 17.2.7-123-gbef78a51 ae6196193935 ee8e9d7455f9 2023-12-12T11:52:38.748 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi093 smithi093 running (7m) 3s ago 7m 56.4M 2048M 17.2.7-123-gbef78a51 ae6196193935 fac71666a805 2023-12-12T11:52:38.748 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (33s) 0s ago 8m 7931k - 1.5.0 0da6a335fe13 8eed63374ddf 2023-12-12T11:52:38.748 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi093 smithi093 *:9100 running (12s) 3s ago 7m 7113k - 1.5.0 0da6a335fe13 10e19431c1a2 2023-12-12T11:52:38.748 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (6m) 0s ago 6m 546M 1618M 17.2.7-123-gbef78a51 ae6196193935 636790d2b28c 2023-12-12T11:52:38.748 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (6m) 0s ago 6m 605M 1618M 17.2.7-123-gbef78a51 ae6196193935 5388a4bc6b12 2023-12-12T11:52:38.748 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (5m) 0s ago 5m 472M 1618M 17.2.7-123-gbef78a51 ae6196193935 9eb2483337c8 2023-12-12T11:52:38.748 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi093 running (5m) 3s ago 5m 652M 2642M 17.2.7-123-gbef78a51 ae6196193935 5b2bb36b5843 2023-12-12T11:52:38.748 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi093 running (5m) 3s ago 5m 501M 2642M 17.2.7-123-gbef78a51 ae6196193935 7dc3f04b04cb 2023-12-12T11:52:38.748 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi093 running (4m) 3s ago 4m 544M 2642M 17.2.7-123-gbef78a51 ae6196193935 16fe8e4668f1 2023-12-12T11:52:38.749 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (14s) 0s ago 7m 37.5M - 2.43.0 a07b618ecd1d a10dc7ca2537 2023-12-12T11:52:38.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.747+0000 7f65b0a30700 1 -- 172.21.15.63:0/3629152943 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f659406ae40 msgr2=0x7f659406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:38.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.747+0000 7f65b0a30700 1 --2- 172.21.15.63:0/3629152943 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f659406ae40 0x7f659406d2f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f659c00b0d0 tx=0x7f659c009e30 comp rx=0 tx=0).stop 2023-12-12T11:52:38.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.747+0000 7f65b0a30700 1 -- 172.21.15.63:0/3629152943 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65ac0fde00 msgr2=0x7f65ac06ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:38.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.747+0000 7f65b0a30700 1 --2- 172.21.15.63:0/3629152943 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65ac0fde00 0x7f65ac06ff90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f65a000eb40 tx=0x7f65a000b040 comp rx=0 tx=0).stop 2023-12-12T11:52:38.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.747+0000 7f65b0a30700 1 -- 172.21.15.63:0/3629152943 shutdown_connections 2023-12-12T11:52:38.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.747+0000 7f65b0a30700 1 --2- 172.21.15.63:0/3629152943 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f659406ae40 0x7f659406d2f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:38.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.747+0000 7f65b0a30700 1 --2- 172.21.15.63:0/3629152943 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65ac0fcbf0 0x7f65ac071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:38.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.747+0000 7f65b0a30700 1 --2- 172.21.15.63:0/3629152943 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65ac0fde00 0x7f65ac06ff90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:38.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.747+0000 7f65b0a30700 1 -- 172.21.15.63:0/3629152943 >> 172.21.15.63:0/3629152943 conn(0x7f65ac0f82d0 msgr2=0x7f65ac101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:52:38.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.748+0000 7f65b0a30700 1 -- 172.21.15.63:0/3629152943 shutdown_connections 2023-12-12T11:52:38.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.748+0000 7f65b0a30700 1 -- 172.21.15.63:0/3629152943 wait complete. 2023-12-12T11:52:38.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.954+0000 7f0a0962c700 1 -- 172.21.15.63:0/1135654455 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0a040fde00 msgr2=0x7f0a040fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:38.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.954+0000 7f0a0962c700 1 --2- 172.21.15.63:0/1135654455 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0a040fde00 0x7f0a040fe250 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f09f400f3f0 tx=0x7f09f4004d10 comp rx=0 tx=0).stop 2023-12-12T11:52:38.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.954+0000 7f0a0962c700 1 -- 172.21.15.63:0/1135654455 shutdown_connections 2023-12-12T11:52:38.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.954+0000 7f0a0962c700 1 --2- 172.21.15.63:0/1135654455 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0a040fde00 0x7f0a040fe250 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:38.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.954+0000 7f0a0962c700 1 --2- 172.21.15.63:0/1135654455 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a040fcbf0 0x7f0a040fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:38.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.954+0000 7f0a0962c700 1 -- 172.21.15.63:0/1135654455 >> 172.21.15.63:0/1135654455 conn(0x7f0a040f82d0 msgr2=0x7f0a040fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:52:38.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.954+0000 7f0a0962c700 1 -- 172.21.15.63:0/1135654455 shutdown_connections 2023-12-12T11:52:38.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.954+0000 7f0a0962c700 1 -- 172.21.15.63:0/1135654455 wait complete. 2023-12-12T11:52:38.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.955+0000 7f0a0962c700 1 Processor -- start 2023-12-12T11:52:38.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.957+0000 7f0a0962c700 1 -- start start 2023-12-12T11:52:38.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.957+0000 7f0a0962c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0a040fcbf0 0x7f0a0410b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:38.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.957+0000 7f0a0962c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a040fde00 0x7f0a0410bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:38.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.957+0000 7f0a0962c700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0410c150 con 0x7f0a040fde00 2023-12-12T11:52:38.961 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.957+0000 7f0a0962c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0410c990 con 0x7f0a040fcbf0 2023-12-12T11:52:38.961 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.958+0000 7f0a02ffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0a040fcbf0 0x7f0a0410b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:38.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.958+0000 7f0a02ffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0a040fcbf0 0x7f0a0410b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:45960/0 (socket says 172.21.15.63:45960) 2023-12-12T11:52:38.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.958+0000 7f0a02ffd700 1 -- 172.21.15.63:0/1403732945 learned_addr learned my addr 172.21.15.63:0/1403732945 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:52:38.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.958+0000 7f0a027fc700 1 --2- 172.21.15.63:0/1403732945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a040fde00 0x7f0a0410bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:38.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.958+0000 7f0a02ffd700 1 -- 172.21.15.63:0/1403732945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a040fde00 msgr2=0x7f0a0410bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:38.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.958+0000 7f0a02ffd700 1 --2- 172.21.15.63:0/1403732945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a040fde00 0x7f0a0410bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:38.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.958+0000 7f0a02ffd700 1 -- 172.21.15.63:0/1403732945 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f400f050 con 0x7f0a040fcbf0 2023-12-12T11:52:38.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.958+0000 7f0a027fc700 1 --2- 172.21.15.63:0/1403732945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a040fde00 0x7f0a0410bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T11:52:38.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.959+0000 7f0a02ffd700 1 --2- 172.21.15.63:0/1403732945 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0a040fcbf0 0x7f0a0410b580 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00b790 tx=0x7f09ec009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:52:38.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.959+0000 7f09fb7fe700 1 -- 172.21.15.63:0/1403732945 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09ec00f6f0 con 0x7f0a040fcbf0 2023-12-12T11:52:38.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.959+0000 7f0a0962c700 1 -- 172.21.15.63:0/1403732945 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a0410cc70 con 0x7f0a040fcbf0 2023-12-12T11:52:38.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.959+0000 7f0a0962c700 1 -- 172.21.15.63:0/1403732945 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a0410d1b0 con 0x7f0a040fcbf0 2023-12-12T11:52:38.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.960+0000 7f09fb7fe700 1 -- 172.21.15.63:0/1403732945 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f09ec00fd00 con 0x7f0a040fcbf0 2023-12-12T11:52:38.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.960+0000 7f09fb7fe700 1 -- 172.21.15.63:0/1403732945 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09ec0103a0 con 0x7f0a040fcbf0 2023-12-12T11:52:38.966 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.963+0000 7f09fb7fe700 1 -- 172.21.15.63:0/1403732945 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 24) v1 ==== 88724+0+0 (secure 0 0 0) 0x7f09ec010500 con 0x7f0a040fcbf0 2023-12-12T11:52:38.966 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.963+0000 7f0a0962c700 1 -- 172.21.15.63:0/1403732945 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e40052e0 con 0x7f0a040fcbf0 2023-12-12T11:52:38.966 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.964+0000 7f09fb7fe700 1 --2- 172.21.15.63:0/1403732945 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f09f006ae40 0x7f09f006d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:38.967 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.964+0000 7f09fb7fe700 1 -- 172.21.15.63:0/1403732945 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f09ec0894e0 con 0x7f0a040fcbf0 2023-12-12T11:52:38.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.965+0000 7f0a027fc700 1 --2- 172.21.15.63:0/1403732945 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f09f006ae40 0x7f09f006d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:38.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.965+0000 7f0a027fc700 1 --2- 172.21.15.63:0/1403732945 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f09f006ae40 0x7f09f006d2f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f09f4005010 tx=0x7f09f4004d10 comp rx=0 tx=0).ready entity=mgr.24471 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:52:38.970 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:38.968+0000 7f09fb7fe700 1 -- 172.21.15.63:0/1403732945 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f09ec058340 con 0x7f0a040fcbf0 2023-12-12T11:52:39.027 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:38 smithi063 ceph-mon[107117]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:52:39.027 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:38 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:39.027 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:38 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:39.027 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:38 smithi063 ceph-mon[107117]: from='client.24549 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:52:39.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:38 smithi093 ceph-mon[115914]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:52:39.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:38 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:39.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:38 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:39.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:38 smithi093 ceph-mon[115914]: from='client.24549 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:52:39.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.464+0000 7f0a0962c700 1 -- 172.21.15.63:0/1403732945 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f09e4005860 con 0x7f0a040fcbf0 2023-12-12T11:52:39.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.465+0000 7f09fb7fe700 1 -- 172.21.15.63:0/1403732945 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+840 (secure 0 0 0) 0x7f09ec057ed0 con 0x7f0a040fcbf0 2023-12-12T11:52:39.467 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:52:39.467 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-12T11:52:39.468 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 2 2023-12-12T11:52:39.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:52:39.468 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-12T11:52:39.468 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 1, 2023-12-12T11:52:39.468 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 1 2023-12-12T11:52:39.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:52:39.468 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-12T11:52:39.468 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 6 2023-12-12T11:52:39.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:52:39.468 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-12T11:52:39.468 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 4 2023-12-12T11:52:39.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:52:39.468 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-12T11:52:39.468 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 13, 2023-12-12T11:52:39.468 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 1 2023-12-12T11:52:39.469 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-12T11:52:39.469 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:52:39.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.467+0000 7f0a0962c700 1 -- 172.21.15.63:0/1403732945 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f09f006ae40 msgr2=0x7f09f006d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:39.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.467+0000 7f0a0962c700 1 --2- 172.21.15.63:0/1403732945 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f09f006ae40 0x7f09f006d2f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f09f4005010 tx=0x7f09f4004d10 comp rx=0 tx=0).stop 2023-12-12T11:52:39.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.467+0000 7f0a0962c700 1 -- 172.21.15.63:0/1403732945 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0a040fcbf0 msgr2=0x7f0a0410b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:39.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.467+0000 7f0a0962c700 1 --2- 172.21.15.63:0/1403732945 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0a040fcbf0 0x7f0a0410b580 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00b790 tx=0x7f09ec009220 comp rx=0 tx=0).stop 2023-12-12T11:52:39.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.468+0000 7f0a0962c700 1 -- 172.21.15.63:0/1403732945 shutdown_connections 2023-12-12T11:52:39.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.468+0000 7f0a0962c700 1 --2- 172.21.15.63:0/1403732945 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f09f006ae40 0x7f09f006d2f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:39.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.468+0000 7f0a0962c700 1 --2- 172.21.15.63:0/1403732945 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0a040fcbf0 0x7f0a0410b580 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:39.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.468+0000 7f0a0962c700 1 --2- 172.21.15.63:0/1403732945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a040fde00 0x7f0a0410bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:39.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.468+0000 7f0a0962c700 1 -- 172.21.15.63:0/1403732945 >> 172.21.15.63:0/1403732945 conn(0x7f0a040f82d0 msgr2=0x7f0a04101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:52:39.471 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.468+0000 7f0a0962c700 1 -- 172.21.15.63:0/1403732945 shutdown_connections 2023-12-12T11:52:39.471 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.468+0000 7f0a0962c700 1 -- 172.21.15.63:0/1403732945 wait complete. 2023-12-12T11:52:39.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.650+0000 7ff88e62b700 1 -- 172.21.15.63:0/1129329335 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff8880fcbf0 msgr2=0x7ff8880fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:39.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.650+0000 7ff88e62b700 1 --2- 172.21.15.63:0/1129329335 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff8880fcbf0 0x7ff8880fd000 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff878004940 tx=0x7ff878009e30 comp rx=0 tx=0).stop 2023-12-12T11:52:39.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.650+0000 7ff88e62b700 1 -- 172.21.15.63:0/1129329335 shutdown_connections 2023-12-12T11:52:39.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.650+0000 7ff88e62b700 1 --2- 172.21.15.63:0/1129329335 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8880fde00 0x7ff8880fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:39.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.650+0000 7ff88e62b700 1 --2- 172.21.15.63:0/1129329335 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff8880fcbf0 0x7ff8880fd000 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:39.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.650+0000 7ff88e62b700 1 -- 172.21.15.63:0/1129329335 >> 172.21.15.63:0/1129329335 conn(0x7ff8880f82d0 msgr2=0x7ff8880fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:52:39.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.650+0000 7ff88e62b700 1 -- 172.21.15.63:0/1129329335 shutdown_connections 2023-12-12T11:52:39.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.650+0000 7ff88e62b700 1 -- 172.21.15.63:0/1129329335 wait complete. 2023-12-12T11:52:39.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.651+0000 7ff88e62b700 1 Processor -- start 2023-12-12T11:52:39.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.652+0000 7ff88e62b700 1 -- start start 2023-12-12T11:52:39.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.652+0000 7ff88e62b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff8880fcbf0 0x7ff88810d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:39.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.652+0000 7ff88e62b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8880fde00 0x7ff88810da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:39.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.652+0000 7ff88e62b700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88810e010 con 0x7ff8880fde00 2023-12-12T11:52:39.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.652+0000 7ff88e62b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88810e8b0 con 0x7ff8880fcbf0 2023-12-12T11:52:39.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.653+0000 7ff8877fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8880fde00 0x7ff88810da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:39.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.653+0000 7ff887fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff8880fcbf0 0x7ff88810d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:39.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.653+0000 7ff887fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff8880fcbf0 0x7ff88810d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:45974/0 (socket says 172.21.15.63:45974) 2023-12-12T11:52:39.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.653+0000 7ff887fff700 1 -- 172.21.15.63:0/1080926621 learned_addr learned my addr 172.21.15.63:0/1080926621 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:52:39.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.653+0000 7ff887fff700 1 -- 172.21.15.63:0/1080926621 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8880fde00 msgr2=0x7ff88810da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:39.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.653+0000 7ff887fff700 1 --2- 172.21.15.63:0/1080926621 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8880fde00 0x7ff88810da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:39.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.653+0000 7ff887fff700 1 -- 172.21.15.63:0/1080926621 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff87c005040 con 0x7ff8880fcbf0 2023-12-12T11:52:39.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.654+0000 7ff887fff700 1 --2- 172.21.15.63:0/1080926621 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff8880fcbf0 0x7ff88810d4d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff878004890 tx=0x7ff878009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:52:39.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.654+0000 7ff884ff9700 1 -- 172.21.15.63:0/1080926621 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff87800e070 con 0x7ff8880fcbf0 2023-12-12T11:52:39.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.654+0000 7ff884ff9700 1 -- 172.21.15.63:0/1080926621 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff878004290 con 0x7ff8880fcbf0 2023-12-12T11:52:39.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.654+0000 7ff88e62b700 1 -- 172.21.15.63:0/1080926621 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff878005040 con 0x7ff8880fcbf0 2023-12-12T11:52:39.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.655+0000 7ff88e62b700 1 -- 172.21.15.63:0/1080926621 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff88810ee00 con 0x7ff8880fcbf0 2023-12-12T11:52:39.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.655+0000 7ff884ff9700 1 -- 172.21.15.63:0/1080926621 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff87801cd90 con 0x7ff8880fcbf0 2023-12-12T11:52:39.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.656+0000 7ff88e62b700 1 -- 172.21.15.63:0/1080926621 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff88804bb80 con 0x7ff8880fcbf0 2023-12-12T11:52:39.660 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.658+0000 7ff884ff9700 1 -- 172.21.15.63:0/1080926621 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 24) v1 ==== 88724+0+0 (secure 0 0 0) 0x7ff87801c400 con 0x7ff8880fcbf0 2023-12-12T11:52:39.663 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.660+0000 7ff884ff9700 1 --2- 172.21.15.63:0/1080926621 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7ff87006ae90 0x7ff87006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:39.663 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.660+0000 7ff884ff9700 1 -- 172.21.15.63:0/1080926621 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7ff87808a070 con 0x7ff8880fcbf0 2023-12-12T11:52:39.663 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.660+0000 7ff8877fe700 1 --2- 172.21.15.63:0/1080926621 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7ff87006ae90 0x7ff87006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:39.664 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.662+0000 7ff8877fe700 1 --2- 172.21.15.63:0/1080926621 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7ff87006ae90 0x7ff87006d340 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff87c009fd0 tx=0x7ff87c00b040 comp rx=0 tx=0).ready entity=mgr.24471 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:52:39.667 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:39.664+0000 7ff884ff9700 1 -- 172.21.15.63:0/1080926621 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7ff878057e20 con 0x7ff8880fcbf0 2023-12-12T11:52:40.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:39 smithi063 ceph-mon[107117]: from='client.24553 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:52:40.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:39 smithi063 ceph-mon[107117]: pgmap v34: 65 pgs: 65 active+clean; 481 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 30 KiB/s rd, 2.0 MiB/s wr, 221 op/s 2023-12-12T11:52:40.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:39 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/1403732945' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:52:40.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:39 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:40.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:39 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:40.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.122+0000 7ff88e62b700 1 -- 172.21.15.63:0/1080926621 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff88810f1d0 con 0x7ff8880fcbf0 2023-12-12T11:52:40.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.123+0000 7ff884ff9700 1 -- 172.21.15.63:0/1080926621 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1807 (secure 0 0 0) 0x7ff8780579b0 con 0x7ff8880fcbf0 2023-12-12T11:52:40.127 INFO:teuthology.orchestra.run.smithi063.stdout:e13 2023-12-12T11:52:40.127 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-12T11:52:40.127 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:52:40.127 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-12T11:52:40.127 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:52:40.127 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-12T11:52:40.127 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-12T11:52:40.127 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 13 2023-12-12T11:52:40.127 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-12T11:52:40.127 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-12T11:48:58.523481+0000 2023-12-12T11:52:40.127 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-12T11:49:14.113993+0000 2023-12-12T11:52:40.127 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-12T11:52:40.127 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-12T11:52:40.127 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-12T11:52:40.128 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-12T11:52:40.128 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-12T11:52:40.128 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-12T11:52:40.128 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-12T11:52:40.128 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 46 2023-12-12T11:52:40.128 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:52:40.128 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 1 2023-12-12T11:52:40.128 INFO:teuthology.orchestra.run.smithi063.stdout:in 0 2023-12-12T11:52:40.128 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=14492} 2023-12-12T11:52:40.128 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-12T11:52:40.128 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-12T11:52:40.128 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-12T11:52:40.128 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-12T11:52:40.128 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-12T11:52:40.129 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data enabled 2023-12-12T11:52:40.129 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-12T11:52:40.129 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 1 2023-12-12T11:52:40.129 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.aevpzg{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.63:6828/3709000039,v1:172.21.15.63:6829/3709000039] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:52:40.129 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:52:40.129 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:52:40.129 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2023-12-12T11:52:40.129 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:52:40.129 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.swdqms{-1:14500} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.93:6826/3307558569,v1:172.21.15.93:6827/3307558569] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:52:40.129 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.bdqbnp{-1:14508} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/2191270944,v1:172.21.15.63:6827/2191270944] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:52:40.129 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.rhaqsh{-1:24317} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.93:6824/3161864019,v1:172.21.15.93:6825/3161864019] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:52:40.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.127+0000 7ff88e62b700 1 -- 172.21.15.63:0/1080926621 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7ff87006ae90 msgr2=0x7ff87006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:40.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.127+0000 7ff88e62b700 1 --2- 172.21.15.63:0/1080926621 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7ff87006ae90 0x7ff87006d340 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff87c009fd0 tx=0x7ff87c00b040 comp rx=0 tx=0).stop 2023-12-12T11:52:40.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.127+0000 7ff88e62b700 1 -- 172.21.15.63:0/1080926621 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff8880fcbf0 msgr2=0x7ff88810d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:40.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.127+0000 7ff88e62b700 1 --2- 172.21.15.63:0/1080926621 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff8880fcbf0 0x7ff88810d4d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff878004890 tx=0x7ff878009e30 comp rx=0 tx=0).stop 2023-12-12T11:52:40.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.127+0000 7ff88e62b700 1 -- 172.21.15.63:0/1080926621 shutdown_connections 2023-12-12T11:52:40.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.127+0000 7ff88e62b700 1 --2- 172.21.15.63:0/1080926621 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7ff87006ae90 0x7ff87006d340 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:40.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.127+0000 7ff88e62b700 1 --2- 172.21.15.63:0/1080926621 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff8880fcbf0 0x7ff88810d4d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:40.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.127+0000 7ff88e62b700 1 --2- 172.21.15.63:0/1080926621 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8880fde00 0x7ff88810da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:40.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.127+0000 7ff88e62b700 1 -- 172.21.15.63:0/1080926621 >> 172.21.15.63:0/1080926621 conn(0x7ff8880f82d0 msgr2=0x7ff888101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:52:40.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.127+0000 7ff88e62b700 1 -- 172.21.15.63:0/1080926621 shutdown_connections 2023-12-12T11:52:40.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.128+0000 7ff88e62b700 1 -- 172.21.15.63:0/1080926621 wait complete. 2023-12-12T11:52:40.131 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 13 2023-12-12T11:52:40.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:39 smithi093 ceph-mon[115914]: from='client.24553 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:52:40.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:39 smithi093 ceph-mon[115914]: pgmap v34: 65 pgs: 65 active+clean; 481 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 30 KiB/s rd, 2.0 MiB/s wr, 221 op/s 2023-12-12T11:52:40.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:39 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/1403732945' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:52:40.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:39 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:40.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:39 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:40.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.334+0000 7f993a611700 1 -- 172.21.15.63:0/2710812770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99340fdc20 msgr2=0x7f99340fe070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:40.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.334+0000 7f993a611700 1 --2- 172.21.15.63:0/2710812770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99340fdc20 0x7f99340fe070 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9930004880 tx=0x7f9930009e30 comp rx=0 tx=0).stop 2023-12-12T11:52:40.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.334+0000 7f993a611700 1 -- 172.21.15.63:0/2710812770 shutdown_connections 2023-12-12T11:52:40.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.334+0000 7f993a611700 1 --2- 172.21.15.63:0/2710812770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99340fdc20 0x7f99340fe070 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:40.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.334+0000 7f993a611700 1 --2- 172.21.15.63:0/2710812770 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99340fca10 0x7f99340fce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:40.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.334+0000 7f993a611700 1 -- 172.21.15.63:0/2710812770 >> 172.21.15.63:0/2710812770 conn(0x7f99340f80b0 msgr2=0x7f99340fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:52:40.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.334+0000 7f993a611700 1 -- 172.21.15.63:0/2710812770 shutdown_connections 2023-12-12T11:52:40.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.334+0000 7f993a611700 1 -- 172.21.15.63:0/2710812770 wait complete. 2023-12-12T11:52:40.338 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.336+0000 7f993a611700 1 Processor -- start 2023-12-12T11:52:40.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.337+0000 7f993a611700 1 -- start start 2023-12-12T11:52:40.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.339+0000 7f993a611700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99340fca10 0x7f993410d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:40.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.339+0000 7f993a611700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99340fdc20 0x7f993410d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:40.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.339+0000 7f993a611700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993410dda0 con 0x7f99340fdc20 2023-12-12T11:52:40.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.339+0000 7f993a611700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993410e640 con 0x7f99340fca10 2023-12-12T11:52:40.342 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.339+0000 7f993960f700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99340fca10 0x7f993410d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:40.342 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.339+0000 7f993960f700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99340fca10 0x7f993410d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:45990/0 (socket says 172.21.15.63:45990) 2023-12-12T11:52:40.342 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.339+0000 7f993960f700 1 -- 172.21.15.63:0/897490657 learned_addr learned my addr 172.21.15.63:0/897490657 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:52:40.343 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.340+0000 7f9938e0e700 1 --2- 172.21.15.63:0/897490657 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99340fdc20 0x7f993410d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:40.343 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.340+0000 7f993960f700 1 -- 172.21.15.63:0/897490657 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99340fdc20 msgr2=0x7f993410d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:40.343 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.340+0000 7f993960f700 1 --2- 172.21.15.63:0/897490657 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99340fdc20 0x7f993410d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:40.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.340+0000 7f993960f700 1 -- 172.21.15.63:0/897490657 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9924005040 con 0x7f99340fca10 2023-12-12T11:52:40.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.340+0000 7f993960f700 1 --2- 172.21.15.63:0/897490657 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99340fca10 0x7f993410d260 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f99240096b0 tx=0x7f9924009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:52:40.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.341+0000 7f9929ffb700 1 -- 172.21.15.63:0/897490657 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f992400e840 con 0x7f99340fca10 2023-12-12T11:52:40.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.341+0000 7f9929ffb700 1 -- 172.21.15.63:0/897490657 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f992400f040 con 0x7f99340fca10 2023-12-12T11:52:40.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.341+0000 7f9929ffb700 1 -- 172.21.15.63:0/897490657 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9924013d60 con 0x7f99340fca10 2023-12-12T11:52:40.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.342+0000 7f993a611700 1 -- 172.21.15.63:0/897490657 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9930005040 con 0x7f99340fca10 2023-12-12T11:52:40.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.343+0000 7f993a611700 1 -- 172.21.15.63:0/897490657 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f993410ebf0 con 0x7f99340fca10 2023-12-12T11:52:40.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.345+0000 7f993a611700 1 -- 172.21.15.63:0/897490657 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f993404bb80 con 0x7f99340fca10 2023-12-12T11:52:40.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.347+0000 7f9929ffb700 1 -- 172.21.15.63:0/897490657 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 24) v1 ==== 88724+0+0 (secure 0 0 0) 0x7f9924013590 con 0x7f99340fca10 2023-12-12T11:52:40.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.348+0000 7f9929ffb700 1 --2- 172.21.15.63:0/897490657 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f992006ae90 0x7f992006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:40.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.349+0000 7f9929ffb700 1 -- 172.21.15.63:0/897490657 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f99240890e0 con 0x7f99340fca10 2023-12-12T11:52:40.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.349+0000 7f9938e0e700 1 --2- 172.21.15.63:0/897490657 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f992006ae90 0x7f992006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:40.352 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.350+0000 7f9938e0e700 1 --2- 172.21.15.63:0/897490657 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f992006ae90 0x7f992006d340 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f99300135d0 tx=0x7f9930009e30 comp rx=0 tx=0).ready entity=mgr.24471 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:52:40.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.353+0000 7f9929ffb700 1 -- 172.21.15.63:0/897490657 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f992404dce0 con 0x7f99340fca10 2023-12-12T11:52:40.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.718+0000 7f993a611700 1 -- 172.21.15.63:0/897490657 --> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f993410f3a0 con 0x7f992006ae90 2023-12-12T11:52:40.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.720+0000 7f9929ffb700 1 -- 172.21.15.63:0/897490657 <== mgr.24471 v2:172.21.15.93:6828/3441331233 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f993410f3a0 con 0x7f992006ae90 2023-12-12T11:52:40.723 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:52:40.723 INFO:teuthology.orchestra.run.smithi063.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dbb46fd2dbbe029cfba763f2b7c769e980f86b63e74be0c72e188909e20b81f3", 2023-12-12T11:52:40.723 INFO:teuthology.orchestra.run.smithi063.stdout: "in_progress": true, 2023-12-12T11:52:40.723 INFO:teuthology.orchestra.run.smithi063.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-12T11:52:40.723 INFO:teuthology.orchestra.run.smithi063.stdout: "services_complete": [ 2023-12-12T11:52:40.723 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr" 2023-12-12T11:52:40.723 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2023-12-12T11:52:40.724 INFO:teuthology.orchestra.run.smithi063.stdout: "progress": "2/21 daemons upgraded", 2023-12-12T11:52:40.724 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "Currently upgrading mgr daemons", 2023-12-12T11:52:40.724 INFO:teuthology.orchestra.run.smithi063.stdout: "is_paused": false 2023-12-12T11:52:40.724 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:52:40.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.724+0000 7f993a611700 1 -- 172.21.15.63:0/897490657 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f992006ae90 msgr2=0x7f992006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:40.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.724+0000 7f993a611700 1 --2- 172.21.15.63:0/897490657 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f992006ae90 0x7f992006d340 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f99300135d0 tx=0x7f9930009e30 comp rx=0 tx=0).stop 2023-12-12T11:52:40.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.724+0000 7f993a611700 1 -- 172.21.15.63:0/897490657 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99340fca10 msgr2=0x7f993410d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:40.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.724+0000 7f993a611700 1 --2- 172.21.15.63:0/897490657 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99340fca10 0x7f993410d260 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f99240096b0 tx=0x7f9924009e30 comp rx=0 tx=0).stop 2023-12-12T11:52:40.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.725+0000 7f993a611700 1 -- 172.21.15.63:0/897490657 shutdown_connections 2023-12-12T11:52:40.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.725+0000 7f993a611700 1 --2- 172.21.15.63:0/897490657 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f992006ae90 0x7f992006d340 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:40.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.725+0000 7f993a611700 1 --2- 172.21.15.63:0/897490657 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99340fca10 0x7f993410d260 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:40.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.725+0000 7f993a611700 1 --2- 172.21.15.63:0/897490657 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99340fdc20 0x7f993410d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:40.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.725+0000 7f993a611700 1 -- 172.21.15.63:0/897490657 >> 172.21.15.63:0/897490657 conn(0x7f99340f80b0 msgr2=0x7f9934100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:52:40.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.725+0000 7f993a611700 1 -- 172.21.15.63:0/897490657 shutdown_connections 2023-12-12T11:52:40.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.725+0000 7f993a611700 1 -- 172.21.15.63:0/897490657 wait complete. 2023-12-12T11:52:40.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.922+0000 7f695c294700 1 -- 172.21.15.63:0/2601090054 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69540fcbf0 msgr2=0x7f69540fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:40.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.922+0000 7f695c294700 1 --2- 172.21.15.63:0/2601090054 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69540fcbf0 0x7f69540fd000 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6950004940 tx=0x7f6950009e30 comp rx=0 tx=0).stop 2023-12-12T11:52:40.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.922+0000 7f695c294700 1 -- 172.21.15.63:0/2601090054 shutdown_connections 2023-12-12T11:52:40.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.922+0000 7f695c294700 1 --2- 172.21.15.63:0/2601090054 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69540fde00 0x7f69540fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:40.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.922+0000 7f695c294700 1 --2- 172.21.15.63:0/2601090054 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69540fcbf0 0x7f69540fd000 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:40.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.922+0000 7f695c294700 1 -- 172.21.15.63:0/2601090054 >> 172.21.15.63:0/2601090054 conn(0x7f69540f82d0 msgr2=0x7f69540fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:52:40.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.923+0000 7f695c294700 1 -- 172.21.15.63:0/2601090054 shutdown_connections 2023-12-12T11:52:40.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.923+0000 7f695c294700 1 -- 172.21.15.63:0/2601090054 wait complete. 2023-12-12T11:52:40.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.924+0000 7f695c294700 1 Processor -- start 2023-12-12T11:52:40.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.924+0000 7f695c294700 1 -- start start 2023-12-12T11:52:40.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.925+0000 7f695c294700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69540fcbf0 0x7f6954071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:40.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.925+0000 7f695c294700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69540fde00 0x7f695406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:40.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.925+0000 7f695c294700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6954070590 con 0x7f69540fcbf0 2023-12-12T11:52:40.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.925+0000 7f695c294700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6954070700 con 0x7f69540fde00 2023-12-12T11:52:40.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.925+0000 7f695a030700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69540fcbf0 0x7f6954071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:40.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.925+0000 7f695a030700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69540fcbf0 0x7f6954071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48842/0 (socket says 172.21.15.63:48842) 2023-12-12T11:52:40.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.925+0000 7f695a030700 1 -- 172.21.15.63:0/4293480888 learned_addr learned my addr 172.21.15.63:0/4293480888 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:52:40.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.925+0000 7f695982f700 1 --2- 172.21.15.63:0/4293480888 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69540fde00 0x7f695406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:40.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.926+0000 7f695982f700 1 -- 172.21.15.63:0/4293480888 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69540fcbf0 msgr2=0x7f6954071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:40.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.926+0000 7f695982f700 1 --2- 172.21.15.63:0/4293480888 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69540fcbf0 0x7f6954071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:40.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.926+0000 7f695982f700 1 -- 172.21.15.63:0/4293480888 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6950005040 con 0x7f69540fde00 2023-12-12T11:52:40.930 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.926+0000 7f695982f700 1 --2- 172.21.15.63:0/4293480888 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69540fde00 0x7f695406ff90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6944009fd0 tx=0x7f694400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:52:40.930 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.927+0000 7f694affd700 1 -- 172.21.15.63:0/4293480888 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6944007cc0 con 0x7f69540fde00 2023-12-12T11:52:40.930 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.927+0000 7f694affd700 1 -- 172.21.15.63:0/4293480888 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f694400f040 con 0x7f69540fde00 2023-12-12T11:52:40.930 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.927+0000 7f694affd700 1 -- 172.21.15.63:0/4293480888 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f694400ca60 con 0x7f69540fde00 2023-12-12T11:52:40.930 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.927+0000 7f695c294700 1 -- 172.21.15.63:0/4293480888 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6954070980 con 0x7f69540fde00 2023-12-12T11:52:40.930 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.927+0000 7f695c294700 1 -- 172.21.15.63:0/4293480888 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6954115590 con 0x7f69540fde00 2023-12-12T11:52:40.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.929+0000 7f695c294700 1 -- 172.21.15.63:0/4293480888 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f695404bb80 con 0x7f69540fde00 2023-12-12T11:52:40.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.930+0000 7f694affd700 1 -- 172.21.15.63:0/4293480888 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 24) v1 ==== 88724+0+0 (secure 0 0 0) 0x7f694400cbc0 con 0x7f69540fde00 2023-12-12T11:52:40.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.932+0000 7f694affd700 1 --2- 172.21.15.63:0/4293480888 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f694006ae40 0x7f694006d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:52:40.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.932+0000 7f694affd700 1 -- 172.21.15.63:0/4293480888 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f69440892e0 con 0x7f69540fde00 2023-12-12T11:52:40.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.932+0000 7f695a030700 1 --2- 172.21.15.63:0/4293480888 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f694006ae40 0x7f694006d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:52:40.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.933+0000 7f695a030700 1 --2- 172.21.15.63:0/4293480888 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f694006ae40 0x7f694006d2f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f695000b0d0 tx=0x7f6950009e30 comp rx=0 tx=0).ready entity=mgr.24471 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:52:40.938 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:40.936+0000 7f694affd700 1 -- 172.21.15.63:0/4293480888 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f694404ece0 con 0x7f69540fde00 2023-12-12T11:52:41.179 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:40 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/1080926621' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:52:41.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:40 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/1080926621' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:52:41.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:41.421+0000 7f695c294700 1 -- 172.21.15.63:0/4293480888 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6954105590 con 0x7f69540fde00 2023-12-12T11:52:41.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:41.422+0000 7f694affd700 1 -- 172.21.15.63:0/4293480888 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f69440570c0 con 0x7f69540fde00 2023-12-12T11:52:41.424 INFO:teuthology.orchestra.run.smithi063.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-12T11:52:41.424 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-12T11:52:41.425 INFO:teuthology.orchestra.run.smithi063.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-12T11:52:41.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:41.425+0000 7f695c294700 1 -- 172.21.15.63:0/4293480888 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f694006ae40 msgr2=0x7f694006d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:41.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:41.425+0000 7f695c294700 1 --2- 172.21.15.63:0/4293480888 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f694006ae40 0x7f694006d2f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f695000b0d0 tx=0x7f6950009e30 comp rx=0 tx=0).stop 2023-12-12T11:52:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:41.426+0000 7f695c294700 1 -- 172.21.15.63:0/4293480888 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69540fde00 msgr2=0x7f695406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:52:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:41.426+0000 7f695c294700 1 --2- 172.21.15.63:0/4293480888 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69540fde00 0x7f695406ff90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6944009fd0 tx=0x7f694400b040 comp rx=0 tx=0).stop 2023-12-12T11:52:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:41.426+0000 7f695c294700 1 -- 172.21.15.63:0/4293480888 shutdown_connections 2023-12-12T11:52:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:41.426+0000 7f695c294700 1 --2- 172.21.15.63:0/4293480888 >> [v2:172.21.15.93:6828/3441331233,v1:172.21.15.93:6829/3441331233] conn(0x7f694006ae40 0x7f694006d2f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:41.426+0000 7f695c294700 1 --2- 172.21.15.63:0/4293480888 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69540fcbf0 0x7f6954071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:41.426+0000 7f695c294700 1 --2- 172.21.15.63:0/4293480888 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69540fde00 0x7f695406ff90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:52:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:41.426+0000 7f695c294700 1 -- 172.21.15.63:0/4293480888 >> 172.21.15.63:0/4293480888 conn(0x7f69540f82d0 msgr2=0x7f6954101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:52:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:41.426+0000 7f695c294700 1 -- 172.21.15.63:0/4293480888 shutdown_connections 2023-12-12T11:52:41.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:52:41.426+0000 7f695c294700 1 -- 172.21.15.63:0/4293480888 wait complete. 2023-12-12T11:52:42.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:41 smithi063 ceph-mon[107117]: from='client.24565 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:52:42.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:41 smithi063 ceph-mon[107117]: pgmap v35: 65 pgs: 65 active+clean; 481 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 18 KiB/s rd, 1.4 MiB/s wr, 146 op/s 2023-12-12T11:52:42.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:41 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/4293480888' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:52:42.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:41 smithi093 ceph-mon[115914]: from='client.24565 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:52:42.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:41 smithi093 ceph-mon[115914]: pgmap v35: 65 pgs: 65 active+clean; 481 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 18 KiB/s rd, 1.4 MiB/s wr, 146 op/s 2023-12-12T11:52:42.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:41 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/4293480888' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:52:44.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:43 smithi063 ceph-mon[107117]: pgmap v36: 65 pgs: 65 active+clean; 473 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 18 KiB/s rd, 1.4 MiB/s wr, 152 op/s 2023-12-12T11:52:44.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:43 smithi093 ceph-mon[115914]: pgmap v36: 65 pgs: 65 active+clean; 473 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 18 KiB/s rd, 1.4 MiB/s wr, 152 op/s 2023-12-12T11:52:46.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:45 smithi063 ceph-mon[107117]: pgmap v37: 65 pgs: 65 active+clean; 310 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 2.0 MiB/s wr, 243 op/s 2023-12-12T11:52:46.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:45 smithi063 ceph-mon[107117]: Standby manager daemon smithi063.zjnfdi restarted 2023-12-12T11:52:46.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:45 smithi063 ceph-mon[107117]: Standby manager daemon smithi063.zjnfdi started 2023-12-12T11:52:46.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:45 smithi063 ceph-mon[107117]: from='mgr.? 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi063.zjnfdi/crt"}]: dispatch 2023-12-12T11:52:46.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:45 smithi063 ceph-mon[107117]: from='mgr.? 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-12T11:52:46.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:45 smithi063 ceph-mon[107117]: from='mgr.? 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi063.zjnfdi/key"}]: dispatch 2023-12-12T11:52:46.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:45 smithi063 ceph-mon[107117]: from='mgr.? 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-12T11:52:46.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:45 smithi093 ceph-mon[115914]: pgmap v37: 65 pgs: 65 active+clean; 310 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 2.0 MiB/s wr, 243 op/s 2023-12-12T11:52:46.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:45 smithi093 ceph-mon[115914]: Standby manager daemon smithi063.zjnfdi restarted 2023-12-12T11:52:46.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:45 smithi093 ceph-mon[115914]: Standby manager daemon smithi063.zjnfdi started 2023-12-12T11:52:46.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:45 smithi093 ceph-mon[115914]: from='mgr.? 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi063.zjnfdi/crt"}]: dispatch 2023-12-12T11:52:46.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:45 smithi093 ceph-mon[115914]: from='mgr.? 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-12T11:52:46.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:45 smithi093 ceph-mon[115914]: from='mgr.? 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi063.zjnfdi/key"}]: dispatch 2023-12-12T11:52:46.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:45 smithi093 ceph-mon[115914]: from='mgr.? 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-12T11:52:47.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:46 smithi063 ceph-mon[107117]: mgrmap e25: smithi093.nbtltu(active, since 69s), standbys: smithi063.zjnfdi 2023-12-12T11:52:47.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:46 smithi093 ceph-mon[115914]: mgrmap e25: smithi093.nbtltu(active, since 69s), standbys: smithi063.zjnfdi 2023-12-12T11:52:48.296 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:47 smithi063 ceph-mon[107117]: pgmap v38: 65 pgs: 65 active+clean; 310 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 1.2 MiB/s wr, 195 op/s 2023-12-12T11:52:48.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:47 smithi093 ceph-mon[115914]: pgmap v38: 65 pgs: 65 active+clean; 310 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 1.2 MiB/s wr, 195 op/s 2023-12-12T11:52:50.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:49 smithi063 ceph-mon[107117]: pgmap v39: 65 pgs: 65 active+clean; 322 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 2.2 MiB/s wr, 238 op/s 2023-12-12T11:52:50.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:49 smithi093 ceph-mon[115914]: pgmap v39: 65 pgs: 65 active+clean; 322 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 2.2 MiB/s wr, 238 op/s 2023-12-12T11:52:52.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:51 smithi063 ceph-mon[107117]: pgmap v40: 65 pgs: 65 active+clean; 322 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 12 KiB/s rd, 1.6 MiB/s wr, 142 op/s 2023-12-12T11:52:52.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:51 smithi093 ceph-mon[115914]: pgmap v40: 65 pgs: 65 active+clean; 322 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 12 KiB/s rd, 1.6 MiB/s wr, 142 op/s 2023-12-12T11:52:53.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:53 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:52:53.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:53 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:52:54.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:54 smithi063 ceph-mon[107117]: pgmap v41: 65 pgs: 65 active+clean; 321 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 12 KiB/s rd, 1.6 MiB/s wr, 156 op/s 2023-12-12T11:52:54.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:54 smithi093 ceph-mon[115914]: pgmap v41: 65 pgs: 65 active+clean; 321 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 12 KiB/s rd, 1.6 MiB/s wr, 156 op/s 2023-12-12T11:52:56.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:56 smithi063 ceph-mon[107117]: pgmap v42: 65 pgs: 65 active+clean; 327 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 2.4 MiB/s wr, 320 op/s 2023-12-12T11:52:56.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:56 smithi093 ceph-mon[115914]: pgmap v42: 65 pgs: 65 active+clean; 327 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 2.4 MiB/s wr, 320 op/s 2023-12-12T11:52:57.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:57.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:57.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:52:57.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:52:57.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:57.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:52:57.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "mgr fail", "who": "smithi093.nbtltu"}]: dispatch 2023-12-12T11:52:57.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: osdmap e48: 6 total, 6 up, 6 in 2023-12-12T11:52:57.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd='[{"prefix": "mgr fail", "who": "smithi093.nbtltu"}]': finished 2023-12-12T11:52:57.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: mgrmap e26: smithi063.zjnfdi(active, starting, since 0.00794304s) 2023-12-12T11:52:57.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-12T11:52:57.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi093"}]: dispatch 2023-12-12T11:52:57.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.aevpzg"}]: dispatch 2023-12-12T11:52:57.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi093.swdqms"}]: dispatch 2023-12-12T11:52:57.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.bdqbnp"}]: dispatch 2023-12-12T11:52:57.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi093.rhaqsh"}]: dispatch 2023-12-12T11:52:57.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr metadata", "who": "smithi063.zjnfdi", "id": "smithi063.zjnfdi"}]: dispatch 2023-12-12T11:52:57.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-12T11:52:57.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-12T11:52:57.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-12T11:52:57.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-12T11:52:57.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-12T11:52:57.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-12T11:52:57.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-12T11:52:57.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-12T11:52:57.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-12T11:52:57.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: Manager daemon smithi063.zjnfdi is now available 2023-12-12T11:52:57.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:52:57.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:52:57.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:52:57.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.zjnfdi/mirror_snapshot_schedule"}]: dispatch 2023-12-12T11:52:57.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:57 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.zjnfdi/trash_purge_schedule"}]: dispatch 2023-12-12T11:52:57.946 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:57.947 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:57.947 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:52:57.947 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:52:57.947 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' 2023-12-12T11:52:57.947 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:52:57.947 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "mgr fail", "who": "smithi093.nbtltu"}]: dispatch 2023-12-12T11:52:57.947 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: osdmap e48: 6 total, 6 up, 6 in 2023-12-12T11:52:57.947 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: from='mgr.24471 172.21.15.93:0/4231006265' entity='mgr.smithi093.nbtltu' cmd='[{"prefix": "mgr fail", "who": "smithi093.nbtltu"}]': finished 2023-12-12T11:52:57.947 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: mgrmap e26: smithi063.zjnfdi(active, starting, since 0.00794304s) 2023-12-12T11:52:57.947 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-12T11:52:57.947 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi093"}]: dispatch 2023-12-12T11:52:57.947 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.aevpzg"}]: dispatch 2023-12-12T11:52:57.948 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi093.swdqms"}]: dispatch 2023-12-12T11:52:57.948 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.bdqbnp"}]: dispatch 2023-12-12T11:52:57.948 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi093.rhaqsh"}]: dispatch 2023-12-12T11:52:57.948 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr metadata", "who": "smithi063.zjnfdi", "id": "smithi063.zjnfdi"}]: dispatch 2023-12-12T11:52:57.948 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-12T11:52:57.948 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-12T11:52:57.948 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-12T11:52:57.948 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-12T11:52:57.948 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-12T11:52:57.948 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-12T11:52:57.948 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-12T11:52:57.948 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-12T11:52:57.948 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-12T11:52:57.948 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: Manager daemon smithi063.zjnfdi is now available 2023-12-12T11:52:57.948 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:52:57.949 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:52:57.949 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:52:57.949 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.zjnfdi/mirror_snapshot_schedule"}]: dispatch 2023-12-12T11:52:57.949 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:57 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.zjnfdi/trash_purge_schedule"}]: dispatch 2023-12-12T11:52:59.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:58 smithi063 ceph-mon[107117]: mgrmap e27: smithi063.zjnfdi(active, since 1.0135s) 2023-12-12T11:52:59.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:58 smithi063 ceph-mon[107117]: [12/Dec/2023:11:52:57] ENGINE Bus STARTING 2023-12-12T11:52:59.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:58 smithi063 ceph-mon[107117]: [12/Dec/2023:11:52:58] ENGINE Serving on http://172.21.15.63:8765 2023-12-12T11:52:59.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:58 smithi063 ceph-mon[107117]: [12/Dec/2023:11:52:58] ENGINE Serving on https://172.21.15.63:7150 2023-12-12T11:52:59.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:58 smithi063 ceph-mon[107117]: [12/Dec/2023:11:52:58] ENGINE Bus STARTED 2023-12-12T11:52:59.120 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:58 smithi093 ceph-mon[115914]: mgrmap e27: smithi063.zjnfdi(active, since 1.0135s) 2023-12-12T11:52:59.120 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:58 smithi093 ceph-mon[115914]: [12/Dec/2023:11:52:57] ENGINE Bus STARTING 2023-12-12T11:52:59.120 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:58 smithi093 ceph-mon[115914]: [12/Dec/2023:11:52:58] ENGINE Serving on http://172.21.15.63:8765 2023-12-12T11:52:59.120 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:58 smithi093 ceph-mon[115914]: [12/Dec/2023:11:52:58] ENGINE Serving on https://172.21.15.63:7150 2023-12-12T11:52:59.120 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:58 smithi093 ceph-mon[115914]: [12/Dec/2023:11:52:58] ENGINE Bus STARTED 2023-12-12T11:53:00.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:52:59 smithi093 ceph-mon[115914]: pgmap v4: 65 pgs: 65 active+clean; 332 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:53:00.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:52:59 smithi063 ceph-mon[107117]: pgmap v4: 65 pgs: 65 active+clean; 332 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:53:01.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:00 smithi093 ceph-mon[115914]: mgrmap e28: smithi063.zjnfdi(active, since 3s) 2023-12-12T11:53:01.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:00 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:01.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:00 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:01.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:00 smithi063 ceph-mon[107117]: mgrmap e28: smithi063.zjnfdi(active, since 3s) 2023-12-12T11:53:01.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:00 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:01.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:00 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:02.204 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:01 smithi093 ceph-mon[115914]: pgmap v5: 65 pgs: 65 active+clean; 332 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:53:02.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:01 smithi063 ceph-mon[107117]: pgmap v5: 65 pgs: 65 active+clean; 332 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:53:03.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:02 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:03.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:02 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:03.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:02 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:03.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:02 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:04.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:03 smithi063 ceph-mon[107117]: pgmap v6: 65 pgs: 65 active+clean; 332 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:53:04.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:03 smithi093 ceph-mon[115914]: pgmap v6: 65 pgs: 65 active+clean; 332 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:53:06.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:05 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:06.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:05 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:06.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:05 smithi063 ceph-mon[107117]: pgmap v7: 65 pgs: 65 active+clean; 332 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 54 KiB/s rd, 1.4 MiB/s wr, 704 op/s 2023-12-12T11:53:06.220 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:05 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:06.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:05 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:06.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:05 smithi093 ceph-mon[115914]: pgmap v7: 65 pgs: 65 active+clean; 332 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 54 KiB/s rd, 1.4 MiB/s wr, 704 op/s 2023-12-12T11:53:07.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:07 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:07.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:07 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:07.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:07 smithi063 ceph-mon[107117]: pgmap v8: 65 pgs: 65 active+clean; 332 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.1 MiB/s wr, 547 op/s 2023-12-12T11:53:07.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:07 smithi063 ceph-mon[107117]: Standby manager daemon smithi093.nbtltu started 2023-12-12T11:53:07.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:07 smithi063 ceph-mon[107117]: from='mgr.? 172.21.15.93:0/2688246396' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi093.nbtltu/crt"}]: dispatch 2023-12-12T11:53:07.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:07 smithi063 ceph-mon[107117]: from='mgr.? 172.21.15.93:0/2688246396' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-12T11:53:07.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:07 smithi063 ceph-mon[107117]: from='mgr.? 172.21.15.93:0/2688246396' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi093.nbtltu/key"}]: dispatch 2023-12-12T11:53:07.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:07 smithi063 ceph-mon[107117]: from='mgr.? 172.21.15.93:0/2688246396' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-12T11:53:07.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:07 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:07.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:07 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:07.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:07 smithi093 ceph-mon[115914]: pgmap v8: 65 pgs: 65 active+clean; 332 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.1 MiB/s wr, 547 op/s 2023-12-12T11:53:07.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:07 smithi093 ceph-mon[115914]: Standby manager daemon smithi093.nbtltu started 2023-12-12T11:53:07.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:07 smithi093 ceph-mon[115914]: from='mgr.? 172.21.15.93:0/2688246396' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi093.nbtltu/crt"}]: dispatch 2023-12-12T11:53:07.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:07 smithi093 ceph-mon[115914]: from='mgr.? 172.21.15.93:0/2688246396' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-12T11:53:07.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:07 smithi093 ceph-mon[115914]: from='mgr.? 172.21.15.93:0/2688246396' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi093.nbtltu/key"}]: dispatch 2023-12-12T11:53:07.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:07 smithi093 ceph-mon[115914]: from='mgr.? 172.21.15.93:0/2688246396' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-12T11:53:08.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:08 smithi093 ceph-mon[115914]: mgrmap e29: smithi063.zjnfdi(active, since 10s), standbys: smithi093.nbtltu 2023-12-12T11:53:08.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:08 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr metadata", "who": "smithi093.nbtltu", "id": "smithi093.nbtltu"}]: dispatch 2023-12-12T11:53:09.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:08 smithi063 ceph-mon[107117]: mgrmap e29: smithi063.zjnfdi(active, since 10s), standbys: smithi093.nbtltu 2023-12-12T11:53:09.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:08 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr metadata", "who": "smithi093.nbtltu", "id": "smithi093.nbtltu"}]: dispatch 2023-12-12T11:53:09.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:09 smithi093 ceph-mon[115914]: pgmap v9: 65 pgs: 65 active+clean; 325 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 1.8 MiB/s wr, 795 op/s 2023-12-12T11:53:10.013 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:09 smithi063 ceph-mon[107117]: pgmap v9: 65 pgs: 65 active+clean; 325 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 1.8 MiB/s wr, 795 op/s 2023-12-12T11:53:11.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.631+0000 7fc5eaa36700 1 -- 172.21.15.63:0/1294725825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5e40fde00 msgr2=0x7fc5e40fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:11.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.631+0000 7fc5eaa36700 1 --2- 172.21.15.63:0/1294725825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5e40fde00 0x7fc5e40fe250 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8004940 tx=0x7fc5d8009e30 comp rx=0 tx=0).stop 2023-12-12T11:53:11.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.632+0000 7fc5eaa36700 1 -- 172.21.15.63:0/1294725825 shutdown_connections 2023-12-12T11:53:11.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.632+0000 7fc5eaa36700 1 --2- 172.21.15.63:0/1294725825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5e40fde00 0x7fc5e40fe250 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:11.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.632+0000 7fc5eaa36700 1 --2- 172.21.15.63:0/1294725825 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5e40fcbf0 0x7fc5e40fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:11.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.632+0000 7fc5eaa36700 1 -- 172.21.15.63:0/1294725825 >> 172.21.15.63:0/1294725825 conn(0x7fc5e40f82d0 msgr2=0x7fc5e40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:53:11.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.632+0000 7fc5eaa36700 1 -- 172.21.15.63:0/1294725825 shutdown_connections 2023-12-12T11:53:11.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.632+0000 7fc5eaa36700 1 -- 172.21.15.63:0/1294725825 wait complete. 2023-12-12T11:53:11.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.633+0000 7fc5eaa36700 1 Processor -- start 2023-12-12T11:53:11.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.633+0000 7fc5eaa36700 1 -- start start 2023-12-12T11:53:11.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.634+0000 7fc5eaa36700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5e40fcbf0 0x7fc5e410d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:11.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.634+0000 7fc5eaa36700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5e40fde00 0x7fc5e410da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:11.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.634+0000 7fc5eaa36700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e410e020 con 0x7fc5e40fcbf0 2023-12-12T11:53:11.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.634+0000 7fc5eaa36700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e410e8c0 con 0x7fc5e40fde00 2023-12-12T11:53:11.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.634+0000 7fc5e3fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5e40fcbf0 0x7fc5e410d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:11.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.634+0000 7fc5e3fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5e40fcbf0 0x7fc5e410d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57518/0 (socket says 172.21.15.63:57518) 2023-12-12T11:53:11.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.634+0000 7fc5e3fff700 1 -- 172.21.15.63:0/1759380469 learned_addr learned my addr 172.21.15.63:0/1759380469 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:53:11.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.635+0000 7fc5e37fe700 1 --2- 172.21.15.63:0/1759380469 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5e40fde00 0x7fc5e410da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:11.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.635+0000 7fc5e3fff700 1 -- 172.21.15.63:0/1759380469 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5e40fde00 msgr2=0x7fc5e410da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:11.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.635+0000 7fc5e3fff700 1 --2- 172.21.15.63:0/1759380469 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5e40fde00 0x7fc5e410da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:11.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.635+0000 7fc5e3fff700 1 -- 172.21.15.63:0/1759380469 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d8005040 con 0x7fc5e40fcbf0 2023-12-12T11:53:11.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.635+0000 7fc5e3fff700 1 --2- 172.21.15.63:0/1759380469 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5e40fcbf0 0x7fc5e410d4e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc5d400eb40 tx=0x7fc5d400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:53:11.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.635+0000 7fc5e0ff9700 1 -- 172.21.15.63:0/1759380469 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5d4007cc0 con 0x7fc5e40fcbf0 2023-12-12T11:53:11.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.635+0000 7fc5e0ff9700 1 -- 172.21.15.63:0/1759380469 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc5d400f040 con 0x7fc5e40fcbf0 2023-12-12T11:53:11.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.635+0000 7fc5e0ff9700 1 -- 172.21.15.63:0/1759380469 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5d400cad0 con 0x7fc5e40fcbf0 2023-12-12T11:53:11.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.635+0000 7fc5eaa36700 1 -- 172.21.15.63:0/1759380469 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e410eac0 con 0x7fc5e40fcbf0 2023-12-12T11:53:11.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.636+0000 7fc5eaa36700 1 -- 172.21.15.63:0/1759380469 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e410f000 con 0x7fc5e40fcbf0 2023-12-12T11:53:11.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.637+0000 7fc5eaa36700 1 -- 172.21.15.63:0/1759380469 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e404bb80 con 0x7fc5e40fcbf0 2023-12-12T11:53:11.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.639+0000 7fc5e0ff9700 1 -- 172.21.15.63:0/1759380469 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 29) v1 ==== 90899+0+0 (secure 0 0 0) 0x7fc5d400cc30 con 0x7fc5e40fcbf0 2023-12-12T11:53:11.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.641+0000 7fc5e0ff9700 1 --2- 172.21.15.63:0/1759380469 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7fc5cc06cc00 0x7fc5cc06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:11.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.642+0000 7fc5e0ff9700 1 -- 172.21.15.63:0/1759380469 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fc5d408bef0 con 0x7fc5e40fcbf0 2023-12-12T11:53:11.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.642+0000 7fc5e37fe700 1 --2- 172.21.15.63:0/1759380469 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7fc5cc06cc00 0x7fc5cc06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:11.646 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.643+0000 7fc5e37fe700 1 --2- 172.21.15.63:0/1759380469 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7fc5cc06cc00 0x7fc5cc06f0b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc5d800b0d0 tx=0x7fc5d8009e30 comp rx=0 tx=0).ready entity=mgr.14732 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:53:11.647 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:11.645+0000 7fc5e0ff9700 1 -- 172.21.15.63:0/1759380469 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fc5d40b8ce0 con 0x7fc5e40fcbf0 2023-12-12T11:53:11.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:11 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:11.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:11 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:11.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:11 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:53:11.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:11 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:53:11.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:11 smithi093 ceph-mon[115914]: Updating smithi063:/etc/ceph/ceph.conf 2023-12-12T11:53:11.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:11 smithi093 ceph-mon[115914]: Updating smithi093:/etc/ceph/ceph.conf 2023-12-12T11:53:11.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:11 smithi093 ceph-mon[115914]: pgmap v10: 65 pgs: 65 active+clean; 325 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.6 MiB/s wr, 728 op/s 2023-12-12T11:53:12.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.040+0000 7fc5eaa36700 1 -- 172.21.15.63:0/1759380469 --> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5e4102750 con 0x7fc5cc06cc00 2023-12-12T11:53:12.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:11 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:12.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:11 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:12.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:11 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:53:12.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:11 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:53:12.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:11 smithi063 ceph-mon[107117]: Updating smithi063:/etc/ceph/ceph.conf 2023-12-12T11:53:12.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:11 smithi063 ceph-mon[107117]: Updating smithi093:/etc/ceph/ceph.conf 2023-12-12T11:53:12.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:11 smithi063 ceph-mon[107117]: pgmap v10: 65 pgs: 65 active+clean; 325 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.6 MiB/s wr, 728 op/s 2023-12-12T11:53:12.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.042+0000 7fc5e0ff9700 1 -- 172.21.15.63:0/1759380469 <== mgr.14732 v2:172.21.15.63:6800/368827847 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fc5e4102750 con 0x7fc5cc06cc00 2023-12-12T11:53:12.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.045+0000 7fc5eaa36700 1 -- 172.21.15.63:0/1759380469 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7fc5cc06cc00 msgr2=0x7fc5cc06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:12.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.045+0000 7fc5eaa36700 1 --2- 172.21.15.63:0/1759380469 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7fc5cc06cc00 0x7fc5cc06f0b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc5d800b0d0 tx=0x7fc5d8009e30 comp rx=0 tx=0).stop 2023-12-12T11:53:12.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.045+0000 7fc5eaa36700 1 -- 172.21.15.63:0/1759380469 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5e40fcbf0 msgr2=0x7fc5e410d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:12.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.045+0000 7fc5eaa36700 1 --2- 172.21.15.63:0/1759380469 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5e40fcbf0 0x7fc5e410d4e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc5d400eb40 tx=0x7fc5d400b040 comp rx=0 tx=0).stop 2023-12-12T11:53:12.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.045+0000 7fc5eaa36700 1 -- 172.21.15.63:0/1759380469 shutdown_connections 2023-12-12T11:53:12.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.045+0000 7fc5eaa36700 1 --2- 172.21.15.63:0/1759380469 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5e40fcbf0 0x7fc5e410d4e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:12.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.045+0000 7fc5eaa36700 1 --2- 172.21.15.63:0/1759380469 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7fc5cc06cc00 0x7fc5cc06f0b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:12.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.045+0000 7fc5eaa36700 1 --2- 172.21.15.63:0/1759380469 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5e40fde00 0x7fc5e410da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:12.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.045+0000 7fc5eaa36700 1 -- 172.21.15.63:0/1759380469 >> 172.21.15.63:0/1759380469 conn(0x7fc5e40f82d0 msgr2=0x7fc5e4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:53:12.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.045+0000 7fc5eaa36700 1 -- 172.21.15.63:0/1759380469 shutdown_connections 2023-12-12T11:53:12.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.045+0000 7fc5eaa36700 1 -- 172.21.15.63:0/1759380469 wait complete. 2023-12-12T11:53:12.066 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-12T11:53:12.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.303+0000 7f1456376700 1 -- 172.21.15.63:0/800366160 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f14500fcd00 msgr2=0x7f14500fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:12.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.303+0000 7f1456376700 1 --2- 172.21.15.63:0/800366160 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f14500fcd00 0x7f14500fd150 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1444004940 tx=0x7f1444009e30 comp rx=0 tx=0).stop 2023-12-12T11:53:12.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.303+0000 7f1456376700 1 -- 172.21.15.63:0/800366160 shutdown_connections 2023-12-12T11:53:12.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.303+0000 7f1456376700 1 --2- 172.21.15.63:0/800366160 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f14500fcd00 0x7f14500fd150 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:12.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.303+0000 7f1456376700 1 --2- 172.21.15.63:0/800366160 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14500fbaf0 0x7f14500fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:12.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.304+0000 7f1456376700 1 -- 172.21.15.63:0/800366160 >> 172.21.15.63:0/800366160 conn(0x7f14500f7190 msgr2=0x7f14500f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:53:12.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.305+0000 7f1456376700 1 -- 172.21.15.63:0/800366160 shutdown_connections 2023-12-12T11:53:12.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.305+0000 7f1456376700 1 -- 172.21.15.63:0/800366160 wait complete. 2023-12-12T11:53:12.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.306+0000 7f1456376700 1 Processor -- start 2023-12-12T11:53:12.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.306+0000 7f1456376700 1 -- start start 2023-12-12T11:53:12.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.307+0000 7f1456376700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14500fbaf0 0x7f145010b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:12.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.307+0000 7f1456376700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f14500fcd00 0x7f145010b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:12.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.307+0000 7f1456376700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145010bdd0 con 0x7f14500fbaf0 2023-12-12T11:53:12.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.307+0000 7f1456376700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145010c670 con 0x7f14500fcd00 2023-12-12T11:53:12.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.308+0000 7f144ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14500fbaf0 0x7f145010b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:12.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.308+0000 7f144f7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f14500fcd00 0x7f145010b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:12.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.308+0000 7f144f7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f14500fcd00 0x7f145010b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:55988/0 (socket says 172.21.15.63:55988) 2023-12-12T11:53:12.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.308+0000 7f144f7fe700 1 -- 172.21.15.63:0/2005718703 learned_addr learned my addr 172.21.15.63:0/2005718703 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:53:12.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.308+0000 7f144f7fe700 1 -- 172.21.15.63:0/2005718703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14500fbaf0 msgr2=0x7f145010b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:12.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.308+0000 7f144f7fe700 1 --2- 172.21.15.63:0/2005718703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14500fbaf0 0x7f145010b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:12.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.308+0000 7f144f7fe700 1 -- 172.21.15.63:0/2005718703 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1444005040 con 0x7f14500fcd00 2023-12-12T11:53:12.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.308+0000 7f144ffff700 1 --2- 172.21.15.63:0/2005718703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14500fbaf0 0x7f145010b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T11:53:12.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.309+0000 7f144f7fe700 1 --2- 172.21.15.63:0/2005718703 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f14500fcd00 0x7f145010b780 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1444009fd0 tx=0x7f1444009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:53:12.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.309+0000 7f144cff9700 1 -- 172.21.15.63:0/2005718703 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f144400e070 con 0x7f14500fcd00 2023-12-12T11:53:12.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.309+0000 7f144cff9700 1 -- 172.21.15.63:0/2005718703 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f144401c400 con 0x7f14500fcd00 2023-12-12T11:53:12.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.309+0000 7f144cff9700 1 -- 172.21.15.63:0/2005718703 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f144400b650 con 0x7f14500fcd00 2023-12-12T11:53:12.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.310+0000 7f1456376700 1 -- 172.21.15.63:0/2005718703 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f145010c8f0 con 0x7f14500fcd00 2023-12-12T11:53:12.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.310+0000 7f1456376700 1 -- 172.21.15.63:0/2005718703 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f145010cdd0 con 0x7f14500fcd00 2023-12-12T11:53:12.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.312+0000 7f1456376700 1 -- 172.21.15.63:0/2005718703 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f145004bb80 con 0x7f14500fcd00 2023-12-12T11:53:12.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.314+0000 7f144cff9700 1 -- 172.21.15.63:0/2005718703 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 29) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f144400b7b0 con 0x7f14500fcd00 2023-12-12T11:53:12.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.317+0000 7f144cff9700 1 --2- 172.21.15.63:0/2005718703 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f143806cc50 0x7f143806f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:12.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.317+0000 7f144cff9700 1 -- 172.21.15.63:0/2005718703 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f144408d670 con 0x7f14500fcd00 2023-12-12T11:53:12.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.317+0000 7f144ffff700 1 --2- 172.21.15.63:0/2005718703 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f143806cc50 0x7f143806f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:12.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.322+0000 7f144ffff700 1 --2- 172.21.15.63:0/2005718703 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f143806cc50 0x7f143806f100 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f145010afd0 tx=0x7f144000d040 comp rx=0 tx=0).ready entity=mgr.14732 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:53:12.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.323+0000 7f144cff9700 1 -- 172.21.15.63:0/2005718703 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f14440587f0 con 0x7f14500fcd00 2023-12-12T11:53:12.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.677+0000 7f1456376700 1 -- 172.21.15.63:0/2005718703 --> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1450101650 con 0x7f143806cc50 2023-12-12T11:53:12.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.680+0000 7f144cff9700 1 -- 172.21.15.63:0/2005718703 <== mgr.14732 v2:172.21.15.63:6800/368827847 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f1450101650 con 0x7f143806cc50 2023-12-12T11:53:12.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.684+0000 7f1456376700 1 -- 172.21.15.63:0/2005718703 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f143806cc50 msgr2=0x7f143806f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:12.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.684+0000 7f1456376700 1 --2- 172.21.15.63:0/2005718703 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f143806cc50 0x7f143806f100 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f145010afd0 tx=0x7f144000d040 comp rx=0 tx=0).stop 2023-12-12T11:53:12.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.684+0000 7f1456376700 1 -- 172.21.15.63:0/2005718703 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f14500fcd00 msgr2=0x7f145010b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:12.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.684+0000 7f1456376700 1 --2- 172.21.15.63:0/2005718703 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f14500fcd00 0x7f145010b780 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1444009fd0 tx=0x7f1444009e30 comp rx=0 tx=0).stop 2023-12-12T11:53:12.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.684+0000 7f1456376700 1 -- 172.21.15.63:0/2005718703 shutdown_connections 2023-12-12T11:53:12.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.684+0000 7f1456376700 1 --2- 172.21.15.63:0/2005718703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14500fbaf0 0x7f145010b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:12.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.684+0000 7f1456376700 1 --2- 172.21.15.63:0/2005718703 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f143806cc50 0x7f143806f100 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:12.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.684+0000 7f1456376700 1 --2- 172.21.15.63:0/2005718703 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f14500fcd00 0x7f145010b780 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:12.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.684+0000 7f1456376700 1 -- 172.21.15.63:0/2005718703 >> 172.21.15.63:0/2005718703 conn(0x7f14500f7190 msgr2=0x7f14500fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:53:12.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.685+0000 7f1456376700 1 -- 172.21.15.63:0/2005718703 shutdown_connections 2023-12-12T11:53:12.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.685+0000 7f1456376700 1 -- 172.21.15.63:0/2005718703 wait complete. 2023-12-12T11:53:12.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.905+0000 7f6aa262b700 1 -- 172.21.15.63:0/2807606454 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6a9c0faad0 msgr2=0x7f6a9c0faee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:12.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.905+0000 7f6aa262b700 1 --2- 172.21.15.63:0/2807606454 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6a9c0faad0 0x7f6a9c0faee0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c004940 tx=0x7f6a8c009e30 comp rx=0 tx=0).stop 2023-12-12T11:53:12.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.906+0000 7f6aa262b700 1 -- 172.21.15.63:0/2807606454 shutdown_connections 2023-12-12T11:53:12.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.906+0000 7f6aa262b700 1 --2- 172.21.15.63:0/2807606454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a9c0fb4b0 0x7f6a9c104850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:12.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.906+0000 7f6aa262b700 1 --2- 172.21.15.63:0/2807606454 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6a9c0faad0 0x7f6a9c0faee0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:12.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.907+0000 7f6aa262b700 1 -- 172.21.15.63:0/2807606454 >> 172.21.15.63:0/2807606454 conn(0x7f6a9c0f64f0 msgr2=0x7f6a9c0f8920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:53:12.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.907+0000 7f6aa262b700 1 -- 172.21.15.63:0/2807606454 shutdown_connections 2023-12-12T11:53:12.911 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.907+0000 7f6aa262b700 1 -- 172.21.15.63:0/2807606454 wait complete. 2023-12-12T11:53:12.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.911+0000 7f6aa262b700 1 Processor -- start 2023-12-12T11:53:12.915 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.912+0000 7f6aa262b700 1 -- start start 2023-12-12T11:53:12.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.912+0000 7f6aa262b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a9c0faad0 0x7f6a9c113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:12.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.912+0000 7f6aa262b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6a9c1140d0 0x7f6a9c114f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:12.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.912+0000 7f6aa262b700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c114590 con 0x7f6a9c0faad0 2023-12-12T11:53:12.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.912+0000 7f6aa262b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c1146d0 con 0x7f6a9c1140d0 2023-12-12T11:53:12.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.913+0000 7f6a9bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a9c0faad0 0x7f6a9c113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:12.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.913+0000 7f6a9bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a9c0faad0 0x7f6a9c113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57576/0 (socket says 172.21.15.63:57576) 2023-12-12T11:53:12.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.913+0000 7f6a9bfff700 1 -- 172.21.15.63:0/2109446307 learned_addr learned my addr 172.21.15.63:0/2109446307 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:53:12.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.914+0000 7f6a9bfff700 1 -- 172.21.15.63:0/2109446307 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6a9c1140d0 msgr2=0x7f6a9c114f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:12.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.914+0000 7f6a9bfff700 1 --2- 172.21.15.63:0/2109446307 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6a9c1140d0 0x7f6a9c114f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:12.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.914+0000 7f6a9bfff700 1 -- 172.21.15.63:0/2109446307 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8c005040 con 0x7f6a9c0faad0 2023-12-12T11:53:12.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.914+0000 7f6a9bfff700 1 --2- 172.21.15.63:0/2109446307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a9c0faad0 0x7f6a9c113b90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c008f80 tx=0x7f6a8c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:53:12.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.916+0000 7f6a997fa700 1 -- 172.21.15.63:0/2109446307 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a8c00e070 con 0x7f6a9c0faad0 2023-12-12T11:53:12.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.916+0000 7f6a997fa700 1 -- 172.21.15.63:0/2109446307 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6a8c013420 con 0x7f6a9c0faad0 2023-12-12T11:53:12.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.916+0000 7f6a997fa700 1 -- 172.21.15.63:0/2109446307 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a8c01c620 con 0x7f6a9c0faad0 2023-12-12T11:53:12.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.916+0000 7f6aa262b700 1 -- 172.21.15.63:0/2109446307 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a9c115570 con 0x7f6a9c0faad0 2023-12-12T11:53:12.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.917+0000 7f6aa262b700 1 -- 172.21.15.63:0/2109446307 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a9c115a80 con 0x7f6a9c0faad0 2023-12-12T11:53:12.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.919+0000 7f6aa262b700 1 -- 172.21.15.63:0/2109446307 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a9c04bb80 con 0x7f6a9c0faad0 2023-12-12T11:53:12.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.923+0000 7f6a997fa700 1 -- 172.21.15.63:0/2109446307 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 29) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f6a8c013a00 con 0x7f6a9c0faad0 2023-12-12T11:53:12.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.924+0000 7f6a997fa700 1 --2- 172.21.15.63:0/2109446307 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f6a8806cc50 0x7f6a8806f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:12.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.925+0000 7f6a997fa700 1 -- 172.21.15.63:0/2109446307 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f6a8c08dc00 con 0x7f6a9c0faad0 2023-12-12T11:53:12.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.926+0000 7f6a937fe700 1 --2- 172.21.15.63:0/2109446307 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f6a8806cc50 0x7f6a8806f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:12.930 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.928+0000 7f6a937fe700 1 --2- 172.21.15.63:0/2109446307 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f6a8806cc50 0x7f6a8806f100 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0fbee0 tx=0x7f6a84007cc0 comp rx=0 tx=0).ready entity=mgr.14732 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:53:12.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:12.940+0000 7f6a997fa700 1 -- 172.21.15.63:0/2109446307 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f6a8c05b8f0 con 0x7f6a9c0faad0 2023-12-12T11:53:12.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:12 smithi093 ceph-mon[115914]: Updating smithi093:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-12T11:53:12.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:12 smithi093 ceph-mon[115914]: Updating smithi063:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-12T11:53:12.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:12 smithi093 ceph-mon[115914]: Updating smithi093:/etc/ceph/ceph.client.admin.keyring 2023-12-12T11:53:12.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:12 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:53:12.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:12 smithi093 ceph-mon[115914]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:53:13.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:12 smithi063 ceph-mon[107117]: Updating smithi093:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-12T11:53:13.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:12 smithi063 ceph-mon[107117]: Updating smithi063:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-12T11:53:13.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:12 smithi063 ceph-mon[107117]: Updating smithi093:/etc/ceph/ceph.client.admin.keyring 2023-12-12T11:53:13.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:12 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:53:13.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:12 smithi063 ceph-mon[107117]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:53:13.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.304+0000 7f6aa262b700 1 -- 172.21.15.63:0/2109446307 --> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a9c115c10 con 0x7f6a8806cc50 2023-12-12T11:53:13.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.318+0000 7f6a997fa700 1 -- 172.21.15.63:0/2109446307 <== mgr.14732 v2:172.21.15.63:6800/368827847 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f6a9c115c10 con 0x7f6a8806cc50 2023-12-12T11:53:13.320 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-12T11:53:13.321 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (58s) 8s ago 8m 15.2M - 0.25.0 c8568f914cd2 f237d9f64783 2023-12-12T11:53:13.321 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (8m) 8s ago 8m 7818k - 17.2.7-123-gbef78a51 ae6196193935 ee4415610fae 2023-12-12T11:53:13.321 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi093 smithi093 running (7m) 12s ago 7m 7810k - 17.2.7-123-gbef78a51 ae6196193935 f64e68742cfe 2023-12-12T11:53:13.321 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (53s) 8s ago 8m 78.7M - 9.4.7 954c08fa6188 51300a1a5b87 2023-12-12T11:53:13.321 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.aevpzg smithi063 running (4m) 8s ago 4m 7545M - 17.2.7-123-gbef78a51 ae6196193935 df9a6781f836 2023-12-12T11:53:13.321 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.bdqbnp smithi063 running (4m) 8s ago 4m 14.2M - 17.2.7-123-gbef78a51 ae6196193935 0c7e1d21eee9 2023-12-12T11:53:13.321 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.rhaqsh smithi093 running (4m) 12s ago 4m 14.0M - 17.2.7-123-gbef78a51 ae6196193935 257aee771d87 2023-12-12T11:53:13.321 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.swdqms smithi093 running (4m) 12s ago 4m 14.0M - 17.2.7-123-gbef78a51 ae6196193935 f46d7173d3b1 2023-12-12T11:53:13.321 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.zjnfdi smithi063 *:8443,9283,8765 running (41s) 8s ago 10m 482M - 19.0.0-96-gf1fbf3c5 8cf689f388db dab6fa4aaa54 2023-12-12T11:53:13.321 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi093.nbtltu smithi093 *:8443,9283 running (114s) 12s ago 7m 78.2M - 19.0.0-96-gf1fbf3c5 8cf689f388db 58a1ec037be4 2023-12-12T11:53:13.321 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (10m) 8s ago 10m 91.0M 2048M 17.2.7-123-gbef78a51 ae6196193935 ee8e9d7455f9 2023-12-12T11:53:13.321 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi093 smithi093 running (7m) 12s ago 7m 59.2M 2048M 17.2.7-123-gbef78a51 ae6196193935 fac71666a805 2023-12-12T11:53:13.321 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (68s) 8s ago 8m 8774k - 1.5.0 0da6a335fe13 8eed63374ddf 2023-12-12T11:53:13.321 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi093 smithi093 *:9100 running (46s) 12s ago 7m 7788k - 1.5.0 0da6a335fe13 10e19431c1a2 2023-12-12T11:53:13.321 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (7m) 8s ago 7m 610M 1618M 17.2.7-123-gbef78a51 ae6196193935 636790d2b28c 2023-12-12T11:53:13.322 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (6m) 8s ago 6m 679M 1618M 17.2.7-123-gbef78a51 ae6196193935 5388a4bc6b12 2023-12-12T11:53:13.322 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (6m) 8s ago 6m 534M 1618M 17.2.7-123-gbef78a51 ae6196193935 9eb2483337c8 2023-12-12T11:53:13.322 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi093 running (6m) 12s ago 6m 750M 2642M 17.2.7-123-gbef78a51 ae6196193935 5b2bb36b5843 2023-12-12T11:53:13.322 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi093 running (5m) 12s ago 5m 557M 2642M 17.2.7-123-gbef78a51 ae6196193935 7dc3f04b04cb 2023-12-12T11:53:13.322 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi093 running (5m) 12s ago 5m 626M 2642M 17.2.7-123-gbef78a51 ae6196193935 16fe8e4668f1 2023-12-12T11:53:13.322 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (48s) 8s ago 8m 39.9M - 2.43.0 a07b618ecd1d a10dc7ca2537 2023-12-12T11:53:13.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.323+0000 7f6aa262b700 1 -- 172.21.15.63:0/2109446307 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f6a8806cc50 msgr2=0x7f6a8806f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:13.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.323+0000 7f6aa262b700 1 --2- 172.21.15.63:0/2109446307 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f6a8806cc50 0x7f6a8806f100 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0fbee0 tx=0x7f6a84007cc0 comp rx=0 tx=0).stop 2023-12-12T11:53:13.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.323+0000 7f6aa262b700 1 -- 172.21.15.63:0/2109446307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a9c0faad0 msgr2=0x7f6a9c113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:13.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.323+0000 7f6aa262b700 1 --2- 172.21.15.63:0/2109446307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a9c0faad0 0x7f6a9c113b90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c008f80 tx=0x7f6a8c009e30 comp rx=0 tx=0).stop 2023-12-12T11:53:13.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.323+0000 7f6aa262b700 1 -- 172.21.15.63:0/2109446307 shutdown_connections 2023-12-12T11:53:13.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.323+0000 7f6aa262b700 1 --2- 172.21.15.63:0/2109446307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a9c0faad0 0x7f6a9c113b90 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:13.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.323+0000 7f6aa262b700 1 --2- 172.21.15.63:0/2109446307 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f6a8806cc50 0x7f6a8806f100 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:13.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.323+0000 7f6aa262b700 1 --2- 172.21.15.63:0/2109446307 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6a9c1140d0 0x7f6a9c114f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:13.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.323+0000 7f6aa262b700 1 -- 172.21.15.63:0/2109446307 >> 172.21.15.63:0/2109446307 conn(0x7f6a9c0f64f0 msgr2=0x7f6a9c0f71a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:53:13.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.324+0000 7f6aa262b700 1 -- 172.21.15.63:0/2109446307 shutdown_connections 2023-12-12T11:53:13.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.324+0000 7f6aa262b700 1 -- 172.21.15.63:0/2109446307 wait complete. 2023-12-12T11:53:13.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.501+0000 7f33a3ccf700 1 -- 172.21.15.63:0/1739192879 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f339c0fde00 msgr2=0x7f339c0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:13.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.501+0000 7f33a3ccf700 1 --2- 172.21.15.63:0/1739192879 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f339c0fde00 0x7f339c0fe250 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f338c004940 tx=0x7f338c009e30 comp rx=0 tx=0).stop 2023-12-12T11:53:13.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.501+0000 7f33a3ccf700 1 -- 172.21.15.63:0/1739192879 shutdown_connections 2023-12-12T11:53:13.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.501+0000 7f33a3ccf700 1 --2- 172.21.15.63:0/1739192879 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f339c0fde00 0x7f339c0fe250 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:13.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.501+0000 7f33a3ccf700 1 --2- 172.21.15.63:0/1739192879 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f339c0fcbf0 0x7f339c0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:13.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.501+0000 7f33a3ccf700 1 -- 172.21.15.63:0/1739192879 >> 172.21.15.63:0/1739192879 conn(0x7f339c0f82d0 msgr2=0x7f339c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:53:13.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.501+0000 7f33a3ccf700 1 -- 172.21.15.63:0/1739192879 shutdown_connections 2023-12-12T11:53:13.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.501+0000 7f33a3ccf700 1 -- 172.21.15.63:0/1739192879 wait complete. 2023-12-12T11:53:13.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.502+0000 7f33a3ccf700 1 Processor -- start 2023-12-12T11:53:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.502+0000 7f33a3ccf700 1 -- start start 2023-12-12T11:53:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.502+0000 7f33a3ccf700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f339c0fcbf0 0x7f339c10b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.502+0000 7f33a3ccf700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f339c0fde00 0x7f339c10b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.502+0000 7f33a3ccf700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c10be90 con 0x7f339c0fcbf0 2023-12-12T11:53:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.502+0000 7f33a3ccf700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c10c730 con 0x7f339c0fde00 2023-12-12T11:53:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.503+0000 7f33a126a700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f339c0fde00 0x7f339c10b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.503+0000 7f33a126a700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f339c0fde00 0x7f339c10b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:56014/0 (socket says 172.21.15.63:56014) 2023-12-12T11:53:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.503+0000 7f33a126a700 1 -- 172.21.15.63:0/300753403 learned_addr learned my addr 172.21.15.63:0/300753403 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:53:13.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.503+0000 7f33a126a700 1 -- 172.21.15.63:0/300753403 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f339c0fcbf0 msgr2=0x7f339c10b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:13.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.503+0000 7f33a126a700 1 --2- 172.21.15.63:0/300753403 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f339c0fcbf0 0x7f339c10b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:13.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.503+0000 7f33a126a700 1 -- 172.21.15.63:0/300753403 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338c005040 con 0x7f339c0fde00 2023-12-12T11:53:13.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.504+0000 7f33a126a700 1 --2- 172.21.15.63:0/300753403 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f339c0fde00 0x7f339c10b840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f338c00b3b0 tx=0x7f338c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:53:13.507 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.504+0000 7f33927fc700 1 -- 172.21.15.63:0/300753403 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f338c00e040 con 0x7f339c0fde00 2023-12-12T11:53:13.507 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.504+0000 7f33a3ccf700 1 -- 172.21.15.63:0/300753403 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f339c10c9b0 con 0x7f339c0fde00 2023-12-12T11:53:13.507 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.504+0000 7f33927fc700 1 -- 172.21.15.63:0/300753403 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f338c004290 con 0x7f339c0fde00 2023-12-12T11:53:13.507 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.504+0000 7f33927fc700 1 -- 172.21.15.63:0/300753403 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f338c01c3f0 con 0x7f339c0fde00 2023-12-12T11:53:13.507 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.504+0000 7f33a3ccf700 1 -- 172.21.15.63:0/300753403 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f339c10ce30 con 0x7f339c0fde00 2023-12-12T11:53:13.508 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.506+0000 7f33a3ccf700 1 -- 172.21.15.63:0/300753403 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f339c04bb80 con 0x7f339c0fde00 2023-12-12T11:53:13.509 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.507+0000 7f33927fc700 1 -- 172.21.15.63:0/300753403 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 29) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f338c013420 con 0x7f339c0fde00 2023-12-12T11:53:13.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.508+0000 7f33927fc700 1 --2- 172.21.15.63:0/300753403 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f338806cc00 0x7f338806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:13.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.508+0000 7f33927fc700 1 -- 172.21.15.63:0/300753403 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f338c08d610 con 0x7f339c0fde00 2023-12-12T11:53:13.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.509+0000 7f33a1a6b700 1 --2- 172.21.15.63:0/300753403 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f338806cc00 0x7f338806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:13.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.510+0000 7f33a1a6b700 1 --2- 172.21.15.63:0/300753403 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f338806cc00 0x7f338806f0b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3398009b80 tx=0x7f3398009d60 comp rx=0 tx=0).ready entity=mgr.14732 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:53:13.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.513+0000 7f33927fc700 1 -- 172.21.15.63:0/300753403 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f338c0576b0 con 0x7f339c0fde00 2023-12-12T11:53:13.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:13 smithi093 ceph-mon[115914]: Updating smithi063:/etc/ceph/ceph.client.admin.keyring 2023-12-12T11:53:13.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:13 smithi093 ceph-mon[115914]: Updating smithi093:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-12T11:53:13.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:13 smithi093 ceph-mon[115914]: from='client.24605 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:53:13.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:13 smithi093 ceph-mon[115914]: pgmap v11: 65 pgs: 65 active+clean; 325 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.6 MiB/s wr, 728 op/s 2023-12-12T11:53:13.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:13 smithi093 ceph-mon[115914]: Updating smithi063:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-12T11:53:13.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:13 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:13.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:13 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:13.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.975+0000 7f33a3ccf700 1 -- 172.21.15.63:0/300753403 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f339c10d1d0 con 0x7f339c0fde00 2023-12-12T11:53:13.978 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.976+0000 7f33927fc700 1 -- 172.21.15.63:0/300753403 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f338c05acd0 con 0x7f339c0fde00 2023-12-12T11:53:13.978 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:53:13.979 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-12T11:53:13.979 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 2 2023-12-12T11:53:13.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:53:13.979 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-12T11:53:13.979 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 2 2023-12-12T11:53:13.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:53:13.979 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-12T11:53:13.979 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 6 2023-12-12T11:53:13.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:53:13.979 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-12T11:53:13.979 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 4 2023-12-12T11:53:13.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:53:13.979 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-12T11:53:13.979 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 12, 2023-12-12T11:53:13.979 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 2 2023-12-12T11:53:13.980 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-12T11:53:13.980 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:53:13.982 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.979+0000 7f33a3ccf700 1 -- 172.21.15.63:0/300753403 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f338806cc00 msgr2=0x7f338806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:13.982 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.979+0000 7f33a3ccf700 1 --2- 172.21.15.63:0/300753403 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f338806cc00 0x7f338806f0b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3398009b80 tx=0x7f3398009d60 comp rx=0 tx=0).stop 2023-12-12T11:53:13.982 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.979+0000 7f33a3ccf700 1 -- 172.21.15.63:0/300753403 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f339c0fde00 msgr2=0x7f339c10b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:13.982 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.979+0000 7f33a3ccf700 1 --2- 172.21.15.63:0/300753403 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f339c0fde00 0x7f339c10b840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f338c00b3b0 tx=0x7f338c009e30 comp rx=0 tx=0).stop 2023-12-12T11:53:13.983 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.980+0000 7f33a3ccf700 1 -- 172.21.15.63:0/300753403 shutdown_connections 2023-12-12T11:53:13.983 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.980+0000 7f33a3ccf700 1 --2- 172.21.15.63:0/300753403 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f339c0fcbf0 0x7f339c10b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:13.983 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.980+0000 7f33a3ccf700 1 --2- 172.21.15.63:0/300753403 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f338806cc00 0x7f338806f0b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:13.983 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.980+0000 7f33a3ccf700 1 --2- 172.21.15.63:0/300753403 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f339c0fde00 0x7f339c10b840 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:13.983 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.980+0000 7f33a3ccf700 1 -- 172.21.15.63:0/300753403 >> 172.21.15.63:0/300753403 conn(0x7f339c0f82d0 msgr2=0x7f339c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:53:13.983 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.980+0000 7f33a3ccf700 1 -- 172.21.15.63:0/300753403 shutdown_connections 2023-12-12T11:53:13.983 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:13.980+0000 7f33a3ccf700 1 -- 172.21.15.63:0/300753403 wait complete. 2023-12-12T11:53:14.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:13 smithi063 ceph-mon[107117]: Updating smithi063:/etc/ceph/ceph.client.admin.keyring 2023-12-12T11:53:14.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:13 smithi063 ceph-mon[107117]: Updating smithi093:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-12T11:53:14.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:13 smithi063 ceph-mon[107117]: from='client.24605 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:53:14.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:13 smithi063 ceph-mon[107117]: pgmap v11: 65 pgs: 65 active+clean; 325 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.6 MiB/s wr, 728 op/s 2023-12-12T11:53:14.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:13 smithi063 ceph-mon[107117]: Updating smithi063:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-12T11:53:14.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:13 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:14.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:13 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:14.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.174+0000 7f8622b0a700 1 -- 172.21.15.63:0/2499705534 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f861c0fcbf0 msgr2=0x7f861c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:14.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.174+0000 7f8622b0a700 1 --2- 172.21.15.63:0/2499705534 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f861c0fcbf0 0x7f861c0fd000 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8610004940 tx=0x7f8610009e30 comp rx=0 tx=0).stop 2023-12-12T11:53:14.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.174+0000 7f8622b0a700 1 -- 172.21.15.63:0/2499705534 shutdown_connections 2023-12-12T11:53:14.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.174+0000 7f8622b0a700 1 --2- 172.21.15.63:0/2499705534 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f861c0fde00 0x7f861c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:14.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.174+0000 7f8622b0a700 1 --2- 172.21.15.63:0/2499705534 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f861c0fcbf0 0x7f861c0fd000 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:14.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.174+0000 7f8622b0a700 1 -- 172.21.15.63:0/2499705534 >> 172.21.15.63:0/2499705534 conn(0x7f861c0f82d0 msgr2=0x7f861c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:53:14.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.174+0000 7f8622b0a700 1 -- 172.21.15.63:0/2499705534 shutdown_connections 2023-12-12T11:53:14.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.174+0000 7f8622b0a700 1 -- 172.21.15.63:0/2499705534 wait complete. 2023-12-12T11:53:14.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.175+0000 7f8622b0a700 1 Processor -- start 2023-12-12T11:53:14.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.176+0000 7f8622b0a700 1 -- start start 2023-12-12T11:53:14.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.176+0000 7f8622b0a700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f861c0fcbf0 0x7f861c10d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:14.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.176+0000 7f8622b0a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f861c0fde00 0x7f861c10da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:14.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.176+0000 7f8622b0a700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861c10e010 con 0x7f861c0fde00 2023-12-12T11:53:14.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.176+0000 7f8622b0a700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861c10e8b0 con 0x7f861c0fcbf0 2023-12-12T11:53:14.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.176+0000 7f861bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f861c0fde00 0x7f861c10da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:14.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.176+0000 7f86208a6700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f861c0fcbf0 0x7f861c10d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:14.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.176+0000 7f86208a6700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f861c0fcbf0 0x7f861c10d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:56024/0 (socket says 172.21.15.63:56024) 2023-12-12T11:53:14.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.176+0000 7f86208a6700 1 -- 172.21.15.63:0/1787357249 learned_addr learned my addr 172.21.15.63:0/1787357249 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:53:14.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.177+0000 7f86208a6700 1 -- 172.21.15.63:0/1787357249 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f861c0fde00 msgr2=0x7f861c10da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:14.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.177+0000 7f86208a6700 1 --2- 172.21.15.63:0/1787357249 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f861c0fde00 0x7f861c10da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:14.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.177+0000 7f86208a6700 1 -- 172.21.15.63:0/1787357249 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8610005040 con 0x7f861c0fcbf0 2023-12-12T11:53:14.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.177+0000 7f861bfff700 1 --2- 172.21.15.63:0/1787357249 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f861c0fde00 0x7f861c10da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T11:53:14.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.177+0000 7f86208a6700 1 --2- 172.21.15.63:0/1787357249 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f861c0fcbf0 0x7f861c10d4d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8610009fd0 tx=0x7f8610009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:53:14.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.177+0000 7f86197fa700 1 -- 172.21.15.63:0/1787357249 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8610021070 con 0x7f861c0fcbf0 2023-12-12T11:53:14.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.177+0000 7f86197fa700 1 -- 172.21.15.63:0/1787357249 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f861001c400 con 0x7f861c0fcbf0 2023-12-12T11:53:14.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.178+0000 7f86197fa700 1 -- 172.21.15.63:0/1787357249 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f861000e070 con 0x7f861c0fcbf0 2023-12-12T11:53:14.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.178+0000 7f8622b0a700 1 -- 172.21.15.63:0/1787357249 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f861c10eb30 con 0x7f861c0fcbf0 2023-12-12T11:53:14.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.178+0000 7f8622b0a700 1 -- 172.21.15.63:0/1787357249 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f861c10f020 con 0x7f861c0fcbf0 2023-12-12T11:53:14.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.179+0000 7f8622b0a700 1 -- 172.21.15.63:0/1787357249 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f861c04bb80 con 0x7f861c0fcbf0 2023-12-12T11:53:14.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.180+0000 7f86197fa700 1 -- 172.21.15.63:0/1787357249 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 29) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f861001c9c0 con 0x7f861c0fcbf0 2023-12-12T11:53:14.183 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.181+0000 7f86197fa700 1 --2- 172.21.15.63:0/1787357249 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f860c06cc00 0x7f860c06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:14.183 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.181+0000 7f86197fa700 1 -- 172.21.15.63:0/1787357249 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f861008d4d0 con 0x7f861c0fcbf0 2023-12-12T11:53:14.184 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.182+0000 7f861bfff700 1 --2- 172.21.15.63:0/1787357249 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f860c06cc00 0x7f860c06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:14.184 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.182+0000 7f861bfff700 1 --2- 172.21.15.63:0/1787357249 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f860c06cc00 0x7f860c06f0b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8608009b80 tx=0x7f860800b040 comp rx=0 tx=0).ready entity=mgr.14732 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:53:14.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.184+0000 7f86197fa700 1 -- 172.21.15.63:0/1787357249 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f861005b1c0 con 0x7f861c0fcbf0 2023-12-12T11:53:14.561 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.559+0000 7f8622b0a700 1 -- 172.21.15.63:0/1787357249 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f861c10f300 con 0x7f861c0fcbf0 2023-12-12T11:53:14.562 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.559+0000 7f86197fa700 1 -- 172.21.15.63:0/1787357249 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1807 (secure 0 0 0) 0x7f861005ad50 con 0x7f861c0fcbf0 2023-12-12T11:53:14.562 INFO:teuthology.orchestra.run.smithi063.stdout:e13 2023-12-12T11:53:14.562 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-12T11:53:14.562 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:53:14.562 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-12T11:53:14.562 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:53:14.562 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-12T11:53:14.562 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-12T11:53:14.562 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 13 2023-12-12T11:53:14.562 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-12T11:53:14.562 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-12T11:48:58.523481+0000 2023-12-12T11:53:14.562 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-12T11:49:14.113993+0000 2023-12-12T11:53:14.563 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-12T11:53:14.563 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-12T11:53:14.563 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-12T11:53:14.563 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-12T11:53:14.563 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-12T11:53:14.563 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-12T11:53:14.563 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-12T11:53:14.563 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 46 2023-12-12T11:53:14.563 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:53:14.563 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 1 2023-12-12T11:53:14.563 INFO:teuthology.orchestra.run.smithi063.stdout:in 0 2023-12-12T11:53:14.563 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=14492} 2023-12-12T11:53:14.563 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-12T11:53:14.563 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-12T11:53:14.563 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-12T11:53:14.564 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-12T11:53:14.564 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-12T11:53:14.564 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data enabled 2023-12-12T11:53:14.564 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-12T11:53:14.564 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 1 2023-12-12T11:53:14.564 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.aevpzg{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.63:6828/3709000039,v1:172.21.15.63:6829/3709000039] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:53:14.564 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:53:14.564 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:53:14.564 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2023-12-12T11:53:14.564 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:53:14.564 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.swdqms{-1:14500} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.93:6826/3307558569,v1:172.21.15.93:6827/3307558569] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:53:14.564 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.bdqbnp{-1:14508} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/2191270944,v1:172.21.15.63:6827/2191270944] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:53:14.564 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.rhaqsh{-1:24317} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.93:6824/3161864019,v1:172.21.15.93:6825/3161864019] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:53:14.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.562+0000 7f8622b0a700 1 -- 172.21.15.63:0/1787357249 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f860c06cc00 msgr2=0x7f860c06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:14.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.562+0000 7f8622b0a700 1 --2- 172.21.15.63:0/1787357249 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f860c06cc00 0x7f860c06f0b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8608009b80 tx=0x7f860800b040 comp rx=0 tx=0).stop 2023-12-12T11:53:14.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.562+0000 7f8622b0a700 1 -- 172.21.15.63:0/1787357249 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f861c0fcbf0 msgr2=0x7f861c10d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:14.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.562+0000 7f8622b0a700 1 --2- 172.21.15.63:0/1787357249 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f861c0fcbf0 0x7f861c10d4d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8610009fd0 tx=0x7f8610009e30 comp rx=0 tx=0).stop 2023-12-12T11:53:14.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.562+0000 7f8622b0a700 1 -- 172.21.15.63:0/1787357249 shutdown_connections 2023-12-12T11:53:14.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.562+0000 7f8622b0a700 1 --2- 172.21.15.63:0/1787357249 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f860c06cc00 0x7f860c06f0b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:14.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.562+0000 7f8622b0a700 1 --2- 172.21.15.63:0/1787357249 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f861c0fcbf0 0x7f861c10d4d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:14.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.562+0000 7f8622b0a700 1 --2- 172.21.15.63:0/1787357249 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f861c0fde00 0x7f861c10da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:14.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.562+0000 7f8622b0a700 1 -- 172.21.15.63:0/1787357249 >> 172.21.15.63:0/1787357249 conn(0x7f861c0f82d0 msgr2=0x7f861c101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:53:14.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.563+0000 7f8622b0a700 1 -- 172.21.15.63:0/1787357249 shutdown_connections 2023-12-12T11:53:14.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.563+0000 7f8622b0a700 1 -- 172.21.15.63:0/1787357249 wait complete. 2023-12-12T11:53:14.566 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 13 2023-12-12T11:53:14.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.766+0000 7fa72cf9e700 1 -- 172.21.15.63:0/1931976451 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7280fc9f0 msgr2=0x7fa7280fce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:14.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.766+0000 7fa72cf9e700 1 --2- 172.21.15.63:0/1931976451 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7280fc9f0 0x7fa7280fce00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa718004940 tx=0x7fa718009e30 comp rx=0 tx=0).stop 2023-12-12T11:53:14.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.766+0000 7fa72cf9e700 1 -- 172.21.15.63:0/1931976451 shutdown_connections 2023-12-12T11:53:14.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.766+0000 7fa72cf9e700 1 --2- 172.21.15.63:0/1931976451 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7280fdc00 0x7fa7280fe050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:14.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.766+0000 7fa72cf9e700 1 --2- 172.21.15.63:0/1931976451 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7280fc9f0 0x7fa7280fce00 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:14.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.766+0000 7fa72cf9e700 1 -- 172.21.15.63:0/1931976451 >> 172.21.15.63:0/1931976451 conn(0x7fa7280f8090 msgr2=0x7fa7280fa4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:53:14.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.767+0000 7fa72cf9e700 1 -- 172.21.15.63:0/1931976451 shutdown_connections 2023-12-12T11:53:14.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.767+0000 7fa72cf9e700 1 -- 172.21.15.63:0/1931976451 wait complete. 2023-12-12T11:53:14.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.768+0000 7fa72cf9e700 1 Processor -- start 2023-12-12T11:53:14.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.768+0000 7fa72cf9e700 1 -- start start 2023-12-12T11:53:14.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.768+0000 7fa72cf9e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7280fc9f0 0x7fa72810f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:14.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.768+0000 7fa72cf9e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7280fdc00 0x7fa72810f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:14.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.768+0000 7fa72cf9e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72810ffb0 con 0x7fa7280fdc00 2023-12-12T11:53:14.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.768+0000 7fa72cf9e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa728110850 con 0x7fa7280fc9f0 2023-12-12T11:53:14.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.769+0000 7fa726ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7280fdc00 0x7fa72810f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:14.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.769+0000 7fa7277fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7280fc9f0 0x7fa72810f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:14.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.769+0000 7fa726ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7280fdc00 0x7fa72810f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57640/0 (socket says 172.21.15.63:57640) 2023-12-12T11:53:14.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.769+0000 7fa726ffd700 1 -- 172.21.15.63:0/747396669 learned_addr learned my addr 172.21.15.63:0/747396669 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:53:14.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.769+0000 7fa7277fe700 1 -- 172.21.15.63:0/747396669 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7280fdc00 msgr2=0x7fa72810f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:14.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.769+0000 7fa7277fe700 1 --2- 172.21.15.63:0/747396669 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7280fdc00 0x7fa72810f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:14.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.769+0000 7fa7277fe700 1 -- 172.21.15.63:0/747396669 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa718005040 con 0x7fa7280fc9f0 2023-12-12T11:53:14.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.769+0000 7fa726ffd700 1 --2- 172.21.15.63:0/747396669 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7280fdc00 0x7fa72810f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T11:53:14.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.770+0000 7fa7277fe700 1 --2- 172.21.15.63:0/747396669 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7280fc9f0 0x7fa72810f470 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa718009fd0 tx=0x7fa718009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:53:14.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.770+0000 7fa70ffff700 1 -- 172.21.15.63:0/747396669 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa718020070 con 0x7fa7280fc9f0 2023-12-12T11:53:14.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.770+0000 7fa70ffff700 1 -- 172.21.15.63:0/747396669 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa71801c400 con 0x7fa7280fc9f0 2023-12-12T11:53:14.773 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.770+0000 7fa72cf9e700 1 -- 172.21.15.63:0/747396669 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa728110ad0 con 0x7fa7280fc9f0 2023-12-12T11:53:14.773 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.770+0000 7fa70ffff700 1 -- 172.21.15.63:0/747396669 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa71800e070 con 0x7fa7280fc9f0 2023-12-12T11:53:14.773 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.770+0000 7fa72cf9e700 1 -- 172.21.15.63:0/747396669 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa728110fb0 con 0x7fa7280fc9f0 2023-12-12T11:53:14.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.772+0000 7fa70dffb700 1 -- 172.21.15.63:0/747396669 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa72804bb80 con 0x7fa7280fc9f0 2023-12-12T11:53:14.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.773+0000 7fa70ffff700 1 -- 172.21.15.63:0/747396669 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 29) v1 ==== 90899+0+0 (secure 0 0 0) 0x7fa71801c570 con 0x7fa7280fc9f0 2023-12-12T11:53:14.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.774+0000 7fa70ffff700 1 --2- 172.21.15.63:0/747396669 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7fa71006ccd0 0x7fa71006f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:14.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.774+0000 7fa70ffff700 1 -- 172.21.15.63:0/747396669 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fa71808cf00 con 0x7fa7280fc9f0 2023-12-12T11:53:14.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.774+0000 7fa726ffd700 1 --2- 172.21.15.63:0/747396669 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7fa71006ccd0 0x7fa71006f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:14.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.775+0000 7fa726ffd700 1 --2- 172.21.15.63:0/747396669 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7fa71006ccd0 0x7fa71006f180 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa71c0041d0 tx=0x7fa71c00b040 comp rx=0 tx=0).ready entity=mgr.14732 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:53:14.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:14.778+0000 7fa70ffff700 1 -- 172.21.15.63:0/747396669 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fa71805abe0 con 0x7fa7280fc9f0 2023-12-12T11:53:15.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.150+0000 7fa70dffb700 1 -- 172.21.15.63:0/747396669 --> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7281075a0 con 0x7fa71006ccd0 2023-12-12T11:53:15.159 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:53:15.159 INFO:teuthology.orchestra.run.smithi063.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dbb46fd2dbbe029cfba763f2b7c769e980f86b63e74be0c72e188909e20b81f3", 2023-12-12T11:53:15.159 INFO:teuthology.orchestra.run.smithi063.stdout: "in_progress": true, 2023-12-12T11:53:15.159 INFO:teuthology.orchestra.run.smithi063.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-12T11:53:15.159 INFO:teuthology.orchestra.run.smithi063.stdout: "services_complete": [ 2023-12-12T11:53:15.159 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr" 2023-12-12T11:53:15.160 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2023-12-12T11:53:15.160 INFO:teuthology.orchestra.run.smithi063.stdout: "progress": "2/21 daemons upgraded", 2023-12-12T11:53:15.160 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "", 2023-12-12T11:53:15.160 INFO:teuthology.orchestra.run.smithi063.stdout: "is_paused": false 2023-12-12T11:53:15.160 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:53:15.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.156+0000 7fa70ffff700 1 -- 172.21.15.63:0/747396669 <== mgr.14732 v2:172.21.15.63:6800/368827847 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fa7281075a0 con 0x7fa71006ccd0 2023-12-12T11:53:15.162 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.160+0000 7fa70dffb700 1 -- 172.21.15.63:0/747396669 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7fa71006ccd0 msgr2=0x7fa71006f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:15.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.160+0000 7fa70dffb700 1 --2- 172.21.15.63:0/747396669 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7fa71006ccd0 0x7fa71006f180 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa71c0041d0 tx=0x7fa71c00b040 comp rx=0 tx=0).stop 2023-12-12T11:53:15.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.160+0000 7fa70dffb700 1 -- 172.21.15.63:0/747396669 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7280fc9f0 msgr2=0x7fa72810f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:15.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.160+0000 7fa70dffb700 1 --2- 172.21.15.63:0/747396669 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7280fc9f0 0x7fa72810f470 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa718009fd0 tx=0x7fa718009e30 comp rx=0 tx=0).stop 2023-12-12T11:53:15.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.160+0000 7fa70dffb700 1 -- 172.21.15.63:0/747396669 shutdown_connections 2023-12-12T11:53:15.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.160+0000 7fa70dffb700 1 --2- 172.21.15.63:0/747396669 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7fa71006ccd0 0x7fa71006f180 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:15.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.160+0000 7fa70dffb700 1 --2- 172.21.15.63:0/747396669 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7280fc9f0 0x7fa72810f470 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:15.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.160+0000 7fa70dffb700 1 --2- 172.21.15.63:0/747396669 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7280fdc00 0x7fa72810f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:15.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.160+0000 7fa70dffb700 1 -- 172.21.15.63:0/747396669 >> 172.21.15.63:0/747396669 conn(0x7fa7280f8090 msgr2=0x7fa728100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:53:15.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.161+0000 7fa70dffb700 1 -- 172.21.15.63:0/747396669 shutdown_connections 2023-12-12T11:53:15.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.161+0000 7fa70dffb700 1 -- 172.21.15.63:0/747396669 wait complete. 2023-12-12T11:53:15.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:14 smithi093 ceph-mon[115914]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:53:15.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:14 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:15.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:14 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:15.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:14 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:15.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:14 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/300753403' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:53:15.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:14 smithi093 ceph-mon[115914]: Reconfiguring prometheus.smithi063 (dependencies changed)... 2023-12-12T11:53:15.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:14 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/1787357249' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:53:15.289 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:14 smithi063 ceph-mon[107117]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:53:15.289 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:14 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:15.289 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:14 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:15.289 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:14 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:15.290 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:14 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/300753403' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:53:15.290 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:14 smithi063 ceph-mon[107117]: Reconfiguring prometheus.smithi063 (dependencies changed)... 2023-12-12T11:53:15.290 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:14 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/1787357249' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:53:15.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.371+0000 7f168ffe0700 1 -- 172.21.15.63:0/2120775073 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16880fbe70 msgr2=0x7f16880fc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:15.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.371+0000 7f168ffe0700 1 --2- 172.21.15.63:0/2120775073 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16880fbe70 0x7f16880fc2c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1678004940 tx=0x7f1678009e30 comp rx=0 tx=0).stop 2023-12-12T11:53:15.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.371+0000 7f168ffe0700 1 -- 172.21.15.63:0/2120775073 shutdown_connections 2023-12-12T11:53:15.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.371+0000 7f168ffe0700 1 --2- 172.21.15.63:0/2120775073 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16880fbe70 0x7f16880fc2c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:15.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.371+0000 7f168ffe0700 1 --2- 172.21.15.63:0/2120775073 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16880fd110 0x7f16880fd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:15.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.371+0000 7f168ffe0700 1 -- 172.21.15.63:0/2120775073 >> 172.21.15.63:0/2120775073 conn(0x7f16880f6950 msgr2=0x7f16880f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:53:15.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.372+0000 7f168ffe0700 1 -- 172.21.15.63:0/2120775073 shutdown_connections 2023-12-12T11:53:15.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.372+0000 7f168ffe0700 1 -- 172.21.15.63:0/2120775073 wait complete. 2023-12-12T11:53:15.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.373+0000 7f168ffe0700 1 Processor -- start 2023-12-12T11:53:15.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.373+0000 7f168ffe0700 1 -- start start 2023-12-12T11:53:15.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.374+0000 7f168ffe0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16880fbe70 0x7f168810b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:15.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.374+0000 7f168ffe0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16880fd110 0x7f168810b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:15.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.374+0000 7f168ffe0700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168810bd30 con 0x7f16880fbe70 2023-12-12T11:53:15.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.374+0000 7f168dd7c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16880fbe70 0x7f168810b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:15.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.374+0000 7f168ffe0700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168810be70 con 0x7f16880fd110 2023-12-12T11:53:15.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.375+0000 7f168d57b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16880fd110 0x7f168810b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:15.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.375+0000 7f168d57b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16880fd110 0x7f168810b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:56060/0 (socket says 172.21.15.63:56060) 2023-12-12T11:53:15.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.375+0000 7f168d57b700 1 -- 172.21.15.63:0/2250826702 learned_addr learned my addr 172.21.15.63:0/2250826702 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:53:15.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.375+0000 7f168d57b700 1 -- 172.21.15.63:0/2250826702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16880fbe70 msgr2=0x7f168810b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:15.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.375+0000 7f168d57b700 1 --2- 172.21.15.63:0/2250826702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16880fbe70 0x7f168810b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:15.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.375+0000 7f168d57b700 1 -- 172.21.15.63:0/2250826702 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1678005040 con 0x7f16880fd110 2023-12-12T11:53:15.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.375+0000 7f168dd7c700 1 --2- 172.21.15.63:0/2250826702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16880fbe70 0x7f168810b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T11:53:15.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.375+0000 7f168d57b700 1 --2- 172.21.15.63:0/2250826702 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16880fd110 0x7f168810b7a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1678000c00 tx=0x7f1678009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:53:15.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.376+0000 7f167e7fc700 1 -- 172.21.15.63:0/2250826702 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1678021070 con 0x7f16880fd110 2023-12-12T11:53:15.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.376+0000 7f167e7fc700 1 -- 172.21.15.63:0/2250826702 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f167801c400 con 0x7f16880fd110 2023-12-12T11:53:15.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.376+0000 7f167e7fc700 1 -- 172.21.15.63:0/2250826702 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f167800e070 con 0x7f16880fd110 2023-12-12T11:53:15.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.376+0000 7f168ffe0700 1 -- 172.21.15.63:0/2250826702 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168810c7a0 con 0x7f16880fd110 2023-12-12T11:53:15.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.376+0000 7f168ffe0700 1 -- 172.21.15.63:0/2250826702 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f168810cc80 con 0x7f16880fd110 2023-12-12T11:53:15.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.378+0000 7f168ffe0700 1 -- 172.21.15.63:0/2250826702 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f168804bb80 con 0x7f16880fd110 2023-12-12T11:53:15.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.379+0000 7f167e7fc700 1 -- 172.21.15.63:0/2250826702 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 29) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f167801c570 con 0x7f16880fd110 2023-12-12T11:53:15.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.380+0000 7f167e7fc700 1 --2- 172.21.15.63:0/2250826702 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f167406cc00 0x7f167406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:15.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.381+0000 7f167e7fc700 1 -- 172.21.15.63:0/2250826702 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f167808d2c0 con 0x7f16880fd110 2023-12-12T11:53:15.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.381+0000 7f168dd7c700 1 --2- 172.21.15.63:0/2250826702 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f167406cc00 0x7f167406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:15.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.382+0000 7f168dd7c700 1 --2- 172.21.15.63:0/2250826702 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f167406cc00 0x7f167406f0b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f168810aff0 tx=0x7f168400b040 comp rx=0 tx=0).ready entity=mgr.14732 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:53:15.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.385+0000 7f167e7fc700 1 -- 172.21.15.63:0/2250826702 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f1678057460 con 0x7f16880fd110 2023-12-12T11:53:15.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.899+0000 7f168ffe0700 1 -- 172.21.15.63:0/2250826702 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f16881032e0 con 0x7f16880fd110 2023-12-12T11:53:15.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.900+0000 7f167e7fc700 1 -- 172.21.15.63:0/2250826702 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f167805aa80 con 0x7f16880fd110 2023-12-12T11:53:15.902 INFO:teuthology.orchestra.run.smithi063.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-12T11:53:15.903 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-12T11:53:15.903 INFO:teuthology.orchestra.run.smithi063.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-12T11:53:15.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.904+0000 7f168ffe0700 1 -- 172.21.15.63:0/2250826702 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f167406cc00 msgr2=0x7f167406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:15.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.904+0000 7f168ffe0700 1 --2- 172.21.15.63:0/2250826702 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f167406cc00 0x7f167406f0b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f168810aff0 tx=0x7f168400b040 comp rx=0 tx=0).stop 2023-12-12T11:53:15.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.904+0000 7f168ffe0700 1 -- 172.21.15.63:0/2250826702 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16880fd110 msgr2=0x7f168810b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:15.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.904+0000 7f168ffe0700 1 --2- 172.21.15.63:0/2250826702 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16880fd110 0x7f168810b7a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1678000c00 tx=0x7f1678009e30 comp rx=0 tx=0).stop 2023-12-12T11:53:15.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.904+0000 7f168ffe0700 1 -- 172.21.15.63:0/2250826702 shutdown_connections 2023-12-12T11:53:15.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.904+0000 7f168ffe0700 1 --2- 172.21.15.63:0/2250826702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16880fbe70 0x7f168810b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:15.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.904+0000 7f168ffe0700 1 --2- 172.21.15.63:0/2250826702 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f167406cc00 0x7f167406f0b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:15.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.904+0000 7f168ffe0700 1 --2- 172.21.15.63:0/2250826702 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16880fd110 0x7f168810b7a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:15.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.904+0000 7f168ffe0700 1 -- 172.21.15.63:0/2250826702 >> 172.21.15.63:0/2250826702 conn(0x7f16880f6950 msgr2=0x7f16881000b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:53:15.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.905+0000 7f168ffe0700 1 -- 172.21.15.63:0/2250826702 shutdown_connections 2023-12-12T11:53:15.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:15.906+0000 7f168ffe0700 1 -- 172.21.15.63:0/2250826702 wait complete. 2023-12-12T11:53:15.987 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:15 smithi063 ceph-mon[107117]: Reconfiguring daemon prometheus.smithi063 on smithi063 2023-12-12T11:53:15.987 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:15 smithi063 ceph-mon[107117]: pgmap v12: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 62 KiB/s rd, 2.4 MiB/s wr, 1.00k op/s 2023-12-12T11:53:15.987 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:15 smithi063 ceph-mon[107117]: from='client.24619 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:53:15.987 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:15 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/2250826702' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:53:16.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:15 smithi093 ceph-mon[115914]: Reconfiguring daemon prometheus.smithi063 on smithi063 2023-12-12T11:53:16.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:15 smithi093 ceph-mon[115914]: pgmap v12: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 62 KiB/s rd, 2.4 MiB/s wr, 1.00k op/s 2023-12-12T11:53:16.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:15 smithi093 ceph-mon[115914]: from='client.24619 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:53:16.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:15 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/2250826702' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:53:17.750 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:17 smithi063 ceph-mon[107117]: pgmap v13: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 595 op/s 2023-12-12T11:53:17.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:17 smithi093 ceph-mon[115914]: pgmap v13: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 595 op/s 2023-12-12T11:53:20.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:19 smithi093 ceph-mon[115914]: pgmap v14: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 2.3 MiB/s wr, 1.18k op/s 2023-12-12T11:53:20.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:19 smithi063 ceph-mon[107117]: pgmap v14: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 2.3 MiB/s wr, 1.18k op/s 2023-12-12T11:53:22.184 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:21 smithi093 ceph-mon[115914]: pgmap v15: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.5 MiB/s wr, 863 op/s 2023-12-12T11:53:22.184 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:21 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:22.184 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:21 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:22.185 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:21 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-12T11:53:22.185 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:21 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:53:22.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:21 smithi063 ceph-mon[107117]: pgmap v15: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.5 MiB/s wr, 863 op/s 2023-12-12T11:53:22.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:21 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:22.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:21 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:22.296 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:21 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-12T11:53:22.296 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:21 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:53:23.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:22 smithi093 ceph-mon[115914]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-12T11:53:23.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:22 smithi063 ceph-mon[107117]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-12T11:53:23.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:23 smithi093 ceph-mon[115914]: pgmap v16: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.5 MiB/s wr, 863 op/s 2023-12-12T11:53:23.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:23 smithi093 ceph-mon[115914]: Upgrade: Updating mgr.smithi093.nbtltu 2023-12-12T11:53:23.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:23 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi093.nbtltu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-12T11:53:23.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:23 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-12T11:53:23.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:23 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:53:23.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:23 smithi093 ceph-mon[115914]: Deploying daemon mgr.smithi093.nbtltu on smithi093 2023-12-12T11:53:24.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:23 smithi063 ceph-mon[107117]: pgmap v16: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.5 MiB/s wr, 863 op/s 2023-12-12T11:53:24.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:23 smithi063 ceph-mon[107117]: Upgrade: Updating mgr.smithi093.nbtltu 2023-12-12T11:53:24.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:23 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi093.nbtltu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-12T11:53:24.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:23 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-12T11:53:24.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:23 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:53:24.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:23 smithi063 ceph-mon[107117]: Deploying daemon mgr.smithi093.nbtltu on smithi093 2023-12-12T11:53:26.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:25 smithi093 ceph-mon[115914]: pgmap v17: 65 pgs: 65 active+clean; 281 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 2.2 MiB/s wr, 1.42k op/s 2023-12-12T11:53:26.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:25 smithi063 ceph-mon[107117]: pgmap v17: 65 pgs: 65 active+clean; 281 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 2.2 MiB/s wr, 1.42k op/s 2023-12-12T11:53:27.891 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:27 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:27.891 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:27 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:27.891 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:27 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:53:27.892 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:27 smithi093 ceph-mon[115914]: pgmap v18: 65 pgs: 65 active+clean; 281 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.5 MiB/s wr, 1.14k op/s 2023-12-12T11:53:27.892 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:27 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:53:28.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:27 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:28.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:27 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:28.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:27 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:53:28.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:27 smithi063 ceph-mon[107117]: pgmap v18: 65 pgs: 65 active+clean; 281 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.5 MiB/s wr, 1.14k op/s 2023-12-12T11:53:28.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:27 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:53:30.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:29 smithi093 ceph-mon[115914]: pgmap v19: 65 pgs: 65 active+clean; 276 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 2.3 MiB/s wr, 1.41k op/s 2023-12-12T11:53:30.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:29 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:30.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:29 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:30.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:29 smithi063 ceph-mon[107117]: pgmap v19: 65 pgs: 65 active+clean; 276 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 2.3 MiB/s wr, 1.41k op/s 2023-12-12T11:53:30.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:29 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:30.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:29 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:32.153 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:31 smithi093 ceph-mon[115914]: pgmap v20: 65 pgs: 65 active+clean; 276 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 821 op/s 2023-12-12T11:53:32.153 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:31 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:32.153 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:31 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:32.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:31 smithi063 ceph-mon[107117]: pgmap v20: 65 pgs: 65 active+clean; 276 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 821 op/s 2023-12-12T11:53:32.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:31 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:32.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:31 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:33.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:33 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:33.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:33 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:33.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:33 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:33.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:33 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:34.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:34 smithi063 ceph-mon[107117]: pgmap v21: 65 pgs: 65 active+clean; 276 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 821 op/s 2023-12-12T11:53:34.557 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:34 smithi093 ceph-mon[115914]: pgmap v21: 65 pgs: 65 active+clean; 276 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 821 op/s 2023-12-12T11:53:36.403 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:36 smithi093 ceph-mon[115914]: pgmap v22: 65 pgs: 65 active+clean; 267 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 2.1 MiB/s wr, 980 op/s 2023-12-12T11:53:36.403 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:36 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:36.403 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:36 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:36.403 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:36 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:53:36.403 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:36 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:53:36.403 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:36 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:36.403 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:36 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:53:36.404 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:36 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:53:36.404 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:36 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:36.404 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:36 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi063.zjnfdi"}]: dispatch 2023-12-12T11:53:36.404 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:36 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi063.zjnfdi"}]': finished 2023-12-12T11:53:36.404 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:36 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi093.nbtltu"}]: dispatch 2023-12-12T11:53:36.404 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:36 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi093.nbtltu"}]': finished 2023-12-12T11:53:36.404 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:36 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-12T11:53:36.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:36 smithi063 ceph-mon[107117]: pgmap v22: 65 pgs: 65 active+clean; 267 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 2.1 MiB/s wr, 980 op/s 2023-12-12T11:53:36.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:36 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:36.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:36 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:36.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:36 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:53:36.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:36 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:53:36.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:36 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:36.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:36 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:53:36.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:36 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:53:36.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:36 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:36.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:36 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi063.zjnfdi"}]: dispatch 2023-12-12T11:53:36.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:36 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi063.zjnfdi"}]': finished 2023-12-12T11:53:36.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:36 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi093.nbtltu"}]: dispatch 2023-12-12T11:53:36.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:36 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi093.nbtltu"}]': finished 2023-12-12T11:53:36.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:36 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-12T11:53:37.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:37 smithi093 ceph-mon[115914]: Upgrade: Setting container_image for all mgr 2023-12-12T11:53:37.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:37 smithi093 ceph-mon[115914]: Standby manager daemon smithi093.nbtltu restarted 2023-12-12T11:53:37.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:37 smithi093 ceph-mon[115914]: Standby manager daemon smithi093.nbtltu started 2023-12-12T11:53:37.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:37 smithi093 ceph-mon[115914]: from='mgr.? 172.21.15.93:0/1037935204' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi093.nbtltu/crt"}]: dispatch 2023-12-12T11:53:37.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:37 smithi093 ceph-mon[115914]: from='mgr.? 172.21.15.93:0/1037935204' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-12T11:53:37.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:37 smithi093 ceph-mon[115914]: from='mgr.? 172.21.15.93:0/1037935204' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi093.nbtltu/key"}]: dispatch 2023-12-12T11:53:37.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:37 smithi093 ceph-mon[115914]: from='mgr.? 172.21.15.93:0/1037935204' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-12T11:53:37.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:37 smithi063 ceph-mon[107117]: Upgrade: Setting container_image for all mgr 2023-12-12T11:53:37.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:37 smithi063 ceph-mon[107117]: Standby manager daemon smithi093.nbtltu restarted 2023-12-12T11:53:37.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:37 smithi063 ceph-mon[107117]: Standby manager daemon smithi093.nbtltu started 2023-12-12T11:53:37.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:37 smithi063 ceph-mon[107117]: from='mgr.? 172.21.15.93:0/1037935204' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi093.nbtltu/crt"}]: dispatch 2023-12-12T11:53:37.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:37 smithi063 ceph-mon[107117]: from='mgr.? 172.21.15.93:0/1037935204' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-12T11:53:37.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:37 smithi063 ceph-mon[107117]: from='mgr.? 172.21.15.93:0/1037935204' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi093.nbtltu/key"}]: dispatch 2023-12-12T11:53:37.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:37 smithi063 ceph-mon[107117]: from='mgr.? 172.21.15.93:0/1037935204' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-12T11:53:38.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:38 smithi093 ceph-mon[115914]: pgmap v23: 65 pgs: 65 active+clean; 267 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.4 MiB/s wr, 422 op/s 2023-12-12T11:53:38.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:38 smithi093 ceph-mon[115914]: mgrmap e30: smithi063.zjnfdi(active, since 40s), standbys: smithi093.nbtltu 2023-12-12T11:53:38.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:38 smithi063 ceph-mon[107117]: pgmap v23: 65 pgs: 65 active+clean; 267 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.4 MiB/s wr, 422 op/s 2023-12-12T11:53:38.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:38 smithi063 ceph-mon[107117]: mgrmap e30: smithi063.zjnfdi(active, since 40s), standbys: smithi093.nbtltu 2023-12-12T11:53:40.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:40 smithi093 ceph-mon[115914]: pgmap v24: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 2.1 MiB/s wr, 590 op/s 2023-12-12T11:53:40.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:40 smithi063 ceph-mon[107117]: pgmap v24: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 2.1 MiB/s wr, 590 op/s 2023-12-12T11:53:42.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:42 smithi093 ceph-mon[115914]: pgmap v25: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.4 MiB/s wr, 326 op/s 2023-12-12T11:53:42.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:42 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:53:42.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:42 smithi063 ceph-mon[107117]: pgmap v25: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.4 MiB/s wr, 326 op/s 2023-12-12T11:53:42.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:42 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:53:44.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:44 smithi093 ceph-mon[115914]: pgmap v26: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.4 MiB/s wr, 326 op/s 2023-12-12T11:53:44.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:44 smithi063 ceph-mon[107117]: pgmap v26: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.4 MiB/s wr, 326 op/s 2023-12-12T11:53:46.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.117+0000 7fd8ea2fc700 1 -- 172.21.15.63:0/3088081972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8e40fde00 msgr2=0x7fd8e40fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:46.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.117+0000 7fd8ea2fc700 1 --2- 172.21.15.63:0/3088081972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8e40fde00 0x7fd8e40fe250 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8004940 tx=0x7fd8d8009e30 comp rx=0 tx=0).stop 2023-12-12T11:53:46.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.117+0000 7fd8ea2fc700 1 -- 172.21.15.63:0/3088081972 shutdown_connections 2023-12-12T11:53:46.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.117+0000 7fd8ea2fc700 1 --2- 172.21.15.63:0/3088081972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8e40fde00 0x7fd8e40fe250 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:46.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.117+0000 7fd8ea2fc700 1 --2- 172.21.15.63:0/3088081972 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8e40fcbf0 0x7fd8e40fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:46.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.117+0000 7fd8ea2fc700 1 -- 172.21.15.63:0/3088081972 >> 172.21.15.63:0/3088081972 conn(0x7fd8e40f82d0 msgr2=0x7fd8e40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:53:46.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.117+0000 7fd8ea2fc700 1 -- 172.21.15.63:0/3088081972 shutdown_connections 2023-12-12T11:53:46.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.118+0000 7fd8ea2fc700 1 -- 172.21.15.63:0/3088081972 wait complete. 2023-12-12T11:53:46.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.119+0000 7fd8ea2fc700 1 Processor -- start 2023-12-12T11:53:46.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.119+0000 7fd8ea2fc700 1 -- start start 2023-12-12T11:53:46.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.120+0000 7fd8ea2fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8e40fcbf0 0x7fd8e4071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:46.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.120+0000 7fd8ea2fc700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8e40fde00 0x7fd8e4071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:46.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.120+0000 7fd8ea2fc700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e411afb0 con 0x7fd8e40fcbf0 2023-12-12T11:53:46.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.120+0000 7fd8ea2fc700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e411b0f0 con 0x7fd8e40fde00 2023-12-12T11:53:46.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.120+0000 7fd8e37fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8e40fde00 0x7fd8e4071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:46.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.120+0000 7fd8e37fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8e40fde00 0x7fd8e4071ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:45226/0 (socket says 172.21.15.63:45226) 2023-12-12T11:53:46.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.120+0000 7fd8e37fe700 1 -- 172.21.15.63:0/2375278051 learned_addr learned my addr 172.21.15.63:0/2375278051 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:53:46.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.120+0000 7fd8e3fff700 1 --2- 172.21.15.63:0/2375278051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8e40fcbf0 0x7fd8e4071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:46.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.121+0000 7fd8e37fe700 1 -- 172.21.15.63:0/2375278051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8e40fcbf0 msgr2=0x7fd8e4071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:46.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.121+0000 7fd8e37fe700 1 --2- 172.21.15.63:0/2375278051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8e40fcbf0 0x7fd8e4071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:46.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.121+0000 7fd8e37fe700 1 -- 172.21.15.63:0/2375278051 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d8005040 con 0x7fd8e40fde00 2023-12-12T11:53:46.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.121+0000 7fd8e37fe700 1 --2- 172.21.15.63:0/2375278051 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8e40fde00 0x7fd8e4071ab0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8009fd0 tx=0x7fd8d8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:53:46.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.121+0000 7fd8e0ff9700 1 -- 172.21.15.63:0/2375278051 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8d8021070 con 0x7fd8e40fde00 2023-12-12T11:53:46.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.121+0000 7fd8e0ff9700 1 -- 172.21.15.63:0/2375278051 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd8d801c400 con 0x7fd8e40fde00 2023-12-12T11:53:46.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.121+0000 7fd8e0ff9700 1 -- 172.21.15.63:0/2375278051 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8d800e070 con 0x7fd8e40fde00 2023-12-12T11:53:46.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.122+0000 7fd8ea2fc700 1 -- 172.21.15.63:0/2375278051 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e4070100 con 0x7fd8e40fde00 2023-12-12T11:53:46.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.122+0000 7fd8ea2fc700 1 -- 172.21.15.63:0/2375278051 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e40705e0 con 0x7fd8e40fde00 2023-12-12T11:53:46.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.124+0000 7fd8ea2fc700 1 -- 172.21.15.63:0/2375278051 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e404bb80 con 0x7fd8e40fde00 2023-12-12T11:53:46.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.125+0000 7fd8e0ff9700 1 -- 172.21.15.63:0/2375278051 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 30) v1 ==== 90899+0+0 (secure 0 0 0) 0x7fd8d801ca00 con 0x7fd8e40fde00 2023-12-12T11:53:46.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.126+0000 7fd8e0ff9700 1 --2- 172.21.15.63:0/2375278051 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7fd8cc06cc00 0x7fd8cc06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:46.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.126+0000 7fd8e0ff9700 1 -- 172.21.15.63:0/2375278051 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fd8d808cc20 con 0x7fd8e40fde00 2023-12-12T11:53:46.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.127+0000 7fd8e3fff700 1 --2- 172.21.15.63:0/2375278051 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7fd8cc06cc00 0x7fd8cc06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:46.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.128+0000 7fd8e3fff700 1 --2- 172.21.15.63:0/2375278051 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7fd8cc06cc00 0x7fd8cc06f0b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4071300 tx=0x7fd8d400b040 comp rx=0 tx=0).ready entity=mgr.14732 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:53:46.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.130+0000 7fd8e0ff9700 1 -- 172.21.15.63:0/2375278051 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fd8d8056e70 con 0x7fd8e40fde00 2023-12-12T11:53:46.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:46 smithi063 ceph-mon[107117]: pgmap v27: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 2.0 MiB/s wr, 538 op/s 2023-12-12T11:53:46.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:46 smithi093 ceph-mon[115914]: pgmap v27: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 2.0 MiB/s wr, 538 op/s 2023-12-12T11:53:46.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.522+0000 7fd8ea2fc700 1 -- 172.21.15.63:0/2375278051 --> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8e4070e00 con 0x7fd8cc06cc00 2023-12-12T11:53:46.526 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.524+0000 7fd8e0ff9700 1 -- 172.21.15.63:0/2375278051 <== mgr.14732 v2:172.21.15.63:6800/368827847 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fd8e4070e00 con 0x7fd8cc06cc00 2023-12-12T11:53:46.529 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.526+0000 7fd8ea2fc700 1 -- 172.21.15.63:0/2375278051 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7fd8cc06cc00 msgr2=0x7fd8cc06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:46.529 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.526+0000 7fd8ea2fc700 1 --2- 172.21.15.63:0/2375278051 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7fd8cc06cc00 0x7fd8cc06f0b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4071300 tx=0x7fd8d400b040 comp rx=0 tx=0).stop 2023-12-12T11:53:46.529 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.526+0000 7fd8ea2fc700 1 -- 172.21.15.63:0/2375278051 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8e40fde00 msgr2=0x7fd8e4071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:46.529 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.526+0000 7fd8ea2fc700 1 --2- 172.21.15.63:0/2375278051 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8e40fde00 0x7fd8e4071ab0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8009fd0 tx=0x7fd8d8009e30 comp rx=0 tx=0).stop 2023-12-12T11:53:46.529 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.527+0000 7fd8ea2fc700 1 -- 172.21.15.63:0/2375278051 shutdown_connections 2023-12-12T11:53:46.529 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.527+0000 7fd8ea2fc700 1 --2- 172.21.15.63:0/2375278051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8e40fcbf0 0x7fd8e4071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:46.530 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.527+0000 7fd8ea2fc700 1 --2- 172.21.15.63:0/2375278051 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7fd8cc06cc00 0x7fd8cc06f0b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:46.530 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.527+0000 7fd8ea2fc700 1 --2- 172.21.15.63:0/2375278051 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8e40fde00 0x7fd8e4071ab0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:46.530 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.527+0000 7fd8ea2fc700 1 -- 172.21.15.63:0/2375278051 >> 172.21.15.63:0/2375278051 conn(0x7fd8e40f82d0 msgr2=0x7fd8e4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:53:46.530 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.527+0000 7fd8ea2fc700 1 -- 172.21.15.63:0/2375278051 shutdown_connections 2023-12-12T11:53:46.530 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.527+0000 7fd8ea2fc700 1 -- 172.21.15.63:0/2375278051 wait complete. 2023-12-12T11:53:46.545 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-12T11:53:46.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.715+0000 7f9590618700 1 -- 172.21.15.63:0/1442158009 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9588071b60 msgr2=0x7f958806ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:46.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.715+0000 7f9590618700 1 --2- 172.21.15.63:0/1442158009 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9588071b60 0x7f958806ffd0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9584004940 tx=0x7f9584009e30 comp rx=0 tx=0).stop 2023-12-12T11:53:46.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.715+0000 7f9590618700 1 -- 172.21.15.63:0/1442158009 shutdown_connections 2023-12-12T11:53:46.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.715+0000 7f9590618700 1 --2- 172.21.15.63:0/1442158009 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9588070510 0x7f9588070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:46.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.715+0000 7f9590618700 1 --2- 172.21.15.63:0/1442158009 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9588071b60 0x7f958806ffd0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:46.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.715+0000 7f9590618700 1 -- 172.21.15.63:0/1442158009 >> 172.21.15.63:0/1442158009 conn(0x7f95880f82d0 msgr2=0x7f95880fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:53:46.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.715+0000 7f9590618700 1 -- 172.21.15.63:0/1442158009 shutdown_connections 2023-12-12T11:53:46.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.715+0000 7f9590618700 1 -- 172.21.15.63:0/1442158009 wait complete. 2023-12-12T11:53:46.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.716+0000 7f9590618700 1 Processor -- start 2023-12-12T11:53:46.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.717+0000 7f9590618700 1 -- start start 2023-12-12T11:53:46.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.717+0000 7f9590618700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9588070510 0x7f958810f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:46.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.717+0000 7f9590618700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9588071b60 0x7f958810fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:46.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.717+0000 7f9590618700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9588110370 con 0x7f9588070510 2023-12-12T11:53:46.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.717+0000 7f9590618700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9588110c10 con 0x7f9588071b60 2023-12-12T11:53:46.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.717+0000 7f958e3b4700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9588070510 0x7f958810f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:46.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.717+0000 7f958dbb3700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9588071b60 0x7f958810fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:46.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.717+0000 7f958e3b4700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9588070510 0x7f958810f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43982/0 (socket says 172.21.15.63:43982) 2023-12-12T11:53:46.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.717+0000 7f958e3b4700 1 -- 172.21.15.63:0/1149724063 learned_addr learned my addr 172.21.15.63:0/1149724063 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:53:46.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.718+0000 7f958dbb3700 1 -- 172.21.15.63:0/1149724063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9588070510 msgr2=0x7f958810f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:46.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.718+0000 7f958dbb3700 1 --2- 172.21.15.63:0/1149724063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9588070510 0x7f958810f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:46.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.718+0000 7f958dbb3700 1 -- 172.21.15.63:0/1149724063 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9584005040 con 0x7f9588071b60 2023-12-12T11:53:46.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.718+0000 7f958dbb3700 1 --2- 172.21.15.63:0/1149724063 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9588071b60 0x7f958810fd70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9578009fd0 tx=0x7f957800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:53:46.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.718+0000 7f957effd700 1 -- 172.21.15.63:0/1149724063 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9578004e70 con 0x7f9588071b60 2023-12-12T11:53:46.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.718+0000 7f9590618700 1 -- 172.21.15.63:0/1149724063 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9588110e90 con 0x7f9588071b60 2023-12-12T11:53:46.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.719+0000 7f9590618700 1 -- 172.21.15.63:0/1149724063 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95881113d0 con 0x7f9588071b60 2023-12-12T11:53:46.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.718+0000 7f957effd700 1 -- 172.21.15.63:0/1149724063 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f957800f040 con 0x7f9588071b60 2023-12-12T11:53:46.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.719+0000 7f957effd700 1 -- 172.21.15.63:0/1149724063 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f957800c930 con 0x7f9588071b60 2023-12-12T11:53:46.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.720+0000 7f9590618700 1 -- 172.21.15.63:0/1149724063 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f956c0052e0 con 0x7f9588071b60 2023-12-12T11:53:46.723 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.721+0000 7f957effd700 1 -- 172.21.15.63:0/1149724063 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 30) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f957800cba0 con 0x7f9588071b60 2023-12-12T11:53:46.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.721+0000 7f957effd700 1 --2- 172.21.15.63:0/1149724063 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f957406cc00 0x7f957406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:46.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.722+0000 7f957effd700 1 -- 172.21.15.63:0/1149724063 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f957808bbd0 con 0x7f9588071b60 2023-12-12T11:53:46.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.722+0000 7f958e3b4700 1 --2- 172.21.15.63:0/1149724063 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f957406cc00 0x7f957406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:46.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.723+0000 7f958e3b4700 1 --2- 172.21.15.63:0/1149724063 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f957406cc00 0x7f957406f0b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f95840136a0 tx=0x7f9584009e30 comp rx=0 tx=0).ready entity=mgr.14732 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:53:46.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:46.726+0000 7f957effd700 1 -- 172.21.15.63:0/1149724063 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f9578059700 con 0x7f9588071b60 2023-12-12T11:53:47.080 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.078+0000 7f9590618700 1 -- 172.21.15.63:0/1149724063 --> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f956c000bf0 con 0x7f957406cc00 2023-12-12T11:53:47.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.079+0000 7f957effd700 1 -- 172.21.15.63:0/1149724063 <== mgr.14732 v2:172.21.15.63:6800/368827847 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f956c000bf0 con 0x7f957406cc00 2023-12-12T11:53:47.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.081+0000 7f9590618700 1 -- 172.21.15.63:0/1149724063 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f957406cc00 msgr2=0x7f957406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:47.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.081+0000 7f9590618700 1 --2- 172.21.15.63:0/1149724063 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f957406cc00 0x7f957406f0b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f95840136a0 tx=0x7f9584009e30 comp rx=0 tx=0).stop 2023-12-12T11:53:47.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.081+0000 7f9590618700 1 -- 172.21.15.63:0/1149724063 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9588071b60 msgr2=0x7f958810fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:47.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.081+0000 7f9590618700 1 --2- 172.21.15.63:0/1149724063 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9588071b60 0x7f958810fd70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9578009fd0 tx=0x7f957800b040 comp rx=0 tx=0).stop 2023-12-12T11:53:47.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.082+0000 7f9590618700 1 -- 172.21.15.63:0/1149724063 shutdown_connections 2023-12-12T11:53:47.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.082+0000 7f9590618700 1 --2- 172.21.15.63:0/1149724063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9588070510 0x7f958810f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:47.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.082+0000 7f9590618700 1 --2- 172.21.15.63:0/1149724063 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f957406cc00 0x7f957406f0b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:47.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.082+0000 7f9590618700 1 --2- 172.21.15.63:0/1149724063 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9588071b60 0x7f958810fd70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:47.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.082+0000 7f9590618700 1 -- 172.21.15.63:0/1149724063 >> 172.21.15.63:0/1149724063 conn(0x7f95880f82d0 msgr2=0x7f9588103370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:53:47.085 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.082+0000 7f9590618700 1 -- 172.21.15.63:0/1149724063 shutdown_connections 2023-12-12T11:53:47.085 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.082+0000 7f9590618700 1 -- 172.21.15.63:0/1149724063 wait complete. 2023-12-12T11:53:47.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.259+0000 7f30fd5b7700 1 -- 172.21.15.63:0/1518261881 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30f80fde00 msgr2=0x7f30f80fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:47.262 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.259+0000 7f30fd5b7700 1 --2- 172.21.15.63:0/1518261881 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30f80fde00 0x7f30f80fe250 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f30e8004940 tx=0x7f30e8009e30 comp rx=0 tx=0).stop 2023-12-12T11:53:47.262 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.259+0000 7f30fd5b7700 1 -- 172.21.15.63:0/1518261881 shutdown_connections 2023-12-12T11:53:47.262 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.259+0000 7f30fd5b7700 1 --2- 172.21.15.63:0/1518261881 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30f80fde00 0x7f30f80fe250 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:47.262 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.259+0000 7f30fd5b7700 1 --2- 172.21.15.63:0/1518261881 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f30f80fcbf0 0x7f30f80fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:47.262 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.259+0000 7f30fd5b7700 1 -- 172.21.15.63:0/1518261881 >> 172.21.15.63:0/1518261881 conn(0x7f30f80f82d0 msgr2=0x7f30f80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:53:47.262 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.259+0000 7f30fd5b7700 1 -- 172.21.15.63:0/1518261881 shutdown_connections 2023-12-12T11:53:47.262 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.259+0000 7f30fd5b7700 1 -- 172.21.15.63:0/1518261881 wait complete. 2023-12-12T11:53:47.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.260+0000 7f30fd5b7700 1 Processor -- start 2023-12-12T11:53:47.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.260+0000 7f30fd5b7700 1 -- start start 2023-12-12T11:53:47.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.260+0000 7f30fd5b7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30f80fcbf0 0x7f30f8071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:47.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.260+0000 7f30fd5b7700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f30f80fde00 0x7f30f806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:47.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.260+0000 7f30fd5b7700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f81111d0 con 0x7f30f80fcbf0 2023-12-12T11:53:47.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.260+0000 7f30fd5b7700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f8111340 con 0x7f30f80fde00 2023-12-12T11:53:47.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.261+0000 7f30f6ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30f80fcbf0 0x7f30f8071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:47.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.261+0000 7f30f6ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30f80fcbf0 0x7f30f8071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43994/0 (socket says 172.21.15.63:43994) 2023-12-12T11:53:47.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.261+0000 7f30f6ffd700 1 -- 172.21.15.63:0/506398694 learned_addr learned my addr 172.21.15.63:0/506398694 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:53:47.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.261+0000 7f30f67fc700 1 --2- 172.21.15.63:0/506398694 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f30f80fde00 0x7f30f806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:47.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.261+0000 7f30f67fc700 1 -- 172.21.15.63:0/506398694 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30f80fcbf0 msgr2=0x7f30f8071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:47.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.261+0000 7f30f67fc700 1 --2- 172.21.15.63:0/506398694 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30f80fcbf0 0x7f30f8071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:47.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.261+0000 7f30f67fc700 1 -- 172.21.15.63:0/506398694 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e8005040 con 0x7f30f80fde00 2023-12-12T11:53:47.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.262+0000 7f30f67fc700 1 --2- 172.21.15.63:0/506398694 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f30f80fde00 0x7f30f806ff90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f30e8009fd0 tx=0x7f30e8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:53:47.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.262+0000 7f30df7fe700 1 -- 172.21.15.63:0/506398694 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30e800e070 con 0x7f30f80fde00 2023-12-12T11:53:47.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.262+0000 7f30df7fe700 1 -- 172.21.15.63:0/506398694 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f30e80093f0 con 0x7f30f80fde00 2023-12-12T11:53:47.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.262+0000 7f30fd5b7700 1 -- 172.21.15.63:0/506398694 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f8070590 con 0x7f30f80fde00 2023-12-12T11:53:47.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.262+0000 7f30df7fe700 1 -- 172.21.15.63:0/506398694 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30e800b410 con 0x7f30f80fde00 2023-12-12T11:53:47.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.263+0000 7f30fd5b7700 1 -- 172.21.15.63:0/506398694 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f80709b0 con 0x7f30f80fde00 2023-12-12T11:53:47.267 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.264+0000 7f30df7fe700 1 -- 172.21.15.63:0/506398694 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 30) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f30e801c400 con 0x7f30f80fde00 2023-12-12T11:53:47.267 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.264+0000 7f30fd5b7700 1 -- 172.21.15.63:0/506398694 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f804bb80 con 0x7f30f80fde00 2023-12-12T11:53:47.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.265+0000 7f30df7fe700 1 --2- 172.21.15.63:0/506398694 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f30e006cc00 0x7f30e006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:47.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.266+0000 7f30df7fe700 1 -- 172.21.15.63:0/506398694 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f30e808d5f0 con 0x7f30f80fde00 2023-12-12T11:53:47.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.266+0000 7f30f6ffd700 1 --2- 172.21.15.63:0/506398694 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f30e006cc00 0x7f30e006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:47.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.267+0000 7f30f6ffd700 1 --2- 172.21.15.63:0/506398694 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f30e006cc00 0x7f30e006f0b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f30f80718a0 tx=0x7f30ec00b040 comp rx=0 tx=0).ready entity=mgr.14732 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:53:47.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.270+0000 7f30df7fe700 1 -- 172.21.15.63:0/506398694 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f30e805b2e0 con 0x7f30f80fde00 2023-12-12T11:53:47.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.669+0000 7f30fd5b7700 1 -- 172.21.15.63:0/506398694 --> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f30f8102750 con 0x7f30e006cc00 2023-12-12T11:53:47.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.680+0000 7f30df7fe700 1 -- 172.21.15.63:0/506398694 <== mgr.14732 v2:172.21.15.63:6800/368827847 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f30f8102750 con 0x7f30e006cc00 2023-12-12T11:53:47.683 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-12T11:53:47.683 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (93s) 15s ago 9m 15.3M - 0.25.0 c8568f914cd2 f237d9f64783 2023-12-12T11:53:47.683 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (9m) 15s ago 9m 7818k - 17.2.7-123-gbef78a51 ae6196193935 ee4415610fae 2023-12-12T11:53:47.683 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi093 smithi093 running (8m) 17s ago 8m 7810k - 17.2.7-123-gbef78a51 ae6196193935 f64e68742cfe 2023-12-12T11:53:47.683 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (87s) 15s ago 8m 79.2M - 9.4.7 954c08fa6188 51300a1a5b87 2023-12-12T11:53:47.683 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.aevpzg smithi063 running (4m) 15s ago 4m 9234M - 17.2.7-123-gbef78a51 ae6196193935 df9a6781f836 2023-12-12T11:53:47.683 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.bdqbnp smithi063 running (4m) 15s ago 4m 14.5M - 17.2.7-123-gbef78a51 ae6196193935 0c7e1d21eee9 2023-12-12T11:53:47.683 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.rhaqsh smithi093 running (4m) 17s ago 4m 14.2M - 17.2.7-123-gbef78a51 ae6196193935 257aee771d87 2023-12-12T11:53:47.683 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.swdqms smithi093 running (4m) 17s ago 4m 14.2M - 17.2.7-123-gbef78a51 ae6196193935 f46d7173d3b1 2023-12-12T11:53:47.683 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.zjnfdi smithi063 *:8443,9283,8765 running (75s) 15s ago 10m 500M - 19.0.0-96-gf1fbf3c5 8cf689f388db dab6fa4aaa54 2023-12-12T11:53:47.684 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi093.nbtltu smithi093 *:8443,9283,8765 running (21s) 17s ago 8m 59.0M - 19.0.0-96-gf1fbf3c5 8cf689f388db 701529e7fa8e 2023-12-12T11:53:47.684 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (10m) 15s ago 10m 94.5M 2048M 17.2.7-123-gbef78a51 ae6196193935 ee8e9d7455f9 2023-12-12T11:53:47.684 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi093 smithi093 running (8m) 17s ago 8m 63.7M 2048M 17.2.7-123-gbef78a51 ae6196193935 fac71666a805 2023-12-12T11:53:47.684 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (102s) 15s ago 9m 8665k - 1.5.0 0da6a335fe13 8eed63374ddf 2023-12-12T11:53:47.684 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi093 smithi093 *:9100 running (81s) 17s ago 8m 8086k - 1.5.0 0da6a335fe13 10e19431c1a2 2023-12-12T11:53:47.684 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (7m) 15s ago 7m 801M 1618M 17.2.7-123-gbef78a51 ae6196193935 636790d2b28c 2023-12-12T11:53:47.684 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (7m) 15s ago 7m 878M 1618M 17.2.7-123-gbef78a51 ae6196193935 5388a4bc6b12 2023-12-12T11:53:47.684 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (6m) 15s ago 6m 697M 1618M 17.2.7-123-gbef78a51 ae6196193935 9eb2483337c8 2023-12-12T11:53:47.684 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi093 running (6m) 17s ago 6m 985M 2642M 17.2.7-123-gbef78a51 ae6196193935 5b2bb36b5843 2023-12-12T11:53:47.684 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi093 running (6m) 17s ago 6m 728M 2642M 17.2.7-123-gbef78a51 ae6196193935 7dc3f04b04cb 2023-12-12T11:53:47.684 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi093 running (5m) 17s ago 5m 827M 2642M 17.2.7-123-gbef78a51 ae6196193935 16fe8e4668f1 2023-12-12T11:53:47.684 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (28s) 15s ago 8m 35.6M - 2.43.0 a07b618ecd1d 834d9fc4eb61 2023-12-12T11:53:47.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.683+0000 7f30fd5b7700 1 -- 172.21.15.63:0/506398694 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f30e006cc00 msgr2=0x7f30e006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:47.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.683+0000 7f30fd5b7700 1 --2- 172.21.15.63:0/506398694 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f30e006cc00 0x7f30e006f0b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f30f80718a0 tx=0x7f30ec00b040 comp rx=0 tx=0).stop 2023-12-12T11:53:47.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.683+0000 7f30fd5b7700 1 -- 172.21.15.63:0/506398694 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f30f80fde00 msgr2=0x7f30f806ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:47.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.683+0000 7f30fd5b7700 1 --2- 172.21.15.63:0/506398694 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f30f80fde00 0x7f30f806ff90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f30e8009fd0 tx=0x7f30e8009e30 comp rx=0 tx=0).stop 2023-12-12T11:53:47.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.683+0000 7f30fd5b7700 1 -- 172.21.15.63:0/506398694 shutdown_connections 2023-12-12T11:53:47.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.683+0000 7f30fd5b7700 1 --2- 172.21.15.63:0/506398694 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30f80fcbf0 0x7f30f8071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:47.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.683+0000 7f30fd5b7700 1 --2- 172.21.15.63:0/506398694 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f30e006cc00 0x7f30e006f0b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:47.686 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.683+0000 7f30fd5b7700 1 --2- 172.21.15.63:0/506398694 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f30f80fde00 0x7f30f806ff90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:47.686 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.683+0000 7f30fd5b7700 1 -- 172.21.15.63:0/506398694 >> 172.21.15.63:0/506398694 conn(0x7f30f80f82d0 msgr2=0x7f30f8101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:53:47.686 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.683+0000 7f30fd5b7700 1 -- 172.21.15.63:0/506398694 shutdown_connections 2023-12-12T11:53:47.686 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.683+0000 7f30fd5b7700 1 -- 172.21.15.63:0/506398694 wait complete. 2023-12-12T11:53:47.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.873+0000 7f8be4730700 1 -- 172.21.15.63:0/3418241295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bdc0fcbf0 msgr2=0x7f8bdc0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:47.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.873+0000 7f8be4730700 1 --2- 172.21.15.63:0/3418241295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bdc0fcbf0 0x7f8bdc0fd000 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8004940 tx=0x7f8bd8009e30 comp rx=0 tx=0).stop 2023-12-12T11:53:47.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.873+0000 7f8be4730700 1 -- 172.21.15.63:0/3418241295 shutdown_connections 2023-12-12T11:53:47.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.873+0000 7f8be4730700 1 --2- 172.21.15.63:0/3418241295 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8bdc0fde00 0x7f8bdc0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:47.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.873+0000 7f8be4730700 1 --2- 172.21.15.63:0/3418241295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bdc0fcbf0 0x7f8bdc0fd000 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:47.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.873+0000 7f8be4730700 1 -- 172.21.15.63:0/3418241295 >> 172.21.15.63:0/3418241295 conn(0x7f8bdc0f82d0 msgr2=0x7f8bdc0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:53:47.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.873+0000 7f8be4730700 1 -- 172.21.15.63:0/3418241295 shutdown_connections 2023-12-12T11:53:47.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.873+0000 7f8be4730700 1 -- 172.21.15.63:0/3418241295 wait complete. 2023-12-12T11:53:47.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.874+0000 7f8be4730700 1 Processor -- start 2023-12-12T11:53:47.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.875+0000 7f8be4730700 1 -- start start 2023-12-12T11:53:47.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.875+0000 7f8be4730700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bdc0fcbf0 0x7f8bdc071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:47.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.875+0000 7f8be4730700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8bdc0fde00 0x7f8bdc06ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:47.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.875+0000 7f8be4730700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc1111b0 con 0x7f8bdc0fcbf0 2023-12-12T11:53:47.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.875+0000 7f8be4730700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc111320 con 0x7f8bdc0fde00 2023-12-12T11:53:47.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.875+0000 7f8be1ccb700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8bdc0fde00 0x7f8bdc06ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:47.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.875+0000 7f8be24cc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bdc0fcbf0 0x7f8bdc071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:47.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.876+0000 7f8be24cc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bdc0fcbf0 0x7f8bdc071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44020/0 (socket says 172.21.15.63:44020) 2023-12-12T11:53:47.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.876+0000 7f8be24cc700 1 -- 172.21.15.63:0/4207258635 learned_addr learned my addr 172.21.15.63:0/4207258635 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:53:47.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.876+0000 7f8be24cc700 1 -- 172.21.15.63:0/4207258635 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8bdc0fde00 msgr2=0x7f8bdc06ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:47.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.876+0000 7f8be24cc700 1 --2- 172.21.15.63:0/4207258635 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8bdc0fde00 0x7f8bdc06ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:47.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.876+0000 7f8be24cc700 1 -- 172.21.15.63:0/4207258635 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd8005040 con 0x7f8bdc0fcbf0 2023-12-12T11:53:47.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.876+0000 7f8be1ccb700 1 --2- 172.21.15.63:0/4207258635 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8bdc0fde00 0x7f8bdc06ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T11:53:47.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.876+0000 7f8be24cc700 1 --2- 172.21.15.63:0/4207258635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bdc0fcbf0 0x7f8bdc071b10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8009fd0 tx=0x7f8bd8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:53:47.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.877+0000 7f8bd2ffd700 1 -- 172.21.15.63:0/4207258635 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bd8021070 con 0x7f8bdc0fcbf0 2023-12-12T11:53:47.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.877+0000 7f8be4730700 1 -- 172.21.15.63:0/4207258635 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bdc070590 con 0x7f8bdc0fcbf0 2023-12-12T11:53:47.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.877+0000 7f8bd2ffd700 1 -- 172.21.15.63:0/4207258635 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8bd801c400 con 0x7f8bdc0fcbf0 2023-12-12T11:53:47.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.877+0000 7f8be4730700 1 -- 172.21.15.63:0/4207258635 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bdc070ad0 con 0x7f8bdc0fcbf0 2023-12-12T11:53:47.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.878+0000 7f8bd2ffd700 1 -- 172.21.15.63:0/4207258635 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bd800e070 con 0x7f8bdc0fcbf0 2023-12-12T11:53:47.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.879+0000 7f8bd0ff9700 1 -- 172.21.15.63:0/4207258635 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bc40052b0 con 0x7f8bdc0fcbf0 2023-12-12T11:53:47.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.881+0000 7f8bd2ffd700 1 -- 172.21.15.63:0/4207258635 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 30) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f8bd801c9c0 con 0x7f8bdc0fcbf0 2023-12-12T11:53:47.885 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.883+0000 7f8bd2ffd700 1 --2- 172.21.15.63:0/4207258635 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f8bc806cc00 0x7f8bc806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:47.885 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.883+0000 7f8bd2ffd700 1 -- 172.21.15.63:0/4207258635 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f8bd808d260 con 0x7f8bdc0fcbf0 2023-12-12T11:53:47.885 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.883+0000 7f8be1ccb700 1 --2- 172.21.15.63:0/4207258635 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f8bc806cc00 0x7f8bc806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:47.886 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.884+0000 7f8be1ccb700 1 --2- 172.21.15.63:0/4207258635 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f8bc806cc00 0x7f8bc806f0b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc009b80 tx=0x7f8bcc00b040 comp rx=0 tx=0).ready entity=mgr.14732 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:53:47.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:47.891+0000 7f8bd2ffd700 1 -- 172.21.15.63:0/4207258635 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f8bd805ae10 con 0x7f8bdc0fcbf0 2023-12-12T11:53:47.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:47 smithi093 ceph-mon[115914]: from='client.24631 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:53:47.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:47 smithi093 ceph-mon[115914]: pgmap v28: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.4 MiB/s wr, 379 op/s 2023-12-12T11:53:47.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:47 smithi093 ceph-mon[115914]: from='client.24635 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:53:48.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:47 smithi063 ceph-mon[107117]: from='client.24631 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:53:48.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:47 smithi063 ceph-mon[107117]: pgmap v28: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.4 MiB/s wr, 379 op/s 2023-12-12T11:53:48.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:47 smithi063 ceph-mon[107117]: from='client.24635 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:53:48.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.389+0000 7f8bd0ff9700 1 -- 172.21.15.63:0/4207258635 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8bc4005830 con 0x7f8bdc0fcbf0 2023-12-12T11:53:48.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.390+0000 7f8bd2ffd700 1 -- 172.21.15.63:0/4207258635 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f8bd805a9a0 con 0x7f8bdc0fcbf0 2023-12-12T11:53:48.393 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:53:48.393 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-12T11:53:48.393 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 2 2023-12-12T11:53:48.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:53:48.393 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-12T11:53:48.393 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 2 2023-12-12T11:53:48.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:53:48.393 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-12T11:53:48.394 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 6 2023-12-12T11:53:48.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:53:48.394 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-12T11:53:48.394 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 4 2023-12-12T11:53:48.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:53:48.395 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-12T11:53:48.395 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 12, 2023-12-12T11:53:48.395 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 2 2023-12-12T11:53:48.395 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-12T11:53:48.395 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:53:48.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.393+0000 7f8bd0ff9700 1 -- 172.21.15.63:0/4207258635 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f8bc806cc00 msgr2=0x7f8bc806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:48.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.393+0000 7f8bd0ff9700 1 --2- 172.21.15.63:0/4207258635 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f8bc806cc00 0x7f8bc806f0b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc009b80 tx=0x7f8bcc00b040 comp rx=0 tx=0).stop 2023-12-12T11:53:48.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.393+0000 7f8bd0ff9700 1 -- 172.21.15.63:0/4207258635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bdc0fcbf0 msgr2=0x7f8bdc071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:48.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.393+0000 7f8bd0ff9700 1 --2- 172.21.15.63:0/4207258635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bdc0fcbf0 0x7f8bdc071b10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8009fd0 tx=0x7f8bd8009e30 comp rx=0 tx=0).stop 2023-12-12T11:53:48.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.393+0000 7f8bd0ff9700 1 -- 172.21.15.63:0/4207258635 shutdown_connections 2023-12-12T11:53:48.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.393+0000 7f8bd0ff9700 1 --2- 172.21.15.63:0/4207258635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bdc0fcbf0 0x7f8bdc071b10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:48.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.393+0000 7f8bd0ff9700 1 --2- 172.21.15.63:0/4207258635 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f8bc806cc00 0x7f8bc806f0b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:48.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.393+0000 7f8bd0ff9700 1 --2- 172.21.15.63:0/4207258635 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8bdc0fde00 0x7f8bdc06ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:48.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.393+0000 7f8bd0ff9700 1 -- 172.21.15.63:0/4207258635 >> 172.21.15.63:0/4207258635 conn(0x7f8bdc0f82d0 msgr2=0x7f8bdc101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:53:48.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.394+0000 7f8bd0ff9700 1 -- 172.21.15.63:0/4207258635 shutdown_connections 2023-12-12T11:53:48.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.394+0000 7f8bd0ff9700 1 -- 172.21.15.63:0/4207258635 wait complete. 2023-12-12T11:53:48.594 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.591+0000 7f8a35602700 1 -- 172.21.15.63:0/1807220713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a300fde00 msgr2=0x7f8a300fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:48.594 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.591+0000 7f8a35602700 1 --2- 172.21.15.63:0/1807220713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a300fde00 0x7f8a300fe250 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8a24004940 tx=0x7f8a24009e30 comp rx=0 tx=0).stop 2023-12-12T11:53:48.594 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.592+0000 7f8a35602700 1 -- 172.21.15.63:0/1807220713 shutdown_connections 2023-12-12T11:53:48.595 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.592+0000 7f8a35602700 1 --2- 172.21.15.63:0/1807220713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a300fde00 0x7f8a300fe250 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:48.595 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.592+0000 7f8a35602700 1 --2- 172.21.15.63:0/1807220713 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a300fcbf0 0x7f8a300fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:48.595 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.592+0000 7f8a35602700 1 -- 172.21.15.63:0/1807220713 >> 172.21.15.63:0/1807220713 conn(0x7f8a300f82d0 msgr2=0x7f8a300fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:53:48.595 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.592+0000 7f8a35602700 1 -- 172.21.15.63:0/1807220713 shutdown_connections 2023-12-12T11:53:48.595 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.592+0000 7f8a35602700 1 -- 172.21.15.63:0/1807220713 wait complete. 2023-12-12T11:53:48.595 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.593+0000 7f8a35602700 1 Processor -- start 2023-12-12T11:53:48.596 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.593+0000 7f8a35602700 1 -- start start 2023-12-12T11:53:48.596 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.593+0000 7f8a35602700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a300fcbf0 0x7f8a30106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:48.596 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.593+0000 7f8a35602700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a300fde00 0x7f8a30106760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:48.596 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.593+0000 7f8a35602700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a30106db0 con 0x7f8a300fcbf0 2023-12-12T11:53:48.596 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.593+0000 7f8a35602700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a30107650 con 0x7f8a300fde00 2023-12-12T11:53:48.596 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.594+0000 7f8a2e7fc700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a300fde00 0x7f8a30106760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:48.596 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.594+0000 7f8a2effd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a300fcbf0 0x7f8a30106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:48.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.594+0000 7f8a2e7fc700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a300fde00 0x7f8a30106760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:36230/0 (socket says 172.21.15.63:36230) 2023-12-12T11:53:48.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.594+0000 7f8a2e7fc700 1 -- 172.21.15.63:0/3939913995 learned_addr learned my addr 172.21.15.63:0/3939913995 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:53:48.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.594+0000 7f8a2e7fc700 1 -- 172.21.15.63:0/3939913995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a300fcbf0 msgr2=0x7f8a30106220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:48.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.594+0000 7f8a2e7fc700 1 --2- 172.21.15.63:0/3939913995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a300fcbf0 0x7f8a30106220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:48.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.594+0000 7f8a2e7fc700 1 -- 172.21.15.63:0/3939913995 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a24005040 con 0x7f8a300fde00 2023-12-12T11:53:48.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.594+0000 7f8a2e7fc700 1 --2- 172.21.15.63:0/3939913995 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a300fde00 0x7f8a30106760 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8a24009fd0 tx=0x7f8a24009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:53:48.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.595+0000 7f8a177fe700 1 -- 172.21.15.63:0/3939913995 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a24021070 con 0x7f8a300fde00 2023-12-12T11:53:48.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.595+0000 7f8a35602700 1 -- 172.21.15.63:0/3939913995 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a301078d0 con 0x7f8a300fde00 2023-12-12T11:53:48.598 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.595+0000 7f8a177fe700 1 -- 172.21.15.63:0/3939913995 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8a2401c400 con 0x7f8a300fde00 2023-12-12T11:53:48.598 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.595+0000 7f8a177fe700 1 -- 172.21.15.63:0/3939913995 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a2400e070 con 0x7f8a300fde00 2023-12-12T11:53:48.598 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.595+0000 7f8a35602700 1 -- 172.21.15.63:0/3939913995 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a30107e10 con 0x7f8a300fde00 2023-12-12T11:53:48.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.597+0000 7f8a35602700 1 -- 172.21.15.63:0/3939913995 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a30101ea0 con 0x7f8a300fde00 2023-12-12T11:53:48.600 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.598+0000 7f8a177fe700 1 -- 172.21.15.63:0/3939913995 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 30) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f8a2401ca00 con 0x7f8a300fde00 2023-12-12T11:53:48.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.600+0000 7f8a177fe700 1 --2- 172.21.15.63:0/3939913995 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f8a1806cc00 0x7f8a1806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:48.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.600+0000 7f8a177fe700 1 -- 172.21.15.63:0/3939913995 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f8a2408d2a0 con 0x7f8a300fde00 2023-12-12T11:53:48.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.600+0000 7f8a2effd700 1 --2- 172.21.15.63:0/3939913995 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f8a1806cc00 0x7f8a1806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:48.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.601+0000 7f8a2effd700 1 --2- 172.21.15.63:0/3939913995 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f8a1806cc00 0x7f8a1806f0b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8a30105fb0 tx=0x7f8a2000b040 comp rx=0 tx=0).ready entity=mgr.14732 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:53:48.606 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.604+0000 7f8a177fe700 1 -- 172.21.15.63:0/3939913995 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f8a24057340 con 0x7f8a300fde00 2023-12-12T11:53:48.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.926+0000 7f8a35602700 1 -- 172.21.15.63:0/3939913995 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8a3004bb80 con 0x7f8a300fde00 2023-12-12T11:53:48.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.927+0000 7f8a177fe700 1 -- 172.21.15.63:0/3939913995 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1807 (secure 0 0 0) 0x7f8a2405a960 con 0x7f8a300fde00 2023-12-12T11:53:48.929 INFO:teuthology.orchestra.run.smithi063.stdout:e13 2023-12-12T11:53:48.929 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-12T11:53:48.930 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:53:48.930 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-12T11:53:48.930 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:53:48.930 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-12T11:53:48.930 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-12T11:53:48.930 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 13 2023-12-12T11:53:48.930 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-12T11:53:48.930 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-12T11:48:58.523481+0000 2023-12-12T11:53:48.930 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-12T11:49:14.113993+0000 2023-12-12T11:53:48.930 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-12T11:53:48.930 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-12T11:53:48.930 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-12T11:53:48.930 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-12T11:53:48.930 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-12T11:53:48.930 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-12T11:53:48.931 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-12T11:53:48.931 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 46 2023-12-12T11:53:48.931 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:53:48.931 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 1 2023-12-12T11:53:48.931 INFO:teuthology.orchestra.run.smithi063.stdout:in 0 2023-12-12T11:53:48.931 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=14492} 2023-12-12T11:53:48.931 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-12T11:53:48.931 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-12T11:53:48.931 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-12T11:53:48.931 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-12T11:53:48.931 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-12T11:53:48.931 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data enabled 2023-12-12T11:53:48.931 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-12T11:53:48.931 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 1 2023-12-12T11:53:48.932 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.aevpzg{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.63:6828/3709000039,v1:172.21.15.63:6829/3709000039] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:53:48.932 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:53:48.932 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:53:48.932 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2023-12-12T11:53:48.932 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:53:48.932 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.swdqms{-1:14500} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.93:6826/3307558569,v1:172.21.15.93:6827/3307558569] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:53:48.932 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.bdqbnp{-1:14508} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/2191270944,v1:172.21.15.63:6827/2191270944] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:53:48.932 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.rhaqsh{-1:24317} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.93:6824/3161864019,v1:172.21.15.93:6825/3161864019] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:53:48.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.930+0000 7f8a35602700 1 -- 172.21.15.63:0/3939913995 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f8a1806cc00 msgr2=0x7f8a1806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:48.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.930+0000 7f8a35602700 1 --2- 172.21.15.63:0/3939913995 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f8a1806cc00 0x7f8a1806f0b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8a30105fb0 tx=0x7f8a2000b040 comp rx=0 tx=0).stop 2023-12-12T11:53:48.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.930+0000 7f8a35602700 1 -- 172.21.15.63:0/3939913995 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a300fde00 msgr2=0x7f8a30106760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:48.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.930+0000 7f8a35602700 1 --2- 172.21.15.63:0/3939913995 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a300fde00 0x7f8a30106760 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8a24009fd0 tx=0x7f8a24009e30 comp rx=0 tx=0).stop 2023-12-12T11:53:48.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.931+0000 7f8a35602700 1 -- 172.21.15.63:0/3939913995 shutdown_connections 2023-12-12T11:53:48.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.931+0000 7f8a35602700 1 --2- 172.21.15.63:0/3939913995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a300fcbf0 0x7f8a30106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:48.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.931+0000 7f8a35602700 1 --2- 172.21.15.63:0/3939913995 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f8a1806cc00 0x7f8a1806f0b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:48.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.931+0000 7f8a35602700 1 --2- 172.21.15.63:0/3939913995 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a300fde00 0x7f8a30106760 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:48.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.931+0000 7f8a35602700 1 -- 172.21.15.63:0/3939913995 >> 172.21.15.63:0/3939913995 conn(0x7f8a300f82d0 msgr2=0x7f8a300ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:53:48.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.931+0000 7f8a35602700 1 -- 172.21.15.63:0/3939913995 shutdown_connections 2023-12-12T11:53:48.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:48.931+0000 7f8a35602700 1 -- 172.21.15.63:0/3939913995 wait complete. 2023-12-12T11:53:48.934 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 13 2023-12-12T11:53:48.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:48 smithi093 ceph-mon[115914]: from='client.24639 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:53:48.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:48 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/4207258635' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:53:49.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:48 smithi063 ceph-mon[107117]: from='client.24639 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:53:49.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:48 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/4207258635' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:53:49.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.125+0000 7fe89a920700 1 -- 172.21.15.63:0/1659701026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8940ffe50 msgr2=0x7fe894102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:49.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.125+0000 7fe89a920700 1 --2- 172.21.15.63:0/1659701026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8940ffe50 0x7fe894102230 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe884004940 tx=0x7fe884009e30 comp rx=0 tx=0).stop 2023-12-12T11:53:49.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.125+0000 7fe89a920700 1 -- 172.21.15.63:0/1659701026 shutdown_connections 2023-12-12T11:53:49.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.125+0000 7fe89a920700 1 --2- 172.21.15.63:0/1659701026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8940ffe50 0x7fe894102230 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:49.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.125+0000 7fe89a920700 1 --2- 172.21.15.63:0/1659701026 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8940fd530 0x7fe8940ff910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:49.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.125+0000 7fe89a920700 1 -- 172.21.15.63:0/1659701026 >> 172.21.15.63:0/1659701026 conn(0x7fe8940f6f70 msgr2=0x7fe8940f93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:53:49.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.125+0000 7fe89a920700 1 -- 172.21.15.63:0/1659701026 shutdown_connections 2023-12-12T11:53:49.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.125+0000 7fe89a920700 1 -- 172.21.15.63:0/1659701026 wait complete. 2023-12-12T11:53:49.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.126+0000 7fe89a920700 1 Processor -- start 2023-12-12T11:53:49.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.126+0000 7fe89a920700 1 -- start start 2023-12-12T11:53:49.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.127+0000 7fe89a920700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8940fd530 0x7fe89410f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:49.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.127+0000 7fe89a920700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8940ffe50 0x7fe89410f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:49.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.127+0000 7fe89a920700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89410ff70 con 0x7fe8940fd530 2023-12-12T11:53:49.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.127+0000 7fe89a920700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe894110810 con 0x7fe8940ffe50 2023-12-12T11:53:49.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.127+0000 7fe89991e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8940fd530 0x7fe89410f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:49.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.127+0000 7fe89991e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8940fd530 0x7fe89410f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35684/0 (socket says 172.21.15.63:35684) 2023-12-12T11:53:49.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.127+0000 7fe89991e700 1 -- 172.21.15.63:0/1975003579 learned_addr learned my addr 172.21.15.63:0/1975003579 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:53:49.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.127+0000 7fe89911d700 1 --2- 172.21.15.63:0/1975003579 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8940ffe50 0x7fe89410f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:49.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.127+0000 7fe89991e700 1 -- 172.21.15.63:0/1975003579 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8940ffe50 msgr2=0x7fe89410f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:49.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.127+0000 7fe89991e700 1 --2- 172.21.15.63:0/1975003579 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8940ffe50 0x7fe89410f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:49.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.127+0000 7fe89991e700 1 -- 172.21.15.63:0/1975003579 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe884005040 con 0x7fe8940fd530 2023-12-12T11:53:49.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.128+0000 7fe89991e700 1 --2- 172.21.15.63:0/1975003579 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8940fd530 0x7fe89410f430 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe890002a80 tx=0x7fe8900046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:53:49.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.128+0000 7fe88a7fc700 1 -- 172.21.15.63:0/1975003579 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe890007cc0 con 0x7fe8940fd530 2023-12-12T11:53:49.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.128+0000 7fe88a7fc700 1 -- 172.21.15.63:0/1975003579 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe89000f040 con 0x7fe8940fd530 2023-12-12T11:53:49.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.128+0000 7fe88a7fc700 1 -- 172.21.15.63:0/1975003579 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe89000da60 con 0x7fe8940fd530 2023-12-12T11:53:49.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.128+0000 7fe89a920700 1 -- 172.21.15.63:0/1975003579 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe894110af0 con 0x7fe8940fd530 2023-12-12T11:53:49.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.128+0000 7fe89a920700 1 -- 172.21.15.63:0/1975003579 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe894111030 con 0x7fe8940fd530 2023-12-12T11:53:49.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.131+0000 7fe89a920700 1 -- 172.21.15.63:0/1975003579 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe89404bb80 con 0x7fe8940fd530 2023-12-12T11:53:49.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.131+0000 7fe88a7fc700 1 -- 172.21.15.63:0/1975003579 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 30) v1 ==== 90899+0+0 (secure 0 0 0) 0x7fe89000dbc0 con 0x7fe8940fd530 2023-12-12T11:53:49.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.134+0000 7fe88a7fc700 1 --2- 172.21.15.63:0/1975003579 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7fe88006cc00 0x7fe88006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:49.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.134+0000 7fe88a7fc700 1 -- 172.21.15.63:0/1975003579 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fe89008bd50 con 0x7fe8940fd530 2023-12-12T11:53:49.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.135+0000 7fe89911d700 1 --2- 172.21.15.63:0/1975003579 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7fe88006cc00 0x7fe88006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:49.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.135+0000 7fe89911d700 1 --2- 172.21.15.63:0/1975003579 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7fe88006cc00 0x7fe88006f0b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe8840043d0 tx=0x7fe884009e30 comp rx=0 tx=0).ready entity=mgr.14732 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:53:49.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.140+0000 7fe88a7fc700 1 -- 172.21.15.63:0/1975003579 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fe890059880 con 0x7fe8940fd530 2023-12-12T11:53:49.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.577+0000 7fe89a920700 1 -- 172.21.15.63:0/1975003579 --> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8941116a0 con 0x7fe88006cc00 2023-12-12T11:53:49.581 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.579+0000 7fe88a7fc700 1 -- 172.21.15.63:0/1975003579 <== mgr.14732 v2:172.21.15.63:6800/368827847 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fe8840096f0 con 0x7fe88006cc00 2023-12-12T11:53:49.581 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:53:49.581 INFO:teuthology.orchestra.run.smithi063.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dbb46fd2dbbe029cfba763f2b7c769e980f86b63e74be0c72e188909e20b81f3", 2023-12-12T11:53:49.581 INFO:teuthology.orchestra.run.smithi063.stdout: "in_progress": true, 2023-12-12T11:53:49.581 INFO:teuthology.orchestra.run.smithi063.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-12T11:53:49.581 INFO:teuthology.orchestra.run.smithi063.stdout: "services_complete": [ 2023-12-12T11:53:49.581 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr" 2023-12-12T11:53:49.581 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2023-12-12T11:53:49.581 INFO:teuthology.orchestra.run.smithi063.stdout: "progress": "2/21 daemons upgraded", 2023-12-12T11:53:49.581 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "Currently upgrading mon daemons", 2023-12-12T11:53:49.581 INFO:teuthology.orchestra.run.smithi063.stdout: "is_paused": false 2023-12-12T11:53:49.582 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:53:49.585 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.584+0000 7fe89a920700 1 -- 172.21.15.63:0/1975003579 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7fe88006cc00 msgr2=0x7fe88006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:49.585 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.584+0000 7fe89a920700 1 --2- 172.21.15.63:0/1975003579 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7fe88006cc00 0x7fe88006f0b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe8840043d0 tx=0x7fe884009e30 comp rx=0 tx=0).stop 2023-12-12T11:53:49.585 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.584+0000 7fe89a920700 1 -- 172.21.15.63:0/1975003579 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8940fd530 msgr2=0x7fe89410f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:49.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.584+0000 7fe89a920700 1 --2- 172.21.15.63:0/1975003579 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8940fd530 0x7fe89410f430 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe890002a80 tx=0x7fe8900046b0 comp rx=0 tx=0).stop 2023-12-12T11:53:49.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.584+0000 7fe89a920700 1 -- 172.21.15.63:0/1975003579 shutdown_connections 2023-12-12T11:53:49.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.584+0000 7fe89a920700 1 --2- 172.21.15.63:0/1975003579 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8940fd530 0x7fe89410f430 secure :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe890002a80 tx=0x7fe8900046b0 comp rx=0 tx=0).stop 2023-12-12T11:53:49.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.584+0000 7fe89a920700 1 --2- 172.21.15.63:0/1975003579 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7fe88006cc00 0x7fe88006f0b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:49.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.584+0000 7fe89a920700 1 --2- 172.21.15.63:0/1975003579 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8940ffe50 0x7fe89410f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:49.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.584+0000 7fe89a920700 1 -- 172.21.15.63:0/1975003579 >> 172.21.15.63:0/1975003579 conn(0x7fe8940f6f70 msgr2=0x7fe8940fb320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:53:49.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.585+0000 7fe89a920700 1 -- 172.21.15.63:0/1975003579 shutdown_connections 2023-12-12T11:53:49.587 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.585+0000 7fe89a920700 1 -- 172.21.15.63:0/1975003579 wait complete. 2023-12-12T11:53:49.794 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.793+0000 7f0cf2d6a700 1 -- 172.21.15.63:0/2964509649 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cec0fcb00 msgr2=0x7f0cec0fcf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:49.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.793+0000 7f0cf2d6a700 1 --2- 172.21.15.63:0/2964509649 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cec0fcb00 0x7f0cec0fcf50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc004940 tx=0x7f0cdc009e30 comp rx=0 tx=0).stop 2023-12-12T11:53:49.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.793+0000 7f0cf2d6a700 1 -- 172.21.15.63:0/2964509649 shutdown_connections 2023-12-12T11:53:49.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.793+0000 7f0cf2d6a700 1 --2- 172.21.15.63:0/2964509649 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cec0fcb00 0x7f0cec0fcf50 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:49.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.793+0000 7f0cf2d6a700 1 --2- 172.21.15.63:0/2964509649 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0cec0fb8f0 0x7f0cec0fbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:49.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.793+0000 7f0cf2d6a700 1 -- 172.21.15.63:0/2964509649 >> 172.21.15.63:0/2964509649 conn(0x7f0cec0f6f70 msgr2=0x7f0cec0f93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:53:49.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.793+0000 7f0cf2d6a700 1 -- 172.21.15.63:0/2964509649 shutdown_connections 2023-12-12T11:53:49.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.793+0000 7f0cf2d6a700 1 -- 172.21.15.63:0/2964509649 wait complete. 2023-12-12T11:53:49.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.794+0000 7f0cf2d6a700 1 Processor -- start 2023-12-12T11:53:49.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.794+0000 7f0cf2d6a700 1 -- start start 2023-12-12T11:53:49.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.795+0000 7f0cf2d6a700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0cec0fb8f0 0x7f0cec10f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:49.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.795+0000 7f0cf2d6a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cec0fcb00 0x7f0cec10f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:49.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.795+0000 7f0cf2d6a700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec10ffb0 con 0x7f0cec0fcb00 2023-12-12T11:53:49.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.795+0000 7f0cf2d6a700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec110850 con 0x7f0cec0fb8f0 2023-12-12T11:53:49.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.795+0000 7f0cf1567700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cec0fcb00 0x7f0cec10f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:49.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.795+0000 7f0cf1567700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cec0fcb00 0x7f0cec10f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35698/0 (socket says 172.21.15.63:35698) 2023-12-12T11:53:49.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.795+0000 7f0cf1567700 1 -- 172.21.15.63:0/2611584709 learned_addr learned my addr 172.21.15.63:0/2611584709 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:53:49.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.795+0000 7f0cf1d68700 1 --2- 172.21.15.63:0/2611584709 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0cec0fb8f0 0x7f0cec10f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:49.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.795+0000 7f0cf1567700 1 -- 172.21.15.63:0/2611584709 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0cec0fb8f0 msgr2=0x7f0cec10f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:49.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.796+0000 7f0cf1567700 1 --2- 172.21.15.63:0/2611584709 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0cec0fb8f0 0x7f0cec10f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:49.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.796+0000 7f0cf1567700 1 -- 172.21.15.63:0/2611584709 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc005040 con 0x7f0cec0fcb00 2023-12-12T11:53:49.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.796+0000 7f0cf1567700 1 --2- 172.21.15.63:0/2611584709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cec0fcb00 0x7f0cec10f9b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc00b3b0 tx=0x7f0cdc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:53:49.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.796+0000 7f0ce27fc700 1 -- 172.21.15.63:0/2611584709 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cdc00e040 con 0x7f0cec0fcb00 2023-12-12T11:53:49.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.796+0000 7f0cf2d6a700 1 -- 172.21.15.63:0/2611584709 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cec110ad0 con 0x7f0cec0fcb00 2023-12-12T11:53:49.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.796+0000 7f0ce27fc700 1 -- 172.21.15.63:0/2611584709 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0cdc00bc50 con 0x7f0cec0fcb00 2023-12-12T11:53:49.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.796+0000 7f0ce27fc700 1 -- 172.21.15.63:0/2611584709 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cdc01c630 con 0x7f0cec0fcb00 2023-12-12T11:53:49.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.796+0000 7f0cf2d6a700 1 -- 172.21.15.63:0/2611584709 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cec111010 con 0x7f0cec0fcb00 2023-12-12T11:53:49.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.798+0000 7f0cf2d6a700 1 -- 172.21.15.63:0/2611584709 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cec04bb80 con 0x7f0cec0fcb00 2023-12-12T11:53:49.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.800+0000 7f0ce27fc700 1 -- 172.21.15.63:0/2611584709 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 30) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f0cdc013420 con 0x7f0cec0fcb00 2023-12-12T11:53:49.802 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.801+0000 7f0ce27fc700 1 --2- 172.21.15.63:0/2611584709 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f0cd806cc00 0x7f0cd806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:53:49.802 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.801+0000 7f0ce27fc700 1 -- 172.21.15.63:0/2611584709 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f0cdc08d470 con 0x7f0cec0fcb00 2023-12-12T11:53:49.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.802+0000 7f0cf1d68700 1 --2- 172.21.15.63:0/2611584709 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f0cd806cc00 0x7f0cd806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:53:49.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.802+0000 7f0cf1d68700 1 --2- 172.21.15.63:0/2611584709 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f0cd806cc00 0x7f0cd806f0b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8009fd0 tx=0x7f0ce800b040 comp rx=0 tx=0).ready entity=mgr.14732 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:53:49.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:49.808+0000 7f0ce27fc700 1 -- 172.21.15.63:0/2611584709 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f0cdc05b0a0 con 0x7f0cec0fcb00 2023-12-12T11:53:49.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:49 smithi093 ceph-mon[115914]: pgmap v29: 65 pgs: 65 active+clean; 231 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 2.0 MiB/s wr, 544 op/s 2023-12-12T11:53:49.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:49 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/3939913995' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:53:50.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:49 smithi063 ceph-mon[107117]: pgmap v29: 65 pgs: 65 active+clean; 231 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 2.0 MiB/s wr, 544 op/s 2023-12-12T11:53:50.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:49 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/3939913995' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:53:50.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:50.236+0000 7f0cf2d6a700 1 -- 172.21.15.63:0/2611584709 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0cec110c60 con 0x7f0cec0fcb00 2023-12-12T11:53:50.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:50.237+0000 7f0ce27fc700 1 -- 172.21.15.63:0/2611584709 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f0cec110c60 con 0x7f0cec0fcb00 2023-12-12T11:53:50.239 INFO:teuthology.orchestra.run.smithi063.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-12T11:53:50.240 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-12T11:53:50.240 INFO:teuthology.orchestra.run.smithi063.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-12T11:53:50.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:50.240+0000 7f0cf2d6a700 1 -- 172.21.15.63:0/2611584709 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f0cd806cc00 msgr2=0x7f0cd806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:50.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:50.240+0000 7f0cf2d6a700 1 --2- 172.21.15.63:0/2611584709 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f0cd806cc00 0x7f0cd806f0b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8009fd0 tx=0x7f0ce800b040 comp rx=0 tx=0).stop 2023-12-12T11:53:50.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:50.240+0000 7f0cf2d6a700 1 -- 172.21.15.63:0/2611584709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cec0fcb00 msgr2=0x7f0cec10f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:53:50.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:50.240+0000 7f0cf2d6a700 1 --2- 172.21.15.63:0/2611584709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cec0fcb00 0x7f0cec10f9b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc00b3b0 tx=0x7f0cdc009e30 comp rx=0 tx=0).stop 2023-12-12T11:53:50.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:50.240+0000 7f0cf2d6a700 1 -- 172.21.15.63:0/2611584709 shutdown_connections 2023-12-12T11:53:50.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:50.240+0000 7f0cf2d6a700 1 --2- 172.21.15.63:0/2611584709 >> [v2:172.21.15.63:6800/368827847,v1:172.21.15.63:6801/368827847] conn(0x7f0cd806cc00 0x7f0cd806f0b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:50.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:50.240+0000 7f0cf2d6a700 1 --2- 172.21.15.63:0/2611584709 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0cec0fb8f0 0x7f0cec10f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:50.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:50.240+0000 7f0cf2d6a700 1 --2- 172.21.15.63:0/2611584709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cec0fcb00 0x7f0cec10f9b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:53:50.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:50.240+0000 7f0cf2d6a700 1 -- 172.21.15.63:0/2611584709 >> 172.21.15.63:0/2611584709 conn(0x7f0cec0f6f70 msgr2=0x7f0cec065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:53:50.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:50.240+0000 7f0cf2d6a700 1 -- 172.21.15.63:0/2611584709 shutdown_connections 2023-12-12T11:53:50.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:53:50.241+0000 7f0cf2d6a700 1 -- 172.21.15.63:0/2611584709 wait complete. 2023-12-12T11:53:50.728 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2023-12-12T11:53:50.728 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2023-12-12T11:53:50.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:50 smithi093 ceph-mon[115914]: from='client.14822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:53:50.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:50 smithi093 ceph-mon[115914]: from='client.? 172.21.15.63:0/2611584709' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:53:51.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:50 smithi063 ceph-mon[107117]: from='client.14822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:53:51.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:50 smithi063 ceph-mon[107117]: from='client.? 172.21.15.63:0/2611584709' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:53:51.701 DEBUG:teuthology.parallel:result is None 2023-12-12T11:53:51.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:51 smithi093 ceph-mon[115914]: Upgrade: Updating mon.smithi063 2023-12-12T11:53:51.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:51 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:51.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:51 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-12T11:53:51.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:51 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-12T11:53:51.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:51 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:53:51.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:51 smithi093 ceph-mon[115914]: Deploying daemon mon.smithi063 on smithi063 2023-12-12T11:53:51.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:51 smithi093 ceph-mon[115914]: pgmap v30: 65 pgs: 65 active+clean; 231 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 377 op/s 2023-12-12T11:53:51.993 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:51 smithi063 ceph-mon[107117]: Upgrade: Updating mon.smithi063 2023-12-12T11:53:51.993 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:51 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:53:51.993 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:51 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-12T11:53:51.993 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:51 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-12T11:53:51.993 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:51 smithi063 ceph-mon[107117]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:53:51.993 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:51 smithi063 ceph-mon[107117]: Deploying daemon mon.smithi063 on smithi063 2023-12-12T11:53:51.993 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:51 smithi063 ceph-mon[107117]: pgmap v30: 65 pgs: 65 active+clean; 231 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 377 op/s 2023-12-12T11:53:52.870 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:52 smithi063 systemd[1]: Stopping Ceph mon.smithi063 for 85e33c70-98e3-11ee-95a3-87774f69a715... 2023-12-12T11:53:53.140 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:52 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-mon-smithi063[107093]: 2023-12-12T11:53:52.867+0000 7f99930f8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi063 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-12T11:53:53.141 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:52 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-mon-smithi063[107093]: 2023-12-12T11:53:52.867+0000 7f99930f8700 -1 mon.smithi063@0(leader) e2 *** Got Signal Terminated *** 2023-12-12T11:53:53.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:53 smithi063 bash[187063]: ceph-85e33c70-98e3-11ee-95a3-87774f69a715-mon-smithi063 2023-12-12T11:53:54.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:53 smithi063 systemd[1]: ceph-85e33c70-98e3-11ee-95a3-87774f69a715@mon.smithi063.service: Succeeded. 2023-12-12T11:53:54.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:53 smithi063 systemd[1]: Stopped Ceph mon.smithi063 for 85e33c70-98e3-11ee-95a3-87774f69a715. 2023-12-12T11:53:54.493 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 systemd[1]: Starting Ceph mon.smithi063 for 85e33c70-98e3-11ee-95a3-87774f69a715... 2023-12-12T11:53:54.497 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2023-12-12T11:53:54.497 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-12T11:53:54.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 bash[187219]: 11f12a2e88e4031fc676d98462da090952914c7b58daa32df0f109e411eb268f 2023-12-12T11:53:54.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: set uid:gid to 167:167 (ceph:ceph) 2023-12-12T11:53:54.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev), process ceph-mon, pid 7 2023-12-12T11:53:54.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: pidfile_write: ignore empty --pid-file 2023-12-12T11:53:54.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 systemd[1]: Started Ceph mon.smithi063 for 85e33c70-98e3-11ee-95a3-87774f69a715. 2023-12-12T11:53:54.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: load: jerasure load: lrc 2023-12-12T11:53:54.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: RocksDB version: 7.9.2 2023-12-12T11:53:54.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Git sha 0 2023-12-12T11:53:54.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Compile date 2023-12-11 04:34:03 2023-12-12T11:53:54.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: DB SUMMARY 2023-12-12T11:53:54.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: DB Session ID: FNOE6IH59R0CR30SZUHL 2023-12-12T11:53:54.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: CURRENT file: CURRENT 2023-12-12T11:53:54.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: IDENTITY file: IDENTITY 2023-12-12T11:53:54.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1171 Bytes 2023-12-12T11:53:54.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi063/store.db dir, Total Num: 1, files: 000033.sst 2023-12-12T11:53:54.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi063/store.db: 000031.log size: 50073 ; 2023-12-12T11:53:54.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.error_if_exists: 0 2023-12-12T11:53:54.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.create_if_missing: 0 2023-12-12T11:53:54.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.paranoid_checks: 1 2023-12-12T11:53:54.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-12T11:53:54.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-12T11:53:54.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-12T11:53:54.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.env: 0x5584e2417a60 2023-12-12T11:53:54.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.fs: PosixFileSystem 2023-12-12T11:53:54.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.info_log: 0x5584e4aa1640 2023-12-12T11:53:54.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.max_file_opening_threads: 16 2023-12-12T11:53:54.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.statistics: (nil) 2023-12-12T11:53:54.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.use_fsync: 0 2023-12-12T11:53:54.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.max_log_file_size: 0 2023-12-12T11:53:54.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-12T11:53:54.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-12T11:53:54.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.keep_log_file_num: 1000 2023-12-12T11:53:54.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.recycle_log_file_num: 0 2023-12-12T11:53:54.798 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.allow_fallocate: 1 2023-12-12T11:53:54.798 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.allow_mmap_reads: 0 2023-12-12T11:53:54.798 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.allow_mmap_writes: 0 2023-12-12T11:53:54.798 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.use_direct_reads: 0 2023-12-12T11:53:54.798 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-12T11:53:54.798 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.create_missing_column_families: 0 2023-12-12T11:53:54.800 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.db_log_dir: 2023-12-12T11:53:54.800 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.wal_dir: 2023-12-12T11:53:54.800 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-12T11:53:54.800 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-12T11:53:54.800 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-12T11:53:54.800 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-12T11:53:54.800 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-12T11:53:54.800 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-12T11:53:54.800 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.advise_random_on_open: 1 2023-12-12T11:53:54.800 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.db_write_buffer_size: 0 2023-12-12T11:53:54.800 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.write_buffer_manager: 0x5584e4a57360 2023-12-12T11:53:54.801 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-12T11:53:54.801 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-12T11:53:54.801 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-12T11:53:54.801 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.rate_limiter: (nil) 2023-12-12T11:53:54.801 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-12T11:53:54.801 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.wal_recovery_mode: 2 2023-12-12T11:53:54.801 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.enable_thread_tracking: 0 2023-12-12T11:53:54.801 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.enable_pipelined_write: 0 2023-12-12T11:53:54.801 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.unordered_write: 0 2023-12-12T11:53:54.801 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-12T11:53:54.801 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-12T11:53:54.802 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-12T11:53:54.802 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-12T11:53:54.802 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.row_cache: None 2023-12-12T11:53:54.802 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.wal_filter: None 2023-12-12T11:53:54.802 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-12T11:53:54.802 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.allow_ingest_behind: 0 2023-12-12T11:53:54.802 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.two_write_queues: 0 2023-12-12T11:53:54.802 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.manual_wal_flush: 0 2023-12-12T11:53:54.802 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.wal_compression: 0 2023-12-12T11:53:54.802 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.atomic_flush: 0 2023-12-12T11:53:54.802 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-12T11:53:54.802 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-12T11:53:54.802 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-12T11:53:54.802 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.log_readahead_size: 0 2023-12-12T11:53:54.803 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-12T11:53:54.803 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.best_efforts_recovery: 0 2023-12-12T11:53:54.803 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-12T11:53:54.803 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-12T11:53:54.803 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.allow_data_in_errors: 0 2023-12-12T11:53:54.803 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.db_host_id: __hostname__ 2023-12-12T11:53:54.803 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-12T11:53:54.803 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.max_background_jobs: 2 2023-12-12T11:53:54.803 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.max_background_compactions: -1 2023-12-12T11:53:54.803 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.max_subcompactions: 1 2023-12-12T11:53:54.803 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-12T11:53:54.803 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-12T11:53:54.803 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-12T11:53:54.804 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.max_total_wal_size: 0 2023-12-12T11:53:54.804 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-12T11:53:54.804 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-12T11:53:54.804 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-12T11:53:54.804 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-12T11:53:54.804 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.max_open_files: -1 2023-12-12T11:53:54.804 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.bytes_per_sync: 0 2023-12-12T11:53:54.804 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-12T11:53:54.804 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-12T11:53:54.804 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.compaction_readahead_size: 0 2023-12-12T11:53:54.804 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.max_background_flushes: -1 2023-12-12T11:53:54.804 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Compression algorithms supported: 2023-12-12T11:53:54.804 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-12T11:53:54.804 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: kZSTD supported: 0 2023-12-12T11:53:54.804 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: kXpressCompression supported: 0 2023-12-12T11:53:54.805 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: kLZ4HCCompression supported: 1 2023-12-12T11:53:54.805 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: kZlibCompression supported: 1 2023-12-12T11:53:54.805 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: kSnappyCompression supported: 1 2023-12-12T11:53:54.805 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: kLZ4Compression supported: 1 2023-12-12T11:53:54.805 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: kBZip2Compression supported: 0 2023-12-12T11:53:54.805 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-12T11:53:54.805 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-12T11:53:54.805 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi063/store.db/MANIFEST-000015 2023-12-12T11:53:54.805 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-12T11:53:54.805 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-12T11:53:54.805 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.merge_operator: 2023-12-12T11:53:54.805 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.compaction_filter: None 2023-12-12T11:53:54.805 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.compaction_filter_factory: None 2023-12-12T11:53:54.805 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.sst_partitioner_factory: None 2023-12-12T11:53:54.805 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-12T11:53:54.806 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-12T11:53:54.806 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5584e4aa1740) 2023-12-12T11:53:54.806 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: cache_index_and_filter_blocks: 1 2023-12-12T11:53:54.806 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-12T11:53:54.806 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-12T11:53:54.806 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: pin_top_level_index_and_filter: 1 2023-12-12T11:53:54.806 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: index_type: 0 2023-12-12T11:53:54.806 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: data_block_index_type: 0 2023-12-12T11:53:54.806 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: index_shortening: 1 2023-12-12T11:53:54.806 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-12T11:53:54.806 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: checksum: 4 2023-12-12T11:53:54.806 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: no_block_cache: 0 2023-12-12T11:53:54.806 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_cache: 0x5584e4af7090 2023-12-12T11:53:54.806 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_cache_name: BinnedLRUCache 2023-12-12T11:53:54.807 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_cache_options: 2023-12-12T11:53:54.807 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: capacity : 536870912 2023-12-12T11:53:54.807 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: num_shard_bits : 4 2023-12-12T11:53:54.807 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: strict_capacity_limit : 0 2023-12-12T11:53:54.807 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: high_pri_pool_ratio: 0.000 2023-12-12T11:53:54.807 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_cache_compressed: (nil) 2023-12-12T11:53:54.807 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: persistent_cache: (nil) 2023-12-12T11:53:54.807 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_size: 4096 2023-12-12T11:53:54.807 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_size_deviation: 10 2023-12-12T11:53:54.807 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_restart_interval: 16 2023-12-12T11:53:54.807 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: index_block_restart_interval: 1 2023-12-12T11:53:54.807 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: metadata_block_size: 4096 2023-12-12T11:53:54.807 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: partition_filters: 0 2023-12-12T11:53:54.807 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: use_delta_encoding: 1 2023-12-12T11:53:54.807 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: filter_policy: bloomfilter 2023-12-12T11:53:54.808 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: whole_key_filtering: 1 2023-12-12T11:53:54.808 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: verify_compression: 0 2023-12-12T11:53:54.808 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: read_amp_bytes_per_bit: 0 2023-12-12T11:53:54.808 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: format_version: 5 2023-12-12T11:53:54.808 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: enable_index_compression: 1 2023-12-12T11:53:54.808 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_align: 0 2023-12-12T11:53:54.808 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: max_auto_readahead_size: 262144 2023-12-12T11:53:54.808 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: prepopulate_block_cache: 0 2023-12-12T11:53:54.808 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: initial_auto_readahead_size: 8192 2023-12-12T11:53:54.808 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: num_file_reads_for_auto_readahead: 2 2023-12-12T11:53:54.808 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.write_buffer_size: 33554432 2023-12-12T11:53:54.808 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.max_write_buffer_number: 2 2023-12-12T11:53:54.808 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.compression: NoCompression 2023-12-12T11:53:54.808 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.bottommost_compression: Disabled 2023-12-12T11:53:54.809 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.prefix_extractor: nullptr 2023-12-12T11:53:54.809 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-12T11:53:54.809 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.num_levels: 7 2023-12-12T11:53:54.809 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-12T11:53:54.809 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-12T11:53:54.809 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-12T11:53:54.809 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-12T11:53:54.809 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-12T11:53:54.809 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-12T11:53:54.809 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-12T11:53:54.809 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-12T11:53:54.809 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-12T11:53:54.809 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-12T11:53:54.809 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-12T11:53:54.809 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-12T11:53:54.810 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-12T11:53:54.810 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.compression_opts.level: 32767 2023-12-12T11:53:54.810 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.compression_opts.strategy: 0 2023-12-12T11:53:54.810 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-12T11:53:54.810 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-12T11:53:54.810 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-12T11:53:54.810 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-12T11:53:54.810 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.compression_opts.enabled: false 2023-12-12T11:53:54.810 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-12T11:53:54.810 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-12T11:53:54.810 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-12T11:53:54.810 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-12T11:53:54.810 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.target_file_size_base: 67108864 2023-12-12T11:53:54.810 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-12T11:53:54.811 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-12T11:53:54.811 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-12T11:53:54.811 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-12T11:53:54.811 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-12T11:53:54.811 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-12T11:53:54.811 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-12T11:53:54.811 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-12T11:53:54.811 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-12T11:53:54.811 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-12T11:53:54.811 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-12T11:53:54.811 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-12T11:53:54.811 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-12T11:53:54.811 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-12T11:53:54.811 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.arena_block_size: 1048576 2023-12-12T11:53:54.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-12T11:53:54.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-12T11:53:54.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.disable_auto_compactions: 0 2023-12-12T11:53:54.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-12T11:53:54.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-12T11:53:54.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-12T11:53:54.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-12T11:53:54.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-12T11:53:54.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-12T11:53:54.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-12T11:53:54.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-12T11:53:54.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-12T11:53:54.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-12T11:53:54.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.table_properties_collectors: 2023-12-12T11:53:54.812 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.inplace_update_support: 0 2023-12-12T11:53:54.813 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-12T11:53:54.813 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-12T11:53:54.813 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-12T11:53:54.813 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-12T11:53:54.813 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.bloom_locality: 0 2023-12-12T11:53:54.813 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.max_successive_merges: 0 2023-12-12T11:53:54.813 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-12T11:53:54.813 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.paranoid_file_checks: 0 2023-12-12T11:53:54.813 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.force_consistency_checks: 1 2023-12-12T11:53:54.813 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.report_bg_io_stats: 0 2023-12-12T11:53:54.813 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.ttl: 2592000 2023-12-12T11:53:54.813 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-12T11:53:54.813 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-12T11:53:54.813 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-12T11:53:54.814 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.enable_blob_files: false 2023-12-12T11:53:54.814 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.min_blob_size: 0 2023-12-12T11:53:54.814 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.blob_file_size: 268435456 2023-12-12T11:53:54.814 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-12T11:53:54.814 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-12T11:53:54.814 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-12T11:53:54.814 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-12T11:53:54.814 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-12T11:53:54.814 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.blob_file_starting_level: 0 2023-12-12T11:53:54.814 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-12T11:53:54.814 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 33.sst 2023-12-12T11:53:54.814 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-12T11:53:54.814 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi063/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 35, last_sequence is 12118, log_number is 31,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-12T11:53:54.814 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 31 2023-12-12T11:53:54.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: dd20ea7e-1a6a-4575-b807-93642a2628b0 2023-12-12T11:53:54.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702382034682519, "job": 1, "event": "recovery_started", "wal_files": [31]} 2023-12-12T11:53:54.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #31 mode 2 2023-12-12T11:53:54.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702382034683611, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 36, "file_size": 49912, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12119, "largest_seqno": 12213, "table_properties": {"data_size": 48522, "index_size": 186, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 197, "raw_key_size": 1282, "raw_average_key_size": 24, "raw_value_size": 47387, "raw_average_value_size": 911, "num_data_blocks": 9, "num_entries": 52, "num_filter_entries": 52, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1702382034, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "dd20ea7e-1a6a-4575-b807-93642a2628b0", "db_session_id": "FNOE6IH59R0CR30SZUHL", "orig_file_number": 36, "seqno_to_time_mapping": "N/A"}} 2023-12-12T11:53:54.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702382034683744, "job": 1, "event": "recovery_finished"} 2023-12-12T11:53:54.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: [db/version_set.cc:5047] Creating manifest 38 2023-12-12T11:53:54.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-12T11:53:54.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi063/store.db/000031.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-12T11:53:54.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5584e4b92000 2023-12-12T11:53:54.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: DB pointer 0x5584e4b7e000 2023-12-12T11:53:54.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-12T11:53:54.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-12T11:53:54.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ** DB Stats ** 2023-12-12T11:53:54.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-12T11:53:54.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-12T11:53:54.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-12T11:53:54.816 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-12T11:53:54.816 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-12T11:53:54.816 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-12T11:53:54.816 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-12T11:53:54.816 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-12T11:53:54.816 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ** Compaction Stats [default] ** 2023-12-12T11:53:54.816 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-12T11:53:54.816 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-12T11:53:54.816 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: L0 1/0 48.74 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 67.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-12T11:53:54.816 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: L6 1/0 5.99 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2023-12-12T11:53:54.816 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Sum 2/0 6.04 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 67.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-12T11:53:54.816 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 67.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-12T11:53:54.816 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-12T11:53:54.816 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ** Compaction Stats [default] ** 2023-12-12T11:53:54.816 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-12T11:53:54.817 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-12T11:53:54.817 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 67.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-12T11:53:54.817 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-12T11:53:54.817 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-12T11:53:54.817 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-12T11:53:54.817 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-12T11:53:54.817 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-12T11:53:54.817 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-12T11:53:54.817 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-12T11:53:54.817 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-12T11:53:54.817 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-12T11:53:54.817 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Cumulative compaction: 0.00 GB write, 6.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-12T11:53:54.817 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Interval compaction: 0.00 GB write, 6.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-12T11:53:54.817 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-12T11:53:54.817 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Block cache BinnedLRUCache@0x5584e4af7090#7 capacity: 512.00 MB usage: 0.50 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2023-12-12T11:53:54.818 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.23 KB,4.47035e-05%) IndexBlock(1,0.27 KB,5.06639e-05%) Misc(1,0.00 KB,0%) 2023-12-12T11:53:54.818 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-12T11:53:54.818 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-12T11:53:54.818 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: starting mon.smithi063 rank 0 at public addrs [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] at bind addrs [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi063 fsid 85e33c70-98e3-11ee-95a3-87774f69a715 2023-12-12T11:53:54.818 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: mon.smithi063@-1(???) e2 preinit fsid 85e33c70-98e3-11ee-95a3-87774f69a715 2023-12-12T11:53:54.818 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: mon.smithi063@-1(???).mds e13 new map 2023-12-12T11:53:54.818 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: mon.smithi063@-1(???).mds e13 print_map 2023-12-12T11:53:54.818 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: e13 2023-12-12T11:53:54.818 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-12T11:53:54.818 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:53:54.818 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: legacy client fscid: 1 2023-12-12T11:53:54.818 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-12T11:53:54.818 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Filesystem 'cephfs' (1) 2023-12-12T11:53:54.818 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: fs_name cephfs 2023-12-12T11:53:54.819 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: epoch 13 2023-12-12T11:53:54.819 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-12T11:53:54.819 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: created 2023-12-12T11:48:58.523481+0000 2023-12-12T11:53:54.819 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: modified 2023-12-12T11:49:14.113993+0000 2023-12-12T11:53:54.819 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: tableserver 0 2023-12-12T11:53:54.819 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: root 0 2023-12-12T11:53:54.819 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: session_timeout 60 2023-12-12T11:53:54.819 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: session_autoclose 300 2023-12-12T11:53:54.819 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: max_file_size 1099511627776 2023-12-12T11:53:54.819 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: max_xattr_size 65536 2023-12-12T11:53:54.819 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: required_client_features {} 2023-12-12T11:53:54.819 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: last_failure 0 2023-12-12T11:53:54.819 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: last_failure_osd_epoch 46 2023-12-12T11:53:54.819 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:53:54.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: max_mds 1 2023-12-12T11:53:54.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: in 0 2023-12-12T11:53:54.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: up {0=14492} 2023-12-12T11:53:54.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: failed 2023-12-12T11:53:54.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: damaged 2023-12-12T11:53:54.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: stopped 2023-12-12T11:53:54.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: data_pools [3] 2023-12-12T11:53:54.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: metadata_pool 2 2023-12-12T11:53:54.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: inline_data enabled 2023-12-12T11:53:54.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: balancer 2023-12-12T11:53:54.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: bal_rank_mask -1 2023-12-12T11:53:54.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: standby_count_wanted 1 2023-12-12T11:53:54.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: [mds.cephfs.smithi063.aevpzg{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.63:6828/3709000039,v1:172.21.15.63:6829/3709000039] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:53:54.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-12T11:53:54.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-12T11:53:54.821 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Standby daemons: 2023-12-12T11:53:54.821 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-12T11:53:54.821 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: [mds.cephfs.smithi093.swdqms{-1:14500} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.93:6826/3307558569,v1:172.21.15.93:6827/3307558569] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:53:54.821 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: [mds.cephfs.smithi063.bdqbnp{-1:14508} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/2191270944,v1:172.21.15.63:6827/2191270944] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:53:54.821 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: [mds.cephfs.smithi093.rhaqsh{-1:24317} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.93:6824/3161864019,v1:172.21.15.93:6825/3161864019] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:53:54.821 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: mon.smithi063@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2023-12-12T11:53:54.821 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: mon.smithi063@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2023-12-12T11:53:54.821 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: mon.smithi063@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2023-12-12T11:53:54.821 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: mon.smithi063@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2023-12-12T11:53:54.821 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:54 smithi063 ceph-mon[187282]: mon.smithi063@-1(???).paxosservice(auth 1..20) refresh upgraded, format 0 -> 3 2023-12-12T11:53:55.511 DEBUG:teuthology.parallel:result is None 2023-12-12T11:53:55.511 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-12T11:53:55.592 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-12T11:53:55.593 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2023-12-12T11:53:55.680 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2023-12-12T11:53:55.681 DEBUG:teuthology.parallel:result is None 2023-12-12T11:53:56.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:56 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-12T11:53:56.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:56 smithi093 ceph-mon[115914]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi093"}]: dispatch 2023-12-12T11:53:56.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:56 smithi093 ceph-mon[115914]: pgmap v32: 65 pgs: 65 active+clean; 221 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 1.9 MiB/s wr, 625 op/s 2023-12-12T11:53:56.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:56 smithi093 ceph-mon[115914]: mon.smithi063 calling monitor election 2023-12-12T11:53:56.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:56 smithi093 ceph-mon[115914]: mon.smithi063 is new leader, mons smithi063,smithi093 in quorum (ranks 0,1) 2023-12-12T11:53:56.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:56 smithi093 ceph-mon[115914]: monmap e2: 2 mons at {smithi063=[v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0],smithi093=[v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-12T11:53:56.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:56 smithi093 ceph-mon[115914]: fsmap cephfs:1 {0=cephfs.smithi063.aevpzg=up:active} 3 up:standby 2023-12-12T11:53:56.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:56 smithi093 ceph-mon[115914]: osdmap e48: 6 total, 6 up, 6 in 2023-12-12T11:53:56.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:56 smithi093 ceph-mon[115914]: mgrmap e30: smithi063.zjnfdi(active, since 59s), standbys: smithi093.nbtltu 2023-12-12T11:53:56.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:56 smithi093 ceph-mon[115914]: from='mgr.14732 ' entity='' 2023-12-12T11:53:56.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:56 smithi093 ceph-mon[115914]: mgrmap e31: smithi063.zjnfdi(active, since 59s), standbys: smithi093.nbtltu 2023-12-12T11:53:56.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:56 smithi093 ceph-mon[115914]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-12T11:53:56.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:56 smithi093 ceph-mon[115914]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-12T11:53:56.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:53:56 smithi093 ceph-mon[115914]: fs cephfs has deprecated feature inline_data enabled. 2023-12-12T11:53:56.533 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:56 smithi063 ceph-mon[187282]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-12T11:53:56.533 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:56 smithi063 ceph-mon[187282]: from='mgr.14732 172.21.15.63:0/738179803' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi093"}]: dispatch 2023-12-12T11:53:56.533 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:56 smithi063 ceph-mon[187282]: pgmap v32: 65 pgs: 65 active+clean; 221 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 1.9 MiB/s wr, 625 op/s 2023-12-12T11:53:56.533 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:56 smithi063 ceph-mon[187282]: mon.smithi063 calling monitor election 2023-12-12T11:53:56.534 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:56 smithi063 ceph-mon[187282]: mon.smithi063 is new leader, mons smithi063,smithi093 in quorum (ranks 0,1) 2023-12-12T11:53:56.534 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:56 smithi063 ceph-mon[187282]: monmap e2: 2 mons at {smithi063=[v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0],smithi093=[v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-12T11:53:56.534 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:56 smithi063 ceph-mon[187282]: fsmap cephfs:1 {0=cephfs.smithi063.aevpzg=up:active} 3 up:standby 2023-12-12T11:53:56.534 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:56 smithi063 ceph-mon[187282]: osdmap e48: 6 total, 6 up, 6 in 2023-12-12T11:53:56.534 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:56 smithi063 ceph-mon[187282]: mgrmap e30: smithi063.zjnfdi(active, since 59s), standbys: smithi093.nbtltu 2023-12-12T11:53:56.534 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:56 smithi063 ceph-mon[187282]: from='mgr.14732 ' entity='' 2023-12-12T11:53:56.534 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:56 smithi063 ceph-mon[187282]: mgrmap e31: smithi063.zjnfdi(active, since 59s), standbys: smithi093.nbtltu 2023-12-12T11:53:56.534 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:56 smithi063 ceph-mon[187282]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-12T11:53:56.534 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:56 smithi063 ceph-mon[187282]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-12T11:53:56.534 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:53:56 smithi063 ceph-mon[187282]: fs cephfs has deprecated feature inline_data enabled. 2023-12-12T11:54:05.703 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-mon-smithi093[115890]: 2023-12-12T11:54:05.319+0000 7f8cf0b52700 -1 mon.smithi093@1(peon).osd e49 update_from_paxos full map CRC mismatch, resetting to canonical 2023-12-12T11:54:05.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: Standby manager daemon smithi093.nbtltu restarted 2023-12-12T11:54:05.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: Standby manager daemon smithi093.nbtltu started 2023-12-12T11:54:05.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: from='mgr.? 172.21.15.93:0/807898982' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi093.nbtltu/crt"}]: dispatch 2023-12-12T11:54:05.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: from='mgr.? 172.21.15.93:0/807898982' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-12T11:54:05.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: from='mgr.? 172.21.15.93:0/807898982' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi093.nbtltu/key"}]: dispatch 2023-12-12T11:54:05.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: from='mgr.? 172.21.15.93:0/807898982' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-12T11:54:05.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: Active manager daemon smithi063.zjnfdi restarted 2023-12-12T11:54:05.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: Activating manager daemon smithi063.zjnfdi 2023-12-12T11:54:05.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: osdmap e49: 6 total, 6 up, 6 in 2023-12-12T11:54:05.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: mgrmap e32: smithi063.zjnfdi(active, starting, since 0.00740386s), standbys: smithi093.nbtltu 2023-12-12T11:54:05.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: failed to encode map e49 with expected crc 2023-12-12T11:54:05.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-12T11:54:05.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi093"}]: dispatch 2023-12-12T11:54:05.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.aevpzg"}]: dispatch 2023-12-12T11:54:05.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi093.swdqms"}]: dispatch 2023-12-12T11:54:05.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.bdqbnp"}]: dispatch 2023-12-12T11:54:05.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi093.rhaqsh"}]: dispatch 2023-12-12T11:54:05.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr metadata", "who": "smithi063.zjnfdi", "id": "smithi063.zjnfdi"}]: dispatch 2023-12-12T11:54:05.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr metadata", "who": "smithi093.nbtltu", "id": "smithi093.nbtltu"}]: dispatch 2023-12-12T11:54:05.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-12T11:54:05.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-12T11:54:05.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-12T11:54:05.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-12T11:54:05.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-12T11:54:05.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-12T11:54:05.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-12T11:54:05.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-12T11:54:05.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-12T11:54:05.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: Manager daemon smithi063.zjnfdi is now available 2023-12-12T11:54:05.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:54:05.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:54:05.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:54:05.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.zjnfdi/mirror_snapshot_schedule"}]: dispatch 2023-12-12T11:54:05.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:05 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.zjnfdi/trash_purge_schedule"}]: dispatch 2023-12-12T11:54:06.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: Standby manager daemon smithi093.nbtltu restarted 2023-12-12T11:54:06.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: Standby manager daemon smithi093.nbtltu started 2023-12-12T11:54:06.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: from='mgr.? 172.21.15.93:0/807898982' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi093.nbtltu/crt"}]: dispatch 2023-12-12T11:54:06.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: from='mgr.? 172.21.15.93:0/807898982' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-12T11:54:06.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: from='mgr.? 172.21.15.93:0/807898982' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi093.nbtltu/key"}]: dispatch 2023-12-12T11:54:06.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: from='mgr.? 172.21.15.93:0/807898982' entity='mgr.smithi093.nbtltu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-12T11:54:06.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: Active manager daemon smithi063.zjnfdi restarted 2023-12-12T11:54:06.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: Activating manager daemon smithi063.zjnfdi 2023-12-12T11:54:06.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: osdmap e49: 6 total, 6 up, 6 in 2023-12-12T11:54:06.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: mgrmap e32: smithi063.zjnfdi(active, starting, since 0.00740386s), standbys: smithi093.nbtltu 2023-12-12T11:54:06.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: failed to encode map e49 with expected crc 2023-12-12T11:54:06.046 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-12T11:54:06.046 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi093"}]: dispatch 2023-12-12T11:54:06.046 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.aevpzg"}]: dispatch 2023-12-12T11:54:06.046 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi093.swdqms"}]: dispatch 2023-12-12T11:54:06.046 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.bdqbnp"}]: dispatch 2023-12-12T11:54:06.046 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi093.rhaqsh"}]: dispatch 2023-12-12T11:54:06.046 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr metadata", "who": "smithi063.zjnfdi", "id": "smithi063.zjnfdi"}]: dispatch 2023-12-12T11:54:06.046 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr metadata", "who": "smithi093.nbtltu", "id": "smithi093.nbtltu"}]: dispatch 2023-12-12T11:54:06.046 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-12T11:54:06.046 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-12T11:54:06.046 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-12T11:54:06.046 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-12T11:54:06.047 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-12T11:54:06.047 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-12T11:54:06.047 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-12T11:54:06.047 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-12T11:54:06.047 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-12T11:54:06.047 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: Manager daemon smithi063.zjnfdi is now available 2023-12-12T11:54:06.047 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:54:06.047 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:54:06.047 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:54:06.047 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.zjnfdi/mirror_snapshot_schedule"}]: dispatch 2023-12-12T11:54:06.047 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:05 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.zjnfdi/trash_purge_schedule"}]: dispatch 2023-12-12T11:54:06.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:06 smithi093 ceph-mon[115914]: failed to encode map e49 with expected crc 2023-12-12T11:54:06.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:06 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:06.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:06 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:06.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:06 smithi093 ceph-mon[115914]: mgrmap e33: smithi063.zjnfdi(active, since 1.01318s), standbys: smithi093.nbtltu 2023-12-12T11:54:06.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:06 smithi093 ceph-mon[115914]: pgmap v3: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:07.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:06 smithi063 ceph-mon[187282]: failed to encode map e49 with expected crc 2023-12-12T11:54:07.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:06 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:07.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:06 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:07.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:06 smithi063 ceph-mon[187282]: mgrmap e33: smithi063.zjnfdi(active, since 1.01318s), standbys: smithi093.nbtltu 2023-12-12T11:54:07.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:06 smithi063 ceph-mon[187282]: pgmap v3: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:08.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:08 smithi093 ceph-mon[115914]: [12/Dec/2023:11:54:06] ENGINE Bus STARTING 2023-12-12T11:54:08.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:08 smithi093 ceph-mon[115914]: [12/Dec/2023:11:54:06] ENGINE Serving on https://172.21.15.63:7150 2023-12-12T11:54:08.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:08 smithi093 ceph-mon[115914]: [12/Dec/2023:11:54:06] ENGINE Serving on http://172.21.15.63:8765 2023-12-12T11:54:08.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:08 smithi093 ceph-mon[115914]: [12/Dec/2023:11:54:06] ENGINE Bus STARTED 2023-12-12T11:54:08.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:08 smithi093 ceph-mon[115914]: pgmap v4: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:08.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:08 smithi093 ceph-mon[115914]: mgrmap e34: smithi063.zjnfdi(active, since 2s), standbys: smithi093.nbtltu 2023-12-12T11:54:08.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:08 smithi063 ceph-mon[187282]: [12/Dec/2023:11:54:06] ENGINE Bus STARTING 2023-12-12T11:54:08.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:08 smithi063 ceph-mon[187282]: [12/Dec/2023:11:54:06] ENGINE Serving on https://172.21.15.63:7150 2023-12-12T11:54:08.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:08 smithi063 ceph-mon[187282]: [12/Dec/2023:11:54:06] ENGINE Serving on http://172.21.15.63:8765 2023-12-12T11:54:08.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:08 smithi063 ceph-mon[187282]: [12/Dec/2023:11:54:06] ENGINE Bus STARTED 2023-12-12T11:54:08.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:08 smithi063 ceph-mon[187282]: pgmap v4: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:08.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:08 smithi063 ceph-mon[187282]: mgrmap e34: smithi063.zjnfdi(active, since 2s), standbys: smithi093.nbtltu 2023-12-12T11:54:09.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:09 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:09.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:09 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:09.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:09 smithi063 ceph-mon[187282]: pgmap v5: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:09.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:09 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:09.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:09 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:09.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:09 smithi093 ceph-mon[115914]: pgmap v5: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:10.720 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:10 smithi093 ceph-mon[115914]: mgrmap e35: smithi063.zjnfdi(active, since 4s), standbys: smithi093.nbtltu 2023-12-12T11:54:10.720 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:10 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:10.720 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:10 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:10.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:10 smithi063 ceph-mon[187282]: mgrmap e35: smithi063.zjnfdi(active, since 4s), standbys: smithi093.nbtltu 2023-12-12T11:54:10.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:10 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:10.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:10 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:11.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:11 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:11.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:11 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:11.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:11 smithi093 ceph-mon[115914]: pgmap v6: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 0 B/s wr, 23 op/s 2023-12-12T11:54:12.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:11 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:12.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:11 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:12.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:11 smithi063 ceph-mon[187282]: pgmap v6: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 0 B/s wr, 23 op/s 2023-12-12T11:54:13.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:12 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:13.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:12 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:13.202 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:12 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:13.203 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:12 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:14.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:14 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:14.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:14 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:14.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:14 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:14.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:14 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:54:14.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:14 smithi063 ceph-mon[187282]: Updating smithi063:/etc/ceph/ceph.conf 2023-12-12T11:54:14.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:14 smithi063 ceph-mon[187282]: Updating smithi093:/etc/ceph/ceph.conf 2023-12-12T11:54:14.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:14 smithi063 ceph-mon[187282]: pgmap v7: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2023-12-12T11:54:14.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:14 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:14.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:14 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:14.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:14 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:14.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:14 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:54:14.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:14 smithi093 ceph-mon[115914]: Updating smithi063:/etc/ceph/ceph.conf 2023-12-12T11:54:14.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:14 smithi093 ceph-mon[115914]: Updating smithi093:/etc/ceph/ceph.conf 2023-12-12T11:54:14.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:14 smithi093 ceph-mon[115914]: pgmap v7: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2023-12-12T11:54:15.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:15 smithi063 ceph-mon[187282]: Updating smithi063:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-12T11:54:15.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:15 smithi063 ceph-mon[187282]: Updating smithi093:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-12T11:54:15.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:15 smithi093 ceph-mon[115914]: Updating smithi063:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-12T11:54:15.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:15 smithi093 ceph-mon[115914]: Updating smithi093:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-12T11:54:16.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:16 smithi063 ceph-mon[187282]: Updating smithi063:/etc/ceph/ceph.client.admin.keyring 2023-12-12T11:54:16.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:16 smithi063 ceph-mon[187282]: Updating smithi093:/etc/ceph/ceph.client.admin.keyring 2023-12-12T11:54:16.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:16 smithi063 ceph-mon[187282]: Updating smithi063:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-12T11:54:16.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:16 smithi063 ceph-mon[187282]: Updating smithi093:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-12T11:54:16.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:16 smithi063 ceph-mon[187282]: pgmap v8: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2023-12-12T11:54:16.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:16 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:16.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:16 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:16.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:16 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:16.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:16 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:16.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:16 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:16.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:16 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:54:16.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:16 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:54:16.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:16 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-12T11:54:16.701 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:16 smithi093 ceph-mon[115914]: Updating smithi063:/etc/ceph/ceph.client.admin.keyring 2023-12-12T11:54:16.702 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:16 smithi093 ceph-mon[115914]: Updating smithi093:/etc/ceph/ceph.client.admin.keyring 2023-12-12T11:54:16.702 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:16 smithi093 ceph-mon[115914]: Updating smithi063:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-12T11:54:16.702 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:16 smithi093 ceph-mon[115914]: Updating smithi093:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-12T11:54:16.702 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:16 smithi093 ceph-mon[115914]: pgmap v8: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2023-12-12T11:54:16.702 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:16 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:16.702 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:16 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:16.702 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:16 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:16.702 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:16 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:16.702 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:16 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:16.702 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:16 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:54:16.702 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:16 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:54:16.702 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:16 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-12T11:54:18.266 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:18 smithi093 ceph-mon[115914]: Upgrade: Updating mon.smithi093 2023-12-12T11:54:18.266 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:18 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:18.266 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:18 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-12T11:54:18.266 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:18 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-12T11:54:18.266 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:18 smithi093 ceph-mon[115914]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:18.266 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:18 smithi093 ceph-mon[115914]: Deploying daemon mon.smithi093 on smithi093 2023-12-12T11:54:18.266 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:18 smithi093 ceph-mon[115914]: pgmap v9: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2023-12-12T11:54:18.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:18 smithi063 ceph-mon[187282]: Upgrade: Updating mon.smithi093 2023-12-12T11:54:18.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:18 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:18.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:18 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-12T11:54:18.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:18 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-12T11:54:18.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:18 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:18.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:18 smithi063 ceph-mon[187282]: Deploying daemon mon.smithi093 on smithi093 2023-12-12T11:54:18.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:18 smithi063 ceph-mon[187282]: pgmap v9: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2023-12-12T11:54:18.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:18 smithi093 systemd[1]: Stopping Ceph mon.smithi093 for 85e33c70-98e3-11ee-95a3-87774f69a715... 2023-12-12T11:54:19.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:18 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-mon-smithi093[115890]: 2023-12-12T11:54:18.774+0000 7f8cf635d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi093 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-12T11:54:19.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:18 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-mon-smithi093[115890]: 2023-12-12T11:54:18.774+0000 7f8cf635d700 -1 mon.smithi093@1(peon) e2 *** Got Signal Terminated *** 2023-12-12T11:54:19.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:19 smithi093 bash[171519]: ceph-85e33c70-98e3-11ee-95a3-87774f69a715-mon-smithi093 2023-12-12T11:54:19.569 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:19 smithi093 systemd[1]: ceph-85e33c70-98e3-11ee-95a3-87774f69a715@mon.smithi093.service: Succeeded. 2023-12-12T11:54:19.569 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:19 smithi093 systemd[1]: Stopped Ceph mon.smithi093 for 85e33c70-98e3-11ee-95a3-87774f69a715. 2023-12-12T11:54:19.964 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:19 smithi093 systemd[1]: Starting Ceph mon.smithi093 for 85e33c70-98e3-11ee-95a3-87774f69a715... 2023-12-12T11:54:20.403 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.400+0000 7fcbee60d700 1 -- 172.21.15.63:0/795693394 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbe80fde00 msgr2=0x7fcbe80fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:20.403 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.400+0000 7fcbee60d700 1 --2- 172.21.15.63:0/795693394 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbe80fde00 0x7fcbe80fe250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc004940 tx=0x7fcbdc009e30 comp rx=0 tx=0).stop 2023-12-12T11:54:20.403 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.400+0000 7fcbee60d700 1 -- 172.21.15.63:0/795693394 shutdown_connections 2023-12-12T11:54:20.403 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.400+0000 7fcbee60d700 1 --2- 172.21.15.63:0/795693394 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbe80fde00 0x7fcbe80fe250 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:20.403 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.400+0000 7fcbee60d700 1 --2- 172.21.15.63:0/795693394 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbe80fcbf0 0x7fcbe80fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:20.403 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.400+0000 7fcbee60d700 1 -- 172.21.15.63:0/795693394 >> 172.21.15.63:0/795693394 conn(0x7fcbe80f82d0 msgr2=0x7fcbe80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:54:20.403 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.400+0000 7fcbee60d700 1 -- 172.21.15.63:0/795693394 shutdown_connections 2023-12-12T11:54:20.403 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.400+0000 7fcbee60d700 1 -- 172.21.15.63:0/795693394 wait complete. 2023-12-12T11:54:20.404 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.401+0000 7fcbee60d700 1 Processor -- start 2023-12-12T11:54:20.404 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.402+0000 7fcbee60d700 1 -- start start 2023-12-12T11:54:20.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.402+0000 7fcbee60d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbe80fcbf0 0x7fcbe810f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:20.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.402+0000 7fcbee60d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbe80fde00 0x7fcbe810fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:20.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.402+0000 7fcbee60d700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe8110310 con 0x7fcbe80fde00 2023-12-12T11:54:20.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.402+0000 7fcbee60d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe8110b60 con 0x7fcbe80fcbf0 2023-12-12T11:54:20.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.403+0000 7fcbe77fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbe80fde00 0x7fcbe810fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:20.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.403+0000 7fcbe77fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbe80fde00 0x7fcbe810fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48196/0 (socket says 172.21.15.63:48196) 2023-12-12T11:54:20.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.403+0000 7fcbe77fe700 1 -- 172.21.15.63:0/3195569685 learned_addr learned my addr 172.21.15.63:0/3195569685 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:54:20.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.403+0000 7fcbe7fff700 1 --2- 172.21.15.63:0/3195569685 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbe80fcbf0 0x7fcbe810f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:20.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.403+0000 7fcbe7fff700 1 -- 172.21.15.63:0/3195569685 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbe80fcbf0 msgr2=0x7fcbe810f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-12T11:54:20.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.403+0000 7fcbe7fff700 1 -- 172.21.15.63:0/3195569685 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbe80fcbf0 msgr2=0x7fcbe810f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-12T11:54:20.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.403+0000 7fcbe7fff700 1 --2- 172.21.15.63:0/3195569685 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbe80fcbf0 0x7fcbe810f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-12T11:54:20.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.403+0000 7fcbe7fff700 1 --2- 172.21.15.63:0/3195569685 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbe80fcbf0 0x7fcbe810f7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T11:54:20.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.403+0000 7fcbe77fe700 1 -- 172.21.15.63:0/3195569685 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbe80fcbf0 msgr2=0x7fcbe810f7d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-12T11:54:20.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.403+0000 7fcbe77fe700 1 --2- 172.21.15.63:0/3195569685 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbe80fcbf0 0x7fcbe810f7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:20.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.403+0000 7fcbe77fe700 1 -- 172.21.15.63:0/3195569685 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc005040 con 0x7fcbe80fde00 2023-12-12T11:54:20.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.403+0000 7fcbe77fe700 1 --2- 172.21.15.63:0/3195569685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbe80fde00 0x7fcbe810fd10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009360 tx=0x7fcbdc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:54:20.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.403+0000 7fcbe4ff9700 1 -- 172.21.15.63:0/3195569685 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbdc00e040 con 0x7fcbe80fde00 2023-12-12T11:54:20.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.404+0000 7fcbe4ff9700 1 -- 172.21.15.63:0/3195569685 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcbdc00bcd0 con 0x7fcbe80fde00 2023-12-12T11:54:20.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.404+0000 7fcbee60d700 1 -- 172.21.15.63:0/3195569685 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe8110de0 con 0x7fcbe80fde00 2023-12-12T11:54:20.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.404+0000 7fcbe4ff9700 1 -- 172.21.15.63:0/3195569685 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbdc01c630 con 0x7fcbe80fde00 2023-12-12T11:54:20.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.404+0000 7fcbee60d700 1 -- 172.21.15.63:0/3195569685 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe8111320 con 0x7fcbe80fde00 2023-12-12T11:54:20.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.405+0000 7fcbee60d700 1 -- 172.21.15.63:0/3195569685 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe8101ea0 con 0x7fcbe80fde00 2023-12-12T11:54:20.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.406+0000 7fcbe4ff9700 1 -- 172.21.15.63:0/3195569685 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 35) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fcbdc013960 con 0x7fcbe80fde00 2023-12-12T11:54:20.409 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.407+0000 7fcbe4ff9700 1 --2- 172.21.15.63:0/3195569685 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fcbd006cf80 0x7fcbd006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:20.410 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.407+0000 7fcbe4ff9700 1 -- 172.21.15.63:0/3195569685 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fcbdc08da80 con 0x7fcbe80fde00 2023-12-12T11:54:20.410 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.408+0000 7fcbe7fff700 1 --2- 172.21.15.63:0/3195569685 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fcbd006cf80 0x7fcbd006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:20.410 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.408+0000 7fcbe7fff700 1 --2- 172.21.15.63:0/3195569685 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fcbd006cf80 0x7fcbd006f430 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8009fd0 tx=0x7fcbd8009f00 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:54:20.415 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.413+0000 7fcbe4ff9700 1 -- 172.21.15.63:0/3195569685 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fcbdc05b1f0 con 0x7fcbe80fde00 2023-12-12T11:54:20.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 bash[171672]: 1ffc49fcd680dd4573d1f012be5ba6bdaa3a601ea5d3157451b52e0bfe1c71ed 2023-12-12T11:54:20.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 systemd[1]: Started Ceph mon.smithi093 for 85e33c70-98e3-11ee-95a3-87774f69a715. 2023-12-12T11:54:20.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: set uid:gid to 167:167 (ceph:ceph) 2023-12-12T11:54:20.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev), process ceph-mon, pid 7 2023-12-12T11:54:20.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: pidfile_write: ignore empty --pid-file 2023-12-12T11:54:20.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: load: jerasure load: lrc 2023-12-12T11:54:20.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: RocksDB version: 7.9.2 2023-12-12T11:54:20.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Git sha 0 2023-12-12T11:54:20.473 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Compile date 2023-12-11 04:34:03 2023-12-12T11:54:20.473 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: DB SUMMARY 2023-12-12T11:54:20.473 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: DB Session ID: FWNUNZA01DD0AZZ3QPU6 2023-12-12T11:54:20.473 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: CURRENT file: CURRENT 2023-12-12T11:54:20.473 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: IDENTITY file: IDENTITY 2023-12-12T11:54:20.473 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1096 Bytes 2023-12-12T11:54:20.473 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi093/store.db dir, Total Num: 1, files: 000027.sst 2023-12-12T11:54:20.473 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi093/store.db: 000025.log size: 2673389 ; 2023-12-12T11:54:20.473 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.error_if_exists: 0 2023-12-12T11:54:20.473 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.create_if_missing: 0 2023-12-12T11:54:20.473 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.paranoid_checks: 1 2023-12-12T11:54:20.473 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-12T11:54:20.474 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-12T11:54:20.474 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-12T11:54:20.474 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.env: 0x55666ae8ea60 2023-12-12T11:54:20.474 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.fs: PosixFileSystem 2023-12-12T11:54:20.474 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.info_log: 0x55666d589640 2023-12-12T11:54:20.474 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.max_file_opening_threads: 16 2023-12-12T11:54:20.474 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.statistics: (nil) 2023-12-12T11:54:20.474 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.use_fsync: 0 2023-12-12T11:54:20.474 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.max_log_file_size: 0 2023-12-12T11:54:20.474 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-12T11:54:20.474 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-12T11:54:20.475 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.keep_log_file_num: 1000 2023-12-12T11:54:20.475 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.recycle_log_file_num: 0 2023-12-12T11:54:20.475 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.allow_fallocate: 1 2023-12-12T11:54:20.475 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.allow_mmap_reads: 0 2023-12-12T11:54:20.475 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.allow_mmap_writes: 0 2023-12-12T11:54:20.475 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.use_direct_reads: 0 2023-12-12T11:54:20.475 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-12T11:54:20.475 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.create_missing_column_families: 0 2023-12-12T11:54:20.475 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.db_log_dir: 2023-12-12T11:54:20.475 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.wal_dir: 2023-12-12T11:54:20.475 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-12T11:54:20.475 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-12T11:54:20.475 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-12T11:54:20.475 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-12T11:54:20.475 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-12T11:54:20.476 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-12T11:54:20.476 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.advise_random_on_open: 1 2023-12-12T11:54:20.476 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.db_write_buffer_size: 0 2023-12-12T11:54:20.476 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.write_buffer_manager: 0x55666d53f360 2023-12-12T11:54:20.476 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-12T11:54:20.476 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-12T11:54:20.476 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-12T11:54:20.476 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.rate_limiter: (nil) 2023-12-12T11:54:20.476 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-12T11:54:20.476 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.wal_recovery_mode: 2 2023-12-12T11:54:20.476 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.enable_thread_tracking: 0 2023-12-12T11:54:20.476 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.enable_pipelined_write: 0 2023-12-12T11:54:20.476 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.unordered_write: 0 2023-12-12T11:54:20.476 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-12T11:54:20.476 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-12T11:54:20.477 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-12T11:54:20.477 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-12T11:54:20.477 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.row_cache: None 2023-12-12T11:54:20.477 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.wal_filter: None 2023-12-12T11:54:20.477 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-12T11:54:20.477 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.allow_ingest_behind: 0 2023-12-12T11:54:20.477 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.two_write_queues: 0 2023-12-12T11:54:20.477 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.manual_wal_flush: 0 2023-12-12T11:54:20.477 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.wal_compression: 0 2023-12-12T11:54:20.477 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.atomic_flush: 0 2023-12-12T11:54:20.477 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-12T11:54:20.477 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-12T11:54:20.477 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-12T11:54:20.477 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.log_readahead_size: 0 2023-12-12T11:54:20.477 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-12T11:54:20.478 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.best_efforts_recovery: 0 2023-12-12T11:54:20.478 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-12T11:54:20.478 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-12T11:54:20.478 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.allow_data_in_errors: 0 2023-12-12T11:54:20.478 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.db_host_id: __hostname__ 2023-12-12T11:54:20.478 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-12T11:54:20.478 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.max_background_jobs: 2 2023-12-12T11:54:20.478 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.max_background_compactions: -1 2023-12-12T11:54:20.478 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.max_subcompactions: 1 2023-12-12T11:54:20.478 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-12T11:54:20.478 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-12T11:54:20.478 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-12T11:54:20.479 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.max_total_wal_size: 0 2023-12-12T11:54:20.479 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-12T11:54:20.479 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-12T11:54:20.479 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-12T11:54:20.479 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-12T11:54:20.479 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.max_open_files: -1 2023-12-12T11:54:20.479 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.bytes_per_sync: 0 2023-12-12T11:54:20.479 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-12T11:54:20.479 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-12T11:54:20.479 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.compaction_readahead_size: 0 2023-12-12T11:54:20.479 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.max_background_flushes: -1 2023-12-12T11:54:20.479 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Compression algorithms supported: 2023-12-12T11:54:20.480 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-12T11:54:20.480 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: kZSTD supported: 0 2023-12-12T11:54:20.480 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: kXpressCompression supported: 0 2023-12-12T11:54:20.480 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: kLZ4HCCompression supported: 1 2023-12-12T11:54:20.480 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: kZlibCompression supported: 1 2023-12-12T11:54:20.480 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: kSnappyCompression supported: 1 2023-12-12T11:54:20.480 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: kLZ4Compression supported: 1 2023-12-12T11:54:20.480 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: kBZip2Compression supported: 0 2023-12-12T11:54:20.480 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-12T11:54:20.480 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-12T11:54:20.480 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi093/store.db/MANIFEST-000009 2023-12-12T11:54:20.480 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-12T11:54:20.480 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-12T11:54:20.480 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.merge_operator: 2023-12-12T11:54:20.481 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.compaction_filter: None 2023-12-12T11:54:20.481 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.compaction_filter_factory: None 2023-12-12T11:54:20.481 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.sst_partitioner_factory: None 2023-12-12T11:54:20.481 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-12T11:54:20.481 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-12T11:54:20.481 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55666d589740) 2023-12-12T11:54:20.481 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: cache_index_and_filter_blocks: 1 2023-12-12T11:54:20.481 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-12T11:54:20.481 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-12T11:54:20.481 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: pin_top_level_index_and_filter: 1 2023-12-12T11:54:20.481 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: index_type: 0 2023-12-12T11:54:20.481 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: data_block_index_type: 0 2023-12-12T11:54:20.481 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: index_shortening: 1 2023-12-12T11:54:20.481 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-12T11:54:20.481 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: checksum: 4 2023-12-12T11:54:20.481 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: no_block_cache: 0 2023-12-12T11:54:20.482 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: block_cache: 0x55666d5df090 2023-12-12T11:54:20.482 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: block_cache_name: BinnedLRUCache 2023-12-12T11:54:20.482 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: block_cache_options: 2023-12-12T11:54:20.482 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: capacity : 536870912 2023-12-12T11:54:20.482 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: num_shard_bits : 4 2023-12-12T11:54:20.482 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: strict_capacity_limit : 0 2023-12-12T11:54:20.482 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: high_pri_pool_ratio: 0.000 2023-12-12T11:54:20.482 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: block_cache_compressed: (nil) 2023-12-12T11:54:20.482 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: persistent_cache: (nil) 2023-12-12T11:54:20.482 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: block_size: 4096 2023-12-12T11:54:20.482 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: block_size_deviation: 10 2023-12-12T11:54:20.483 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: block_restart_interval: 16 2023-12-12T11:54:20.483 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: index_block_restart_interval: 1 2023-12-12T11:54:20.483 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: metadata_block_size: 4096 2023-12-12T11:54:20.483 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: partition_filters: 0 2023-12-12T11:54:20.483 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: use_delta_encoding: 1 2023-12-12T11:54:20.483 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: filter_policy: bloomfilter 2023-12-12T11:54:20.483 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: whole_key_filtering: 1 2023-12-12T11:54:20.483 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: verify_compression: 0 2023-12-12T11:54:20.483 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: read_amp_bytes_per_bit: 0 2023-12-12T11:54:20.483 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: format_version: 5 2023-12-12T11:54:20.483 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: enable_index_compression: 1 2023-12-12T11:54:20.483 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: block_align: 0 2023-12-12T11:54:20.483 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: max_auto_readahead_size: 262144 2023-12-12T11:54:20.484 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: prepopulate_block_cache: 0 2023-12-12T11:54:20.484 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: initial_auto_readahead_size: 8192 2023-12-12T11:54:20.484 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: num_file_reads_for_auto_readahead: 2 2023-12-12T11:54:20.484 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.write_buffer_size: 33554432 2023-12-12T11:54:20.484 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.max_write_buffer_number: 2 2023-12-12T11:54:20.484 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.compression: NoCompression 2023-12-12T11:54:20.484 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.bottommost_compression: Disabled 2023-12-12T11:54:20.484 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.prefix_extractor: nullptr 2023-12-12T11:54:20.484 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-12T11:54:20.484 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.num_levels: 7 2023-12-12T11:54:20.484 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-12T11:54:20.484 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-12T11:54:20.485 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-12T11:54:20.485 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-12T11:54:20.485 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-12T11:54:20.485 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-12T11:54:20.485 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-12T11:54:20.485 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-12T11:54:20.485 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-12T11:54:20.485 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-12T11:54:20.485 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-12T11:54:20.485 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-12T11:54:20.485 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-12T11:54:20.485 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.compression_opts.level: 32767 2023-12-12T11:54:20.485 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.compression_opts.strategy: 0 2023-12-12T11:54:20.485 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-12T11:54:20.486 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-12T11:54:20.486 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-12T11:54:20.486 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-12T11:54:20.486 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.compression_opts.enabled: false 2023-12-12T11:54:20.486 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-12T11:54:20.486 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-12T11:54:20.486 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-12T11:54:20.486 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-12T11:54:20.486 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.target_file_size_base: 67108864 2023-12-12T11:54:20.486 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-12T11:54:20.486 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-12T11:54:20.486 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-12T11:54:20.487 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-12T11:54:20.487 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-12T11:54:20.487 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-12T11:54:20.487 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-12T11:54:20.487 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-12T11:54:20.487 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-12T11:54:20.487 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-12T11:54:20.487 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-12T11:54:20.487 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-12T11:54:20.487 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-12T11:54:20.487 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-12T11:54:20.487 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.arena_block_size: 1048576 2023-12-12T11:54:20.487 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-12T11:54:20.487 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-12T11:54:20.488 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.disable_auto_compactions: 0 2023-12-12T11:54:20.488 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-12T11:54:20.489 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-12T11:54:20.489 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-12T11:54:20.489 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-12T11:54:20.489 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-12T11:54:20.489 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-12T11:54:20.489 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-12T11:54:20.489 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-12T11:54:20.489 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-12T11:54:20.489 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-12T11:54:20.489 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.table_properties_collectors: 2023-12-12T11:54:20.489 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.inplace_update_support: 0 2023-12-12T11:54:20.489 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-12T11:54:20.490 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-12T11:54:20.490 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-12T11:54:20.490 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-12T11:54:20.490 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.bloom_locality: 0 2023-12-12T11:54:20.490 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.max_successive_merges: 0 2023-12-12T11:54:20.490 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-12T11:54:20.490 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.paranoid_file_checks: 0 2023-12-12T11:54:20.490 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.force_consistency_checks: 1 2023-12-12T11:54:20.490 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.report_bg_io_stats: 0 2023-12-12T11:54:20.490 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.ttl: 2592000 2023-12-12T11:54:20.490 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-12T11:54:20.490 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-12T11:54:20.490 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-12T11:54:20.490 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.enable_blob_files: false 2023-12-12T11:54:20.491 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.min_blob_size: 0 2023-12-12T11:54:20.491 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.blob_file_size: 268435456 2023-12-12T11:54:20.491 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-12T11:54:20.491 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-12T11:54:20.491 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-12T11:54:20.491 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-12T11:54:20.491 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-12T11:54:20.491 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.blob_file_starting_level: 0 2023-12-12T11:54:20.491 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-12T11:54:20.491 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2023-12-12T11:54:20.491 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-12T11:54:20.491 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi093/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 12320, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-12T11:54:20.491 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2023-12-12T11:54:20.491 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: da635135-4875-40ac-a671-88ceaf0546de 2023-12-12T11:54:20.491 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702382060068300, "job": 1, "event": "recovery_started", "wal_files": [25]} 2023-12-12T11:54:20.492 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2023-12-12T11:54:20.492 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702382060083339, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 1696086, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12325, "largest_seqno": 12940, "table_properties": {"data_size": 1692703, "index_size": 1665, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 6560, "raw_average_key_size": 24, "raw_value_size": 1686773, "raw_average_value_size": 6224, "num_data_blocks": 75, "num_entries": 271, "num_filter_entries": 271, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1702382060, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "da635135-4875-40ac-a671-88ceaf0546de", "db_session_id": "FWNUNZA01DD0AZZ3QPU6", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2023-12-12T11:54:20.492 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702382060083653, "job": 1, "event": "recovery_finished"} 2023-12-12T11:54:20.492 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2023-12-12T11:54:20.492 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-12T11:54:20.492 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi093/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-12T11:54:20.492 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55666d67a000 2023-12-12T11:54:20.492 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: DB pointer 0x55666d666000 2023-12-12T11:54:20.492 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-12T11:54:20.492 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-12T11:54:20.492 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: ** DB Stats ** 2023-12-12T11:54:20.492 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-12T11:54:20.492 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-12T11:54:20.492 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-12T11:54:20.493 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-12T11:54:20.493 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-12T11:54:20.493 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-12T11:54:20.493 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-12T11:54:20.493 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: 2023-12-12T11:54:20.493 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: ** Compaction Stats [default] ** 2023-12-12T11:54:20.493 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-12T11:54:20.493 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-12T11:54:20.493 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: L0 1/0 1.62 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 381.6 0.00 0.00 1 0.004 0 0 0.0 0.0 2023-12-12T11:54:20.493 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: L6 1/0 5.99 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2023-12-12T11:54:20.494 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Sum 2/0 7.61 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 381.6 0.00 0.00 1 0.004 0 0 0.0 0.0 2023-12-12T11:54:20.494 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 381.6 0.00 0.00 1 0.004 0 0 0.0 0.0 2023-12-12T11:54:20.494 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: 2023-12-12T11:54:20.494 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: ** Compaction Stats [default] ** 2023-12-12T11:54:20.494 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-12T11:54:20.494 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-12T11:54:20.494 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 381.6 0.00 0.00 1 0.004 0 0 0.0 0.0 2023-12-12T11:54:20.494 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: 2023-12-12T11:54:20.494 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-12T11:54:20.494 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: 2023-12-12T11:54:20.494 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-12T11:54:20.494 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Flush(GB): cumulative 0.002, interval 0.002 2023-12-12T11:54:20.494 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-12T11:54:20.494 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-12T11:54:20.495 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-12T11:54:20.495 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-12T11:54:20.495 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Cumulative compaction: 0.00 GB write, 78.19 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-12T11:54:20.495 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Interval compaction: 0.00 GB write, 78.19 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-12T11:54:20.495 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-12T11:54:20.495 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Block cache BinnedLRUCache@0x55666d5df090#7 capacity: 512.00 MB usage: 2.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2023-12-12T11:54:20.495 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.78 KB,0.000149012%) IndexBlock(1,1.83 KB,0.000348687%) Misc(1,0.00 KB,0%) 2023-12-12T11:54:20.495 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: 2023-12-12T11:54:20.495 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-12T11:54:20.495 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: starting mon.smithi093 rank 1 at public addrs [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] at bind addrs [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi093 fsid 85e33c70-98e3-11ee-95a3-87774f69a715 2023-12-12T11:54:20.495 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: mon.smithi093@-1(???) e2 preinit fsid 85e33c70-98e3-11ee-95a3-87774f69a715 2023-12-12T11:54:20.495 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: mon.smithi093@-1(???).mds e13 new map 2023-12-12T11:54:20.495 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: mon.smithi093@-1(???).mds e13 print_map 2023-12-12T11:54:20.495 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: e13 2023-12-12T11:54:20.496 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-12T11:54:20.496 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:54:20.496 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: legacy client fscid: 1 2023-12-12T11:54:20.496 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: 2023-12-12T11:54:20.496 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Filesystem 'cephfs' (1) 2023-12-12T11:54:20.496 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: fs_name cephfs 2023-12-12T11:54:20.496 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: epoch 13 2023-12-12T11:54:20.496 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-12T11:54:20.496 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: created 2023-12-12T11:48:58.523481+0000 2023-12-12T11:54:20.496 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: modified 2023-12-12T11:49:14.113993+0000 2023-12-12T11:54:20.496 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: tableserver 0 2023-12-12T11:54:20.496 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: root 0 2023-12-12T11:54:20.496 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: session_timeout 60 2023-12-12T11:54:20.496 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: session_autoclose 300 2023-12-12T11:54:20.496 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: max_file_size 1099511627776 2023-12-12T11:54:20.497 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: max_xattr_size 65536 2023-12-12T11:54:20.497 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: required_client_features {} 2023-12-12T11:54:20.497 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: last_failure 0 2023-12-12T11:54:20.497 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: last_failure_osd_epoch 46 2023-12-12T11:54:20.497 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:54:20.497 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: max_mds 1 2023-12-12T11:54:20.497 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: in 0 2023-12-12T11:54:20.497 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: up {0=14492} 2023-12-12T11:54:20.497 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: failed 2023-12-12T11:54:20.497 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: damaged 2023-12-12T11:54:20.497 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: stopped 2023-12-12T11:54:20.497 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: data_pools [3] 2023-12-12T11:54:20.497 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: metadata_pool 2 2023-12-12T11:54:20.497 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: inline_data enabled 2023-12-12T11:54:20.497 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: balancer 2023-12-12T11:54:20.498 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: bal_rank_mask -1 2023-12-12T11:54:20.498 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: standby_count_wanted 1 2023-12-12T11:54:20.498 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: [mds.cephfs.smithi063.aevpzg{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.63:6828/3709000039,v1:172.21.15.63:6829/3709000039] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:54:20.498 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: 2023-12-12T11:54:20.498 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: 2023-12-12T11:54:20.498 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: Standby daemons: 2023-12-12T11:54:20.498 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: 2023-12-12T11:54:20.498 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: [mds.cephfs.smithi093.swdqms{-1:14500} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.93:6826/3307558569,v1:172.21.15.93:6827/3307558569] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:54:20.498 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: [mds.cephfs.smithi063.bdqbnp{-1:14508} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/2191270944,v1:172.21.15.63:6827/2191270944] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:54:20.498 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout: [mds.cephfs.smithi093.rhaqsh{-1:24317} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.93:6824/3161864019,v1:172.21.15.93:6825/3161864019] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:54:20.498 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: mon.smithi093@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2023-12-12T11:54:20.498 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: mon.smithi093@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2023-12-12T11:54:20.498 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: mon.smithi093@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2023-12-12T11:54:20.498 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: mon.smithi093@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2023-12-12T11:54:20.499 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:20 smithi093 ceph-mon[171709]: mon.smithi093@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2023-12-12T11:54:20.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.532+0000 7fcbe4ff9700 1 -- 172.21.15.63:0/3195569685 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbdc092020 con 0x7fcbe80fde00 2023-12-12T11:54:20.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.649+0000 7fcbee60d700 1 -- 172.21.15.63:0/3195569685 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbe802b150 con 0x7fcbd006cf80 2023-12-12T11:54:20.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.650+0000 7fcbe4ff9700 1 -- 172.21.15.63:0/3195569685 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fcbe802b150 con 0x7fcbd006cf80 2023-12-12T11:54:20.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.653+0000 7fcbee60d700 1 -- 172.21.15.63:0/3195569685 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fcbd006cf80 msgr2=0x7fcbd006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:20.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.653+0000 7fcbee60d700 1 --2- 172.21.15.63:0/3195569685 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fcbd006cf80 0x7fcbd006f430 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8009fd0 tx=0x7fcbd8009f00 comp rx=0 tx=0).stop 2023-12-12T11:54:20.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.653+0000 7fcbee60d700 1 -- 172.21.15.63:0/3195569685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbe80fde00 msgr2=0x7fcbe810fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:20.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.653+0000 7fcbee60d700 1 --2- 172.21.15.63:0/3195569685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbe80fde00 0x7fcbe810fd10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009360 tx=0x7fcbdc009e30 comp rx=0 tx=0).stop 2023-12-12T11:54:20.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.653+0000 7fcbee60d700 1 -- 172.21.15.63:0/3195569685 shutdown_connections 2023-12-12T11:54:20.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.653+0000 7fcbee60d700 1 --2- 172.21.15.63:0/3195569685 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fcbd006cf80 0x7fcbd006f430 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:20.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.653+0000 7fcbee60d700 1 --2- 172.21.15.63:0/3195569685 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbe80fcbf0 0x7fcbe810f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:20.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.653+0000 7fcbee60d700 1 --2- 172.21.15.63:0/3195569685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbe80fde00 0x7fcbe810fd10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:20.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.653+0000 7fcbee60d700 1 -- 172.21.15.63:0/3195569685 >> 172.21.15.63:0/3195569685 conn(0x7fcbe80f82d0 msgr2=0x7fcbe80ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:54:20.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.653+0000 7fcbee60d700 1 -- 172.21.15.63:0/3195569685 shutdown_connections 2023-12-12T11:54:20.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.653+0000 7fcbee60d700 1 -- 172.21.15.63:0/3195569685 wait complete. 2023-12-12T11:54:20.670 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-12T11:54:20.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.794+0000 7f75402a1700 1 -- 172.21.15.63:0/2562800174 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75380fcbf0 msgr2=0x7f75380fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:20.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.794+0000 7f75402a1700 1 --2- 172.21.15.63:0/2562800174 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75380fcbf0 0x7f75380fd000 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7534004940 tx=0x7f7534009e30 comp rx=0 tx=0).stop 2023-12-12T11:54:20.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.794+0000 7f75402a1700 1 -- 172.21.15.63:0/2562800174 shutdown_connections 2023-12-12T11:54:20.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.794+0000 7f75402a1700 1 --2- 172.21.15.63:0/2562800174 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f75380fde00 0x7f75380fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:20.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.794+0000 7f75402a1700 1 --2- 172.21.15.63:0/2562800174 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75380fcbf0 0x7f75380fd000 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:20.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.794+0000 7f75402a1700 1 -- 172.21.15.63:0/2562800174 >> 172.21.15.63:0/2562800174 conn(0x7f75380f82d0 msgr2=0x7f75380fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:54:20.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.794+0000 7f75402a1700 1 -- 172.21.15.63:0/2562800174 shutdown_connections 2023-12-12T11:54:20.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.794+0000 7f75402a1700 1 -- 172.21.15.63:0/2562800174 wait complete. 2023-12-12T11:54:20.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.795+0000 7f75402a1700 1 Processor -- start 2023-12-12T11:54:20.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.795+0000 7f75402a1700 1 -- start start 2023-12-12T11:54:20.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.795+0000 7f75402a1700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75380fcbf0 0x7f753810d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:20.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.795+0000 7f75402a1700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f75380fde00 0x7f753810daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:20.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.795+0000 7f75402a1700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753810e0a0 con 0x7f75380fcbf0 2023-12-12T11:54:20.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.795+0000 7f75402a1700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753810e940 con 0x7f75380fde00 2023-12-12T11:54:20.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.796+0000 7f753e03d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75380fcbf0 0x7f753810d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:20.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.796+0000 7f753e03d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75380fcbf0 0x7f753810d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48210/0 (socket says 172.21.15.63:48210) 2023-12-12T11:54:20.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.796+0000 7f753d83c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f75380fde00 0x7f753810daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:20.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.796+0000 7f753e03d700 1 -- 172.21.15.63:0/1375901358 learned_addr learned my addr 172.21.15.63:0/1375901358 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:54:20.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.796+0000 7f753d83c700 1 -- 172.21.15.63:0/1375901358 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f75380fde00 msgr2=0x7f753810daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-12-12T11:54:20.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.796+0000 7f753d83c700 1 -- 172.21.15.63:0/1375901358 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f75380fde00 msgr2=0x7f753810daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-12T11:54:20.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.796+0000 7f753d83c700 1 --2- 172.21.15.63:0/1375901358 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f75380fde00 0x7f753810daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-12T11:54:20.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.796+0000 7f753d83c700 1 --2- 172.21.15.63:0/1375901358 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f75380fde00 0x7f753810daa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T11:54:20.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.796+0000 7f753e03d700 1 -- 172.21.15.63:0/1375901358 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f75380fde00 msgr2=0x7f753810daa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-12T11:54:20.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.796+0000 7f753e03d700 1 --2- 172.21.15.63:0/1375901358 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f75380fde00 0x7f753810daa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:20.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.796+0000 7f753e03d700 1 -- 172.21.15.63:0/1375901358 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7534005040 con 0x7f75380fcbf0 2023-12-12T11:54:20.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.797+0000 7f753e03d700 1 --2- 172.21.15.63:0/1375901358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75380fcbf0 0x7f753810d560 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7534009360 tx=0x7f7534009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:54:20.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.797+0000 7f752effd700 1 -- 172.21.15.63:0/1375901358 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f753400e040 con 0x7f75380fcbf0 2023-12-12T11:54:20.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.797+0000 7f752effd700 1 -- 172.21.15.63:0/1375901358 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7534004290 con 0x7f75380fcbf0 2023-12-12T11:54:20.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.797+0000 7f752effd700 1 -- 172.21.15.63:0/1375901358 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f753401c630 con 0x7f75380fcbf0 2023-12-12T11:54:20.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.797+0000 7f75402a1700 1 -- 172.21.15.63:0/1375901358 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f753810ebc0 con 0x7f75380fcbf0 2023-12-12T11:54:20.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.797+0000 7f75402a1700 1 -- 172.21.15.63:0/1375901358 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753810f100 con 0x7f75380fcbf0 2023-12-12T11:54:20.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.798+0000 7f75402a1700 1 -- 172.21.15.63:0/1375901358 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f753804bb80 con 0x7f75380fcbf0 2023-12-12T11:54:20.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.799+0000 7f752effd700 1 -- 172.21.15.63:0/1375901358 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 35) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f7534013960 con 0x7f75380fcbf0 2023-12-12T11:54:20.802 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.800+0000 7f752effd700 1 --2- 172.21.15.63:0/1375901358 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f752406cf80 0x7f752406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:20.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.800+0000 7f752effd700 1 -- 172.21.15.63:0/1375901358 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f753408d980 con 0x7f75380fcbf0 2023-12-12T11:54:20.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.800+0000 7f753d83c700 1 --2- 172.21.15.63:0/1375901358 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f752406cf80 0x7f752406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:20.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.801+0000 7f753d83c700 1 --2- 172.21.15.63:0/1375901358 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f752406cf80 0x7f752406f430 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7528009e50 tx=0x7f7528009f10 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:54:20.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:20.805+0000 7f752effd700 1 -- 172.21.15.63:0/1375901358 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f753405b0d0 con 0x7f75380fcbf0 2023-12-12T11:54:21.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.034+0000 7f75402a1700 1 -- 172.21.15.63:0/1375901358 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7538102750 con 0x7f752406cf80 2023-12-12T11:54:21.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.035+0000 7f752effd700 1 -- 172.21.15.63:0/1375901358 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f7538102750 con 0x7f752406cf80 2023-12-12T11:54:21.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.037+0000 7f75402a1700 1 -- 172.21.15.63:0/1375901358 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f752406cf80 msgr2=0x7f752406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:21.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.037+0000 7f75402a1700 1 --2- 172.21.15.63:0/1375901358 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f752406cf80 0x7f752406f430 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7528009e50 tx=0x7f7528009f10 comp rx=0 tx=0).stop 2023-12-12T11:54:21.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.037+0000 7f75402a1700 1 -- 172.21.15.63:0/1375901358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75380fcbf0 msgr2=0x7f753810d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:21.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.037+0000 7f75402a1700 1 --2- 172.21.15.63:0/1375901358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75380fcbf0 0x7f753810d560 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7534009360 tx=0x7f7534009e30 comp rx=0 tx=0).stop 2023-12-12T11:54:21.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.037+0000 7f75402a1700 1 -- 172.21.15.63:0/1375901358 shutdown_connections 2023-12-12T11:54:21.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.037+0000 7f75402a1700 1 --2- 172.21.15.63:0/1375901358 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f752406cf80 0x7f752406f430 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:21.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.037+0000 7f75402a1700 1 --2- 172.21.15.63:0/1375901358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75380fcbf0 0x7f753810d560 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:21.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.037+0000 7f75402a1700 1 --2- 172.21.15.63:0/1375901358 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f75380fde00 0x7f753810daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:21.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.037+0000 7f75402a1700 1 -- 172.21.15.63:0/1375901358 >> 172.21.15.63:0/1375901358 conn(0x7f75380f82d0 msgr2=0x7f7538101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:54:21.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.038+0000 7f75402a1700 1 -- 172.21.15.63:0/1375901358 shutdown_connections 2023-12-12T11:54:21.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.038+0000 7f75402a1700 1 -- 172.21.15.63:0/1375901358 wait complete. 2023-12-12T11:54:21.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.175+0000 7f230f9a1700 1 -- 172.21.15.63:0/899989815 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23080fcbf0 msgr2=0x7f23080fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:21.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.176+0000 7f230f9a1700 1 --2- 172.21.15.63:0/899989815 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23080fcbf0 0x7f23080fd000 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2304004940 tx=0x7f2304009e30 comp rx=0 tx=0).stop 2023-12-12T11:54:21.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.176+0000 7f230f9a1700 1 -- 172.21.15.63:0/899989815 shutdown_connections 2023-12-12T11:54:21.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.176+0000 7f230f9a1700 1 --2- 172.21.15.63:0/899989815 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f23080fde00 0x7f23080fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:21.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.176+0000 7f230f9a1700 1 --2- 172.21.15.63:0/899989815 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23080fcbf0 0x7f23080fd000 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:21.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.176+0000 7f230f9a1700 1 -- 172.21.15.63:0/899989815 >> 172.21.15.63:0/899989815 conn(0x7f23080f82d0 msgr2=0x7f23080fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:54:21.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.176+0000 7f230f9a1700 1 -- 172.21.15.63:0/899989815 shutdown_connections 2023-12-12T11:54:21.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.176+0000 7f230f9a1700 1 -- 172.21.15.63:0/899989815 wait complete. 2023-12-12T11:54:21.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.177+0000 7f230f9a1700 1 Processor -- start 2023-12-12T11:54:21.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.177+0000 7f230f9a1700 1 -- start start 2023-12-12T11:54:21.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.177+0000 7f230f9a1700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f23080fcbf0 0x7f230810f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:21.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.177+0000 7f230f9a1700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23080fde00 0x7f230810fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:21.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.177+0000 7f230f9a1700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23081102c0 con 0x7f23080fde00 2023-12-12T11:54:21.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.177+0000 7f230f9a1700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2308110b60 con 0x7f23080fcbf0 2023-12-12T11:54:21.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.178+0000 7f230cf3c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23080fde00 0x7f230810fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:21.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.178+0000 7f230d73d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f23080fcbf0 0x7f230810f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:21.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.178+0000 7f230d73d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f23080fcbf0 0x7f230810f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:44258/0 (socket says 172.21.15.63:44258) 2023-12-12T11:54:21.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.178+0000 7f230cf3c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23080fde00 0x7f230810fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48232/0 (socket says 172.21.15.63:48232) 2023-12-12T11:54:21.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.178+0000 7f230d73d700 1 -- 172.21.15.63:0/1340271827 learned_addr learned my addr 172.21.15.63:0/1340271827 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:54:21.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.178+0000 7f230d73d700 1 -- 172.21.15.63:0/1340271827 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f23080fcbf0 msgr2=0x7f230810f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-12T11:54:21.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.178+0000 7f230d73d700 1 -- 172.21.15.63:0/1340271827 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f23080fcbf0 msgr2=0x7f230810f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-12T11:54:21.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.178+0000 7f230d73d700 1 --2- 172.21.15.63:0/1340271827 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f23080fcbf0 0x7f230810f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-12T11:54:21.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.178+0000 7f230d73d700 1 --2- 172.21.15.63:0/1340271827 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f23080fcbf0 0x7f230810f780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T11:54:21.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.178+0000 7f230cf3c700 1 -- 172.21.15.63:0/1340271827 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f23080fcbf0 msgr2=0x7f230810f780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-12T11:54:21.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.178+0000 7f230cf3c700 1 --2- 172.21.15.63:0/1340271827 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f23080fcbf0 0x7f230810f780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:21.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.178+0000 7f230cf3c700 1 -- 172.21.15.63:0/1340271827 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2304005040 con 0x7f23080fde00 2023-12-12T11:54:21.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.178+0000 7f230cf3c700 1 --2- 172.21.15.63:0/1340271827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23080fde00 0x7f230810fcc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f22f8002a50 tx=0x7f22f8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:54:21.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.178+0000 7f22fdffb700 1 -- 172.21.15.63:0/1340271827 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22f8007cc0 con 0x7f23080fde00 2023-12-12T11:54:21.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.179+0000 7f22fdffb700 1 -- 172.21.15.63:0/1340271827 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f22f800f040 con 0x7f23080fde00 2023-12-12T11:54:21.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.179+0000 7f230f9a1700 1 -- 172.21.15.63:0/1340271827 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2308110e40 con 0x7f23080fde00 2023-12-12T11:54:21.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.179+0000 7f22fdffb700 1 -- 172.21.15.63:0/1340271827 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22f800daa0 con 0x7f23080fde00 2023-12-12T11:54:21.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.179+0000 7f230f9a1700 1 -- 172.21.15.63:0/1340271827 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2308111380 con 0x7f23080fde00 2023-12-12T11:54:21.183 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.180+0000 7f230f9a1700 1 -- 172.21.15.63:0/1340271827 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2308101ea0 con 0x7f23080fde00 2023-12-12T11:54:21.183 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.181+0000 7f22fdffb700 1 -- 172.21.15.63:0/1340271827 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 35) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f22f800dc00 con 0x7f23080fde00 2023-12-12T11:54:21.184 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.181+0000 7f22fdffb700 1 --2- 172.21.15.63:0/1340271827 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f22f406cf80 0x7f22f406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:21.184 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.182+0000 7f22fdffb700 1 -- 172.21.15.63:0/1340271827 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f22f808bb90 con 0x7f23080fde00 2023-12-12T11:54:21.184 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.182+0000 7f230d73d700 1 --2- 172.21.15.63:0/1340271827 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f22f406cf80 0x7f22f406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:21.184 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.182+0000 7f230d73d700 1 --2- 172.21.15.63:0/1340271827 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f22f406cf80 0x7f22f406f430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2304004f90 tx=0x7f2304009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:54:21.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.186+0000 7f22fdffb700 1 -- 172.21.15.63:0/1340271827 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f22f8059300 con 0x7f23080fde00 2023-12-12T11:54:21.412 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.409+0000 7f230f9a1700 1 -- 172.21.15.63:0/1340271827 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f23081115f0 con 0x7f22f406cf80 2023-12-12T11:54:21.422 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.420+0000 7f22fdffb700 1 -- 172.21.15.63:0/1340271827 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f23081115f0 con 0x7f22f406cf80 2023-12-12T11:54:21.422 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-12T11:54:21.422 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (2m) 10s ago 9m 15.3M - 0.25.0 c8568f914cd2 f237d9f64783 2023-12-12T11:54:21.423 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (9m) 10s ago 9m 7818k - 17.2.7-123-gbef78a51 ae6196193935 ee4415610fae 2023-12-12T11:54:21.423 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi093 smithi093 running (9m) 12s ago 9m 7810k - 17.2.7-123-gbef78a51 ae6196193935 f64e68742cfe 2023-12-12T11:54:21.423 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (2m) 10s ago 9m 77.3M - 9.4.7 954c08fa6188 51300a1a5b87 2023-12-12T11:54:21.423 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.aevpzg smithi063 running (5m) 10s ago 5m 10.5G - 17.2.7-123-gbef78a51 ae6196193935 df9a6781f836 2023-12-12T11:54:21.423 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.bdqbnp smithi063 running (5m) 10s ago 5m 14.9M - 17.2.7-123-gbef78a51 ae6196193935 0c7e1d21eee9 2023-12-12T11:54:21.423 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.rhaqsh smithi093 running (5m) 12s ago 5m 14.4M - 17.2.7-123-gbef78a51 ae6196193935 257aee771d87 2023-12-12T11:54:21.423 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.swdqms smithi093 running (5m) 12s ago 5m 14.7M - 17.2.7-123-gbef78a51 ae6196193935 f46d7173d3b1 2023-12-12T11:54:21.423 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.zjnfdi smithi063 *:8443,9283,8765 running (109s) 10s ago 11m 489M - 19.0.0-96-gf1fbf3c5 8cf689f388db dab6fa4aaa54 2023-12-12T11:54:21.423 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi093.nbtltu smithi093 *:8443,9283,8765 running (55s) 12s ago 8m 449M - 19.0.0-96-gf1fbf3c5 8cf689f388db 701529e7fa8e 2023-12-12T11:54:21.423 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (27s) 10s ago 11m 32.1M 2048M 19.0.0-96-gf1fbf3c5 8cf689f388db 11f12a2e88e4 2023-12-12T11:54:21.423 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi093 smithi093 starting - - - 2048M 2023-12-12T11:54:21.423 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (2m) 10s ago 9m 8451k - 1.5.0 0da6a335fe13 8eed63374ddf 2023-12-12T11:54:21.423 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi093 smithi093 *:9100 running (114s) 12s ago 8m 8124k - 1.5.0 0da6a335fe13 10e19431c1a2 2023-12-12T11:54:21.423 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (8m) 10s ago 8m 918M 1618M 17.2.7-123-gbef78a51 ae6196193935 636790d2b28c 2023-12-12T11:54:21.423 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (7m) 10s ago 7m 999M 1618M 17.2.7-123-gbef78a51 ae6196193935 5388a4bc6b12 2023-12-12T11:54:21.424 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (7m) 10s ago 7m 811M 1618M 17.2.7-123-gbef78a51 ae6196193935 9eb2483337c8 2023-12-12T11:54:21.424 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi093 running (7m) 12s ago 7m 1121M 2642M 17.2.7-123-gbef78a51 ae6196193935 5b2bb36b5843 2023-12-12T11:54:21.424 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi093 running (6m) 12s ago 6m 813M 2642M 17.2.7-123-gbef78a51 ae6196193935 7dc3f04b04cb 2023-12-12T11:54:21.424 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi093 running (6m) 12s ago 6m 952M 2642M 17.2.7-123-gbef78a51 ae6196193935 16fe8e4668f1 2023-12-12T11:54:21.424 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (62s) 10s ago 9m 43.0M - 2.43.0 a07b618ecd1d 834d9fc4eb61 2023-12-12T11:54:21.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.422+0000 7f230f9a1700 1 -- 172.21.15.63:0/1340271827 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f22f406cf80 msgr2=0x7f22f406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:21.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.422+0000 7f230f9a1700 1 --2- 172.21.15.63:0/1340271827 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f22f406cf80 0x7f22f406f430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2304004f90 tx=0x7f2304009e30 comp rx=0 tx=0).stop 2023-12-12T11:54:21.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.422+0000 7f230f9a1700 1 -- 172.21.15.63:0/1340271827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23080fde00 msgr2=0x7f230810fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:21.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.422+0000 7f230f9a1700 1 --2- 172.21.15.63:0/1340271827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23080fde00 0x7f230810fcc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f22f8002a50 tx=0x7f22f8004600 comp rx=0 tx=0).stop 2023-12-12T11:54:21.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.422+0000 7f230f9a1700 1 -- 172.21.15.63:0/1340271827 shutdown_connections 2023-12-12T11:54:21.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.422+0000 7f230f9a1700 1 --2- 172.21.15.63:0/1340271827 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f22f406cf80 0x7f22f406f430 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:21.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.423+0000 7f230f9a1700 1 --2- 172.21.15.63:0/1340271827 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f23080fcbf0 0x7f230810f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:21.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.423+0000 7f230f9a1700 1 --2- 172.21.15.63:0/1340271827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23080fde00 0x7f230810fcc0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:21.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.423+0000 7f230f9a1700 1 -- 172.21.15.63:0/1340271827 >> 172.21.15.63:0/1340271827 conn(0x7f23080f82d0 msgr2=0x7f23080ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:54:21.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.423+0000 7f230f9a1700 1 -- 172.21.15.63:0/1340271827 shutdown_connections 2023-12-12T11:54:21.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.423+0000 7f230f9a1700 1 -- 172.21.15.63:0/1340271827 wait complete. 2023-12-12T11:54:21.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.563+0000 7f5053c3c700 1 -- 172.21.15.63:0/1749060730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f504c0fcbf0 msgr2=0x7f504c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:21.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.563+0000 7f5053c3c700 1 --2- 172.21.15.63:0/1749060730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f504c0fcbf0 0x7f504c0fd000 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5048004940 tx=0x7f5048009e30 comp rx=0 tx=0).stop 2023-12-12T11:54:21.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.563+0000 7f5053c3c700 1 -- 172.21.15.63:0/1749060730 shutdown_connections 2023-12-12T11:54:21.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.563+0000 7f5053c3c700 1 --2- 172.21.15.63:0/1749060730 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f504c0fde00 0x7f504c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:21.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.563+0000 7f5053c3c700 1 --2- 172.21.15.63:0/1749060730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f504c0fcbf0 0x7f504c0fd000 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:21.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.563+0000 7f5053c3c700 1 -- 172.21.15.63:0/1749060730 >> 172.21.15.63:0/1749060730 conn(0x7f504c0f82d0 msgr2=0x7f504c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:54:21.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.563+0000 7f5053c3c700 1 -- 172.21.15.63:0/1749060730 shutdown_connections 2023-12-12T11:54:21.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.563+0000 7f5053c3c700 1 -- 172.21.15.63:0/1749060730 wait complete. 2023-12-12T11:54:21.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.564+0000 7f5053c3c700 1 Processor -- start 2023-12-12T11:54:21.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.564+0000 7f5053c3c700 1 -- start start 2023-12-12T11:54:21.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.564+0000 7f5053c3c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f504c0fcbf0 0x7f504c10d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:21.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.564+0000 7f5053c3c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f504c0fde00 0x7f504c10daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:21.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.564+0000 7f5053c3c700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504c10e0a0 con 0x7f504c0fde00 2023-12-12T11:54:21.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.564+0000 7f5053c3c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504c10e940 con 0x7f504c0fcbf0 2023-12-12T11:54:21.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.564+0000 7f50511d7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f504c0fde00 0x7f504c10daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:21.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.565+0000 7f50511d7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f504c0fde00 0x7f504c10daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48244/0 (socket says 172.21.15.63:48244) 2023-12-12T11:54:21.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.565+0000 7f50511d7700 1 -- 172.21.15.63:0/3617628864 learned_addr learned my addr 172.21.15.63:0/3617628864 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:54:21.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.565+0000 7f50519d8700 1 --2- 172.21.15.63:0/3617628864 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f504c0fcbf0 0x7f504c10d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:21.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.565+0000 7f50519d8700 1 -- 172.21.15.63:0/3617628864 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f504c0fcbf0 msgr2=0x7f504c10d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-12T11:54:21.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.565+0000 7f50519d8700 1 -- 172.21.15.63:0/3617628864 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f504c0fcbf0 msgr2=0x7f504c10d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-12T11:54:21.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.565+0000 7f50519d8700 1 --2- 172.21.15.63:0/3617628864 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f504c0fcbf0 0x7f504c10d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-12T11:54:21.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.565+0000 7f50511d7700 1 -- 172.21.15.63:0/3617628864 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f504c0fcbf0 msgr2=0x7f504c10d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:21.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.565+0000 7f50519d8700 1 --2- 172.21.15.63:0/3617628864 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f504c0fcbf0 0x7f504c10d560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T11:54:21.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.565+0000 7f50511d7700 1 --2- 172.21.15.63:0/3617628864 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f504c0fcbf0 0x7f504c10d560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:21.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.565+0000 7f50511d7700 1 -- 172.21.15.63:0/3617628864 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5048005040 con 0x7f504c0fde00 2023-12-12T11:54:21.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.565+0000 7f50511d7700 1 --2- 172.21.15.63:0/3617628864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f504c0fde00 0x7f504c10daa0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f503c002a50 tx=0x7f503c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:54:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.565+0000 7f50427fc700 1 -- 172.21.15.63:0/3617628864 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f503c007cc0 con 0x7f504c0fde00 2023-12-12T11:54:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.566+0000 7f5053c3c700 1 -- 172.21.15.63:0/3617628864 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f504c10ec20 con 0x7f504c0fde00 2023-12-12T11:54:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.566+0000 7f50427fc700 1 -- 172.21.15.63:0/3617628864 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f503c00f040 con 0x7f504c0fde00 2023-12-12T11:54:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.566+0000 7f50427fc700 1 -- 172.21.15.63:0/3617628864 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f503c009540 con 0x7f504c0fde00 2023-12-12T11:54:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.566+0000 7f5053c3c700 1 -- 172.21.15.63:0/3617628864 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f504c10f160 con 0x7f504c0fde00 2023-12-12T11:54:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.567+0000 7f5053c3c700 1 -- 172.21.15.63:0/3617628864 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f504c04bb80 con 0x7f504c0fde00 2023-12-12T11:54:21.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.568+0000 7f50427fc700 1 -- 172.21.15.63:0/3617628864 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 35) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f503c0096a0 con 0x7f504c0fde00 2023-12-12T11:54:21.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.569+0000 7f50427fc700 1 --2- 172.21.15.63:0/3617628864 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f503806cf80 0x7f503806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:21.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.569+0000 7f50427fc700 1 -- 172.21.15.63:0/3617628864 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f503c08c470 con 0x7f504c0fde00 2023-12-12T11:54:21.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.569+0000 7f50519d8700 1 --2- 172.21.15.63:0/3617628864 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f503806cf80 0x7f503806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:21.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.570+0000 7f50519d8700 1 --2- 172.21.15.63:0/3617628864 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f503806cf80 0x7f503806f430 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f504800b3b0 tx=0x7f5048009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:54:21.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.574+0000 7f50427fc700 1 -- 172.21.15.63:0/3617628864 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f503c059ac0 con 0x7f504c0fde00 2023-12-12T11:54:21.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:21 smithi063 ceph-mon[187282]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-12T11:54:21.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:21 smithi063 ceph-mon[187282]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-12T11:54:21.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:21 smithi063 ceph-mon[187282]: fs cephfs has deprecated feature inline_data enabled. 2023-12-12T11:54:21.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:21 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-12T11:54:21.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:21 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi093"}]: dispatch 2023-12-12T11:54:21.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:21 smithi063 ceph-mon[187282]: mon.smithi063 calling monitor election 2023-12-12T11:54:21.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:21 smithi063 ceph-mon[187282]: mon.smithi093 calling monitor election 2023-12-12T11:54:21.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:21 smithi063 ceph-mon[187282]: mon.smithi063 is new leader, mons smithi063,smithi093 in quorum (ranks 0,1) 2023-12-12T11:54:21.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:21 smithi063 ceph-mon[187282]: monmap e3: 2 mons at {smithi063=[v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0],smithi093=[v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-12T11:54:21.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:21 smithi063 ceph-mon[187282]: fsmap cephfs:1 {0=cephfs.smithi063.aevpzg=up:active} 3 up:standby 2023-12-12T11:54:21.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:21 smithi063 ceph-mon[187282]: osdmap e49: 6 total, 6 up, 6 in 2023-12-12T11:54:21.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:21 smithi063 ceph-mon[187282]: mgrmap e35: smithi063.zjnfdi(active, since 15s), standbys: smithi093.nbtltu 2023-12-12T11:54:21.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:21 smithi063 ceph-mon[187282]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-12T11:54:21.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:21 smithi063 ceph-mon[187282]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-12T11:54:21.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:21 smithi063 ceph-mon[187282]: fs cephfs has deprecated feature inline_data enabled. 2023-12-12T11:54:21.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:21 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:21.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:21 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:21.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:21 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:54:21.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:21 smithi063 ceph-mon[187282]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:54:21.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:21 smithi063 ceph-mon[187282]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:54:21.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:21 smithi063 ceph-mon[187282]: pgmap v11: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-12T11:54:21.870 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.867+0000 7f5053c3c700 1 -- 172.21.15.63:0/3617628864 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f504c105590 con 0x7f504c0fde00 2023-12-12T11:54:21.870 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.868+0000 7f50427fc700 1 -- 172.21.15.63:0/3617628864 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+727 (secure 0 0 0) 0x7f503c059650 con 0x7f504c0fde00 2023-12-12T11:54:21.870 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:54:21.871 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-12T11:54:21.871 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 2 2023-12-12T11:54:21.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:54:21.871 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-12T11:54:21.871 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 2 2023-12-12T11:54:21.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:54:21.871 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-12T11:54:21.871 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 6 2023-12-12T11:54:21.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:54:21.871 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-12T11:54:21.871 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 4 2023-12-12T11:54:21.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:54:21.871 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-12T11:54:21.871 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 10, 2023-12-12T11:54:21.872 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 4 2023-12-12T11:54:21.872 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-12T11:54:21.872 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:54:21.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.870+0000 7f5053c3c700 1 -- 172.21.15.63:0/3617628864 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f503806cf80 msgr2=0x7f503806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:21.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.870+0000 7f5053c3c700 1 --2- 172.21.15.63:0/3617628864 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f503806cf80 0x7f503806f430 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f504800b3b0 tx=0x7f5048009e30 comp rx=0 tx=0).stop 2023-12-12T11:54:21.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.870+0000 7f5053c3c700 1 -- 172.21.15.63:0/3617628864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f504c0fde00 msgr2=0x7f504c10daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:21.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.870+0000 7f5053c3c700 1 --2- 172.21.15.63:0/3617628864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f504c0fde00 0x7f504c10daa0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f503c002a50 tx=0x7f503c0046b0 comp rx=0 tx=0).stop 2023-12-12T11:54:21.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.870+0000 7f5053c3c700 1 -- 172.21.15.63:0/3617628864 shutdown_connections 2023-12-12T11:54:21.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.870+0000 7f5053c3c700 1 --2- 172.21.15.63:0/3617628864 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f503806cf80 0x7f503806f430 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:21.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.870+0000 7f5053c3c700 1 --2- 172.21.15.63:0/3617628864 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f504c0fcbf0 0x7f504c10d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:21.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.870+0000 7f5053c3c700 1 --2- 172.21.15.63:0/3617628864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f504c0fde00 0x7f504c10daa0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:21.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.870+0000 7f5053c3c700 1 -- 172.21.15.63:0/3617628864 >> 172.21.15.63:0/3617628864 conn(0x7f504c0f82d0 msgr2=0x7f504c101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:54:21.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.870+0000 7f5053c3c700 1 -- 172.21.15.63:0/3617628864 shutdown_connections 2023-12-12T11:54:21.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:21.871+0000 7f5053c3c700 1 -- 172.21.15.63:0/3617628864 wait complete. 2023-12-12T11:54:21.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:21 smithi093 ceph-mon[171709]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-12T11:54:21.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:21 smithi093 ceph-mon[171709]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-12T11:54:21.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:21 smithi093 ceph-mon[171709]: fs cephfs has deprecated feature inline_data enabled. 2023-12-12T11:54:21.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:21 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-12T11:54:21.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:21 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mon metadata", "id": "smithi093"}]: dispatch 2023-12-12T11:54:21.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:21 smithi093 ceph-mon[171709]: mon.smithi063 calling monitor election 2023-12-12T11:54:21.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:21 smithi093 ceph-mon[171709]: mon.smithi093 calling monitor election 2023-12-12T11:54:21.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:21 smithi093 ceph-mon[171709]: mon.smithi063 is new leader, mons smithi063,smithi093 in quorum (ranks 0,1) 2023-12-12T11:54:21.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:21 smithi093 ceph-mon[171709]: monmap e3: 2 mons at {smithi063=[v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0],smithi093=[v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-12T11:54:21.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:21 smithi093 ceph-mon[171709]: fsmap cephfs:1 {0=cephfs.smithi063.aevpzg=up:active} 3 up:standby 2023-12-12T11:54:21.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:21 smithi093 ceph-mon[171709]: osdmap e49: 6 total, 6 up, 6 in 2023-12-12T11:54:21.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:21 smithi093 ceph-mon[171709]: mgrmap e35: smithi063.zjnfdi(active, since 15s), standbys: smithi093.nbtltu 2023-12-12T11:54:21.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:21 smithi093 ceph-mon[171709]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-12T11:54:21.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:21 smithi093 ceph-mon[171709]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-12T11:54:21.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:21 smithi093 ceph-mon[171709]: fs cephfs has deprecated feature inline_data enabled. 2023-12-12T11:54:21.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:21 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:21.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:21 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:21.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:21 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:54:21.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:21 smithi093 ceph-mon[171709]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:54:21.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:21 smithi093 ceph-mon[171709]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:54:21.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:21 smithi093 ceph-mon[171709]: pgmap v11: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-12T11:54:22.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.009+0000 7f443b04d700 1 -- 172.21.15.63:0/1388143399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44340fcbf0 msgr2=0x7f44340fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:22.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.009+0000 7f443b04d700 1 --2- 172.21.15.63:0/1388143399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44340fcbf0 0x7f44340fd000 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4428004940 tx=0x7f4428009e30 comp rx=0 tx=0).stop 2023-12-12T11:54:22.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.009+0000 7f443b04d700 1 -- 172.21.15.63:0/1388143399 shutdown_connections 2023-12-12T11:54:22.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.009+0000 7f443b04d700 1 --2- 172.21.15.63:0/1388143399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44340fde00 0x7f44340fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:22.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.009+0000 7f443b04d700 1 --2- 172.21.15.63:0/1388143399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44340fcbf0 0x7f44340fd000 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:22.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.009+0000 7f443b04d700 1 -- 172.21.15.63:0/1388143399 >> 172.21.15.63:0/1388143399 conn(0x7f44340f82d0 msgr2=0x7f44340fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:54:22.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.009+0000 7f443b04d700 1 -- 172.21.15.63:0/1388143399 shutdown_connections 2023-12-12T11:54:22.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.009+0000 7f443b04d700 1 -- 172.21.15.63:0/1388143399 wait complete. 2023-12-12T11:54:22.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.010+0000 7f443b04d700 1 Processor -- start 2023-12-12T11:54:22.015 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.010+0000 7f443b04d700 1 -- start start 2023-12-12T11:54:22.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.011+0000 7f443b04d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44340fcbf0 0x7f443410d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:22.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.011+0000 7f443b04d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44340fde00 0x7f443410dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:22.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.011+0000 7f443b04d700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443410e0c0 con 0x7f44340fcbf0 2023-12-12T11:54:22.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.011+0000 7f443b04d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443410e960 con 0x7f44340fde00 2023-12-12T11:54:22.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.011+0000 7f4438de9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44340fcbf0 0x7f443410d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:22.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.011+0000 7f4438de9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44340fcbf0 0x7f443410d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48248/0 (socket says 172.21.15.63:48248) 2023-12-12T11:54:22.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.011+0000 7f4438de9700 1 -- 172.21.15.63:0/3695114195 learned_addr learned my addr 172.21.15.63:0/3695114195 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:54:22.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.011+0000 7f4433fff700 1 --2- 172.21.15.63:0/3695114195 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44340fde00 0x7f443410dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:22.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.011+0000 7f4438de9700 1 -- 172.21.15.63:0/3695114195 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44340fde00 msgr2=0x7f443410dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:22.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.011+0000 7f4438de9700 1 --2- 172.21.15.63:0/3695114195 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44340fde00 0x7f443410dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:22.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.011+0000 7f4438de9700 1 -- 172.21.15.63:0/3695114195 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4428005040 con 0x7f44340fcbf0 2023-12-12T11:54:22.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.012+0000 7f4438de9700 1 --2- 172.21.15.63:0/3695114195 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44340fcbf0 0x7f443410d580 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4428009360 tx=0x7f4428009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:54:22.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.012+0000 7f44317fa700 1 -- 172.21.15.63:0/3695114195 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f442800e040 con 0x7f44340fcbf0 2023-12-12T11:54:22.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.012+0000 7f44317fa700 1 -- 172.21.15.63:0/3695114195 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4428004290 con 0x7f44340fcbf0 2023-12-12T11:54:22.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.012+0000 7f443b04d700 1 -- 172.21.15.63:0/3695114195 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f443410ebe0 con 0x7f44340fcbf0 2023-12-12T11:54:22.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.012+0000 7f44317fa700 1 -- 172.21.15.63:0/3695114195 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f442801c630 con 0x7f44340fcbf0 2023-12-12T11:54:22.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.012+0000 7f443b04d700 1 -- 172.21.15.63:0/3695114195 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f443410f120 con 0x7f44340fcbf0 2023-12-12T11:54:22.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.013+0000 7f443b04d700 1 -- 172.21.15.63:0/3695114195 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f443404bb80 con 0x7f44340fcbf0 2023-12-12T11:54:22.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.014+0000 7f44317fa700 1 -- 172.21.15.63:0/3695114195 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 35) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f4428013960 con 0x7f44340fcbf0 2023-12-12T11:54:22.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.015+0000 7f44317fa700 1 --2- 172.21.15.63:0/3695114195 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f442406cf80 0x7f442406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:22.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.015+0000 7f44317fa700 1 -- 172.21.15.63:0/3695114195 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f442808d8a0 con 0x7f44340fcbf0 2023-12-12T11:54:22.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.015+0000 7f4433fff700 1 --2- 172.21.15.63:0/3695114195 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f442406cf80 0x7f442406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:22.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.016+0000 7f4433fff700 1 --2- 172.21.15.63:0/3695114195 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f442406cf80 0x7f442406f430 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4420009fd0 tx=0x7f442000b040 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:54:22.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.019+0000 7f44317fa700 1 -- 172.21.15.63:0/3695114195 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f442805b0b0 con 0x7f44340fcbf0 2023-12-12T11:54:22.284 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.281+0000 7f443b04d700 1 -- 172.21.15.63:0/3695114195 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f443410f520 con 0x7f44340fcbf0 2023-12-12T11:54:22.284 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.281+0000 7f44317fa700 1 -- 172.21.15.63:0/3695114195 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1845 (secure 0 0 0) 0x7f4428061070 con 0x7f44340fcbf0 2023-12-12T11:54:22.284 INFO:teuthology.orchestra.run.smithi063.stdout:e13 2023-12-12T11:54:22.285 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-12T11:54:22.285 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:54:22.285 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-12T11:54:22.285 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:54:22.285 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-12T11:54:22.285 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-12T11:54:22.285 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 13 2023-12-12T11:54:22.286 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-12T11:54:22.286 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-12T11:48:58.523481+0000 2023-12-12T11:54:22.286 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-12T11:49:14.113993+0000 2023-12-12T11:54:22.286 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-12T11:54:22.286 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-12T11:54:22.286 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-12T11:54:22.287 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-12T11:54:22.287 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-12T11:54:22.287 INFO:teuthology.orchestra.run.smithi063.stdout:max_xattr_size 65536 2023-12-12T11:54:22.287 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-12T11:54:22.287 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-12T11:54:22.287 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 46 2023-12-12T11:54:22.287 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:54:22.288 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 1 2023-12-12T11:54:22.288 INFO:teuthology.orchestra.run.smithi063.stdout:in 0 2023-12-12T11:54:22.288 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=14492} 2023-12-12T11:54:22.288 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-12T11:54:22.288 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-12T11:54:22.288 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-12T11:54:22.288 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-12T11:54:22.289 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-12T11:54:22.289 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data enabled 2023-12-12T11:54:22.289 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-12T11:54:22.289 INFO:teuthology.orchestra.run.smithi063.stdout:bal_rank_mask -1 2023-12-12T11:54:22.289 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 1 2023-12-12T11:54:22.289 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.aevpzg{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.63:6828/3709000039,v1:172.21.15.63:6829/3709000039] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:54:22.289 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:54:22.290 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:54:22.290 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2023-12-12T11:54:22.290 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:54:22.290 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.swdqms{-1:14500} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.93:6826/3307558569,v1:172.21.15.93:6827/3307558569] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:54:22.290 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.bdqbnp{-1:14508} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/2191270944,v1:172.21.15.63:6827/2191270944] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:54:22.290 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.rhaqsh{-1:24317} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.93:6824/3161864019,v1:172.21.15.93:6825/3161864019] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:54:22.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.284+0000 7f443b04d700 1 -- 172.21.15.63:0/3695114195 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f442406cf80 msgr2=0x7f442406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:22.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.284+0000 7f443b04d700 1 --2- 172.21.15.63:0/3695114195 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f442406cf80 0x7f442406f430 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4420009fd0 tx=0x7f442000b040 comp rx=0 tx=0).stop 2023-12-12T11:54:22.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.284+0000 7f443b04d700 1 -- 172.21.15.63:0/3695114195 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44340fcbf0 msgr2=0x7f443410d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:22.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.284+0000 7f443b04d700 1 --2- 172.21.15.63:0/3695114195 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44340fcbf0 0x7f443410d580 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4428009360 tx=0x7f4428009e30 comp rx=0 tx=0).stop 2023-12-12T11:54:22.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.284+0000 7f443b04d700 1 -- 172.21.15.63:0/3695114195 shutdown_connections 2023-12-12T11:54:22.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.284+0000 7f443b04d700 1 --2- 172.21.15.63:0/3695114195 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f442406cf80 0x7f442406f430 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:22.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.284+0000 7f443b04d700 1 --2- 172.21.15.63:0/3695114195 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44340fcbf0 0x7f443410d580 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:22.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.284+0000 7f443b04d700 1 --2- 172.21.15.63:0/3695114195 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44340fde00 0x7f443410dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:22.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.284+0000 7f443b04d700 1 -- 172.21.15.63:0/3695114195 >> 172.21.15.63:0/3695114195 conn(0x7f44340f82d0 msgr2=0x7f4434101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:54:22.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.284+0000 7f443b04d700 1 -- 172.21.15.63:0/3695114195 shutdown_connections 2023-12-12T11:54:22.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.284+0000 7f443b04d700 1 -- 172.21.15.63:0/3695114195 wait complete. 2023-12-12T11:54:22.293 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 13 2023-12-12T11:54:22.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.423+0000 7f9753db7700 1 -- 172.21.15.63:0/3598342745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f974c0fcbf0 msgr2=0x7f974c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:22.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.423+0000 7f9753db7700 1 --2- 172.21.15.63:0/3598342745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f974c0fcbf0 0x7f974c0fd000 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9748004940 tx=0x7f9748009e30 comp rx=0 tx=0).stop 2023-12-12T11:54:22.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.423+0000 7f9753db7700 1 -- 172.21.15.63:0/3598342745 shutdown_connections 2023-12-12T11:54:22.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.423+0000 7f9753db7700 1 --2- 172.21.15.63:0/3598342745 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f974c0fde00 0x7f974c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:22.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.423+0000 7f9753db7700 1 --2- 172.21.15.63:0/3598342745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f974c0fcbf0 0x7f974c0fd000 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:22.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.423+0000 7f9753db7700 1 -- 172.21.15.63:0/3598342745 >> 172.21.15.63:0/3598342745 conn(0x7f974c0f82d0 msgr2=0x7f974c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:54:22.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.423+0000 7f9753db7700 1 -- 172.21.15.63:0/3598342745 shutdown_connections 2023-12-12T11:54:22.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.423+0000 7f9753db7700 1 -- 172.21.15.63:0/3598342745 wait complete. 2023-12-12T11:54:22.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.424+0000 7f9753db7700 1 Processor -- start 2023-12-12T11:54:22.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.424+0000 7f9753db7700 1 -- start start 2023-12-12T11:54:22.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.425+0000 7f9753db7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f974c0fcbf0 0x7f974c10f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:22.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.425+0000 7f9753db7700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f974c0fde00 0x7f974c10fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:22.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.425+0000 7f9753db7700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974c1102e0 con 0x7f974c0fcbf0 2023-12-12T11:54:22.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.425+0000 7f9753db7700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974c110b80 con 0x7f974c0fde00 2023-12-12T11:54:22.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.425+0000 7f9751b53700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f974c0fcbf0 0x7f974c10f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:22.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.425+0000 7f9751b53700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f974c0fcbf0 0x7f974c10f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48268/0 (socket says 172.21.15.63:48268) 2023-12-12T11:54:22.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.425+0000 7f9751b53700 1 -- 172.21.15.63:0/2803693815 learned_addr learned my addr 172.21.15.63:0/2803693815 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:54:22.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.425+0000 7f9751352700 1 --2- 172.21.15.63:0/2803693815 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f974c0fde00 0x7f974c10fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:22.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.425+0000 7f9751b53700 1 -- 172.21.15.63:0/2803693815 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f974c0fde00 msgr2=0x7f974c10fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:22.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.425+0000 7f9751b53700 1 --2- 172.21.15.63:0/2803693815 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f974c0fde00 0x7f974c10fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:22.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.425+0000 7f9751b53700 1 -- 172.21.15.63:0/2803693815 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9748005040 con 0x7f974c0fcbf0 2023-12-12T11:54:22.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.426+0000 7f9751b53700 1 --2- 172.21.15.63:0/2803693815 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f974c0fcbf0 0x7f974c10f7a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9748000c00 tx=0x7f9748009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:54:22.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.426+0000 7f97427fc700 1 -- 172.21.15.63:0/2803693815 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f974800e040 con 0x7f974c0fcbf0 2023-12-12T11:54:22.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.426+0000 7f97427fc700 1 -- 172.21.15.63:0/2803693815 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f974800bc50 con 0x7f974c0fcbf0 2023-12-12T11:54:22.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.426+0000 7f97427fc700 1 -- 172.21.15.63:0/2803693815 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f974801c630 con 0x7f974c0fcbf0 2023-12-12T11:54:22.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.426+0000 7f9753db7700 1 -- 172.21.15.63:0/2803693815 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f974c110e00 con 0x7f974c0fcbf0 2023-12-12T11:54:22.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.426+0000 7f9753db7700 1 -- 172.21.15.63:0/2803693815 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f974c1112f0 con 0x7f974c0fcbf0 2023-12-12T11:54:22.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.427+0000 7f9753db7700 1 -- 172.21.15.63:0/2803693815 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f974c101ea0 con 0x7f974c0fcbf0 2023-12-12T11:54:22.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.428+0000 7f97427fc700 1 -- 172.21.15.63:0/2803693815 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 35) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f9748013420 con 0x7f974c0fcbf0 2023-12-12T11:54:22.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.429+0000 7f97427fc700 1 --2- 172.21.15.63:0/2803693815 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f973806cf80 0x7f973806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:22.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.429+0000 7f97427fc700 1 -- 172.21.15.63:0/2803693815 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f974808d9b0 con 0x7f974c0fcbf0 2023-12-12T11:54:22.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.429+0000 7f9751352700 1 --2- 172.21.15.63:0/2803693815 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f973806cf80 0x7f973806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:22.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.430+0000 7f9751352700 1 --2- 172.21.15.63:0/2803693815 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f973806cf80 0x7f973806f430 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f973c009fd0 tx=0x7f973c009f20 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:54:22.436 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.433+0000 7f97427fc700 1 -- 172.21.15.63:0/2803693815 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f974805b000 con 0x7f974c0fcbf0 2023-12-12T11:54:22.666 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.664+0000 7f9753db7700 1 -- 172.21.15.63:0/2803693815 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f974c1116e0 con 0x7f973806cf80 2023-12-12T11:54:22.667 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.665+0000 7f97427fc700 1 -- 172.21.15.63:0/2803693815 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f974c1116e0 con 0x7f973806cf80 2023-12-12T11:54:22.667 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:54:22.667 INFO:teuthology.orchestra.run.smithi063.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dbb46fd2dbbe029cfba763f2b7c769e980f86b63e74be0c72e188909e20b81f3", 2023-12-12T11:54:22.667 INFO:teuthology.orchestra.run.smithi063.stdout: "in_progress": true, 2023-12-12T11:54:22.668 INFO:teuthology.orchestra.run.smithi063.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-12T11:54:22.668 INFO:teuthology.orchestra.run.smithi063.stdout: "services_complete": [ 2023-12-12T11:54:22.668 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr" 2023-12-12T11:54:22.668 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2023-12-12T11:54:22.668 INFO:teuthology.orchestra.run.smithi063.stdout: "progress": "3/21 daemons upgraded", 2023-12-12T11:54:22.668 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "Currently upgrading mon daemons", 2023-12-12T11:54:22.668 INFO:teuthology.orchestra.run.smithi063.stdout: "is_paused": false 2023-12-12T11:54:22.668 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:54:22.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.667+0000 7f9753db7700 1 -- 172.21.15.63:0/2803693815 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f973806cf80 msgr2=0x7f973806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:22.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.667+0000 7f9753db7700 1 --2- 172.21.15.63:0/2803693815 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f973806cf80 0x7f973806f430 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f973c009fd0 tx=0x7f973c009f20 comp rx=0 tx=0).stop 2023-12-12T11:54:22.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.667+0000 7f9753db7700 1 -- 172.21.15.63:0/2803693815 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f974c0fcbf0 msgr2=0x7f974c10f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:22.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.667+0000 7f9753db7700 1 --2- 172.21.15.63:0/2803693815 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f974c0fcbf0 0x7f974c10f7a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9748000c00 tx=0x7f9748009e30 comp rx=0 tx=0).stop 2023-12-12T11:54:22.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.667+0000 7f9753db7700 1 -- 172.21.15.63:0/2803693815 shutdown_connections 2023-12-12T11:54:22.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.667+0000 7f9753db7700 1 --2- 172.21.15.63:0/2803693815 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f973806cf80 0x7f973806f430 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:22.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.667+0000 7f9753db7700 1 --2- 172.21.15.63:0/2803693815 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f974c0fcbf0 0x7f974c10f7a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:22.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.667+0000 7f9753db7700 1 --2- 172.21.15.63:0/2803693815 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f974c0fde00 0x7f974c10fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:22.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.667+0000 7f9753db7700 1 -- 172.21.15.63:0/2803693815 >> 172.21.15.63:0/2803693815 conn(0x7f974c0f82d0 msgr2=0x7f974c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:54:22.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.667+0000 7f9753db7700 1 -- 172.21.15.63:0/2803693815 shutdown_connections 2023-12-12T11:54:22.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.668+0000 7f9753db7700 1 -- 172.21.15.63:0/2803693815 wait complete. 2023-12-12T11:54:22.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.805+0000 7fe9a84f9700 1 -- 172.21.15.63:0/1025446383 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9a00fcbf0 msgr2=0x7fe9a00fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:22.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.805+0000 7fe9a84f9700 1 --2- 172.21.15.63:0/1025446383 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9a00fcbf0 0x7fe9a00fd000 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe99c004940 tx=0x7fe99c009e30 comp rx=0 tx=0).stop 2023-12-12T11:54:22.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.805+0000 7fe9a84f9700 1 -- 172.21.15.63:0/1025446383 shutdown_connections 2023-12-12T11:54:22.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.805+0000 7fe9a84f9700 1 --2- 172.21.15.63:0/1025446383 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe9a00fde00 0x7fe9a00fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:22.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.805+0000 7fe9a84f9700 1 --2- 172.21.15.63:0/1025446383 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9a00fcbf0 0x7fe9a00fd000 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:22.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.806+0000 7fe9a84f9700 1 -- 172.21.15.63:0/1025446383 >> 172.21.15.63:0/1025446383 conn(0x7fe9a00f82d0 msgr2=0x7fe9a00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:54:22.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.806+0000 7fe9a84f9700 1 -- 172.21.15.63:0/1025446383 shutdown_connections 2023-12-12T11:54:22.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.806+0000 7fe9a84f9700 1 -- 172.21.15.63:0/1025446383 wait complete. 2023-12-12T11:54:22.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.806+0000 7fe9a84f9700 1 Processor -- start 2023-12-12T11:54:22.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.807+0000 7fe9a84f9700 1 -- start start 2023-12-12T11:54:22.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.807+0000 7fe9a84f9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9a00fcbf0 0x7fe9a010d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:22.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.807+0000 7fe9a84f9700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe9a00fde00 0x7fe9a010daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:22.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.807+0000 7fe9a84f9700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a010e0a0 con 0x7fe9a00fcbf0 2023-12-12T11:54:22.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.807+0000 7fe9a84f9700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a010e940 con 0x7fe9a00fde00 2023-12-12T11:54:22.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.807+0000 7fe9a6295700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9a00fcbf0 0x7fe9a010d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:22.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.807+0000 7fe9a6295700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9a00fcbf0 0x7fe9a010d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48274/0 (socket says 172.21.15.63:48274) 2023-12-12T11:54:22.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.807+0000 7fe9a6295700 1 -- 172.21.15.63:0/759415668 learned_addr learned my addr 172.21.15.63:0/759415668 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:54:22.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.807+0000 7fe9a5a94700 1 --2- 172.21.15.63:0/759415668 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe9a00fde00 0x7fe9a010daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:22.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.808+0000 7fe9a5a94700 1 -- 172.21.15.63:0/759415668 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe9a00fde00 msgr2=0x7fe9a010daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-12-12T11:54:22.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.808+0000 7fe9a5a94700 1 -- 172.21.15.63:0/759415668 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe9a00fde00 msgr2=0x7fe9a010daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-12T11:54:22.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.808+0000 7fe9a5a94700 1 --2- 172.21.15.63:0/759415668 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe9a00fde00 0x7fe9a010daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-12T11:54:22.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.808+0000 7fe9a5a94700 1 --2- 172.21.15.63:0/759415668 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe9a00fde00 0x7fe9a010daa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T11:54:22.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.808+0000 7fe9a6295700 1 -- 172.21.15.63:0/759415668 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe9a00fde00 msgr2=0x7fe9a010daa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-12T11:54:22.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.808+0000 7fe9a6295700 1 --2- 172.21.15.63:0/759415668 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe9a00fde00 0x7fe9a010daa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:22.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.808+0000 7fe9a6295700 1 -- 172.21.15.63:0/759415668 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99c005040 con 0x7fe9a00fcbf0 2023-12-12T11:54:22.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.808+0000 7fe9a6295700 1 --2- 172.21.15.63:0/759415668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9a00fcbf0 0x7fe9a010d560 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe99c000c00 tx=0x7fe99c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:54:22.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.808+0000 7fe996ffd700 1 -- 172.21.15.63:0/759415668 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe99c00e040 con 0x7fe9a00fcbf0 2023-12-12T11:54:22.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.808+0000 7fe996ffd700 1 -- 172.21.15.63:0/759415668 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe99c00bc50 con 0x7fe9a00fcbf0 2023-12-12T11:54:22.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.808+0000 7fe9a84f9700 1 -- 172.21.15.63:0/759415668 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a010ebc0 con 0x7fe9a00fcbf0 2023-12-12T11:54:22.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.808+0000 7fe996ffd700 1 -- 172.21.15.63:0/759415668 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe99c01c630 con 0x7fe9a00fcbf0 2023-12-12T11:54:22.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.808+0000 7fe9a84f9700 1 -- 172.21.15.63:0/759415668 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a010f100 con 0x7fe9a00fcbf0 2023-12-12T11:54:22.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.809+0000 7fe9a84f9700 1 -- 172.21.15.63:0/759415668 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a004bb80 con 0x7fe9a00fcbf0 2023-12-12T11:54:22.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.810+0000 7fe996ffd700 1 -- 172.21.15.63:0/759415668 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 35) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fe99c013420 con 0x7fe9a00fcbf0 2023-12-12T11:54:22.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.812+0000 7fe996ffd700 1 --2- 172.21.15.63:0/759415668 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe98c06cf80 0x7fe98c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:22.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.812+0000 7fe996ffd700 1 -- 172.21.15.63:0/759415668 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fe99c08d8f0 con 0x7fe9a00fcbf0 2023-12-12T11:54:22.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.812+0000 7fe9a5a94700 1 --2- 172.21.15.63:0/759415668 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe98c06cf80 0x7fe98c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:22.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.813+0000 7fe9a5a94700 1 --2- 172.21.15.63:0/759415668 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe98c06cf80 0x7fe98c06f430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe990009e50 tx=0x7fe990009f10 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:54:22.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:22.817+0000 7fe996ffd700 1 -- 172.21.15.63:0/759415668 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe99c05afc0 con 0x7fe9a00fcbf0 2023-12-12T11:54:22.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:22 smithi093 ceph-mon[171709]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:54:22.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:22 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/3617628864' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:54:22.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:22 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/3695114195' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:54:23.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:22 smithi063 ceph-mon[187282]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:54:23.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:22 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/3617628864' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:54:23.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:22 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/3695114195' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:54:23.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:23.113+0000 7fe9a84f9700 1 -- 172.21.15.63:0/759415668 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe9a010f490 con 0x7fe9a00fcbf0 2023-12-12T11:54:23.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:23.114+0000 7fe996ffd700 1 -- 172.21.15.63:0/759415668 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fe99c05ab50 con 0x7fe9a00fcbf0 2023-12-12T11:54:23.116 INFO:teuthology.orchestra.run.smithi063.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-12T11:54:23.117 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-12T11:54:23.117 INFO:teuthology.orchestra.run.smithi063.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-12T11:54:23.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:23.116+0000 7fe9a84f9700 1 -- 172.21.15.63:0/759415668 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe98c06cf80 msgr2=0x7fe98c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:23.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:23.116+0000 7fe9a84f9700 1 --2- 172.21.15.63:0/759415668 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe98c06cf80 0x7fe98c06f430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe990009e50 tx=0x7fe990009f10 comp rx=0 tx=0).stop 2023-12-12T11:54:23.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:23.116+0000 7fe9a84f9700 1 -- 172.21.15.63:0/759415668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9a00fcbf0 msgr2=0x7fe9a010d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:23.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:23.116+0000 7fe9a84f9700 1 --2- 172.21.15.63:0/759415668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9a00fcbf0 0x7fe9a010d560 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe99c000c00 tx=0x7fe99c009e30 comp rx=0 tx=0).stop 2023-12-12T11:54:23.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:23.116+0000 7fe9a84f9700 1 -- 172.21.15.63:0/759415668 shutdown_connections 2023-12-12T11:54:23.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:23.116+0000 7fe9a84f9700 1 --2- 172.21.15.63:0/759415668 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe98c06cf80 0x7fe98c06f430 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:23.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:23.116+0000 7fe9a84f9700 1 --2- 172.21.15.63:0/759415668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9a00fcbf0 0x7fe9a010d560 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:23.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:23.116+0000 7fe9a84f9700 1 --2- 172.21.15.63:0/759415668 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe9a00fde00 0x7fe9a010daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:23.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:23.116+0000 7fe9a84f9700 1 -- 172.21.15.63:0/759415668 >> 172.21.15.63:0/759415668 conn(0x7fe9a00f82d0 msgr2=0x7fe9a0101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:54:23.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:23.116+0000 7fe9a84f9700 1 -- 172.21.15.63:0/759415668 shutdown_connections 2023-12-12T11:54:23.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:23.117+0000 7fe9a84f9700 1 -- 172.21.15.63:0/759415668 wait complete. 2023-12-12T11:54:23.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:23 smithi093 ceph-mon[171709]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:54:23.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:23 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/759415668' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:54:23.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:23 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:23.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:23 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:23.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:23 smithi093 ceph-mon[171709]: pgmap v12: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:24.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:23 smithi063 ceph-mon[187282]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:54:24.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:23 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/759415668' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:54:24.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:23 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:24.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:23 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:24.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:23 smithi063 ceph-mon[187282]: pgmap v12: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:25.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:25 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:25.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:25 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:25.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:25 smithi093 ceph-mon[171709]: pgmap v13: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:26.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:25 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:26.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:25 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:26.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:25 smithi063 ceph-mon[187282]: pgmap v13: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:27.660 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:27 smithi093 ceph-mon[171709]: pgmap v14: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:27.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:27 smithi063 ceph-mon[187282]: pgmap v14: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:28.909 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:28 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:28.909 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:28 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:28.909 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:28 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:28.910 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:28 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:54:28.910 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:28 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:28.910 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:28 smithi063 ceph-mon[187282]: Reconfiguring mon.smithi063 (monmap changed)... 2023-12-12T11:54:28.910 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:28 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-12T11:54:28.910 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:28 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-12T11:54:28.910 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:28 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:28.910 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:28 smithi063 ceph-mon[187282]: Reconfiguring daemon mon.smithi063 on smithi063 2023-12-12T11:54:29.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:28 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:29.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:28 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:29.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:28 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:29.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:28 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:54:29.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:28 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:29.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:28 smithi093 ceph-mon[171709]: Reconfiguring mon.smithi063 (monmap changed)... 2023-12-12T11:54:29.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:28 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-12T11:54:29.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:28 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-12T11:54:29.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:28 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:29.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:28 smithi093 ceph-mon[171709]: Reconfiguring daemon mon.smithi063 on smithi063 2023-12-12T11:54:30.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:30 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:30.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:30 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:30.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:30 smithi093 ceph-mon[171709]: Reconfiguring mgr.smithi063.zjnfdi (monmap changed)... 2023-12-12T11:54:30.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:30 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi063.zjnfdi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-12T11:54:30.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:30 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-12T11:54:30.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:30 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:30.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:30 smithi093 ceph-mon[171709]: Reconfiguring daemon mgr.smithi063.zjnfdi on smithi063 2023-12-12T11:54:30.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:30 smithi093 ceph-mon[171709]: pgmap v15: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:30.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:30 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:30.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:30 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:30.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:30 smithi063 ceph-mon[187282]: Reconfiguring mgr.smithi063.zjnfdi (monmap changed)... 2023-12-12T11:54:30.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:30 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi063.zjnfdi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-12T11:54:30.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:30 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-12T11:54:30.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:30 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:30.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:30 smithi063 ceph-mon[187282]: Reconfiguring daemon mgr.smithi063.zjnfdi on smithi063 2023-12-12T11:54:30.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:30 smithi063 ceph-mon[187282]: pgmap v15: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:31.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:31 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:31.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:31 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:31.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:31 smithi093 ceph-mon[171709]: Reconfiguring crash.smithi063 (monmap changed)... 2023-12-12T11:54:31.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:31 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi063", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-12T11:54:31.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:31 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:31.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:31 smithi093 ceph-mon[171709]: Reconfiguring daemon crash.smithi063 on smithi063 2023-12-12T11:54:31.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:31 smithi093 ceph-mon[171709]: pgmap v16: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:31.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:31 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:31.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:31 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:31.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:31 smithi063 ceph-mon[187282]: Reconfiguring crash.smithi063 (monmap changed)... 2023-12-12T11:54:31.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:31 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi063", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-12T11:54:31.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:31 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:31.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:31 smithi063 ceph-mon[187282]: Reconfiguring daemon crash.smithi063 on smithi063 2023-12-12T11:54:31.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:31 smithi063 ceph-mon[187282]: pgmap v16: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:32.777 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:32 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:32.777 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:32 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:32.777 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:32 smithi063 ceph-mon[187282]: Reconfiguring osd.0 (monmap changed)... 2023-12-12T11:54:32.777 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:32 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-12T11:54:32.777 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:32 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:32.777 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:32 smithi063 ceph-mon[187282]: Reconfiguring daemon osd.0 on smithi063 2023-12-12T11:54:32.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:32 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:32.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:32 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:32.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:32 smithi093 ceph-mon[171709]: Reconfiguring osd.0 (monmap changed)... 2023-12-12T11:54:32.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:32 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-12T11:54:32.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:32 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:32.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:32 smithi093 ceph-mon[171709]: Reconfiguring daemon osd.0 on smithi063 2023-12-12T11:54:34.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:33 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:34.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:33 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:34.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:33 smithi063 ceph-mon[187282]: Reconfiguring osd.1 (monmap changed)... 2023-12-12T11:54:34.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:33 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-12T11:54:34.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:33 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:34.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:33 smithi063 ceph-mon[187282]: Reconfiguring daemon osd.1 on smithi063 2023-12-12T11:54:34.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:33 smithi063 ceph-mon[187282]: pgmap v17: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:34.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:33 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:34.274 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:33 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:34.275 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:33 smithi093 ceph-mon[171709]: Reconfiguring osd.1 (monmap changed)... 2023-12-12T11:54:34.275 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:33 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-12T11:54:34.275 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:33 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:34.275 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:33 smithi093 ceph-mon[171709]: Reconfiguring daemon osd.1 on smithi063 2023-12-12T11:54:34.275 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:33 smithi093 ceph-mon[171709]: pgmap v17: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:35.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:35 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:35.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:35 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:35.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:35 smithi063 ceph-mon[187282]: Reconfiguring osd.2 (monmap changed)... 2023-12-12T11:54:35.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:35 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-12T11:54:35.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:35 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:35.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:35 smithi063 ceph-mon[187282]: Reconfiguring daemon osd.2 on smithi063 2023-12-12T11:54:35.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:35 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:35.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:35 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:35.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:35 smithi093 ceph-mon[171709]: Reconfiguring osd.2 (monmap changed)... 2023-12-12T11:54:35.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:35 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-12T11:54:35.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:35 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:35.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:35 smithi093 ceph-mon[171709]: Reconfiguring daemon osd.2 on smithi063 2023-12-12T11:54:36.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:36 smithi063 ceph-mon[187282]: pgmap v18: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:36.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:36 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:36.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:36 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:36.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:36 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi063.bdqbnp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-12T11:54:36.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:36 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:36.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:36 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:54:36.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:36 smithi093 ceph-mon[171709]: pgmap v18: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:36.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:36 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:36.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:36 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:36.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:36 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi063.bdqbnp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-12T11:54:36.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:36 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:36.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:36 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:54:37.451 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:37 smithi063 ceph-mon[187282]: Reconfiguring mds.cephfs.smithi063.bdqbnp (monmap changed)... 2023-12-12T11:54:37.451 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:37 smithi063 ceph-mon[187282]: Reconfiguring daemon mds.cephfs.smithi063.bdqbnp on smithi063 2023-12-12T11:54:37.451 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:37 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:37.451 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:37 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:37.451 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:37 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi063.aevpzg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-12T11:54:37.451 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:37 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:37.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:37 smithi093 ceph-mon[171709]: Reconfiguring mds.cephfs.smithi063.bdqbnp (monmap changed)... 2023-12-12T11:54:37.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:37 smithi093 ceph-mon[171709]: Reconfiguring daemon mds.cephfs.smithi063.bdqbnp on smithi063 2023-12-12T11:54:37.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:37 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:37.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:37 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:37.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:37 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi063.aevpzg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-12T11:54:37.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:37 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:38.642 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:38 smithi093 ceph-mon[171709]: Reconfiguring mds.cephfs.smithi063.aevpzg (monmap changed)... 2023-12-12T11:54:38.642 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:38 smithi093 ceph-mon[171709]: Reconfiguring daemon mds.cephfs.smithi063.aevpzg on smithi063 2023-12-12T11:54:38.642 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:38 smithi093 ceph-mon[171709]: pgmap v19: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:38.642 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:38 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:38.643 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:38 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:38.643 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:38 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi093", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-12T11:54:38.643 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:38 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:38.662 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:38 smithi063 ceph-mon[187282]: Reconfiguring mds.cephfs.smithi063.aevpzg (monmap changed)... 2023-12-12T11:54:38.663 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:38 smithi063 ceph-mon[187282]: Reconfiguring daemon mds.cephfs.smithi063.aevpzg on smithi063 2023-12-12T11:54:38.663 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:38 smithi063 ceph-mon[187282]: pgmap v19: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:38.663 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:38 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:38.663 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:38 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:38.663 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:38 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi093", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-12T11:54:38.663 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:38 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:39.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:39 smithi093 ceph-mon[171709]: Reconfiguring crash.smithi093 (monmap changed)... 2023-12-12T11:54:39.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:39 smithi093 ceph-mon[171709]: Reconfiguring daemon crash.smithi093 on smithi093 2023-12-12T11:54:39.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:39 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:39.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:39 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:39.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:39 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi093.nbtltu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-12T11:54:39.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:39 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-12T11:54:39.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:39 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:39.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:39 smithi063 ceph-mon[187282]: Reconfiguring crash.smithi093 (monmap changed)... 2023-12-12T11:54:39.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:39 smithi063 ceph-mon[187282]: Reconfiguring daemon crash.smithi093 on smithi093 2023-12-12T11:54:39.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:39 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:39.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:39 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:39.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:39 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi093.nbtltu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-12T11:54:39.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:39 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-12T11:54:39.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:39 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:40.643 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:40 smithi093 ceph-mon[171709]: Reconfiguring mgr.smithi093.nbtltu (monmap changed)... 2023-12-12T11:54:40.643 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:40 smithi093 ceph-mon[171709]: Reconfiguring daemon mgr.smithi093.nbtltu on smithi093 2023-12-12T11:54:40.643 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:40 smithi093 ceph-mon[171709]: pgmap v20: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:40.643 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:40 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:40.643 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:40 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:40.643 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:40 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-12T11:54:40.643 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:40 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-12T11:54:40.643 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:40 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:40.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:40 smithi063 ceph-mon[187282]: Reconfiguring mgr.smithi093.nbtltu (monmap changed)... 2023-12-12T11:54:40.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:40 smithi063 ceph-mon[187282]: Reconfiguring daemon mgr.smithi093.nbtltu on smithi093 2023-12-12T11:54:40.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:40 smithi063 ceph-mon[187282]: pgmap v20: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:40.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:40 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:40.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:40 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:40.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:40 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-12T11:54:40.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:40 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-12T11:54:40.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:40 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:41.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:41 smithi093 ceph-mon[171709]: Reconfiguring mon.smithi093 (monmap changed)... 2023-12-12T11:54:41.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:41 smithi093 ceph-mon[171709]: Reconfiguring daemon mon.smithi093 on smithi093 2023-12-12T11:54:41.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:41 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:41.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:41 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:41.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:41 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-12T11:54:41.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:41 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:41.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:41 smithi063 ceph-mon[187282]: Reconfiguring mon.smithi093 (monmap changed)... 2023-12-12T11:54:41.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:41 smithi063 ceph-mon[187282]: Reconfiguring daemon mon.smithi093 on smithi093 2023-12-12T11:54:41.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:41 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:41.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:41 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:41.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:41 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-12T11:54:41.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:41 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:42.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:42 smithi093 ceph-mon[171709]: Reconfiguring osd.3 (monmap changed)... 2023-12-12T11:54:42.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:42 smithi093 ceph-mon[171709]: Reconfiguring daemon osd.3 on smithi093 2023-12-12T11:54:42.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:42 smithi093 ceph-mon[171709]: pgmap v21: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:42.776 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:42 smithi063 ceph-mon[187282]: Reconfiguring osd.3 (monmap changed)... 2023-12-12T11:54:42.776 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:42 smithi063 ceph-mon[187282]: Reconfiguring daemon osd.3 on smithi093 2023-12-12T11:54:42.776 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:42 smithi063 ceph-mon[187282]: pgmap v21: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:43.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:43 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:43.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:43 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:43.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:43 smithi093 ceph-mon[171709]: Reconfiguring osd.4 (monmap changed)... 2023-12-12T11:54:43.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:43 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-12T11:54:43.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:43 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:43.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:43 smithi093 ceph-mon[171709]: Reconfiguring daemon osd.4 on smithi093 2023-12-12T11:54:43.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:43 smithi093 ceph-mon[171709]: pgmap v22: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:44.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:43 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:44.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:43 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:44.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:43 smithi063 ceph-mon[187282]: Reconfiguring osd.4 (monmap changed)... 2023-12-12T11:54:44.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:43 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-12T11:54:44.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:43 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:44.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:43 smithi063 ceph-mon[187282]: Reconfiguring daemon osd.4 on smithi093 2023-12-12T11:54:44.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:43 smithi063 ceph-mon[187282]: pgmap v22: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:45.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:44 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:45.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:44 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:45.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:44 smithi093 ceph-mon[171709]: Reconfiguring osd.5 (monmap changed)... 2023-12-12T11:54:45.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:44 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-12T11:54:45.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:44 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:45.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:44 smithi093 ceph-mon[171709]: Reconfiguring daemon osd.5 on smithi093 2023-12-12T11:54:45.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:44 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:45.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:44 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:45.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:44 smithi063 ceph-mon[187282]: Reconfiguring osd.5 (monmap changed)... 2023-12-12T11:54:45.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:44 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-12T11:54:45.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:44 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:45.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:44 smithi063 ceph-mon[187282]: Reconfiguring daemon osd.5 on smithi093 2023-12-12T11:54:46.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:46 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:46.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:46 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:46.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:46 smithi063 ceph-mon[187282]: Reconfiguring mds.cephfs.smithi093.rhaqsh (monmap changed)... 2023-12-12T11:54:46.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:46 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi093.rhaqsh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-12T11:54:46.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:46 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:46.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:46 smithi063 ceph-mon[187282]: Reconfiguring daemon mds.cephfs.smithi093.rhaqsh on smithi093 2023-12-12T11:54:46.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:46 smithi063 ceph-mon[187282]: pgmap v23: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:46.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:46 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:46.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:46 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:46.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:46 smithi093 ceph-mon[171709]: Reconfiguring mds.cephfs.smithi093.rhaqsh (monmap changed)... 2023-12-12T11:54:46.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:46 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi093.rhaqsh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-12T11:54:46.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:46 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:46.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:46 smithi093 ceph-mon[171709]: Reconfiguring daemon mds.cephfs.smithi093.rhaqsh on smithi093 2023-12-12T11:54:46.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:46 smithi093 ceph-mon[171709]: pgmap v23: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:47.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:47 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:47.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:47 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:47.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:47 smithi063 ceph-mon[187282]: Reconfiguring mds.cephfs.smithi093.swdqms (monmap changed)... 2023-12-12T11:54:47.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:47 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi093.swdqms", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-12T11:54:47.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:47 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:47.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:47 smithi063 ceph-mon[187282]: Reconfiguring daemon mds.cephfs.smithi093.swdqms on smithi093 2023-12-12T11:54:47.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:47 smithi063 ceph-mon[187282]: pgmap v24: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:47.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:47 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:47.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:47 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:47.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:47 smithi093 ceph-mon[171709]: Reconfiguring mds.cephfs.smithi093.swdqms (monmap changed)... 2023-12-12T11:54:47.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:47 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi093.swdqms", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-12T11:54:47.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:47 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:47.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:47 smithi093 ceph-mon[171709]: Reconfiguring daemon mds.cephfs.smithi093.swdqms on smithi093 2023-12-12T11:54:47.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:47 smithi093 ceph-mon[171709]: pgmap v24: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:49.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:48 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:49.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:48 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:49.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:48 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:54:49.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:48 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:54:49.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:48 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:54:49.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:48 smithi063 ceph-mon[187282]: Upgrade: Setting container_image for all mon 2023-12-12T11:54:49.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:48 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:49.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:48 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi063"}]: dispatch 2023-12-12T11:54:49.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:48 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi063"}]': finished 2023-12-12T11:54:49.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:48 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi093"}]: dispatch 2023-12-12T11:54:49.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:48 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi093"}]': finished 2023-12-12T11:54:49.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:48 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:49.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:48 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:49.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:48 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:54:49.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:48 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:54:49.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:48 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:54:49.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:48 smithi093 ceph-mon[171709]: Upgrade: Setting container_image for all mon 2023-12-12T11:54:49.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:48 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:49.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:48 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi063"}]: dispatch 2023-12-12T11:54:49.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:48 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi063"}]': finished 2023-12-12T11:54:49.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:48 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi093"}]: dispatch 2023-12-12T11:54:49.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:48 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi093"}]': finished 2023-12-12T11:54:50.265 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:50 smithi063 ceph-mon[187282]: Upgrade: Updating crash.smithi063 (1/2) 2023-12-12T11:54:50.265 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:50 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:50.265 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:50 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi063", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-12T11:54:50.265 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:50 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:50.265 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:50 smithi063 ceph-mon[187282]: Deploying daemon crash.smithi063 on smithi063 2023-12-12T11:54:50.265 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:50 smithi063 ceph-mon[187282]: pgmap v25: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:50.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:50 smithi093 ceph-mon[171709]: Upgrade: Updating crash.smithi063 (1/2) 2023-12-12T11:54:50.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:50 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:50.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:50 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi063", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-12T11:54:50.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:50 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:50.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:50 smithi093 ceph-mon[171709]: Deploying daemon crash.smithi063 on smithi063 2023-12-12T11:54:50.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:50 smithi093 ceph-mon[171709]: pgmap v25: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:51.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:51 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:54:51.540 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:51 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:54:52.470 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:52 smithi093 ceph-mon[171709]: pgmap v26: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:52.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:52 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:52.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:52 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:52.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:52 smithi063 ceph-mon[187282]: pgmap v26: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:52.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:52 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:52.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:52 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:53.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.270+0000 7f6f26892700 1 -- 172.21.15.63:0/3322152183 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f200fde00 msgr2=0x7f6f200fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:53.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.270+0000 7f6f26892700 1 --2- 172.21.15.63:0/3322152183 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f200fde00 0x7f6f200fe250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6f14004940 tx=0x7f6f14009e30 comp rx=0 tx=0).stop 2023-12-12T11:54:53.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.270+0000 7f6f26892700 1 -- 172.21.15.63:0/3322152183 shutdown_connections 2023-12-12T11:54:53.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.270+0000 7f6f26892700 1 --2- 172.21.15.63:0/3322152183 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f200fde00 0x7f6f200fe250 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:53.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.270+0000 7f6f26892700 1 --2- 172.21.15.63:0/3322152183 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f200fcbf0 0x7f6f200fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:53.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.270+0000 7f6f26892700 1 -- 172.21.15.63:0/3322152183 >> 172.21.15.63:0/3322152183 conn(0x7f6f200f82d0 msgr2=0x7f6f200fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:54:53.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.270+0000 7f6f26892700 1 -- 172.21.15.63:0/3322152183 shutdown_connections 2023-12-12T11:54:53.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.270+0000 7f6f26892700 1 -- 172.21.15.63:0/3322152183 wait complete. 2023-12-12T11:54:53.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.271+0000 7f6f26892700 1 Processor -- start 2023-12-12T11:54:53.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.271+0000 7f6f26892700 1 -- start start 2023-12-12T11:54:53.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.271+0000 7f6f26892700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f200fcbf0 0x7f6f2010f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:53.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.271+0000 7f6f26892700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f200fde00 0x7f6f2010fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:53.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.271+0000 7f6f26892700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f20110310 con 0x7f6f200fde00 2023-12-12T11:54:53.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.271+0000 7f6f26892700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f20110b60 con 0x7f6f200fcbf0 2023-12-12T11:54:53.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.272+0000 7f6f1f7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f200fde00 0x7f6f2010fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:53.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.272+0000 7f6f1f7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f200fde00 0x7f6f2010fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51434/0 (socket says 172.21.15.63:51434) 2023-12-12T11:54:53.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.272+0000 7f6f1f7fe700 1 -- 172.21.15.63:0/3724129152 learned_addr learned my addr 172.21.15.63:0/3724129152 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:54:53.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.272+0000 7f6f1ffff700 1 --2- 172.21.15.63:0/3724129152 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f200fcbf0 0x7f6f2010f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:53.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.272+0000 7f6f1f7fe700 1 -- 172.21.15.63:0/3724129152 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f200fcbf0 msgr2=0x7f6f2010f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:53.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.272+0000 7f6f1f7fe700 1 --2- 172.21.15.63:0/3724129152 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f200fcbf0 0x7f6f2010f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:53.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.272+0000 7f6f1f7fe700 1 -- 172.21.15.63:0/3724129152 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f14005040 con 0x7f6f200fde00 2023-12-12T11:54:53.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.272+0000 7f6f1ffff700 1 --2- 172.21.15.63:0/3724129152 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f200fcbf0 0x7f6f2010f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T11:54:53.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.272+0000 7f6f1f7fe700 1 --2- 172.21.15.63:0/3724129152 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f200fde00 0x7f6f2010fd10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6f1400b3b0 tx=0x7f6f14009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:54:53.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.273+0000 7f6f1cff9700 1 -- 172.21.15.63:0/3724129152 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f1400e040 con 0x7f6f200fde00 2023-12-12T11:54:53.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.273+0000 7f6f26892700 1 -- 172.21.15.63:0/3724129152 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f20110de0 con 0x7f6f200fde00 2023-12-12T11:54:53.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.273+0000 7f6f1cff9700 1 -- 172.21.15.63:0/3724129152 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6f1400bcd0 con 0x7f6f200fde00 2023-12-12T11:54:53.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.273+0000 7f6f1cff9700 1 -- 172.21.15.63:0/3724129152 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f1401c630 con 0x7f6f200fde00 2023-12-12T11:54:53.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.273+0000 7f6f26892700 1 -- 172.21.15.63:0/3724129152 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f20111320 con 0x7f6f200fde00 2023-12-12T11:54:53.278 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.274+0000 7f6f26892700 1 -- 172.21.15.63:0/3724129152 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f20101ea0 con 0x7f6f200fde00 2023-12-12T11:54:53.278 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.275+0000 7f6f1cff9700 1 -- 172.21.15.63:0/3724129152 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 35) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f6f14013420 con 0x7f6f200fde00 2023-12-12T11:54:53.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.276+0000 7f6f1cff9700 1 --2- 172.21.15.63:0/3724129152 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f6f0806cf80 0x7f6f0806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:53.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.276+0000 7f6f1cff9700 1 -- 172.21.15.63:0/3724129152 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f6f1408db10 con 0x7f6f200fde00 2023-12-12T11:54:53.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.276+0000 7f6f1ffff700 1 --2- 172.21.15.63:0/3724129152 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f6f0806cf80 0x7f6f0806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:53.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.277+0000 7f6f1ffff700 1 --2- 172.21.15.63:0/3724129152 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f6f0806cf80 0x7f6f0806f430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6f10009fd0 tx=0x7f6f10009f00 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:54:53.284 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.281+0000 7f6f1cff9700 1 -- 172.21.15.63:0/3724129152 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6f1405b160 con 0x7f6f200fde00 2023-12-12T11:54:53.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.517+0000 7f6f26892700 1 -- 172.21.15.63:0/3724129152 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f2002b150 con 0x7f6f0806cf80 2023-12-12T11:54:53.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.519+0000 7f6f1cff9700 1 -- 172.21.15.63:0/3724129152 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f6f2002b150 con 0x7f6f0806cf80 2023-12-12T11:54:53.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.521+0000 7f6f26892700 1 -- 172.21.15.63:0/3724129152 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f6f0806cf80 msgr2=0x7f6f0806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:53.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.521+0000 7f6f26892700 1 --2- 172.21.15.63:0/3724129152 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f6f0806cf80 0x7f6f0806f430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6f10009fd0 tx=0x7f6f10009f00 comp rx=0 tx=0).stop 2023-12-12T11:54:53.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.521+0000 7f6f26892700 1 -- 172.21.15.63:0/3724129152 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f200fde00 msgr2=0x7f6f2010fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:53.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.521+0000 7f6f26892700 1 --2- 172.21.15.63:0/3724129152 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f200fde00 0x7f6f2010fd10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6f1400b3b0 tx=0x7f6f14009e30 comp rx=0 tx=0).stop 2023-12-12T11:54:53.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.521+0000 7f6f26892700 1 -- 172.21.15.63:0/3724129152 shutdown_connections 2023-12-12T11:54:53.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.521+0000 7f6f26892700 1 --2- 172.21.15.63:0/3724129152 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f6f0806cf80 0x7f6f0806f430 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:53.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.521+0000 7f6f26892700 1 --2- 172.21.15.63:0/3724129152 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f200fcbf0 0x7f6f2010f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:53.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.521+0000 7f6f26892700 1 --2- 172.21.15.63:0/3724129152 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f200fde00 0x7f6f2010fd10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:53.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.521+0000 7f6f26892700 1 -- 172.21.15.63:0/3724129152 >> 172.21.15.63:0/3724129152 conn(0x7f6f200f82d0 msgr2=0x7f6f200ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:54:53.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.522+0000 7f6f26892700 1 -- 172.21.15.63:0/3724129152 shutdown_connections 2023-12-12T11:54:53.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.522+0000 7f6f26892700 1 -- 172.21.15.63:0/3724129152 wait complete. 2023-12-12T11:54:53.538 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-12T11:54:53.664 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.661+0000 7fa714d58700 1 -- 172.21.15.63:0/2671036296 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7100fde00 msgr2=0x7fa7100fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:53.665 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.661+0000 7fa714d58700 1 --2- 172.21.15.63:0/2671036296 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7100fde00 0x7fa7100fe250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa704004940 tx=0x7fa704009e30 comp rx=0 tx=0).stop 2023-12-12T11:54:53.665 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.661+0000 7fa714d58700 1 -- 172.21.15.63:0/2671036296 shutdown_connections 2023-12-12T11:54:53.665 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.661+0000 7fa714d58700 1 --2- 172.21.15.63:0/2671036296 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7100fde00 0x7fa7100fe250 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:53.665 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.661+0000 7fa714d58700 1 --2- 172.21.15.63:0/2671036296 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7100fcbf0 0x7fa7100fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:53.665 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.661+0000 7fa714d58700 1 -- 172.21.15.63:0/2671036296 >> 172.21.15.63:0/2671036296 conn(0x7fa7100f82d0 msgr2=0x7fa7100fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:54:53.666 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.661+0000 7fa714d58700 1 -- 172.21.15.63:0/2671036296 shutdown_connections 2023-12-12T11:54:53.666 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.661+0000 7fa714d58700 1 -- 172.21.15.63:0/2671036296 wait complete. 2023-12-12T11:54:53.666 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.662+0000 7fa714d58700 1 Processor -- start 2023-12-12T11:54:53.666 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.662+0000 7fa714d58700 1 -- start start 2023-12-12T11:54:53.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.663+0000 7fa714d58700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7100fcbf0 0x7fa710071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:53.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.663+0000 7fa714d58700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7100fde00 0x7fa71006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:53.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.663+0000 7fa714d58700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa710070590 con 0x7fa7100fcbf0 2023-12-12T11:54:53.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.663+0000 7fa714d58700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa710070700 con 0x7fa7100fde00 2023-12-12T11:54:53.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.663+0000 7fa70e59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7100fcbf0 0x7fa710071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:53.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.663+0000 7fa70e59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7100fcbf0 0x7fa710071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51454/0 (socket says 172.21.15.63:51454) 2023-12-12T11:54:53.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.663+0000 7fa70e59c700 1 -- 172.21.15.63:0/1598739063 learned_addr learned my addr 172.21.15.63:0/1598739063 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:54:53.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.663+0000 7fa70dd9b700 1 --2- 172.21.15.63:0/1598739063 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7100fde00 0x7fa71006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:53.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.663+0000 7fa70e59c700 1 -- 172.21.15.63:0/1598739063 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7100fde00 msgr2=0x7fa71006ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:53.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.663+0000 7fa70e59c700 1 --2- 172.21.15.63:0/1598739063 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7100fde00 0x7fa71006ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:53.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.663+0000 7fa70e59c700 1 -- 172.21.15.63:0/1598739063 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa704005040 con 0x7fa7100fcbf0 2023-12-12T11:54:53.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.664+0000 7fa70e59c700 1 --2- 172.21.15.63:0/1598739063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7100fcbf0 0x7fa710071b10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa70000eb40 tx=0x7fa70000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:54:53.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.664+0000 7fa6feffd700 1 -- 172.21.15.63:0/1598739063 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa700007cc0 con 0x7fa7100fcbf0 2023-12-12T11:54:53.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.664+0000 7fa714d58700 1 -- 172.21.15.63:0/1598739063 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa710070980 con 0x7fa7100fcbf0 2023-12-12T11:54:53.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.664+0000 7fa714d58700 1 -- 172.21.15.63:0/1598739063 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa710115510 con 0x7fa7100fcbf0 2023-12-12T11:54:53.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.664+0000 7fa6feffd700 1 -- 172.21.15.63:0/1598739063 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa70000f040 con 0x7fa7100fcbf0 2023-12-12T11:54:53.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.664+0000 7fa6feffd700 1 -- 172.21.15.63:0/1598739063 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa70000c930 con 0x7fa7100fcbf0 2023-12-12T11:54:53.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.665+0000 7fa714d58700 1 -- 172.21.15.63:0/1598739063 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f00052e0 con 0x7fa7100fcbf0 2023-12-12T11:54:53.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.666+0000 7fa6feffd700 1 -- 172.21.15.63:0/1598739063 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 35) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fa70000ca90 con 0x7fa7100fcbf0 2023-12-12T11:54:53.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.667+0000 7fa6feffd700 1 --2- 172.21.15.63:0/1598739063 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fa6f806cf80 0x7fa6f806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:53.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.667+0000 7fa6feffd700 1 -- 172.21.15.63:0/1598739063 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fa70008c0c0 con 0x7fa7100fcbf0 2023-12-12T11:54:53.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.667+0000 7fa70dd9b700 1 --2- 172.21.15.63:0/1598739063 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fa6f806cf80 0x7fa6f806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:53.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.668+0000 7fa70dd9b700 1 --2- 172.21.15.63:0/1598739063 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fa6f806cf80 0x7fa6f806f430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa704013680 tx=0x7fa704009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:54:53.674 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.672+0000 7fa6feffd700 1 -- 172.21.15.63:0/1598739063 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa7000597c0 con 0x7fa7100fcbf0 2023-12-12T11:54:53.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:53 smithi093 ceph-mon[171709]: pgmap v27: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:53.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:53 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:53.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:53 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi093", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-12T11:54:53.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:53 smithi063 ceph-mon[187282]: pgmap v27: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:53.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:53 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:53.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:53 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi093", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-12T11:54:53.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.905+0000 7fa714d58700 1 -- 172.21.15.63:0/1598739063 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6f0000bf0 con 0x7fa6f806cf80 2023-12-12T11:54:53.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.906+0000 7fa6feffd700 1 -- 172.21.15.63:0/1598739063 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fa6f0000bf0 con 0x7fa6f806cf80 2023-12-12T11:54:53.911 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.908+0000 7fa714d58700 1 -- 172.21.15.63:0/1598739063 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fa6f806cf80 msgr2=0x7fa6f806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:53.911 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.908+0000 7fa714d58700 1 --2- 172.21.15.63:0/1598739063 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fa6f806cf80 0x7fa6f806f430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa704013680 tx=0x7fa704009e30 comp rx=0 tx=0).stop 2023-12-12T11:54:53.911 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.908+0000 7fa714d58700 1 -- 172.21.15.63:0/1598739063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7100fcbf0 msgr2=0x7fa710071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:53.911 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.908+0000 7fa714d58700 1 --2- 172.21.15.63:0/1598739063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7100fcbf0 0x7fa710071b10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa70000eb40 tx=0x7fa70000b040 comp rx=0 tx=0).stop 2023-12-12T11:54:53.911 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.908+0000 7fa714d58700 1 -- 172.21.15.63:0/1598739063 shutdown_connections 2023-12-12T11:54:53.911 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.908+0000 7fa714d58700 1 --2- 172.21.15.63:0/1598739063 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fa6f806cf80 0x7fa6f806f430 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:53.911 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.908+0000 7fa714d58700 1 --2- 172.21.15.63:0/1598739063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7100fcbf0 0x7fa710071b10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:53.911 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.908+0000 7fa714d58700 1 --2- 172.21.15.63:0/1598739063 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7100fde00 0x7fa71006ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:53.911 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.909+0000 7fa714d58700 1 -- 172.21.15.63:0/1598739063 >> 172.21.15.63:0/1598739063 conn(0x7fa7100f82d0 msgr2=0x7fa710101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:54:53.912 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.909+0000 7fa714d58700 1 -- 172.21.15.63:0/1598739063 shutdown_connections 2023-12-12T11:54:53.912 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:53.909+0000 7fa714d58700 1 -- 172.21.15.63:0/1598739063 wait complete. 2023-12-12T11:54:54.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.047+0000 7fbb1a435700 1 -- 172.21.15.63:0/4252403967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb140fcbf0 msgr2=0x7fbb140fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:54.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.047+0000 7fbb1a435700 1 --2- 172.21.15.63:0/4252403967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb140fcbf0 0x7fbb140fd000 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbb04004940 tx=0x7fbb04009e30 comp rx=0 tx=0).stop 2023-12-12T11:54:54.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.047+0000 7fbb1a435700 1 -- 172.21.15.63:0/4252403967 shutdown_connections 2023-12-12T11:54:54.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.047+0000 7fbb1a435700 1 --2- 172.21.15.63:0/4252403967 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb140fde00 0x7fbb140fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:54.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.047+0000 7fbb1a435700 1 --2- 172.21.15.63:0/4252403967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb140fcbf0 0x7fbb140fd000 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:54.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.047+0000 7fbb1a435700 1 -- 172.21.15.63:0/4252403967 >> 172.21.15.63:0/4252403967 conn(0x7fbb140f82d0 msgr2=0x7fbb140fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:54:54.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.047+0000 7fbb1a435700 1 -- 172.21.15.63:0/4252403967 shutdown_connections 2023-12-12T11:54:54.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.047+0000 7fbb1a435700 1 -- 172.21.15.63:0/4252403967 wait complete. 2023-12-12T11:54:54.051 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.048+0000 7fbb1a435700 1 Processor -- start 2023-12-12T11:54:54.051 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.048+0000 7fbb1a435700 1 -- start start 2023-12-12T11:54:54.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.049+0000 7fbb1a435700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb140fcbf0 0x7fbb14071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:54.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.049+0000 7fbb1a435700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb140fde00 0x7fbb1406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:54.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.049+0000 7fbb1a435700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb14070590 con 0x7fbb140fde00 2023-12-12T11:54:54.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.049+0000 7fbb1a435700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb14070700 con 0x7fbb140fcbf0 2023-12-12T11:54:54.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.049+0000 7fbb137fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb140fde00 0x7fbb1406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:54.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.049+0000 7fbb13fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb140fcbf0 0x7fbb14071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:54.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.049+0000 7fbb13fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb140fcbf0 0x7fbb14071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:46862/0 (socket says 172.21.15.63:46862) 2023-12-12T11:54:54.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.049+0000 7fbb13fff700 1 -- 172.21.15.63:0/2693787632 learned_addr learned my addr 172.21.15.63:0/2693787632 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:54:54.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.050+0000 7fbb137fe700 1 -- 172.21.15.63:0/2693787632 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb140fcbf0 msgr2=0x7fbb14071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:54.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.050+0000 7fbb137fe700 1 --2- 172.21.15.63:0/2693787632 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb140fcbf0 0x7fbb14071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:54.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.050+0000 7fbb137fe700 1 -- 172.21.15.63:0/2693787632 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb04005040 con 0x7fbb140fde00 2023-12-12T11:54:54.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.050+0000 7fbb13fff700 1 --2- 172.21.15.63:0/2693787632 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb140fcbf0 0x7fbb14071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T11:54:54.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.050+0000 7fbb137fe700 1 --2- 172.21.15.63:0/2693787632 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb140fde00 0x7fbb1406ff90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbb08002820 tx=0x7fbb08004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:54:54.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.050+0000 7fbb10ff9700 1 -- 172.21.15.63:0/2693787632 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb08007cc0 con 0x7fbb140fde00 2023-12-12T11:54:54.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.050+0000 7fbb10ff9700 1 -- 172.21.15.63:0/2693787632 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbb0800f040 con 0x7fbb140fde00 2023-12-12T11:54:54.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.050+0000 7fbb10ff9700 1 -- 172.21.15.63:0/2693787632 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb080137d0 con 0x7fbb140fde00 2023-12-12T11:54:54.054 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.050+0000 7fbb1a435700 1 -- 172.21.15.63:0/2693787632 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb140709e0 con 0x7fbb140fde00 2023-12-12T11:54:54.054 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.050+0000 7fbb1a435700 1 -- 172.21.15.63:0/2693787632 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb14115590 con 0x7fbb140fde00 2023-12-12T11:54:54.054 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.051+0000 7fbb1a435700 1 -- 172.21.15.63:0/2693787632 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb1404bb80 con 0x7fbb140fde00 2023-12-12T11:54:54.055 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.052+0000 7fbb10ff9700 1 -- 172.21.15.63:0/2693787632 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 35) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fbb0801c400 con 0x7fbb140fde00 2023-12-12T11:54:54.056 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.054+0000 7fbb10ff9700 1 --2- 172.21.15.63:0/2693787632 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fbafc06cf80 0x7fbafc06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:54.056 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.054+0000 7fbb10ff9700 1 -- 172.21.15.63:0/2693787632 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fbb0808c1d0 con 0x7fbb140fde00 2023-12-12T11:54:54.056 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.054+0000 7fbb13fff700 1 --2- 172.21.15.63:0/2693787632 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fbafc06cf80 0x7fbafc06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:54.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.054+0000 7fbb13fff700 1 --2- 172.21.15.63:0/2693787632 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fbafc06cf80 0x7fbafc06f430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbb04004f90 tx=0x7fbb04009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:54:54.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.058+0000 7fbb10ff9700 1 -- 172.21.15.63:0/2693787632 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fbb08059940 con 0x7fbb140fde00 2023-12-12T11:54:54.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.276+0000 7fbb1a435700 1 -- 172.21.15.63:0/2693787632 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb14102750 con 0x7fbafc06cf80 2023-12-12T11:54:54.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.287+0000 7fbb10ff9700 1 -- 172.21.15.63:0/2693787632 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fbb14102750 con 0x7fbafc06cf80 2023-12-12T11:54:54.289 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-12T11:54:54.289 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (2m) 43s ago 10m 15.3M - 0.25.0 c8568f914cd2 f237d9f64783 2023-12-12T11:54:54.289 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 starting - - - - 2023-12-12T11:54:54.289 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi093 smithi093 running (9m) 30s ago 9m 7810k - 17.2.7-123-gbef78a51 ae6196193935 f64e68742cfe 2023-12-12T11:54:54.289 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (2m) 43s ago 10m 77.3M - 9.4.7 954c08fa6188 51300a1a5b87 2023-12-12T11:54:54.289 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.aevpzg smithi063 running (5m) 43s ago 5m 10.5G - 17.2.7-123-gbef78a51 ae6196193935 df9a6781f836 2023-12-12T11:54:54.290 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.bdqbnp smithi063 running (5m) 43s ago 5m 14.9M - 17.2.7-123-gbef78a51 ae6196193935 0c7e1d21eee9 2023-12-12T11:54:54.290 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.rhaqsh smithi093 running (5m) 30s ago 5m 14.9M - 17.2.7-123-gbef78a51 ae6196193935 257aee771d87 2023-12-12T11:54:54.290 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.swdqms smithi093 running (5m) 30s ago 5m 14.9M - 17.2.7-123-gbef78a51 ae6196193935 f46d7173d3b1 2023-12-12T11:54:54.290 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.zjnfdi smithi063 *:8443,9283,8765 running (2m) 43s ago 11m 489M - 19.0.0-96-gf1fbf3c5 8cf689f388db dab6fa4aaa54 2023-12-12T11:54:54.290 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi093.nbtltu smithi093 *:8443,9283,8765 running (88s) 30s ago 9m 450M - 19.0.0-96-gf1fbf3c5 8cf689f388db 701529e7fa8e 2023-12-12T11:54:54.290 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (59s) 43s ago 11m 32.1M 2048M 19.0.0-96-gf1fbf3c5 8cf689f388db 11f12a2e88e4 2023-12-12T11:54:54.290 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi093 smithi093 running (34s) 30s ago 9m 22.3M 2048M 19.0.0-96-gf1fbf3c5 8cf689f388db 1ffc49fcd680 2023-12-12T11:54:54.290 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (2m) 43s ago 10m 8451k - 1.5.0 0da6a335fe13 8eed63374ddf 2023-12-12T11:54:54.290 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi093 smithi093 *:9100 running (2m) 30s ago 9m 7972k - 1.5.0 0da6a335fe13 10e19431c1a2 2023-12-12T11:54:54.290 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (8m) 43s ago 8m 918M 1618M 17.2.7-123-gbef78a51 ae6196193935 636790d2b28c 2023-12-12T11:54:54.290 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (8m) 43s ago 8m 999M 1618M 17.2.7-123-gbef78a51 ae6196193935 5388a4bc6b12 2023-12-12T11:54:54.290 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (8m) 43s ago 8m 811M 1618M 17.2.7-123-gbef78a51 ae6196193935 9eb2483337c8 2023-12-12T11:54:54.290 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi093 running (7m) 30s ago 7m 1123M 2642M 17.2.7-123-gbef78a51 ae6196193935 5b2bb36b5843 2023-12-12T11:54:54.290 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi093 running (7m) 30s ago 7m 814M 2642M 17.2.7-123-gbef78a51 ae6196193935 7dc3f04b04cb 2023-12-12T11:54:54.290 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi093 running (6m) 30s ago 6m 952M 2642M 17.2.7-123-gbef78a51 ae6196193935 16fe8e4668f1 2023-12-12T11:54:54.291 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (95s) 43s ago 9m 43.0M - 2.43.0 a07b618ecd1d 834d9fc4eb61 2023-12-12T11:54:54.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.289+0000 7fbb1a435700 1 -- 172.21.15.63:0/2693787632 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fbafc06cf80 msgr2=0x7fbafc06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:54.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.289+0000 7fbb1a435700 1 --2- 172.21.15.63:0/2693787632 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fbafc06cf80 0x7fbafc06f430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbb04004f90 tx=0x7fbb04009e30 comp rx=0 tx=0).stop 2023-12-12T11:54:54.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.289+0000 7fbb1a435700 1 -- 172.21.15.63:0/2693787632 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb140fde00 msgr2=0x7fbb1406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:54.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.289+0000 7fbb1a435700 1 --2- 172.21.15.63:0/2693787632 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb140fde00 0x7fbb1406ff90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbb08002820 tx=0x7fbb08004570 comp rx=0 tx=0).stop 2023-12-12T11:54:54.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.289+0000 7fbb1a435700 1 -- 172.21.15.63:0/2693787632 shutdown_connections 2023-12-12T11:54:54.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.289+0000 7fbb1a435700 1 --2- 172.21.15.63:0/2693787632 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fbafc06cf80 0x7fbafc06f430 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:54.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.289+0000 7fbb1a435700 1 --2- 172.21.15.63:0/2693787632 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb140fcbf0 0x7fbb14071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:54.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.289+0000 7fbb1a435700 1 --2- 172.21.15.63:0/2693787632 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb140fde00 0x7fbb1406ff90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:54.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.289+0000 7fbb1a435700 1 -- 172.21.15.63:0/2693787632 >> 172.21.15.63:0/2693787632 conn(0x7fbb140f82d0 msgr2=0x7fbb14101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:54:54.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.289+0000 7fbb1a435700 1 -- 172.21.15.63:0/2693787632 shutdown_connections 2023-12-12T11:54:54.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.289+0000 7fbb1a435700 1 -- 172.21.15.63:0/2693787632 wait complete. 2023-12-12T11:54:54.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.425+0000 7f2be1e15700 1 -- 172.21.15.63:0/1857190329 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bdc0fde00 msgr2=0x7f2bdc0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:54.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.425+0000 7f2be1e15700 1 --2- 172.21.15.63:0/1857190329 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bdc0fde00 0x7f2bdc0fe250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0004940 tx=0x7f2bd0009e30 comp rx=0 tx=0).stop 2023-12-12T11:54:54.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.425+0000 7f2be1e15700 1 -- 172.21.15.63:0/1857190329 shutdown_connections 2023-12-12T11:54:54.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.425+0000 7f2be1e15700 1 --2- 172.21.15.63:0/1857190329 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bdc0fde00 0x7f2bdc0fe250 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:54.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.425+0000 7f2be1e15700 1 --2- 172.21.15.63:0/1857190329 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2bdc0fcbf0 0x7f2bdc0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:54.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.425+0000 7f2be1e15700 1 -- 172.21.15.63:0/1857190329 >> 172.21.15.63:0/1857190329 conn(0x7f2bdc0f82d0 msgr2=0x7f2bdc0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:54:54.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.426+0000 7f2be1e15700 1 -- 172.21.15.63:0/1857190329 shutdown_connections 2023-12-12T11:54:54.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.426+0000 7f2be1e15700 1 -- 172.21.15.63:0/1857190329 wait complete. 2023-12-12T11:54:54.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.426+0000 7f2be1e15700 1 Processor -- start 2023-12-12T11:54:54.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.427+0000 7f2be1e15700 1 -- start start 2023-12-12T11:54:54.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.427+0000 7f2be1e15700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2bdc0fcbf0 0x7f2bdc10f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:54.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.427+0000 7f2be1e15700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bdc0fde00 0x7f2bdc10fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:54.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.427+0000 7f2be1e15700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc110310 con 0x7f2bdc0fde00 2023-12-12T11:54:54.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.427+0000 7f2be1e15700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc110b60 con 0x7f2bdc0fcbf0 2023-12-12T11:54:54.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.427+0000 7f2bdaffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bdc0fde00 0x7f2bdc10fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:54.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.427+0000 7f2bdaffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bdc0fde00 0x7f2bdc10fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51490/0 (socket says 172.21.15.63:51490) 2023-12-12T11:54:54.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.427+0000 7f2bdb7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2bdc0fcbf0 0x7f2bdc10f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:54.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.427+0000 7f2bdaffd700 1 -- 172.21.15.63:0/3028669460 learned_addr learned my addr 172.21.15.63:0/3028669460 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:54:54.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.428+0000 7f2bdaffd700 1 -- 172.21.15.63:0/3028669460 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2bdc0fcbf0 msgr2=0x7f2bdc10f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:54.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.428+0000 7f2bdaffd700 1 --2- 172.21.15.63:0/3028669460 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2bdc0fcbf0 0x7f2bdc10f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:54.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.428+0000 7f2bdaffd700 1 -- 172.21.15.63:0/3028669460 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd0005040 con 0x7f2bdc0fde00 2023-12-12T11:54:54.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.428+0000 7f2bdaffd700 1 --2- 172.21.15.63:0/3028669460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bdc0fde00 0x7f2bdc10fd10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0009fd0 tx=0x7f2bd0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:54:54.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.428+0000 7f2bc3fff700 1 -- 172.21.15.63:0/3028669460 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bd000e040 con 0x7f2bdc0fde00 2023-12-12T11:54:54.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.428+0000 7f2bc3fff700 1 -- 172.21.15.63:0/3028669460 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2bd0004290 con 0x7f2bdc0fde00 2023-12-12T11:54:54.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.428+0000 7f2bc3fff700 1 -- 172.21.15.63:0/3028669460 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bd001c3f0 con 0x7f2bdc0fde00 2023-12-12T11:54:54.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.428+0000 7f2be1e15700 1 -- 172.21.15.63:0/3028669460 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bdc110de0 con 0x7f2bdc0fde00 2023-12-12T11:54:54.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.428+0000 7f2be1e15700 1 -- 172.21.15.63:0/3028669460 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bdc111320 con 0x7f2bdc0fde00 2023-12-12T11:54:54.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.429+0000 7f2be1e15700 1 -- 172.21.15.63:0/3028669460 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bdc101ea0 con 0x7f2bdc0fde00 2023-12-12T11:54:54.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.431+0000 7f2bc3fff700 1 -- 172.21.15.63:0/3028669460 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 35) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f2bd000bc50 con 0x7f2bdc0fde00 2023-12-12T11:54:54.434 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.432+0000 7f2bc3fff700 1 --2- 172.21.15.63:0/3028669460 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f2bc406cf80 0x7f2bc406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:54.434 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.432+0000 7f2bc3fff700 1 -- 172.21.15.63:0/3028669460 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f2bd008d950 con 0x7f2bdc0fde00 2023-12-12T11:54:54.434 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.432+0000 7f2bdb7fe700 1 --2- 172.21.15.63:0/3028669460 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f2bc406cf80 0x7f2bc406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:54.435 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.433+0000 7f2bdb7fe700 1 --2- 172.21.15.63:0/3028669460 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f2bc406cf80 0x7f2bc406f430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc0fdc60 tx=0x7f2bcc00b040 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:54:54.440 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.438+0000 7f2bc3fff700 1 -- 172.21.15.63:0/3028669460 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f2bd005b0a0 con 0x7f2bdc0fde00 2023-12-12T11:54:54.591 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:54 smithi093 ceph-mon[171709]: Upgrade: Updating crash.smithi093 (2/2) 2023-12-12T11:54:54.592 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:54 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:54.592 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:54 smithi093 ceph-mon[171709]: Deploying daemon crash.smithi093 on smithi093 2023-12-12T11:54:54.592 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:54 smithi093 ceph-mon[171709]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:54:54.592 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:54 smithi093 ceph-mon[171709]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:54:54.592 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:54 smithi093 ceph-mon[171709]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:54:54.737 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.735+0000 7f2be1e15700 1 -- 172.21.15.63:0/3028669460 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2bdc105590 con 0x7f2bdc0fde00 2023-12-12T11:54:54.737 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.735+0000 7f2bc3fff700 1 -- 172.21.15.63:0/3028669460 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+727 (secure 0 0 0) 0x7f2bd005ac30 con 0x7f2bdc0fde00 2023-12-12T11:54:54.738 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:54:54.738 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-12T11:54:54.738 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 2 2023-12-12T11:54:54.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:54:54.738 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-12T11:54:54.738 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 2 2023-12-12T11:54:54.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:54:54.738 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-12T11:54:54.738 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 6 2023-12-12T11:54:54.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:54:54.738 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-12T11:54:54.738 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 4 2023-12-12T11:54:54.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:54:54.739 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-12T11:54:54.739 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 10, 2023-12-12T11:54:54.739 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 4 2023-12-12T11:54:54.739 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-12T11:54:54.739 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:54:54.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.737+0000 7f2be1e15700 1 -- 172.21.15.63:0/3028669460 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f2bc406cf80 msgr2=0x7f2bc406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:54.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.737+0000 7f2be1e15700 1 --2- 172.21.15.63:0/3028669460 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f2bc406cf80 0x7f2bc406f430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc0fdc60 tx=0x7f2bcc00b040 comp rx=0 tx=0).stop 2023-12-12T11:54:54.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.737+0000 7f2be1e15700 1 -- 172.21.15.63:0/3028669460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bdc0fde00 msgr2=0x7f2bdc10fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:54.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.737+0000 7f2be1e15700 1 --2- 172.21.15.63:0/3028669460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bdc0fde00 0x7f2bdc10fd10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0009fd0 tx=0x7f2bd0009e30 comp rx=0 tx=0).stop 2023-12-12T11:54:54.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.737+0000 7f2be1e15700 1 -- 172.21.15.63:0/3028669460 shutdown_connections 2023-12-12T11:54:54.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.737+0000 7f2be1e15700 1 --2- 172.21.15.63:0/3028669460 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f2bc406cf80 0x7f2bc406f430 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:54.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.737+0000 7f2be1e15700 1 --2- 172.21.15.63:0/3028669460 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2bdc0fcbf0 0x7f2bdc10f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:54.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.737+0000 7f2be1e15700 1 --2- 172.21.15.63:0/3028669460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bdc0fde00 0x7f2bdc10fd10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:54.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.737+0000 7f2be1e15700 1 -- 172.21.15.63:0/3028669460 >> 172.21.15.63:0/3028669460 conn(0x7f2bdc0f82d0 msgr2=0x7f2bdc0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:54:54.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.738+0000 7f2be1e15700 1 -- 172.21.15.63:0/3028669460 shutdown_connections 2023-12-12T11:54:54.741 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.738+0000 7f2be1e15700 1 -- 172.21.15.63:0/3028669460 wait complete. 2023-12-12T11:54:54.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:54 smithi063 ceph-mon[187282]: Upgrade: Updating crash.smithi093 (2/2) 2023-12-12T11:54:54.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:54 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:54:54.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:54 smithi063 ceph-mon[187282]: Deploying daemon crash.smithi093 on smithi093 2023-12-12T11:54:54.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:54 smithi063 ceph-mon[187282]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:54:54.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:54 smithi063 ceph-mon[187282]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:54:54.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:54 smithi063 ceph-mon[187282]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:54:54.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.876+0000 7fb27595d700 1 -- 172.21.15.63:0/2239285256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb270070570 msgr2=0x7fb2700709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:54.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.876+0000 7fb27595d700 1 --2- 172.21.15.63:0/2239285256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb270070570 0x7fb2700709c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb264004940 tx=0x7fb264009e30 comp rx=0 tx=0).stop 2023-12-12T11:54:54.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.876+0000 7fb27595d700 1 -- 172.21.15.63:0/2239285256 shutdown_connections 2023-12-12T11:54:54.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.876+0000 7fb27595d700 1 --2- 172.21.15.63:0/2239285256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb270070570 0x7fb2700709c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:54.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.876+0000 7fb27595d700 1 --2- 172.21.15.63:0/2239285256 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb270071bc0 0x7fb270070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:54.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.876+0000 7fb27595d700 1 -- 172.21.15.63:0/2239285256 >> 172.21.15.63:0/2239285256 conn(0x7fb2700f82d0 msgr2=0x7fb2700fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:54:54.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.876+0000 7fb27595d700 1 -- 172.21.15.63:0/2239285256 shutdown_connections 2023-12-12T11:54:54.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.876+0000 7fb27595d700 1 -- 172.21.15.63:0/2239285256 wait complete. 2023-12-12T11:54:54.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.877+0000 7fb27595d700 1 Processor -- start 2023-12-12T11:54:54.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.877+0000 7fb27595d700 1 -- start start 2023-12-12T11:54:54.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.877+0000 7fb27595d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb270070570 0x7fb27010f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:54.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.877+0000 7fb27595d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb270071bc0 0x7fb27010fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:54.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.877+0000 7fb27595d700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2701103a0 con 0x7fb270071bc0 2023-12-12T11:54:54.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.877+0000 7fb27595d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb270110c40 con 0x7fb270070570 2023-12-12T11:54:54.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.877+0000 7fb26e7fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb270071bc0 0x7fb27010fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:54.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.877+0000 7fb26e7fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb270071bc0 0x7fb27010fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51504/0 (socket says 172.21.15.63:51504) 2023-12-12T11:54:54.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.878+0000 7fb26e7fc700 1 -- 172.21.15.63:0/902627562 learned_addr learned my addr 172.21.15.63:0/902627562 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:54:54.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.878+0000 7fb26effd700 1 --2- 172.21.15.63:0/902627562 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb270070570 0x7fb27010f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:54.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.878+0000 7fb26effd700 1 -- 172.21.15.63:0/902627562 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb270071bc0 msgr2=0x7fb27010fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:54.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.878+0000 7fb26effd700 1 --2- 172.21.15.63:0/902627562 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb270071bc0 0x7fb27010fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:54.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.878+0000 7fb26effd700 1 -- 172.21.15.63:0/902627562 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb264005040 con 0x7fb270070570 2023-12-12T11:54:54.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.878+0000 7fb26e7fc700 1 --2- 172.21.15.63:0/902627562 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb270071bc0 0x7fb27010fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T11:54:54.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.878+0000 7fb26effd700 1 --2- 172.21.15.63:0/902627562 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb270070570 0x7fb27010f860 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb260009fd0 tx=0x7fb26000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:54:54.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.878+0000 7fb2577fe700 1 -- 172.21.15.63:0/902627562 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb260004e90 con 0x7fb270070570 2023-12-12T11:54:54.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.878+0000 7fb27595d700 1 -- 172.21.15.63:0/902627562 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb270110ec0 con 0x7fb270070570 2023-12-12T11:54:54.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.878+0000 7fb2577fe700 1 -- 172.21.15.63:0/902627562 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb26000f040 con 0x7fb270070570 2023-12-12T11:54:54.885 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.878+0000 7fb2577fe700 1 -- 172.21.15.63:0/902627562 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb26000c9b0 con 0x7fb270070570 2023-12-12T11:54:54.885 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.879+0000 7fb27595d700 1 -- 172.21.15.63:0/902627562 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb270111400 con 0x7fb270070570 2023-12-12T11:54:54.886 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.880+0000 7fb27595d700 1 -- 172.21.15.63:0/902627562 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2701096f0 con 0x7fb270070570 2023-12-12T11:54:54.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.881+0000 7fb2577fe700 1 -- 172.21.15.63:0/902627562 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 35) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fb260007cc0 con 0x7fb270070570 2023-12-12T11:54:54.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.882+0000 7fb2577fe700 1 --2- 172.21.15.63:0/902627562 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fb25806cf80 0x7fb25806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:54.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.882+0000 7fb2577fe700 1 -- 172.21.15.63:0/902627562 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fb26008c060 con 0x7fb270070570 2023-12-12T11:54:54.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.882+0000 7fb26e7fc700 1 --2- 172.21.15.63:0/902627562 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fb25806cf80 0x7fb25806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:54.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.883+0000 7fb26e7fc700 1 --2- 172.21.15.63:0/902627562 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fb25806cf80 0x7fb25806f430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb264013680 tx=0x7fb264009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:54:54.888 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:54.886+0000 7fb2577fe700 1 -- 172.21.15.63:0/902627562 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fb2600597e0 con 0x7fb270070570 2023-12-12T11:54:55.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.140+0000 7fb27595d700 1 -- 172.21.15.63:0/902627562 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb270109110 con 0x7fb270070570 2023-12-12T11:54:55.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.141+0000 7fb2577fe700 1 -- 172.21.15.63:0/902627562 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1845 (secure 0 0 0) 0x7fb260019750 con 0x7fb270070570 2023-12-12T11:54:55.143 INFO:teuthology.orchestra.run.smithi063.stdout:e13 2023-12-12T11:54:55.143 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-12T11:54:55.144 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:54:55.144 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-12T11:54:55.144 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:54:55.144 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-12T11:54:55.144 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-12T11:54:55.144 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 13 2023-12-12T11:54:55.144 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-12T11:54:55.144 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-12T11:48:58.523481+0000 2023-12-12T11:54:55.144 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-12T11:49:14.113993+0000 2023-12-12T11:54:55.144 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-12T11:54:55.144 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-12T11:54:55.144 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-12T11:54:55.144 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-12T11:54:55.144 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-12T11:54:55.144 INFO:teuthology.orchestra.run.smithi063.stdout:max_xattr_size 65536 2023-12-12T11:54:55.145 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-12T11:54:55.145 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-12T11:54:55.145 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 46 2023-12-12T11:54:55.145 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:54:55.145 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 1 2023-12-12T11:54:55.145 INFO:teuthology.orchestra.run.smithi063.stdout:in 0 2023-12-12T11:54:55.145 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=14492} 2023-12-12T11:54:55.145 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-12T11:54:55.145 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-12T11:54:55.145 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-12T11:54:55.145 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-12T11:54:55.145 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-12T11:54:55.145 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data enabled 2023-12-12T11:54:55.145 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-12T11:54:55.145 INFO:teuthology.orchestra.run.smithi063.stdout:bal_rank_mask -1 2023-12-12T11:54:55.145 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 1 2023-12-12T11:54:55.146 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.aevpzg{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.63:6828/3709000039,v1:172.21.15.63:6829/3709000039] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:54:55.146 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:54:55.146 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:54:55.146 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2023-12-12T11:54:55.146 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:54:55.146 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.swdqms{-1:14500} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.93:6826/3307558569,v1:172.21.15.93:6827/3307558569] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:54:55.146 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.bdqbnp{-1:14508} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/2191270944,v1:172.21.15.63:6827/2191270944] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:54:55.146 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.rhaqsh{-1:24317} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.93:6824/3161864019,v1:172.21.15.93:6825/3161864019] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:54:55.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.143+0000 7fb27595d700 1 -- 172.21.15.63:0/902627562 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fb25806cf80 msgr2=0x7fb25806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:55.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.143+0000 7fb27595d700 1 --2- 172.21.15.63:0/902627562 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fb25806cf80 0x7fb25806f430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb264013680 tx=0x7fb264009e30 comp rx=0 tx=0).stop 2023-12-12T11:54:55.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.143+0000 7fb27595d700 1 -- 172.21.15.63:0/902627562 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb270070570 msgr2=0x7fb27010f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:55.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.143+0000 7fb27595d700 1 --2- 172.21.15.63:0/902627562 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb270070570 0x7fb27010f860 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb260009fd0 tx=0x7fb26000b040 comp rx=0 tx=0).stop 2023-12-12T11:54:55.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.143+0000 7fb27595d700 1 -- 172.21.15.63:0/902627562 shutdown_connections 2023-12-12T11:54:55.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.143+0000 7fb27595d700 1 --2- 172.21.15.63:0/902627562 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fb25806cf80 0x7fb25806f430 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:55.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.143+0000 7fb27595d700 1 --2- 172.21.15.63:0/902627562 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb270070570 0x7fb27010f860 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:55.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.143+0000 7fb27595d700 1 --2- 172.21.15.63:0/902627562 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb270071bc0 0x7fb27010fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:55.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.144+0000 7fb27595d700 1 -- 172.21.15.63:0/902627562 >> 172.21.15.63:0/902627562 conn(0x7fb2700f82d0 msgr2=0x7fb270103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:54:55.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.144+0000 7fb27595d700 1 -- 172.21.15.63:0/902627562 shutdown_connections 2023-12-12T11:54:55.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.144+0000 7fb27595d700 1 -- 172.21.15.63:0/902627562 wait complete. 2023-12-12T11:54:55.148 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 13 2023-12-12T11:54:55.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.283+0000 7f11ffd94700 1 -- 172.21.15.63:0/296552454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11f80fde00 msgr2=0x7f11f80fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:55.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.283+0000 7f11ffd94700 1 --2- 172.21.15.63:0/296552454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11f80fde00 0x7f11f80fe250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f11e8004940 tx=0x7f11e8009e30 comp rx=0 tx=0).stop 2023-12-12T11:54:55.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.283+0000 7f11ffd94700 1 -- 172.21.15.63:0/296552454 shutdown_connections 2023-12-12T11:54:55.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.283+0000 7f11ffd94700 1 --2- 172.21.15.63:0/296552454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11f80fde00 0x7f11f80fe250 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:55.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.283+0000 7f11ffd94700 1 --2- 172.21.15.63:0/296552454 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11f80fcbf0 0x7f11f80fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:55.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.283+0000 7f11ffd94700 1 -- 172.21.15.63:0/296552454 >> 172.21.15.63:0/296552454 conn(0x7f11f80f82d0 msgr2=0x7f11f80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:54:55.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.283+0000 7f11ffd94700 1 -- 172.21.15.63:0/296552454 shutdown_connections 2023-12-12T11:54:55.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.283+0000 7f11ffd94700 1 -- 172.21.15.63:0/296552454 wait complete. 2023-12-12T11:54:55.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.284+0000 7f11ffd94700 1 Processor -- start 2023-12-12T11:54:55.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.284+0000 7f11ffd94700 1 -- start start 2023-12-12T11:54:55.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.284+0000 7f11ffd94700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11f80fcbf0 0x7f11f810f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:55.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.284+0000 7f11ffd94700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11f80fde00 0x7f11f810fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:55.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.284+0000 7f11ffd94700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f8110330 con 0x7f11f80fcbf0 2023-12-12T11:54:55.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.284+0000 7f11ffd94700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f8110b70 con 0x7f11f80fde00 2023-12-12T11:54:55.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.285+0000 7f11fdb30700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11f80fcbf0 0x7f11f810f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:55.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.285+0000 7f11fdb30700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11f80fcbf0 0x7f11f810f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51528/0 (socket says 172.21.15.63:51528) 2023-12-12T11:54:55.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.285+0000 7f11fdb30700 1 -- 172.21.15.63:0/2139633635 learned_addr learned my addr 172.21.15.63:0/2139633635 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:54:55.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.285+0000 7f11fd32f700 1 --2- 172.21.15.63:0/2139633635 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11f80fde00 0x7f11f810fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:55.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.285+0000 7f11fdb30700 1 -- 172.21.15.63:0/2139633635 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11f80fde00 msgr2=0x7f11f810fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:55.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.285+0000 7f11fdb30700 1 --2- 172.21.15.63:0/2139633635 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11f80fde00 0x7f11f810fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:55.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.285+0000 7f11fdb30700 1 -- 172.21.15.63:0/2139633635 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e8005040 con 0x7f11f80fcbf0 2023-12-12T11:54:55.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.285+0000 7f11fdb30700 1 --2- 172.21.15.63:0/2139633635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11f80fcbf0 0x7f11f810f760 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f11f400b790 tx=0x7f11f4009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:54:55.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.286+0000 7f11ee7fc700 1 -- 172.21.15.63:0/2139633635 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11f400f6f0 con 0x7f11f80fcbf0 2023-12-12T11:54:55.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.286+0000 7f11ee7fc700 1 -- 172.21.15.63:0/2139633635 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f11f400fd00 con 0x7f11f80fcbf0 2023-12-12T11:54:55.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.286+0000 7f11ffd94700 1 -- 172.21.15.63:0/2139633635 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f8110e50 con 0x7f11f80fcbf0 2023-12-12T11:54:55.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.286+0000 7f11ee7fc700 1 -- 172.21.15.63:0/2139633635 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11f4011e90 con 0x7f11f80fcbf0 2023-12-12T11:54:55.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.286+0000 7f11ffd94700 1 -- 172.21.15.63:0/2139633635 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f8111390 con 0x7f11f80fcbf0 2023-12-12T11:54:55.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.287+0000 7f11ffd94700 1 -- 172.21.15.63:0/2139633635 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11f8101ea0 con 0x7f11f80fcbf0 2023-12-12T11:54:55.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.288+0000 7f11ee7fc700 1 -- 172.21.15.63:0/2139633635 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 35) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f11f400f850 con 0x7f11f80fcbf0 2023-12-12T11:54:55.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.289+0000 7f11ee7fc700 1 --2- 172.21.15.63:0/2139633635 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f11e406cf80 0x7f11e406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:55.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.290+0000 7f11ee7fc700 1 -- 172.21.15.63:0/2139633635 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f11f408c2a0 con 0x7f11f80fcbf0 2023-12-12T11:54:55.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.290+0000 7f11fd32f700 1 --2- 172.21.15.63:0/2139633635 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f11e406cf80 0x7f11e406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:55.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.290+0000 7f11fd32f700 1 --2- 172.21.15.63:0/2139633635 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f11e406cf80 0x7f11e406f430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f11e8004890 tx=0x7f11e8009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:54:55.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.294+0000 7f11ee7fc700 1 -- 172.21.15.63:0/2139633635 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f11f4059b00 con 0x7f11f80fcbf0 2023-12-12T11:54:55.526 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.523+0000 7f11ffd94700 1 -- 172.21.15.63:0/2139633635 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f11f8111680 con 0x7f11e406cf80 2023-12-12T11:54:55.527 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.525+0000 7f11ee7fc700 1 -- 172.21.15.63:0/2139633635 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f11f8111680 con 0x7f11e406cf80 2023-12-12T11:54:55.527 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:54:55.528 INFO:teuthology.orchestra.run.smithi063.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dbb46fd2dbbe029cfba763f2b7c769e980f86b63e74be0c72e188909e20b81f3", 2023-12-12T11:54:55.528 INFO:teuthology.orchestra.run.smithi063.stdout: "in_progress": true, 2023-12-12T11:54:55.528 INFO:teuthology.orchestra.run.smithi063.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-12T11:54:55.528 INFO:teuthology.orchestra.run.smithi063.stdout: "services_complete": [ 2023-12-12T11:54:55.528 INFO:teuthology.orchestra.run.smithi063.stdout: "mon", 2023-12-12T11:54:55.528 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr" 2023-12-12T11:54:55.529 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2023-12-12T11:54:55.529 INFO:teuthology.orchestra.run.smithi063.stdout: "progress": "4/21 daemons upgraded", 2023-12-12T11:54:55.529 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "Currently upgrading crash daemons", 2023-12-12T11:54:55.529 INFO:teuthology.orchestra.run.smithi063.stdout: "is_paused": false 2023-12-12T11:54:55.529 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:54:55.531 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.527+0000 7f11ffd94700 1 -- 172.21.15.63:0/2139633635 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f11e406cf80 msgr2=0x7f11e406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:55.531 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.527+0000 7f11ffd94700 1 --2- 172.21.15.63:0/2139633635 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f11e406cf80 0x7f11e406f430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f11e8004890 tx=0x7f11e8009e30 comp rx=0 tx=0).stop 2023-12-12T11:54:55.531 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.527+0000 7f11ffd94700 1 -- 172.21.15.63:0/2139633635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11f80fcbf0 msgr2=0x7f11f810f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:55.531 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.527+0000 7f11ffd94700 1 --2- 172.21.15.63:0/2139633635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11f80fcbf0 0x7f11f810f760 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f11f400b790 tx=0x7f11f4009220 comp rx=0 tx=0).stop 2023-12-12T11:54:55.531 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.527+0000 7f11ffd94700 1 -- 172.21.15.63:0/2139633635 shutdown_connections 2023-12-12T11:54:55.531 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.527+0000 7f11ffd94700 1 --2- 172.21.15.63:0/2139633635 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f11e406cf80 0x7f11e406f430 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:55.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.527+0000 7f11ffd94700 1 --2- 172.21.15.63:0/2139633635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11f80fcbf0 0x7f11f810f760 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:55.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.527+0000 7f11ffd94700 1 --2- 172.21.15.63:0/2139633635 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11f80fde00 0x7f11f810fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:55.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.527+0000 7f11ffd94700 1 -- 172.21.15.63:0/2139633635 >> 172.21.15.63:0/2139633635 conn(0x7f11f80f82d0 msgr2=0x7f11f80ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:54:55.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.527+0000 7f11ffd94700 1 -- 172.21.15.63:0/2139633635 shutdown_connections 2023-12-12T11:54:55.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.527+0000 7f11ffd94700 1 -- 172.21.15.63:0/2139633635 wait complete. 2023-12-12T11:54:55.667 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.664+0000 7fab6996d700 1 -- 172.21.15.63:0/4119433811 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab64070570 msgr2=0x7fab640709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:55.667 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.664+0000 7fab6996d700 1 --2- 172.21.15.63:0/4119433811 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab64070570 0x7fab640709c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fab58004940 tx=0x7fab58009e30 comp rx=0 tx=0).stop 2023-12-12T11:54:55.667 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.664+0000 7fab6996d700 1 -- 172.21.15.63:0/4119433811 shutdown_connections 2023-12-12T11:54:55.667 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.664+0000 7fab6996d700 1 --2- 172.21.15.63:0/4119433811 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab64070570 0x7fab640709c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:55.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.664+0000 7fab6996d700 1 --2- 172.21.15.63:0/4119433811 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab64071bc0 0x7fab64070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:55.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.664+0000 7fab6996d700 1 -- 172.21.15.63:0/4119433811 >> 172.21.15.63:0/4119433811 conn(0x7fab640f82d0 msgr2=0x7fab640fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:54:55.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.664+0000 7fab6996d700 1 -- 172.21.15.63:0/4119433811 shutdown_connections 2023-12-12T11:54:55.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.664+0000 7fab6996d700 1 -- 172.21.15.63:0/4119433811 wait complete. 2023-12-12T11:54:55.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.665+0000 7fab6996d700 1 Processor -- start 2023-12-12T11:54:55.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.665+0000 7fab6996d700 1 -- start start 2023-12-12T11:54:55.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.665+0000 7fab6996d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab64070570 0x7fab6410f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:55.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.665+0000 7fab6996d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab64071bc0 0x7fab6410fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:55.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.665+0000 7fab6996d700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab641103a0 con 0x7fab64071bc0 2023-12-12T11:54:55.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.665+0000 7fab6996d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab64110c40 con 0x7fab64070570 2023-12-12T11:54:55.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.666+0000 7fab627fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab64071bc0 0x7fab6410fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:55.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.666+0000 7fab62ffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab64070570 0x7fab6410f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:55.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.666+0000 7fab627fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab64071bc0 0x7fab6410fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51556/0 (socket says 172.21.15.63:51556) 2023-12-12T11:54:55.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.666+0000 7fab62ffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab64070570 0x7fab6410f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:46940/0 (socket says 172.21.15.63:46940) 2023-12-12T11:54:55.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.666+0000 7fab627fc700 1 -- 172.21.15.63:0/1989892995 learned_addr learned my addr 172.21.15.63:0/1989892995 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:54:55.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.666+0000 7fab627fc700 1 -- 172.21.15.63:0/1989892995 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab64070570 msgr2=0x7fab6410f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:55.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.666+0000 7fab627fc700 1 --2- 172.21.15.63:0/1989892995 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab64070570 0x7fab6410f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:55.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.666+0000 7fab627fc700 1 -- 172.21.15.63:0/1989892995 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab58005040 con 0x7fab64071bc0 2023-12-12T11:54:55.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.667+0000 7fab627fc700 1 --2- 172.21.15.63:0/1989892995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab64071bc0 0x7fab6410fda0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fab58004890 tx=0x7fab58009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:54:55.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.667+0000 7fab4b7fe700 1 -- 172.21.15.63:0/1989892995 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab58021070 con 0x7fab64071bc0 2023-12-12T11:54:55.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.667+0000 7fab4b7fe700 1 -- 172.21.15.63:0/1989892995 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fab58004290 con 0x7fab64071bc0 2023-12-12T11:54:55.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.667+0000 7fab4b7fe700 1 -- 172.21.15.63:0/1989892995 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab5800e070 con 0x7fab64071bc0 2023-12-12T11:54:55.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.667+0000 7fab6996d700 1 -- 172.21.15.63:0/1989892995 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab64110ec0 con 0x7fab64071bc0 2023-12-12T11:54:55.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.667+0000 7fab6996d700 1 -- 172.21.15.63:0/1989892995 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab641113a0 con 0x7fab64071bc0 2023-12-12T11:54:55.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.668+0000 7fab6996d700 1 -- 172.21.15.63:0/1989892995 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab641096f0 con 0x7fab64071bc0 2023-12-12T11:54:55.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.669+0000 7fab4b7fe700 1 -- 172.21.15.63:0/1989892995 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 35) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fab5801c690 con 0x7fab64071bc0 2023-12-12T11:54:55.673 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.670+0000 7fab4b7fe700 1 --2- 172.21.15.63:0/1989892995 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fab4c06cf80 0x7fab4c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:54:55.673 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.671+0000 7fab4b7fe700 1 -- 172.21.15.63:0/1989892995 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fab5808d5b0 con 0x7fab64071bc0 2023-12-12T11:54:55.673 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.671+0000 7fab62ffd700 1 --2- 172.21.15.63:0/1989892995 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fab4c06cf80 0x7fab4c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:54:55.673 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.671+0000 7fab62ffd700 1 --2- 172.21.15.63:0/1989892995 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fab4c06cf80 0x7fab4c06f430 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fab54009b80 tx=0x7fab5400b040 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:54:55.677 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.675+0000 7fab4b7fe700 1 -- 172.21.15.63:0/1989892995 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fab5805adc0 con 0x7fab64071bc0 2023-12-12T11:54:55.896 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:55 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/3028669460' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:54:55.896 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:55 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/902627562' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:54:55.896 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:55 smithi093 ceph-mon[171709]: pgmap v28: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:55.972 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.969+0000 7fab6996d700 1 -- 172.21.15.63:0/1989892995 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fab6404bb80 con 0x7fab64071bc0 2023-12-12T11:54:55.972 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.970+0000 7fab4b7fe700 1 -- 172.21.15.63:0/1989892995 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fab5805a950 con 0x7fab64071bc0 2023-12-12T11:54:55.972 INFO:teuthology.orchestra.run.smithi063.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-12T11:54:55.972 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-12T11:54:55.973 INFO:teuthology.orchestra.run.smithi063.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-12T11:54:55.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.972+0000 7fab6996d700 1 -- 172.21.15.63:0/1989892995 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fab4c06cf80 msgr2=0x7fab4c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:55.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.972+0000 7fab6996d700 1 --2- 172.21.15.63:0/1989892995 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fab4c06cf80 0x7fab4c06f430 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fab54009b80 tx=0x7fab5400b040 comp rx=0 tx=0).stop 2023-12-12T11:54:55.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.972+0000 7fab6996d700 1 -- 172.21.15.63:0/1989892995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab64071bc0 msgr2=0x7fab6410fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:54:55.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.972+0000 7fab6996d700 1 --2- 172.21.15.63:0/1989892995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab64071bc0 0x7fab6410fda0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fab58004890 tx=0x7fab58009e30 comp rx=0 tx=0).stop 2023-12-12T11:54:55.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.972+0000 7fab6996d700 1 -- 172.21.15.63:0/1989892995 shutdown_connections 2023-12-12T11:54:55.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.972+0000 7fab6996d700 1 --2- 172.21.15.63:0/1989892995 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fab4c06cf80 0x7fab4c06f430 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:55.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.972+0000 7fab6996d700 1 --2- 172.21.15.63:0/1989892995 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab64070570 0x7fab6410f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:55.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.972+0000 7fab6996d700 1 --2- 172.21.15.63:0/1989892995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab64071bc0 0x7fab6410fda0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:54:55.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.972+0000 7fab6996d700 1 -- 172.21.15.63:0/1989892995 >> 172.21.15.63:0/1989892995 conn(0x7fab640f82d0 msgr2=0x7fab64103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:54:55.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.972+0000 7fab6996d700 1 -- 172.21.15.63:0/1989892995 shutdown_connections 2023-12-12T11:54:55.976 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:54:55.973+0000 7fab6996d700 1 -- 172.21.15.63:0/1989892995 wait complete. 2023-12-12T11:54:56.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:55 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/3028669460' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:54:56.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:55 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/902627562' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:54:56.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:55 smithi063 ceph-mon[187282]: pgmap v28: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:57.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:56 smithi063 ceph-mon[187282]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:54:57.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:56 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/1989892995' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:54:57.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:56 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:57.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:56 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:57.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:56 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:54:57.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:56 smithi093 ceph-mon[171709]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:54:57.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:56 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/1989892995' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:54:57.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:56 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:57.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:56 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:54:57.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:56 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:54:58.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:54:57 smithi063 ceph-mon[187282]: pgmap v29: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:54:58.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:54:57 smithi093 ceph-mon[171709]: pgmap v29: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:00.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:00 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:00.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:00 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:00.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:00 smithi063 ceph-mon[187282]: pgmap v30: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:00.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:00 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:00.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:00 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:00.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:00 smithi093 ceph-mon[171709]: pgmap v30: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:01.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:01 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:01.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:01 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:01.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:01 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:01.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:01 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:01.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:01 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:01.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:01 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:01.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:01 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:01.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:01 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:02.603 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:02 smithi063 ceph-mon[187282]: pgmap v31: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:02.603 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:02 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:02.603 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:02 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:02.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:02 smithi093 ceph-mon[171709]: pgmap v31: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:02.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:02 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:02.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:02 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:03.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:03 smithi063 ceph-mon[187282]: pgmap v32: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:03.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:03 smithi093 ceph-mon[171709]: pgmap v32: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:04.963 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:04 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:04.963 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:04 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:04.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:04 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:04.970 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:04 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:06.159 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:06 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:06.159 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:06 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:06.159 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:06 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:55:06.159 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:06 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:55:06.159 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:06 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:06.159 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:06 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:55:06.160 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:06 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:55:06.160 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:06 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:55:06.160 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:06 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:55:06.160 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:06 smithi063 ceph-mon[187282]: Upgrade: Setting container_image for all crash 2023-12-12T11:55:06.160 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:06 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:06.160 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:06 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi063"}]: dispatch 2023-12-12T11:55:06.160 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:06 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi063"}]': finished 2023-12-12T11:55:06.160 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:06 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi093"}]: dispatch 2023-12-12T11:55:06.160 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:06 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi093"}]': finished 2023-12-12T11:55:06.160 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:06 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-12T11:55:06.160 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:06 smithi063 ceph-mon[187282]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-12T11:55:06.160 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:06 smithi063 ceph-mon[187282]: Upgrade: osd.0 is safe to restart 2023-12-12T11:55:06.160 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:06 smithi063 ceph-mon[187282]: pgmap v33: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:06.160 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:06 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:55:06.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:06 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:06.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:06 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:06.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:06 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:55:06.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:06 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:55:06.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:06 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:06.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:06 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:55:06.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:06 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:55:06.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:06 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:55:06.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:06 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:55:06.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:06 smithi093 ceph-mon[171709]: Upgrade: Setting container_image for all crash 2023-12-12T11:55:06.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:06 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:06.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:06 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi063"}]: dispatch 2023-12-12T11:55:06.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:06 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi063"}]': finished 2023-12-12T11:55:06.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:06 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi093"}]: dispatch 2023-12-12T11:55:06.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:06 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi093"}]': finished 2023-12-12T11:55:06.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:06 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-12T11:55:06.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:06 smithi093 ceph-mon[171709]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-12T11:55:06.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:06 smithi093 ceph-mon[171709]: Upgrade: osd.0 is safe to restart 2023-12-12T11:55:06.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:06 smithi093 ceph-mon[171709]: pgmap v33: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:06.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:06 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:55:07.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:07 smithi063 ceph-mon[187282]: Upgrade: Updating osd.0 2023-12-12T11:55:07.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:07.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-12T11:55:07.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:55:07.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:07 smithi063 ceph-mon[187282]: Deploying daemon osd.0 on smithi063 2023-12-12T11:55:07.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:07 smithi063 ceph-mon[187282]: pgmap v34: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:07.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:07 smithi093 ceph-mon[171709]: Upgrade: Updating osd.0 2023-12-12T11:55:07.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:07.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-12T11:55:07.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:55:07.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:07 smithi093 ceph-mon[171709]: Deploying daemon osd.0 on smithi063 2023-12-12T11:55:07.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:07 smithi093 ceph-mon[171709]: pgmap v34: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:09.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:09 smithi093 ceph-mon[171709]: pgmap v35: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:09.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:09 smithi063 ceph-mon[187282]: pgmap v35: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:09.795 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:55:09 smithi063 systemd[1]: Stopping Ceph osd.0 for 85e33c70-98e3-11ee-95a3-87774f69a715... 2023-12-12T11:55:09.795 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:55:09 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-0[130381]: 2023-12-12T11:55:09.626+0000 7efd85d7f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-12T11:55:09.796 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:55:09 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-0[130381]: 2023-12-12T11:55:09.626+0000 7efd85d7f700 -1 osd.0 49 *** Got signal Terminated *** 2023-12-12T11:55:09.796 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:55:09 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-0[130381]: 2023-12-12T11:55:09.626+0000 7efd85d7f700 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-12T11:55:10.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:10 smithi093 ceph-mon[171709]: osd.0 marked itself down and dead 2023-12-12T11:55:10.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:10 smithi063 ceph-mon[187282]: osd.0 marked itself down and dead 2023-12-12T11:55:11.295 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:55:11 smithi063 bash[196899]: ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-0 2023-12-12T11:55:11.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:11 smithi093 ceph-mon[171709]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-12T11:55:11.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:11 smithi093 ceph-mon[171709]: failed to encode map e50 with expected crc 2023-12-12T11:55:11.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:11 smithi093 ceph-mon[171709]: osdmap e50: 6 total, 5 up, 6 in 2023-12-12T11:55:11.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:11 smithi093 ceph-mon[171709]: pgmap v37: 65 pgs: 34 peering, 31 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:11.738 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:11 smithi063 ceph-mon[187282]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-12T11:55:11.738 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:11 smithi063 ceph-mon[187282]: failed to encode map e50 with expected crc 2023-12-12T11:55:11.738 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:11 smithi063 ceph-mon[187282]: osdmap e50: 6 total, 5 up, 6 in 2023-12-12T11:55:11.738 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:11 smithi063 ceph-mon[187282]: pgmap v37: 65 pgs: 34 peering, 31 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:12.540 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:12 smithi063 ceph-mon[187282]: Health check failed: Reduced data availability: 34 pgs peering (PG_AVAILABILITY) 2023-12-12T11:55:12.541 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:12 smithi063 ceph-mon[187282]: failed to encode map e51 with expected crc 2023-12-12T11:55:12.541 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:12 smithi063 ceph-mon[187282]: osdmap e51: 6 total, 5 up, 6 in 2023-12-12T11:55:12.541 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:12 smithi063 ceph-mon[187282]: failed to encode map e51 with expected crc 2023-12-12T11:55:12.541 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:12 smithi063 ceph-mon[187282]: failed to encode map e51 with expected crc 2023-12-12T11:55:12.541 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:12 smithi063 ceph-mon[187282]: failed to encode map e51 with expected crc 2023-12-12T11:55:12.541 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:12 smithi063 ceph-mon[187282]: failed to encode map e51 with expected crc 2023-12-12T11:55:12.541 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:12 smithi063 ceph-mon[187282]: failed to encode map e51 with expected crc 2023-12-12T11:55:12.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:12 smithi093 ceph-mon[171709]: Health check failed: Reduced data availability: 34 pgs peering (PG_AVAILABILITY) 2023-12-12T11:55:12.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:12 smithi093 ceph-mon[171709]: failed to encode map e51 with expected crc 2023-12-12T11:55:12.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:12 smithi093 ceph-mon[171709]: osdmap e51: 6 total, 5 up, 6 in 2023-12-12T11:55:12.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:12 smithi093 ceph-mon[171709]: failed to encode map e51 with expected crc 2023-12-12T11:55:12.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:12 smithi093 ceph-mon[171709]: failed to encode map e51 with expected crc 2023-12-12T11:55:12.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:12 smithi093 ceph-mon[171709]: failed to encode map e51 with expected crc 2023-12-12T11:55:12.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:12 smithi093 ceph-mon[171709]: failed to encode map e51 with expected crc 2023-12-12T11:55:12.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:12 smithi093 ceph-mon[171709]: failed to encode map e51 with expected crc 2023-12-12T11:55:12.853 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:55:12 smithi063 systemd[1]: ceph-85e33c70-98e3-11ee-95a3-87774f69a715@osd.0.service: Succeeded. 2023-12-12T11:55:12.853 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:55:12 smithi063 systemd[1]: Stopped Ceph osd.0 for 85e33c70-98e3-11ee-95a3-87774f69a715. 2023-12-12T11:55:13.214 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:55:12 smithi063 systemd[1]: Starting Ceph osd.0 for 85e33c70-98e3-11ee-95a3-87774f69a715... 2023-12-12T11:55:13.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:13 smithi063 ceph-mon[187282]: pgmap v39: 65 pgs: 34 peering, 31 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:13.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:13 smithi093 ceph-mon[171709]: pgmap v39: 65 pgs: 34 peering, 31 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:14.295 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:55:14 smithi063 bash[197163]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-12T11:55:14.295 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:55:14 smithi063 bash[197163]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-12-12T11:55:14.295 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:55:14 smithi063 bash[197163]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-12-12T11:55:14.295 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:55:14 smithi063 bash[197163]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-12-12T11:55:14.295 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:55:14 smithi063 bash[197163]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2023-12-12T11:55:14.295 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:55:14 smithi063 bash[197163]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-12T11:55:14.295 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:55:14 smithi063 bash[197163]: --> ceph-volume raw activate successful for osd ID: 0 2023-12-12T11:55:15.294 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:55:14 smithi063 bash[197438]: fade55811ec17fdb2a02427ce29babd55413888b25e1d8ff0bdca56141359349 2023-12-12T11:55:15.295 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:55:14 smithi063 systemd[1]: Started Ceph osd.0 for 85e33c70-98e3-11ee-95a3-87774f69a715. 2023-12-12T11:55:15.295 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:55:14 smithi063 ceph-osd[197476]: -- 172.21.15.63:0/1845064139 <== mon.0 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558dcb40f6c0 con 0x558dcb3dec00 2023-12-12T11:55:15.794 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:55:15 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-0[197453]: 2023-12-12T11:55:15.365+0000 7f266ffaf640 -1 Falling back to public interface 2023-12-12T11:55:16.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:15 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:16.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:15 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:16.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:15 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:55:16.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:15 smithi093 ceph-mon[171709]: pgmap v40: 65 pgs: 34 peering, 31 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:16.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:15 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:16.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:15 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:16.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:15 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:16.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:15 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:16.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:15 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:55:16.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:15 smithi063 ceph-mon[187282]: pgmap v40: 65 pgs: 34 peering, 31 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:16.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:15 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:16.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:15 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:17.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:17 smithi093 ceph-mon[171709]: pgmap v41: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2023-12-12T11:55:17.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:17 smithi093 ceph-mon[171709]: Health check failed: Degraded data redundancy: 44/219 objects degraded (20.091%), 17 pgs degraded (PG_DEGRADED) 2023-12-12T11:55:17.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:17 smithi093 ceph-mon[171709]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 34 pgs peering) 2023-12-12T11:55:17.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:17 smithi063 ceph-mon[187282]: pgmap v41: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2023-12-12T11:55:17.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:17 smithi063 ceph-mon[187282]: Health check failed: Degraded data redundancy: 44/219 objects degraded (20.091%), 17 pgs degraded (PG_DEGRADED) 2023-12-12T11:55:17.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:17 smithi063 ceph-mon[187282]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 34 pgs peering) 2023-12-12T11:55:20.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:20 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:20.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:20 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:20.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:20 smithi093 ceph-mon[171709]: pgmap v42: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2023-12-12T11:55:20.487 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:20 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:20.488 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:20 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:20.488 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:20 smithi063 ceph-mon[187282]: pgmap v42: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2023-12-12T11:55:20.794 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:55:20 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-0[197453]: 2023-12-12T11:55:20.485+0000 7f266ffaf640 -1 osd.0 0 read_superblock omap replica is missing. 2023-12-12T11:55:21.418 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:55:21 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-0[197453]: 2023-12-12T11:55:21.142+0000 7f266ffaf640 -1 osd.0 49 log_to_monitors true 2023-12-12T11:55:21.697 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:55:21 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-0[197453]: 2023-12-12T11:55:21.531+0000 7f265f41c700 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T11:55:21.697 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:21 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:21.697 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:21 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:55:21.698 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:21 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:21.698 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:21 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:21.698 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:21 smithi063 ceph-mon[187282]: from='osd.0 [v2:172.21.15.63:6802/4193564418,v1:172.21.15.63:6803/4193564418]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-12T11:55:21.698 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:21 smithi063 ceph-mon[187282]: pgmap v43: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2023-12-12T11:55:21.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:21 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:21.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:21 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:55:21.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:21 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:21.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:21 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:21.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:21 smithi093 ceph-mon[171709]: from='osd.0 [v2:172.21.15.63:6802/4193564418,v1:172.21.15.63:6803/4193564418]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-12T11:55:21.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:21 smithi093 ceph-mon[171709]: pgmap v43: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2023-12-12T11:55:22.776 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:22 smithi063 ceph-mon[187282]: from='osd.0 [v2:172.21.15.63:6802/4193564418,v1:172.21.15.63:6803/4193564418]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-12T11:55:22.777 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:22 smithi063 ceph-mon[187282]: failed to encode map e52 with expected crc 2023-12-12T11:55:22.777 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:22 smithi063 ceph-mon[187282]: osdmap e52: 6 total, 5 up, 6 in 2023-12-12T11:55:22.777 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:22 smithi063 ceph-mon[187282]: from='osd.0 [v2:172.21.15.63:6802/4193564418,v1:172.21.15.63:6803/4193564418]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2023-12-12T11:55:22.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:22 smithi093 ceph-mon[171709]: from='osd.0 [v2:172.21.15.63:6802/4193564418,v1:172.21.15.63:6803/4193564418]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-12T11:55:22.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:22 smithi093 ceph-mon[171709]: failed to encode map e52 with expected crc 2023-12-12T11:55:22.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:22 smithi093 ceph-mon[171709]: osdmap e52: 6 total, 5 up, 6 in 2023-12-12T11:55:22.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:22 smithi093 ceph-mon[171709]: from='osd.0 [v2:172.21.15.63:6802/4193564418,v1:172.21.15.63:6803/4193564418]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2023-12-12T11:55:23.627 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:23 smithi063 ceph-mon[187282]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-12T11:55:23.628 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:23 smithi063 ceph-mon[187282]: failed to encode map e52 with expected crc 2023-12-12T11:55:23.628 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:23 smithi063 ceph-mon[187282]: osd.0 [v2:172.21.15.63:6802/4193564418,v1:172.21.15.63:6803/4193564418] boot 2023-12-12T11:55:23.628 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:23 smithi063 ceph-mon[187282]: osdmap e53: 6 total, 6 up, 6 in 2023-12-12T11:55:23.628 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:23 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-12T11:55:23.628 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:23 smithi063 ceph-mon[187282]: pgmap v46: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2023-12-12T11:55:23.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:23 smithi093 ceph-mon[171709]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-12T11:55:23.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:23 smithi093 ceph-mon[171709]: failed to encode map e52 with expected crc 2023-12-12T11:55:23.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:23 smithi093 ceph-mon[171709]: osd.0 [v2:172.21.15.63:6802/4193564418,v1:172.21.15.63:6803/4193564418] boot 2023-12-12T11:55:23.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:23 smithi093 ceph-mon[171709]: osdmap e53: 6 total, 6 up, 6 in 2023-12-12T11:55:23.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:23 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-12T11:55:23.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:23 smithi093 ceph-mon[171709]: pgmap v46: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2023-12-12T11:55:24.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:24 smithi063 ceph-mon[187282]: failed to encode map e54 with expected crc 2023-12-12T11:55:24.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:24 smithi063 ceph-mon[187282]: osdmap e54: 6 total, 6 up, 6 in 2023-12-12T11:55:24.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:24 smithi063 ceph-mon[187282]: failed to encode map e54 with expected crc 2023-12-12T11:55:24.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:24 smithi063 ceph-mon[187282]: failed to encode map e54 with expected crc 2023-12-12T11:55:24.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:24 smithi063 ceph-mon[187282]: failed to encode map e54 with expected crc 2023-12-12T11:55:24.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:24 smithi063 ceph-mon[187282]: failed to encode map e54 with expected crc 2023-12-12T11:55:24.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:24 smithi063 ceph-mon[187282]: failed to encode map e54 with expected crc 2023-12-12T11:55:24.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:24 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:24.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:24 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:24.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:24 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:55:24.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:24 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:55:24.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:24 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:24.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:24 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:55:24.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:24 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:55:24.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:24 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:55:24.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:24 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:55:24.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:24 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-12T11:55:24.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:24 smithi063 ceph-mon[187282]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-12T11:55:24.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:24 smithi063 ceph-mon[187282]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2023-12-12T11:55:24.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:24 smithi093 ceph-mon[171709]: failed to encode map e54 with expected crc 2023-12-12T11:55:24.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:24 smithi093 ceph-mon[171709]: osdmap e54: 6 total, 6 up, 6 in 2023-12-12T11:55:24.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:24 smithi093 ceph-mon[171709]: failed to encode map e54 with expected crc 2023-12-12T11:55:24.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:24 smithi093 ceph-mon[171709]: failed to encode map e54 with expected crc 2023-12-12T11:55:24.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:24 smithi093 ceph-mon[171709]: failed to encode map e54 with expected crc 2023-12-12T11:55:24.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:24 smithi093 ceph-mon[171709]: failed to encode map e54 with expected crc 2023-12-12T11:55:24.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:24 smithi093 ceph-mon[171709]: failed to encode map e54 with expected crc 2023-12-12T11:55:24.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:24 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:24.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:24 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:24.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:24 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:55:24.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:24 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:55:24.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:24 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:24.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:24 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:55:24.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:24 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:55:24.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:24 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:55:24.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:24 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:55:24.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:24 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-12T11:55:24.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:24 smithi093 ceph-mon[171709]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-12T11:55:24.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:24 smithi093 ceph-mon[171709]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2023-12-12T11:55:26.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:25 smithi063 ceph-mon[187282]: pgmap v48: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2023-12-12T11:55:26.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.128+0000 7efd0e014700 1 -- 172.21.15.63:0/3330768947 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd080fcbf0 msgr2=0x7efd080fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:26.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.128+0000 7efd0e014700 1 --2- 172.21.15.63:0/3330768947 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd080fcbf0 0x7efd080fd000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efcf8004940 tx=0x7efcf8009e30 comp rx=0 tx=0).stop 2023-12-12T11:55:26.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.128+0000 7efd0e014700 1 -- 172.21.15.63:0/3330768947 shutdown_connections 2023-12-12T11:55:26.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.128+0000 7efd0e014700 1 --2- 172.21.15.63:0/3330768947 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd080fde00 0x7efd080fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:26.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.128+0000 7efd0e014700 1 --2- 172.21.15.63:0/3330768947 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd080fcbf0 0x7efd080fd000 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:26.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.128+0000 7efd0e014700 1 -- 172.21.15.63:0/3330768947 >> 172.21.15.63:0/3330768947 conn(0x7efd080f82d0 msgr2=0x7efd080fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:55:26.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.128+0000 7efd0e014700 1 -- 172.21.15.63:0/3330768947 shutdown_connections 2023-12-12T11:55:26.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.128+0000 7efd0e014700 1 -- 172.21.15.63:0/3330768947 wait complete. 2023-12-12T11:55:26.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.129+0000 7efd0e014700 1 Processor -- start 2023-12-12T11:55:26.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.130+0000 7efd0e014700 1 -- start start 2023-12-12T11:55:26.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.130+0000 7efd0e014700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd080fcbf0 0x7efd0810f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:55:26.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.130+0000 7efd0e014700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd080fde00 0x7efd0810fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:55:26.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.130+0000 7efd0e014700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd081102a0 con 0x7efd080fde00 2023-12-12T11:55:26.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.130+0000 7efd0e014700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd08110b40 con 0x7efd080fcbf0 2023-12-12T11:55:26.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.130+0000 7efd06ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd080fde00 0x7efd0810fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:55:26.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.130+0000 7efd077fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd080fcbf0 0x7efd0810f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:55:26.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.130+0000 7efd06ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd080fde00 0x7efd0810fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36550/0 (socket says 172.21.15.63:36550) 2023-12-12T11:55:26.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.130+0000 7efd06ffd700 1 -- 172.21.15.63:0/141539148 learned_addr learned my addr 172.21.15.63:0/141539148 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:55:26.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.131+0000 7efd06ffd700 1 -- 172.21.15.63:0/141539148 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd080fcbf0 msgr2=0x7efd0810f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:26.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.131+0000 7efd06ffd700 1 --2- 172.21.15.63:0/141539148 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd080fcbf0 0x7efd0810f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:26.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.131+0000 7efd06ffd700 1 -- 172.21.15.63:0/141539148 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf8005040 con 0x7efd080fde00 2023-12-12T11:55:26.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.131+0000 7efd077fe700 1 --2- 172.21.15.63:0/141539148 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd080fcbf0 0x7efd0810f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T11:55:26.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.131+0000 7efd06ffd700 1 --2- 172.21.15.63:0/141539148 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd080fde00 0x7efd0810fca0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efcfc002a50 tx=0x7efcfc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:55:26.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.131+0000 7efceffff700 1 -- 172.21.15.63:0/141539148 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcfc007cc0 con 0x7efd080fde00 2023-12-12T11:55:26.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.131+0000 7efceffff700 1 -- 172.21.15.63:0/141539148 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efcfc00f040 con 0x7efd080fde00 2023-12-12T11:55:26.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.131+0000 7efceffff700 1 -- 172.21.15.63:0/141539148 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcfc00d9c0 con 0x7efd080fde00 2023-12-12T11:55:26.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.131+0000 7efd0e014700 1 -- 172.21.15.63:0/141539148 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd08110e20 con 0x7efd080fde00 2023-12-12T11:55:26.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.132+0000 7efd0e014700 1 -- 172.21.15.63:0/141539148 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd08111360 con 0x7efd080fde00 2023-12-12T11:55:26.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.133+0000 7efd0e014700 1 -- 172.21.15.63:0/141539148 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd08101ea0 con 0x7efd080fde00 2023-12-12T11:55:26.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.134+0000 7efceffff700 1 -- 172.21.15.63:0/141539148 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 35) v1 ==== 91038+0+0 (secure 0 0 0) 0x7efcfc00db20 con 0x7efd080fde00 2023-12-12T11:55:26.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.135+0000 7efceffff700 1 --2- 172.21.15.63:0/141539148 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7efcf006cf80 0x7efcf006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:55:26.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.135+0000 7efceffff700 1 -- 172.21.15.63:0/141539148 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6500+0+0 (secure 0 0 0) 0x7efcfc08c380 con 0x7efd080fde00 2023-12-12T11:55:26.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.135+0000 7efd077fe700 1 --2- 172.21.15.63:0/141539148 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7efcf006cf80 0x7efcf006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:55:26.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.136+0000 7efd077fe700 1 --2- 172.21.15.63:0/141539148 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7efcf006cf80 0x7efcf006f430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efcf800b7d0 tx=0x7efcf8009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:55:26.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.140+0000 7efceffff700 1 -- 172.21.15.63:0/141539148 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7efcfc0599d0 con 0x7efd080fde00 2023-12-12T11:55:26.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:25 smithi093 ceph-mon[171709]: pgmap v48: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2023-12-12T11:55:26.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.367+0000 7efd0e014700 1 -- 172.21.15.63:0/141539148 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efd08111580 con 0x7efcf006cf80 2023-12-12T11:55:26.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.368+0000 7efceffff700 1 -- 172.21.15.63:0/141539148 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7efd08111580 con 0x7efcf006cf80 2023-12-12T11:55:26.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.370+0000 7efd0e014700 1 -- 172.21.15.63:0/141539148 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7efcf006cf80 msgr2=0x7efcf006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:26.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.370+0000 7efd0e014700 1 --2- 172.21.15.63:0/141539148 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7efcf006cf80 0x7efcf006f430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efcf800b7d0 tx=0x7efcf8009e30 comp rx=0 tx=0).stop 2023-12-12T11:55:26.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.370+0000 7efd0e014700 1 -- 172.21.15.63:0/141539148 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd080fde00 msgr2=0x7efd0810fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:26.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.370+0000 7efd0e014700 1 --2- 172.21.15.63:0/141539148 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd080fde00 0x7efd0810fca0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efcfc002a50 tx=0x7efcfc0046b0 comp rx=0 tx=0).stop 2023-12-12T11:55:26.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.370+0000 7efd0e014700 1 -- 172.21.15.63:0/141539148 shutdown_connections 2023-12-12T11:55:26.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.370+0000 7efd0e014700 1 --2- 172.21.15.63:0/141539148 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7efcf006cf80 0x7efcf006f430 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:26.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.370+0000 7efd0e014700 1 --2- 172.21.15.63:0/141539148 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd080fcbf0 0x7efd0810f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:26.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.370+0000 7efd0e014700 1 --2- 172.21.15.63:0/141539148 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd080fde00 0x7efd0810fca0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:26.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.370+0000 7efd0e014700 1 -- 172.21.15.63:0/141539148 >> 172.21.15.63:0/141539148 conn(0x7efd080f82d0 msgr2=0x7efd080ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:55:26.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.371+0000 7efd0e014700 1 -- 172.21.15.63:0/141539148 shutdown_connections 2023-12-12T11:55:26.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.371+0000 7efd0e014700 1 -- 172.21.15.63:0/141539148 wait complete. 2023-12-12T11:55:26.388 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-12T11:55:26.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.510+0000 7ffbbe907700 1 -- 172.21.15.63:0/703741850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffbb80fcbf0 msgr2=0x7ffbb80fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:26.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.510+0000 7ffbbe907700 1 --2- 172.21.15.63:0/703741850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffbb80fcbf0 0x7ffbb80fd000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffba8004940 tx=0x7ffba8009e30 comp rx=0 tx=0).stop 2023-12-12T11:55:26.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.510+0000 7ffbbe907700 1 -- 172.21.15.63:0/703741850 shutdown_connections 2023-12-12T11:55:26.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.510+0000 7ffbbe907700 1 --2- 172.21.15.63:0/703741850 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbb80fde00 0x7ffbb80fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:26.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.510+0000 7ffbbe907700 1 --2- 172.21.15.63:0/703741850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffbb80fcbf0 0x7ffbb80fd000 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:26.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.510+0000 7ffbbe907700 1 -- 172.21.15.63:0/703741850 >> 172.21.15.63:0/703741850 conn(0x7ffbb80f82d0 msgr2=0x7ffbb80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:55:26.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.510+0000 7ffbbe907700 1 -- 172.21.15.63:0/703741850 shutdown_connections 2023-12-12T11:55:26.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.510+0000 7ffbbe907700 1 -- 172.21.15.63:0/703741850 wait complete. 2023-12-12T11:55:26.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.511+0000 7ffbbe907700 1 Processor -- start 2023-12-12T11:55:26.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.511+0000 7ffbbe907700 1 -- start start 2023-12-12T11:55:26.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.511+0000 7ffbbe907700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbb80fcbf0 0x7ffbb810f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:55:26.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.511+0000 7ffbbe907700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffbb80fde00 0x7ffbb810fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:55:26.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.511+0000 7ffbbe907700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb81102a0 con 0x7ffbb80fde00 2023-12-12T11:55:26.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.511+0000 7ffbbe907700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb8110b40 con 0x7ffbb80fcbf0 2023-12-12T11:55:26.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.511+0000 7ffbb77fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffbb80fde00 0x7ffbb810fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:55:26.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.512+0000 7ffbb77fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffbb80fde00 0x7ffbb810fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36576/0 (socket says 172.21.15.63:36576) 2023-12-12T11:55:26.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.512+0000 7ffbb77fe700 1 -- 172.21.15.63:0/3721383511 learned_addr learned my addr 172.21.15.63:0/3721383511 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:55:26.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.512+0000 7ffbb7fff700 1 --2- 172.21.15.63:0/3721383511 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbb80fcbf0 0x7ffbb810f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:55:26.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.512+0000 7ffbb77fe700 1 -- 172.21.15.63:0/3721383511 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbb80fcbf0 msgr2=0x7ffbb810f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:26.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.512+0000 7ffbb77fe700 1 --2- 172.21.15.63:0/3721383511 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbb80fcbf0 0x7ffbb810f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:26.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.512+0000 7ffbb77fe700 1 -- 172.21.15.63:0/3721383511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba8005040 con 0x7ffbb80fde00 2023-12-12T11:55:26.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.512+0000 7ffbb7fff700 1 --2- 172.21.15.63:0/3721383511 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbb80fcbf0 0x7ffbb810f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T11:55:26.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.512+0000 7ffbb77fe700 1 --2- 172.21.15.63:0/3721383511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffbb80fde00 0x7ffbb810fca0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffbac002a50 tx=0x7ffbac0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:55:26.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.512+0000 7ffbb4ff9700 1 -- 172.21.15.63:0/3721383511 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbac007cc0 con 0x7ffbb80fde00 2023-12-12T11:55:26.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.512+0000 7ffbb4ff9700 1 -- 172.21.15.63:0/3721383511 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffbac00f040 con 0x7ffbb80fde00 2023-12-12T11:55:26.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.512+0000 7ffbb4ff9700 1 -- 172.21.15.63:0/3721383511 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbac009540 con 0x7ffbb80fde00 2023-12-12T11:55:26.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.512+0000 7ffbbe907700 1 -- 172.21.15.63:0/3721383511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb8110e20 con 0x7ffbb80fde00 2023-12-12T11:55:26.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.513+0000 7ffbbe907700 1 -- 172.21.15.63:0/3721383511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb8111310 con 0x7ffbb80fde00 2023-12-12T11:55:26.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.514+0000 7ffbbe907700 1 -- 172.21.15.63:0/3721383511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbb8101ea0 con 0x7ffbb80fde00 2023-12-12T11:55:26.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.515+0000 7ffbb4ff9700 1 -- 172.21.15.63:0/3721383511 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 35) v1 ==== 91038+0+0 (secure 0 0 0) 0x7ffbac0096a0 con 0x7ffbb80fde00 2023-12-12T11:55:26.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.516+0000 7ffbb4ff9700 1 --2- 172.21.15.63:0/3721383511 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7ffba006cf80 0x7ffba006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:55:26.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.516+0000 7ffbb4ff9700 1 -- 172.21.15.63:0/3721383511 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6500+0+0 (secure 0 0 0) 0x7ffbac08c470 con 0x7ffbb80fde00 2023-12-12T11:55:26.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.516+0000 7ffbb7fff700 1 --2- 172.21.15.63:0/3721383511 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7ffba006cf80 0x7ffba006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:55:26.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.517+0000 7ffbb7fff700 1 --2- 172.21.15.63:0/3721383511 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7ffba006cf80 0x7ffba006f430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ffba8004f90 tx=0x7ffba8009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:55:26.522 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.520+0000 7ffbb4ff9700 1 -- 172.21.15.63:0/3721383511 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ffbac059ac0 con 0x7ffbb80fde00 2023-12-12T11:55:26.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.750+0000 7ffbbe907700 1 -- 172.21.15.63:0/3721383511 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffbb81115f0 con 0x7ffba006cf80 2023-12-12T11:55:26.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.751+0000 7ffbb4ff9700 1 -- 172.21.15.63:0/3721383511 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ffbb81115f0 con 0x7ffba006cf80 2023-12-12T11:55:26.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.754+0000 7ffbbe907700 1 -- 172.21.15.63:0/3721383511 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7ffba006cf80 msgr2=0x7ffba006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:26.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.754+0000 7ffbbe907700 1 --2- 172.21.15.63:0/3721383511 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7ffba006cf80 0x7ffba006f430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ffba8004f90 tx=0x7ffba8009e30 comp rx=0 tx=0).stop 2023-12-12T11:55:26.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.754+0000 7ffbbe907700 1 -- 172.21.15.63:0/3721383511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffbb80fde00 msgr2=0x7ffbb810fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:26.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.754+0000 7ffbbe907700 1 --2- 172.21.15.63:0/3721383511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffbb80fde00 0x7ffbb810fca0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffbac002a50 tx=0x7ffbac0046b0 comp rx=0 tx=0).stop 2023-12-12T11:55:26.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.754+0000 7ffbbe907700 1 -- 172.21.15.63:0/3721383511 shutdown_connections 2023-12-12T11:55:26.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.754+0000 7ffbbe907700 1 --2- 172.21.15.63:0/3721383511 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7ffba006cf80 0x7ffba006f430 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:26.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.754+0000 7ffbbe907700 1 --2- 172.21.15.63:0/3721383511 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbb80fcbf0 0x7ffbb810f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:26.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.754+0000 7ffbbe907700 1 --2- 172.21.15.63:0/3721383511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffbb80fde00 0x7ffbb810fca0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:26.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.754+0000 7ffbbe907700 1 -- 172.21.15.63:0/3721383511 >> 172.21.15.63:0/3721383511 conn(0x7ffbb80f82d0 msgr2=0x7ffbb80ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:55:26.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.754+0000 7ffbbe907700 1 -- 172.21.15.63:0/3721383511 shutdown_connections 2023-12-12T11:55:26.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.754+0000 7ffbbe907700 1 -- 172.21.15.63:0/3721383511 wait complete. 2023-12-12T11:55:26.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.893+0000 7f7536746700 1 -- 172.21.15.63:0/1200594261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75300fcbf0 msgr2=0x7f75300fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:26.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.893+0000 7f7536746700 1 --2- 172.21.15.63:0/1200594261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75300fcbf0 0x7f75300fd000 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7520004940 tx=0x7f7520009e30 comp rx=0 tx=0).stop 2023-12-12T11:55:26.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.894+0000 7f7536746700 1 -- 172.21.15.63:0/1200594261 shutdown_connections 2023-12-12T11:55:26.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.894+0000 7f7536746700 1 --2- 172.21.15.63:0/1200594261 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f75300fde00 0x7f75300fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:26.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.894+0000 7f7536746700 1 --2- 172.21.15.63:0/1200594261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75300fcbf0 0x7f75300fd000 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:26.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.894+0000 7f7536746700 1 -- 172.21.15.63:0/1200594261 >> 172.21.15.63:0/1200594261 conn(0x7f75300f82d0 msgr2=0x7f75300fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:55:26.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.894+0000 7f7536746700 1 -- 172.21.15.63:0/1200594261 shutdown_connections 2023-12-12T11:55:26.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.894+0000 7f7536746700 1 -- 172.21.15.63:0/1200594261 wait complete. 2023-12-12T11:55:26.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.894+0000 7f7536746700 1 Processor -- start 2023-12-12T11:55:26.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.895+0000 7f7536746700 1 -- start start 2023-12-12T11:55:26.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.895+0000 7f7536746700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f75300fcbf0 0x7f753010f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:55:26.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.895+0000 7f7536746700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75300fde00 0x7f753010fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:55:26.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.895+0000 7f7536746700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75301102e0 con 0x7f75300fde00 2023-12-12T11:55:26.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.895+0000 7f7536746700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7530110b80 con 0x7f75300fcbf0 2023-12-12T11:55:26.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.895+0000 7f752f7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75300fde00 0x7f753010fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:55:26.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.895+0000 7f752f7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75300fde00 0x7f753010fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36590/0 (socket says 172.21.15.63:36590) 2023-12-12T11:55:26.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.895+0000 7f752f7fe700 1 -- 172.21.15.63:0/4074210645 learned_addr learned my addr 172.21.15.63:0/4074210645 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:55:26.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.896+0000 7f752ffff700 1 --2- 172.21.15.63:0/4074210645 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f75300fcbf0 0x7f753010f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:55:26.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.896+0000 7f752f7fe700 1 -- 172.21.15.63:0/4074210645 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f75300fcbf0 msgr2=0x7f753010f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:26.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.896+0000 7f752f7fe700 1 --2- 172.21.15.63:0/4074210645 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f75300fcbf0 0x7f753010f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:26.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.896+0000 7f752f7fe700 1 -- 172.21.15.63:0/4074210645 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7520005040 con 0x7f75300fde00 2023-12-12T11:55:26.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.896+0000 7f752ffff700 1 --2- 172.21.15.63:0/4074210645 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f75300fcbf0 0x7f753010f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T11:55:26.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.896+0000 7f752f7fe700 1 --2- 172.21.15.63:0/4074210645 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75300fde00 0x7f753010fce0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7524002a50 tx=0x7f75240046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:55:26.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.896+0000 7f752cff9700 1 -- 172.21.15.63:0/4074210645 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7524007cc0 con 0x7f75300fde00 2023-12-12T11:55:26.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.896+0000 7f752cff9700 1 -- 172.21.15.63:0/4074210645 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f752400f040 con 0x7f75300fde00 2023-12-12T11:55:26.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.896+0000 7f7536746700 1 -- 172.21.15.63:0/4074210645 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7530110e60 con 0x7f75300fde00 2023-12-12T11:55:26.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.896+0000 7f752cff9700 1 -- 172.21.15.63:0/4074210645 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f752400da70 con 0x7f75300fde00 2023-12-12T11:55:26.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.896+0000 7f7536746700 1 -- 172.21.15.63:0/4074210645 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75301113a0 con 0x7f75300fde00 2023-12-12T11:55:26.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.897+0000 7f7536746700 1 -- 172.21.15.63:0/4074210645 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7530101ea0 con 0x7f75300fde00 2023-12-12T11:55:26.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.899+0000 7f752cff9700 1 -- 172.21.15.63:0/4074210645 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 35) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f752400dc10 con 0x7f75300fde00 2023-12-12T11:55:26.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.900+0000 7f752cff9700 1 --2- 172.21.15.63:0/4074210645 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f751806cf80 0x7f751806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:55:26.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.900+0000 7f752cff9700 1 -- 172.21.15.63:0/4074210645 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f752408bcb0 con 0x7f75300fde00 2023-12-12T11:55:26.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.900+0000 7f752ffff700 1 --2- 172.21.15.63:0/4074210645 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f751806cf80 0x7f751806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:55:26.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.901+0000 7f752ffff700 1 --2- 172.21.15.63:0/4074210645 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f751806cf80 0x7f751806f430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7520004f90 tx=0x7f7520009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:55:26.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:26.904+0000 7f752cff9700 1 -- 172.21.15.63:0/4074210645 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7524059380 con 0x7f75300fde00 2023-12-12T11:55:27.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:26 smithi063 ceph-mon[187282]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:55:27.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.125+0000 7f7536746700 1 -- 172.21.15.63:0/4074210645 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7530111680 con 0x7f751806cf80 2023-12-12T11:55:27.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.135+0000 7f752cff9700 1 -- 172.21.15.63:0/4074210645 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f7530111680 con 0x7f751806cf80 2023-12-12T11:55:27.138 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-12T11:55:27.138 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (3m) 7s ago 10m 15.5M - 0.25.0 c8568f914cd2 f237d9f64783 2023-12-12T11:55:27.138 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (35s) 7s ago 11m 7852k - 19.0.0-96-gf1fbf3c5 8cf689f388db 202fa7506e7c 2023-12-12T11:55:27.138 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi093 smithi093 running (30s) 28s ago 10m 7852k - 19.0.0-96-gf1fbf3c5 8cf689f388db ac9d76320ce6 2023-12-12T11:55:27.138 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (3m) 7s ago 10m 78.1M - 9.4.7 954c08fa6188 51300a1a5b87 2023-12-12T11:55:27.138 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.aevpzg smithi063 running (6m) 7s ago 6m 10.5G - 17.2.7-123-gbef78a51 ae6196193935 df9a6781f836 2023-12-12T11:55:27.138 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.bdqbnp smithi063 running (6m) 7s ago 6m 15.3M - 17.2.7-123-gbef78a51 ae6196193935 0c7e1d21eee9 2023-12-12T11:55:27.138 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.rhaqsh smithi093 running (6m) 28s ago 6m 15.0M - 17.2.7-123-gbef78a51 ae6196193935 257aee771d87 2023-12-12T11:55:27.138 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.swdqms smithi093 running (6m) 28s ago 6m 15.0M - 17.2.7-123-gbef78a51 ae6196193935 f46d7173d3b1 2023-12-12T11:55:27.138 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.zjnfdi smithi063 *:8443,9283,8765 running (2m) 7s ago 12m 511M - 19.0.0-96-gf1fbf3c5 8cf689f388db dab6fa4aaa54 2023-12-12T11:55:27.138 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi093.nbtltu smithi093 *:8443,9283,8765 running (2m) 28s ago 10m 450M - 19.0.0-96-gf1fbf3c5 8cf689f388db 701529e7fa8e 2023-12-12T11:55:27.138 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (92s) 7s ago 12m 52.9M 2048M 19.0.0-96-gf1fbf3c5 8cf689f388db 11f12a2e88e4 2023-12-12T11:55:27.139 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi093 smithi093 running (67s) 28s ago 9m 38.5M 2048M 19.0.0-96-gf1fbf3c5 8cf689f388db 1ffc49fcd680 2023-12-12T11:55:27.139 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (3m) 7s ago 11m 8560k - 1.5.0 0da6a335fe13 8eed63374ddf 2023-12-12T11:55:27.139 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi093 smithi093 *:9100 running (3m) 28s ago 10m 7898k - 1.5.0 0da6a335fe13 10e19431c1a2 2023-12-12T11:55:27.139 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (12s) 7s ago 9m 12.5M 1618M 19.0.0-96-gf1fbf3c5 8cf689f388db fade55811ec1 2023-12-12T11:55:27.139 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (9m) 7s ago 9m 1030M 1618M 17.2.7-123-gbef78a51 ae6196193935 5388a4bc6b12 2023-12-12T11:55:27.139 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (8m) 7s ago 8m 815M 1618M 17.2.7-123-gbef78a51 ae6196193935 9eb2483337c8 2023-12-12T11:55:27.139 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi093 running (8m) 28s ago 8m 1125M 2642M 17.2.7-123-gbef78a51 ae6196193935 5b2bb36b5843 2023-12-12T11:55:27.139 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi093 running (7m) 28s ago 7m 816M 2642M 17.2.7-123-gbef78a51 ae6196193935 7dc3f04b04cb 2023-12-12T11:55:27.139 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi093 running (7m) 28s ago 7m 955M 2642M 17.2.7-123-gbef78a51 ae6196193935 16fe8e4668f1 2023-12-12T11:55:27.139 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (2m) 7s ago 10m 46.7M - 2.43.0 a07b618ecd1d 834d9fc4eb61 2023-12-12T11:55:27.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.137+0000 7f7536746700 1 -- 172.21.15.63:0/4074210645 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f751806cf80 msgr2=0x7f751806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:27.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.137+0000 7f7536746700 1 --2- 172.21.15.63:0/4074210645 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f751806cf80 0x7f751806f430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7520004f90 tx=0x7f7520009e30 comp rx=0 tx=0).stop 2023-12-12T11:55:27.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.137+0000 7f7536746700 1 -- 172.21.15.63:0/4074210645 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75300fde00 msgr2=0x7f753010fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:27.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.137+0000 7f7536746700 1 --2- 172.21.15.63:0/4074210645 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75300fde00 0x7f753010fce0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7524002a50 tx=0x7f75240046b0 comp rx=0 tx=0).stop 2023-12-12T11:55:27.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.137+0000 7f7536746700 1 -- 172.21.15.63:0/4074210645 shutdown_connections 2023-12-12T11:55:27.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.138+0000 7f7536746700 1 --2- 172.21.15.63:0/4074210645 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f751806cf80 0x7f751806f430 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:27.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.138+0000 7f7536746700 1 --2- 172.21.15.63:0/4074210645 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f75300fcbf0 0x7f753010f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:27.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.138+0000 7f7536746700 1 --2- 172.21.15.63:0/4074210645 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75300fde00 0x7f753010fce0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:27.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.138+0000 7f7536746700 1 -- 172.21.15.63:0/4074210645 >> 172.21.15.63:0/4074210645 conn(0x7f75300f82d0 msgr2=0x7f75300ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:55:27.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.138+0000 7f7536746700 1 -- 172.21.15.63:0/4074210645 shutdown_connections 2023-12-12T11:55:27.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.138+0000 7f7536746700 1 -- 172.21.15.63:0/4074210645 wait complete. 2023-12-12T11:55:27.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:26 smithi093 ceph-mon[171709]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:55:27.278 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.275+0000 7fbf57263700 1 -- 172.21.15.63:0/2046292073 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf50071bc0 msgr2=0x7fbf50070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:27.278 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.275+0000 7fbf57263700 1 --2- 172.21.15.63:0/2046292073 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf50071bc0 0x7fbf50070030 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbf44004940 tx=0x7fbf44009e30 comp rx=0 tx=0).stop 2023-12-12T11:55:27.278 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.275+0000 7fbf57263700 1 -- 172.21.15.63:0/2046292073 shutdown_connections 2023-12-12T11:55:27.278 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.275+0000 7fbf57263700 1 --2- 172.21.15.63:0/2046292073 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf50070570 0x7fbf500709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:27.278 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.275+0000 7fbf57263700 1 --2- 172.21.15.63:0/2046292073 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf50071bc0 0x7fbf50070030 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:27.278 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.275+0000 7fbf57263700 1 -- 172.21.15.63:0/2046292073 >> 172.21.15.63:0/2046292073 conn(0x7fbf500f82d0 msgr2=0x7fbf500fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:55:27.278 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.275+0000 7fbf57263700 1 -- 172.21.15.63:0/2046292073 shutdown_connections 2023-12-12T11:55:27.278 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.275+0000 7fbf57263700 1 -- 172.21.15.63:0/2046292073 wait complete. 2023-12-12T11:55:27.280 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.276+0000 7fbf57263700 1 Processor -- start 2023-12-12T11:55:27.280 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.276+0000 7fbf57263700 1 -- start start 2023-12-12T11:55:27.280 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.276+0000 7fbf57263700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf50070570 0x7fbf5010f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:55:27.280 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.276+0000 7fbf57263700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf50071bc0 0x7fbf5010fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:55:27.280 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.276+0000 7fbf57263700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf50110420 con 0x7fbf50071bc0 2023-12-12T11:55:27.280 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.276+0000 7fbf57263700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf50110cc0 con 0x7fbf50070570 2023-12-12T11:55:27.280 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.277+0000 7fbf4ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf50071bc0 0x7fbf5010fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:55:27.280 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.277+0000 7fbf4ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf50071bc0 0x7fbf5010fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36600/0 (socket says 172.21.15.63:36600) 2023-12-12T11:55:27.280 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.277+0000 7fbf4ffff700 1 -- 172.21.15.63:0/1220316679 learned_addr learned my addr 172.21.15.63:0/1220316679 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:55:27.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.277+0000 7fbf54fff700 1 --2- 172.21.15.63:0/1220316679 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf50070570 0x7fbf5010f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:55:27.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.277+0000 7fbf4ffff700 1 -- 172.21.15.63:0/1220316679 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf50070570 msgr2=0x7fbf5010f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:27.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.277+0000 7fbf4ffff700 1 --2- 172.21.15.63:0/1220316679 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf50070570 0x7fbf5010f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:27.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.277+0000 7fbf4ffff700 1 -- 172.21.15.63:0/1220316679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf44005040 con 0x7fbf50071bc0 2023-12-12T11:55:27.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.277+0000 7fbf4ffff700 1 --2- 172.21.15.63:0/1220316679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf50071bc0 0x7fbf5010fe20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c002a50 tx=0x7fbf3c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:55:27.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.277+0000 7fbf4d7fa700 1 -- 172.21.15.63:0/1220316679 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf3c007cc0 con 0x7fbf50071bc0 2023-12-12T11:55:27.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.277+0000 7fbf4d7fa700 1 -- 172.21.15.63:0/1220316679 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbf3c00f040 con 0x7fbf50071bc0 2023-12-12T11:55:27.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.278+0000 7fbf57263700 1 -- 172.21.15.63:0/1220316679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf50110fa0 con 0x7fbf50071bc0 2023-12-12T11:55:27.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.278+0000 7fbf4d7fa700 1 -- 172.21.15.63:0/1220316679 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf3c009540 con 0x7fbf50071bc0 2023-12-12T11:55:27.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.278+0000 7fbf57263700 1 -- 172.21.15.63:0/1220316679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf501114e0 con 0x7fbf50071bc0 2023-12-12T11:55:27.282 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.279+0000 7fbf57263700 1 -- 172.21.15.63:0/1220316679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf501096f0 con 0x7fbf50071bc0 2023-12-12T11:55:27.282 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.280+0000 7fbf4d7fa700 1 -- 172.21.15.63:0/1220316679 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 35) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fbf3c0096a0 con 0x7fbf50071bc0 2023-12-12T11:55:27.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.281+0000 7fbf4d7fa700 1 --2- 172.21.15.63:0/1220316679 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fbf4006cf80 0x7fbf4006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:55:27.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.281+0000 7fbf4d7fa700 1 -- 172.21.15.63:0/1220316679 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fbf3c08c2c0 con 0x7fbf50071bc0 2023-12-12T11:55:27.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.281+0000 7fbf54fff700 1 --2- 172.21.15.63:0/1220316679 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fbf4006cf80 0x7fbf4006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:55:27.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.281+0000 7fbf54fff700 1 --2- 172.21.15.63:0/1220316679 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fbf4006cf80 0x7fbf4006f430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbf44004560 tx=0x7fbf44009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:55:27.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.285+0000 7fbf4d7fa700 1 -- 172.21.15.63:0/1220316679 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fbf3c059a30 con 0x7fbf50071bc0 2023-12-12T11:55:27.580 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.578+0000 7fbf57263700 1 -- 172.21.15.63:0/1220316679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbf50107860 con 0x7fbf50071bc0 2023-12-12T11:55:27.581 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.578+0000 7fbf4d7fa700 1 -- 172.21.15.63:0/1220316679 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7fbf3c0595c0 con 0x7fbf50071bc0 2023-12-12T11:55:27.581 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:55:27.581 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-12T11:55:27.581 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 2 2023-12-12T11:55:27.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:55:27.581 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-12T11:55:27.582 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 2 2023-12-12T11:55:27.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:55:27.582 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-12T11:55:27.582 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 5, 2023-12-12T11:55:27.582 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 1 2023-12-12T11:55:27.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:55:27.582 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-12T11:55:27.582 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 4 2023-12-12T11:55:27.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:55:27.582 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-12T11:55:27.582 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 9, 2023-12-12T11:55:27.582 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 5 2023-12-12T11:55:27.583 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-12T11:55:27.583 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:55:27.583 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.581+0000 7fbf57263700 1 -- 172.21.15.63:0/1220316679 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fbf4006cf80 msgr2=0x7fbf4006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:27.584 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.581+0000 7fbf57263700 1 --2- 172.21.15.63:0/1220316679 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fbf4006cf80 0x7fbf4006f430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbf44004560 tx=0x7fbf44009e30 comp rx=0 tx=0).stop 2023-12-12T11:55:27.584 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.581+0000 7fbf57263700 1 -- 172.21.15.63:0/1220316679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf50071bc0 msgr2=0x7fbf5010fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:27.584 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.581+0000 7fbf57263700 1 --2- 172.21.15.63:0/1220316679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf50071bc0 0x7fbf5010fe20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c002a50 tx=0x7fbf3c0046b0 comp rx=0 tx=0).stop 2023-12-12T11:55:27.584 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.581+0000 7fbf57263700 1 -- 172.21.15.63:0/1220316679 shutdown_connections 2023-12-12T11:55:27.584 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.581+0000 7fbf57263700 1 --2- 172.21.15.63:0/1220316679 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fbf4006cf80 0x7fbf4006f430 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:27.584 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.581+0000 7fbf57263700 1 --2- 172.21.15.63:0/1220316679 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf50070570 0x7fbf5010f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:27.584 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.581+0000 7fbf57263700 1 --2- 172.21.15.63:0/1220316679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbf50071bc0 0x7fbf5010fe20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:27.584 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.581+0000 7fbf57263700 1 -- 172.21.15.63:0/1220316679 >> 172.21.15.63:0/1220316679 conn(0x7fbf500f82d0 msgr2=0x7fbf50103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:55:27.584 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.581+0000 7fbf57263700 1 -- 172.21.15.63:0/1220316679 shutdown_connections 2023-12-12T11:55:27.584 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.581+0000 7fbf57263700 1 -- 172.21.15.63:0/1220316679 wait complete. 2023-12-12T11:55:27.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.720+0000 7f3403c44700 1 -- 172.21.15.63:0/2728012063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33fc0fde00 msgr2=0x7f33fc0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:27.723 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.720+0000 7f3403c44700 1 --2- 172.21.15.63:0/2728012063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33fc0fde00 0x7f33fc0fe250 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f33ec004940 tx=0x7f33ec009e30 comp rx=0 tx=0).stop 2023-12-12T11:55:27.723 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.720+0000 7f3403c44700 1 -- 172.21.15.63:0/2728012063 shutdown_connections 2023-12-12T11:55:27.723 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.720+0000 7f3403c44700 1 --2- 172.21.15.63:0/2728012063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33fc0fde00 0x7f33fc0fe250 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:27.723 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.720+0000 7f3403c44700 1 --2- 172.21.15.63:0/2728012063 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f33fc0fcbf0 0x7f33fc0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:27.723 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.720+0000 7f3403c44700 1 -- 172.21.15.63:0/2728012063 >> 172.21.15.63:0/2728012063 conn(0x7f33fc0f82d0 msgr2=0x7f33fc0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:55:27.723 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.720+0000 7f3403c44700 1 -- 172.21.15.63:0/2728012063 shutdown_connections 2023-12-12T11:55:27.723 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.720+0000 7f3403c44700 1 -- 172.21.15.63:0/2728012063 wait complete. 2023-12-12T11:55:27.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.721+0000 7f3403c44700 1 Processor -- start 2023-12-12T11:55:27.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.721+0000 7f3403c44700 1 -- start start 2023-12-12T11:55:27.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.721+0000 7f3403c44700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f33fc0fcbf0 0x7f33fc071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:55:27.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.721+0000 7f3403c44700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33fc0fde00 0x7f33fc06ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:55:27.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.721+0000 7f3403c44700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc070590 con 0x7f33fc0fde00 2023-12-12T11:55:27.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.721+0000 7f3403c44700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc070700 con 0x7f33fc0fcbf0 2023-12-12T11:55:27.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.722+0000 7f34011df700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33fc0fde00 0x7f33fc06ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:55:27.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.722+0000 7f34011df700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33fc0fde00 0x7f33fc06ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36626/0 (socket says 172.21.15.63:36626) 2023-12-12T11:55:27.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.722+0000 7f34011df700 1 -- 172.21.15.63:0/3753347057 learned_addr learned my addr 172.21.15.63:0/3753347057 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:55:27.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.722+0000 7f34019e0700 1 --2- 172.21.15.63:0/3753347057 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f33fc0fcbf0 0x7f33fc071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:55:27.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.722+0000 7f34011df700 1 -- 172.21.15.63:0/3753347057 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f33fc0fcbf0 msgr2=0x7f33fc071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:27.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.722+0000 7f34011df700 1 --2- 172.21.15.63:0/3753347057 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f33fc0fcbf0 0x7f33fc071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:27.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.722+0000 7f34011df700 1 -- 172.21.15.63:0/3753347057 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec005040 con 0x7f33fc0fde00 2023-12-12T11:55:27.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.722+0000 7f34011df700 1 --2- 172.21.15.63:0/3753347057 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33fc0fde00 0x7f33fc06ff90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f33ec000c00 tx=0x7f33ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:55:27.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.722+0000 7f33f27fc700 1 -- 172.21.15.63:0/3753347057 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33ec021070 con 0x7f33fc0fde00 2023-12-12T11:55:27.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.722+0000 7f33f27fc700 1 -- 172.21.15.63:0/3753347057 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f33ec01c400 con 0x7f33fc0fde00 2023-12-12T11:55:27.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.722+0000 7f3403c44700 1 -- 172.21.15.63:0/3753347057 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33fc070980 con 0x7f33fc0fde00 2023-12-12T11:55:27.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.723+0000 7f33f27fc700 1 -- 172.21.15.63:0/3753347057 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33ec00e070 con 0x7f33fc0fde00 2023-12-12T11:55:27.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.723+0000 7f3403c44700 1 -- 172.21.15.63:0/3753347057 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33fc115520 con 0x7f33fc0fde00 2023-12-12T11:55:27.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.724+0000 7f3403c44700 1 -- 172.21.15.63:0/3753347057 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33fc04bb80 con 0x7f33fc0fde00 2023-12-12T11:55:27.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.725+0000 7f33f27fc700 1 -- 172.21.15.63:0/3753347057 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 35) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f33ec01c9c0 con 0x7f33fc0fde00 2023-12-12T11:55:27.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.725+0000 7f33f27fc700 1 --2- 172.21.15.63:0/3753347057 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f33e806cf80 0x7f33e806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:55:27.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.726+0000 7f33f27fc700 1 -- 172.21.15.63:0/3753347057 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f33ec08d8a0 con 0x7f33fc0fde00 2023-12-12T11:55:27.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.726+0000 7f34019e0700 1 --2- 172.21.15.63:0/3753347057 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f33e806cf80 0x7f33e806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:55:27.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.726+0000 7f34019e0700 1 --2- 172.21.15.63:0/3753347057 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f33e806cf80 0x7f33e806f430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f33fc0718a0 tx=0x7f33f800b040 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:55:27.732 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.730+0000 7f33f27fc700 1 -- 172.21.15.63:0/3753347057 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f33ec05af70 con 0x7f33fc0fde00 2023-12-12T11:55:27.987 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.985+0000 7f3403c44700 1 -- 172.21.15.63:0/3753347057 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f33fc115790 con 0x7f33fc0fde00 2023-12-12T11:55:27.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.985+0000 7f33f27fc700 1 -- 172.21.15.63:0/3753347057 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1845 (secure 0 0 0) 0x7f33ec05ab00 con 0x7f33fc0fde00 2023-12-12T11:55:27.988 INFO:teuthology.orchestra.run.smithi063.stdout:e13 2023-12-12T11:55:27.988 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-12T11:55:27.988 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:55:27.989 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-12T11:55:27.989 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:55:27.989 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-12T11:55:27.989 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-12T11:55:27.989 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 13 2023-12-12T11:55:27.989 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-12T11:55:27.989 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-12T11:48:58.523481+0000 2023-12-12T11:55:27.989 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-12T11:49:14.113993+0000 2023-12-12T11:55:27.990 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-12T11:55:27.990 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-12T11:55:27.990 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-12T11:55:27.990 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-12T11:55:27.990 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-12T11:55:27.990 INFO:teuthology.orchestra.run.smithi063.stdout:max_xattr_size 65536 2023-12-12T11:55:27.990 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-12T11:55:27.991 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-12T11:55:27.991 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 46 2023-12-12T11:55:27.991 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:55:27.991 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 1 2023-12-12T11:55:27.991 INFO:teuthology.orchestra.run.smithi063.stdout:in 0 2023-12-12T11:55:27.991 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=14492} 2023-12-12T11:55:27.992 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-12T11:55:27.992 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-12T11:55:27.992 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-12T11:55:27.992 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-12T11:55:27.992 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-12T11:55:27.992 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data enabled 2023-12-12T11:55:27.993 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-12T11:55:27.993 INFO:teuthology.orchestra.run.smithi063.stdout:bal_rank_mask -1 2023-12-12T11:55:27.993 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 1 2023-12-12T11:55:27.993 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.aevpzg{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.63:6828/3709000039,v1:172.21.15.63:6829/3709000039] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:55:27.993 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:55:27.993 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:55:27.993 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2023-12-12T11:55:27.994 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:55:27.994 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.swdqms{-1:14500} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.93:6826/3307558569,v1:172.21.15.93:6827/3307558569] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:55:27.994 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.bdqbnp{-1:14508} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/2191270944,v1:172.21.15.63:6827/2191270944] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:55:27.994 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.rhaqsh{-1:24317} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.93:6824/3161864019,v1:172.21.15.93:6825/3161864019] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:55:27.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.987+0000 7f3403c44700 1 -- 172.21.15.63:0/3753347057 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f33e806cf80 msgr2=0x7f33e806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:27.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.987+0000 7f3403c44700 1 --2- 172.21.15.63:0/3753347057 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f33e806cf80 0x7f33e806f430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f33fc0718a0 tx=0x7f33f800b040 comp rx=0 tx=0).stop 2023-12-12T11:55:27.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.987+0000 7f3403c44700 1 -- 172.21.15.63:0/3753347057 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33fc0fde00 msgr2=0x7f33fc06ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:27.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.987+0000 7f3403c44700 1 --2- 172.21.15.63:0/3753347057 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33fc0fde00 0x7f33fc06ff90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f33ec000c00 tx=0x7f33ec009e30 comp rx=0 tx=0).stop 2023-12-12T11:55:27.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.987+0000 7f3403c44700 1 -- 172.21.15.63:0/3753347057 shutdown_connections 2023-12-12T11:55:27.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.987+0000 7f3403c44700 1 --2- 172.21.15.63:0/3753347057 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f33e806cf80 0x7f33e806f430 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:27.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.987+0000 7f3403c44700 1 --2- 172.21.15.63:0/3753347057 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f33fc0fcbf0 0x7f33fc071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:27.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.987+0000 7f3403c44700 1 --2- 172.21.15.63:0/3753347057 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33fc0fde00 0x7f33fc06ff90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:27.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.987+0000 7f3403c44700 1 -- 172.21.15.63:0/3753347057 >> 172.21.15.63:0/3753347057 conn(0x7f33fc0f82d0 msgr2=0x7f33fc101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:55:27.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.988+0000 7f3403c44700 1 -- 172.21.15.63:0/3753347057 shutdown_connections 2023-12-12T11:55:27.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:27.988+0000 7f3403c44700 1 -- 172.21.15.63:0/3753347057 wait complete. 2023-12-12T11:55:27.997 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 13 2023-12-12T11:55:28.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:27 smithi063 ceph-mon[187282]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:55:28.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:27 smithi063 ceph-mon[187282]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:55:28.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:27 smithi063 ceph-mon[187282]: pgmap v49: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:28.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:27 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/1220316679' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:55:28.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.126+0000 7efd15812700 1 -- 172.21.15.63:0/1926048891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd100fde00 msgr2=0x7efd100fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:28.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.126+0000 7efd15812700 1 --2- 172.21.15.63:0/1926048891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd100fde00 0x7efd100fe250 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efd04004940 tx=0x7efd04009e30 comp rx=0 tx=0).stop 2023-12-12T11:55:28.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.126+0000 7efd15812700 1 -- 172.21.15.63:0/1926048891 shutdown_connections 2023-12-12T11:55:28.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.126+0000 7efd15812700 1 --2- 172.21.15.63:0/1926048891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd100fde00 0x7efd100fe250 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:28.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.126+0000 7efd15812700 1 --2- 172.21.15.63:0/1926048891 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd100fcbf0 0x7efd100fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:28.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.126+0000 7efd15812700 1 -- 172.21.15.63:0/1926048891 >> 172.21.15.63:0/1926048891 conn(0x7efd100f82d0 msgr2=0x7efd100fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:55:28.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.126+0000 7efd15812700 1 -- 172.21.15.63:0/1926048891 shutdown_connections 2023-12-12T11:55:28.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.126+0000 7efd15812700 1 -- 172.21.15.63:0/1926048891 wait complete. 2023-12-12T11:55:28.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.128+0000 7efd15812700 1 Processor -- start 2023-12-12T11:55:28.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.128+0000 7efd15812700 1 -- start start 2023-12-12T11:55:28.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.128+0000 7efd15812700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd100fcbf0 0x7efd10071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:55:28.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.128+0000 7efd15812700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd100fde00 0x7efd1006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:55:28.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.128+0000 7efd15812700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd10070590 con 0x7efd100fcbf0 2023-12-12T11:55:28.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.128+0000 7efd15812700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd10070700 con 0x7efd100fde00 2023-12-12T11:55:28.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.129+0000 7efd0effd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd100fcbf0 0x7efd10071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:55:28.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.129+0000 7efd0effd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd100fcbf0 0x7efd10071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43200/0 (socket says 172.21.15.63:43200) 2023-12-12T11:55:28.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.129+0000 7efd0effd700 1 -- 172.21.15.63:0/3298068645 learned_addr learned my addr 172.21.15.63:0/3298068645 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:55:28.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.129+0000 7efd0e7fc700 1 --2- 172.21.15.63:0/3298068645 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd100fde00 0x7efd1006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:55:28.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.129+0000 7efd0effd700 1 -- 172.21.15.63:0/3298068645 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd100fde00 msgr2=0x7efd1006ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:28.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.129+0000 7efd0effd700 1 --2- 172.21.15.63:0/3298068645 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd100fde00 0x7efd1006ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:28.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.129+0000 7efd0effd700 1 -- 172.21.15.63:0/3298068645 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd04005040 con 0x7efd100fcbf0 2023-12-12T11:55:28.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.129+0000 7efd0effd700 1 --2- 172.21.15.63:0/3298068645 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd100fcbf0 0x7efd10071b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efd00002a80 tx=0x7efd00004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:55:28.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.130+0000 7efcf77fe700 1 -- 172.21.15.63:0/3298068645 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd00007cc0 con 0x7efd100fcbf0 2023-12-12T11:55:28.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.130+0000 7efcf77fe700 1 -- 172.21.15.63:0/3298068645 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efd0000f040 con 0x7efd100fcbf0 2023-12-12T11:55:28.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.130+0000 7efd15812700 1 -- 172.21.15.63:0/3298068645 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd100709e0 con 0x7efd100fcbf0 2023-12-12T11:55:28.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.130+0000 7efcf77fe700 1 -- 172.21.15.63:0/3298068645 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd0000d9c0 con 0x7efd100fcbf0 2023-12-12T11:55:28.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.130+0000 7efd15812700 1 -- 172.21.15.63:0/3298068645 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd101155b0 con 0x7efd100fcbf0 2023-12-12T11:55:28.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.131+0000 7efd15812700 1 -- 172.21.15.63:0/3298068645 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd1004bb80 con 0x7efd100fcbf0 2023-12-12T11:55:28.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.132+0000 7efcf77fe700 1 -- 172.21.15.63:0/3298068645 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 35) v1 ==== 91038+0+0 (secure 0 0 0) 0x7efd0000db20 con 0x7efd100fcbf0 2023-12-12T11:55:28.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.133+0000 7efcf77fe700 1 --2- 172.21.15.63:0/3298068645 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7efcf806cf80 0x7efcf806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:55:28.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.133+0000 7efcf77fe700 1 -- 172.21.15.63:0/3298068645 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6500+0+0 (secure 0 0 0) 0x7efd0008c090 con 0x7efd100fcbf0 2023-12-12T11:55:28.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.133+0000 7efd0e7fc700 1 --2- 172.21.15.63:0/3298068645 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7efcf806cf80 0x7efcf806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:55:28.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.134+0000 7efd0e7fc700 1 --2- 172.21.15.63:0/3298068645 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7efcf806cf80 0x7efcf806f430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efd040043d0 tx=0x7efd04009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:55:28.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.137+0000 7efcf77fe700 1 -- 172.21.15.63:0/3298068645 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7efd00059780 con 0x7efd100fcbf0 2023-12-12T11:55:28.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:27 smithi093 ceph-mon[171709]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:55:28.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:27 smithi093 ceph-mon[171709]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:55:28.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:27 smithi093 ceph-mon[171709]: pgmap v49: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:28.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:27 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/1220316679' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:55:28.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.367+0000 7efd15812700 1 -- 172.21.15.63:0/3298068645 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efd10102770 con 0x7efcf806cf80 2023-12-12T11:55:28.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.368+0000 7efcf77fe700 1 -- 172.21.15.63:0/3298068645 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7efd10102770 con 0x7efcf806cf80 2023-12-12T11:55:28.371 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:55:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dbb46fd2dbbe029cfba763f2b7c769e980f86b63e74be0c72e188909e20b81f3", 2023-12-12T11:55:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "in_progress": true, 2023-12-12T11:55:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-12T11:55:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "services_complete": [ 2023-12-12T11:55:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "mon", 2023-12-12T11:55:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr", 2023-12-12T11:55:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "crash" 2023-12-12T11:55:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2023-12-12T11:55:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "progress": "7/21 daemons upgraded", 2023-12-12T11:55:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "Currently upgrading osd daemons", 2023-12-12T11:55:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "is_paused": false 2023-12-12T11:55:28.371 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:55:28.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.370+0000 7efd15812700 1 -- 172.21.15.63:0/3298068645 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7efcf806cf80 msgr2=0x7efcf806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:28.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.370+0000 7efd15812700 1 --2- 172.21.15.63:0/3298068645 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7efcf806cf80 0x7efcf806f430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efd040043d0 tx=0x7efd04009e30 comp rx=0 tx=0).stop 2023-12-12T11:55:28.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.370+0000 7efd15812700 1 -- 172.21.15.63:0/3298068645 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd100fcbf0 msgr2=0x7efd10071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:28.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.370+0000 7efd15812700 1 --2- 172.21.15.63:0/3298068645 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd100fcbf0 0x7efd10071b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efd00002a80 tx=0x7efd00004600 comp rx=0 tx=0).stop 2023-12-12T11:55:28.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.370+0000 7efd15812700 1 -- 172.21.15.63:0/3298068645 shutdown_connections 2023-12-12T11:55:28.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.370+0000 7efd15812700 1 --2- 172.21.15.63:0/3298068645 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7efcf806cf80 0x7efcf806f430 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:28.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.370+0000 7efd15812700 1 --2- 172.21.15.63:0/3298068645 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd100fcbf0 0x7efd10071b10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:28.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.370+0000 7efd15812700 1 --2- 172.21.15.63:0/3298068645 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd100fde00 0x7efd1006ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:28.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.370+0000 7efd15812700 1 -- 172.21.15.63:0/3298068645 >> 172.21.15.63:0/3298068645 conn(0x7efd100f82d0 msgr2=0x7efd10101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:55:28.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.370+0000 7efd15812700 1 -- 172.21.15.63:0/3298068645 shutdown_connections 2023-12-12T11:55:28.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.371+0000 7efd15812700 1 -- 172.21.15.63:0/3298068645 wait complete. 2023-12-12T11:55:28.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.508+0000 7f251cabb700 1 -- 172.21.15.63:0/1348059026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25180fde00 msgr2=0x7f25180fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:28.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.508+0000 7f251cabb700 1 --2- 172.21.15.63:0/1348059026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25180fde00 0x7f25180fe250 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f250c004940 tx=0x7f250c009e30 comp rx=0 tx=0).stop 2023-12-12T11:55:28.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.508+0000 7f251cabb700 1 -- 172.21.15.63:0/1348059026 shutdown_connections 2023-12-12T11:55:28.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.508+0000 7f251cabb700 1 --2- 172.21.15.63:0/1348059026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25180fde00 0x7f25180fe250 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:28.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.508+0000 7f251cabb700 1 --2- 172.21.15.63:0/1348059026 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25180fcbf0 0x7f25180fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:28.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.508+0000 7f251cabb700 1 -- 172.21.15.63:0/1348059026 >> 172.21.15.63:0/1348059026 conn(0x7f25180f82d0 msgr2=0x7f25180fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:55:28.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.508+0000 7f251cabb700 1 -- 172.21.15.63:0/1348059026 shutdown_connections 2023-12-12T11:55:28.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.509+0000 7f251cabb700 1 -- 172.21.15.63:0/1348059026 wait complete. 2023-12-12T11:55:28.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.509+0000 7f251cabb700 1 Processor -- start 2023-12-12T11:55:28.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.509+0000 7f251cabb700 1 -- start start 2023-12-12T11:55:28.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.510+0000 7f251cabb700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25180fcbf0 0x7f251810d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:55:28.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.510+0000 7f251cabb700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25180fde00 0x7f251810dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:55:28.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.510+0000 7f251cabb700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251810e0c0 con 0x7f25180fcbf0 2023-12-12T11:55:28.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.510+0000 7f251cabb700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251810e960 con 0x7f25180fde00 2023-12-12T11:55:28.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.510+0000 7f251659c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25180fcbf0 0x7f251810d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:55:28.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.510+0000 7f251659c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25180fcbf0 0x7f251810d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43216/0 (socket says 172.21.15.63:43216) 2023-12-12T11:55:28.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.510+0000 7f251659c700 1 -- 172.21.15.63:0/2983746898 learned_addr learned my addr 172.21.15.63:0/2983746898 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:55:28.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.510+0000 7f2515d9b700 1 --2- 172.21.15.63:0/2983746898 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25180fde00 0x7f251810dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:55:28.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.510+0000 7f251659c700 1 -- 172.21.15.63:0/2983746898 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25180fde00 msgr2=0x7f251810dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:28.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.510+0000 7f251659c700 1 --2- 172.21.15.63:0/2983746898 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25180fde00 0x7f251810dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:28.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.510+0000 7f251659c700 1 -- 172.21.15.63:0/2983746898 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250c005040 con 0x7f25180fcbf0 2023-12-12T11:55:28.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.511+0000 7f251659c700 1 --2- 172.21.15.63:0/2983746898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25180fcbf0 0x7f251810d580 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2508002a80 tx=0x7f2508004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:55:28.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.511+0000 7f2506ffd700 1 -- 172.21.15.63:0/2983746898 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2508007cc0 con 0x7f25180fcbf0 2023-12-12T11:55:28.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.511+0000 7f2506ffd700 1 -- 172.21.15.63:0/2983746898 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f250800f040 con 0x7f25180fcbf0 2023-12-12T11:55:28.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.511+0000 7f2506ffd700 1 -- 172.21.15.63:0/2983746898 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f250800d9c0 con 0x7f25180fcbf0 2023-12-12T11:55:28.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.511+0000 7f251cabb700 1 -- 172.21.15.63:0/2983746898 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f251810ec40 con 0x7f25180fcbf0 2023-12-12T11:55:28.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.511+0000 7f251cabb700 1 -- 172.21.15.63:0/2983746898 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f251810f180 con 0x7f25180fcbf0 2023-12-12T11:55:28.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.512+0000 7f251cabb700 1 -- 172.21.15.63:0/2983746898 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f251804bb80 con 0x7f25180fcbf0 2023-12-12T11:55:28.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.513+0000 7f2506ffd700 1 -- 172.21.15.63:0/2983746898 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 35) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f250800db20 con 0x7f25180fcbf0 2023-12-12T11:55:28.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.514+0000 7f2506ffd700 1 --2- 172.21.15.63:0/2983746898 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f250006cf80 0x7f250006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:55:28.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.514+0000 7f2506ffd700 1 -- 172.21.15.63:0/2983746898 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f250808c200 con 0x7f25180fcbf0 2023-12-12T11:55:28.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.514+0000 7f2515d9b700 1 --2- 172.21.15.63:0/2983746898 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f250006cf80 0x7f250006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:55:28.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.515+0000 7f2515d9b700 1 --2- 172.21.15.63:0/2983746898 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f250006cf80 0x7f250006f430 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f250c0043d0 tx=0x7f250c009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:55:28.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.518+0000 7f2506ffd700 1 -- 172.21.15.63:0/2983746898 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f2508059970 con 0x7f25180fcbf0 2023-12-12T11:55:28.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.812+0000 7f251cabb700 1 -- 172.21.15.63:0/2983746898 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f251810f510 con 0x7f25180fcbf0 2023-12-12T11:55:28.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.813+0000 7f2506ffd700 1 -- 172.21.15.63:0/2983746898 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f2508059500 con 0x7f25180fcbf0 2023-12-12T11:55:28.815 INFO:teuthology.orchestra.run.smithi063.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-12T11:55:28.815 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-12T11:55:28.816 INFO:teuthology.orchestra.run.smithi063.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-12T11:55:28.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.815+0000 7f251cabb700 1 -- 172.21.15.63:0/2983746898 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f250006cf80 msgr2=0x7f250006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:28.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.815+0000 7f251cabb700 1 --2- 172.21.15.63:0/2983746898 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f250006cf80 0x7f250006f430 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f250c0043d0 tx=0x7f250c009e30 comp rx=0 tx=0).stop 2023-12-12T11:55:28.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.815+0000 7f251cabb700 1 -- 172.21.15.63:0/2983746898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25180fcbf0 msgr2=0x7f251810d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:28.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.815+0000 7f251cabb700 1 --2- 172.21.15.63:0/2983746898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25180fcbf0 0x7f251810d580 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2508002a80 tx=0x7f2508004600 comp rx=0 tx=0).stop 2023-12-12T11:55:28.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.815+0000 7f251cabb700 1 -- 172.21.15.63:0/2983746898 shutdown_connections 2023-12-12T11:55:28.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.815+0000 7f251cabb700 1 --2- 172.21.15.63:0/2983746898 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f250006cf80 0x7f250006f430 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:28.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.815+0000 7f251cabb700 1 --2- 172.21.15.63:0/2983746898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25180fcbf0 0x7f251810d580 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:28.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.815+0000 7f251cabb700 1 --2- 172.21.15.63:0/2983746898 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25180fde00 0x7f251810dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:28.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.815+0000 7f251cabb700 1 -- 172.21.15.63:0/2983746898 >> 172.21.15.63:0/2983746898 conn(0x7f25180f82d0 msgr2=0x7f2518101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:55:28.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.815+0000 7f251cabb700 1 -- 172.21.15.63:0/2983746898 shutdown_connections 2023-12-12T11:55:28.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:28.815+0000 7f251cabb700 1 -- 172.21.15.63:0/2983746898 wait complete. 2023-12-12T11:55:29.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:28 smithi063 ceph-mon[187282]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 44/219 objects degraded (20.091%), 17 pgs degraded) 2023-12-12T11:55:29.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:28 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/3753347057' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:55:29.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:28 smithi063 ceph-mon[187282]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:55:29.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:28 smithi093 ceph-mon[171709]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 44/219 objects degraded (20.091%), 17 pgs degraded) 2023-12-12T11:55:29.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:28 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/3753347057' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:55:29.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:28 smithi093 ceph-mon[171709]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:55:30.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:29 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/2983746898' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:55:30.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:29 smithi063 ceph-mon[187282]: pgmap v50: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:30.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:29 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/2983746898' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:55:30.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:29 smithi093 ceph-mon[171709]: pgmap v50: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:31.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:31 smithi093 ceph-mon[171709]: pgmap v51: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:31.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:31 smithi063 ceph-mon[187282]: pgmap v51: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:33.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:33 smithi093 ceph-mon[171709]: pgmap v52: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:33.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:33 smithi063 ceph-mon[187282]: pgmap v52: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:36.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:35 smithi063 ceph-mon[187282]: pgmap v53: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:36.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:35 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:36.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:35 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:55:36.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:35 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:36.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:35 smithi093 ceph-mon[171709]: pgmap v53: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:36.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:35 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:36.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:35 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:55:36.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:35 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:37.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:37 smithi093 ceph-mon[171709]: pgmap v54: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-12T11:55:37.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:37 smithi093 ceph-mon[171709]: mgrmap e36: smithi063.zjnfdi(active, since 92s), standbys: smithi093.nbtltu 2023-12-12T11:55:37.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:37 smithi063 ceph-mon[187282]: pgmap v54: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-12T11:55:37.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:37 smithi063 ceph-mon[187282]: mgrmap e36: smithi063.zjnfdi(active, since 92s), standbys: smithi093.nbtltu 2023-12-12T11:55:39.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:39 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-12T11:55:39.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:39 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-12T11:55:40.197 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:40 smithi063 ceph-mon[187282]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-12T11:55:40.197 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:40 smithi063 ceph-mon[187282]: Upgrade: osd.1 is safe to restart 2023-12-12T11:55:40.197 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:40 smithi063 ceph-mon[187282]: pgmap v55: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-12T11:55:40.473 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:40 smithi093 ceph-mon[171709]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-12T11:55:40.474 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:40 smithi093 ceph-mon[171709]: Upgrade: osd.1 is safe to restart 2023-12-12T11:55:40.474 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:40 smithi093 ceph-mon[171709]: pgmap v55: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-12T11:55:41.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:41 smithi063 ceph-mon[187282]: Upgrade: Updating osd.1 2023-12-12T11:55:41.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:41 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:41.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:41 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-12T11:55:41.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:41 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:55:41.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:41 smithi063 ceph-mon[187282]: Deploying daemon osd.1 on smithi063 2023-12-12T11:55:41.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:41 smithi093 ceph-mon[171709]: Upgrade: Updating osd.1 2023-12-12T11:55:41.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:41 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:41.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:41 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-12T11:55:41.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:41 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:55:41.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:41 smithi093 ceph-mon[171709]: Deploying daemon osd.1 on smithi063 2023-12-12T11:55:42.450 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:42 smithi063 ceph-mon[187282]: pgmap v56: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-12T11:55:42.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:42 smithi093 ceph-mon[171709]: pgmap v56: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-12T11:55:43.045 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:55:43 smithi063 systemd[1]: Stopping Ceph osd.1 for 85e33c70-98e3-11ee-95a3-87774f69a715... 2023-12-12T11:55:43.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:43 smithi063 ceph-mon[187282]: osd.1 marked itself down and dead 2023-12-12T11:55:43.545 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:55:43 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-1[139948]: 2023-12-12T11:55:43.272+0000 7fc24708d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-12T11:55:43.545 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:55:43 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-1[139948]: 2023-12-12T11:55:43.272+0000 7fc24708d700 -1 osd.1 54 *** Got signal Terminated *** 2023-12-12T11:55:43.545 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:55:43 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-1[139948]: 2023-12-12T11:55:43.272+0000 7fc24708d700 -1 osd.1 54 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-12T11:55:43.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:43 smithi093 ceph-mon[171709]: osd.1 marked itself down and dead 2023-12-12T11:55:44.295 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:55:44 smithi063 bash[203427]: ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-1 2023-12-12T11:55:44.714 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:44 smithi063 ceph-mon[187282]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-12T11:55:44.715 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:44 smithi063 ceph-mon[187282]: osdmap e55: 6 total, 5 up, 6 in 2023-12-12T11:55:44.715 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:44 smithi063 ceph-mon[187282]: failed to encode map e55 with expected crc 2023-12-12T11:55:44.715 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:44 smithi063 ceph-mon[187282]: failed to encode map e55 with expected crc 2023-12-12T11:55:44.715 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:44 smithi063 ceph-mon[187282]: failed to encode map e55 with expected crc 2023-12-12T11:55:44.715 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:44 smithi063 ceph-mon[187282]: failed to encode map e55 with expected crc 2023-12-12T11:55:44.715 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:44 smithi063 ceph-mon[187282]: pgmap v58: 65 pgs: 12 stale+active+clean, 53 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 307 B/s wr, 0 op/s 2023-12-12T11:55:44.715 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:44 smithi063 ceph-mon[187282]: osdmap e56: 6 total, 5 up, 6 in 2023-12-12T11:55:44.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:44 smithi093 ceph-mon[171709]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-12T11:55:44.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:44 smithi093 ceph-mon[171709]: osdmap e55: 6 total, 5 up, 6 in 2023-12-12T11:55:44.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:44 smithi093 ceph-mon[171709]: failed to encode map e55 with expected crc 2023-12-12T11:55:44.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:44 smithi093 ceph-mon[171709]: failed to encode map e55 with expected crc 2023-12-12T11:55:44.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:44 smithi093 ceph-mon[171709]: failed to encode map e55 with expected crc 2023-12-12T11:55:44.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:44 smithi093 ceph-mon[171709]: failed to encode map e55 with expected crc 2023-12-12T11:55:44.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:44 smithi093 ceph-mon[171709]: pgmap v58: 65 pgs: 12 stale+active+clean, 53 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 307 B/s wr, 0 op/s 2023-12-12T11:55:44.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:44 smithi093 ceph-mon[171709]: osdmap e56: 6 total, 5 up, 6 in 2023-12-12T11:55:45.519 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:45 smithi063 ceph-mon[187282]: failed to encode map e56 with expected crc 2023-12-12T11:55:45.519 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:45 smithi063 ceph-mon[187282]: failed to encode map e56 with expected crc 2023-12-12T11:55:45.520 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:45 smithi063 ceph-mon[187282]: failed to encode map e56 with expected crc 2023-12-12T11:55:45.520 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:45 smithi063 ceph-mon[187282]: failed to encode map e56 with expected crc 2023-12-12T11:55:45.520 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:45 smithi063 ceph-mon[187282]: failed to encode map e56 with expected crc 2023-12-12T11:55:45.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:45 smithi093 ceph-mon[171709]: failed to encode map e56 with expected crc 2023-12-12T11:55:45.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:45 smithi093 ceph-mon[171709]: failed to encode map e56 with expected crc 2023-12-12T11:55:45.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:45 smithi093 ceph-mon[171709]: failed to encode map e56 with expected crc 2023-12-12T11:55:45.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:45 smithi093 ceph-mon[171709]: failed to encode map e56 with expected crc 2023-12-12T11:55:45.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:45 smithi093 ceph-mon[171709]: failed to encode map e56 with expected crc 2023-12-12T11:55:45.795 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:55:45 smithi063 systemd[1]: ceph-85e33c70-98e3-11ee-95a3-87774f69a715@osd.1.service: Succeeded. 2023-12-12T11:55:45.795 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:55:45 smithi063 systemd[1]: Stopped Ceph osd.1 for 85e33c70-98e3-11ee-95a3-87774f69a715. 2023-12-12T11:55:46.230 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:55:45 smithi063 systemd[1]: Starting Ceph osd.1 for 85e33c70-98e3-11ee-95a3-87774f69a715... 2023-12-12T11:55:46.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:46 smithi063 ceph-mon[187282]: pgmap v60: 65 pgs: 12 stale+active+clean, 53 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:46.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:46 smithi093 ceph-mon[171709]: pgmap v60: 65 pgs: 12 stale+active+clean, 53 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-12T11:55:47.294 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:55:47 smithi063 bash[203694]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-12T11:55:47.295 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:55:47 smithi063 bash[203694]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-12-12T11:55:47.295 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:55:47 smithi063 bash[203694]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-12-12T11:55:47.295 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:55:47 smithi063 bash[203694]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-12-12T11:55:47.295 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:55:47 smithi063 bash[203694]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2023-12-12T11:55:47.295 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:55:47 smithi063 bash[203694]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-12T11:55:47.295 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:55:47 smithi063 bash[203694]: --> ceph-volume raw activate successful for osd ID: 1 2023-12-12T11:55:47.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:47 smithi093 ceph-mon[171709]: pgmap v61: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2023-12-12T11:55:47.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:47 smithi093 ceph-mon[171709]: Health check failed: Degraded data redundancy: 32/219 objects degraded (14.612%), 13 pgs degraded (PG_DEGRADED) 2023-12-12T11:55:47.742 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:47 smithi063 ceph-mon[187282]: pgmap v61: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2023-12-12T11:55:47.742 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:47 smithi063 ceph-mon[187282]: Health check failed: Degraded data redundancy: 32/219 objects degraded (14.612%), 13 pgs degraded (PG_DEGRADED) 2023-12-12T11:55:48.294 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:55:47 smithi063 bash[203945]: 733e6ff9e83d3e36a0b3f4174a30def7b81ef19ed572f83ffb4ca4aa12163259 2023-12-12T11:55:48.294 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:55:47 smithi063 systemd[1]: Started Ceph osd.1 for 85e33c70-98e3-11ee-95a3-87774f69a715. 2023-12-12T11:55:48.295 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:55:47 smithi063 ceph-osd[203982]: -- 172.21.15.63:0/584790334 <== mon.0 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5565f549b6c0 con 0x5565f546ac00 2023-12-12T11:55:48.661 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:55:48 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-1[203959]: 2023-12-12T11:55:48.355+0000 7f6456304640 -1 Falling back to public interface 2023-12-12T11:55:49.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:48 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:49.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:48 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:49.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:48 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:55:49.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:48 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:49.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:48 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:49.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:48 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:55:50.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:49 smithi093 ceph-mon[171709]: pgmap v62: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2023-12-12T11:55:50.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:49 smithi063 ceph-mon[187282]: pgmap v62: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2023-12-12T11:55:51.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:51 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:51.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:51 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:55:51.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:51 smithi093 ceph-mon[171709]: pgmap v63: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2023-12-12T11:55:51.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:51 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:51.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:51 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:55:51.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:51 smithi063 ceph-mon[187282]: pgmap v63: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2023-12-12T11:55:53.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:53 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:53.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:53 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:53.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:53 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:53.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:53 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:54.044 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:55:53 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-1[203959]: 2023-12-12T11:55:53.549+0000 7f6456304640 -1 osd.1 0 read_superblock omap replica is missing. 2023-12-12T11:55:54.413 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:55:54 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-1[203959]: 2023-12-12T11:55:54.265+0000 7f6456304640 -1 osd.1 54 log_to_monitors true 2023-12-12T11:55:54.413 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:54 smithi063 ceph-mon[187282]: pgmap v64: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2023-12-12T11:55:54.413 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:54 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:54.413 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:54 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:54.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:54 smithi093 ceph-mon[171709]: pgmap v64: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2023-12-12T11:55:54.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:54 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:54.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:54 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:55.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:55 smithi063 ceph-mon[187282]: from='osd.1 [v2:172.21.15.63:6810/392040058,v1:172.21.15.63:6811/392040058]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-12T11:55:55.295 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:55:55 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-1[203959]: 2023-12-12T11:55:55.167+0000 7f6445771700 -1 osd.1 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T11:55:55.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:55 smithi093 ceph-mon[171709]: from='osd.1 [v2:172.21.15.63:6810/392040058,v1:172.21.15.63:6811/392040058]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-12T11:55:56.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:56 smithi093 ceph-mon[171709]: from='osd.1 [v2:172.21.15.63:6810/392040058,v1:172.21.15.63:6811/392040058]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-12T11:55:56.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:56 smithi093 ceph-mon[171709]: osdmap e57: 6 total, 5 up, 6 in 2023-12-12T11:55:56.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:56 smithi093 ceph-mon[171709]: from='osd.1 [v2:172.21.15.63:6810/392040058,v1:172.21.15.63:6811/392040058]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2023-12-12T11:55:56.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:56 smithi093 ceph-mon[171709]: pgmap v66: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2023-12-12T11:55:56.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:56 smithi093 ceph-mon[171709]: failed to encode map e57 with expected crc 2023-12-12T11:55:56.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:56 smithi093 ceph-mon[171709]: failed to encode map e57 with expected crc 2023-12-12T11:55:56.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:56 smithi063 ceph-mon[187282]: from='osd.1 [v2:172.21.15.63:6810/392040058,v1:172.21.15.63:6811/392040058]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-12T11:55:56.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:56 smithi063 ceph-mon[187282]: osdmap e57: 6 total, 5 up, 6 in 2023-12-12T11:55:56.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:56 smithi063 ceph-mon[187282]: from='osd.1 [v2:172.21.15.63:6810/392040058,v1:172.21.15.63:6811/392040058]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2023-12-12T11:55:56.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:56 smithi063 ceph-mon[187282]: pgmap v66: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2023-12-12T11:55:56.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:56 smithi063 ceph-mon[187282]: failed to encode map e57 with expected crc 2023-12-12T11:55:56.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:56 smithi063 ceph-mon[187282]: failed to encode map e57 with expected crc 2023-12-12T11:55:57.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:57 smithi093 ceph-mon[171709]: failed to encode map e57 with expected crc 2023-12-12T11:55:57.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:57 smithi093 ceph-mon[171709]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-12T11:55:57.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:57 smithi093 ceph-mon[171709]: failed to encode map e58 with expected crc 2023-12-12T11:55:57.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:57 smithi093 ceph-mon[171709]: osd.1 [v2:172.21.15.63:6810/392040058,v1:172.21.15.63:6811/392040058] boot 2023-12-12T11:55:57.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:57 smithi093 ceph-mon[171709]: osdmap e58: 6 total, 6 up, 6 in 2023-12-12T11:55:57.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:57 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-12T11:55:57.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:57 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:57.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:57 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:57.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:57 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:55:57.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:57 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:55:57.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:57 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:57.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:57 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:55:57.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:57 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:55:57.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:57 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:55:57.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:57 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:55:57.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:57 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-12T11:55:57.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:57 smithi063 ceph-mon[187282]: failed to encode map e57 with expected crc 2023-12-12T11:55:57.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:57 smithi063 ceph-mon[187282]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-12T11:55:57.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:57 smithi063 ceph-mon[187282]: failed to encode map e58 with expected crc 2023-12-12T11:55:57.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:57 smithi063 ceph-mon[187282]: osd.1 [v2:172.21.15.63:6810/392040058,v1:172.21.15.63:6811/392040058] boot 2023-12-12T11:55:57.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:57 smithi063 ceph-mon[187282]: osdmap e58: 6 total, 6 up, 6 in 2023-12-12T11:55:57.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:57 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-12T11:55:57.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:57 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:57.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:57 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:57.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:57 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:55:57.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:57 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:55:57.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:57 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:55:57.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:57 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:55:57.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:57 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:55:57.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:57 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:55:57.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:57 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:55:57.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:57 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-12T11:55:58.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:58 smithi093 ceph-mon[171709]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-12T11:55:58.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:58 smithi093 ceph-mon[171709]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-12-12T11:55:58.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:58 smithi093 ceph-mon[171709]: osdmap e59: 6 total, 6 up, 6 in 2023-12-12T11:55:58.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:58 smithi093 ceph-mon[171709]: failed to encode map e59 with expected crc 2023-12-12T11:55:58.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:58 smithi093 ceph-mon[171709]: failed to encode map e59 with expected crc 2023-12-12T11:55:58.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:58 smithi093 ceph-mon[171709]: failed to encode map e59 with expected crc 2023-12-12T11:55:58.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:58 smithi093 ceph-mon[171709]: failed to encode map e59 with expected crc 2023-12-12T11:55:58.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:58 smithi093 ceph-mon[171709]: failed to encode map e59 with expected crc 2023-12-12T11:55:58.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:58 smithi093 ceph-mon[171709]: failed to encode map e59 with expected crc 2023-12-12T11:55:58.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:58 smithi093 ceph-mon[171709]: failed to encode map e59 with expected crc 2023-12-12T11:55:58.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:58 smithi093 ceph-mon[171709]: failed to encode map e59 with expected crc 2023-12-12T11:55:58.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:58 smithi093 ceph-mon[171709]: failed to encode map e59 with expected crc 2023-12-12T11:55:58.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:58 smithi093 ceph-mon[171709]: pgmap v69: 65 pgs: 22 peering, 7 active+undersized+degraded, 5 active+undersized, 31 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2023-12-12T11:55:58.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:58 smithi063 ceph-mon[187282]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-12T11:55:58.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:58 smithi063 ceph-mon[187282]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-12-12T11:55:58.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:58 smithi063 ceph-mon[187282]: osdmap e59: 6 total, 6 up, 6 in 2023-12-12T11:55:58.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:58 smithi063 ceph-mon[187282]: failed to encode map e59 with expected crc 2023-12-12T11:55:58.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:58 smithi063 ceph-mon[187282]: failed to encode map e59 with expected crc 2023-12-12T11:55:58.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:58 smithi063 ceph-mon[187282]: failed to encode map e59 with expected crc 2023-12-12T11:55:58.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:58 smithi063 ceph-mon[187282]: failed to encode map e59 with expected crc 2023-12-12T11:55:58.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:58 smithi063 ceph-mon[187282]: failed to encode map e59 with expected crc 2023-12-12T11:55:58.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:58 smithi063 ceph-mon[187282]: failed to encode map e59 with expected crc 2023-12-12T11:55:58.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:58 smithi063 ceph-mon[187282]: failed to encode map e59 with expected crc 2023-12-12T11:55:58.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:58 smithi063 ceph-mon[187282]: failed to encode map e59 with expected crc 2023-12-12T11:55:58.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:58 smithi063 ceph-mon[187282]: failed to encode map e59 with expected crc 2023-12-12T11:55:58.546 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:58 smithi063 ceph-mon[187282]: pgmap v69: 65 pgs: 22 peering, 7 active+undersized+degraded, 5 active+undersized, 31 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2023-12-12T11:55:58.974 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.971+0000 7f0ddde7b700 1 -- 172.21.15.63:0/2327014397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dd80fde00 msgr2=0x7f0dd80fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:58.974 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.971+0000 7f0ddde7b700 1 --2- 172.21.15.63:0/2327014397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dd80fde00 0x7f0dd80fe250 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc004940 tx=0x7f0dcc009e30 comp rx=0 tx=0).stop 2023-12-12T11:55:58.974 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.971+0000 7f0ddde7b700 1 -- 172.21.15.63:0/2327014397 shutdown_connections 2023-12-12T11:55:58.974 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.971+0000 7f0ddde7b700 1 --2- 172.21.15.63:0/2327014397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dd80fde00 0x7f0dd80fe250 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:58.974 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.971+0000 7f0ddde7b700 1 --2- 172.21.15.63:0/2327014397 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0dd80fcbf0 0x7f0dd80fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:58.974 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.971+0000 7f0ddde7b700 1 -- 172.21.15.63:0/2327014397 >> 172.21.15.63:0/2327014397 conn(0x7f0dd80f82d0 msgr2=0x7f0dd80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:55:58.974 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.971+0000 7f0ddde7b700 1 -- 172.21.15.63:0/2327014397 shutdown_connections 2023-12-12T11:55:58.974 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.971+0000 7f0ddde7b700 1 -- 172.21.15.63:0/2327014397 wait complete. 2023-12-12T11:55:58.976 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.972+0000 7f0ddde7b700 1 Processor -- start 2023-12-12T11:55:58.976 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.972+0000 7f0ddde7b700 1 -- start start 2023-12-12T11:55:58.976 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.972+0000 7f0ddde7b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dd80fcbf0 0x7f0dd810d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:55:58.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.972+0000 7f0ddde7b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0dd80fde00 0x7f0dd810da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:55:58.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.972+0000 7f0ddde7b700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd810e030 con 0x7f0dd80fcbf0 2023-12-12T11:55:58.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.972+0000 7f0ddde7b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd810e8d0 con 0x7f0dd80fde00 2023-12-12T11:55:58.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.973+0000 7f0dd77fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dd80fcbf0 0x7f0dd810d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:55:58.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.973+0000 7f0dd77fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dd80fcbf0 0x7f0dd810d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55662/0 (socket says 172.21.15.63:55662) 2023-12-12T11:55:58.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.973+0000 7f0dd77fe700 1 -- 172.21.15.63:0/4146468797 learned_addr learned my addr 172.21.15.63:0/4146468797 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:55:58.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.973+0000 7f0dd6ffd700 1 --2- 172.21.15.63:0/4146468797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0dd80fde00 0x7f0dd810da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:55:58.978 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.973+0000 7f0dd77fe700 1 -- 172.21.15.63:0/4146468797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0dd80fde00 msgr2=0x7f0dd810da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:58.978 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.973+0000 7f0dd77fe700 1 --2- 172.21.15.63:0/4146468797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0dd80fde00 0x7f0dd810da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:58.978 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.973+0000 7f0dd77fe700 1 -- 172.21.15.63:0/4146468797 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dcc005040 con 0x7f0dd80fcbf0 2023-12-12T11:55:58.978 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.973+0000 7f0dd6ffd700 1 --2- 172.21.15.63:0/4146468797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0dd80fde00 0x7f0dd810da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T11:55:58.978 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.973+0000 7f0dd77fe700 1 --2- 172.21.15.63:0/4146468797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dd80fcbf0 0x7f0dd810d4f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0dc800eb70 tx=0x7f0dc800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:55:58.979 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.974+0000 7f0dbffff700 1 -- 172.21.15.63:0/4146468797 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dc8007cc0 con 0x7f0dd80fcbf0 2023-12-12T11:55:58.979 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.974+0000 7f0dbffff700 1 -- 172.21.15.63:0/4146468797 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0dc800f040 con 0x7f0dd80fcbf0 2023-12-12T11:55:58.979 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.974+0000 7f0ddde7b700 1 -- 172.21.15.63:0/4146468797 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd810eb50 con 0x7f0dd80fcbf0 2023-12-12T11:55:58.979 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.974+0000 7f0dbffff700 1 -- 172.21.15.63:0/4146468797 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dc800cad0 con 0x7f0dd80fcbf0 2023-12-12T11:55:58.979 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.974+0000 7f0ddde7b700 1 -- 172.21.15.63:0/4146468797 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd810f090 con 0x7f0dd80fcbf0 2023-12-12T11:55:58.980 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.975+0000 7f0ddde7b700 1 -- 172.21.15.63:0/4146468797 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd804bb80 con 0x7f0dd80fcbf0 2023-12-12T11:55:58.980 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.976+0000 7f0dbffff700 1 -- 172.21.15.63:0/4146468797 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f0dc800cc30 con 0x7f0dd80fcbf0 2023-12-12T11:55:58.980 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.977+0000 7f0dbffff700 1 --2- 172.21.15.63:0/4146468797 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f0dc006ce70 0x7f0dc006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:55:58.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.977+0000 7f0dbffff700 1 -- 172.21.15.63:0/4146468797 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f0dc808be30 con 0x7f0dd80fcbf0 2023-12-12T11:55:58.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.977+0000 7f0dd6ffd700 1 --2- 172.21.15.63:0/4146468797 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f0dc006ce70 0x7f0dc006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:55:58.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.978+0000 7f0dd6ffd700 1 --2- 172.21.15.63:0/4146468797 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f0dc006ce70 0x7f0dc006f320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0135e0 tx=0x7f0dcc009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:55:58.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:58.982+0000 7f0dbffff700 1 -- 172.21.15.63:0/4146468797 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f0dc80597d0 con 0x7f0dd80fcbf0 2023-12-12T11:55:59.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.211+0000 7f0ddde7b700 1 -- 172.21.15.63:0/4146468797 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0dd810f550 con 0x7f0dc006ce70 2023-12-12T11:55:59.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.213+0000 7f0dbffff700 1 -- 172.21.15.63:0/4146468797 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0dd810f550 con 0x7f0dc006ce70 2023-12-12T11:55:59.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.215+0000 7f0ddde7b700 1 -- 172.21.15.63:0/4146468797 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f0dc006ce70 msgr2=0x7f0dc006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:59.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.215+0000 7f0ddde7b700 1 --2- 172.21.15.63:0/4146468797 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f0dc006ce70 0x7f0dc006f320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0135e0 tx=0x7f0dcc009e30 comp rx=0 tx=0).stop 2023-12-12T11:55:59.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.215+0000 7f0ddde7b700 1 -- 172.21.15.63:0/4146468797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dd80fcbf0 msgr2=0x7f0dd810d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:59.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.215+0000 7f0ddde7b700 1 --2- 172.21.15.63:0/4146468797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dd80fcbf0 0x7f0dd810d4f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0dc800eb70 tx=0x7f0dc800b040 comp rx=0 tx=0).stop 2023-12-12T11:55:59.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.215+0000 7f0ddde7b700 1 -- 172.21.15.63:0/4146468797 shutdown_connections 2023-12-12T11:55:59.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.215+0000 7f0ddde7b700 1 --2- 172.21.15.63:0/4146468797 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f0dc006ce70 0x7f0dc006f320 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:59.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.215+0000 7f0ddde7b700 1 --2- 172.21.15.63:0/4146468797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dd80fcbf0 0x7f0dd810d4f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:59.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.215+0000 7f0ddde7b700 1 --2- 172.21.15.63:0/4146468797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0dd80fde00 0x7f0dd810da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:59.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.215+0000 7f0ddde7b700 1 -- 172.21.15.63:0/4146468797 >> 172.21.15.63:0/4146468797 conn(0x7f0dd80f82d0 msgr2=0x7f0dd8101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:55:59.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.215+0000 7f0ddde7b700 1 -- 172.21.15.63:0/4146468797 shutdown_connections 2023-12-12T11:55:59.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.215+0000 7f0ddde7b700 1 -- 172.21.15.63:0/4146468797 wait complete. 2023-12-12T11:55:59.232 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-12T11:55:59.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.355+0000 7fb82de4c700 1 -- 172.21.15.63:0/3977271601 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8280fcbf0 msgr2=0x7fb8280fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:59.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.355+0000 7fb82de4c700 1 --2- 172.21.15.63:0/3977271601 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8280fcbf0 0x7fb8280fd000 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb818004940 tx=0x7fb818009e30 comp rx=0 tx=0).stop 2023-12-12T11:55:59.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.355+0000 7fb82de4c700 1 -- 172.21.15.63:0/3977271601 shutdown_connections 2023-12-12T11:55:59.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.355+0000 7fb82de4c700 1 --2- 172.21.15.63:0/3977271601 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb8280fde00 0x7fb8280fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:59.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.355+0000 7fb82de4c700 1 --2- 172.21.15.63:0/3977271601 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8280fcbf0 0x7fb8280fd000 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:59.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.355+0000 7fb82de4c700 1 -- 172.21.15.63:0/3977271601 >> 172.21.15.63:0/3977271601 conn(0x7fb8280f82d0 msgr2=0x7fb8280fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:55:59.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.355+0000 7fb82de4c700 1 -- 172.21.15.63:0/3977271601 shutdown_connections 2023-12-12T11:55:59.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.355+0000 7fb82de4c700 1 -- 172.21.15.63:0/3977271601 wait complete. 2023-12-12T11:55:59.359 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.356+0000 7fb82de4c700 1 Processor -- start 2023-12-12T11:55:59.359 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.356+0000 7fb82de4c700 1 -- start start 2023-12-12T11:55:59.359 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.356+0000 7fb82de4c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb8280fcbf0 0x7fb828071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:55:59.359 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.356+0000 7fb82de4c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8280fde00 0x7fb82806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:55:59.359 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.356+0000 7fb82de4c700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb828070590 con 0x7fb8280fde00 2023-12-12T11:55:59.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.356+0000 7fb82de4c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb828070700 con 0x7fb8280fcbf0 2023-12-12T11:55:59.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.357+0000 7fb826ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8280fde00 0x7fb82806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:55:59.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.357+0000 7fb826ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8280fde00 0x7fb82806ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55684/0 (socket says 172.21.15.63:55684) 2023-12-12T11:55:59.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.357+0000 7fb826ffd700 1 -- 172.21.15.63:0/1671535946 learned_addr learned my addr 172.21.15.63:0/1671535946 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:55:59.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.357+0000 7fb8277fe700 1 --2- 172.21.15.63:0/1671535946 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb8280fcbf0 0x7fb828071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:55:59.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.357+0000 7fb826ffd700 1 -- 172.21.15.63:0/1671535946 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb8280fcbf0 msgr2=0x7fb828071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:59.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.357+0000 7fb826ffd700 1 --2- 172.21.15.63:0/1671535946 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb8280fcbf0 0x7fb828071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:59.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.357+0000 7fb826ffd700 1 -- 172.21.15.63:0/1671535946 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb818005040 con 0x7fb8280fde00 2023-12-12T11:55:59.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.357+0000 7fb826ffd700 1 --2- 172.21.15.63:0/1671535946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8280fde00 0x7fb82806ff90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb81c002a50 tx=0x7fb81c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:55:59.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.358+0000 7fb80ffff700 1 -- 172.21.15.63:0/1671535946 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb81c007cc0 con 0x7fb8280fde00 2023-12-12T11:55:59.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.358+0000 7fb80ffff700 1 -- 172.21.15.63:0/1671535946 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb81c00f040 con 0x7fb8280fde00 2023-12-12T11:55:59.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.358+0000 7fb82de4c700 1 -- 172.21.15.63:0/1671535946 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8280709e0 con 0x7fb8280fde00 2023-12-12T11:55:59.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.358+0000 7fb80ffff700 1 -- 172.21.15.63:0/1671535946 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb81c00d9c0 con 0x7fb8280fde00 2023-12-12T11:55:59.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.358+0000 7fb82de4c700 1 -- 172.21.15.63:0/1671535946 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb828115590 con 0x7fb8280fde00 2023-12-12T11:55:59.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.359+0000 7fb82de4c700 1 -- 172.21.15.63:0/1671535946 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb82804bb80 con 0x7fb8280fde00 2023-12-12T11:55:59.363 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.360+0000 7fb80ffff700 1 -- 172.21.15.63:0/1671535946 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fb81c00db20 con 0x7fb8280fde00 2023-12-12T11:55:59.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.362+0000 7fb80ffff700 1 --2- 172.21.15.63:0/1671535946 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fb81006ce70 0x7fb81006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:55:59.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.362+0000 7fb80ffff700 1 -- 172.21.15.63:0/1671535946 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fb81c08c6a0 con 0x7fb8280fde00 2023-12-12T11:55:59.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.362+0000 7fb8277fe700 1 --2- 172.21.15.63:0/1671535946 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fb81006ce70 0x7fb81006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:55:59.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.363+0000 7fb8277fe700 1 --2- 172.21.15.63:0/1671535946 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fb81006ce70 0x7fb81006f320 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb81800b7d0 tx=0x7fb818009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:55:59.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.365+0000 7fb80ffff700 1 -- 172.21.15.63:0/1671535946 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fb81c05a0c0 con 0x7fb8280fde00 2023-12-12T11:55:59.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:55:59 smithi093 ceph-mon[171709]: Health check update: Degraded data redundancy: 16/219 objects degraded (7.306%), 7 pgs degraded (PG_DEGRADED) 2023-12-12T11:55:59.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:55:59 smithi063 ceph-mon[187282]: Health check update: Degraded data redundancy: 16/219 objects degraded (7.306%), 7 pgs degraded (PG_DEGRADED) 2023-12-12T11:55:59.598 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.596+0000 7fb82de4c700 1 -- 172.21.15.63:0/1671535946 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb828102750 con 0x7fb81006ce70 2023-12-12T11:55:59.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.597+0000 7fb80ffff700 1 -- 172.21.15.63:0/1671535946 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb828102750 con 0x7fb81006ce70 2023-12-12T11:55:59.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.599+0000 7fb82de4c700 1 -- 172.21.15.63:0/1671535946 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fb81006ce70 msgr2=0x7fb81006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:59.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.599+0000 7fb82de4c700 1 --2- 172.21.15.63:0/1671535946 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fb81006ce70 0x7fb81006f320 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb81800b7d0 tx=0x7fb818009e30 comp rx=0 tx=0).stop 2023-12-12T11:55:59.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.599+0000 7fb82de4c700 1 -- 172.21.15.63:0/1671535946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8280fde00 msgr2=0x7fb82806ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:59.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.599+0000 7fb82de4c700 1 --2- 172.21.15.63:0/1671535946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8280fde00 0x7fb82806ff90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb81c002a50 tx=0x7fb81c0046b0 comp rx=0 tx=0).stop 2023-12-12T11:55:59.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.600+0000 7fb82de4c700 1 -- 172.21.15.63:0/1671535946 shutdown_connections 2023-12-12T11:55:59.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.600+0000 7fb82de4c700 1 --2- 172.21.15.63:0/1671535946 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fb81006ce70 0x7fb81006f320 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:59.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.600+0000 7fb82de4c700 1 --2- 172.21.15.63:0/1671535946 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb8280fcbf0 0x7fb828071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:59.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.600+0000 7fb82de4c700 1 --2- 172.21.15.63:0/1671535946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8280fde00 0x7fb82806ff90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:59.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.600+0000 7fb82de4c700 1 -- 172.21.15.63:0/1671535946 >> 172.21.15.63:0/1671535946 conn(0x7fb8280f82d0 msgr2=0x7fb828101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:55:59.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.600+0000 7fb82de4c700 1 -- 172.21.15.63:0/1671535946 shutdown_connections 2023-12-12T11:55:59.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.600+0000 7fb82de4c700 1 -- 172.21.15.63:0/1671535946 wait complete. 2023-12-12T11:55:59.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.738+0000 7f2fabe52700 1 -- 172.21.15.63:0/3762941639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa40fcbf0 msgr2=0x7f2fa40fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:59.741 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.738+0000 7f2fabe52700 1 --2- 172.21.15.63:0/3762941639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa40fcbf0 0x7f2fa40fd000 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0004940 tx=0x7f2fa0009e30 comp rx=0 tx=0).stop 2023-12-12T11:55:59.741 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.738+0000 7f2fabe52700 1 -- 172.21.15.63:0/3762941639 shutdown_connections 2023-12-12T11:55:59.741 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.738+0000 7f2fabe52700 1 --2- 172.21.15.63:0/3762941639 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2fa40fde00 0x7f2fa40fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:59.741 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.738+0000 7f2fabe52700 1 --2- 172.21.15.63:0/3762941639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa40fcbf0 0x7f2fa40fd000 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:59.741 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.738+0000 7f2fabe52700 1 -- 172.21.15.63:0/3762941639 >> 172.21.15.63:0/3762941639 conn(0x7f2fa40f82d0 msgr2=0x7f2fa40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:55:59.741 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.738+0000 7f2fabe52700 1 -- 172.21.15.63:0/3762941639 shutdown_connections 2023-12-12T11:55:59.741 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.738+0000 7f2fabe52700 1 -- 172.21.15.63:0/3762941639 wait complete. 2023-12-12T11:55:59.742 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.739+0000 7f2fabe52700 1 Processor -- start 2023-12-12T11:55:59.742 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.739+0000 7f2fabe52700 1 -- start start 2023-12-12T11:55:59.742 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.739+0000 7f2fabe52700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa40fcbf0 0x7f2fa410d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:55:59.742 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.739+0000 7f2fabe52700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2fa40fde00 0x7f2fa410da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:55:59.743 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.739+0000 7f2fabe52700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa410e010 con 0x7f2fa40fcbf0 2023-12-12T11:55:59.743 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.739+0000 7f2fabe52700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa410e8b0 con 0x7f2fa40fde00 2023-12-12T11:55:59.743 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.739+0000 7f2fa9bee700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa40fcbf0 0x7f2fa410d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:55:59.743 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.740+0000 7f2fa9bee700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa40fcbf0 0x7f2fa410d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55704/0 (socket says 172.21.15.63:55704) 2023-12-12T11:55:59.743 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.740+0000 7f2fa9bee700 1 -- 172.21.15.63:0/3254039284 learned_addr learned my addr 172.21.15.63:0/3254039284 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:55:59.743 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.740+0000 7f2fa93ed700 1 --2- 172.21.15.63:0/3254039284 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2fa40fde00 0x7f2fa410da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:55:59.743 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.740+0000 7f2fa9bee700 1 -- 172.21.15.63:0/3254039284 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2fa40fde00 msgr2=0x7f2fa410da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:59.743 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.740+0000 7f2fa9bee700 1 --2- 172.21.15.63:0/3254039284 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2fa40fde00 0x7f2fa410da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:59.743 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.740+0000 7f2fa9bee700 1 -- 172.21.15.63:0/3254039284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa0005040 con 0x7f2fa40fcbf0 2023-12-12T11:55:59.743 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.740+0000 7f2fa9bee700 1 --2- 172.21.15.63:0/3254039284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa40fcbf0 0x7f2fa410d4d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0009fd0 tx=0x7f2fa0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:55:59.744 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.740+0000 7f2f9a7fc700 1 -- 172.21.15.63:0/3254039284 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fa0021070 con 0x7f2fa40fcbf0 2023-12-12T11:55:59.744 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.740+0000 7f2f9a7fc700 1 -- 172.21.15.63:0/3254039284 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2fa0013c60 con 0x7f2fa40fcbf0 2023-12-12T11:55:59.744 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.740+0000 7f2f9a7fc700 1 -- 172.21.15.63:0/3254039284 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fa000e070 con 0x7f2fa40fcbf0 2023-12-12T11:55:59.744 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.740+0000 7f2fabe52700 1 -- 172.21.15.63:0/3254039284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa410eb30 con 0x7f2fa40fcbf0 2023-12-12T11:55:59.744 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.741+0000 7f2fabe52700 1 -- 172.21.15.63:0/3254039284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa410efc0 con 0x7f2fa40fcbf0 2023-12-12T11:55:59.744 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.742+0000 7f2fabe52700 1 -- 172.21.15.63:0/3254039284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa404bb80 con 0x7f2fa40fcbf0 2023-12-12T11:55:59.745 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.743+0000 7f2f9a7fc700 1 -- 172.21.15.63:0/3254039284 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f2fa001c400 con 0x7f2fa40fcbf0 2023-12-12T11:55:59.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.743+0000 7f2f9a7fc700 1 --2- 172.21.15.63:0/3254039284 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f2f9006ce60 0x7f2f9006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:55:59.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.744+0000 7f2f9a7fc700 1 -- 172.21.15.63:0/3254039284 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f2fa008d510 con 0x7f2fa40fcbf0 2023-12-12T11:55:59.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.744+0000 7f2fa93ed700 1 --2- 172.21.15.63:0/3254039284 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f2f9006ce60 0x7f2f9006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:55:59.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.744+0000 7f2fa93ed700 1 --2- 172.21.15.63:0/3254039284 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f2f9006ce60 0x7f2f9006f310 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2f94009fd0 tx=0x7f2f9400b040 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:55:59.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.748+0000 7f2f9a7fc700 1 -- 172.21.15.63:0/3254039284 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f2fa005af40 con 0x7f2fa40fcbf0 2023-12-12T11:55:59.972 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.970+0000 7f2fabe52700 1 -- 172.21.15.63:0/3254039284 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2fa410f420 con 0x7f2f9006ce60 2023-12-12T11:55:59.982 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.980+0000 7f2f9a7fc700 1 -- 172.21.15.63:0/3254039284 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f2fa410f420 con 0x7f2f9006ce60 2023-12-12T11:55:59.982 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-12T11:55:59.983 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (3m) 7s ago 11m 15.6M - 0.25.0 c8568f914cd2 f237d9f64783 2023-12-12T11:55:59.983 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (68s) 7s ago 11m 7852k - 19.0.0-96-gf1fbf3c5 8cf689f388db 202fa7506e7c 2023-12-12T11:55:59.983 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi093 smithi093 running (63s) 60s ago 10m 7852k - 19.0.0-96-gf1fbf3c5 8cf689f388db ac9d76320ce6 2023-12-12T11:55:59.983 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (3m) 7s ago 11m 78.4M - 9.4.7 954c08fa6188 51300a1a5b87 2023-12-12T11:55:59.983 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.aevpzg smithi063 running (6m) 7s ago 6m 10.5G - 17.2.7-123-gbef78a51 ae6196193935 df9a6781f836 2023-12-12T11:55:59.983 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.bdqbnp smithi063 running (6m) 7s ago 6m 15.4M - 17.2.7-123-gbef78a51 ae6196193935 0c7e1d21eee9 2023-12-12T11:55:59.983 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.rhaqsh smithi093 running (6m) 60s ago 6m 15.0M - 17.2.7-123-gbef78a51 ae6196193935 257aee771d87 2023-12-12T11:55:59.983 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.swdqms smithi093 running (6m) 60s ago 6m 15.0M - 17.2.7-123-gbef78a51 ae6196193935 f46d7173d3b1 2023-12-12T11:55:59.983 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.zjnfdi smithi063 *:8443,9283,8765 running (3m) 7s ago 12m 513M - 19.0.0-96-gf1fbf3c5 8cf689f388db dab6fa4aaa54 2023-12-12T11:55:59.983 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi093.nbtltu smithi093 *:8443,9283,8765 running (2m) 60s ago 10m 450M - 19.0.0-96-gf1fbf3c5 8cf689f388db 701529e7fa8e 2023-12-12T11:55:59.983 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (2m) 7s ago 12m 58.4M 2048M 19.0.0-96-gf1fbf3c5 8cf689f388db 11f12a2e88e4 2023-12-12T11:55:59.983 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi093 smithi093 running (100s) 60s ago 10m 38.5M 2048M 19.0.0-96-gf1fbf3c5 8cf689f388db 1ffc49fcd680 2023-12-12T11:55:59.983 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (3m) 7s ago 11m 8468k - 1.5.0 0da6a335fe13 8eed63374ddf 2023-12-12T11:55:59.983 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi093 smithi093 *:9100 running (3m) 60s ago 10m 7898k - 1.5.0 0da6a335fe13 10e19431c1a2 2023-12-12T11:55:59.984 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (45s) 7s ago 9m 124M 1618M 19.0.0-96-gf1fbf3c5 8cf689f388db fade55811ec1 2023-12-12T11:55:59.984 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (12s) 7s ago 9m 13.2M 1618M 19.0.0-96-gf1fbf3c5 8cf689f388db 733e6ff9e83d 2023-12-12T11:55:59.984 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (9m) 7s ago 9m 821M 1618M 17.2.7-123-gbef78a51 ae6196193935 9eb2483337c8 2023-12-12T11:55:59.984 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi093 running (8m) 60s ago 8m 1125M 2642M 17.2.7-123-gbef78a51 ae6196193935 5b2bb36b5843 2023-12-12T11:55:59.984 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi093 running (8m) 60s ago 8m 816M 2642M 17.2.7-123-gbef78a51 ae6196193935 7dc3f04b04cb 2023-12-12T11:55:59.984 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi093 running (8m) 60s ago 8m 955M 2642M 17.2.7-123-gbef78a51 ae6196193935 16fe8e4668f1 2023-12-12T11:55:59.984 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (2m) 7s ago 11m 47.3M - 2.43.0 a07b618ecd1d 834d9fc4eb61 2023-12-12T11:55:59.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.982+0000 7f2fabe52700 1 -- 172.21.15.63:0/3254039284 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f2f9006ce60 msgr2=0x7f2f9006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:59.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.982+0000 7f2fabe52700 1 --2- 172.21.15.63:0/3254039284 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f2f9006ce60 0x7f2f9006f310 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2f94009fd0 tx=0x7f2f9400b040 comp rx=0 tx=0).stop 2023-12-12T11:55:59.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.982+0000 7f2fabe52700 1 -- 172.21.15.63:0/3254039284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa40fcbf0 msgr2=0x7f2fa410d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:55:59.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.982+0000 7f2fabe52700 1 --2- 172.21.15.63:0/3254039284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa40fcbf0 0x7f2fa410d4d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0009fd0 tx=0x7f2fa0009e30 comp rx=0 tx=0).stop 2023-12-12T11:55:59.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.982+0000 7f2fabe52700 1 -- 172.21.15.63:0/3254039284 shutdown_connections 2023-12-12T11:55:59.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.982+0000 7f2fabe52700 1 --2- 172.21.15.63:0/3254039284 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f2f9006ce60 0x7f2f9006f310 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:59.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.982+0000 7f2fabe52700 1 --2- 172.21.15.63:0/3254039284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fa40fcbf0 0x7f2fa410d4d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:59.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.982+0000 7f2fabe52700 1 --2- 172.21.15.63:0/3254039284 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2fa40fde00 0x7f2fa410da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:55:59.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.983+0000 7f2fabe52700 1 -- 172.21.15.63:0/3254039284 >> 172.21.15.63:0/3254039284 conn(0x7f2fa40f82d0 msgr2=0x7f2fa4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:55:59.986 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.983+0000 7f2fabe52700 1 -- 172.21.15.63:0/3254039284 shutdown_connections 2023-12-12T11:55:59.986 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:55:59.983+0000 7f2fabe52700 1 -- 172.21.15.63:0/3254039284 wait complete. 2023-12-12T11:56:00.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.120+0000 7f6d052eb700 1 -- 172.21.15.63:0/1470510407 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d00071b60 msgr2=0x7f6d0006ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:00.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.120+0000 7f6d052eb700 1 --2- 172.21.15.63:0/1470510407 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d00071b60 0x7f6d0006ffd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0004940 tx=0x7f6cf0009e30 comp rx=0 tx=0).stop 2023-12-12T11:56:00.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.120+0000 7f6d052eb700 1 -- 172.21.15.63:0/1470510407 shutdown_connections 2023-12-12T11:56:00.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.120+0000 7f6d052eb700 1 --2- 172.21.15.63:0/1470510407 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d00070510 0x7f6d00070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:00.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.120+0000 7f6d052eb700 1 --2- 172.21.15.63:0/1470510407 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d00071b60 0x7f6d0006ffd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:00.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.120+0000 7f6d052eb700 1 -- 172.21.15.63:0/1470510407 >> 172.21.15.63:0/1470510407 conn(0x7f6d000f82d0 msgr2=0x7f6d000fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:56:00.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.120+0000 7f6d052eb700 1 -- 172.21.15.63:0/1470510407 shutdown_connections 2023-12-12T11:56:00.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.120+0000 7f6d052eb700 1 -- 172.21.15.63:0/1470510407 wait complete. 2023-12-12T11:56:00.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.121+0000 7f6d052eb700 1 Processor -- start 2023-12-12T11:56:00.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.121+0000 7f6d052eb700 1 -- start start 2023-12-12T11:56:00.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.121+0000 7f6d052eb700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d00070510 0x7f6d0010f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:00.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.122+0000 7f6d052eb700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d00071b60 0x7f6d0010fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:00.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.122+0000 7f6d052eb700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d001102d0 con 0x7f6d00071b60 2023-12-12T11:56:00.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.122+0000 7f6d052eb700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d00110b70 con 0x7f6d00070510 2023-12-12T11:56:00.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.122+0000 7f6cfe7fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d00071b60 0x7f6d0010fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:56:00.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.122+0000 7f6cfe7fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d00071b60 0x7f6d0010fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55734/0 (socket says 172.21.15.63:55734) 2023-12-12T11:56:00.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.122+0000 7f6cfe7fc700 1 -- 172.21.15.63:0/631166786 learned_addr learned my addr 172.21.15.63:0/631166786 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:56:00.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.122+0000 7f6cfeffd700 1 --2- 172.21.15.63:0/631166786 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d00070510 0x7f6d0010f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:56:00.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.122+0000 7f6cfe7fc700 1 -- 172.21.15.63:0/631166786 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d00070510 msgr2=0x7f6d0010f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:00.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.122+0000 7f6cfe7fc700 1 --2- 172.21.15.63:0/631166786 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d00070510 0x7f6d0010f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:00.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.122+0000 7f6cfe7fc700 1 -- 172.21.15.63:0/631166786 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf0005040 con 0x7f6d00071b60 2023-12-12T11:56:00.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.122+0000 7f6cfeffd700 1 --2- 172.21.15.63:0/631166786 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d00070510 0x7f6d0010f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T11:56:00.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.122+0000 7f6cfe7fc700 1 --2- 172.21.15.63:0/631166786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d00071b60 0x7f6d0010fcd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6cf400eb40 tx=0x7f6cf400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:56:00.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.123+0000 7f6ce77fe700 1 -- 172.21.15.63:0/631166786 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cf4007cc0 con 0x7f6d00071b60 2023-12-12T11:56:00.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.123+0000 7f6ce77fe700 1 -- 172.21.15.63:0/631166786 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6cf400f040 con 0x7f6d00071b60 2023-12-12T11:56:00.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.123+0000 7f6ce77fe700 1 -- 172.21.15.63:0/631166786 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cf4009570 con 0x7f6d00071b60 2023-12-12T11:56:00.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.123+0000 7f6d052eb700 1 -- 172.21.15.63:0/631166786 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d00110df0 con 0x7f6d00071b60 2023-12-12T11:56:00.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.123+0000 7f6d052eb700 1 -- 172.21.15.63:0/631166786 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d00111330 con 0x7f6d00071b60 2023-12-12T11:56:00.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.124+0000 7f6d052eb700 1 -- 172.21.15.63:0/631166786 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d001096f0 con 0x7f6d00071b60 2023-12-12T11:56:00.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.125+0000 7f6ce77fe700 1 -- 172.21.15.63:0/631166786 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f6cf40096d0 con 0x7f6d00071b60 2023-12-12T11:56:00.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.126+0000 7f6ce77fe700 1 --2- 172.21.15.63:0/631166786 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f6ce806ce70 0x7f6ce806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:00.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.126+0000 7f6ce77fe700 1 -- 172.21.15.63:0/631166786 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f6cf408bf80 con 0x7f6d00071b60 2023-12-12T11:56:00.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.126+0000 7f6cfeffd700 1 --2- 172.21.15.63:0/631166786 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f6ce806ce70 0x7f6ce806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:56:00.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.127+0000 7f6cfeffd700 1 --2- 172.21.15.63:0/631166786 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f6ce806ce70 0x7f6ce806f320 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0013680 tx=0x7f6cf0009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:56:00.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.130+0000 7f6ce77fe700 1 -- 172.21.15.63:0/631166786 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6cf4059920 con 0x7f6d00071b60 2023-12-12T11:56:00.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.427+0000 7f6d052eb700 1 -- 172.21.15.63:0/631166786 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6d00109110 con 0x7f6d00071b60 2023-12-12T11:56:00.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.427+0000 7f6ce77fe700 1 -- 172.21.15.63:0/631166786 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7f6cf40594b0 con 0x7f6d00071b60 2023-12-12T11:56:00.430 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:56:00.430 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-12T11:56:00.430 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 2 2023-12-12T11:56:00.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:56:00.430 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-12T11:56:00.430 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 2 2023-12-12T11:56:00.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:56:00.431 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-12T11:56:00.431 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 4, 2023-12-12T11:56:00.431 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 2 2023-12-12T11:56:00.431 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:56:00.431 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-12T11:56:00.431 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 4 2023-12-12T11:56:00.431 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:56:00.431 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-12T11:56:00.431 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 8, 2023-12-12T11:56:00.431 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 6 2023-12-12T11:56:00.431 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-12T11:56:00.431 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:56:00.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.430+0000 7f6d052eb700 1 -- 172.21.15.63:0/631166786 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f6ce806ce70 msgr2=0x7f6ce806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:00.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.430+0000 7f6d052eb700 1 --2- 172.21.15.63:0/631166786 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f6ce806ce70 0x7f6ce806f320 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0013680 tx=0x7f6cf0009e30 comp rx=0 tx=0).stop 2023-12-12T11:56:00.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.430+0000 7f6d052eb700 1 -- 172.21.15.63:0/631166786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d00071b60 msgr2=0x7f6d0010fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:00.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.430+0000 7f6d052eb700 1 --2- 172.21.15.63:0/631166786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d00071b60 0x7f6d0010fcd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6cf400eb40 tx=0x7f6cf400b040 comp rx=0 tx=0).stop 2023-12-12T11:56:00.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.430+0000 7f6d052eb700 1 -- 172.21.15.63:0/631166786 shutdown_connections 2023-12-12T11:56:00.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.430+0000 7f6d052eb700 1 --2- 172.21.15.63:0/631166786 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f6ce806ce70 0x7f6ce806f320 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:00.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.430+0000 7f6d052eb700 1 --2- 172.21.15.63:0/631166786 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d00070510 0x7f6d0010f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:00.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.430+0000 7f6d052eb700 1 --2- 172.21.15.63:0/631166786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d00071b60 0x7f6d0010fcd0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:00.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.430+0000 7f6d052eb700 1 -- 172.21.15.63:0/631166786 >> 172.21.15.63:0/631166786 conn(0x7f6d000f82d0 msgr2=0x7f6d000fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:56:00.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.430+0000 7f6d052eb700 1 -- 172.21.15.63:0/631166786 shutdown_connections 2023-12-12T11:56:00.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.430+0000 7f6d052eb700 1 -- 172.21.15.63:0/631166786 wait complete. 2023-12-12T11:56:00.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:00 smithi093 ceph-mon[171709]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:56:00.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:00 smithi093 ceph-mon[171709]: pgmap v70: 65 pgs: 22 peering, 7 active+undersized+degraded, 5 active+undersized, 31 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2023-12-12T11:56:00.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:00 smithi063 ceph-mon[187282]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:56:00.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:00 smithi063 ceph-mon[187282]: pgmap v70: 65 pgs: 22 peering, 7 active+undersized+degraded, 5 active+undersized, 31 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2023-12-12T11:56:00.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.569+0000 7f16f802c700 1 -- 172.21.15.63:0/1163980430 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16f0071bc0 msgr2=0x7f16f0070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:00.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.569+0000 7f16f802c700 1 --2- 172.21.15.63:0/1163980430 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16f0071bc0 0x7f16f0070030 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f16ec004940 tx=0x7f16ec009e30 comp rx=0 tx=0).stop 2023-12-12T11:56:00.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.569+0000 7f16f802c700 1 -- 172.21.15.63:0/1163980430 shutdown_connections 2023-12-12T11:56:00.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.569+0000 7f16f802c700 1 --2- 172.21.15.63:0/1163980430 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16f0070570 0x7f16f00709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:00.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.569+0000 7f16f802c700 1 --2- 172.21.15.63:0/1163980430 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16f0071bc0 0x7f16f0070030 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:00.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.569+0000 7f16f802c700 1 -- 172.21.15.63:0/1163980430 >> 172.21.15.63:0/1163980430 conn(0x7f16f00f82d0 msgr2=0x7f16f00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:56:00.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.569+0000 7f16f802c700 1 -- 172.21.15.63:0/1163980430 shutdown_connections 2023-12-12T11:56:00.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.569+0000 7f16f802c700 1 -- 172.21.15.63:0/1163980430 wait complete. 2023-12-12T11:56:00.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.570+0000 7f16f802c700 1 Processor -- start 2023-12-12T11:56:00.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.570+0000 7f16f802c700 1 -- start start 2023-12-12T11:56:00.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.570+0000 7f16f802c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16f0070570 0x7f16f010f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:00.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.570+0000 7f16f802c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16f0071bc0 0x7f16f010fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:00.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.570+0000 7f16f802c700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f0110420 con 0x7f16f0071bc0 2023-12-12T11:56:00.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.570+0000 7f16f802c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f0110cc0 con 0x7f16f0070570 2023-12-12T11:56:00.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.570+0000 7f16f55c7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16f0071bc0 0x7f16f010fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:56:00.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.570+0000 7f16f55c7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16f0071bc0 0x7f16f010fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55748/0 (socket says 172.21.15.63:55748) 2023-12-12T11:56:00.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.570+0000 7f16f55c7700 1 -- 172.21.15.63:0/559180723 learned_addr learned my addr 172.21.15.63:0/559180723 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:56:00.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.571+0000 7f16f5dc8700 1 --2- 172.21.15.63:0/559180723 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16f0070570 0x7f16f010f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:56:00.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.571+0000 7f16f55c7700 1 -- 172.21.15.63:0/559180723 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16f0070570 msgr2=0x7f16f010f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:00.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.571+0000 7f16f55c7700 1 --2- 172.21.15.63:0/559180723 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16f0070570 0x7f16f010f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:00.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.571+0000 7f16f55c7700 1 -- 172.21.15.63:0/559180723 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ec005040 con 0x7f16f0071bc0 2023-12-12T11:56:00.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.571+0000 7f16f55c7700 1 --2- 172.21.15.63:0/559180723 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16f0071bc0 0x7f16f010fe20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f16e0002a50 tx=0x7f16e00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:56:00.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.571+0000 7f16e67fc700 1 -- 172.21.15.63:0/559180723 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16e0007cc0 con 0x7f16f0071bc0 2023-12-12T11:56:00.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.571+0000 7f16e67fc700 1 -- 172.21.15.63:0/559180723 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f16e000f040 con 0x7f16f0071bc0 2023-12-12T11:56:00.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.571+0000 7f16f802c700 1 -- 172.21.15.63:0/559180723 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f0110fa0 con 0x7f16f0071bc0 2023-12-12T11:56:00.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.572+0000 7f16e67fc700 1 -- 172.21.15.63:0/559180723 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16e000d9c0 con 0x7f16f0071bc0 2023-12-12T11:56:00.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.572+0000 7f16f802c700 1 -- 172.21.15.63:0/559180723 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f01114e0 con 0x7f16f0071bc0 2023-12-12T11:56:00.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.573+0000 7f16f802c700 1 -- 172.21.15.63:0/559180723 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f01096f0 con 0x7f16f0071bc0 2023-12-12T11:56:00.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.574+0000 7f16e67fc700 1 -- 172.21.15.63:0/559180723 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f16e000db20 con 0x7f16f0071bc0 2023-12-12T11:56:00.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.575+0000 7f16e67fc700 1 --2- 172.21.15.63:0/559180723 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f16dc06ce70 0x7f16dc06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:00.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.575+0000 7f16e67fc700 1 -- 172.21.15.63:0/559180723 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f16e008bff0 con 0x7f16f0071bc0 2023-12-12T11:56:00.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.575+0000 7f16f5dc8700 1 --2- 172.21.15.63:0/559180723 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f16dc06ce70 0x7f16dc06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:56:00.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.576+0000 7f16f5dc8700 1 --2- 172.21.15.63:0/559180723 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f16dc06ce70 0x7f16dc06f320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f16ec009fd0 tx=0x7f16ec009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:56:00.581 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.579+0000 7f16e67fc700 1 -- 172.21.15.63:0/559180723 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f16e0059900 con 0x7f16f0071bc0 2023-12-12T11:56:00.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.834+0000 7f16f802c700 1 -- 172.21.15.63:0/559180723 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f16f0107900 con 0x7f16f0071bc0 2023-12-12T11:56:00.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.835+0000 7f16e67fc700 1 -- 172.21.15.63:0/559180723 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1845 (secure 0 0 0) 0x7f16e0059490 con 0x7f16f0071bc0 2023-12-12T11:56:00.837 INFO:teuthology.orchestra.run.smithi063.stdout:e13 2023-12-12T11:56:00.838 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-12T11:56:00.838 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:56:00.838 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-12T11:56:00.838 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:56:00.838 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-12T11:56:00.838 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-12T11:56:00.838 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 13 2023-12-12T11:56:00.838 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-12T11:56:00.838 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-12T11:48:58.523481+0000 2023-12-12T11:56:00.838 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-12T11:49:14.113993+0000 2023-12-12T11:56:00.838 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-12T11:56:00.838 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-12T11:56:00.838 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-12T11:56:00.839 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-12T11:56:00.839 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-12T11:56:00.839 INFO:teuthology.orchestra.run.smithi063.stdout:max_xattr_size 65536 2023-12-12T11:56:00.839 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-12T11:56:00.839 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-12T11:56:00.839 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 46 2023-12-12T11:56:00.839 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:56:00.839 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 1 2023-12-12T11:56:00.839 INFO:teuthology.orchestra.run.smithi063.stdout:in 0 2023-12-12T11:56:00.839 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=14492} 2023-12-12T11:56:00.839 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-12T11:56:00.839 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-12T11:56:00.839 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-12T11:56:00.839 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-12T11:56:00.840 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-12T11:56:00.840 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data enabled 2023-12-12T11:56:00.840 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-12T11:56:00.840 INFO:teuthology.orchestra.run.smithi063.stdout:bal_rank_mask -1 2023-12-12T11:56:00.840 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 1 2023-12-12T11:56:00.840 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.aevpzg{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.63:6828/3709000039,v1:172.21.15.63:6829/3709000039] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:56:00.840 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:56:00.840 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:56:00.840 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2023-12-12T11:56:00.840 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:56:00.840 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.swdqms{-1:14500} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.93:6826/3307558569,v1:172.21.15.93:6827/3307558569] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:56:00.840 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.bdqbnp{-1:14508} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/2191270944,v1:172.21.15.63:6827/2191270944] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:56:00.840 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.rhaqsh{-1:24317} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.93:6824/3161864019,v1:172.21.15.93:6825/3161864019] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:56:00.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.837+0000 7f16f802c700 1 -- 172.21.15.63:0/559180723 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f16dc06ce70 msgr2=0x7f16dc06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:00.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.837+0000 7f16f802c700 1 --2- 172.21.15.63:0/559180723 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f16dc06ce70 0x7f16dc06f320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f16ec009fd0 tx=0x7f16ec009e30 comp rx=0 tx=0).stop 2023-12-12T11:56:00.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.837+0000 7f16f802c700 1 -- 172.21.15.63:0/559180723 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16f0071bc0 msgr2=0x7f16f010fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:00.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.837+0000 7f16f802c700 1 --2- 172.21.15.63:0/559180723 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16f0071bc0 0x7f16f010fe20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f16e0002a50 tx=0x7f16e00046b0 comp rx=0 tx=0).stop 2023-12-12T11:56:00.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.837+0000 7f16f802c700 1 -- 172.21.15.63:0/559180723 shutdown_connections 2023-12-12T11:56:00.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.837+0000 7f16f802c700 1 --2- 172.21.15.63:0/559180723 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f16dc06ce70 0x7f16dc06f320 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:00.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.837+0000 7f16f802c700 1 --2- 172.21.15.63:0/559180723 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16f0070570 0x7f16f010f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:00.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.837+0000 7f16f802c700 1 --2- 172.21.15.63:0/559180723 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16f0071bc0 0x7f16f010fe20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:00.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.837+0000 7f16f802c700 1 -- 172.21.15.63:0/559180723 >> 172.21.15.63:0/559180723 conn(0x7f16f00f82d0 msgr2=0x7f16f0103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:56:00.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.837+0000 7f16f802c700 1 -- 172.21.15.63:0/559180723 shutdown_connections 2023-12-12T11:56:00.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.837+0000 7f16f802c700 1 -- 172.21.15.63:0/559180723 wait complete. 2023-12-12T11:56:00.842 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 13 2023-12-12T11:56:00.979 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.976+0000 7fa9d1a54700 1 -- 172.21.15.63:0/2264969044 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9cc0fcbf0 msgr2=0x7fa9cc0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:00.979 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.976+0000 7fa9d1a54700 1 --2- 172.21.15.63:0/2264969044 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9cc0fcbf0 0x7fa9cc0fd000 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc004940 tx=0x7fa9bc009e30 comp rx=0 tx=0).stop 2023-12-12T11:56:00.979 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.976+0000 7fa9d1a54700 1 -- 172.21.15.63:0/2264969044 shutdown_connections 2023-12-12T11:56:00.979 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.976+0000 7fa9d1a54700 1 --2- 172.21.15.63:0/2264969044 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa9cc0fde00 0x7fa9cc0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:00.979 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.976+0000 7fa9d1a54700 1 --2- 172.21.15.63:0/2264969044 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9cc0fcbf0 0x7fa9cc0fd000 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:00.979 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.976+0000 7fa9d1a54700 1 -- 172.21.15.63:0/2264969044 >> 172.21.15.63:0/2264969044 conn(0x7fa9cc0f82d0 msgr2=0x7fa9cc0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:56:00.979 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.976+0000 7fa9d1a54700 1 -- 172.21.15.63:0/2264969044 shutdown_connections 2023-12-12T11:56:00.979 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.976+0000 7fa9d1a54700 1 -- 172.21.15.63:0/2264969044 wait complete. 2023-12-12T11:56:00.980 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.977+0000 7fa9d1a54700 1 Processor -- start 2023-12-12T11:56:00.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.977+0000 7fa9d1a54700 1 -- start start 2023-12-12T11:56:00.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.978+0000 7fa9d1a54700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9cc0fcbf0 0x7fa9cc10f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:00.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.978+0000 7fa9d1a54700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa9cc0fde00 0x7fa9cc10fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:00.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.978+0000 7fa9d1a54700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc110200 con 0x7fa9cc0fcbf0 2023-12-12T11:56:00.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.978+0000 7fa9d1a54700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc110aa0 con 0x7fa9cc0fde00 2023-12-12T11:56:00.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.978+0000 7fa9caffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9cc0fcbf0 0x7fa9cc10f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:56:00.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.978+0000 7fa9caffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9cc0fcbf0 0x7fa9cc10f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55768/0 (socket says 172.21.15.63:55768) 2023-12-12T11:56:00.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.978+0000 7fa9caffd700 1 -- 172.21.15.63:0/2022366630 learned_addr learned my addr 172.21.15.63:0/2022366630 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:56:00.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.978+0000 7fa9ca7fc700 1 --2- 172.21.15.63:0/2022366630 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa9cc0fde00 0x7fa9cc10fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:56:00.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.978+0000 7fa9caffd700 1 -- 172.21.15.63:0/2022366630 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa9cc0fde00 msgr2=0x7fa9cc10fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:00.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.978+0000 7fa9caffd700 1 --2- 172.21.15.63:0/2022366630 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa9cc0fde00 0x7fa9cc10fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:00.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.978+0000 7fa9caffd700 1 -- 172.21.15.63:0/2022366630 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9bc005040 con 0x7fa9cc0fcbf0 2023-12-12T11:56:00.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.978+0000 7fa9ca7fc700 1 --2- 172.21.15.63:0/2022366630 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa9cc0fde00 0x7fa9cc10fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T11:56:00.982 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.979+0000 7fa9caffd700 1 --2- 172.21.15.63:0/2022366630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9cc0fcbf0 0x7fa9cc10f6c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc000c00 tx=0x7fa9bc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:56:00.982 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.979+0000 7fa9b37fe700 1 -- 172.21.15.63:0/2022366630 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9bc00e040 con 0x7fa9cc0fcbf0 2023-12-12T11:56:00.982 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.979+0000 7fa9b37fe700 1 -- 172.21.15.63:0/2022366630 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa9bc00bc50 con 0x7fa9cc0fcbf0 2023-12-12T11:56:00.982 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.979+0000 7fa9d1a54700 1 -- 172.21.15.63:0/2022366630 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9cc110d20 con 0x7fa9cc0fcbf0 2023-12-12T11:56:00.982 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.979+0000 7fa9b37fe700 1 -- 172.21.15.63:0/2022366630 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9bc01c630 con 0x7fa9cc0fcbf0 2023-12-12T11:56:00.983 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.979+0000 7fa9d1a54700 1 -- 172.21.15.63:0/2022366630 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9cc111260 con 0x7fa9cc0fcbf0 2023-12-12T11:56:00.983 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.980+0000 7fa9d1a54700 1 -- 172.21.15.63:0/2022366630 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9cc101ea0 con 0x7fa9cc0fcbf0 2023-12-12T11:56:00.983 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.981+0000 7fa9b37fe700 1 -- 172.21.15.63:0/2022366630 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fa9bc013420 con 0x7fa9cc0fcbf0 2023-12-12T11:56:00.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.982+0000 7fa9b37fe700 1 --2- 172.21.15.63:0/2022366630 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fa9b406ce70 0x7fa9b406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:00.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.982+0000 7fa9b37fe700 1 -- 172.21.15.63:0/2022366630 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fa9bc08d5d0 con 0x7fa9cc0fcbf0 2023-12-12T11:56:00.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.982+0000 7fa9ca7fc700 1 --2- 172.21.15.63:0/2022366630 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fa9b406ce70 0x7fa9b406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:56:00.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.983+0000 7fa9ca7fc700 1 --2- 172.21.15.63:0/2022366630 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fa9b406ce70 0x7fa9b406f320 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0007fd0 tx=0x7fa9c0009f60 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:56:00.989 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:00.986+0000 7fa9b37fe700 1 -- 172.21.15.63:0/2022366630 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa9bc05af60 con 0x7fa9cc0fcbf0 2023-12-12T11:56:01.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.215+0000 7fa9d1a54700 1 -- 172.21.15.63:0/2022366630 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9cc1114d0 con 0x7fa9b406ce70 2023-12-12T11:56:01.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.216+0000 7fa9b37fe700 1 -- 172.21.15.63:0/2022366630 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa9cc1114d0 con 0x7fa9b406ce70 2023-12-12T11:56:01.219 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:56:01.219 INFO:teuthology.orchestra.run.smithi063.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dbb46fd2dbbe029cfba763f2b7c769e980f86b63e74be0c72e188909e20b81f3", 2023-12-12T11:56:01.219 INFO:teuthology.orchestra.run.smithi063.stdout: "in_progress": true, 2023-12-12T11:56:01.219 INFO:teuthology.orchestra.run.smithi063.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-12T11:56:01.219 INFO:teuthology.orchestra.run.smithi063.stdout: "services_complete": [ 2023-12-12T11:56:01.219 INFO:teuthology.orchestra.run.smithi063.stdout: "mon", 2023-12-12T11:56:01.219 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr", 2023-12-12T11:56:01.219 INFO:teuthology.orchestra.run.smithi063.stdout: "crash" 2023-12-12T11:56:01.219 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2023-12-12T11:56:01.220 INFO:teuthology.orchestra.run.smithi063.stdout: "progress": "8/21 daemons upgraded", 2023-12-12T11:56:01.220 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "Currently upgrading osd daemons", 2023-12-12T11:56:01.220 INFO:teuthology.orchestra.run.smithi063.stdout: "is_paused": false 2023-12-12T11:56:01.220 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:56:01.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.218+0000 7fa9d1a54700 1 -- 172.21.15.63:0/2022366630 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fa9b406ce70 msgr2=0x7fa9b406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:01.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.218+0000 7fa9d1a54700 1 --2- 172.21.15.63:0/2022366630 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fa9b406ce70 0x7fa9b406f320 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0007fd0 tx=0x7fa9c0009f60 comp rx=0 tx=0).stop 2023-12-12T11:56:01.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.218+0000 7fa9d1a54700 1 -- 172.21.15.63:0/2022366630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9cc0fcbf0 msgr2=0x7fa9cc10f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:01.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.218+0000 7fa9d1a54700 1 --2- 172.21.15.63:0/2022366630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9cc0fcbf0 0x7fa9cc10f6c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc000c00 tx=0x7fa9bc009e30 comp rx=0 tx=0).stop 2023-12-12T11:56:01.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.219+0000 7fa9d1a54700 1 -- 172.21.15.63:0/2022366630 shutdown_connections 2023-12-12T11:56:01.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.219+0000 7fa9d1a54700 1 --2- 172.21.15.63:0/2022366630 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fa9b406ce70 0x7fa9b406f320 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:01.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.219+0000 7fa9d1a54700 1 --2- 172.21.15.63:0/2022366630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9cc0fcbf0 0x7fa9cc10f6c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:01.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.219+0000 7fa9d1a54700 1 --2- 172.21.15.63:0/2022366630 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa9cc0fde00 0x7fa9cc10fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:01.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.219+0000 7fa9d1a54700 1 -- 172.21.15.63:0/2022366630 >> 172.21.15.63:0/2022366630 conn(0x7fa9cc0f82d0 msgr2=0x7fa9cc0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:56:01.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.219+0000 7fa9d1a54700 1 -- 172.21.15.63:0/2022366630 shutdown_connections 2023-12-12T11:56:01.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.219+0000 7fa9d1a54700 1 -- 172.21.15.63:0/2022366630 wait complete. 2023-12-12T11:56:01.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.356+0000 7eff51f88700 1 -- 172.21.15.63:0/3688935852 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff4c0fcbf0 msgr2=0x7eff4c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:01.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.356+0000 7eff51f88700 1 --2- 172.21.15.63:0/3688935852 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff4c0fcbf0 0x7eff4c0fd000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7eff3c004940 tx=0x7eff3c009e30 comp rx=0 tx=0).stop 2023-12-12T11:56:01.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.357+0000 7eff51f88700 1 -- 172.21.15.63:0/3688935852 shutdown_connections 2023-12-12T11:56:01.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.357+0000 7eff51f88700 1 --2- 172.21.15.63:0/3688935852 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7eff4c0fde00 0x7eff4c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:01.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.357+0000 7eff51f88700 1 --2- 172.21.15.63:0/3688935852 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff4c0fcbf0 0x7eff4c0fd000 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:01.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.357+0000 7eff51f88700 1 -- 172.21.15.63:0/3688935852 >> 172.21.15.63:0/3688935852 conn(0x7eff4c0f82d0 msgr2=0x7eff4c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:56:01.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.357+0000 7eff51f88700 1 -- 172.21.15.63:0/3688935852 shutdown_connections 2023-12-12T11:56:01.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.357+0000 7eff51f88700 1 -- 172.21.15.63:0/3688935852 wait complete. 2023-12-12T11:56:01.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.358+0000 7eff51f88700 1 Processor -- start 2023-12-12T11:56:01.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.358+0000 7eff51f88700 1 -- start start 2023-12-12T11:56:01.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.359+0000 7eff51f88700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff4c0fcbf0 0x7eff4c10d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:01.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.359+0000 7eff51f88700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7eff4c0fde00 0x7eff4c10daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:01.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.359+0000 7eff51f88700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c10e0a0 con 0x7eff4c0fcbf0 2023-12-12T11:56:01.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.359+0000 7eff51f88700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c10e940 con 0x7eff4c0fde00 2023-12-12T11:56:01.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.359+0000 7eff4b7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff4c0fcbf0 0x7eff4c10d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:56:01.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.359+0000 7eff4b7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff4c0fcbf0 0x7eff4c10d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55788/0 (socket says 172.21.15.63:55788) 2023-12-12T11:56:01.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.359+0000 7eff4b7fe700 1 -- 172.21.15.63:0/3714454770 learned_addr learned my addr 172.21.15.63:0/3714454770 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:56:01.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.359+0000 7eff4b7fe700 1 -- 172.21.15.63:0/3714454770 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7eff4c0fde00 msgr2=0x7eff4c10daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:01.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.359+0000 7eff4b7fe700 1 --2- 172.21.15.63:0/3714454770 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7eff4c0fde00 0x7eff4c10daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:01.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.359+0000 7eff4b7fe700 1 -- 172.21.15.63:0/3714454770 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c005040 con 0x7eff4c0fcbf0 2023-12-12T11:56:01.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.360+0000 7eff4b7fe700 1 --2- 172.21.15.63:0/3714454770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff4c0fcbf0 0x7eff4c10d560 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7eff3c009380 tx=0x7eff3c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:56:01.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.360+0000 7eff33fff700 1 -- 172.21.15.63:0/3714454770 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff3c00e040 con 0x7eff4c0fcbf0 2023-12-12T11:56:01.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.360+0000 7eff33fff700 1 -- 172.21.15.63:0/3714454770 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7eff3c004290 con 0x7eff4c0fcbf0 2023-12-12T11:56:01.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.360+0000 7eff51f88700 1 -- 172.21.15.63:0/3714454770 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff4c10ebc0 con 0x7eff4c0fcbf0 2023-12-12T11:56:01.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.360+0000 7eff33fff700 1 -- 172.21.15.63:0/3714454770 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff3c013ea0 con 0x7eff4c0fcbf0 2023-12-12T11:56:01.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.360+0000 7eff51f88700 1 -- 172.21.15.63:0/3714454770 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff4c10f100 con 0x7eff4c0fcbf0 2023-12-12T11:56:01.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.361+0000 7eff51f88700 1 -- 172.21.15.63:0/3714454770 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff4c04bb80 con 0x7eff4c0fcbf0 2023-12-12T11:56:01.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.362+0000 7eff33fff700 1 -- 172.21.15.63:0/3714454770 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7eff3c00bc50 con 0x7eff4c0fcbf0 2023-12-12T11:56:01.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.363+0000 7eff33fff700 1 --2- 172.21.15.63:0/3714454770 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7eff3406ce70 0x7eff3406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:01.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.363+0000 7eff33fff700 1 -- 172.21.15.63:0/3714454770 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6500+0+0 (secure 0 0 0) 0x7eff3c08d7b0 con 0x7eff4c0fcbf0 2023-12-12T11:56:01.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.363+0000 7eff4affd700 1 --2- 172.21.15.63:0/3714454770 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7eff3406ce70 0x7eff3406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:56:01.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.364+0000 7eff4affd700 1 --2- 172.21.15.63:0/3714454770 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7eff3406ce70 0x7eff3406f320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7eff40004d00 tx=0x7eff40009ce0 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:56:01.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.367+0000 7eff33fff700 1 -- 172.21.15.63:0/3714454770 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7eff3c05b140 con 0x7eff4c0fcbf0 2023-12-12T11:56:01.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:01 smithi093 ceph-mon[171709]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:56:01.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:01 smithi093 ceph-mon[171709]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:56:01.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:01 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/631166786' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:56:01.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:01 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/559180723' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:56:01.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:01 smithi063 ceph-mon[187282]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:56:01.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:01 smithi063 ceph-mon[187282]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:56:01.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:01 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/631166786' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:56:01.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:01 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/559180723' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:56:01.689 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.687+0000 7eff51f88700 1 -- 172.21.15.63:0/3714454770 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7eff4c105590 con 0x7eff4c0fcbf0 2023-12-12T11:56:01.689 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.687+0000 7eff33fff700 1 -- 172.21.15.63:0/3714454770 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+758 (secure 0 0 0) 0x7eff3c05acd0 con 0x7eff4c0fcbf0 2023-12-12T11:56:01.690 INFO:teuthology.orchestra.run.smithi063.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 16/219 objects degraded (7.306%), 7 pgs degraded 2023-12-12T11:56:01.690 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-12T11:56:01.690 INFO:teuthology.orchestra.run.smithi063.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-12T11:56:01.690 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 16/219 objects degraded (7.306%), 7 pgs degraded 2023-12-12T11:56:01.690 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2023-12-12T11:56:01.690 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2023-12-12T11:56:01.690 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2023-12-12T11:56:01.690 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2023-12-12T11:56:01.690 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2023-12-12T11:56:01.690 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2023-12-12T11:56:01.690 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2023-12-12T11:56:01.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.690+0000 7eff51f88700 1 -- 172.21.15.63:0/3714454770 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7eff3406ce70 msgr2=0x7eff3406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:01.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.690+0000 7eff51f88700 1 --2- 172.21.15.63:0/3714454770 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7eff3406ce70 0x7eff3406f320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7eff40004d00 tx=0x7eff40009ce0 comp rx=0 tx=0).stop 2023-12-12T11:56:01.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.690+0000 7eff51f88700 1 -- 172.21.15.63:0/3714454770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff4c0fcbf0 msgr2=0x7eff4c10d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:01.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.690+0000 7eff51f88700 1 --2- 172.21.15.63:0/3714454770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff4c0fcbf0 0x7eff4c10d560 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7eff3c009380 tx=0x7eff3c009e30 comp rx=0 tx=0).stop 2023-12-12T11:56:01.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.690+0000 7eff51f88700 1 -- 172.21.15.63:0/3714454770 shutdown_connections 2023-12-12T11:56:01.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.690+0000 7eff51f88700 1 --2- 172.21.15.63:0/3714454770 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7eff3406ce70 0x7eff3406f320 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:01.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.690+0000 7eff51f88700 1 --2- 172.21.15.63:0/3714454770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff4c0fcbf0 0x7eff4c10d560 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:01.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.690+0000 7eff51f88700 1 --2- 172.21.15.63:0/3714454770 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7eff4c0fde00 0x7eff4c10daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:01.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.690+0000 7eff51f88700 1 -- 172.21.15.63:0/3714454770 >> 172.21.15.63:0/3714454770 conn(0x7eff4c0f82d0 msgr2=0x7eff4c101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:56:01.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.690+0000 7eff51f88700 1 -- 172.21.15.63:0/3714454770 shutdown_connections 2023-12-12T11:56:01.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:01.690+0000 7eff51f88700 1 -- 172.21.15.63:0/3714454770 wait complete. 2023-12-12T11:56:02.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:02 smithi093 ceph-mon[171709]: from='client.34242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:56:02.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:02 smithi093 ceph-mon[171709]: pgmap v71: 65 pgs: 2 peering, 63 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:02.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:02 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/3714454770' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:56:02.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:02 smithi063 ceph-mon[187282]: from='client.34242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:56:02.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:02 smithi063 ceph-mon[187282]: pgmap v71: 65 pgs: 2 peering, 63 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:02.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:02 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/3714454770' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:56:03.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:03 smithi093 ceph-mon[171709]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/219 objects degraded (7.306%), 7 pgs degraded) 2023-12-12T11:56:03.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:03 smithi063 ceph-mon[187282]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/219 objects degraded (7.306%), 7 pgs degraded) 2023-12-12T11:56:04.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:04 smithi093 ceph-mon[171709]: pgmap v72: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:04.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:04 smithi063 ceph-mon[187282]: pgmap v72: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:06.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:05 smithi063 ceph-mon[187282]: pgmap v73: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:06.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:05 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:06.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:05 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:56:06.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:05 smithi093 ceph-mon[171709]: pgmap v73: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:06.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:05 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:06.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:05 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:56:07.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:07 smithi093 ceph-mon[171709]: pgmap v74: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:07.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:07 smithi063 ceph-mon[187282]: pgmap v74: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:09.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:09 smithi093 ceph-mon[171709]: pgmap v75: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:09.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:09 smithi063 ceph-mon[187282]: pgmap v75: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:11.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:11 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:11.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:11 smithi093 ceph-mon[171709]: pgmap v76: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:11.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:11 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:11.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:11 smithi063 ceph-mon[187282]: pgmap v76: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:12.708 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:12 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-12T11:56:12.708 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:12 smithi063 ceph-mon[187282]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-12T11:56:12.708 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:12 smithi063 ceph-mon[187282]: Upgrade: osd.2 is safe to restart 2023-12-12T11:56:12.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:12 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-12T11:56:12.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:12 smithi093 ceph-mon[171709]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-12T11:56:12.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:12 smithi093 ceph-mon[171709]: Upgrade: osd.2 is safe to restart 2023-12-12T11:56:14.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:14 smithi063 ceph-mon[187282]: Upgrade: Updating osd.2 2023-12-12T11:56:14.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:14 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:14.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:14 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-12T11:56:14.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:14 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:56:14.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:14 smithi063 ceph-mon[187282]: Deploying daemon osd.2 on smithi063 2023-12-12T11:56:14.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:14 smithi063 ceph-mon[187282]: pgmap v77: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:14.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:14 smithi093 ceph-mon[171709]: Upgrade: Updating osd.2 2023-12-12T11:56:14.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:14 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:14.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:14 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-12T11:56:14.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:14 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:56:14.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:14 smithi093 ceph-mon[171709]: Deploying daemon osd.2 on smithi063 2023-12-12T11:56:14.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:14 smithi093 ceph-mon[171709]: pgmap v77: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:15.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:15 smithi063 ceph-mon[187282]: pgmap v78: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:16.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:15 smithi093 ceph-mon[171709]: pgmap v78: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:16.539 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:56:16 smithi063 systemd[1]: Stopping Ceph osd.2 for 85e33c70-98e3-11ee-95a3-87774f69a715... 2023-12-12T11:56:16.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:16 smithi063 ceph-mon[187282]: osd.2 marked itself down and dead 2023-12-12T11:56:16.795 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:56:16 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-2[149451]: 2023-12-12T11:56:16.535+0000 7fe8dda0b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-12T11:56:16.795 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:56:16 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-2[149451]: 2023-12-12T11:56:16.535+0000 7fe8dda0b700 -1 osd.2 59 *** Got signal Terminated *** 2023-12-12T11:56:16.795 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:56:16 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-2[149451]: 2023-12-12T11:56:16.535+0000 7fe8dda0b700 -1 osd.2 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-12T11:56:17.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:16 smithi093 ceph-mon[171709]: osd.2 marked itself down and dead 2023-12-12T11:56:17.545 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:56:17 smithi063 bash[209897]: ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-2 2023-12-12T11:56:18.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:17 smithi063 ceph-mon[187282]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-12T11:56:18.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:17 smithi063 ceph-mon[187282]: osdmap e60: 6 total, 5 up, 6 in 2023-12-12T11:56:18.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:17 smithi063 ceph-mon[187282]: failed to encode map e60 with expected crc 2023-12-12T11:56:18.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:17 smithi063 ceph-mon[187282]: failed to encode map e60 with expected crc 2023-12-12T11:56:18.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:17 smithi063 ceph-mon[187282]: failed to encode map e60 with expected crc 2023-12-12T11:56:18.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:17 smithi063 ceph-mon[187282]: pgmap v80: 65 pgs: 9 stale+active+clean, 56 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:18.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:17 smithi093 ceph-mon[171709]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-12T11:56:18.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:17 smithi093 ceph-mon[171709]: osdmap e60: 6 total, 5 up, 6 in 2023-12-12T11:56:18.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:17 smithi093 ceph-mon[171709]: failed to encode map e60 with expected crc 2023-12-12T11:56:18.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:17 smithi093 ceph-mon[171709]: failed to encode map e60 with expected crc 2023-12-12T11:56:18.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:17 smithi093 ceph-mon[171709]: failed to encode map e60 with expected crc 2023-12-12T11:56:18.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:17 smithi093 ceph-mon[171709]: pgmap v80: 65 pgs: 9 stale+active+clean, 56 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:18.936 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:18 smithi063 ceph-mon[187282]: osdmap e61: 6 total, 5 up, 6 in 2023-12-12T11:56:18.936 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:18 smithi063 ceph-mon[187282]: failed to encode map e61 with expected crc 2023-12-12T11:56:18.936 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:18 smithi063 ceph-mon[187282]: failed to encode map e61 with expected crc 2023-12-12T11:56:18.936 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:18 smithi063 ceph-mon[187282]: failed to encode map e61 with expected crc 2023-12-12T11:56:18.937 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:18 smithi063 ceph-mon[187282]: failed to encode map e61 with expected crc 2023-12-12T11:56:18.937 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:18 smithi063 ceph-mon[187282]: failed to encode map e61 with expected crc 2023-12-12T11:56:18.937 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:18 smithi063 ceph-mon[187282]: failed to encode map e61 with expected crc 2023-12-12T11:56:19.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:18 smithi093 ceph-mon[171709]: osdmap e61: 6 total, 5 up, 6 in 2023-12-12T11:56:19.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:18 smithi093 ceph-mon[171709]: failed to encode map e61 with expected crc 2023-12-12T11:56:19.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:18 smithi093 ceph-mon[171709]: failed to encode map e61 with expected crc 2023-12-12T11:56:19.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:18 smithi093 ceph-mon[171709]: failed to encode map e61 with expected crc 2023-12-12T11:56:19.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:18 smithi093 ceph-mon[171709]: failed to encode map e61 with expected crc 2023-12-12T11:56:19.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:18 smithi093 ceph-mon[171709]: failed to encode map e61 with expected crc 2023-12-12T11:56:19.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:18 smithi093 ceph-mon[171709]: failed to encode map e61 with expected crc 2023-12-12T11:56:19.267 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:56:18 smithi063 systemd[1]: ceph-85e33c70-98e3-11ee-95a3-87774f69a715@osd.2.service: Succeeded. 2023-12-12T11:56:19.267 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:56:18 smithi063 systemd[1]: Stopped Ceph osd.2 for 85e33c70-98e3-11ee-95a3-87774f69a715. 2023-12-12T11:56:19.545 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:56:19 smithi063 systemd[1]: Starting Ceph osd.2 for 85e33c70-98e3-11ee-95a3-87774f69a715... 2023-12-12T11:56:20.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:19 smithi063 ceph-mon[187282]: pgmap v82: 65 pgs: 9 stale+active+clean, 56 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:20.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:19 smithi093 ceph-mon[171709]: pgmap v82: 65 pgs: 9 stale+active+clean, 56 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:20.794 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:56:20 smithi063 bash[210165]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-12T11:56:20.794 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:56:20 smithi063 bash[210165]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-12-12T11:56:20.795 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:56:20 smithi063 bash[210165]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-12-12T11:56:20.795 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:56:20 smithi063 bash[210165]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-12-12T11:56:20.795 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:56:20 smithi063 bash[210165]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2023-12-12T11:56:20.795 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:56:20 smithi063 bash[210165]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-12T11:56:20.795 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:56:20 smithi063 bash[210165]: --> ceph-volume raw activate successful for osd ID: 2 2023-12-12T11:56:21.544 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:56:21 smithi063 bash[210422]: bc155cfbaf869d3db46ed3790bb00462675445601c1c252433ce04479f58c1f0 2023-12-12T11:56:21.545 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:56:21 smithi063 systemd[1]: Started Ceph osd.2 for 85e33c70-98e3-11ee-95a3-87774f69a715. 2023-12-12T11:56:21.545 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:56:21 smithi063 ceph-osd[210460]: -- 172.21.15.63:0/3885086181 <== mon.0 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564a92a1f6c0 con 0x564a929ef000 2023-12-12T11:56:21.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:21 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:21.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:21 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:56:21.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:21 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:21.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:21 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:21.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:21 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:56:21.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:21 smithi063 ceph-mon[187282]: pgmap v83: 65 pgs: 8 active+undersized+degraded, 3 stale+active+clean, 11 active+undersized, 43 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 23/219 objects degraded (10.502%) 2023-12-12T11:56:21.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:21 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:21.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:21 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:56:21.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:21 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:21.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:21 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:21.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:21 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:56:21.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:21 smithi093 ceph-mon[171709]: pgmap v83: 65 pgs: 8 active+undersized+degraded, 3 stale+active+clean, 11 active+undersized, 43 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 23/219 objects degraded (10.502%) 2023-12-12T11:56:22.044 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:56:21 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-2[210437]: 2023-12-12T11:56:21.748+0000 7f814fdfe640 -1 Falling back to public interface 2023-12-12T11:56:22.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:22 smithi093 ceph-mon[171709]: Health check failed: Degraded data redundancy: 23/219 objects degraded (10.502%), 8 pgs degraded (PG_DEGRADED) 2023-12-12T11:56:22.776 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:22 smithi063 ceph-mon[187282]: Health check failed: Degraded data redundancy: 23/219 objects degraded (10.502%), 8 pgs degraded (PG_DEGRADED) 2023-12-12T11:56:23.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:23 smithi093 ceph-mon[171709]: pgmap v84: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2023-12-12T11:56:23.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:23 smithi063 ceph-mon[187282]: pgmap v84: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2023-12-12T11:56:26.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:25 smithi063 ceph-mon[187282]: pgmap v85: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2023-12-12T11:56:26.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:25 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:26.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:25 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:26.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:25 smithi093 ceph-mon[171709]: pgmap v85: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2023-12-12T11:56:26.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:25 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:26.222 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:25 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:26.544 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:56:26 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-2[210437]: 2023-12-12T11:56:26.291+0000 7f814fdfe640 -1 osd.2 0 read_superblock omap replica is missing. 2023-12-12T11:56:27.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:26 smithi093 ceph-mon[171709]: from='osd.2 [v2:172.21.15.63:6818/2611117524,v1:172.21.15.63:6819/2611117524]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-12T11:56:27.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:26 smithi063 ceph-mon[187282]: from='osd.2 [v2:172.21.15.63:6818/2611117524,v1:172.21.15.63:6819/2611117524]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-12T11:56:27.295 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:56:26 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-2[210437]: 2023-12-12T11:56:26.881+0000 7f814fdfe640 -1 osd.2 59 log_to_monitors true 2023-12-12T11:56:27.295 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:56:26 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-2[210437]: 2023-12-12T11:56:26.975+0000 7f8140a6e700 -1 osd.2 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T11:56:28.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:27 smithi063 ceph-mon[187282]: from='osd.2 [v2:172.21.15.63:6818/2611117524,v1:172.21.15.63:6819/2611117524]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-12T11:56:28.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:27 smithi063 ceph-mon[187282]: osdmap e62: 6 total, 5 up, 6 in 2023-12-12T11:56:28.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:27 smithi063 ceph-mon[187282]: from='osd.2 [v2:172.21.15.63:6818/2611117524,v1:172.21.15.63:6819/2611117524]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2023-12-12T11:56:28.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:27 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:28.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:27 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:28.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:27 smithi063 ceph-mon[187282]: pgmap v87: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2023-12-12T11:56:28.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:27 smithi063 ceph-mon[187282]: failed to encode map e62 with expected crc 2023-12-12T11:56:28.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:27 smithi093 ceph-mon[171709]: from='osd.2 [v2:172.21.15.63:6818/2611117524,v1:172.21.15.63:6819/2611117524]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-12T11:56:28.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:27 smithi093 ceph-mon[171709]: osdmap e62: 6 total, 5 up, 6 in 2023-12-12T11:56:28.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:27 smithi093 ceph-mon[171709]: from='osd.2 [v2:172.21.15.63:6818/2611117524,v1:172.21.15.63:6819/2611117524]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2023-12-12T11:56:28.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:27 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:28.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:27 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:28.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:27 smithi093 ceph-mon[171709]: pgmap v87: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2023-12-12T11:56:28.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:27 smithi093 ceph-mon[171709]: failed to encode map e62 with expected crc 2023-12-12T11:56:29.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:28 smithi093 ceph-mon[171709]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-12T11:56:29.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:28 smithi093 ceph-mon[171709]: osd.2 [v2:172.21.15.63:6818/2611117524,v1:172.21.15.63:6819/2611117524] boot 2023-12-12T11:56:29.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:28 smithi093 ceph-mon[171709]: osdmap e63: 6 total, 6 up, 6 in 2023-12-12T11:56:29.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:28 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-12T11:56:29.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:28 smithi093 ceph-mon[171709]: failed to encode map e62 with expected crc 2023-12-12T11:56:29.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:28 smithi093 ceph-mon[171709]: failed to encode map e63 with expected crc 2023-12-12T11:56:29.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:28 smithi093 ceph-mon[171709]: failed to encode map e62 with expected crc 2023-12-12T11:56:29.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:28 smithi093 ceph-mon[171709]: osdmap e64: 6 total, 6 up, 6 in 2023-12-12T11:56:29.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:28 smithi063 ceph-mon[187282]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-12T11:56:29.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:28 smithi063 ceph-mon[187282]: osd.2 [v2:172.21.15.63:6818/2611117524,v1:172.21.15.63:6819/2611117524] boot 2023-12-12T11:56:29.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:28 smithi063 ceph-mon[187282]: osdmap e63: 6 total, 6 up, 6 in 2023-12-12T11:56:29.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:28 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-12T11:56:29.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:28 smithi063 ceph-mon[187282]: failed to encode map e62 with expected crc 2023-12-12T11:56:29.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:28 smithi063 ceph-mon[187282]: failed to encode map e63 with expected crc 2023-12-12T11:56:29.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:28 smithi063 ceph-mon[187282]: failed to encode map e62 with expected crc 2023-12-12T11:56:29.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:28 smithi063 ceph-mon[187282]: osdmap e64: 6 total, 6 up, 6 in 2023-12-12T11:56:30.228 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:29 smithi063 ceph-mon[187282]: failed to encode map e64 with expected crc 2023-12-12T11:56:30.228 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:29 smithi063 ceph-mon[187282]: failed to encode map e64 with expected crc 2023-12-12T11:56:30.229 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:29 smithi063 ceph-mon[187282]: failed to encode map e64 with expected crc 2023-12-12T11:56:30.229 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:29 smithi063 ceph-mon[187282]: failed to encode map e64 with expected crc 2023-12-12T11:56:30.229 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:29 smithi063 ceph-mon[187282]: pgmap v90: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2023-12-12T11:56:30.229 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:29 smithi063 ceph-mon[187282]: Health check update: Degraded data redundancy: 32/219 objects degraded (14.612%), 11 pgs degraded (PG_DEGRADED) 2023-12-12T11:56:30.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:29 smithi093 ceph-mon[171709]: failed to encode map e64 with expected crc 2023-12-12T11:56:30.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:29 smithi093 ceph-mon[171709]: failed to encode map e64 with expected crc 2023-12-12T11:56:30.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:29 smithi093 ceph-mon[171709]: failed to encode map e64 with expected crc 2023-12-12T11:56:30.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:29 smithi093 ceph-mon[171709]: failed to encode map e64 with expected crc 2023-12-12T11:56:30.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:29 smithi093 ceph-mon[171709]: pgmap v90: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2023-12-12T11:56:30.472 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:29 smithi093 ceph-mon[171709]: Health check update: Degraded data redundancy: 32/219 objects degraded (14.612%), 11 pgs degraded (PG_DEGRADED) 2023-12-12T11:56:31.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:31 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:31.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:31 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:31.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:31 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:56:31.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:31 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:56:31.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:31 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:31.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:31 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:56:31.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:31 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:56:31.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:31 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:56:31.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:31 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:56:31.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:31 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-12T11:56:31.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:31 smithi093 ceph-mon[171709]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-12T11:56:31.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:31 smithi093 ceph-mon[171709]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-12T11:56:31.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:31 smithi093 ceph-mon[171709]: pgmap v91: 65 pgs: 6 active+undersized+degraded, 8 active+undersized, 51 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 20/219 objects degraded (9.132%) 2023-12-12T11:56:31.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:31 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:31.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:31 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:31.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:31 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:56:31.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:31 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:56:31.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:31 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:31.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:31 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:56:31.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:31 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:56:31.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:31 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:56:31.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:31 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:56:31.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:31 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-12T11:56:31.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:31 smithi063 ceph-mon[187282]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-12T11:56:31.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:31 smithi063 ceph-mon[187282]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-12T11:56:31.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:31 smithi063 ceph-mon[187282]: pgmap v91: 65 pgs: 6 active+undersized+degraded, 8 active+undersized, 51 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 20/219 objects degraded (9.132%) 2023-12-12T11:56:31.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.845+0000 7f1572011700 1 -- 172.21.15.63:0/3183281442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f156c0fde00 msgr2=0x7f156c0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:31.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.845+0000 7f1572011700 1 --2- 172.21.15.63:0/3183281442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f156c0fde00 0x7f156c0fe250 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1560004940 tx=0x7f1560009e30 comp rx=0 tx=0).stop 2023-12-12T11:56:31.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.845+0000 7f1572011700 1 -- 172.21.15.63:0/3183281442 shutdown_connections 2023-12-12T11:56:31.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.845+0000 7f1572011700 1 --2- 172.21.15.63:0/3183281442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f156c0fde00 0x7f156c0fe250 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:31.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.845+0000 7f1572011700 1 --2- 172.21.15.63:0/3183281442 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f156c0fcbf0 0x7f156c0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:31.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.845+0000 7f1572011700 1 -- 172.21.15.63:0/3183281442 >> 172.21.15.63:0/3183281442 conn(0x7f156c0f82d0 msgr2=0x7f156c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:56:31.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.845+0000 7f1572011700 1 -- 172.21.15.63:0/3183281442 shutdown_connections 2023-12-12T11:56:31.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.845+0000 7f1572011700 1 -- 172.21.15.63:0/3183281442 wait complete. 2023-12-12T11:56:31.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.846+0000 7f1572011700 1 Processor -- start 2023-12-12T11:56:31.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.846+0000 7f1572011700 1 -- start start 2023-12-12T11:56:31.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.846+0000 7f1572011700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f156c0fcbf0 0x7f156c10d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:31.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.847+0000 7f1572011700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f156c0fde00 0x7f156c10dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:31.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.847+0000 7f1572011700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c10e0c0 con 0x7f156c0fde00 2023-12-12T11:56:31.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.847+0000 7f1572011700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c10e960 con 0x7f156c0fcbf0 2023-12-12T11:56:31.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.847+0000 7f156affd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f156c0fde00 0x7f156c10dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:56:31.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.847+0000 7f156b7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f156c0fcbf0 0x7f156c10d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:56:31.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.847+0000 7f156b7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f156c0fcbf0 0x7f156c10d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.63:36522/0 (socket says 172.21.15.63:36522) 2023-12-12T11:56:31.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.847+0000 7f156b7fe700 1 -- 172.21.15.63:0/3430516425 learned_addr learned my addr 172.21.15.63:0/3430516425 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:56:31.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.847+0000 7f156affd700 1 -- 172.21.15.63:0/3430516425 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f156c0fcbf0 msgr2=0x7f156c10d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:31.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.847+0000 7f156affd700 1 --2- 172.21.15.63:0/3430516425 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f156c0fcbf0 0x7f156c10d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:31.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.847+0000 7f156affd700 1 -- 172.21.15.63:0/3430516425 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1560005040 con 0x7f156c0fde00 2023-12-12T11:56:31.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.848+0000 7f156affd700 1 --2- 172.21.15.63:0/3430516425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f156c0fde00 0x7f156c10dac0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1560000c00 tx=0x7f1560009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:56:31.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.848+0000 7f1553fff700 1 -- 172.21.15.63:0/3430516425 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f156000e040 con 0x7f156c0fde00 2023-12-12T11:56:31.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.848+0000 7f1553fff700 1 -- 172.21.15.63:0/3430516425 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f156000bc50 con 0x7f156c0fde00 2023-12-12T11:56:31.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.848+0000 7f1572011700 1 -- 172.21.15.63:0/3430516425 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156c10ebe0 con 0x7f156c0fde00 2023-12-12T11:56:31.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.848+0000 7f1553fff700 1 -- 172.21.15.63:0/3430516425 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1560013420 con 0x7f156c0fde00 2023-12-12T11:56:31.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.848+0000 7f1572011700 1 -- 172.21.15.63:0/3430516425 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156c10f120 con 0x7f156c0fde00 2023-12-12T11:56:31.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.849+0000 7f1572011700 1 -- 172.21.15.63:0/3430516425 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156c04bb80 con 0x7f156c0fde00 2023-12-12T11:56:31.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.850+0000 7f1553fff700 1 -- 172.21.15.63:0/3430516425 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f156001c430 con 0x7f156c0fde00 2023-12-12T11:56:31.853 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.851+0000 7f1553fff700 1 --2- 172.21.15.63:0/3430516425 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f155406ce60 0x7f155406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:31.853 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.851+0000 7f1553fff700 1 -- 172.21.15.63:0/3430516425 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f156008cf90 con 0x7f156c0fde00 2023-12-12T11:56:31.854 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.851+0000 7f156b7fe700 1 --2- 172.21.15.63:0/3430516425 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f155406ce60 0x7f155406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:56:31.854 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.852+0000 7f156b7fe700 1 --2- 172.21.15.63:0/3430516425 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f155406ce60 0x7f155406f310 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f155c010210 tx=0x7f155c00b040 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:56:31.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:31.856+0000 7f1553fff700 1 -- 172.21.15.63:0/3430516425 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f156005a9b0 con 0x7f156c0fde00 2023-12-12T11:56:32.088 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.085+0000 7f1572011700 1 -- 172.21.15.63:0/3430516425 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f156c10f5c0 con 0x7f155406ce60 2023-12-12T11:56:32.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.087+0000 7f1553fff700 1 -- 172.21.15.63:0/3430516425 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f156c10f5c0 con 0x7f155406ce60 2023-12-12T11:56:32.091 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.089+0000 7f1572011700 1 -- 172.21.15.63:0/3430516425 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f155406ce60 msgr2=0x7f155406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:32.091 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.089+0000 7f1572011700 1 --2- 172.21.15.63:0/3430516425 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f155406ce60 0x7f155406f310 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f155c010210 tx=0x7f155c00b040 comp rx=0 tx=0).stop 2023-12-12T11:56:32.091 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.089+0000 7f1572011700 1 -- 172.21.15.63:0/3430516425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f156c0fde00 msgr2=0x7f156c10dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:32.091 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.089+0000 7f1572011700 1 --2- 172.21.15.63:0/3430516425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f156c0fde00 0x7f156c10dac0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1560000c00 tx=0x7f1560009e30 comp rx=0 tx=0).stop 2023-12-12T11:56:32.092 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.089+0000 7f1572011700 1 -- 172.21.15.63:0/3430516425 shutdown_connections 2023-12-12T11:56:32.092 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.089+0000 7f1572011700 1 --2- 172.21.15.63:0/3430516425 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f155406ce60 0x7f155406f310 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:32.092 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.089+0000 7f1572011700 1 --2- 172.21.15.63:0/3430516425 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f156c0fcbf0 0x7f156c10d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:32.092 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.089+0000 7f1572011700 1 --2- 172.21.15.63:0/3430516425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f156c0fde00 0x7f156c10dac0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:32.092 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.089+0000 7f1572011700 1 -- 172.21.15.63:0/3430516425 >> 172.21.15.63:0/3430516425 conn(0x7f156c0f82d0 msgr2=0x7f156c101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:56:32.092 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.089+0000 7f1572011700 1 -- 172.21.15.63:0/3430516425 shutdown_connections 2023-12-12T11:56:32.092 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.089+0000 7f1572011700 1 -- 172.21.15.63:0/3430516425 wait complete. 2023-12-12T11:56:32.108 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-12T11:56:32.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.232+0000 7fe1d996f700 1 -- 172.21.15.63:0/1518263702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1d40fde00 msgr2=0x7fe1d40fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:32.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.232+0000 7fe1d996f700 1 --2- 172.21.15.63:0/1518263702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1d40fde00 0x7fe1d40fe250 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8004940 tx=0x7fe1c8009e30 comp rx=0 tx=0).stop 2023-12-12T11:56:32.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.232+0000 7fe1d996f700 1 -- 172.21.15.63:0/1518263702 shutdown_connections 2023-12-12T11:56:32.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.232+0000 7fe1d996f700 1 --2- 172.21.15.63:0/1518263702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1d40fde00 0x7fe1d40fe250 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:32.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.232+0000 7fe1d996f700 1 --2- 172.21.15.63:0/1518263702 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe1d40fcbf0 0x7fe1d40fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:32.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.232+0000 7fe1d996f700 1 -- 172.21.15.63:0/1518263702 >> 172.21.15.63:0/1518263702 conn(0x7fe1d40f82d0 msgr2=0x7fe1d40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:56:32.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.232+0000 7fe1d996f700 1 -- 172.21.15.63:0/1518263702 shutdown_connections 2023-12-12T11:56:32.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.233+0000 7fe1d996f700 1 -- 172.21.15.63:0/1518263702 wait complete. 2023-12-12T11:56:32.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.233+0000 7fe1d996f700 1 Processor -- start 2023-12-12T11:56:32.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.233+0000 7fe1d996f700 1 -- start start 2023-12-12T11:56:32.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.234+0000 7fe1d996f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1d40fcbf0 0x7fe1d410f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:32.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.234+0000 7fe1d996f700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe1d40fde00 0x7fe1d410fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:32.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.234+0000 7fe1d996f700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d4110310 con 0x7fe1d40fcbf0 2023-12-12T11:56:32.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.234+0000 7fe1d996f700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d4110b60 con 0x7fe1d40fde00 2023-12-12T11:56:32.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.234+0000 7fe1d2ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1d40fcbf0 0x7fe1d410f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:56:32.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.234+0000 7fe1d2ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1d40fcbf0 0x7fe1d410f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41466/0 (socket says 172.21.15.63:41466) 2023-12-12T11:56:32.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.234+0000 7fe1d2ffd700 1 -- 172.21.15.63:0/987666276 learned_addr learned my addr 172.21.15.63:0/987666276 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:56:32.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.234+0000 7fe1d27fc700 1 --2- 172.21.15.63:0/987666276 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe1d40fde00 0x7fe1d410fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:56:32.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.234+0000 7fe1d2ffd700 1 -- 172.21.15.63:0/987666276 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe1d40fde00 msgr2=0x7fe1d410fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:32.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.234+0000 7fe1d2ffd700 1 --2- 172.21.15.63:0/987666276 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe1d40fde00 0x7fe1d410fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:32.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.234+0000 7fe1d2ffd700 1 -- 172.21.15.63:0/987666276 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c8005040 con 0x7fe1d40fcbf0 2023-12-12T11:56:32.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.235+0000 7fe1d2ffd700 1 --2- 172.21.15.63:0/987666276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1d40fcbf0 0x7fe1d410f7d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4002a80 tx=0x7fe1c4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:56:32.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.235+0000 7fe1bb7fe700 1 -- 172.21.15.63:0/987666276 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1c4007cc0 con 0x7fe1d40fcbf0 2023-12-12T11:56:32.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.235+0000 7fe1bb7fe700 1 -- 172.21.15.63:0/987666276 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe1c400f040 con 0x7fe1d40fcbf0 2023-12-12T11:56:32.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.235+0000 7fe1d996f700 1 -- 172.21.15.63:0/987666276 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d4110e40 con 0x7fe1d40fcbf0 2023-12-12T11:56:32.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.235+0000 7fe1bb7fe700 1 -- 172.21.15.63:0/987666276 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1c400da20 con 0x7fe1d40fcbf0 2023-12-12T11:56:32.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.235+0000 7fe1d996f700 1 -- 172.21.15.63:0/987666276 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d4111380 con 0x7fe1d40fcbf0 2023-12-12T11:56:32.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.236+0000 7fe1d996f700 1 -- 172.21.15.63:0/987666276 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1d4101ea0 con 0x7fe1d40fcbf0 2023-12-12T11:56:32.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.237+0000 7fe1bb7fe700 1 -- 172.21.15.63:0/987666276 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fe1c400db80 con 0x7fe1d40fcbf0 2023-12-12T11:56:32.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.238+0000 7fe1bb7fe700 1 --2- 172.21.15.63:0/987666276 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe1bc06ce70 0x7fe1bc06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:32.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.238+0000 7fe1bb7fe700 1 -- 172.21.15.63:0/987666276 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fe1c408c190 con 0x7fe1d40fcbf0 2023-12-12T11:56:32.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.238+0000 7fe1d27fc700 1 --2- 172.21.15.63:0/987666276 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe1bc06ce70 0x7fe1bc06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:56:32.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.239+0000 7fe1d27fc700 1 --2- 172.21.15.63:0/987666276 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe1bc06ce70 0x7fe1bc06f320 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8004f90 tx=0x7fe1c8009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:56:32.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.242+0000 7fe1bb7fe700 1 -- 172.21.15.63:0/987666276 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe1c4059a00 con 0x7fe1d40fcbf0 2023-12-12T11:56:32.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.473+0000 7fe1d996f700 1 -- 172.21.15.63:0/987666276 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1d4111610 con 0x7fe1bc06ce70 2023-12-12T11:56:32.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.475+0000 7fe1bb7fe700 1 -- 172.21.15.63:0/987666276 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fe1d4111610 con 0x7fe1bc06ce70 2023-12-12T11:56:32.480 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.477+0000 7fe1d996f700 1 -- 172.21.15.63:0/987666276 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe1bc06ce70 msgr2=0x7fe1bc06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:32.480 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.477+0000 7fe1d996f700 1 --2- 172.21.15.63:0/987666276 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe1bc06ce70 0x7fe1bc06f320 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8004f90 tx=0x7fe1c8009e30 comp rx=0 tx=0).stop 2023-12-12T11:56:32.480 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.477+0000 7fe1d996f700 1 -- 172.21.15.63:0/987666276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1d40fcbf0 msgr2=0x7fe1d410f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:32.480 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.477+0000 7fe1d996f700 1 --2- 172.21.15.63:0/987666276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1d40fcbf0 0x7fe1d410f7d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4002a80 tx=0x7fe1c4004600 comp rx=0 tx=0).stop 2023-12-12T11:56:32.480 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.477+0000 7fe1d996f700 1 -- 172.21.15.63:0/987666276 shutdown_connections 2023-12-12T11:56:32.480 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.477+0000 7fe1d996f700 1 --2- 172.21.15.63:0/987666276 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe1bc06ce70 0x7fe1bc06f320 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:32.480 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.477+0000 7fe1d996f700 1 --2- 172.21.15.63:0/987666276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1d40fcbf0 0x7fe1d410f7d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:32.481 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.477+0000 7fe1d996f700 1 --2- 172.21.15.63:0/987666276 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe1d40fde00 0x7fe1d410fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:32.481 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.477+0000 7fe1d996f700 1 -- 172.21.15.63:0/987666276 >> 172.21.15.63:0/987666276 conn(0x7fe1d40f82d0 msgr2=0x7fe1d40ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:56:32.481 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.478+0000 7fe1d996f700 1 -- 172.21.15.63:0/987666276 shutdown_connections 2023-12-12T11:56:32.481 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.478+0000 7fe1d996f700 1 -- 172.21.15.63:0/987666276 wait complete. 2023-12-12T11:56:32.618 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.616+0000 7f80d8ede700 1 -- 172.21.15.63:0/1844294953 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80d40fde00 msgr2=0x7f80d40fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:32.619 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.616+0000 7f80d8ede700 1 --2- 172.21.15.63:0/1844294953 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80d40fde00 0x7f80d40fe250 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f80c8004940 tx=0x7f80c8009e30 comp rx=0 tx=0).stop 2023-12-12T11:56:32.619 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.616+0000 7f80d8ede700 1 -- 172.21.15.63:0/1844294953 shutdown_connections 2023-12-12T11:56:32.619 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.616+0000 7f80d8ede700 1 --2- 172.21.15.63:0/1844294953 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80d40fde00 0x7f80d40fe250 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:32.619 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.616+0000 7f80d8ede700 1 --2- 172.21.15.63:0/1844294953 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80d40fcbf0 0x7f80d40fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:32.619 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.616+0000 7f80d8ede700 1 -- 172.21.15.63:0/1844294953 >> 172.21.15.63:0/1844294953 conn(0x7f80d40f82d0 msgr2=0x7f80d40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:56:32.619 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.616+0000 7f80d8ede700 1 -- 172.21.15.63:0/1844294953 shutdown_connections 2023-12-12T11:56:32.619 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.616+0000 7f80d8ede700 1 -- 172.21.15.63:0/1844294953 wait complete. 2023-12-12T11:56:32.620 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.617+0000 7f80d8ede700 1 Processor -- start 2023-12-12T11:56:32.620 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.617+0000 7f80d8ede700 1 -- start start 2023-12-12T11:56:32.620 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.617+0000 7f80d8ede700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80d40fcbf0 0x7f80d4071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:32.620 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.617+0000 7f80d8ede700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80d40fde00 0x7f80d406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:32.620 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.617+0000 7f80d8ede700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d4070590 con 0x7f80d40fde00 2023-12-12T11:56:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.617+0000 7f80d8ede700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d4070700 con 0x7f80d40fcbf0 2023-12-12T11:56:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.617+0000 7f80d1d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80d40fde00 0x7f80d406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:56:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.617+0000 7f80d1d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80d40fde00 0x7f80d406ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41484/0 (socket says 172.21.15.63:41484) 2023-12-12T11:56:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.617+0000 7f80d1d9b700 1 -- 172.21.15.63:0/1397167326 learned_addr learned my addr 172.21.15.63:0/1397167326 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:56:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.618+0000 7f80d259c700 1 --2- 172.21.15.63:0/1397167326 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80d40fcbf0 0x7f80d4071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:56:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.618+0000 7f80d1d9b700 1 -- 172.21.15.63:0/1397167326 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80d40fcbf0 msgr2=0x7f80d4071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.618+0000 7f80d1d9b700 1 --2- 172.21.15.63:0/1397167326 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80d40fcbf0 0x7f80d4071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.618+0000 7f80d1d9b700 1 -- 172.21.15.63:0/1397167326 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c8005040 con 0x7f80d40fde00 2023-12-12T11:56:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.618+0000 7f80d1d9b700 1 --2- 172.21.15.63:0/1397167326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80d40fde00 0x7f80d406ff90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f80c8009360 tx=0x7f80c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:56:32.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.618+0000 7f80c2ffd700 1 -- 172.21.15.63:0/1397167326 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80c800e040 con 0x7f80d40fde00 2023-12-12T11:56:32.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.618+0000 7f80c2ffd700 1 -- 172.21.15.63:0/1397167326 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f80c800bcd0 con 0x7f80d40fde00 2023-12-12T11:56:32.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.618+0000 7f80c2ffd700 1 -- 172.21.15.63:0/1397167326 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80c801c630 con 0x7f80d40fde00 2023-12-12T11:56:32.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.618+0000 7f80d8ede700 1 -- 172.21.15.63:0/1397167326 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d4070980 con 0x7f80d40fde00 2023-12-12T11:56:32.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.619+0000 7f80d8ede700 1 -- 172.21.15.63:0/1397167326 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d41155b0 con 0x7f80d40fde00 2023-12-12T11:56:32.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.620+0000 7f80d8ede700 1 -- 172.21.15.63:0/1397167326 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d404bb80 con 0x7f80d40fde00 2023-12-12T11:56:32.623 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.621+0000 7f80c2ffd700 1 -- 172.21.15.63:0/1397167326 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f80c8013960 con 0x7f80d40fde00 2023-12-12T11:56:32.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.621+0000 7f80c2ffd700 1 --2- 172.21.15.63:0/1397167326 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f80bc06ce60 0x7f80bc06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:32.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.622+0000 7f80c2ffd700 1 -- 172.21.15.63:0/1397167326 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f80c808d8a0 con 0x7f80d40fde00 2023-12-12T11:56:32.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.622+0000 7f80d259c700 1 --2- 172.21.15.63:0/1397167326 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f80bc06ce60 0x7f80bc06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:56:32.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.622+0000 7f80d259c700 1 --2- 172.21.15.63:0/1397167326 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f80bc06ce60 0x7f80bc06f310 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f80c4009fd0 tx=0x7f80c4009f00 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:56:32.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.626+0000 7f80c2ffd700 1 -- 172.21.15.63:0/1397167326 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f80c805b190 con 0x7f80d40fde00 2023-12-12T11:56:32.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:32 smithi093 ceph-mon[171709]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:56:32.776 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:32 smithi063 ceph-mon[187282]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:56:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.847+0000 7f80d8ede700 1 -- 172.21.15.63:0/1397167326 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f80d4102770 con 0x7f80bc06ce60 2023-12-12T11:56:32.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.857+0000 7f80c2ffd700 1 -- 172.21.15.63:0/1397167326 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f80d4102770 con 0x7f80bc06ce60 2023-12-12T11:56:32.860 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-12T11:56:32.860 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (4m) 7s ago 11m 14.9M - 0.25.0 c8568f914cd2 f237d9f64783 2023-12-12T11:56:32.860 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (101s) 7s ago 12m 7838k - 19.0.0-96-gf1fbf3c5 8cf689f388db 202fa7506e7c 2023-12-12T11:56:32.860 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi093 smithi093 running (96s) 93s ago 11m 7852k - 19.0.0-96-gf1fbf3c5 8cf689f388db ac9d76320ce6 2023-12-12T11:56:32.860 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (4m) 7s ago 11m 78.5M - 9.4.7 954c08fa6188 51300a1a5b87 2023-12-12T11:56:32.860 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.aevpzg smithi063 running (7m) 7s ago 7m 10.5G - 17.2.7-123-gbef78a51 ae6196193935 df9a6781f836 2023-12-12T11:56:32.861 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.bdqbnp smithi063 running (7m) 7s ago 7m 15.6M - 17.2.7-123-gbef78a51 ae6196193935 0c7e1d21eee9 2023-12-12T11:56:32.861 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.rhaqsh smithi093 running (7m) 93s ago 7m 15.0M - 17.2.7-123-gbef78a51 ae6196193935 257aee771d87 2023-12-12T11:56:32.861 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.swdqms smithi093 running (7m) 93s ago 7m 15.0M - 17.2.7-123-gbef78a51 ae6196193935 f46d7173d3b1 2023-12-12T11:56:32.861 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.zjnfdi smithi063 *:8443,9283,8765 running (4m) 7s ago 13m 515M - 19.0.0-96-gf1fbf3c5 8cf689f388db dab6fa4aaa54 2023-12-12T11:56:32.861 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi093.nbtltu smithi093 *:8443,9283,8765 running (3m) 93s ago 11m 450M - 19.0.0-96-gf1fbf3c5 8cf689f388db 701529e7fa8e 2023-12-12T11:56:32.861 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (2m) 7s ago 13m 61.7M 2048M 19.0.0-96-gf1fbf3c5 8cf689f388db 11f12a2e88e4 2023-12-12T11:56:32.861 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi093 smithi093 running (2m) 93s ago 11m 38.5M 2048M 19.0.0-96-gf1fbf3c5 8cf689f388db 1ffc49fcd680 2023-12-12T11:56:32.861 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (4m) 7s ago 12m 8510k - 1.5.0 0da6a335fe13 8eed63374ddf 2023-12-12T11:56:32.861 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi093 smithi093 *:9100 running (4m) 93s ago 11m 7898k - 1.5.0 0da6a335fe13 10e19431c1a2 2023-12-12T11:56:32.861 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (78s) 7s ago 10m 131M 1618M 19.0.0-96-gf1fbf3c5 8cf689f388db fade55811ec1 2023-12-12T11:56:32.861 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (45s) 7s ago 10m 138M 1618M 19.0.0-96-gf1fbf3c5 8cf689f388db 733e6ff9e83d 2023-12-12T11:56:32.861 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (11s) 7s ago 9m 12.5M 1618M 19.0.0-96-gf1fbf3c5 8cf689f388db bc155cfbaf86 2023-12-12T11:56:32.861 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi093 running (9m) 93s ago 9m 1125M 2642M 17.2.7-123-gbef78a51 ae6196193935 5b2bb36b5843 2023-12-12T11:56:32.861 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi093 running (8m) 93s ago 8m 816M 2642M 17.2.7-123-gbef78a51 ae6196193935 7dc3f04b04cb 2023-12-12T11:56:32.861 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi093 running (8m) 93s ago 8m 955M 2642M 17.2.7-123-gbef78a51 ae6196193935 16fe8e4668f1 2023-12-12T11:56:32.861 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (3m) 7s ago 11m 48.2M - 2.43.0 a07b618ecd1d 834d9fc4eb61 2023-12-12T11:56:32.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.860+0000 7f80d8ede700 1 -- 172.21.15.63:0/1397167326 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f80bc06ce60 msgr2=0x7f80bc06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:32.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.860+0000 7f80d8ede700 1 --2- 172.21.15.63:0/1397167326 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f80bc06ce60 0x7f80bc06f310 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f80c4009fd0 tx=0x7f80c4009f00 comp rx=0 tx=0).stop 2023-12-12T11:56:32.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.860+0000 7f80d8ede700 1 -- 172.21.15.63:0/1397167326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80d40fde00 msgr2=0x7f80d406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:32.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.860+0000 7f80d8ede700 1 --2- 172.21.15.63:0/1397167326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80d40fde00 0x7f80d406ff90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f80c8009360 tx=0x7f80c8009e30 comp rx=0 tx=0).stop 2023-12-12T11:56:32.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.860+0000 7f80d8ede700 1 -- 172.21.15.63:0/1397167326 shutdown_connections 2023-12-12T11:56:32.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.860+0000 7f80d8ede700 1 --2- 172.21.15.63:0/1397167326 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f80bc06ce60 0x7f80bc06f310 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:32.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.860+0000 7f80d8ede700 1 --2- 172.21.15.63:0/1397167326 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80d40fcbf0 0x7f80d4071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:32.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.860+0000 7f80d8ede700 1 --2- 172.21.15.63:0/1397167326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80d40fde00 0x7f80d406ff90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:32.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.860+0000 7f80d8ede700 1 -- 172.21.15.63:0/1397167326 >> 172.21.15.63:0/1397167326 conn(0x7f80d40f82d0 msgr2=0x7f80d4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:56:32.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.860+0000 7f80d8ede700 1 -- 172.21.15.63:0/1397167326 shutdown_connections 2023-12-12T11:56:32.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.860+0000 7f80d8ede700 1 -- 172.21.15.63:0/1397167326 wait complete. 2023-12-12T11:56:33.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.998+0000 7fca7eec4700 1 -- 172.21.15.63:0/3421657429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca780fcbf0 msgr2=0x7fca780fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:33.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.998+0000 7fca7eec4700 1 --2- 172.21.15.63:0/3421657429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca780fcbf0 0x7fca780fd000 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fca6c004940 tx=0x7fca6c009e30 comp rx=0 tx=0).stop 2023-12-12T11:56:33.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.998+0000 7fca7eec4700 1 -- 172.21.15.63:0/3421657429 shutdown_connections 2023-12-12T11:56:33.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.998+0000 7fca7eec4700 1 --2- 172.21.15.63:0/3421657429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca780fde00 0x7fca780fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:33.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.998+0000 7fca7eec4700 1 --2- 172.21.15.63:0/3421657429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca780fcbf0 0x7fca780fd000 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:33.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.998+0000 7fca7eec4700 1 -- 172.21.15.63:0/3421657429 >> 172.21.15.63:0/3421657429 conn(0x7fca780f82d0 msgr2=0x7fca780fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:56:33.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.998+0000 7fca7eec4700 1 -- 172.21.15.63:0/3421657429 shutdown_connections 2023-12-12T11:56:33.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.998+0000 7fca7eec4700 1 -- 172.21.15.63:0/3421657429 wait complete. 2023-12-12T11:56:33.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.999+0000 7fca7eec4700 1 Processor -- start 2023-12-12T11:56:33.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.999+0000 7fca7eec4700 1 -- start start 2023-12-12T11:56:33.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.999+0000 7fca7eec4700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca780fcbf0 0x7fca78071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:33.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.999+0000 7fca7eec4700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca780fde00 0x7fca7806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:33.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.999+0000 7fca7eec4700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca78070590 con 0x7fca780fde00 2023-12-12T11:56:33.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:32.999+0000 7fca7eec4700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca78070700 con 0x7fca780fcbf0 2023-12-12T11:56:33.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.000+0000 7fca77fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca780fde00 0x7fca7806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:56:33.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.000+0000 7fca77fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca780fde00 0x7fca7806ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41496/0 (socket says 172.21.15.63:41496) 2023-12-12T11:56:33.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.000+0000 7fca77fff700 1 -- 172.21.15.63:0/4275401302 learned_addr learned my addr 172.21.15.63:0/4275401302 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:56:33.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.000+0000 7fca77fff700 1 -- 172.21.15.63:0/4275401302 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca780fcbf0 msgr2=0x7fca78071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:33.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.000+0000 7fca77fff700 1 --2- 172.21.15.63:0/4275401302 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca780fcbf0 0x7fca78071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:33.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.000+0000 7fca77fff700 1 -- 172.21.15.63:0/4275401302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca6c005040 con 0x7fca780fde00 2023-12-12T11:56:33.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.000+0000 7fca77fff700 1 --2- 172.21.15.63:0/4275401302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca780fde00 0x7fca7806ff90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fca6400eb40 tx=0x7fca6400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:56:33.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.000+0000 7fca757fa700 1 -- 172.21.15.63:0/4275401302 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca64007cc0 con 0x7fca780fde00 2023-12-12T11:56:33.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.000+0000 7fca757fa700 1 -- 172.21.15.63:0/4275401302 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fca6400f040 con 0x7fca780fde00 2023-12-12T11:56:33.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.000+0000 7fca757fa700 1 -- 172.21.15.63:0/4275401302 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca64009570 con 0x7fca780fde00 2023-12-12T11:56:33.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.000+0000 7fca7eec4700 1 -- 172.21.15.63:0/4275401302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca78070980 con 0x7fca780fde00 2023-12-12T11:56:33.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.001+0000 7fca7eec4700 1 -- 172.21.15.63:0/4275401302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca78115500 con 0x7fca780fde00 2023-12-12T11:56:33.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.002+0000 7fca7eec4700 1 -- 172.21.15.63:0/4275401302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca7804bb80 con 0x7fca780fde00 2023-12-12T11:56:33.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.003+0000 7fca757fa700 1 -- 172.21.15.63:0/4275401302 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fca640096d0 con 0x7fca780fde00 2023-12-12T11:56:33.006 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.004+0000 7fca757fa700 1 --2- 172.21.15.63:0/4275401302 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fca6806ce60 0x7fca6806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:33.006 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.004+0000 7fca757fa700 1 -- 172.21.15.63:0/4275401302 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fca6408bf80 con 0x7fca780fde00 2023-12-12T11:56:33.006 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.004+0000 7fca7cc60700 1 --2- 172.21.15.63:0/4275401302 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fca6806ce60 0x7fca6806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:56:33.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.004+0000 7fca7cc60700 1 --2- 172.21.15.63:0/4275401302 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fca6806ce60 0x7fca6806f310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fca6c009fd0 tx=0x7fca6c009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:56:33.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.008+0000 7fca757fa700 1 -- 172.21.15.63:0/4275401302 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fca64059920 con 0x7fca780fde00 2023-12-12T11:56:33.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.301+0000 7fca7eec4700 1 -- 172.21.15.63:0/4275401302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fca78115690 con 0x7fca780fde00 2023-12-12T11:56:33.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.301+0000 7fca757fa700 1 -- 172.21.15.63:0/4275401302 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7fca640594b0 con 0x7fca780fde00 2023-12-12T11:56:33.305 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:56:33.305 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-12T11:56:33.305 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 2 2023-12-12T11:56:33.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:56:33.305 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-12T11:56:33.305 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 2 2023-12-12T11:56:33.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:56:33.306 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-12T11:56:33.306 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 3, 2023-12-12T11:56:33.306 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 3 2023-12-12T11:56:33.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:56:33.306 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-12T11:56:33.306 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 4 2023-12-12T11:56:33.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:56:33.306 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-12T11:56:33.306 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 7, 2023-12-12T11:56:33.307 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 7 2023-12-12T11:56:33.307 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-12T11:56:33.307 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:56:33.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.304+0000 7fca7eec4700 1 -- 172.21.15.63:0/4275401302 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fca6806ce60 msgr2=0x7fca6806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:33.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.304+0000 7fca7eec4700 1 --2- 172.21.15.63:0/4275401302 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fca6806ce60 0x7fca6806f310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fca6c009fd0 tx=0x7fca6c009e30 comp rx=0 tx=0).stop 2023-12-12T11:56:33.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.304+0000 7fca7eec4700 1 -- 172.21.15.63:0/4275401302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca780fde00 msgr2=0x7fca7806ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:33.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.304+0000 7fca7eec4700 1 --2- 172.21.15.63:0/4275401302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca780fde00 0x7fca7806ff90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fca6400eb40 tx=0x7fca6400b040 comp rx=0 tx=0).stop 2023-12-12T11:56:33.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.304+0000 7fca7eec4700 1 -- 172.21.15.63:0/4275401302 shutdown_connections 2023-12-12T11:56:33.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.304+0000 7fca7eec4700 1 --2- 172.21.15.63:0/4275401302 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fca6806ce60 0x7fca6806f310 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:33.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.304+0000 7fca7eec4700 1 --2- 172.21.15.63:0/4275401302 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca780fcbf0 0x7fca78071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:33.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.304+0000 7fca7eec4700 1 --2- 172.21.15.63:0/4275401302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca780fde00 0x7fca7806ff90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:33.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.304+0000 7fca7eec4700 1 -- 172.21.15.63:0/4275401302 >> 172.21.15.63:0/4275401302 conn(0x7fca780f82d0 msgr2=0x7fca78101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:56:33.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.304+0000 7fca7eec4700 1 -- 172.21.15.63:0/4275401302 shutdown_connections 2023-12-12T11:56:33.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.304+0000 7fca7eec4700 1 -- 172.21.15.63:0/4275401302 wait complete. 2023-12-12T11:56:33.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.443+0000 7f7413884700 1 -- 172.21.15.63:0/3477912144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f740c071bc0 msgr2=0x7f740c070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:33.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.443+0000 7f7413884700 1 --2- 172.21.15.63:0/3477912144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f740c071bc0 0x7f740c070030 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7408004940 tx=0x7f7408009e30 comp rx=0 tx=0).stop 2023-12-12T11:56:33.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.443+0000 7f7413884700 1 -- 172.21.15.63:0/3477912144 shutdown_connections 2023-12-12T11:56:33.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.443+0000 7f7413884700 1 --2- 172.21.15.63:0/3477912144 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f740c070570 0x7f740c0709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:33.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.443+0000 7f7413884700 1 --2- 172.21.15.63:0/3477912144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f740c071bc0 0x7f740c070030 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:33.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.443+0000 7f7413884700 1 -- 172.21.15.63:0/3477912144 >> 172.21.15.63:0/3477912144 conn(0x7f740c0f82d0 msgr2=0x7f740c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:56:33.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.443+0000 7f7413884700 1 -- 172.21.15.63:0/3477912144 shutdown_connections 2023-12-12T11:56:33.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.443+0000 7f7413884700 1 -- 172.21.15.63:0/3477912144 wait complete. 2023-12-12T11:56:33.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.444+0000 7f7413884700 1 Processor -- start 2023-12-12T11:56:33.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.444+0000 7f7413884700 1 -- start start 2023-12-12T11:56:33.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.444+0000 7f7413884700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f740c070570 0x7f740c10f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:33.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.444+0000 7f7413884700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f740c071bc0 0x7f740c10fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:33.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.444+0000 7f7413884700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c110420 con 0x7f740c070570 2023-12-12T11:56:33.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.444+0000 7f7413884700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c110cc0 con 0x7f740c071bc0 2023-12-12T11:56:33.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.444+0000 7f7411620700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f740c070570 0x7f740c10f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:56:33.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.445+0000 7f7411620700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f740c070570 0x7f740c10f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41510/0 (socket says 172.21.15.63:41510) 2023-12-12T11:56:33.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.445+0000 7f7411620700 1 -- 172.21.15.63:0/852204553 learned_addr learned my addr 172.21.15.63:0/852204553 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:56:33.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.445+0000 7f7411620700 1 -- 172.21.15.63:0/852204553 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f740c071bc0 msgr2=0x7f740c10fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:33.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.445+0000 7f7411620700 1 --2- 172.21.15.63:0/852204553 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f740c071bc0 0x7f740c10fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:33.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.445+0000 7f7411620700 1 -- 172.21.15.63:0/852204553 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7408005040 con 0x7f740c070570 2023-12-12T11:56:33.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.445+0000 7f7411620700 1 --2- 172.21.15.63:0/852204553 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f740c070570 0x7f740c10f8e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7408000c00 tx=0x7f7408009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:56:33.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.445+0000 7f7401ffb700 1 -- 172.21.15.63:0/852204553 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f740800e040 con 0x7f740c070570 2023-12-12T11:56:33.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.445+0000 7f7401ffb700 1 -- 172.21.15.63:0/852204553 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7408004290 con 0x7f740c070570 2023-12-12T11:56:33.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.445+0000 7f7401ffb700 1 -- 172.21.15.63:0/852204553 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f740801c3f0 con 0x7f740c070570 2023-12-12T11:56:33.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.445+0000 7f7413884700 1 -- 172.21.15.63:0/852204553 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f740c110f40 con 0x7f740c070570 2023-12-12T11:56:33.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.446+0000 7f7413884700 1 -- 172.21.15.63:0/852204553 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f740c111480 con 0x7f740c070570 2023-12-12T11:56:33.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.447+0000 7f7413884700 1 -- 172.21.15.63:0/852204553 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f740c1096f0 con 0x7f740c070570 2023-12-12T11:56:33.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.448+0000 7f7401ffb700 1 -- 172.21.15.63:0/852204553 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f740800bbf0 con 0x7f740c070570 2023-12-12T11:56:33.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.448+0000 7f7401ffb700 1 --2- 172.21.15.63:0/852204553 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f73f806ce60 0x7f73f806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:33.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.448+0000 7f7401ffb700 1 -- 172.21.15.63:0/852204553 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f740808d660 con 0x7f740c070570 2023-12-12T11:56:33.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.449+0000 7f7410e1f700 1 --2- 172.21.15.63:0/852204553 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f73f806ce60 0x7f73f806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:56:33.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.449+0000 7f7410e1f700 1 --2- 172.21.15.63:0/852204553 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f73f806ce60 0x7f73f806f310 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f73fc004d00 tx=0x7f73fc009ce0 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:56:33.455 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.453+0000 7f7401ffb700 1 -- 172.21.15.63:0/852204553 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f740805b090 con 0x7f740c070570 2023-12-12T11:56:33.712 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.710+0000 7f7413884700 1 -- 172.21.15.63:0/852204553 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f740c109110 con 0x7f740c070570 2023-12-12T11:56:33.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.710+0000 7f7401ffb700 1 -- 172.21.15.63:0/852204553 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1845 (secure 0 0 0) 0x7f740805ac20 con 0x7f740c070570 2023-12-12T11:56:33.713 INFO:teuthology.orchestra.run.smithi063.stdout:e13 2023-12-12T11:56:33.713 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-12T11:56:33.713 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:56:33.713 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-12T11:56:33.713 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:56:33.713 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-12T11:56:33.713 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-12T11:56:33.713 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 13 2023-12-12T11:56:33.714 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-12T11:56:33.714 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-12T11:48:58.523481+0000 2023-12-12T11:56:33.714 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-12T11:49:14.113993+0000 2023-12-12T11:56:33.714 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-12T11:56:33.714 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-12T11:56:33.714 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-12T11:56:33.714 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-12T11:56:33.714 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-12T11:56:33.714 INFO:teuthology.orchestra.run.smithi063.stdout:max_xattr_size 65536 2023-12-12T11:56:33.714 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-12T11:56:33.714 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-12T11:56:33.714 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 46 2023-12-12T11:56:33.714 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:56:33.714 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 1 2023-12-12T11:56:33.714 INFO:teuthology.orchestra.run.smithi063.stdout:in 0 2023-12-12T11:56:33.715 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=14492} 2023-12-12T11:56:33.715 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-12T11:56:33.715 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-12T11:56:33.715 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-12T11:56:33.715 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-12T11:56:33.715 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-12T11:56:33.715 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data enabled 2023-12-12T11:56:33.715 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-12T11:56:33.715 INFO:teuthology.orchestra.run.smithi063.stdout:bal_rank_mask -1 2023-12-12T11:56:33.715 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 1 2023-12-12T11:56:33.715 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.aevpzg{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.63:6828/3709000039,v1:172.21.15.63:6829/3709000039] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:56:33.715 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:56:33.715 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:56:33.715 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2023-12-12T11:56:33.715 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:56:33.715 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.swdqms{-1:14500} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.93:6826/3307558569,v1:172.21.15.93:6827/3307558569] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:56:33.716 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.bdqbnp{-1:14508} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/2191270944,v1:172.21.15.63:6827/2191270944] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:56:33.716 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.rhaqsh{-1:24317} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.93:6824/3161864019,v1:172.21.15.93:6825/3161864019] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:56:33.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.713+0000 7f7413884700 1 -- 172.21.15.63:0/852204553 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f73f806ce60 msgr2=0x7f73f806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:33.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.713+0000 7f7413884700 1 --2- 172.21.15.63:0/852204553 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f73f806ce60 0x7f73f806f310 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f73fc004d00 tx=0x7f73fc009ce0 comp rx=0 tx=0).stop 2023-12-12T11:56:33.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.713+0000 7f7413884700 1 -- 172.21.15.63:0/852204553 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f740c070570 msgr2=0x7f740c10f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:33.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.713+0000 7f7413884700 1 --2- 172.21.15.63:0/852204553 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f740c070570 0x7f740c10f8e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7408000c00 tx=0x7f7408009e30 comp rx=0 tx=0).stop 2023-12-12T11:56:33.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.713+0000 7f7413884700 1 -- 172.21.15.63:0/852204553 shutdown_connections 2023-12-12T11:56:33.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.713+0000 7f7413884700 1 --2- 172.21.15.63:0/852204553 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f73f806ce60 0x7f73f806f310 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:33.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.713+0000 7f7413884700 1 --2- 172.21.15.63:0/852204553 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f740c070570 0x7f740c10f8e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:33.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.713+0000 7f7413884700 1 --2- 172.21.15.63:0/852204553 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f740c071bc0 0x7f740c10fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:33.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.713+0000 7f7413884700 1 -- 172.21.15.63:0/852204553 >> 172.21.15.63:0/852204553 conn(0x7f740c0f82d0 msgr2=0x7f740c103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:56:33.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.713+0000 7f7413884700 1 -- 172.21.15.63:0/852204553 shutdown_connections 2023-12-12T11:56:33.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.713+0000 7f7413884700 1 -- 172.21.15.63:0/852204553 wait complete. 2023-12-12T11:56:33.717 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 13 2023-12-12T11:56:33.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:33 smithi093 ceph-mon[171709]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:56:33.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:33 smithi093 ceph-mon[171709]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:56:33.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:33 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/4275401302' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:56:33.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:33 smithi093 ceph-mon[171709]: pgmap v92: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:33.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:33 smithi063 ceph-mon[187282]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:56:33.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:33 smithi063 ceph-mon[187282]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:56:33.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:33 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/4275401302' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:56:33.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:33 smithi063 ceph-mon[187282]: pgmap v92: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:33.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.852+0000 7fb605cfc700 1 -- 172.21.15.63:0/3342299900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6000fcbf0 msgr2=0x7fb6000fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:33.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.852+0000 7fb605cfc700 1 --2- 172.21.15.63:0/3342299900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6000fcbf0 0x7fb6000fd000 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0004940 tx=0x7fb5f0009e30 comp rx=0 tx=0).stop 2023-12-12T11:56:33.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.852+0000 7fb605cfc700 1 -- 172.21.15.63:0/3342299900 shutdown_connections 2023-12-12T11:56:33.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.852+0000 7fb605cfc700 1 --2- 172.21.15.63:0/3342299900 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb6000fde00 0x7fb6000fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:33.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.852+0000 7fb605cfc700 1 --2- 172.21.15.63:0/3342299900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6000fcbf0 0x7fb6000fd000 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:33.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.852+0000 7fb605cfc700 1 -- 172.21.15.63:0/3342299900 >> 172.21.15.63:0/3342299900 conn(0x7fb6000f82d0 msgr2=0x7fb6000fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:56:33.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.852+0000 7fb605cfc700 1 -- 172.21.15.63:0/3342299900 shutdown_connections 2023-12-12T11:56:33.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.852+0000 7fb605cfc700 1 -- 172.21.15.63:0/3342299900 wait complete. 2023-12-12T11:56:33.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.853+0000 7fb605cfc700 1 Processor -- start 2023-12-12T11:56:33.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.853+0000 7fb605cfc700 1 -- start start 2023-12-12T11:56:33.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.854+0000 7fb605cfc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6000fcbf0 0x7fb60010f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:33.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.854+0000 7fb605cfc700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb6000fde00 0x7fb60010fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:33.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.854+0000 7fb605cfc700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb600110220 con 0x7fb6000fcbf0 2023-12-12T11:56:33.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.854+0000 7fb605cfc700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb600110ac0 con 0x7fb6000fde00 2023-12-12T11:56:33.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.854+0000 7fb5ff7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6000fcbf0 0x7fb60010f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:56:33.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.854+0000 7fb5ff7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6000fcbf0 0x7fb60010f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41518/0 (socket says 172.21.15.63:41518) 2023-12-12T11:56:33.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.854+0000 7fb5ff7fe700 1 -- 172.21.15.63:0/4140523525 learned_addr learned my addr 172.21.15.63:0/4140523525 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:56:33.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.854+0000 7fb5feffd700 1 --2- 172.21.15.63:0/4140523525 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb6000fde00 0x7fb60010fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:56:33.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.855+0000 7fb5ff7fe700 1 -- 172.21.15.63:0/4140523525 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb6000fde00 msgr2=0x7fb60010fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:33.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.855+0000 7fb5ff7fe700 1 --2- 172.21.15.63:0/4140523525 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb6000fde00 0x7fb60010fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:33.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.855+0000 7fb5ff7fe700 1 -- 172.21.15.63:0/4140523525 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f0005040 con 0x7fb6000fcbf0 2023-12-12T11:56:33.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.855+0000 7fb5ff7fe700 1 --2- 172.21.15.63:0/4140523525 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6000fcbf0 0x7fb60010f6e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0008f80 tx=0x7fb5f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:56:33.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.855+0000 7fb5e7fff700 1 -- 172.21.15.63:0/4140523525 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5f0021070 con 0x7fb6000fcbf0 2023-12-12T11:56:33.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.855+0000 7fb5e7fff700 1 -- 172.21.15.63:0/4140523525 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb5f001c400 con 0x7fb6000fcbf0 2023-12-12T11:56:33.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.855+0000 7fb605cfc700 1 -- 172.21.15.63:0/4140523525 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb600110d40 con 0x7fb6000fcbf0 2023-12-12T11:56:33.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.855+0000 7fb5e7fff700 1 -- 172.21.15.63:0/4140523525 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5f000e070 con 0x7fb6000fcbf0 2023-12-12T11:56:33.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.855+0000 7fb605cfc700 1 -- 172.21.15.63:0/4140523525 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb600111220 con 0x7fb6000fcbf0 2023-12-12T11:56:33.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.856+0000 7fb605cfc700 1 -- 172.21.15.63:0/4140523525 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb600101ea0 con 0x7fb6000fcbf0 2023-12-12T11:56:33.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.857+0000 7fb5e7fff700 1 -- 172.21.15.63:0/4140523525 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fb5f001c950 con 0x7fb6000fcbf0 2023-12-12T11:56:33.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.858+0000 7fb5e7fff700 1 --2- 172.21.15.63:0/4140523525 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fb5e806ce70 0x7fb5e806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:33.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.858+0000 7fb5e7fff700 1 -- 172.21.15.63:0/4140523525 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fb5f008d570 con 0x7fb6000fcbf0 2023-12-12T11:56:33.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.859+0000 7fb5feffd700 1 --2- 172.21.15.63:0/4140523525 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fb5e806ce70 0x7fb5e806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:56:33.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.859+0000 7fb5feffd700 1 --2- 172.21.15.63:0/4140523525 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fb5e806ce70 0x7fb5e806f320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4009b80 tx=0x7fb5f400b040 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:56:33.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:33.863+0000 7fb5e7fff700 1 -- 172.21.15.63:0/4140523525 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fb5f005aea0 con 0x7fb6000fcbf0 2023-12-12T11:56:34.092 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.089+0000 7fb605cfc700 1 -- 172.21.15.63:0/4140523525 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb600111440 con 0x7fb5e806ce70 2023-12-12T11:56:34.093 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.091+0000 7fb5e7fff700 1 -- 172.21.15.63:0/4140523525 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb600111440 con 0x7fb5e806ce70 2023-12-12T11:56:34.093 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:56:34.093 INFO:teuthology.orchestra.run.smithi063.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dbb46fd2dbbe029cfba763f2b7c769e980f86b63e74be0c72e188909e20b81f3", 2023-12-12T11:56:34.093 INFO:teuthology.orchestra.run.smithi063.stdout: "in_progress": true, 2023-12-12T11:56:34.094 INFO:teuthology.orchestra.run.smithi063.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-12T11:56:34.094 INFO:teuthology.orchestra.run.smithi063.stdout: "services_complete": [ 2023-12-12T11:56:34.094 INFO:teuthology.orchestra.run.smithi063.stdout: "mon", 2023-12-12T11:56:34.094 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr", 2023-12-12T11:56:34.094 INFO:teuthology.orchestra.run.smithi063.stdout: "crash" 2023-12-12T11:56:34.094 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2023-12-12T11:56:34.094 INFO:teuthology.orchestra.run.smithi063.stdout: "progress": "9/21 daemons upgraded", 2023-12-12T11:56:34.094 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "Currently upgrading osd daemons", 2023-12-12T11:56:34.094 INFO:teuthology.orchestra.run.smithi063.stdout: "is_paused": false 2023-12-12T11:56:34.094 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:56:34.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.093+0000 7fb605cfc700 1 -- 172.21.15.63:0/4140523525 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fb5e806ce70 msgr2=0x7fb5e806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:34.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.093+0000 7fb605cfc700 1 --2- 172.21.15.63:0/4140523525 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fb5e806ce70 0x7fb5e806f320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4009b80 tx=0x7fb5f400b040 comp rx=0 tx=0).stop 2023-12-12T11:56:34.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.093+0000 7fb605cfc700 1 -- 172.21.15.63:0/4140523525 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6000fcbf0 msgr2=0x7fb60010f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:34.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.093+0000 7fb605cfc700 1 --2- 172.21.15.63:0/4140523525 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6000fcbf0 0x7fb60010f6e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0008f80 tx=0x7fb5f0009e30 comp rx=0 tx=0).stop 2023-12-12T11:56:34.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.093+0000 7fb605cfc700 1 -- 172.21.15.63:0/4140523525 shutdown_connections 2023-12-12T11:56:34.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.093+0000 7fb605cfc700 1 --2- 172.21.15.63:0/4140523525 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fb5e806ce70 0x7fb5e806f320 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:34.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.093+0000 7fb605cfc700 1 --2- 172.21.15.63:0/4140523525 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6000fcbf0 0x7fb60010f6e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:34.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.093+0000 7fb605cfc700 1 --2- 172.21.15.63:0/4140523525 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb6000fde00 0x7fb60010fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:34.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.093+0000 7fb605cfc700 1 -- 172.21.15.63:0/4140523525 >> 172.21.15.63:0/4140523525 conn(0x7fb6000f82d0 msgr2=0x7fb6000ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:56:34.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.093+0000 7fb605cfc700 1 -- 172.21.15.63:0/4140523525 shutdown_connections 2023-12-12T11:56:34.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.093+0000 7fb605cfc700 1 -- 172.21.15.63:0/4140523525 wait complete. 2023-12-12T11:56:34.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.232+0000 7f248a90e700 1 -- 172.21.15.63:0/368483853 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24840fde00 msgr2=0x7f24840fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:34.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.232+0000 7f248a90e700 1 --2- 172.21.15.63:0/368483853 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24840fde00 0x7f24840fe250 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2478004940 tx=0x7f2478009e30 comp rx=0 tx=0).stop 2023-12-12T11:56:34.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.232+0000 7f248a90e700 1 -- 172.21.15.63:0/368483853 shutdown_connections 2023-12-12T11:56:34.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.232+0000 7f248a90e700 1 --2- 172.21.15.63:0/368483853 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24840fde00 0x7f24840fe250 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:34.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.232+0000 7f248a90e700 1 --2- 172.21.15.63:0/368483853 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24840fcbf0 0x7f24840fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:34.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.232+0000 7f248a90e700 1 -- 172.21.15.63:0/368483853 >> 172.21.15.63:0/368483853 conn(0x7f24840f82d0 msgr2=0x7f24840fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:56:34.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.232+0000 7f248a90e700 1 -- 172.21.15.63:0/368483853 shutdown_connections 2023-12-12T11:56:34.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.232+0000 7f248a90e700 1 -- 172.21.15.63:0/368483853 wait complete. 2023-12-12T11:56:34.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.233+0000 7f248a90e700 1 Processor -- start 2023-12-12T11:56:34.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.233+0000 7f248a90e700 1 -- start start 2023-12-12T11:56:34.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.233+0000 7f248a90e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24840fcbf0 0x7f248410d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:34.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.233+0000 7f248a90e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24840fde00 0x7f248410dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:34.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.233+0000 7f248a90e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248410e0c0 con 0x7f24840fcbf0 2023-12-12T11:56:34.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.233+0000 7f248a90e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248410e960 con 0x7f24840fde00 2023-12-12T11:56:34.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.233+0000 7f2483fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24840fcbf0 0x7f248410d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:56:34.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.234+0000 7f2483fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24840fcbf0 0x7f248410d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41526/0 (socket says 172.21.15.63:41526) 2023-12-12T11:56:34.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.234+0000 7f2483fff700 1 -- 172.21.15.63:0/4205893156 learned_addr learned my addr 172.21.15.63:0/4205893156 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:56:34.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.234+0000 7f24837fe700 1 --2- 172.21.15.63:0/4205893156 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24840fde00 0x7f248410dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:56:34.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.234+0000 7f2483fff700 1 -- 172.21.15.63:0/4205893156 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24840fde00 msgr2=0x7f248410dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:34.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.234+0000 7f2483fff700 1 --2- 172.21.15.63:0/4205893156 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24840fde00 0x7f248410dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:34.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.234+0000 7f2483fff700 1 -- 172.21.15.63:0/4205893156 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2478005040 con 0x7f24840fcbf0 2023-12-12T11:56:34.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.234+0000 7f24837fe700 1 --2- 172.21.15.63:0/4205893156 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24840fde00 0x7f248410dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T11:56:34.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.234+0000 7f2483fff700 1 --2- 172.21.15.63:0/4205893156 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24840fcbf0 0x7f248410d580 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2474002a80 tx=0x7f2474004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:56:34.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.234+0000 7f2480ff9700 1 -- 172.21.15.63:0/4205893156 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2474007cc0 con 0x7f24840fcbf0 2023-12-12T11:56:34.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.235+0000 7f2480ff9700 1 -- 172.21.15.63:0/4205893156 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f247400f040 con 0x7f24840fcbf0 2023-12-12T11:56:34.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.235+0000 7f2480ff9700 1 -- 172.21.15.63:0/4205893156 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f247400da20 con 0x7f24840fcbf0 2023-12-12T11:56:34.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.235+0000 7f248a90e700 1 -- 172.21.15.63:0/4205893156 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f248410ec40 con 0x7f24840fcbf0 2023-12-12T11:56:34.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.235+0000 7f248a90e700 1 -- 172.21.15.63:0/4205893156 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f248410f180 con 0x7f24840fcbf0 2023-12-12T11:56:34.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.236+0000 7f248a90e700 1 -- 172.21.15.63:0/4205893156 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f248404bb80 con 0x7f24840fcbf0 2023-12-12T11:56:34.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.237+0000 7f2480ff9700 1 -- 172.21.15.63:0/4205893156 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f247400db80 con 0x7f24840fcbf0 2023-12-12T11:56:34.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.238+0000 7f2480ff9700 1 --2- 172.21.15.63:0/4205893156 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f246c06ce70 0x7f246c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:56:34.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.238+0000 7f2480ff9700 1 -- 172.21.15.63:0/4205893156 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f247408c040 con 0x7f24840fcbf0 2023-12-12T11:56:34.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.239+0000 7f24837fe700 1 --2- 172.21.15.63:0/4205893156 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f246c06ce70 0x7f246c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:56:34.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.239+0000 7f24837fe700 1 --2- 172.21.15.63:0/4205893156 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f246c06ce70 0x7f246c06f320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2478004f90 tx=0x7f2478009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:56:34.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.242+0000 7f2480ff9700 1 -- 172.21.15.63:0/4205893156 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f24740599d0 con 0x7f24840fcbf0 2023-12-12T11:56:34.539 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.537+0000 7f248a90e700 1 -- 172.21.15.63:0/4205893156 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2484105590 con 0x7f24840fcbf0 2023-12-12T11:56:34.539 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.537+0000 7f2480ff9700 1 -- 172.21.15.63:0/4205893156 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f2474059560 con 0x7f24840fcbf0 2023-12-12T11:56:34.540 INFO:teuthology.orchestra.run.smithi063.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-12T11:56:34.540 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-12T11:56:34.540 INFO:teuthology.orchestra.run.smithi063.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-12T11:56:34.542 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.539+0000 7f248a90e700 1 -- 172.21.15.63:0/4205893156 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f246c06ce70 msgr2=0x7f246c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:34.542 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.539+0000 7f248a90e700 1 --2- 172.21.15.63:0/4205893156 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f246c06ce70 0x7f246c06f320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2478004f90 tx=0x7f2478009e30 comp rx=0 tx=0).stop 2023-12-12T11:56:34.542 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.539+0000 7f248a90e700 1 -- 172.21.15.63:0/4205893156 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24840fcbf0 msgr2=0x7f248410d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:56:34.542 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.539+0000 7f248a90e700 1 --2- 172.21.15.63:0/4205893156 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24840fcbf0 0x7f248410d580 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2474002a80 tx=0x7f2474004600 comp rx=0 tx=0).stop 2023-12-12T11:56:34.542 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.539+0000 7f248a90e700 1 -- 172.21.15.63:0/4205893156 shutdown_connections 2023-12-12T11:56:34.542 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.539+0000 7f248a90e700 1 --2- 172.21.15.63:0/4205893156 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f246c06ce70 0x7f246c06f320 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:34.542 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.539+0000 7f248a90e700 1 --2- 172.21.15.63:0/4205893156 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24840fcbf0 0x7f248410d580 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:34.542 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.539+0000 7f248a90e700 1 --2- 172.21.15.63:0/4205893156 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24840fde00 0x7f248410dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:56:34.542 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.539+0000 7f248a90e700 1 -- 172.21.15.63:0/4205893156 >> 172.21.15.63:0/4205893156 conn(0x7f24840f82d0 msgr2=0x7f2484101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:56:34.542 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.540+0000 7f248a90e700 1 -- 172.21.15.63:0/4205893156 shutdown_connections 2023-12-12T11:56:34.543 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:56:34.540+0000 7f248a90e700 1 -- 172.21.15.63:0/4205893156 wait complete. 2023-12-12T11:56:34.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:34 smithi093 ceph-mon[171709]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 20/219 objects degraded (9.132%), 6 pgs degraded) 2023-12-12T11:56:34.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:34 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/852204553' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:56:34.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:34 smithi093 ceph-mon[171709]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:56:34.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:34 smithi063 ceph-mon[187282]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 20/219 objects degraded (9.132%), 6 pgs degraded) 2023-12-12T11:56:34.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:34 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/852204553' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:56:34.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:34 smithi063 ceph-mon[187282]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:56:35.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:35 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/4205893156' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:56:35.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:35 smithi093 ceph-mon[171709]: pgmap v93: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:35.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:35 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:35.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:35 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:56:35.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:35 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/4205893156' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:56:35.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:35 smithi063 ceph-mon[187282]: pgmap v93: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:35.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:35 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:35.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:35 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:56:37.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:37 smithi093 ceph-mon[171709]: pgmap v94: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:37.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:37 smithi063 ceph-mon[187282]: pgmap v94: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:39.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:39 smithi093 ceph-mon[171709]: pgmap v95: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:39.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:39 smithi063 ceph-mon[187282]: pgmap v95: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:41.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:41 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:41.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:41 smithi093 ceph-mon[171709]: pgmap v96: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:41.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:41 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:41.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:41 smithi063 ceph-mon[187282]: pgmap v96: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:43.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:43 smithi093 ceph-mon[171709]: pgmap v97: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:43.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:43 smithi063 ceph-mon[187282]: pgmap v97: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:46.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:45 smithi063 ceph-mon[187282]: pgmap v98: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:46.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:45 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-12T11:56:46.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:45 smithi093 ceph-mon[171709]: pgmap v98: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:46.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:45 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-12T11:56:46.930 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:46 smithi093 ceph-mon[171709]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-12T11:56:46.930 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:46 smithi093 ceph-mon[171709]: Upgrade: osd.3 is safe to restart 2023-12-12T11:56:47.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:46 smithi063 ceph-mon[187282]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-12T11:56:47.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:46 smithi063 ceph-mon[187282]: Upgrade: osd.3 is safe to restart 2023-12-12T11:56:48.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:47 smithi093 ceph-mon[171709]: Upgrade: Updating osd.3 2023-12-12T11:56:48.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:47 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:48.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:47 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-12T11:56:48.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:47 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:56:48.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:47 smithi093 ceph-mon[171709]: Deploying daemon osd.3 on smithi093 2023-12-12T11:56:48.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:47 smithi093 ceph-mon[171709]: pgmap v99: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:48.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:47 smithi063 ceph-mon[187282]: Upgrade: Updating osd.3 2023-12-12T11:56:48.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:47 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:48.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:47 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-12T11:56:48.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:47 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:56:48.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:47 smithi063 ceph-mon[187282]: Deploying daemon osd.3 on smithi093 2023-12-12T11:56:48.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:47 smithi063 ceph-mon[187282]: pgmap v99: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:49.700 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:49 smithi093 ceph-mon[171709]: pgmap v100: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:49.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:49 smithi063 ceph-mon[187282]: pgmap v100: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:49.964 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 11:56:49 smithi093 systemd[1]: Stopping Ceph osd.3 for 85e33c70-98e3-11ee-95a3-87774f69a715... 2023-12-12T11:56:50.221 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 11:56:49 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-3[122322]: 2023-12-12T11:56:49.961+0000 7f0bfb74c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-12T11:56:50.221 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 11:56:49 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-3[122322]: 2023-12-12T11:56:49.961+0000 7f0bfb74c700 -1 osd.3 64 *** Got signal Terminated *** 2023-12-12T11:56:50.221 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 11:56:49 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-3[122322]: 2023-12-12T11:56:49.961+0000 7f0bfb74c700 -1 osd.3 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-12T11:56:51.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:50 smithi063 ceph-mon[187282]: osd.3 marked itself down and dead 2023-12-12T11:56:51.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:50 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:56:51.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:50 smithi093 ceph-mon[171709]: osd.3 marked itself down and dead 2023-12-12T11:56:51.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:50 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:56:51.721 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 11:56:51 smithi093 bash[183757]: ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-3 2023-12-12T11:56:52.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:51 smithi063 ceph-mon[187282]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-12T11:56:52.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:51 smithi063 ceph-mon[187282]: failed to encode map e65 with expected crc 2023-12-12T11:56:52.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:51 smithi063 ceph-mon[187282]: osdmap e65: 6 total, 5 up, 6 in 2023-12-12T11:56:52.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:51 smithi063 ceph-mon[187282]: pgmap v102: 65 pgs: 18 peering, 6 stale+active+clean, 41 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:52.045 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:51 smithi093 ceph-mon[171709]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-12T11:56:52.045 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:51 smithi093 ceph-mon[171709]: failed to encode map e65 with expected crc 2023-12-12T11:56:52.045 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:51 smithi093 ceph-mon[171709]: osdmap e65: 6 total, 5 up, 6 in 2023-12-12T11:56:52.045 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:51 smithi093 ceph-mon[171709]: pgmap v102: 65 pgs: 18 peering, 6 stale+active+clean, 41 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:56:52.882 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:52 smithi093 ceph-mon[171709]: Health check failed: Reduced data availability: 10 pgs peering (PG_AVAILABILITY) 2023-12-12T11:56:52.882 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:52 smithi093 ceph-mon[171709]: osdmap e66: 6 total, 5 up, 6 in 2023-12-12T11:56:52.883 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:52 smithi093 ceph-mon[171709]: failed to encode map e66 with expected crc 2023-12-12T11:56:52.883 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:52 smithi093 ceph-mon[171709]: failed to encode map e66 with expected crc 2023-12-12T11:56:52.883 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:52 smithi093 ceph-mon[171709]: failed to encode map e66 with expected crc 2023-12-12T11:56:52.883 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:52 smithi093 ceph-mon[171709]: failed to encode map e66 with expected crc 2023-12-12T11:56:53.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:52 smithi063 ceph-mon[187282]: Health check failed: Reduced data availability: 10 pgs peering (PG_AVAILABILITY) 2023-12-12T11:56:53.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:52 smithi063 ceph-mon[187282]: osdmap e66: 6 total, 5 up, 6 in 2023-12-12T11:56:53.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:52 smithi063 ceph-mon[187282]: failed to encode map e66 with expected crc 2023-12-12T11:56:53.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:52 smithi063 ceph-mon[187282]: failed to encode map e66 with expected crc 2023-12-12T11:56:53.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:52 smithi063 ceph-mon[187282]: failed to encode map e66 with expected crc 2023-12-12T11:56:53.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:52 smithi063 ceph-mon[187282]: failed to encode map e66 with expected crc 2023-12-12T11:56:53.156 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 11:56:52 smithi093 systemd[1]: ceph-85e33c70-98e3-11ee-95a3-87774f69a715@osd.3.service: Succeeded. 2023-12-12T11:56:53.156 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 11:56:52 smithi093 systemd[1]: Stopped Ceph osd.3 for 85e33c70-98e3-11ee-95a3-87774f69a715. 2023-12-12T11:56:53.471 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 11:56:53 smithi093 systemd[1]: Starting Ceph osd.3 for 85e33c70-98e3-11ee-95a3-87774f69a715... 2023-12-12T11:56:53.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:53 smithi093 ceph-mon[171709]: pgmap v104: 65 pgs: 2 active+undersized+degraded, 25 peering, 2 stale+active+clean, 2 active+undersized, 34 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 4/219 objects degraded (1.826%) 2023-12-12T11:56:54.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:53 smithi063 ceph-mon[187282]: pgmap v104: 65 pgs: 2 active+undersized+degraded, 25 peering, 2 stale+active+clean, 2 active+undersized, 34 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 4/219 objects degraded (1.826%) 2023-12-12T11:56:54.721 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 11:56:54 smithi093 bash[184024]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-12T11:56:54.721 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 11:56:54 smithi093 bash[184024]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-12-12T11:56:54.721 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 11:56:54 smithi093 bash[184024]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-12-12T11:56:54.721 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 11:56:54 smithi093 bash[184024]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-12-12T11:56:54.721 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 11:56:54 smithi093 bash[184024]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2023-12-12T11:56:54.721 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 11:56:54 smithi093 bash[184024]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-12T11:56:54.721 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 11:56:54 smithi093 bash[184024]: --> ceph-volume raw activate successful for osd ID: 3 2023-12-12T11:56:55.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:54 smithi063 ceph-mon[187282]: Health check failed: Degraded data redundancy: 4/219 objects degraded (1.826%), 2 pgs degraded (PG_DEGRADED) 2023-12-12T11:56:55.123 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:54 smithi093 ceph-mon[171709]: Health check failed: Degraded data redundancy: 4/219 objects degraded (1.826%), 2 pgs degraded (PG_DEGRADED) 2023-12-12T11:56:55.471 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 11:56:55 smithi093 ceph-osd[184328]: -- 172.21.15.93:0/2692449653 <== mon.1 v2:172.21.15.93:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55da830c16c0 con 0x55da83091000 2023-12-12T11:56:55.471 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 11:56:55 smithi093 bash[184291]: 36b87923d47af6cee3d39e4690db2f710656f2c08d14cefb02d97d7bab3cb79e 2023-12-12T11:56:55.471 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 11:56:55 smithi093 systemd[1]: Started Ceph osd.3 for 85e33c70-98e3-11ee-95a3-87774f69a715. 2023-12-12T11:56:56.221 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 11:56:55 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-3[184305]: 2023-12-12T11:56:55.736+0000 7fe9c5c41640 -1 Falling back to public interface 2023-12-12T11:56:56.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:56 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:56.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:56 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:56.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:56 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:56:56.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:56 smithi093 ceph-mon[171709]: pgmap v105: 65 pgs: 7 active+undersized+degraded, 25 peering, 6 active+undersized, 27 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 17/219 objects degraded (7.763%) 2023-12-12T11:56:56.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:56 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:56.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:56 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:56.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:56 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:56:56.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:56 smithi063 ceph-mon[187282]: pgmap v105: 65 pgs: 7 active+undersized+degraded, 25 peering, 6 active+undersized, 27 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 17/219 objects degraded (7.763%) 2023-12-12T11:56:57.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:57 smithi093 ceph-mon[171709]: pgmap v106: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 47/219 objects degraded (21.461%) 2023-12-12T11:56:57.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:57 smithi093 ceph-mon[171709]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 13 pgs peering) 2023-12-12T11:56:57.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:57 smithi063 ceph-mon[187282]: pgmap v106: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 47/219 objects degraded (21.461%) 2023-12-12T11:56:57.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:57 smithi063 ceph-mon[187282]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 13 pgs peering) 2023-12-12T11:56:59.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:59 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:59.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:56:59 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:59.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:59 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:56:59.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:56:59 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:00.453 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:00 smithi093 ceph-mon[171709]: pgmap v107: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 47/219 objects degraded (21.461%) 2023-12-12T11:57:00.453 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:00 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:00.453 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:00 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:00.454 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:00 smithi093 ceph-mon[171709]: Health check update: Degraded data redundancy: 47/219 objects degraded (21.461%), 17 pgs degraded (PG_DEGRADED) 2023-12-12T11:57:00.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:00 smithi063 ceph-mon[187282]: pgmap v107: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 47/219 objects degraded (21.461%) 2023-12-12T11:57:00.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:00 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:00.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:00 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:00.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:00 smithi063 ceph-mon[187282]: Health check update: Degraded data redundancy: 47/219 objects degraded (21.461%), 17 pgs degraded (PG_DEGRADED) 2023-12-12T11:57:01.221 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 11:57:00 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-3[184305]: 2023-12-12T11:57:00.934+0000 7fe9c5c41640 -1 osd.3 0 read_superblock omap replica is missing. 2023-12-12T11:57:01.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:01 smithi093 ceph-mon[171709]: pgmap v108: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 47/219 objects degraded (21.461%) 2023-12-12T11:57:01.721 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 11:57:01 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-3[184305]: 2023-12-12T11:57:01.633+0000 7fe9c5c41640 -1 osd.3 64 log_to_monitors true 2023-12-12T11:57:01.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:01 smithi063 ceph-mon[187282]: pgmap v108: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 47/219 objects degraded (21.461%) 2023-12-12T11:57:02.665 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:02 smithi093 ceph-mon[171709]: from='osd.3 [v2:172.21.15.93:6800/2608957664,v1:172.21.15.93:6801/2608957664]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-12T11:57:02.665 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:02 smithi093 ceph-mon[171709]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-12T11:57:02.666 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 11:57:02 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-3[184305]: 2023-12-12T11:57:02.477+0000 7fe9b50ae700 -1 osd.3 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T11:57:02.776 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:02 smithi063 ceph-mon[187282]: from='osd.3 [v2:172.21.15.93:6800/2608957664,v1:172.21.15.93:6801/2608957664]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-12T11:57:02.776 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:02 smithi063 ceph-mon[187282]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-12T11:57:03.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:03 smithi063 ceph-mon[187282]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-12T11:57:03.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:03 smithi063 ceph-mon[187282]: from='osd.3 [v2:172.21.15.93:6800/2608957664,v1:172.21.15.93:6801/2608957664]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-12T11:57:03.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:03 smithi063 ceph-mon[187282]: osdmap e67: 6 total, 5 up, 6 in 2023-12-12T11:57:03.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:03 smithi063 ceph-mon[187282]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-12T11:57:03.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:03 smithi063 ceph-mon[187282]: failed to encode map e67 with expected crc 2023-12-12T11:57:03.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:03 smithi063 ceph-mon[187282]: failed to encode map e67 with expected crc 2023-12-12T11:57:03.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:03 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:03.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:03 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:03.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:03 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:57:03.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:03 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:57:03.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:03 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:03.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:03 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:57:03.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:03 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:57:03.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:03 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:57:03.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:03 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:57:03.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:03 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-12T11:57:03.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:03 smithi063 ceph-mon[187282]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-12T11:57:03.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:03 smithi063 ceph-mon[187282]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2023-12-12T11:57:03.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:03 smithi063 ceph-mon[187282]: pgmap v110: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 47/219 objects degraded (21.461%) 2023-12-12T11:57:03.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:03 smithi093 ceph-mon[171709]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-12T11:57:03.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:03 smithi093 ceph-mon[171709]: from='osd.3 [v2:172.21.15.93:6800/2608957664,v1:172.21.15.93:6801/2608957664]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-12T11:57:03.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:03 smithi093 ceph-mon[171709]: osdmap e67: 6 total, 5 up, 6 in 2023-12-12T11:57:03.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:03 smithi093 ceph-mon[171709]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-12T11:57:03.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:03 smithi093 ceph-mon[171709]: failed to encode map e67 with expected crc 2023-12-12T11:57:03.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:03 smithi093 ceph-mon[171709]: failed to encode map e67 with expected crc 2023-12-12T11:57:03.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:03 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:03.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:03 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:03.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:03 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:57:03.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:03 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:57:03.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:03 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:03.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:03 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:57:03.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:03 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:57:03.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:03 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:57:03.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:03 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:57:03.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:03 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-12T11:57:03.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:03 smithi093 ceph-mon[171709]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-12T11:57:03.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:03 smithi093 ceph-mon[171709]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2023-12-12T11:57:03.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:03 smithi093 ceph-mon[171709]: pgmap v110: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 47/219 objects degraded (21.461%) 2023-12-12T11:57:04.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.687+0000 7fa5714c6700 1 -- 172.21.15.63:0/1517629958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa56c0fcbf0 msgr2=0x7fa56c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:04.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.687+0000 7fa5714c6700 1 --2- 172.21.15.63:0/1517629958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa56c0fcbf0 0x7fa56c0fd000 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa55c004940 tx=0x7fa55c009e30 comp rx=0 tx=0).stop 2023-12-12T11:57:04.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.687+0000 7fa5714c6700 1 -- 172.21.15.63:0/1517629958 shutdown_connections 2023-12-12T11:57:04.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.687+0000 7fa5714c6700 1 --2- 172.21.15.63:0/1517629958 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa56c0fde00 0x7fa56c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:04.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.687+0000 7fa5714c6700 1 --2- 172.21.15.63:0/1517629958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa56c0fcbf0 0x7fa56c0fd000 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:04.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.687+0000 7fa5714c6700 1 -- 172.21.15.63:0/1517629958 >> 172.21.15.63:0/1517629958 conn(0x7fa56c0f82d0 msgr2=0x7fa56c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:57:04.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.687+0000 7fa5714c6700 1 -- 172.21.15.63:0/1517629958 shutdown_connections 2023-12-12T11:57:04.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.687+0000 7fa5714c6700 1 -- 172.21.15.63:0/1517629958 wait complete. 2023-12-12T11:57:04.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.689+0000 7fa5714c6700 1 Processor -- start 2023-12-12T11:57:04.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.689+0000 7fa5714c6700 1 -- start start 2023-12-12T11:57:04.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.689+0000 7fa5714c6700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa56c0fcbf0 0x7fa56c10f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:04.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.689+0000 7fa5714c6700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa56c0fde00 0x7fa56c10fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:04.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.689+0000 7fa5714c6700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c1102e0 con 0x7fa56c0fde00 2023-12-12T11:57:04.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.689+0000 7fa5714c6700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c110b80 con 0x7fa56c0fcbf0 2023-12-12T11:57:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.690+0000 7fa56a7fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa56c0fde00 0x7fa56c10fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.690+0000 7fa56a7fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa56c0fde00 0x7fa56c10fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33864/0 (socket says 172.21.15.63:33864) 2023-12-12T11:57:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.690+0000 7fa56a7fc700 1 -- 172.21.15.63:0/2310190326 learned_addr learned my addr 172.21.15.63:0/2310190326 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:57:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.690+0000 7fa56affd700 1 --2- 172.21.15.63:0/2310190326 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa56c0fcbf0 0x7fa56c10f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.690+0000 7fa56a7fc700 1 -- 172.21.15.63:0/2310190326 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa56c0fcbf0 msgr2=0x7fa56c10f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:04.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.690+0000 7fa56a7fc700 1 --2- 172.21.15.63:0/2310190326 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa56c0fcbf0 0x7fa56c10f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:04.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.690+0000 7fa56a7fc700 1 -- 172.21.15.63:0/2310190326 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c005040 con 0x7fa56c0fde00 2023-12-12T11:57:04.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.690+0000 7fa56a7fc700 1 --2- 172.21.15.63:0/2310190326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa56c0fde00 0x7fa56c10fce0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa560002a50 tx=0x7fa5600046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:57:04.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.691+0000 7fa5537fe700 1 -- 172.21.15.63:0/2310190326 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa560007cc0 con 0x7fa56c0fde00 2023-12-12T11:57:04.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.691+0000 7fa5537fe700 1 -- 172.21.15.63:0/2310190326 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa56000f040 con 0x7fa56c0fde00 2023-12-12T11:57:04.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.691+0000 7fa5714c6700 1 -- 172.21.15.63:0/2310190326 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa56c110e60 con 0x7fa56c0fde00 2023-12-12T11:57:04.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.691+0000 7fa5537fe700 1 -- 172.21.15.63:0/2310190326 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa56000d9c0 con 0x7fa56c0fde00 2023-12-12T11:57:04.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.691+0000 7fa5714c6700 1 -- 172.21.15.63:0/2310190326 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa56c1113a0 con 0x7fa56c0fde00 2023-12-12T11:57:04.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.692+0000 7fa5714c6700 1 -- 172.21.15.63:0/2310190326 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56c101ea0 con 0x7fa56c0fde00 2023-12-12T11:57:04.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.693+0000 7fa5537fe700 1 -- 172.21.15.63:0/2310190326 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fa56000db60 con 0x7fa56c0fde00 2023-12-12T11:57:04.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.694+0000 7fa5537fe700 1 --2- 172.21.15.63:0/2310190326 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fa55406ce70 0x7fa55406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:04.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.694+0000 7fa5537fe700 1 -- 172.21.15.63:0/2310190326 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fa56008b9b0 con 0x7fa56c0fde00 2023-12-12T11:57:04.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.694+0000 7fa56affd700 1 --2- 172.21.15.63:0/2310190326 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fa55406ce70 0x7fa55406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:04.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.695+0000 7fa56affd700 1 --2- 172.21.15.63:0/2310190326 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fa55406ce70 0x7fa55406f320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00b7d0 tx=0x7fa55c009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:57:04.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.698+0000 7fa5537fe700 1 -- 172.21.15.63:0/2310190326 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa5600592a0 con 0x7fa56c0fde00 2023-12-12T11:57:04.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:04 smithi063 ceph-mon[187282]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-12T11:57:04.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:04 smithi063 ceph-mon[187282]: failed to encode map e68 with expected crc 2023-12-12T11:57:04.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:04 smithi063 ceph-mon[187282]: osd.3 [v2:172.21.15.93:6800/2608957664,v1:172.21.15.93:6801/2608957664] boot 2023-12-12T11:57:04.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:04 smithi063 ceph-mon[187282]: osdmap e68: 6 total, 6 up, 6 in 2023-12-12T11:57:04.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:04 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-12T11:57:04.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.928+0000 7fa5714c6700 1 -- 172.21.15.63:0/2310190326 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa56c111680 con 0x7fa55406ce70 2023-12-12T11:57:04.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.930+0000 7fa5537fe700 1 -- 172.21.15.63:0/2310190326 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fa56c111680 con 0x7fa55406ce70 2023-12-12T11:57:04.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.932+0000 7fa5714c6700 1 -- 172.21.15.63:0/2310190326 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fa55406ce70 msgr2=0x7fa55406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:04.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.932+0000 7fa5714c6700 1 --2- 172.21.15.63:0/2310190326 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fa55406ce70 0x7fa55406f320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00b7d0 tx=0x7fa55c009e30 comp rx=0 tx=0).stop 2023-12-12T11:57:04.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.932+0000 7fa5714c6700 1 -- 172.21.15.63:0/2310190326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa56c0fde00 msgr2=0x7fa56c10fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:04.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.932+0000 7fa5714c6700 1 --2- 172.21.15.63:0/2310190326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa56c0fde00 0x7fa56c10fce0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa560002a50 tx=0x7fa5600046b0 comp rx=0 tx=0).stop 2023-12-12T11:57:04.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.932+0000 7fa5714c6700 1 -- 172.21.15.63:0/2310190326 shutdown_connections 2023-12-12T11:57:04.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.932+0000 7fa5714c6700 1 --2- 172.21.15.63:0/2310190326 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fa55406ce70 0x7fa55406f320 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:04.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.932+0000 7fa5714c6700 1 --2- 172.21.15.63:0/2310190326 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa56c0fcbf0 0x7fa56c10f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:04.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.932+0000 7fa5714c6700 1 --2- 172.21.15.63:0/2310190326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa56c0fde00 0x7fa56c10fce0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:04.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.932+0000 7fa5714c6700 1 -- 172.21.15.63:0/2310190326 >> 172.21.15.63:0/2310190326 conn(0x7fa56c0f82d0 msgr2=0x7fa56c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:57:04.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.932+0000 7fa5714c6700 1 -- 172.21.15.63:0/2310190326 shutdown_connections 2023-12-12T11:57:04.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:04.932+0000 7fa5714c6700 1 -- 172.21.15.63:0/2310190326 wait complete. 2023-12-12T11:57:04.949 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-12T11:57:04.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:04 smithi093 ceph-mon[171709]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-12T11:57:04.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:04 smithi093 ceph-mon[171709]: failed to encode map e68 with expected crc 2023-12-12T11:57:04.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:04 smithi093 ceph-mon[171709]: osd.3 [v2:172.21.15.93:6800/2608957664,v1:172.21.15.93:6801/2608957664] boot 2023-12-12T11:57:04.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:04 smithi093 ceph-mon[171709]: osdmap e68: 6 total, 6 up, 6 in 2023-12-12T11:57:04.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:04 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-12T11:57:05.073 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.071+0000 7f3859448700 1 -- 172.21.15.63:0/4284890950 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38540fde00 msgr2=0x7f38540fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:05.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.071+0000 7f3859448700 1 --2- 172.21.15.63:0/4284890950 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38540fde00 0x7f38540fe250 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3848004940 tx=0x7f3848009e30 comp rx=0 tx=0).stop 2023-12-12T11:57:05.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.071+0000 7f3859448700 1 -- 172.21.15.63:0/4284890950 shutdown_connections 2023-12-12T11:57:05.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.071+0000 7f3859448700 1 --2- 172.21.15.63:0/4284890950 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38540fde00 0x7f38540fe250 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:05.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.071+0000 7f3859448700 1 --2- 172.21.15.63:0/4284890950 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38540fcbf0 0x7f38540fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:05.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.071+0000 7f3859448700 1 -- 172.21.15.63:0/4284890950 >> 172.21.15.63:0/4284890950 conn(0x7f38540f82d0 msgr2=0x7f38540fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:57:05.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.071+0000 7f3859448700 1 -- 172.21.15.63:0/4284890950 shutdown_connections 2023-12-12T11:57:05.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.071+0000 7f3859448700 1 -- 172.21.15.63:0/4284890950 wait complete. 2023-12-12T11:57:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.072+0000 7f3859448700 1 Processor -- start 2023-12-12T11:57:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.072+0000 7f3859448700 1 -- start start 2023-12-12T11:57:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.072+0000 7f3859448700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38540fcbf0 0x7f385410d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.072+0000 7f3859448700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38540fde00 0x7f385410dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.072+0000 7f3859448700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385410e0c0 con 0x7f38540fcbf0 2023-12-12T11:57:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.072+0000 7f3859448700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385410e960 con 0x7f38540fde00 2023-12-12T11:57:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.072+0000 7f3852ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38540fcbf0 0x7f385410d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.073+0000 7f3852ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38540fcbf0 0x7f385410d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33884/0 (socket says 172.21.15.63:33884) 2023-12-12T11:57:05.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.073+0000 7f3852ffd700 1 -- 172.21.15.63:0/3245389347 learned_addr learned my addr 172.21.15.63:0/3245389347 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:57:05.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.073+0000 7f38527fc700 1 --2- 172.21.15.63:0/3245389347 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38540fde00 0x7f385410dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:05.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.073+0000 7f3852ffd700 1 -- 172.21.15.63:0/3245389347 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38540fde00 msgr2=0x7f385410dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:05.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.073+0000 7f3852ffd700 1 --2- 172.21.15.63:0/3245389347 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38540fde00 0x7f385410dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:05.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.073+0000 7f3852ffd700 1 -- 172.21.15.63:0/3245389347 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3848005040 con 0x7f38540fcbf0 2023-12-12T11:57:05.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.073+0000 7f3852ffd700 1 --2- 172.21.15.63:0/3245389347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38540fcbf0 0x7f385410d580 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3844002a80 tx=0x7f3844004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:57:05.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.073+0000 7f383b7fe700 1 -- 172.21.15.63:0/3245389347 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3844007cc0 con 0x7f38540fcbf0 2023-12-12T11:57:05.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.073+0000 7f383b7fe700 1 -- 172.21.15.63:0/3245389347 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f384400f040 con 0x7f38540fcbf0 2023-12-12T11:57:05.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.073+0000 7f383b7fe700 1 -- 172.21.15.63:0/3245389347 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f384400d9c0 con 0x7f38540fcbf0 2023-12-12T11:57:05.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.074+0000 7f3859448700 1 -- 172.21.15.63:0/3245389347 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f385410ec40 con 0x7f38540fcbf0 2023-12-12T11:57:05.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.074+0000 7f3859448700 1 -- 172.21.15.63:0/3245389347 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f385410f180 con 0x7f38540fcbf0 2023-12-12T11:57:05.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.075+0000 7f3859448700 1 -- 172.21.15.63:0/3245389347 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f385404bb80 con 0x7f38540fcbf0 2023-12-12T11:57:05.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.076+0000 7f383b7fe700 1 -- 172.21.15.63:0/3245389347 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f384400db20 con 0x7f38540fcbf0 2023-12-12T11:57:05.079 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.077+0000 7f383b7fe700 1 --2- 172.21.15.63:0/3245389347 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f383c06ce70 0x7f383c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:05.079 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.077+0000 7f383b7fe700 1 -- 172.21.15.63:0/3245389347 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f384408bfe0 con 0x7f38540fcbf0 2023-12-12T11:57:05.079 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.077+0000 7f38527fc700 1 --2- 172.21.15.63:0/3245389347 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f383c06ce70 0x7f383c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:05.079 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.077+0000 7f38527fc700 1 --2- 172.21.15.63:0/3245389347 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f383c06ce70 0x7f383c06f320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f38480043d0 tx=0x7f3848009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:57:05.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.081+0000 7f383b7fe700 1 -- 172.21.15.63:0/3245389347 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f38440598f0 con 0x7f38540fcbf0 2023-12-12T11:57:05.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.309+0000 7f3859448700 1 -- 172.21.15.63:0/3245389347 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f385410f620 con 0x7f383c06ce70 2023-12-12T11:57:05.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.310+0000 7f383b7fe700 1 -- 172.21.15.63:0/3245389347 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f385410f620 con 0x7f383c06ce70 2023-12-12T11:57:05.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.313+0000 7f3859448700 1 -- 172.21.15.63:0/3245389347 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f383c06ce70 msgr2=0x7f383c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:05.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.313+0000 7f3859448700 1 --2- 172.21.15.63:0/3245389347 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f383c06ce70 0x7f383c06f320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f38480043d0 tx=0x7f3848009e30 comp rx=0 tx=0).stop 2023-12-12T11:57:05.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.313+0000 7f3859448700 1 -- 172.21.15.63:0/3245389347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38540fcbf0 msgr2=0x7f385410d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:05.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.313+0000 7f3859448700 1 --2- 172.21.15.63:0/3245389347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38540fcbf0 0x7f385410d580 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3844002a80 tx=0x7f3844004600 comp rx=0 tx=0).stop 2023-12-12T11:57:05.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.313+0000 7f3859448700 1 -- 172.21.15.63:0/3245389347 shutdown_connections 2023-12-12T11:57:05.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.313+0000 7f3859448700 1 --2- 172.21.15.63:0/3245389347 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f383c06ce70 0x7f383c06f320 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:05.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.313+0000 7f3859448700 1 --2- 172.21.15.63:0/3245389347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38540fcbf0 0x7f385410d580 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:05.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.313+0000 7f3859448700 1 --2- 172.21.15.63:0/3245389347 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38540fde00 0x7f385410dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:05.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.313+0000 7f3859448700 1 -- 172.21.15.63:0/3245389347 >> 172.21.15.63:0/3245389347 conn(0x7f38540f82d0 msgr2=0x7f3854101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:57:05.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.313+0000 7f3859448700 1 -- 172.21.15.63:0/3245389347 shutdown_connections 2023-12-12T11:57:05.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.313+0000 7f3859448700 1 -- 172.21.15.63:0/3245389347 wait complete. 2023-12-12T11:57:05.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.453+0000 7f5087e43700 1 -- 172.21.15.63:0/4087771391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50800fde00 msgr2=0x7f50800fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:05.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.453+0000 7f5087e43700 1 --2- 172.21.15.63:0/4087771391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50800fde00 0x7f50800fe250 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5070004940 tx=0x7f5070009e30 comp rx=0 tx=0).stop 2023-12-12T11:57:05.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.453+0000 7f5087e43700 1 -- 172.21.15.63:0/4087771391 shutdown_connections 2023-12-12T11:57:05.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.453+0000 7f5087e43700 1 --2- 172.21.15.63:0/4087771391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50800fde00 0x7f50800fe250 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:05.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.453+0000 7f5087e43700 1 --2- 172.21.15.63:0/4087771391 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50800fcbf0 0x7f50800fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:05.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.453+0000 7f5087e43700 1 -- 172.21.15.63:0/4087771391 >> 172.21.15.63:0/4087771391 conn(0x7f50800f82d0 msgr2=0x7f50800fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:57:05.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.453+0000 7f5087e43700 1 -- 172.21.15.63:0/4087771391 shutdown_connections 2023-12-12T11:57:05.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.453+0000 7f5087e43700 1 -- 172.21.15.63:0/4087771391 wait complete. 2023-12-12T11:57:05.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.454+0000 7f5087e43700 1 Processor -- start 2023-12-12T11:57:05.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.454+0000 7f5087e43700 1 -- start start 2023-12-12T11:57:05.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.455+0000 7f5087e43700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50800fcbf0 0x7f508010f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:05.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.455+0000 7f5087e43700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50800fde00 0x7f508010fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:05.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.455+0000 7f5087e43700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5080110310 con 0x7f50800fcbf0 2023-12-12T11:57:05.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.455+0000 7f5087e43700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5080110b60 con 0x7f50800fde00 2023-12-12T11:57:05.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.455+0000 7f5085bdf700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50800fcbf0 0x7f508010f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:05.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.455+0000 7f5085bdf700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50800fcbf0 0x7f508010f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33902/0 (socket says 172.21.15.63:33902) 2023-12-12T11:57:05.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.455+0000 7f5085bdf700 1 -- 172.21.15.63:0/1860813895 learned_addr learned my addr 172.21.15.63:0/1860813895 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:57:05.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.455+0000 7f50853de700 1 --2- 172.21.15.63:0/1860813895 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50800fde00 0x7f508010fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:05.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.455+0000 7f5085bdf700 1 -- 172.21.15.63:0/1860813895 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50800fde00 msgr2=0x7f508010fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:05.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.455+0000 7f5085bdf700 1 --2- 172.21.15.63:0/1860813895 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50800fde00 0x7f508010fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:05.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.455+0000 7f5085bdf700 1 -- 172.21.15.63:0/1860813895 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5070005040 con 0x7f50800fcbf0 2023-12-12T11:57:05.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.456+0000 7f5085bdf700 1 --2- 172.21.15.63:0/1860813895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50800fcbf0 0x7f508010f7d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f507c00c8e0 tx=0x7f507c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:57:05.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.456+0000 7f50767fc700 1 -- 172.21.15.63:0/1860813895 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f507c00a760 con 0x7f50800fcbf0 2023-12-12T11:57:05.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.456+0000 7f5087e43700 1 -- 172.21.15.63:0/1860813895 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5080110e40 con 0x7f50800fcbf0 2023-12-12T11:57:05.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.456+0000 7f50767fc700 1 -- 172.21.15.63:0/1860813895 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f507c00ad70 con 0x7f50800fcbf0 2023-12-12T11:57:05.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.456+0000 7f50767fc700 1 -- 172.21.15.63:0/1860813895 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f507c0113a0 con 0x7f50800fcbf0 2023-12-12T11:57:05.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.456+0000 7f5087e43700 1 -- 172.21.15.63:0/1860813895 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5080111380 con 0x7f50800fcbf0 2023-12-12T11:57:05.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.457+0000 7f5087e43700 1 -- 172.21.15.63:0/1860813895 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5080101ea0 con 0x7f50800fcbf0 2023-12-12T11:57:05.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.458+0000 7f50767fc700 1 -- 172.21.15.63:0/1860813895 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f507c012400 con 0x7f50800fcbf0 2023-12-12T11:57:05.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.459+0000 7f50767fc700 1 --2- 172.21.15.63:0/1860813895 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f506c06ce70 0x7f506c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:05.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.459+0000 7f50767fc700 1 -- 172.21.15.63:0/1860813895 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f507c08c3d0 con 0x7f50800fcbf0 2023-12-12T11:57:05.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.459+0000 7f50853de700 1 --2- 172.21.15.63:0/1860813895 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f506c06ce70 0x7f506c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:05.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.460+0000 7f50853de700 1 --2- 172.21.15.63:0/1860813895 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f506c06ce70 0x7f506c06f320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f50700043d0 tx=0x7f5070009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:57:05.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.464+0000 7f50767fc700 1 -- 172.21.15.63:0/1860813895 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f507c059cc0 con 0x7f50800fcbf0 2023-12-12T11:57:05.686 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.684+0000 7f5087e43700 1 -- 172.21.15.63:0/1860813895 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5080111600 con 0x7f506c06ce70 2023-12-12T11:57:05.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.694+0000 7f50767fc700 1 -- 172.21.15.63:0/1860813895 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f5080111600 con 0x7f506c06ce70 2023-12-12T11:57:05.697 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-12T11:57:05.697 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (4m) 40s ago 12m 14.9M - 0.25.0 c8568f914cd2 f237d9f64783 2023-12-12T11:57:05.697 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (2m) 40s ago 12m 7838k - 19.0.0-96-gf1fbf3c5 8cf689f388db 202fa7506e7c 2023-12-12T11:57:05.697 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi093 smithi093 running (2m) 7s ago 11m 7852k - 19.0.0-96-gf1fbf3c5 8cf689f388db ac9d76320ce6 2023-12-12T11:57:05.697 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (4m) 40s ago 12m 78.5M - 9.4.7 954c08fa6188 51300a1a5b87 2023-12-12T11:57:05.697 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.aevpzg smithi063 running (7m) 40s ago 7m 10.5G - 17.2.7-123-gbef78a51 ae6196193935 df9a6781f836 2023-12-12T11:57:05.697 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.bdqbnp smithi063 running (8m) 40s ago 8m 15.6M - 17.2.7-123-gbef78a51 ae6196193935 0c7e1d21eee9 2023-12-12T11:57:05.697 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.rhaqsh smithi093 running (8m) 7s ago 8m 15.6M - 17.2.7-123-gbef78a51 ae6196193935 257aee771d87 2023-12-12T11:57:05.697 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.swdqms smithi093 running (7m) 7s ago 7m 15.6M - 17.2.7-123-gbef78a51 ae6196193935 f46d7173d3b1 2023-12-12T11:57:05.697 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.zjnfdi smithi063 *:8443,9283,8765 running (4m) 40s ago 13m 515M - 19.0.0-96-gf1fbf3c5 8cf689f388db dab6fa4aaa54 2023-12-12T11:57:05.697 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi093.nbtltu smithi093 *:8443,9283,8765 running (3m) 7s ago 11m 452M - 19.0.0-96-gf1fbf3c5 8cf689f388db 701529e7fa8e 2023-12-12T11:57:05.697 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (3m) 40s ago 13m 61.7M 2048M 19.0.0-96-gf1fbf3c5 8cf689f388db 11f12a2e88e4 2023-12-12T11:57:05.697 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi093 smithi093 running (2m) 7s ago 11m 49.7M 2048M 19.0.0-96-gf1fbf3c5 8cf689f388db 1ffc49fcd680 2023-12-12T11:57:05.697 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (5m) 40s ago 12m 8510k - 1.5.0 0da6a335fe13 8eed63374ddf 2023-12-12T11:57:05.698 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi093 smithi093 *:9100 running (4m) 7s ago 11m 8384k - 1.5.0 0da6a335fe13 10e19431c1a2 2023-12-12T11:57:05.698 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (111s) 40s ago 11m 131M 1618M 19.0.0-96-gf1fbf3c5 8cf689f388db fade55811ec1 2023-12-12T11:57:05.698 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (78s) 40s ago 10m 138M 1618M 19.0.0-96-gf1fbf3c5 8cf689f388db 733e6ff9e83d 2023-12-12T11:57:05.698 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (44s) 40s ago 10m 12.5M 1618M 19.0.0-96-gf1fbf3c5 8cf689f388db bc155cfbaf86 2023-12-12T11:57:05.698 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi093 running (10s) 7s ago 9m 12.5M 2642M 19.0.0-96-gf1fbf3c5 8cf689f388db 36b87923d47a 2023-12-12T11:57:05.698 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi093 running (9m) 7s ago 9m 836M 2642M 17.2.7-123-gbef78a51 ae6196193935 7dc3f04b04cb 2023-12-12T11:57:05.698 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi093 running (9m) 7s ago 9m 976M 2642M 17.2.7-123-gbef78a51 ae6196193935 16fe8e4668f1 2023-12-12T11:57:05.698 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (3m) 40s ago 12m 48.2M - 2.43.0 a07b618ecd1d 834d9fc4eb61 2023-12-12T11:57:05.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.696+0000 7f5087e43700 1 -- 172.21.15.63:0/1860813895 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f506c06ce70 msgr2=0x7f506c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:05.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.696+0000 7f5087e43700 1 --2- 172.21.15.63:0/1860813895 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f506c06ce70 0x7f506c06f320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f50700043d0 tx=0x7f5070009e30 comp rx=0 tx=0).stop 2023-12-12T11:57:05.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.696+0000 7f5087e43700 1 -- 172.21.15.63:0/1860813895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50800fcbf0 msgr2=0x7f508010f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:05.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.696+0000 7f5087e43700 1 --2- 172.21.15.63:0/1860813895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50800fcbf0 0x7f508010f7d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f507c00c8e0 tx=0x7f507c0044c0 comp rx=0 tx=0).stop 2023-12-12T11:57:05.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.696+0000 7f5087e43700 1 -- 172.21.15.63:0/1860813895 shutdown_connections 2023-12-12T11:57:05.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.696+0000 7f5087e43700 1 --2- 172.21.15.63:0/1860813895 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f506c06ce70 0x7f506c06f320 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:05.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.696+0000 7f5087e43700 1 --2- 172.21.15.63:0/1860813895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50800fcbf0 0x7f508010f7d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:05.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.696+0000 7f5087e43700 1 --2- 172.21.15.63:0/1860813895 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50800fde00 0x7f508010fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:05.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.696+0000 7f5087e43700 1 -- 172.21.15.63:0/1860813895 >> 172.21.15.63:0/1860813895 conn(0x7f50800f82d0 msgr2=0x7f50800ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:57:05.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.696+0000 7f5087e43700 1 -- 172.21.15.63:0/1860813895 shutdown_connections 2023-12-12T11:57:05.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.696+0000 7f5087e43700 1 -- 172.21.15.63:0/1860813895 wait complete. 2023-12-12T11:57:05.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:05 smithi063 ceph-mon[187282]: failed to encode map e69 with expected crc 2023-12-12T11:57:05.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:05 smithi063 ceph-mon[187282]: osdmap e69: 6 total, 6 up, 6 in 2023-12-12T11:57:05.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:05 smithi063 ceph-mon[187282]: failed to encode map e69 with expected crc 2023-12-12T11:57:05.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:05 smithi063 ceph-mon[187282]: failed to encode map e69 with expected crc 2023-12-12T11:57:05.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:05 smithi063 ceph-mon[187282]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:57:05.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:05 smithi063 ceph-mon[187282]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:57:05.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:05 smithi063 ceph-mon[187282]: pgmap v113: 65 pgs: 13 active+undersized+degraded, 18 active+undersized, 34 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/219 objects degraded (15.982%) 2023-12-12T11:57:05.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:05 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:05.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:05 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:57:05.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.834+0000 7f9cc32bf700 1 -- 172.21.15.63:0/1822320733 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9cbc0fde00 msgr2=0x7f9cbc0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:05.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.834+0000 7f9cc32bf700 1 --2- 172.21.15.63:0/1822320733 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9cbc0fde00 0x7f9cbc0fe250 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9cac004940 tx=0x7f9cac009e30 comp rx=0 tx=0).stop 2023-12-12T11:57:05.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.834+0000 7f9cc32bf700 1 -- 172.21.15.63:0/1822320733 shutdown_connections 2023-12-12T11:57:05.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.834+0000 7f9cc32bf700 1 --2- 172.21.15.63:0/1822320733 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9cbc0fde00 0x7f9cbc0fe250 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:05.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.834+0000 7f9cc32bf700 1 --2- 172.21.15.63:0/1822320733 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9cbc0fcbf0 0x7f9cbc0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:05.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.834+0000 7f9cc32bf700 1 -- 172.21.15.63:0/1822320733 >> 172.21.15.63:0/1822320733 conn(0x7f9cbc0f82d0 msgr2=0x7f9cbc0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:57:05.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.835+0000 7f9cc32bf700 1 -- 172.21.15.63:0/1822320733 shutdown_connections 2023-12-12T11:57:05.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.835+0000 7f9cc32bf700 1 -- 172.21.15.63:0/1822320733 wait complete. 2023-12-12T11:57:05.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.835+0000 7f9cc32bf700 1 Processor -- start 2023-12-12T11:57:05.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.835+0000 7f9cc32bf700 1 -- start start 2023-12-12T11:57:05.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.836+0000 7f9cc32bf700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9cbc0fcbf0 0x7f9cbc071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:05.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.836+0000 7f9cc32bf700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9cbc0fde00 0x7f9cbc06ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:05.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.836+0000 7f9cc32bf700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc070590 con 0x7f9cbc0fde00 2023-12-12T11:57:05.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.836+0000 7f9cc32bf700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc070700 con 0x7f9cbc0fcbf0 2023-12-12T11:57:05.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.836+0000 7f9cc085a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9cbc0fde00 0x7f9cbc06ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:05.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.836+0000 7f9cc085a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9cbc0fde00 0x7f9cbc06ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33928/0 (socket says 172.21.15.63:33928) 2023-12-12T11:57:05.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.836+0000 7f9cc085a700 1 -- 172.21.15.63:0/717985718 learned_addr learned my addr 172.21.15.63:0/717985718 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:57:05.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.836+0000 7f9cc105b700 1 --2- 172.21.15.63:0/717985718 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9cbc0fcbf0 0x7f9cbc071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:05.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.837+0000 7f9cc085a700 1 -- 172.21.15.63:0/717985718 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9cbc0fcbf0 msgr2=0x7f9cbc071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:05.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.837+0000 7f9cc085a700 1 --2- 172.21.15.63:0/717985718 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9cbc0fcbf0 0x7f9cbc071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:05.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.837+0000 7f9cc085a700 1 -- 172.21.15.63:0/717985718 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cac005040 con 0x7f9cbc0fde00 2023-12-12T11:57:05.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.837+0000 7f9cc085a700 1 --2- 172.21.15.63:0/717985718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9cbc0fde00 0x7f9cbc06ff90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009fd0 tx=0x7f9cac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:57:05.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.837+0000 7f9cb1ffb700 1 -- 172.21.15.63:0/717985718 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cac00e040 con 0x7f9cbc0fde00 2023-12-12T11:57:05.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.837+0000 7f9cb1ffb700 1 -- 172.21.15.63:0/717985718 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9cac004290 con 0x7f9cbc0fde00 2023-12-12T11:57:05.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.837+0000 7f9cc32bf700 1 -- 172.21.15.63:0/717985718 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cbc070980 con 0x7f9cbc0fde00 2023-12-12T11:57:05.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.837+0000 7f9cb1ffb700 1 -- 172.21.15.63:0/717985718 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cac01c3f0 con 0x7f9cbc0fde00 2023-12-12T11:57:05.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.837+0000 7f9cc32bf700 1 -- 172.21.15.63:0/717985718 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cbc1155b0 con 0x7f9cbc0fde00 2023-12-12T11:57:05.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.838+0000 7f9cc32bf700 1 -- 172.21.15.63:0/717985718 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cbc04bb80 con 0x7f9cbc0fde00 2023-12-12T11:57:05.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.839+0000 7f9cb1ffb700 1 -- 172.21.15.63:0/717985718 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f9cac013420 con 0x7f9cbc0fde00 2023-12-12T11:57:05.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.840+0000 7f9cb1ffb700 1 --2- 172.21.15.63:0/717985718 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f9ca806ce70 0x7f9ca806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:05.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.841+0000 7f9cb1ffb700 1 -- 172.21.15.63:0/717985718 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f9cac08d770 con 0x7f9cbc0fde00 2023-12-12T11:57:05.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.841+0000 7f9cc105b700 1 --2- 172.21.15.63:0/717985718 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f9ca806ce70 0x7f9ca806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:05.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.841+0000 7f9cc105b700 1 --2- 172.21.15.63:0/717985718 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f9ca806ce70 0x7f9ca806f320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8009fd0 tx=0x7f9cb8009f00 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:57:05.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:05.845+0000 7f9cb1ffb700 1 -- 172.21.15.63:0/717985718 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f9cac05b060 con 0x7f9cbc0fde00 2023-12-12T11:57:05.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:05 smithi093 ceph-mon[171709]: failed to encode map e69 with expected crc 2023-12-12T11:57:05.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:05 smithi093 ceph-mon[171709]: osdmap e69: 6 total, 6 up, 6 in 2023-12-12T11:57:05.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:05 smithi093 ceph-mon[171709]: failed to encode map e69 with expected crc 2023-12-12T11:57:05.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:05 smithi093 ceph-mon[171709]: failed to encode map e69 with expected crc 2023-12-12T11:57:05.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:05 smithi093 ceph-mon[171709]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:57:05.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:05 smithi093 ceph-mon[171709]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:57:05.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:05 smithi093 ceph-mon[171709]: pgmap v113: 65 pgs: 13 active+undersized+degraded, 18 active+undersized, 34 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/219 objects degraded (15.982%) 2023-12-12T11:57:05.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:05 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:05.972 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:05 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:57:06.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.138+0000 7f9cc32bf700 1 -- 172.21.15.63:0/717985718 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9cbc070b10 con 0x7f9cbc0fde00 2023-12-12T11:57:06.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.139+0000 7f9cb1ffb700 1 -- 172.21.15.63:0/717985718 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7f9cbc070b10 con 0x7f9cbc0fde00 2023-12-12T11:57:06.142 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:57:06.142 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-12T11:57:06.142 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 2 2023-12-12T11:57:06.142 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:57:06.142 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-12T11:57:06.142 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 2 2023-12-12T11:57:06.142 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:57:06.142 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-12T11:57:06.142 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 2, 2023-12-12T11:57:06.142 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 4 2023-12-12T11:57:06.142 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:57:06.143 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-12T11:57:06.143 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 4 2023-12-12T11:57:06.143 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:57:06.143 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-12T11:57:06.143 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 6, 2023-12-12T11:57:06.143 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 8 2023-12-12T11:57:06.143 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-12T11:57:06.143 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:57:06.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.141+0000 7f9cc32bf700 1 -- 172.21.15.63:0/717985718 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f9ca806ce70 msgr2=0x7f9ca806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:06.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.141+0000 7f9cc32bf700 1 --2- 172.21.15.63:0/717985718 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f9ca806ce70 0x7f9ca806f320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8009fd0 tx=0x7f9cb8009f00 comp rx=0 tx=0).stop 2023-12-12T11:57:06.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.141+0000 7f9cc32bf700 1 -- 172.21.15.63:0/717985718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9cbc0fde00 msgr2=0x7f9cbc06ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:06.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.141+0000 7f9cc32bf700 1 --2- 172.21.15.63:0/717985718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9cbc0fde00 0x7f9cbc06ff90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009fd0 tx=0x7f9cac009e30 comp rx=0 tx=0).stop 2023-12-12T11:57:06.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.141+0000 7f9cc32bf700 1 -- 172.21.15.63:0/717985718 shutdown_connections 2023-12-12T11:57:06.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.141+0000 7f9cc32bf700 1 --2- 172.21.15.63:0/717985718 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f9ca806ce70 0x7f9ca806f320 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:06.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.141+0000 7f9cc32bf700 1 --2- 172.21.15.63:0/717985718 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9cbc0fcbf0 0x7f9cbc071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:06.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.141+0000 7f9cc32bf700 1 --2- 172.21.15.63:0/717985718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9cbc0fde00 0x7f9cbc06ff90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:06.145 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.141+0000 7f9cc32bf700 1 -- 172.21.15.63:0/717985718 >> 172.21.15.63:0/717985718 conn(0x7f9cbc0f82d0 msgr2=0x7f9cbc101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:57:06.145 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.141+0000 7f9cc32bf700 1 -- 172.21.15.63:0/717985718 shutdown_connections 2023-12-12T11:57:06.145 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.142+0000 7f9cc32bf700 1 -- 172.21.15.63:0/717985718 wait complete. 2023-12-12T11:57:06.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.280+0000 7f0a6f314700 1 -- 172.21.15.63:0/4079947613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a680fd730 msgr2=0x7f0a680ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:06.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.280+0000 7f0a6f314700 1 --2- 172.21.15.63:0/4079947613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a680fd730 0x7f0a680ffb10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0a64004940 tx=0x7f0a64009e30 comp rx=0 tx=0).stop 2023-12-12T11:57:06.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.280+0000 7f0a6f314700 1 -- 172.21.15.63:0/4079947613 shutdown_connections 2023-12-12T11:57:06.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.280+0000 7f0a6f314700 1 --2- 172.21.15.63:0/4079947613 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0a68100050 0x7f0a68102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:06.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.280+0000 7f0a6f314700 1 --2- 172.21.15.63:0/4079947613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a680fd730 0x7f0a680ffb10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:06.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.280+0000 7f0a6f314700 1 -- 172.21.15.63:0/4079947613 >> 172.21.15.63:0/4079947613 conn(0x7f0a680f71d0 msgr2=0x7f0a680f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:57:06.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.280+0000 7f0a6f314700 1 -- 172.21.15.63:0/4079947613 shutdown_connections 2023-12-12T11:57:06.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.280+0000 7f0a6f314700 1 -- 172.21.15.63:0/4079947613 wait complete. 2023-12-12T11:57:06.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.281+0000 7f0a6f314700 1 Processor -- start 2023-12-12T11:57:06.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.281+0000 7f0a6f314700 1 -- start start 2023-12-12T11:57:06.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.281+0000 7f0a6f314700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a680fd730 0x7f0a6810f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:06.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.281+0000 7f0a6f314700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0a68100050 0x7f0a6810fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:06.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.281+0000 7f0a6f314700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a681101b0 con 0x7f0a680fd730 2023-12-12T11:57:06.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.281+0000 7f0a6f314700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a68110a50 con 0x7f0a68100050 2023-12-12T11:57:06.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.282+0000 7f0a6d0b0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a680fd730 0x7f0a6810f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:06.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.282+0000 7f0a6d0b0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a680fd730 0x7f0a6810f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33946/0 (socket says 172.21.15.63:33946) 2023-12-12T11:57:06.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.282+0000 7f0a6d0b0700 1 -- 172.21.15.63:0/1224144248 learned_addr learned my addr 172.21.15.63:0/1224144248 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:57:06.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.282+0000 7f0a6c8af700 1 --2- 172.21.15.63:0/1224144248 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0a68100050 0x7f0a6810fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:06.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.282+0000 7f0a6d0b0700 1 -- 172.21.15.63:0/1224144248 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0a68100050 msgr2=0x7f0a6810fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:06.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.282+0000 7f0a6d0b0700 1 --2- 172.21.15.63:0/1224144248 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0a68100050 0x7f0a6810fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:06.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.282+0000 7f0a6d0b0700 1 -- 172.21.15.63:0/1224144248 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a64005040 con 0x7f0a680fd730 2023-12-12T11:57:06.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.282+0000 7f0a6d0b0700 1 --2- 172.21.15.63:0/1224144248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a680fd730 0x7f0a6810f670 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0a64009fd0 tx=0x7f0a64009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:57:06.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.283+0000 7f0a5dffb700 1 -- 172.21.15.63:0/1224144248 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a64021070 con 0x7f0a680fd730 2023-12-12T11:57:06.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.283+0000 7f0a5dffb700 1 -- 172.21.15.63:0/1224144248 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0a6401c400 con 0x7f0a680fd730 2023-12-12T11:57:06.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.283+0000 7f0a6f314700 1 -- 172.21.15.63:0/1224144248 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a68110cd0 con 0x7f0a680fd730 2023-12-12T11:57:06.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.283+0000 7f0a5dffb700 1 -- 172.21.15.63:0/1224144248 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a6400e070 con 0x7f0a680fd730 2023-12-12T11:57:06.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.283+0000 7f0a6f314700 1 -- 172.21.15.63:0/1224144248 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a68111210 con 0x7f0a680fd730 2023-12-12T11:57:06.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.284+0000 7f0a6f314700 1 -- 172.21.15.63:0/1224144248 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a6804bb80 con 0x7f0a680fd730 2023-12-12T11:57:06.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.285+0000 7f0a5dffb700 1 -- 172.21.15.63:0/1224144248 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f0a6401c570 con 0x7f0a680fd730 2023-12-12T11:57:06.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.286+0000 7f0a5dffb700 1 --2- 172.21.15.63:0/1224144248 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f0a5406ce70 0x7f0a5406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:06.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.286+0000 7f0a5dffb700 1 -- 172.21.15.63:0/1224144248 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f0a6408d560 con 0x7f0a680fd730 2023-12-12T11:57:06.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.286+0000 7f0a6c8af700 1 --2- 172.21.15.63:0/1224144248 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f0a5406ce70 0x7f0a5406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:06.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.287+0000 7f0a6c8af700 1 --2- 172.21.15.63:0/1224144248 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f0a5406ce70 0x7f0a5406f320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0a58009b80 tx=0x7f0a5800b040 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:57:06.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.290+0000 7f0a5dffb700 1 -- 172.21.15.63:0/1224144248 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f0a6405aed0 con 0x7f0a680fd730 2023-12-12T11:57:06.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.548+0000 7f0a6f314700 1 -- 172.21.15.63:0/1224144248 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0a68105580 con 0x7f0a680fd730 2023-12-12T11:57:06.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.548+0000 7f0a5dffb700 1 -- 172.21.15.63:0/1224144248 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1845 (secure 0 0 0) 0x7f0a6405aa60 con 0x7f0a680fd730 2023-12-12T11:57:06.551 INFO:teuthology.orchestra.run.smithi063.stdout:e13 2023-12-12T11:57:06.551 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-12T11:57:06.551 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:57:06.551 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-12T11:57:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:57:06.551 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-12T11:57:06.551 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-12T11:57:06.552 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 13 2023-12-12T11:57:06.552 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-12T11:57:06.552 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-12T11:48:58.523481+0000 2023-12-12T11:57:06.552 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-12T11:49:14.113993+0000 2023-12-12T11:57:06.552 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-12T11:57:06.552 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-12T11:57:06.552 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-12T11:57:06.552 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-12T11:57:06.552 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-12T11:57:06.552 INFO:teuthology.orchestra.run.smithi063.stdout:max_xattr_size 65536 2023-12-12T11:57:06.552 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-12T11:57:06.552 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-12T11:57:06.552 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 46 2023-12-12T11:57:06.552 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:57:06.552 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 1 2023-12-12T11:57:06.552 INFO:teuthology.orchestra.run.smithi063.stdout:in 0 2023-12-12T11:57:06.553 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=14492} 2023-12-12T11:57:06.553 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-12T11:57:06.553 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-12T11:57:06.553 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-12T11:57:06.553 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-12T11:57:06.553 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-12T11:57:06.553 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data enabled 2023-12-12T11:57:06.553 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-12T11:57:06.553 INFO:teuthology.orchestra.run.smithi063.stdout:bal_rank_mask -1 2023-12-12T11:57:06.553 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 1 2023-12-12T11:57:06.553 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.aevpzg{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.63:6828/3709000039,v1:172.21.15.63:6829/3709000039] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:57:06.553 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:57:06.553 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:57:06.553 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2023-12-12T11:57:06.553 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:57:06.553 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.swdqms{-1:14500} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.93:6826/3307558569,v1:172.21.15.93:6827/3307558569] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:57:06.553 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.bdqbnp{-1:14508} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/2191270944,v1:172.21.15.63:6827/2191270944] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:57:06.554 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.rhaqsh{-1:24317} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.93:6824/3161864019,v1:172.21.15.93:6825/3161864019] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:57:06.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.551+0000 7f0a6f314700 1 -- 172.21.15.63:0/1224144248 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f0a5406ce70 msgr2=0x7f0a5406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:06.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.551+0000 7f0a6f314700 1 --2- 172.21.15.63:0/1224144248 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f0a5406ce70 0x7f0a5406f320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0a58009b80 tx=0x7f0a5800b040 comp rx=0 tx=0).stop 2023-12-12T11:57:06.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.551+0000 7f0a6f314700 1 -- 172.21.15.63:0/1224144248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a680fd730 msgr2=0x7f0a6810f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:06.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.551+0000 7f0a6f314700 1 --2- 172.21.15.63:0/1224144248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a680fd730 0x7f0a6810f670 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0a64009fd0 tx=0x7f0a64009e30 comp rx=0 tx=0).stop 2023-12-12T11:57:06.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.551+0000 7f0a6f314700 1 -- 172.21.15.63:0/1224144248 shutdown_connections 2023-12-12T11:57:06.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.551+0000 7f0a6f314700 1 --2- 172.21.15.63:0/1224144248 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f0a5406ce70 0x7f0a5406f320 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:06.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.551+0000 7f0a6f314700 1 --2- 172.21.15.63:0/1224144248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a680fd730 0x7f0a6810f670 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:06.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.551+0000 7f0a6f314700 1 --2- 172.21.15.63:0/1224144248 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0a68100050 0x7f0a6810fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:06.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.551+0000 7f0a6f314700 1 -- 172.21.15.63:0/1224144248 >> 172.21.15.63:0/1224144248 conn(0x7f0a680f71d0 msgr2=0x7f0a680fb520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:57:06.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.551+0000 7f0a6f314700 1 -- 172.21.15.63:0/1224144248 shutdown_connections 2023-12-12T11:57:06.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.551+0000 7f0a6f314700 1 -- 172.21.15.63:0/1224144248 wait complete. 2023-12-12T11:57:06.556 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 13 2023-12-12T11:57:06.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.691+0000 7f7606904700 1 -- 172.21.15.63:0/1549938918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76000fcbf0 msgr2=0x7f76000fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:06.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.691+0000 7f7606904700 1 --2- 172.21.15.63:0/1549938918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76000fcbf0 0x7f76000fd000 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f75f0004940 tx=0x7f75f0009e30 comp rx=0 tx=0).stop 2023-12-12T11:57:06.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.691+0000 7f7606904700 1 -- 172.21.15.63:0/1549938918 shutdown_connections 2023-12-12T11:57:06.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.691+0000 7f7606904700 1 --2- 172.21.15.63:0/1549938918 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f76000fde00 0x7f76000fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:06.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.691+0000 7f7606904700 1 --2- 172.21.15.63:0/1549938918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76000fcbf0 0x7f76000fd000 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:06.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.691+0000 7f7606904700 1 -- 172.21.15.63:0/1549938918 >> 172.21.15.63:0/1549938918 conn(0x7f76000f82d0 msgr2=0x7f76000fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:57:06.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.691+0000 7f7606904700 1 -- 172.21.15.63:0/1549938918 shutdown_connections 2023-12-12T11:57:06.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.691+0000 7f7606904700 1 -- 172.21.15.63:0/1549938918 wait complete. 2023-12-12T11:57:06.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.692+0000 7f7606904700 1 Processor -- start 2023-12-12T11:57:06.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.692+0000 7f7606904700 1 -- start start 2023-12-12T11:57:06.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.692+0000 7f7606904700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76000fcbf0 0x7f760010f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:06.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.692+0000 7f7606904700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f76000fde00 0x7f760010fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:06.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.692+0000 7f7606904700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76001102a0 con 0x7f76000fcbf0 2023-12-12T11:57:06.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.692+0000 7f7606904700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7600110b40 con 0x7f76000fde00 2023-12-12T11:57:06.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.693+0000 7f75fffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76000fcbf0 0x7f760010f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:06.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.693+0000 7f75fffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76000fcbf0 0x7f760010f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33966/0 (socket says 172.21.15.63:33966) 2023-12-12T11:57:06.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.693+0000 7f75fffff700 1 -- 172.21.15.63:0/539437634 learned_addr learned my addr 172.21.15.63:0/539437634 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:57:06.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.693+0000 7f75ff7fe700 1 --2- 172.21.15.63:0/539437634 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f76000fde00 0x7f760010fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:06.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.693+0000 7f75fffff700 1 -- 172.21.15.63:0/539437634 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f76000fde00 msgr2=0x7f760010fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:06.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.693+0000 7f75fffff700 1 --2- 172.21.15.63:0/539437634 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f76000fde00 0x7f760010fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:06.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.693+0000 7f75fffff700 1 -- 172.21.15.63:0/539437634 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f0005040 con 0x7f76000fcbf0 2023-12-12T11:57:06.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.693+0000 7f75fffff700 1 --2- 172.21.15.63:0/539437634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76000fcbf0 0x7f760010f760 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f75f0000c00 tx=0x7f75f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:57:06.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.694+0000 7f75fcff9700 1 -- 172.21.15.63:0/539437634 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75f000e040 con 0x7f76000fcbf0 2023-12-12T11:57:06.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.694+0000 7f75fcff9700 1 -- 172.21.15.63:0/539437634 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f75f000bc50 con 0x7f76000fcbf0 2023-12-12T11:57:06.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.694+0000 7f75fcff9700 1 -- 172.21.15.63:0/539437634 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75f001c630 con 0x7f76000fcbf0 2023-12-12T11:57:06.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.694+0000 7f7606904700 1 -- 172.21.15.63:0/539437634 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7600110dc0 con 0x7f76000fcbf0 2023-12-12T11:57:06.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.694+0000 7f7606904700 1 -- 172.21.15.63:0/539437634 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7600111300 con 0x7f76000fcbf0 2023-12-12T11:57:06.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.695+0000 7f7606904700 1 -- 172.21.15.63:0/539437634 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7600101ea0 con 0x7f76000fcbf0 2023-12-12T11:57:06.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.696+0000 7f75fcff9700 1 -- 172.21.15.63:0/539437634 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f75f0013420 con 0x7f76000fcbf0 2023-12-12T11:57:06.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.697+0000 7f75fcff9700 1 --2- 172.21.15.63:0/539437634 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f75e806ce70 0x7f75e806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:06.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.697+0000 7f75fcff9700 1 -- 172.21.15.63:0/539437634 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f75f008d5d0 con 0x7f76000fcbf0 2023-12-12T11:57:06.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.697+0000 7f75ff7fe700 1 --2- 172.21.15.63:0/539437634 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f75e806ce70 0x7f75e806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:06.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.698+0000 7f75ff7fe700 1 --2- 172.21.15.63:0/539437634 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f75e806ce70 0x7f75e806f320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f75f4007fd0 tx=0x7f75f4009040 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:57:06.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.701+0000 7f75fcff9700 1 -- 172.21.15.63:0/539437634 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f75f005af60 con 0x7f76000fcbf0 2023-12-12T11:57:06.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:06 smithi063 ceph-mon[187282]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:57:06.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:06 smithi063 ceph-mon[187282]: Health check update: Degraded data redundancy: 35/219 objects degraded (15.982%), 13 pgs degraded (PG_DEGRADED) 2023-12-12T11:57:06.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:06 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/717985718' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:57:06.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.929+0000 7f7606904700 1 -- 172.21.15.63:0/539437634 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7600111630 con 0x7f75e806ce70 2023-12-12T11:57:06.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.930+0000 7f75fcff9700 1 -- 172.21.15.63:0/539437634 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f7600111630 con 0x7f75e806ce70 2023-12-12T11:57:06.933 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:57:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dbb46fd2dbbe029cfba763f2b7c769e980f86b63e74be0c72e188909e20b81f3", 2023-12-12T11:57:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: "in_progress": true, 2023-12-12T11:57:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-12T11:57:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: "services_complete": [ 2023-12-12T11:57:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: "mon", 2023-12-12T11:57:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr", 2023-12-12T11:57:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: "crash" 2023-12-12T11:57:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2023-12-12T11:57:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: "progress": "10/21 daemons upgraded", 2023-12-12T11:57:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "Currently upgrading osd daemons", 2023-12-12T11:57:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: "is_paused": false 2023-12-12T11:57:06.934 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:57:06.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.933+0000 7f7606904700 1 -- 172.21.15.63:0/539437634 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f75e806ce70 msgr2=0x7f75e806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:06.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.933+0000 7f7606904700 1 --2- 172.21.15.63:0/539437634 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f75e806ce70 0x7f75e806f320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f75f4007fd0 tx=0x7f75f4009040 comp rx=0 tx=0).stop 2023-12-12T11:57:06.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.933+0000 7f7606904700 1 -- 172.21.15.63:0/539437634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76000fcbf0 msgr2=0x7f760010f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:06.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.933+0000 7f7606904700 1 --2- 172.21.15.63:0/539437634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76000fcbf0 0x7f760010f760 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f75f0000c00 tx=0x7f75f0009e30 comp rx=0 tx=0).stop 2023-12-12T11:57:06.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.933+0000 7f7606904700 1 -- 172.21.15.63:0/539437634 shutdown_connections 2023-12-12T11:57:06.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.933+0000 7f7606904700 1 --2- 172.21.15.63:0/539437634 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f75e806ce70 0x7f75e806f320 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:06.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.933+0000 7f7606904700 1 --2- 172.21.15.63:0/539437634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76000fcbf0 0x7f760010f760 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:06.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.933+0000 7f7606904700 1 --2- 172.21.15.63:0/539437634 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f76000fde00 0x7f760010fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:06.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.933+0000 7f7606904700 1 -- 172.21.15.63:0/539437634 >> 172.21.15.63:0/539437634 conn(0x7f76000f82d0 msgr2=0x7f76000ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:57:06.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.933+0000 7f7606904700 1 -- 172.21.15.63:0/539437634 shutdown_connections 2023-12-12T11:57:06.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:06.933+0000 7f7606904700 1 -- 172.21.15.63:0/539437634 wait complete. 2023-12-12T11:57:06.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:06 smithi093 ceph-mon[171709]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:57:06.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:06 smithi093 ceph-mon[171709]: Health check update: Degraded data redundancy: 35/219 objects degraded (15.982%), 13 pgs degraded (PG_DEGRADED) 2023-12-12T11:57:06.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:06 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/717985718' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:57:07.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.071+0000 7f079bfff700 1 -- 172.21.15.63:0/3097609746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f079c0fdc00 msgr2=0x7f079c0fe050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:07.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.071+0000 7f079bfff700 1 --2- 172.21.15.63:0/3097609746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f079c0fdc00 0x7f079c0fe050 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0790004940 tx=0x7f0790009e30 comp rx=0 tx=0).stop 2023-12-12T11:57:07.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.071+0000 7f079bfff700 1 -- 172.21.15.63:0/3097609746 shutdown_connections 2023-12-12T11:57:07.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.071+0000 7f079bfff700 1 --2- 172.21.15.63:0/3097609746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f079c0fdc00 0x7f079c0fe050 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:07.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.071+0000 7f079bfff700 1 --2- 172.21.15.63:0/3097609746 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f079c0fc9f0 0x7f079c0fce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:07.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.071+0000 7f079bfff700 1 -- 172.21.15.63:0/3097609746 >> 172.21.15.63:0/3097609746 conn(0x7f079c0f8090 msgr2=0x7f079c0fa4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:57:07.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.071+0000 7f079bfff700 1 -- 172.21.15.63:0/3097609746 shutdown_connections 2023-12-12T11:57:07.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.071+0000 7f079bfff700 1 -- 172.21.15.63:0/3097609746 wait complete. 2023-12-12T11:57:07.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.072+0000 7f079bfff700 1 Processor -- start 2023-12-12T11:57:07.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.072+0000 7f079bfff700 1 -- start start 2023-12-12T11:57:07.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.073+0000 7f079bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f079c0fc9f0 0x7f079c10d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:07.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.073+0000 7f079bfff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f079c0fdc00 0x7f079c10d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:07.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.073+0000 7f079bfff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079c10ddb0 con 0x7f079c0fc9f0 2023-12-12T11:57:07.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.073+0000 7f079bfff700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079c10e650 con 0x7f079c0fdc00 2023-12-12T11:57:07.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.073+0000 7f079affd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f079c0fc9f0 0x7f079c10d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:07.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.073+0000 7f079affd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f079c0fc9f0 0x7f079c10d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33992/0 (socket says 172.21.15.63:33992) 2023-12-12T11:57:07.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.073+0000 7f079affd700 1 -- 172.21.15.63:0/3971011870 learned_addr learned my addr 172.21.15.63:0/3971011870 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:57:07.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.073+0000 7f079a7fc700 1 --2- 172.21.15.63:0/3971011870 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f079c0fdc00 0x7f079c10d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:07.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.073+0000 7f079affd700 1 -- 172.21.15.63:0/3971011870 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f079c0fdc00 msgr2=0x7f079c10d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:07.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.073+0000 7f079affd700 1 --2- 172.21.15.63:0/3971011870 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f079c0fdc00 0x7f079c10d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:07.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.073+0000 7f079affd700 1 -- 172.21.15.63:0/3971011870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0790005040 con 0x7f079c0fc9f0 2023-12-12T11:57:07.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.074+0000 7f079affd700 1 --2- 172.21.15.63:0/3971011870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f079c0fc9f0 0x7f079c10d270 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f078c00eb70 tx=0x7f078c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:57:07.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.074+0000 7f07837fe700 1 -- 172.21.15.63:0/3971011870 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f078c007cc0 con 0x7f079c0fc9f0 2023-12-12T11:57:07.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.074+0000 7f07837fe700 1 -- 172.21.15.63:0/3971011870 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f078c00f040 con 0x7f079c0fc9f0 2023-12-12T11:57:07.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.074+0000 7f079bfff700 1 -- 172.21.15.63:0/3971011870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f079c10e8d0 con 0x7f079c0fc9f0 2023-12-12T11:57:07.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.074+0000 7f07837fe700 1 -- 172.21.15.63:0/3971011870 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f078c00c9d0 con 0x7f079c0fc9f0 2023-12-12T11:57:07.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.074+0000 7f079bfff700 1 -- 172.21.15.63:0/3971011870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f079c10ee10 con 0x7f079c0fc9f0 2023-12-12T11:57:07.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.075+0000 7f079bfff700 1 -- 172.21.15.63:0/3971011870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f079c04bb80 con 0x7f079c0fc9f0 2023-12-12T11:57:07.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.076+0000 7f07837fe700 1 -- 172.21.15.63:0/3971011870 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f078c00cc40 con 0x7f079c0fc9f0 2023-12-12T11:57:07.080 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.077+0000 7f07837fe700 1 --2- 172.21.15.63:0/3971011870 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f078406ce70 0x7f078406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:07.080 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.077+0000 7f07837fe700 1 -- 172.21.15.63:0/3971011870 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f078c08be80 con 0x7f079c0fc9f0 2023-12-12T11:57:07.080 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.077+0000 7f079a7fc700 1 --2- 172.21.15.63:0/3971011870 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f078406ce70 0x7f078406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:07.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.078+0000 7f079a7fc700 1 --2- 172.21.15.63:0/3971011870 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f078406ce70 0x7f078406f320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0790013600 tx=0x7f0790009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:57:07.083 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.081+0000 7f07837fe700 1 -- 172.21.15.63:0/3971011870 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f078c0597a0 con 0x7f079c0fc9f0 2023-12-12T11:57:07.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.373+0000 7f079bfff700 1 -- 172.21.15.63:0/3971011870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f079c113890 con 0x7f079c0fc9f0 2023-12-12T11:57:07.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.374+0000 7f07837fe700 1 -- 172.21.15.63:0/3971011870 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1096 (secure 0 0 0) 0x7f078c059330 con 0x7f079c0fc9f0 2023-12-12T11:57:07.377 INFO:teuthology.orchestra.run.smithi063.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 35/219 objects degraded (15.982%), 13 pgs degraded 2023-12-12T11:57:07.377 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-12T11:57:07.377 INFO:teuthology.orchestra.run.smithi063.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-12T11:57:07.377 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 35/219 objects degraded (15.982%), 13 pgs degraded 2023-12-12T11:57:07.377 INFO:teuthology.orchestra.run.smithi063.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2023-12-12T11:57:07.377 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2023-12-12T11:57:07.377 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2023-12-12T11:57:07.377 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2023-12-12T11:57:07.377 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2023-12-12T11:57:07.377 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.c is active+undersized+degraded, acting [2,0] 2023-12-12T11:57:07.377 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2023-12-12T11:57:07.377 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2023-12-12T11:57:07.377 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2023-12-12T11:57:07.377 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2023-12-12T11:57:07.378 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2023-12-12T11:57:07.378 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2023-12-12T11:57:07.378 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2023-12-12T11:57:07.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.376+0000 7f079bfff700 1 -- 172.21.15.63:0/3971011870 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f078406ce70 msgr2=0x7f078406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:07.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.376+0000 7f079bfff700 1 --2- 172.21.15.63:0/3971011870 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f078406ce70 0x7f078406f320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0790013600 tx=0x7f0790009e30 comp rx=0 tx=0).stop 2023-12-12T11:57:07.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.376+0000 7f079bfff700 1 -- 172.21.15.63:0/3971011870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f079c0fc9f0 msgr2=0x7f079c10d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:07.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.376+0000 7f079bfff700 1 --2- 172.21.15.63:0/3971011870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f079c0fc9f0 0x7f079c10d270 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f078c00eb70 tx=0x7f078c00b040 comp rx=0 tx=0).stop 2023-12-12T11:57:07.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.376+0000 7f079bfff700 1 -- 172.21.15.63:0/3971011870 shutdown_connections 2023-12-12T11:57:07.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.376+0000 7f079bfff700 1 --2- 172.21.15.63:0/3971011870 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f078406ce70 0x7f078406f320 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:07.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.376+0000 7f079bfff700 1 --2- 172.21.15.63:0/3971011870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f079c0fc9f0 0x7f079c10d270 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:07.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.376+0000 7f079bfff700 1 --2- 172.21.15.63:0/3971011870 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f079c0fdc00 0x7f079c10d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:07.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.376+0000 7f079bfff700 1 -- 172.21.15.63:0/3971011870 >> 172.21.15.63:0/3971011870 conn(0x7f079c0f8090 msgr2=0x7f079c100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:57:07.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.377+0000 7f079bfff700 1 -- 172.21.15.63:0/3971011870 shutdown_connections 2023-12-12T11:57:07.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:07.377+0000 7f079bfff700 1 -- 172.21.15.63:0/3971011870 wait complete. 2023-12-12T11:57:07.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:07 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/1224144248' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:57:07.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:07 smithi063 ceph-mon[187282]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:57:07.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:07 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/3971011870' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:57:07.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:07 smithi063 ceph-mon[187282]: pgmap v114: 65 pgs: 8 active+undersized+degraded, 8 active+undersized, 49 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 21/219 objects degraded (9.589%) 2023-12-12T11:57:07.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:07 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/1224144248' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:57:07.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:07 smithi093 ceph-mon[171709]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:57:07.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:07 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/3971011870' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:57:07.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:07 smithi093 ceph-mon[171709]: pgmap v114: 65 pgs: 8 active+undersized+degraded, 8 active+undersized, 49 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 21/219 objects degraded (9.589%) 2023-12-12T11:57:09.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:09 smithi093 ceph-mon[171709]: pgmap v115: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:09.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:09 smithi093 ceph-mon[171709]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 21/219 objects degraded (9.589%), 8 pgs degraded) 2023-12-12T11:57:09.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:09 smithi063 ceph-mon[187282]: pgmap v115: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:09.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:09 smithi063 ceph-mon[187282]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 21/219 objects degraded (9.589%), 8 pgs degraded) 2023-12-12T11:57:11.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:11 smithi093 ceph-mon[171709]: pgmap v116: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:11.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:11 smithi063 ceph-mon[187282]: pgmap v116: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:13.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:13 smithi093 ceph-mon[171709]: pgmap v117: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:13.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:13 smithi063 ceph-mon[187282]: pgmap v117: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:16.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:15 smithi063 ceph-mon[187282]: pgmap v118: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:16.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:15 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:16.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:15 smithi093 ceph-mon[171709]: pgmap v118: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:16.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:15 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:17.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:17 smithi093 ceph-mon[171709]: pgmap v119: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:17.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:17 smithi063 ceph-mon[187282]: pgmap v119: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:18.715 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:18 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-12T11:57:18.716 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:18 smithi093 ceph-mon[171709]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-12T11:57:18.716 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:18 smithi093 ceph-mon[171709]: Upgrade: osd.4 is safe to restart 2023-12-12T11:57:18.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:18 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-12T11:57:18.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:18 smithi063 ceph-mon[187282]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-12T11:57:18.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:18 smithi063 ceph-mon[187282]: Upgrade: osd.4 is safe to restart 2023-12-12T11:57:20.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:20 smithi093 ceph-mon[171709]: Upgrade: Updating osd.4 2023-12-12T11:57:20.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:20 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:20.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:20 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-12T11:57:20.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:20 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:57:20.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:20 smithi093 ceph-mon[171709]: Deploying daemon osd.4 on smithi093 2023-12-12T11:57:20.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:20 smithi093 ceph-mon[171709]: pgmap v120: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:20.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:20 smithi063 ceph-mon[187282]: Upgrade: Updating osd.4 2023-12-12T11:57:20.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:20 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:20.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:20 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-12T11:57:20.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:20 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:57:20.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:20 smithi063 ceph-mon[187282]: Deploying daemon osd.4 on smithi093 2023-12-12T11:57:20.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:20 smithi063 ceph-mon[187282]: pgmap v120: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:21.541 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:21 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:21.542 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:21 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:57:21.542 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:21 smithi093 ceph-mon[171709]: pgmap v121: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:21.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:21 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:21.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:21 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:57:21.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:21 smithi063 ceph-mon[187282]: pgmap v121: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:22.471 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 11:57:22 smithi093 systemd[1]: Stopping Ceph osd.4 for 85e33c70-98e3-11ee-95a3-87774f69a715... 2023-12-12T11:57:22.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:22 smithi093 ceph-mon[171709]: osd.4 marked itself down and dead 2023-12-12T11:57:22.971 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 11:57:22 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-4[130879]: 2023-12-12T11:57:22.497+0000 7ffa571cc700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-12T11:57:22.971 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 11:57:22 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-4[130879]: 2023-12-12T11:57:22.497+0000 7ffa571cc700 -1 osd.4 69 *** Got signal Terminated *** 2023-12-12T11:57:22.971 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 11:57:22 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-4[130879]: 2023-12-12T11:57:22.497+0000 7ffa571cc700 -1 osd.4 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-12T11:57:23.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:22 smithi063 ceph-mon[187282]: osd.4 marked itself down and dead 2023-12-12T11:57:23.560 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 11:57:23 smithi093 bash[189861]: ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-4 2023-12-12T11:57:23.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:23 smithi093 ceph-mon[171709]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-12T11:57:23.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:23 smithi093 ceph-mon[171709]: failed to encode map e70 with expected crc 2023-12-12T11:57:23.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:23 smithi093 ceph-mon[171709]: osdmap e70: 6 total, 5 up, 6 in 2023-12-12T11:57:23.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:23 smithi093 ceph-mon[171709]: pgmap v123: 65 pgs: 6 stale+active+clean, 59 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:24.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:23 smithi063 ceph-mon[187282]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-12T11:57:24.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:23 smithi063 ceph-mon[187282]: failed to encode map e70 with expected crc 2023-12-12T11:57:24.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:23 smithi063 ceph-mon[187282]: osdmap e70: 6 total, 5 up, 6 in 2023-12-12T11:57:24.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:23 smithi063 ceph-mon[187282]: pgmap v123: 65 pgs: 6 stale+active+clean, 59 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:24.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:24 smithi093 ceph-mon[171709]: osdmap e71: 6 total, 5 up, 6 in 2023-12-12T11:57:24.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:24 smithi093 ceph-mon[171709]: failed to encode map e71 with expected crc 2023-12-12T11:57:24.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:24 smithi093 ceph-mon[171709]: failed to encode map e71 with expected crc 2023-12-12T11:57:24.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:24 smithi093 ceph-mon[171709]: failed to encode map e71 with expected crc 2023-12-12T11:57:24.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:24 smithi093 ceph-mon[171709]: failed to encode map e71 with expected crc 2023-12-12T11:57:25.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:24 smithi063 ceph-mon[187282]: osdmap e71: 6 total, 5 up, 6 in 2023-12-12T11:57:25.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:24 smithi063 ceph-mon[187282]: failed to encode map e71 with expected crc 2023-12-12T11:57:25.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:24 smithi063 ceph-mon[187282]: failed to encode map e71 with expected crc 2023-12-12T11:57:25.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:24 smithi063 ceph-mon[187282]: failed to encode map e71 with expected crc 2023-12-12T11:57:25.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:24 smithi063 ceph-mon[187282]: failed to encode map e71 with expected crc 2023-12-12T11:57:25.098 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 11:57:24 smithi093 systemd[1]: ceph-85e33c70-98e3-11ee-95a3-87774f69a715@osd.4.service: Succeeded. 2023-12-12T11:57:25.098 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 11:57:24 smithi093 systemd[1]: Stopped Ceph osd.4 for 85e33c70-98e3-11ee-95a3-87774f69a715. 2023-12-12T11:57:25.471 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 11:57:25 smithi093 systemd[1]: Starting Ceph osd.4 for 85e33c70-98e3-11ee-95a3-87774f69a715... 2023-12-12T11:57:26.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:25 smithi063 ceph-mon[187282]: pgmap v125: 65 pgs: 4 active+undersized+degraded, 5 stale+active+clean, 4 active+undersized, 52 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 6/219 objects degraded (2.740%) 2023-12-12T11:57:26.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:25 smithi093 ceph-mon[171709]: pgmap v125: 65 pgs: 4 active+undersized+degraded, 5 stale+active+clean, 4 active+undersized, 52 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 6/219 objects degraded (2.740%) 2023-12-12T11:57:26.721 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 11:57:26 smithi093 bash[190139]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-12T11:57:26.721 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 11:57:26 smithi093 bash[190139]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-12-12T11:57:26.721 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 11:57:26 smithi093 bash[190139]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-12-12T11:57:26.721 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 11:57:26 smithi093 bash[190139]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-12-12T11:57:26.721 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 11:57:26 smithi093 bash[190139]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2023-12-12T11:57:26.721 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 11:57:26 smithi093 bash[190139]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-12T11:57:26.721 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 11:57:26 smithi093 bash[190139]: --> ceph-volume raw activate successful for osd ID: 4 2023-12-12T11:57:27.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:26 smithi063 ceph-mon[187282]: Health check failed: Degraded data redundancy: 6/219 objects degraded (2.740%), 4 pgs degraded (PG_DEGRADED) 2023-12-12T11:57:27.058 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:26 smithi093 ceph-mon[171709]: Health check failed: Degraded data redundancy: 6/219 objects degraded (2.740%), 4 pgs degraded (PG_DEGRADED) 2023-12-12T11:57:27.471 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 11:57:27 smithi093 ceph-osd[190426]: -- 172.21.15.93:0/454101705 <== mon.1 v2:172.21.15.93:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5600869916c0 con 0x560086960c00 2023-12-12T11:57:27.471 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 11:57:27 smithi093 bash[190387]: accfb5d51d84acf4a0c23eaa4c9caaecafbb7a5a2be57a6ffe8a4391360f3dab 2023-12-12T11:57:27.471 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 11:57:27 smithi093 systemd[1]: Started Ceph osd.4 for 85e33c70-98e3-11ee-95a3-87774f69a715. 2023-12-12T11:57:27.971 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 11:57:27 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-4[190403]: 2023-12-12T11:57:27.676+0000 7fb02b815640 -1 Falling back to public interface 2023-12-12T11:57:28.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:28 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:28.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:28 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:28.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:28 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:57:28.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:28 smithi063 ceph-mon[187282]: pgmap v126: 65 pgs: 9 active+undersized+degraded, 1 stale+active+clean, 14 active+undersized, 41 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 18/219 objects degraded (8.219%) 2023-12-12T11:57:28.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:28 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:28.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:28 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:28.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:28 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:57:28.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:28 smithi093 ceph-mon[171709]: pgmap v126: 65 pgs: 9 active+undersized+degraded, 1 stale+active+clean, 14 active+undersized, 41 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 18/219 objects degraded (8.219%) 2023-12-12T11:57:29.714 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:29 smithi093 ceph-mon[171709]: pgmap v127: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/219 objects degraded (15.525%) 2023-12-12T11:57:29.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:29 smithi063 ceph-mon[187282]: pgmap v127: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/219 objects degraded (15.525%) 2023-12-12T11:57:31.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:31 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:31.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:31 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:31.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:31 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:31.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:31 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:32.658 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:32 smithi093 ceph-mon[171709]: pgmap v128: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/219 objects degraded (15.525%) 2023-12-12T11:57:32.658 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:32 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:32.658 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:32 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:32.777 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:32 smithi063 ceph-mon[187282]: pgmap v128: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/219 objects degraded (15.525%) 2023-12-12T11:57:32.777 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:32 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:32.777 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:32 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:32.961 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 11:57:32 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-4[190403]: 2023-12-12T11:57:32.901+0000 7fb02b815640 -1 osd.4 0 read_superblock omap replica is missing. 2023-12-12T11:57:33.971 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 11:57:33 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-4[190403]: 2023-12-12T11:57:33.551+0000 7fb02b815640 -1 osd.4 69 log_to_monitors true 2023-12-12T11:57:34.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:34 smithi093 ceph-mon[171709]: pgmap v129: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/219 objects degraded (15.525%) 2023-12-12T11:57:34.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:34 smithi093 ceph-mon[171709]: from='osd.4 [v2:172.21.15.93:6808/1202130659,v1:172.21.15.93:6809/1202130659]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-12T11:57:34.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:34 smithi093 ceph-mon[171709]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-12T11:57:34.722 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 11:57:34 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-4[190403]: 2023-12-12T11:57:34.427+0000 7fb018c7e700 -1 osd.4 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T11:57:34.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:34 smithi063 ceph-mon[187282]: pgmap v129: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/219 objects degraded (15.525%) 2023-12-12T11:57:34.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:34 smithi063 ceph-mon[187282]: from='osd.4 [v2:172.21.15.93:6808/1202130659,v1:172.21.15.93:6809/1202130659]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-12T11:57:34.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:34 smithi063 ceph-mon[187282]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-12T11:57:35.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:35 smithi093 ceph-mon[171709]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-12T11:57:35.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:35 smithi093 ceph-mon[171709]: failed to encode map e72 with expected crc 2023-12-12T11:57:35.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:35 smithi093 ceph-mon[171709]: osdmap e72: 6 total, 5 up, 6 in 2023-12-12T11:57:35.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:35 smithi093 ceph-mon[171709]: from='osd.4 [v2:172.21.15.93:6808/1202130659,v1:172.21.15.93:6809/1202130659]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-12T11:57:35.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:35 smithi093 ceph-mon[171709]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-12T11:57:35.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:35 smithi093 ceph-mon[171709]: Health check update: Degraded data redundancy: 34/219 objects degraded (15.525%), 14 pgs degraded (PG_DEGRADED) 2023-12-12T11:57:35.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:35 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:35.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:35 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:35.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:35 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:57:35.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:35 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:57:35.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:35 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:35.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:35 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:57:35.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:35 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:57:35.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:35 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:57:35.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:35 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:57:35.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:35 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-12T11:57:35.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:35 smithi093 ceph-mon[171709]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-12T11:57:35.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:35 smithi093 ceph-mon[171709]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-12T11:57:35.723 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:35 smithi093 ceph-mon[171709]: pgmap v131: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 34/219 objects degraded (15.525%) 2023-12-12T11:57:35.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:35 smithi063 ceph-mon[187282]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-12T11:57:35.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:35 smithi063 ceph-mon[187282]: failed to encode map e72 with expected crc 2023-12-12T11:57:35.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:35 smithi063 ceph-mon[187282]: osdmap e72: 6 total, 5 up, 6 in 2023-12-12T11:57:35.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:35 smithi063 ceph-mon[187282]: from='osd.4 [v2:172.21.15.93:6808/1202130659,v1:172.21.15.93:6809/1202130659]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-12T11:57:35.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:35 smithi063 ceph-mon[187282]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-12T11:57:35.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:35 smithi063 ceph-mon[187282]: Health check update: Degraded data redundancy: 34/219 objects degraded (15.525%), 14 pgs degraded (PG_DEGRADED) 2023-12-12T11:57:35.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:35 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:35.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:35 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:35.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:35 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:57:35.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:35 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:57:35.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:35 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:35.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:35 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:57:35.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:35 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:57:35.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:35 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:57:35.797 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:35 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:57:35.798 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:35 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-12T11:57:35.798 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:35 smithi063 ceph-mon[187282]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-12T11:57:35.798 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:35 smithi063 ceph-mon[187282]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-12T11:57:35.798 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:35 smithi063 ceph-mon[187282]: pgmap v131: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 34/219 objects degraded (15.525%) 2023-12-12T11:57:36.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:36 smithi093 ceph-mon[171709]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-12T11:57:36.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:36 smithi093 ceph-mon[171709]: failed to encode map e73 with expected crc 2023-12-12T11:57:36.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:36 smithi093 ceph-mon[171709]: osd.4 [v2:172.21.15.93:6808/1202130659,v1:172.21.15.93:6809/1202130659] boot 2023-12-12T11:57:36.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:36 smithi093 ceph-mon[171709]: osdmap e73: 6 total, 6 up, 6 in 2023-12-12T11:57:36.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:36 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-12T11:57:36.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:36 smithi093 ceph-mon[171709]: failed to encode map e73 with expected crc 2023-12-12T11:57:36.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:36 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:36.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:36 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:57:36.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:36 smithi093 ceph-mon[171709]: osdmap e74: 6 total, 6 up, 6 in 2023-12-12T11:57:36.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:36 smithi063 ceph-mon[187282]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-12T11:57:36.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:36 smithi063 ceph-mon[187282]: failed to encode map e73 with expected crc 2023-12-12T11:57:36.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:36 smithi063 ceph-mon[187282]: osd.4 [v2:172.21.15.93:6808/1202130659,v1:172.21.15.93:6809/1202130659] boot 2023-12-12T11:57:36.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:36 smithi063 ceph-mon[187282]: osdmap e73: 6 total, 6 up, 6 in 2023-12-12T11:57:36.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:36 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-12T11:57:36.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:36 smithi063 ceph-mon[187282]: failed to encode map e73 with expected crc 2023-12-12T11:57:36.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:36 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:36.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:36 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:57:36.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:36 smithi063 ceph-mon[187282]: osdmap e74: 6 total, 6 up, 6 in 2023-12-12T11:57:37.531 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.528+0000 7feb275b8700 1 -- 172.21.15.63:0/297051709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb200fde00 msgr2=0x7feb200fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:37.531 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.528+0000 7feb275b8700 1 --2- 172.21.15.63:0/297051709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb200fde00 0x7feb200fe250 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7feb10004940 tx=0x7feb10009e30 comp rx=0 tx=0).stop 2023-12-12T11:57:37.531 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.528+0000 7feb275b8700 1 -- 172.21.15.63:0/297051709 shutdown_connections 2023-12-12T11:57:37.531 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.528+0000 7feb275b8700 1 --2- 172.21.15.63:0/297051709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb200fde00 0x7feb200fe250 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:37.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.528+0000 7feb275b8700 1 --2- 172.21.15.63:0/297051709 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feb200fcbf0 0x7feb200fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:37.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.528+0000 7feb275b8700 1 -- 172.21.15.63:0/297051709 >> 172.21.15.63:0/297051709 conn(0x7feb200f82d0 msgr2=0x7feb200fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:57:37.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.528+0000 7feb275b8700 1 -- 172.21.15.63:0/297051709 shutdown_connections 2023-12-12T11:57:37.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.529+0000 7feb275b8700 1 -- 172.21.15.63:0/297051709 wait complete. 2023-12-12T11:57:37.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.530+0000 7feb275b8700 1 Processor -- start 2023-12-12T11:57:37.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.530+0000 7feb275b8700 1 -- start start 2023-12-12T11:57:37.533 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.530+0000 7feb275b8700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feb200fcbf0 0x7feb2010f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:37.533 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.530+0000 7feb275b8700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb200fde00 0x7feb2010fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:37.533 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.530+0000 7feb275b8700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb20110310 con 0x7feb200fde00 2023-12-12T11:57:37.533 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.530+0000 7feb275b8700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb20110b60 con 0x7feb200fcbf0 2023-12-12T11:57:37.533 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.531+0000 7feb24b53700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb200fde00 0x7feb2010fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:37.533 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.531+0000 7feb24b53700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb200fde00 0x7feb2010fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56526/0 (socket says 172.21.15.63:56526) 2023-12-12T11:57:37.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.531+0000 7feb24b53700 1 -- 172.21.15.63:0/997852035 learned_addr learned my addr 172.21.15.63:0/997852035 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:57:37.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.531+0000 7feb25354700 1 --2- 172.21.15.63:0/997852035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feb200fcbf0 0x7feb2010f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:37.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.531+0000 7feb24b53700 1 -- 172.21.15.63:0/997852035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feb200fcbf0 msgr2=0x7feb2010f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:37.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.531+0000 7feb24b53700 1 --2- 172.21.15.63:0/997852035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feb200fcbf0 0x7feb2010f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:37.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.531+0000 7feb24b53700 1 -- 172.21.15.63:0/997852035 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb10005040 con 0x7feb200fde00 2023-12-12T11:57:37.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.531+0000 7feb24b53700 1 --2- 172.21.15.63:0/997852035 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb200fde00 0x7feb2010fd10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7feb1000b3b0 tx=0x7feb10009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:57:37.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.532+0000 7feb15ffb700 1 -- 172.21.15.63:0/997852035 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb1000e040 con 0x7feb200fde00 2023-12-12T11:57:37.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.532+0000 7feb15ffb700 1 -- 172.21.15.63:0/997852035 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7feb1000bc50 con 0x7feb200fde00 2023-12-12T11:57:37.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.532+0000 7feb275b8700 1 -- 172.21.15.63:0/997852035 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb20110de0 con 0x7feb200fde00 2023-12-12T11:57:37.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.532+0000 7feb15ffb700 1 -- 172.21.15.63:0/997852035 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb1001c630 con 0x7feb200fde00 2023-12-12T11:57:37.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.532+0000 7feb275b8700 1 -- 172.21.15.63:0/997852035 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb20111320 con 0x7feb200fde00 2023-12-12T11:57:37.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.533+0000 7feb275b8700 1 -- 172.21.15.63:0/997852035 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb20101ea0 con 0x7feb200fde00 2023-12-12T11:57:37.536 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.534+0000 7feb15ffb700 1 -- 172.21.15.63:0/997852035 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7feb10013420 con 0x7feb200fde00 2023-12-12T11:57:37.537 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.535+0000 7feb15ffb700 1 --2- 172.21.15.63:0/997852035 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7feb0c06ce70 0x7feb0c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:37.537 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.535+0000 7feb15ffb700 1 -- 172.21.15.63:0/997852035 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6500+0+0 (secure 0 0 0) 0x7feb1008d810 con 0x7feb200fde00 2023-12-12T11:57:37.537 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.535+0000 7feb25354700 1 --2- 172.21.15.63:0/997852035 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7feb0c06ce70 0x7feb0c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:37.538 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.536+0000 7feb25354700 1 --2- 172.21.15.63:0/997852035 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7feb0c06ce70 0x7feb0c06f320 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feb200fdc60 tx=0x7feb1c00b040 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:57:37.542 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.539+0000 7feb15ffb700 1 -- 172.21.15.63:0/997852035 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7feb1005b100 con 0x7feb200fde00 2023-12-12T11:57:37.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:37 smithi093 ceph-mon[171709]: failed to encode map e74 with expected crc 2023-12-12T11:57:37.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:37 smithi093 ceph-mon[171709]: failed to encode map e74 with expected crc 2023-12-12T11:57:37.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:37 smithi093 ceph-mon[171709]: pgmap v134: 65 pgs: 4 peering, 11 active+undersized+degraded, 12 active+undersized, 38 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 25/219 objects degraded (11.416%) 2023-12-12T11:57:37.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.769+0000 7feb275b8700 1 -- 172.21.15.63:0/997852035 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feb2002b150 con 0x7feb0c06ce70 2023-12-12T11:57:37.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.770+0000 7feb15ffb700 1 -- 172.21.15.63:0/997852035 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7feb2002b150 con 0x7feb0c06ce70 2023-12-12T11:57:37.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.772+0000 7feb275b8700 1 -- 172.21.15.63:0/997852035 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7feb0c06ce70 msgr2=0x7feb0c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:37.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.772+0000 7feb275b8700 1 --2- 172.21.15.63:0/997852035 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7feb0c06ce70 0x7feb0c06f320 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feb200fdc60 tx=0x7feb1c00b040 comp rx=0 tx=0).stop 2023-12-12T11:57:37.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.772+0000 7feb275b8700 1 -- 172.21.15.63:0/997852035 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb200fde00 msgr2=0x7feb2010fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:37.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.772+0000 7feb275b8700 1 --2- 172.21.15.63:0/997852035 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb200fde00 0x7feb2010fd10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7feb1000b3b0 tx=0x7feb10009e30 comp rx=0 tx=0).stop 2023-12-12T11:57:37.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.772+0000 7feb275b8700 1 -- 172.21.15.63:0/997852035 shutdown_connections 2023-12-12T11:57:37.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.772+0000 7feb275b8700 1 --2- 172.21.15.63:0/997852035 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7feb0c06ce70 0x7feb0c06f320 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:37.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.772+0000 7feb275b8700 1 --2- 172.21.15.63:0/997852035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feb200fcbf0 0x7feb2010f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:37.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.772+0000 7feb275b8700 1 --2- 172.21.15.63:0/997852035 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb200fde00 0x7feb2010fd10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:37.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.773+0000 7feb275b8700 1 -- 172.21.15.63:0/997852035 >> 172.21.15.63:0/997852035 conn(0x7feb200f82d0 msgr2=0x7feb200ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:57:37.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.773+0000 7feb275b8700 1 -- 172.21.15.63:0/997852035 shutdown_connections 2023-12-12T11:57:37.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.773+0000 7feb275b8700 1 -- 172.21.15.63:0/997852035 wait complete. 2023-12-12T11:57:37.790 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-12T11:57:37.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:37 smithi063 ceph-mon[187282]: failed to encode map e74 with expected crc 2023-12-12T11:57:37.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:37 smithi063 ceph-mon[187282]: failed to encode map e74 with expected crc 2023-12-12T11:57:37.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:37 smithi063 ceph-mon[187282]: pgmap v134: 65 pgs: 4 peering, 11 active+undersized+degraded, 12 active+undersized, 38 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 25/219 objects degraded (11.416%) 2023-12-12T11:57:37.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.913+0000 7ff936927700 1 -- 172.21.15.63:0/1725135709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9300fcbf0 msgr2=0x7ff9300fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:37.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.913+0000 7ff936927700 1 --2- 172.21.15.63:0/1725135709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9300fcbf0 0x7ff9300fd000 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff920004940 tx=0x7ff920009e30 comp rx=0 tx=0).stop 2023-12-12T11:57:37.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.913+0000 7ff936927700 1 -- 172.21.15.63:0/1725135709 shutdown_connections 2023-12-12T11:57:37.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.913+0000 7ff936927700 1 --2- 172.21.15.63:0/1725135709 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9300fde00 0x7ff9300fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:37.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.913+0000 7ff936927700 1 --2- 172.21.15.63:0/1725135709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9300fcbf0 0x7ff9300fd000 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:37.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.913+0000 7ff936927700 1 -- 172.21.15.63:0/1725135709 >> 172.21.15.63:0/1725135709 conn(0x7ff9300f82d0 msgr2=0x7ff9300fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:57:37.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.913+0000 7ff936927700 1 -- 172.21.15.63:0/1725135709 shutdown_connections 2023-12-12T11:57:37.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.913+0000 7ff936927700 1 -- 172.21.15.63:0/1725135709 wait complete. 2023-12-12T11:57:37.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.914+0000 7ff936927700 1 Processor -- start 2023-12-12T11:57:37.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.914+0000 7ff936927700 1 -- start start 2023-12-12T11:57:37.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.915+0000 7ff936927700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9300fcbf0 0x7ff93010f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:37.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.915+0000 7ff936927700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9300fde00 0x7ff93010fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:37.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.915+0000 7ff936927700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9301102a0 con 0x7ff9300fde00 2023-12-12T11:57:37.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.915+0000 7ff936927700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff930110b40 con 0x7ff9300fcbf0 2023-12-12T11:57:37.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.915+0000 7ff92f7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9300fde00 0x7ff93010fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:37.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.915+0000 7ff92f7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9300fde00 0x7ff93010fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60210/0 (socket says 172.21.15.63:60210) 2023-12-12T11:57:37.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.915+0000 7ff92f7fe700 1 -- 172.21.15.63:0/1392450849 learned_addr learned my addr 172.21.15.63:0/1392450849 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:57:37.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.915+0000 7ff92ffff700 1 --2- 172.21.15.63:0/1392450849 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9300fcbf0 0x7ff93010f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:37.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.915+0000 7ff92f7fe700 1 -- 172.21.15.63:0/1392450849 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9300fcbf0 msgr2=0x7ff93010f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:37.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.915+0000 7ff92f7fe700 1 --2- 172.21.15.63:0/1392450849 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9300fcbf0 0x7ff93010f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:37.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.915+0000 7ff92f7fe700 1 -- 172.21.15.63:0/1392450849 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff920005040 con 0x7ff9300fde00 2023-12-12T11:57:37.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.916+0000 7ff92f7fe700 1 --2- 172.21.15.63:0/1392450849 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9300fde00 0x7ff93010fca0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff924002a50 tx=0x7ff9240046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:57:37.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.916+0000 7ff92cff9700 1 -- 172.21.15.63:0/1392450849 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff924007cc0 con 0x7ff9300fde00 2023-12-12T11:57:37.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.916+0000 7ff92cff9700 1 -- 172.21.15.63:0/1392450849 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff92400f040 con 0x7ff9300fde00 2023-12-12T11:57:37.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.916+0000 7ff92cff9700 1 -- 172.21.15.63:0/1392450849 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff924009540 con 0x7ff9300fde00 2023-12-12T11:57:37.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.916+0000 7ff936927700 1 -- 172.21.15.63:0/1392450849 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff930110e20 con 0x7ff9300fde00 2023-12-12T11:57:37.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.916+0000 7ff936927700 1 -- 172.21.15.63:0/1392450849 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff930111360 con 0x7ff9300fde00 2023-12-12T11:57:37.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.917+0000 7ff936927700 1 -- 172.21.15.63:0/1392450849 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff930101ea0 con 0x7ff9300fde00 2023-12-12T11:57:37.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.918+0000 7ff92cff9700 1 -- 172.21.15.63:0/1392450849 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7ff9240096a0 con 0x7ff9300fde00 2023-12-12T11:57:37.922 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.920+0000 7ff92cff9700 1 --2- 172.21.15.63:0/1392450849 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7ff91806ce70 0x7ff91806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:37.922 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.920+0000 7ff92cff9700 1 -- 172.21.15.63:0/1392450849 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6500+0+0 (secure 0 0 0) 0x7ff92408be40 con 0x7ff9300fde00 2023-12-12T11:57:37.922 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.920+0000 7ff92ffff700 1 --2- 172.21.15.63:0/1392450849 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7ff91806ce70 0x7ff91806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:37.923 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.921+0000 7ff92ffff700 1 --2- 172.21.15.63:0/1392450849 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7ff91806ce70 0x7ff91806f320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff92000b020 tx=0x7ff920009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:57:37.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:37.924+0000 7ff92cff9700 1 -- 172.21.15.63:0/1392450849 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff9240597d0 con 0x7ff9300fde00 2023-12-12T11:57:38.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.151+0000 7ff936927700 1 -- 172.21.15.63:0/1392450849 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff930111640 con 0x7ff91806ce70 2023-12-12T11:57:38.154 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.152+0000 7ff92cff9700 1 -- 172.21.15.63:0/1392450849 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7ff930111640 con 0x7ff91806ce70 2023-12-12T11:57:38.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.154+0000 7ff936927700 1 -- 172.21.15.63:0/1392450849 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7ff91806ce70 msgr2=0x7ff91806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:38.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.154+0000 7ff936927700 1 --2- 172.21.15.63:0/1392450849 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7ff91806ce70 0x7ff91806f320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff92000b020 tx=0x7ff920009e30 comp rx=0 tx=0).stop 2023-12-12T11:57:38.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.154+0000 7ff936927700 1 -- 172.21.15.63:0/1392450849 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9300fde00 msgr2=0x7ff93010fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:38.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.154+0000 7ff936927700 1 --2- 172.21.15.63:0/1392450849 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9300fde00 0x7ff93010fca0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff924002a50 tx=0x7ff9240046b0 comp rx=0 tx=0).stop 2023-12-12T11:57:38.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.154+0000 7ff936927700 1 -- 172.21.15.63:0/1392450849 shutdown_connections 2023-12-12T11:57:38.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.154+0000 7ff936927700 1 --2- 172.21.15.63:0/1392450849 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7ff91806ce70 0x7ff91806f320 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:38.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.154+0000 7ff936927700 1 --2- 172.21.15.63:0/1392450849 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9300fcbf0 0x7ff93010f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:38.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.154+0000 7ff936927700 1 --2- 172.21.15.63:0/1392450849 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9300fde00 0x7ff93010fca0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:38.158 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.154+0000 7ff936927700 1 -- 172.21.15.63:0/1392450849 >> 172.21.15.63:0/1392450849 conn(0x7ff9300f82d0 msgr2=0x7ff9300ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:57:38.158 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.155+0000 7ff936927700 1 -- 172.21.15.63:0/1392450849 shutdown_connections 2023-12-12T11:57:38.158 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.155+0000 7ff936927700 1 -- 172.21.15.63:0/1392450849 wait complete. 2023-12-12T11:57:38.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.293+0000 7f04c16fc700 1 -- 172.21.15.63:0/1182774683 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04bc0fcbf0 msgr2=0x7f04bc0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:38.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.293+0000 7f04c16fc700 1 --2- 172.21.15.63:0/1182774683 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04bc0fcbf0 0x7f04bc0fd000 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f04ac004940 tx=0x7f04ac009e30 comp rx=0 tx=0).stop 2023-12-12T11:57:38.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.293+0000 7f04c16fc700 1 -- 172.21.15.63:0/1182774683 shutdown_connections 2023-12-12T11:57:38.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.293+0000 7f04c16fc700 1 --2- 172.21.15.63:0/1182774683 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04bc0fde00 0x7f04bc0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:38.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.293+0000 7f04c16fc700 1 --2- 172.21.15.63:0/1182774683 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04bc0fcbf0 0x7f04bc0fd000 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:38.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.293+0000 7f04c16fc700 1 -- 172.21.15.63:0/1182774683 >> 172.21.15.63:0/1182774683 conn(0x7f04bc0f82d0 msgr2=0x7f04bc0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:57:38.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.293+0000 7f04c16fc700 1 -- 172.21.15.63:0/1182774683 shutdown_connections 2023-12-12T11:57:38.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.293+0000 7f04c16fc700 1 -- 172.21.15.63:0/1182774683 wait complete. 2023-12-12T11:57:38.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.294+0000 7f04c16fc700 1 Processor -- start 2023-12-12T11:57:38.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.294+0000 7f04c16fc700 1 -- start start 2023-12-12T11:57:38.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.294+0000 7f04c16fc700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04bc0fcbf0 0x7f04bc10d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:38.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.294+0000 7f04c16fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04bc0fde00 0x7f04bc10da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:38.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.294+0000 7f04c16fc700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc10e010 con 0x7f04bc0fde00 2023-12-12T11:57:38.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.294+0000 7f04c16fc700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc10e8b0 con 0x7f04bc0fcbf0 2023-12-12T11:57:38.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.295+0000 7f04ba7fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04bc0fde00 0x7f04bc10da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:38.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.295+0000 7f04ba7fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04bc0fde00 0x7f04bc10da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60236/0 (socket says 172.21.15.63:60236) 2023-12-12T11:57:38.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.295+0000 7f04ba7fc700 1 -- 172.21.15.63:0/2454801529 learned_addr learned my addr 172.21.15.63:0/2454801529 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:57:38.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.295+0000 7f04baffd700 1 --2- 172.21.15.63:0/2454801529 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04bc0fcbf0 0x7f04bc10d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:38.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.295+0000 7f04ba7fc700 1 -- 172.21.15.63:0/2454801529 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04bc0fcbf0 msgr2=0x7f04bc10d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:38.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.295+0000 7f04ba7fc700 1 --2- 172.21.15.63:0/2454801529 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04bc0fcbf0 0x7f04bc10d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:38.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.295+0000 7f04ba7fc700 1 -- 172.21.15.63:0/2454801529 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ac005040 con 0x7f04bc0fde00 2023-12-12T11:57:38.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.295+0000 7f04ba7fc700 1 --2- 172.21.15.63:0/2454801529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04bc0fde00 0x7f04bc10da10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f04b000eb40 tx=0x7f04b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:57:38.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.296+0000 7f04a37fe700 1 -- 172.21.15.63:0/2454801529 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04b0007cc0 con 0x7f04bc0fde00 2023-12-12T11:57:38.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.296+0000 7f04a37fe700 1 -- 172.21.15.63:0/2454801529 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f04b000f040 con 0x7f04bc0fde00 2023-12-12T11:57:38.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.296+0000 7f04a37fe700 1 -- 172.21.15.63:0/2454801529 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04b0009570 con 0x7f04bc0fde00 2023-12-12T11:57:38.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.296+0000 7f04c16fc700 1 -- 172.21.15.63:0/2454801529 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04bc10eb30 con 0x7f04bc0fde00 2023-12-12T11:57:38.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.296+0000 7f04c16fc700 1 -- 172.21.15.63:0/2454801529 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04bc10f070 con 0x7f04bc0fde00 2023-12-12T11:57:38.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.297+0000 7f04c16fc700 1 -- 172.21.15.63:0/2454801529 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04bc04bb80 con 0x7f04bc0fde00 2023-12-12T11:57:38.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.298+0000 7f04a37fe700 1 -- 172.21.15.63:0/2454801529 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f04b00096d0 con 0x7f04bc0fde00 2023-12-12T11:57:38.301 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.299+0000 7f04a37fe700 1 --2- 172.21.15.63:0/2454801529 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f04a406ce70 0x7f04a406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:38.301 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.299+0000 7f04a37fe700 1 -- 172.21.15.63:0/2454801529 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f04b008bee0 con 0x7f04bc0fde00 2023-12-12T11:57:38.301 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.299+0000 7f04baffd700 1 --2- 172.21.15.63:0/2454801529 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f04a406ce70 0x7f04a406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:38.302 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.300+0000 7f04baffd700 1 --2- 172.21.15.63:0/2454801529 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f04a406ce70 0x7f04a406f320 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f04ac00b0d0 tx=0x7f04ac009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:57:38.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.303+0000 7f04a37fe700 1 -- 172.21.15.63:0/2454801529 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f04b0059920 con 0x7f04bc0fde00 2023-12-12T11:57:38.527 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.524+0000 7f04c16fc700 1 -- 172.21.15.63:0/2454801529 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f04bc10f510 con 0x7f04a406ce70 2023-12-12T11:57:38.542 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.535+0000 7f04a37fe700 1 -- 172.21.15.63:0/2454801529 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f04bc10f510 con 0x7f04a406ce70 2023-12-12T11:57:38.701 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-12T11:57:38.702 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (5m) 72s ago 13m 14.9M - 0.25.0 c8568f914cd2 f237d9f64783 2023-12-12T11:57:38.702 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (2m) 72s ago 13m 7838k - 19.0.0-96-gf1fbf3c5 8cf689f388db 202fa7506e7c 2023-12-12T11:57:38.702 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi093 smithi093 running (2m) 8s ago 12m 7852k - 19.0.0-96-gf1fbf3c5 8cf689f388db ac9d76320ce6 2023-12-12T11:57:38.702 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (5m) 72s ago 12m 78.5M - 9.4.7 954c08fa6188 51300a1a5b87 2023-12-12T11:57:38.702 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.aevpzg smithi063 running (8m) 72s ago 8m 10.5G - 17.2.7-123-gbef78a51 ae6196193935 df9a6781f836 2023-12-12T11:57:38.702 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.bdqbnp smithi063 running (8m) 72s ago 8m 15.6M - 17.2.7-123-gbef78a51 ae6196193935 0c7e1d21eee9 2023-12-12T11:57:38.702 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.rhaqsh smithi093 running (8m) 8s ago 8m 15.7M - 17.2.7-123-gbef78a51 ae6196193935 257aee771d87 2023-12-12T11:57:38.702 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.swdqms smithi093 running (8m) 8s ago 8m 15.7M - 17.2.7-123-gbef78a51 ae6196193935 f46d7173d3b1 2023-12-12T11:57:38.702 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.zjnfdi smithi063 *:8443,9283,8765 running (5m) 72s ago 14m 515M - 19.0.0-96-gf1fbf3c5 8cf689f388db dab6fa4aaa54 2023-12-12T11:57:38.702 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi093.nbtltu smithi093 *:8443,9283,8765 running (4m) 8s ago 12m 452M - 19.0.0-96-gf1fbf3c5 8cf689f388db 701529e7fa8e 2023-12-12T11:57:38.702 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (3m) 72s ago 14m 61.7M 2048M 19.0.0-96-gf1fbf3c5 8cf689f388db 11f12a2e88e4 2023-12-12T11:57:38.702 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi093 smithi093 running (3m) 8s ago 12m 52.5M 2048M 19.0.0-96-gf1fbf3c5 8cf689f388db 1ffc49fcd680 2023-12-12T11:57:38.702 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (5m) 72s ago 13m 8510k - 1.5.0 0da6a335fe13 8eed63374ddf 2023-12-12T11:57:38.702 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi093 smithi093 *:9100 running (5m) 8s ago 12m 8158k - 1.5.0 0da6a335fe13 10e19431c1a2 2023-12-12T11:57:38.703 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (2m) 72s ago 11m 131M 1618M 19.0.0-96-gf1fbf3c5 8cf689f388db fade55811ec1 2023-12-12T11:57:38.703 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (110s) 72s ago 11m 138M 1618M 19.0.0-96-gf1fbf3c5 8cf689f388db 733e6ff9e83d 2023-12-12T11:57:38.703 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (77s) 72s ago 10m 12.5M 1618M 19.0.0-96-gf1fbf3c5 8cf689f388db bc155cfbaf86 2023-12-12T11:57:38.703 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi093 running (43s) 8s ago 10m 139M 2642M 19.0.0-96-gf1fbf3c5 8cf689f388db 36b87923d47a 2023-12-12T11:57:38.703 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi093 running (11s) 8s ago 10m 12.5M 2642M 19.0.0-96-gf1fbf3c5 8cf689f388db accfb5d51d84 2023-12-12T11:57:38.703 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi093 running (9m) 8s ago 9m 983M 2642M 17.2.7-123-gbef78a51 ae6196193935 16fe8e4668f1 2023-12-12T11:57:38.703 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (4m) 72s ago 12m 48.2M - 2.43.0 a07b618ecd1d 834d9fc4eb61 2023-12-12T11:57:38.706 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.537+0000 7f04c16fc700 1 -- 172.21.15.63:0/2454801529 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f04a406ce70 msgr2=0x7f04a406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:38.706 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.537+0000 7f04c16fc700 1 --2- 172.21.15.63:0/2454801529 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f04a406ce70 0x7f04a406f320 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f04ac00b0d0 tx=0x7f04ac009e30 comp rx=0 tx=0).stop 2023-12-12T11:57:38.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.537+0000 7f04c16fc700 1 -- 172.21.15.63:0/2454801529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04bc0fde00 msgr2=0x7f04bc10da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:38.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.537+0000 7f04c16fc700 1 --2- 172.21.15.63:0/2454801529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04bc0fde00 0x7f04bc10da10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f04b000eb40 tx=0x7f04b000b040 comp rx=0 tx=0).stop 2023-12-12T11:57:38.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.537+0000 7f04c16fc700 1 -- 172.21.15.63:0/2454801529 shutdown_connections 2023-12-12T11:57:38.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.537+0000 7f04c16fc700 1 --2- 172.21.15.63:0/2454801529 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f04a406ce70 0x7f04a406f320 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:38.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.537+0000 7f04c16fc700 1 --2- 172.21.15.63:0/2454801529 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04bc0fcbf0 0x7f04bc10d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:38.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.537+0000 7f04c16fc700 1 --2- 172.21.15.63:0/2454801529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04bc0fde00 0x7f04bc10da10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:38.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.537+0000 7f04c16fc700 1 -- 172.21.15.63:0/2454801529 >> 172.21.15.63:0/2454801529 conn(0x7f04bc0f82d0 msgr2=0x7f04bc101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:57:38.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.537+0000 7f04c16fc700 1 -- 172.21.15.63:0/2454801529 shutdown_connections 2023-12-12T11:57:38.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.537+0000 7f04c16fc700 1 -- 172.21.15.63:0/2454801529 wait complete. 2023-12-12T11:57:38.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.675+0000 7f3ab7dd0700 1 -- 172.21.15.63:0/1759673327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ab00fde00 msgr2=0x7f3ab00fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:38.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.675+0000 7f3ab7dd0700 1 --2- 172.21.15.63:0/1759673327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ab00fde00 0x7f3ab00fe250 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0004940 tx=0x7f3aa0009e30 comp rx=0 tx=0).stop 2023-12-12T11:57:38.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.675+0000 7f3ab7dd0700 1 -- 172.21.15.63:0/1759673327 shutdown_connections 2023-12-12T11:57:38.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.675+0000 7f3ab7dd0700 1 --2- 172.21.15.63:0/1759673327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ab00fde00 0x7f3ab00fe250 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:38.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.675+0000 7f3ab7dd0700 1 --2- 172.21.15.63:0/1759673327 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3ab00fcbf0 0x7f3ab00fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:38.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.675+0000 7f3ab7dd0700 1 -- 172.21.15.63:0/1759673327 >> 172.21.15.63:0/1759673327 conn(0x7f3ab00f82d0 msgr2=0x7f3ab00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:57:38.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.675+0000 7f3ab7dd0700 1 -- 172.21.15.63:0/1759673327 shutdown_connections 2023-12-12T11:57:38.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.675+0000 7f3ab7dd0700 1 -- 172.21.15.63:0/1759673327 wait complete. 2023-12-12T11:57:38.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.676+0000 7f3ab7dd0700 1 Processor -- start 2023-12-12T11:57:38.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.676+0000 7f3ab7dd0700 1 -- start start 2023-12-12T11:57:38.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.676+0000 7f3ab7dd0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ab00fcbf0 0x7f3ab010f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:38.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.676+0000 7f3ab7dd0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3ab00fde00 0x7f3ab010fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:38.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.676+0000 7f3ab7dd0700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab0110230 con 0x7f3ab00fcbf0 2023-12-12T11:57:38.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.676+0000 7f3ab7dd0700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab0110ad0 con 0x7f3ab00fde00 2023-12-12T11:57:38.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.676+0000 7f3ab5b6c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ab00fcbf0 0x7f3ab010f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:38.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.676+0000 7f3ab5b6c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ab00fcbf0 0x7f3ab010f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60244/0 (socket says 172.21.15.63:60244) 2023-12-12T11:57:38.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.676+0000 7f3ab5b6c700 1 -- 172.21.15.63:0/3494743067 learned_addr learned my addr 172.21.15.63:0/3494743067 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:57:38.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.677+0000 7f3ab536b700 1 --2- 172.21.15.63:0/3494743067 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3ab00fde00 0x7f3ab010fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:38.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.677+0000 7f3ab5b6c700 1 -- 172.21.15.63:0/3494743067 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3ab00fde00 msgr2=0x7f3ab010fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:38.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.677+0000 7f3ab5b6c700 1 --2- 172.21.15.63:0/3494743067 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3ab00fde00 0x7f3ab010fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:38.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.677+0000 7f3ab5b6c700 1 -- 172.21.15.63:0/3494743067 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa0005040 con 0x7f3ab00fcbf0 2023-12-12T11:57:38.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.677+0000 7f3ab5b6c700 1 --2- 172.21.15.63:0/3494743067 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ab00fcbf0 0x7f3ab010f6f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3aac002a80 tx=0x7f3aac0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:57:38.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.677+0000 7f3aa67fc700 1 -- 172.21.15.63:0/3494743067 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3aac007cc0 con 0x7f3ab00fcbf0 2023-12-12T11:57:38.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.677+0000 7f3ab7dd0700 1 -- 172.21.15.63:0/3494743067 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab0110db0 con 0x7f3ab00fcbf0 2023-12-12T11:57:38.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.677+0000 7f3aa67fc700 1 -- 172.21.15.63:0/3494743067 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3aac00f040 con 0x7f3ab00fcbf0 2023-12-12T11:57:38.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.677+0000 7f3aa67fc700 1 -- 172.21.15.63:0/3494743067 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3aac00d9e0 con 0x7f3ab00fcbf0 2023-12-12T11:57:38.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.677+0000 7f3ab7dd0700 1 -- 172.21.15.63:0/3494743067 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab01112f0 con 0x7f3ab00fcbf0 2023-12-12T11:57:38.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.678+0000 7f3ab7dd0700 1 -- 172.21.15.63:0/3494743067 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab0101ea0 con 0x7f3ab00fcbf0 2023-12-12T11:57:38.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.679+0000 7f3aa67fc700 1 -- 172.21.15.63:0/3494743067 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f3aac00dc50 con 0x7f3ab00fcbf0 2023-12-12T11:57:38.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.680+0000 7f3aa67fc700 1 --2- 172.21.15.63:0/3494743067 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f3a9c06ce70 0x7f3a9c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:38.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.680+0000 7f3aa67fc700 1 -- 172.21.15.63:0/3494743067 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f3aac08bb40 con 0x7f3ab00fcbf0 2023-12-12T11:57:38.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.681+0000 7f3ab536b700 1 --2- 172.21.15.63:0/3494743067 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f3a9c06ce70 0x7f3a9c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:38.710 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.681+0000 7f3ab536b700 1 --2- 172.21.15.63:0/3494743067 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f3a9c06ce70 0x7f3a9c06f320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3aa00043d0 tx=0x7f3aa0009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:57:38.710 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.685+0000 7f3aa67fc700 1 -- 172.21.15.63:0/3494743067 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3aac059450 con 0x7f3ab00fcbf0 2023-12-12T11:57:38.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:38 smithi093 ceph-mon[171709]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:57:38.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:38 smithi093 ceph-mon[171709]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:57:38.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:38 smithi063 ceph-mon[187282]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:57:38.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:38 smithi063 ceph-mon[187282]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:57:38.982 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.980+0000 7f3ab7dd0700 1 -- 172.21.15.63:0/3494743067 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3ab0111510 con 0x7f3ab00fcbf0 2023-12-12T11:57:38.983 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.980+0000 7f3aa67fc700 1 -- 172.21.15.63:0/3494743067 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7f3aac058fe0 con 0x7f3ab00fcbf0 2023-12-12T11:57:38.983 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:57:38.983 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-12T11:57:38.983 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 2 2023-12-12T11:57:38.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:57:38.983 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-12T11:57:38.983 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 2 2023-12-12T11:57:38.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:57:38.984 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-12T11:57:38.984 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 1, 2023-12-12T11:57:38.984 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 5 2023-12-12T11:57:38.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:57:38.984 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-12T11:57:38.984 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 4 2023-12-12T11:57:38.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:57:38.984 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-12T11:57:38.984 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 5, 2023-12-12T11:57:38.984 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 9 2023-12-12T11:57:38.984 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-12T11:57:38.984 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:57:38.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.982+0000 7f3ab7dd0700 1 -- 172.21.15.63:0/3494743067 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f3a9c06ce70 msgr2=0x7f3a9c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:38.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.983+0000 7f3ab7dd0700 1 --2- 172.21.15.63:0/3494743067 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f3a9c06ce70 0x7f3a9c06f320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3aa00043d0 tx=0x7f3aa0009e30 comp rx=0 tx=0).stop 2023-12-12T11:57:38.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.983+0000 7f3ab7dd0700 1 -- 172.21.15.63:0/3494743067 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ab00fcbf0 msgr2=0x7f3ab010f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:38.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.983+0000 7f3ab7dd0700 1 --2- 172.21.15.63:0/3494743067 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ab00fcbf0 0x7f3ab010f6f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3aac002a80 tx=0x7f3aac0046b0 comp rx=0 tx=0).stop 2023-12-12T11:57:38.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.983+0000 7f3ab7dd0700 1 -- 172.21.15.63:0/3494743067 shutdown_connections 2023-12-12T11:57:38.986 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.983+0000 7f3ab7dd0700 1 --2- 172.21.15.63:0/3494743067 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f3a9c06ce70 0x7f3a9c06f320 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:38.986 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.983+0000 7f3ab7dd0700 1 --2- 172.21.15.63:0/3494743067 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ab00fcbf0 0x7f3ab010f6f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:38.986 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.983+0000 7f3ab7dd0700 1 --2- 172.21.15.63:0/3494743067 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3ab00fde00 0x7f3ab010fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:38.986 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.983+0000 7f3ab7dd0700 1 -- 172.21.15.63:0/3494743067 >> 172.21.15.63:0/3494743067 conn(0x7f3ab00f82d0 msgr2=0x7f3ab00ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:57:38.986 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.983+0000 7f3ab7dd0700 1 -- 172.21.15.63:0/3494743067 shutdown_connections 2023-12-12T11:57:38.986 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:38.983+0000 7f3ab7dd0700 1 -- 172.21.15.63:0/3494743067 wait complete. 2023-12-12T11:57:39.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.121+0000 7ff573263700 1 -- 172.21.15.63:0/3272630392 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff56c0fde00 msgr2=0x7ff56c0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:39.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.121+0000 7ff573263700 1 --2- 172.21.15.63:0/3272630392 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff56c0fde00 0x7ff56c0fe250 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff558004940 tx=0x7ff558009e30 comp rx=0 tx=0).stop 2023-12-12T11:57:39.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.121+0000 7ff573263700 1 -- 172.21.15.63:0/3272630392 shutdown_connections 2023-12-12T11:57:39.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.121+0000 7ff573263700 1 --2- 172.21.15.63:0/3272630392 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff56c0fde00 0x7ff56c0fe250 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:39.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.121+0000 7ff573263700 1 --2- 172.21.15.63:0/3272630392 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff56c0fcbf0 0x7ff56c0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:39.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.121+0000 7ff573263700 1 -- 172.21.15.63:0/3272630392 >> 172.21.15.63:0/3272630392 conn(0x7ff56c0f82d0 msgr2=0x7ff56c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:57:39.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.121+0000 7ff573263700 1 -- 172.21.15.63:0/3272630392 shutdown_connections 2023-12-12T11:57:39.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.121+0000 7ff573263700 1 -- 172.21.15.63:0/3272630392 wait complete. 2023-12-12T11:57:39.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.122+0000 7ff573263700 1 Processor -- start 2023-12-12T11:57:39.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.122+0000 7ff573263700 1 -- start start 2023-12-12T11:57:39.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.123+0000 7ff573263700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff56c0fcbf0 0x7ff56c10f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:39.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.123+0000 7ff573263700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff56c0fde00 0x7ff56c10fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:39.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.123+0000 7ff573263700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c110220 con 0x7ff56c0fde00 2023-12-12T11:57:39.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.123+0000 7ff573263700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c110ac0 con 0x7ff56c0fcbf0 2023-12-12T11:57:39.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.123+0000 7ff56bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff56c0fde00 0x7ff56c10fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:39.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.123+0000 7ff56bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff56c0fde00 0x7ff56c10fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60270/0 (socket says 172.21.15.63:60270) 2023-12-12T11:57:39.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.123+0000 7ff56bfff700 1 -- 172.21.15.63:0/3185106170 learned_addr learned my addr 172.21.15.63:0/3185106170 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:57:39.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.123+0000 7ff570fff700 1 --2- 172.21.15.63:0/3185106170 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff56c0fcbf0 0x7ff56c10f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:39.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.123+0000 7ff56bfff700 1 -- 172.21.15.63:0/3185106170 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff56c0fcbf0 msgr2=0x7ff56c10f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:39.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.123+0000 7ff56bfff700 1 --2- 172.21.15.63:0/3185106170 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff56c0fcbf0 0x7ff56c10f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:39.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.123+0000 7ff56bfff700 1 -- 172.21.15.63:0/3185106170 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff560005040 con 0x7ff56c0fde00 2023-12-12T11:57:39.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.124+0000 7ff56bfff700 1 --2- 172.21.15.63:0/3185106170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff56c0fde00 0x7ff56c10fc20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff558009fd0 tx=0x7ff558009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:57:39.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.124+0000 7ff5697fa700 1 -- 172.21.15.63:0/3185106170 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff558021070 con 0x7ff56c0fde00 2023-12-12T11:57:39.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.124+0000 7ff5697fa700 1 -- 172.21.15.63:0/3185106170 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff55801c400 con 0x7ff56c0fde00 2023-12-12T11:57:39.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.124+0000 7ff573263700 1 -- 172.21.15.63:0/3185106170 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff558005040 con 0x7ff56c0fde00 2023-12-12T11:57:39.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.124+0000 7ff5697fa700 1 -- 172.21.15.63:0/3185106170 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff55800e070 con 0x7ff56c0fde00 2023-12-12T11:57:39.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.124+0000 7ff573263700 1 -- 172.21.15.63:0/3185106170 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff56c1110f0 con 0x7ff56c0fde00 2023-12-12T11:57:39.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.125+0000 7ff573263700 1 -- 172.21.15.63:0/3185106170 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff56c101ea0 con 0x7ff56c0fde00 2023-12-12T11:57:39.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.126+0000 7ff5697fa700 1 -- 172.21.15.63:0/3185106170 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7ff55801c570 con 0x7ff56c0fde00 2023-12-12T11:57:39.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.127+0000 7ff5697fa700 1 --2- 172.21.15.63:0/3185106170 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7ff55c06ce70 0x7ff55c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:39.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.128+0000 7ff5697fa700 1 -- 172.21.15.63:0/3185106170 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6500+0+0 (secure 0 0 0) 0x7ff55808d560 con 0x7ff56c0fde00 2023-12-12T11:57:39.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.128+0000 7ff570fff700 1 --2- 172.21.15.63:0/3185106170 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7ff55c06ce70 0x7ff55c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:39.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.128+0000 7ff570fff700 1 --2- 172.21.15.63:0/3185106170 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7ff55c06ce70 0x7ff55c06f320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0fdc60 tx=0x7ff56000b040 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:57:39.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.132+0000 7ff5697fa700 1 -- 172.21.15.63:0/3185106170 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff55805aed0 con 0x7ff56c0fde00 2023-12-12T11:57:39.388 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.386+0000 7ff573263700 1 -- 172.21.15.63:0/3185106170 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff56c04bb80 con 0x7ff56c0fde00 2023-12-12T11:57:39.388 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.386+0000 7ff5697fa700 1 -- 172.21.15.63:0/3185106170 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1845 (secure 0 0 0) 0x7ff55805aa60 con 0x7ff56c0fde00 2023-12-12T11:57:39.389 INFO:teuthology.orchestra.run.smithi063.stdout:e13 2023-12-12T11:57:39.389 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-12T11:57:39.389 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:57:39.389 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-12T11:57:39.389 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:57:39.389 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-12T11:57:39.389 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-12T11:57:39.389 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 13 2023-12-12T11:57:39.389 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-12T11:57:39.389 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-12T11:48:58.523481+0000 2023-12-12T11:57:39.389 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-12T11:49:14.113993+0000 2023-12-12T11:57:39.390 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-12T11:57:39.390 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-12T11:57:39.390 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-12T11:57:39.390 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-12T11:57:39.390 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-12T11:57:39.390 INFO:teuthology.orchestra.run.smithi063.stdout:max_xattr_size 65536 2023-12-12T11:57:39.390 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-12T11:57:39.390 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-12T11:57:39.390 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 46 2023-12-12T11:57:39.390 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-12T11:57:39.390 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 1 2023-12-12T11:57:39.390 INFO:teuthology.orchestra.run.smithi063.stdout:in 0 2023-12-12T11:57:39.390 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=14492} 2023-12-12T11:57:39.390 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-12T11:57:39.390 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-12T11:57:39.391 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-12T11:57:39.391 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-12T11:57:39.391 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-12T11:57:39.391 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data enabled 2023-12-12T11:57:39.391 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-12T11:57:39.391 INFO:teuthology.orchestra.run.smithi063.stdout:bal_rank_mask -1 2023-12-12T11:57:39.391 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 1 2023-12-12T11:57:39.391 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.aevpzg{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.63:6828/3709000039,v1:172.21.15.63:6829/3709000039] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:57:39.391 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:57:39.391 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:57:39.391 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2023-12-12T11:57:39.391 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:57:39.391 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.swdqms{-1:14500} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.93:6826/3307558569,v1:172.21.15.93:6827/3307558569] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:57:39.391 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.bdqbnp{-1:14508} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/2191270944,v1:172.21.15.63:6827/2191270944] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:57:39.391 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi093.rhaqsh{-1:24317} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.93:6824/3161864019,v1:172.21.15.93:6825/3161864019] compat {c=[1],r=[1],i=[7ff]}] 2023-12-12T11:57:39.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.388+0000 7ff573263700 1 -- 172.21.15.63:0/3185106170 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7ff55c06ce70 msgr2=0x7ff55c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:39.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.388+0000 7ff573263700 1 --2- 172.21.15.63:0/3185106170 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7ff55c06ce70 0x7ff55c06f320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0fdc60 tx=0x7ff56000b040 comp rx=0 tx=0).stop 2023-12-12T11:57:39.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.388+0000 7ff573263700 1 -- 172.21.15.63:0/3185106170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff56c0fde00 msgr2=0x7ff56c10fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:39.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.388+0000 7ff573263700 1 --2- 172.21.15.63:0/3185106170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff56c0fde00 0x7ff56c10fc20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff558009fd0 tx=0x7ff558009e30 comp rx=0 tx=0).stop 2023-12-12T11:57:39.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.389+0000 7ff573263700 1 -- 172.21.15.63:0/3185106170 shutdown_connections 2023-12-12T11:57:39.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.389+0000 7ff573263700 1 --2- 172.21.15.63:0/3185106170 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7ff55c06ce70 0x7ff55c06f320 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:39.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.389+0000 7ff573263700 1 --2- 172.21.15.63:0/3185106170 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff56c0fcbf0 0x7ff56c10f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:39.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.389+0000 7ff573263700 1 --2- 172.21.15.63:0/3185106170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff56c0fde00 0x7ff56c10fc20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:39.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.389+0000 7ff573263700 1 -- 172.21.15.63:0/3185106170 >> 172.21.15.63:0/3185106170 conn(0x7ff56c0f82d0 msgr2=0x7ff56c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:57:39.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.389+0000 7ff573263700 1 -- 172.21.15.63:0/3185106170 shutdown_connections 2023-12-12T11:57:39.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.389+0000 7ff573263700 1 -- 172.21.15.63:0/3185106170 wait complete. 2023-12-12T11:57:39.393 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 13 2023-12-12T11:57:39.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.529+0000 7f6ef1c3a700 1 -- 172.21.15.63:0/1238578414 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6eec0fde00 msgr2=0x7f6eec0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:39.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.529+0000 7f6ef1c3a700 1 --2- 172.21.15.63:0/1238578414 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6eec0fde00 0x7f6eec0fe250 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0004940 tx=0x7f6ee0009e30 comp rx=0 tx=0).stop 2023-12-12T11:57:39.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.529+0000 7f6ef1c3a700 1 -- 172.21.15.63:0/1238578414 shutdown_connections 2023-12-12T11:57:39.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.529+0000 7f6ef1c3a700 1 --2- 172.21.15.63:0/1238578414 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6eec0fde00 0x7f6eec0fe250 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:39.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.529+0000 7f6ef1c3a700 1 --2- 172.21.15.63:0/1238578414 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6eec0fcbf0 0x7f6eec0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:39.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.529+0000 7f6ef1c3a700 1 -- 172.21.15.63:0/1238578414 >> 172.21.15.63:0/1238578414 conn(0x7f6eec0f82d0 msgr2=0x7f6eec0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:57:39.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.529+0000 7f6ef1c3a700 1 -- 172.21.15.63:0/1238578414 shutdown_connections 2023-12-12T11:57:39.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.529+0000 7f6ef1c3a700 1 -- 172.21.15.63:0/1238578414 wait complete. 2023-12-12T11:57:39.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.530+0000 7f6ef1c3a700 1 Processor -- start 2023-12-12T11:57:39.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.530+0000 7f6ef1c3a700 1 -- start start 2023-12-12T11:57:39.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.531+0000 7f6ef1c3a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6eec0fcbf0 0x7f6eec10d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:39.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.531+0000 7f6ef1c3a700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6eec0fde00 0x7f6eec10dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:39.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.531+0000 7f6ef1c3a700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec10e0c0 con 0x7f6eec0fcbf0 2023-12-12T11:57:39.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.531+0000 7f6ef1c3a700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec10e960 con 0x7f6eec0fde00 2023-12-12T11:57:39.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.531+0000 7f6eeb7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6eec0fcbf0 0x7f6eec10d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:39.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.531+0000 7f6eeb7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6eec0fcbf0 0x7f6eec10d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60294/0 (socket says 172.21.15.63:60294) 2023-12-12T11:57:39.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.531+0000 7f6eeb7fe700 1 -- 172.21.15.63:0/1332913327 learned_addr learned my addr 172.21.15.63:0/1332913327 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:57:39.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.531+0000 7f6eeaffd700 1 --2- 172.21.15.63:0/1332913327 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6eec0fde00 0x7f6eec10dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:39.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.531+0000 7f6eeb7fe700 1 -- 172.21.15.63:0/1332913327 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6eec0fde00 msgr2=0x7f6eec10dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:39.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.531+0000 7f6eeb7fe700 1 --2- 172.21.15.63:0/1332913327 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6eec0fde00 0x7f6eec10dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:39.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.531+0000 7f6eeb7fe700 1 -- 172.21.15.63:0/1332913327 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee0005040 con 0x7f6eec0fcbf0 2023-12-12T11:57:39.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.532+0000 7f6eeb7fe700 1 --2- 172.21.15.63:0/1332913327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6eec0fcbf0 0x7f6eec10d580 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6edc002a80 tx=0x7f6edc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:57:39.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.532+0000 7f6ed3fff700 1 -- 172.21.15.63:0/1332913327 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6edc007cc0 con 0x7f6eec0fcbf0 2023-12-12T11:57:39.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.532+0000 7f6ef1c3a700 1 -- 172.21.15.63:0/1332913327 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eec10ec40 con 0x7f6eec0fcbf0 2023-12-12T11:57:39.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.532+0000 7f6ed3fff700 1 -- 172.21.15.63:0/1332913327 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6edc00f040 con 0x7f6eec0fcbf0 2023-12-12T11:57:39.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.532+0000 7f6ed3fff700 1 -- 172.21.15.63:0/1332913327 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6edc00da20 con 0x7f6eec0fcbf0 2023-12-12T11:57:39.536 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.532+0000 7f6ef1c3a700 1 -- 172.21.15.63:0/1332913327 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eec10f180 con 0x7f6eec0fcbf0 2023-12-12T11:57:39.536 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.533+0000 7f6ef1c3a700 1 -- 172.21.15.63:0/1332913327 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eec04bb80 con 0x7f6eec0fcbf0 2023-12-12T11:57:39.536 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.534+0000 7f6ed3fff700 1 -- 172.21.15.63:0/1332913327 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f6edc00db80 con 0x7f6eec0fcbf0 2023-12-12T11:57:39.537 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.535+0000 7f6ed3fff700 1 --2- 172.21.15.63:0/1332913327 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f6ed406ce70 0x7f6ed406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:39.538 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.535+0000 7f6ed3fff700 1 -- 172.21.15.63:0/1332913327 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f6edc08c190 con 0x7f6eec0fcbf0 2023-12-12T11:57:39.538 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.535+0000 7f6eeaffd700 1 --2- 172.21.15.63:0/1332913327 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f6ed406ce70 0x7f6ed406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:39.538 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.536+0000 7f6eeaffd700 1 --2- 172.21.15.63:0/1332913327 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f6ed406ce70 0x7f6ed406f320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0004f90 tx=0x7f6ee0009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:57:39.542 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.539+0000 7f6ed3fff700 1 -- 172.21.15.63:0/1332913327 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6edc059a00 con 0x7f6eec0fcbf0 2023-12-12T11:57:39.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:39 smithi093 ceph-mon[171709]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:57:39.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:39 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/3494743067' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:57:39.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:39 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/3185106170' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:57:39.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:39 smithi093 ceph-mon[171709]: pgmap v135: 65 pgs: 4 peering, 6 active+undersized+degraded, 7 active+undersized, 48 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 9/219 objects degraded (4.110%) 2023-12-12T11:57:39.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.769+0000 7f6ef1c3a700 1 -- 172.21.15.63:0/1332913327 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6eec10f5d0 con 0x7f6ed406ce70 2023-12-12T11:57:39.773 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.770+0000 7f6ed3fff700 1 -- 172.21.15.63:0/1332913327 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f6eec10f5d0 con 0x7f6ed406ce70 2023-12-12T11:57:39.773 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:57:39.773 INFO:teuthology.orchestra.run.smithi063.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dbb46fd2dbbe029cfba763f2b7c769e980f86b63e74be0c72e188909e20b81f3", 2023-12-12T11:57:39.773 INFO:teuthology.orchestra.run.smithi063.stdout: "in_progress": true, 2023-12-12T11:57:39.773 INFO:teuthology.orchestra.run.smithi063.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-12T11:57:39.773 INFO:teuthology.orchestra.run.smithi063.stdout: "services_complete": [ 2023-12-12T11:57:39.773 INFO:teuthology.orchestra.run.smithi063.stdout: "mon", 2023-12-12T11:57:39.774 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr", 2023-12-12T11:57:39.774 INFO:teuthology.orchestra.run.smithi063.stdout: "crash" 2023-12-12T11:57:39.774 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2023-12-12T11:57:39.774 INFO:teuthology.orchestra.run.smithi063.stdout: "progress": "11/21 daemons upgraded", 2023-12-12T11:57:39.774 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "Currently upgrading osd daemons", 2023-12-12T11:57:39.774 INFO:teuthology.orchestra.run.smithi063.stdout: "is_paused": false 2023-12-12T11:57:39.774 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:57:39.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.773+0000 7f6ef1c3a700 1 -- 172.21.15.63:0/1332913327 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f6ed406ce70 msgr2=0x7f6ed406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:39.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.773+0000 7f6ef1c3a700 1 --2- 172.21.15.63:0/1332913327 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f6ed406ce70 0x7f6ed406f320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0004f90 tx=0x7f6ee0009e30 comp rx=0 tx=0).stop 2023-12-12T11:57:39.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.773+0000 7f6ef1c3a700 1 -- 172.21.15.63:0/1332913327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6eec0fcbf0 msgr2=0x7f6eec10d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:39.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.773+0000 7f6ef1c3a700 1 --2- 172.21.15.63:0/1332913327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6eec0fcbf0 0x7f6eec10d580 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6edc002a80 tx=0x7f6edc004600 comp rx=0 tx=0).stop 2023-12-12T11:57:39.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.773+0000 7f6ef1c3a700 1 -- 172.21.15.63:0/1332913327 shutdown_connections 2023-12-12T11:57:39.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.773+0000 7f6ef1c3a700 1 --2- 172.21.15.63:0/1332913327 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f6ed406ce70 0x7f6ed406f320 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:39.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.773+0000 7f6ef1c3a700 1 --2- 172.21.15.63:0/1332913327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6eec0fcbf0 0x7f6eec10d580 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:39.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.773+0000 7f6ef1c3a700 1 --2- 172.21.15.63:0/1332913327 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6eec0fde00 0x7f6eec10dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:39.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.773+0000 7f6ef1c3a700 1 -- 172.21.15.63:0/1332913327 >> 172.21.15.63:0/1332913327 conn(0x7f6eec0f82d0 msgr2=0x7f6eec101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:57:39.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.773+0000 7f6ef1c3a700 1 -- 172.21.15.63:0/1332913327 shutdown_connections 2023-12-12T11:57:39.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.773+0000 7f6ef1c3a700 1 -- 172.21.15.63:0/1332913327 wait complete. 2023-12-12T11:57:39.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:39 smithi063 ceph-mon[187282]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:57:39.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:39 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/3494743067' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:57:39.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:39 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/3185106170' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-12T11:57:39.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:39 smithi063 ceph-mon[187282]: pgmap v135: 65 pgs: 4 peering, 6 active+undersized+degraded, 7 active+undersized, 48 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 9/219 objects degraded (4.110%) 2023-12-12T11:57:39.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.911+0000 7effdd7a6700 1 -- 172.21.15.63:0/975582563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd80fde00 msgr2=0x7effd80fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:39.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.911+0000 7effdd7a6700 1 --2- 172.21.15.63:0/975582563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd80fde00 0x7effd80fe250 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7effcc004940 tx=0x7effcc009e30 comp rx=0 tx=0).stop 2023-12-12T11:57:39.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.911+0000 7effdd7a6700 1 -- 172.21.15.63:0/975582563 shutdown_connections 2023-12-12T11:57:39.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.911+0000 7effdd7a6700 1 --2- 172.21.15.63:0/975582563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd80fde00 0x7effd80fe250 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:39.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.911+0000 7effdd7a6700 1 --2- 172.21.15.63:0/975582563 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7effd80fcbf0 0x7effd80fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:39.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.911+0000 7effdd7a6700 1 -- 172.21.15.63:0/975582563 >> 172.21.15.63:0/975582563 conn(0x7effd80f82d0 msgr2=0x7effd80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:57:39.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.912+0000 7effdd7a6700 1 -- 172.21.15.63:0/975582563 shutdown_connections 2023-12-12T11:57:39.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.912+0000 7effdd7a6700 1 -- 172.21.15.63:0/975582563 wait complete. 2023-12-12T11:57:39.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.912+0000 7effdd7a6700 1 Processor -- start 2023-12-12T11:57:39.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.913+0000 7effdd7a6700 1 -- start start 2023-12-12T11:57:39.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.913+0000 7effdd7a6700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7effd80fcbf0 0x7effd8071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:39.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.913+0000 7effdd7a6700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd80fde00 0x7effd806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:39.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.913+0000 7effdd7a6700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd8070590 con 0x7effd80fde00 2023-12-12T11:57:39.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.913+0000 7effdd7a6700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd8070700 con 0x7effd80fcbf0 2023-12-12T11:57:39.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.913+0000 7effd67fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd80fde00 0x7effd806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:39.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.913+0000 7effd67fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd80fde00 0x7effd806ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60306/0 (socket says 172.21.15.63:60306) 2023-12-12T11:57:39.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.913+0000 7effd67fc700 1 -- 172.21.15.63:0/3337692204 learned_addr learned my addr 172.21.15.63:0/3337692204 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:57:39.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.913+0000 7effd6ffd700 1 --2- 172.21.15.63:0/3337692204 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7effd80fcbf0 0x7effd8071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:39.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.914+0000 7effd67fc700 1 -- 172.21.15.63:0/3337692204 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7effd80fcbf0 msgr2=0x7effd8071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:39.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.914+0000 7effd67fc700 1 --2- 172.21.15.63:0/3337692204 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7effd80fcbf0 0x7effd8071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:39.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.914+0000 7effd67fc700 1 -- 172.21.15.63:0/3337692204 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effcc005040 con 0x7effd80fde00 2023-12-12T11:57:39.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.914+0000 7effd6ffd700 1 --2- 172.21.15.63:0/3337692204 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7effd80fcbf0 0x7effd8071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T11:57:39.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.914+0000 7effd67fc700 1 --2- 172.21.15.63:0/3337692204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd80fde00 0x7effd806ff90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7effcc00b3b0 tx=0x7effcc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:57:39.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.914+0000 7effbf7fe700 1 -- 172.21.15.63:0/3337692204 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effcc00e040 con 0x7effd80fde00 2023-12-12T11:57:39.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.914+0000 7effbf7fe700 1 -- 172.21.15.63:0/3337692204 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7effcc00bcd0 con 0x7effd80fde00 2023-12-12T11:57:39.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.914+0000 7effdd7a6700 1 -- 172.21.15.63:0/3337692204 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd8070980 con 0x7effd80fde00 2023-12-12T11:57:39.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.914+0000 7effbf7fe700 1 -- 172.21.15.63:0/3337692204 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effcc01c630 con 0x7effd80fde00 2023-12-12T11:57:39.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.914+0000 7effdd7a6700 1 -- 172.21.15.63:0/3337692204 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd8115590 con 0x7effd80fde00 2023-12-12T11:57:39.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.915+0000 7effdd7a6700 1 -- 172.21.15.63:0/3337692204 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd804bb80 con 0x7effd80fde00 2023-12-12T11:57:39.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.916+0000 7effbf7fe700 1 -- 172.21.15.63:0/3337692204 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7effcc013420 con 0x7effd80fde00 2023-12-12T11:57:39.922 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.917+0000 7effbf7fe700 1 --2- 172.21.15.63:0/3337692204 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7effc006ce70 0x7effc006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:57:39.922 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.917+0000 7effbf7fe700 1 -- 172.21.15.63:0/3337692204 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6500+0+0 (secure 0 0 0) 0x7effcc08d7f0 con 0x7effd80fde00 2023-12-12T11:57:39.922 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.917+0000 7effd6ffd700 1 --2- 172.21.15.63:0/3337692204 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7effc006ce70 0x7effc006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:57:39.922 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.918+0000 7effd6ffd700 1 --2- 172.21.15.63:0/3337692204 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7effc006ce70 0x7effc006f320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7effc8009fd0 tx=0x7effc800b040 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:57:39.924 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:39.922+0000 7effbf7fe700 1 -- 172.21.15.63:0/3337692204 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7effcc05b190 con 0x7effd80fde00 2023-12-12T11:57:40.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:40.215+0000 7effdd7a6700 1 -- 172.21.15.63:0/3337692204 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7effd81055b0 con 0x7effd80fde00 2023-12-12T11:57:40.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:40.215+0000 7effbf7fe700 1 -- 172.21.15.63:0/3337692204 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+700 (secure 0 0 0) 0x7effcc05ad20 con 0x7effd80fde00 2023-12-12T11:57:40.218 INFO:teuthology.orchestra.run.smithi063.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 9/219 objects degraded (4.110%), 6 pgs degraded 2023-12-12T11:57:40.218 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-12T11:57:40.218 INFO:teuthology.orchestra.run.smithi063.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-12T11:57:40.218 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 9/219 objects degraded (4.110%), 6 pgs degraded 2023-12-12T11:57:40.218 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2023-12-12T11:57:40.218 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2023-12-12T11:57:40.218 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2023-12-12T11:57:40.219 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2023-12-12T11:57:40.219 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2023-12-12T11:57:40.219 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2023-12-12T11:57:40.220 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:40.218+0000 7effdd7a6700 1 -- 172.21.15.63:0/3337692204 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7effc006ce70 msgr2=0x7effc006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:40.220 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:40.218+0000 7effdd7a6700 1 --2- 172.21.15.63:0/3337692204 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7effc006ce70 0x7effc006f320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7effc8009fd0 tx=0x7effc800b040 comp rx=0 tx=0).stop 2023-12-12T11:57:40.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:40.218+0000 7effdd7a6700 1 -- 172.21.15.63:0/3337692204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd80fde00 msgr2=0x7effd806ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:57:40.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:40.218+0000 7effdd7a6700 1 --2- 172.21.15.63:0/3337692204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd80fde00 0x7effd806ff90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7effcc00b3b0 tx=0x7effcc009e30 comp rx=0 tx=0).stop 2023-12-12T11:57:40.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:40.218+0000 7effdd7a6700 1 -- 172.21.15.63:0/3337692204 shutdown_connections 2023-12-12T11:57:40.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:40.218+0000 7effdd7a6700 1 --2- 172.21.15.63:0/3337692204 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7effc006ce70 0x7effc006f320 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:40.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:40.218+0000 7effdd7a6700 1 --2- 172.21.15.63:0/3337692204 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7effd80fcbf0 0x7effd8071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:40.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:40.218+0000 7effdd7a6700 1 --2- 172.21.15.63:0/3337692204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd80fde00 0x7effd806ff90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:57:40.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:40.218+0000 7effdd7a6700 1 -- 172.21.15.63:0/3337692204 >> 172.21.15.63:0/3337692204 conn(0x7effd80f82d0 msgr2=0x7effd8101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:57:40.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:40.218+0000 7effdd7a6700 1 -- 172.21.15.63:0/3337692204 shutdown_connections 2023-12-12T11:57:40.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:57:40.218+0000 7effdd7a6700 1 -- 172.21.15.63:0/3337692204 wait complete. 2023-12-12T11:57:40.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:40 smithi093 ceph-mon[171709]: Health check update: Degraded data redundancy: 9/219 objects degraded (4.110%), 6 pgs degraded (PG_DEGRADED) 2023-12-12T11:57:40.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:40 smithi093 ceph-mon[171709]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:57:40.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:40 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/3337692204' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:57:40.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:40 smithi063 ceph-mon[187282]: Health check update: Degraded data redundancy: 9/219 objects degraded (4.110%), 6 pgs degraded (PG_DEGRADED) 2023-12-12T11:57:40.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:40 smithi063 ceph-mon[187282]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:57:40.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:40 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/3337692204' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:57:41.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:41 smithi093 ceph-mon[171709]: pgmap v136: 65 pgs: 65 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:41.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:41 smithi063 ceph-mon[187282]: pgmap v136: 65 pgs: 65 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:42.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:42 smithi093 ceph-mon[171709]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/219 objects degraded (4.110%), 6 pgs degraded) 2023-12-12T11:57:42.776 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:42 smithi063 ceph-mon[187282]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/219 objects degraded (4.110%), 6 pgs degraded) 2023-12-12T11:57:43.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:43 smithi093 ceph-mon[171709]: pgmap v137: 65 pgs: 65 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:43.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:43 smithi063 ceph-mon[187282]: pgmap v137: 65 pgs: 65 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:46.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:45 smithi063 ceph-mon[187282]: pgmap v138: 65 pgs: 65 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:46.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:45 smithi093 ceph-mon[171709]: pgmap v138: 65 pgs: 65 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:47.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:47 smithi093 ceph-mon[171709]: pgmap v139: 65 pgs: 65 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:47.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:47 smithi063 ceph-mon[187282]: pgmap v139: 65 pgs: 65 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:49.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:49 smithi093 ceph-mon[171709]: pgmap v140: 65 pgs: 65 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:49.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:49 smithi063 ceph-mon[187282]: pgmap v140: 65 pgs: 65 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:51.021 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:50 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-12T11:57:51.021 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:50 smithi093 ceph-mon[171709]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-12T11:57:51.021 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:50 smithi093 ceph-mon[171709]: Upgrade: osd.5 is safe to restart 2023-12-12T11:57:51.021 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:50 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:51.021 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:50 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:57:51.021 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:50 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:51.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:50 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-12T11:57:51.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:50 smithi063 ceph-mon[187282]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-12T11:57:51.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:50 smithi063 ceph-mon[187282]: Upgrade: osd.5 is safe to restart 2023-12-12T11:57:51.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:50 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:51.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:50 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:57:51.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:50 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:52.034 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:51 smithi093 ceph-mon[171709]: pgmap v141: 65 pgs: 65 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:52.034 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:51 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:52.034 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:51 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-12T11:57:52.034 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:51 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:57:52.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:51 smithi063 ceph-mon[187282]: pgmap v141: 65 pgs: 65 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:52.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:51 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:57:52.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:51 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-12T11:57:52.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:51 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:57:53.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:52 smithi063 ceph-mon[187282]: Upgrade: Updating osd.5 2023-12-12T11:57:53.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:52 smithi063 ceph-mon[187282]: Deploying daemon osd.5 on smithi093 2023-12-12T11:57:53.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:52 smithi093 ceph-mon[171709]: Upgrade: Updating osd.5 2023-12-12T11:57:53.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:52 smithi093 ceph-mon[171709]: Deploying daemon osd.5 on smithi093 2023-12-12T11:57:54.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:53 smithi063 ceph-mon[187282]: pgmap v142: 65 pgs: 65 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:54.054 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:53 smithi093 ceph-mon[171709]: pgmap v142: 65 pgs: 65 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:54.471 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 11:57:54 smithi093 systemd[1]: Stopping Ceph osd.5 for 85e33c70-98e3-11ee-95a3-87774f69a715... 2023-12-12T11:57:54.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:54 smithi093 ceph-mon[171709]: osd.5 marked itself down and dead 2023-12-12T11:57:54.971 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 11:57:54 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[138979]: 2023-12-12T11:57:54.534+0000 7fd60deb8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-12T11:57:54.971 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 11:57:54 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[138979]: 2023-12-12T11:57:54.534+0000 7fd60deb8700 -1 osd.5 74 *** Got signal Terminated *** 2023-12-12T11:57:54.971 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 11:57:54 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[138979]: 2023-12-12T11:57:54.534+0000 7fd60deb8700 -1 osd.5 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-12T11:57:55.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:54 smithi063 ceph-mon[187282]: osd.5 marked itself down and dead 2023-12-12T11:57:55.721 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 11:57:55 smithi093 bash[196548]: ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5 2023-12-12T11:57:56.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:55 smithi063 ceph-mon[187282]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-12T11:57:56.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:55 smithi063 ceph-mon[187282]: osdmap e75: 6 total, 5 up, 6 in 2023-12-12T11:57:56.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:55 smithi063 ceph-mon[187282]: pgmap v144: 65 pgs: 3 peering, 12 stale+active+clean, 50 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:56.138 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:55 smithi093 ceph-mon[171709]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-12T11:57:56.138 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:55 smithi093 ceph-mon[171709]: osdmap e75: 6 total, 5 up, 6 in 2023-12-12T11:57:56.138 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:55 smithi093 ceph-mon[171709]: pgmap v144: 65 pgs: 3 peering, 12 stale+active+clean, 50 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-12T11:57:56.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:56 smithi093 ceph-mon[171709]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-12T11:57:56.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:56 smithi093 ceph-mon[171709]: osdmap e76: 6 total, 5 up, 6 in 2023-12-12T11:57:57.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:56 smithi063 ceph-mon[187282]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-12T11:57:57.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:56 smithi063 ceph-mon[187282]: osdmap e76: 6 total, 5 up, 6 in 2023-12-12T11:57:57.270 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 11:57:56 smithi093 systemd[1]: ceph-85e33c70-98e3-11ee-95a3-87774f69a715@osd.5.service: Succeeded. 2023-12-12T11:57:57.270 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 11:57:56 smithi093 systemd[1]: Stopped Ceph osd.5 for 85e33c70-98e3-11ee-95a3-87774f69a715. 2023-12-12T11:57:57.646 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 11:57:57 smithi093 systemd[1]: Starting Ceph osd.5 for 85e33c70-98e3-11ee-95a3-87774f69a715... 2023-12-12T11:57:57.971 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:57 smithi093 ceph-mon[171709]: pgmap v146: 65 pgs: 2 active+undersized+degraded, 3 peering, 7 stale+active+clean, 6 active+undersized, 47 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5/219 objects degraded (2.283%) 2023-12-12T11:57:58.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:57 smithi063 ceph-mon[187282]: pgmap v146: 65 pgs: 2 active+undersized+degraded, 3 peering, 7 stale+active+clean, 6 active+undersized, 47 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5/219 objects degraded (2.283%) 2023-12-12T11:57:58.721 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 11:57:58 smithi093 bash[196815]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-12T11:57:58.721 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 11:57:58 smithi093 bash[196815]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-12-12T11:57:58.721 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 11:57:58 smithi093 bash[196815]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-12-12T11:57:58.721 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 11:57:58 smithi093 bash[196815]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-12-12T11:57:58.721 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 11:57:58 smithi093 bash[196815]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2023-12-12T11:57:58.721 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 11:57:58 smithi093 bash[196815]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-12T11:57:58.722 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 11:57:58 smithi093 bash[196815]: --> ceph-volume raw activate successful for osd ID: 5 2023-12-12T11:57:59.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:57:58 smithi063 ceph-mon[187282]: Health check failed: Degraded data redundancy: 5/219 objects degraded (2.283%), 2 pgs degraded (PG_DEGRADED) 2023-12-12T11:57:59.190 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:57:58 smithi093 ceph-mon[171709]: Health check failed: Degraded data redundancy: 5/219 objects degraded (2.283%), 2 pgs degraded (PG_DEGRADED) 2023-12-12T11:57:59.721 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 11:57:59 smithi093 bash[197061]: 3f1f7e0448b5abdc62c7109a2d8f9f70b34f779fb3b8dd6609766d2973693003 2023-12-12T11:57:59.721 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 11:57:59 smithi093 ceph-osd[197098]: -- 172.21.15.93:0/3504031039 <== mon.1 v2:172.21.15.93:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56364904f6c0 con 0x56364901ec00 2023-12-12T11:57:59.721 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 11:57:59 smithi093 systemd[1]: Started Ceph osd.5 for 85e33c70-98e3-11ee-95a3-87774f69a715. 2023-12-12T11:58:00.221 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 11:57:59 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T11:57:59.810+0000 7fb016431640 -1 Falling back to public interface 2023-12-12T11:58:00.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:00 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:58:00.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:00 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:58:00.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:00 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:58:00.722 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:00 smithi093 ceph-mon[171709]: pgmap v147: 65 pgs: 7 active+undersized+degraded, 3 peering, 4 stale+active+clean, 11 active+undersized, 40 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22/219 objects degraded (10.046%) 2023-12-12T11:58:00.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:00 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:58:00.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:00 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:58:00.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:00 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:58:00.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:00 smithi063 ceph-mon[187282]: pgmap v147: 65 pgs: 7 active+undersized+degraded, 3 peering, 4 stale+active+clean, 11 active+undersized, 40 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22/219 objects degraded (10.046%) 2023-12-12T11:58:01.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:01 smithi093 ceph-mon[171709]: pgmap v148: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 30/219 objects degraded (13.699%) 2023-12-12T11:58:01.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:01 smithi093 ceph-mon[171709]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-12-12T11:58:01.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:01 smithi063 ceph-mon[187282]: pgmap v148: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 30/219 objects degraded (13.699%) 2023-12-12T11:58:01.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:01 smithi063 ceph-mon[187282]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-12-12T11:58:03.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:03 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:58:03.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:03 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:58:03.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:03 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:58:03.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:03 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:58:04.721 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 11:58:04 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T11:58:04.393+0000 7fb016431640 -1 osd.5 0 read_superblock omap replica is missing. 2023-12-12T11:58:04.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:04 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:58:04.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:04 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:58:04.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:04 smithi093 ceph-mon[171709]: pgmap v149: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 30/219 objects degraded (13.699%) 2023-12-12T11:58:04.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:04 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:58:04.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:04 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:58:04.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:04 smithi063 ceph-mon[187282]: pgmap v149: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 30/219 objects degraded (13.699%) 2023-12-12T11:58:05.221 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 11:58:04 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T11:58:04.936+0000 7fb016431640 -1 osd.5 74 log_to_monitors true 2023-12-12T11:58:05.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:05 smithi093 ceph-mon[171709]: Health check update: Degraded data redundancy: 30/219 objects degraded (13.699%), 12 pgs degraded (PG_DEGRADED) 2023-12-12T11:58:05.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:05 smithi093 ceph-mon[171709]: from='osd.5 [v2:172.21.15.93:6816/4114052086,v1:172.21.15.93:6817/4114052086]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-12T11:58:05.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:05 smithi093 ceph-mon[171709]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-12T11:58:05.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:05 smithi063 ceph-mon[187282]: Health check update: Degraded data redundancy: 30/219 objects degraded (13.699%), 12 pgs degraded (PG_DEGRADED) 2023-12-12T11:58:05.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:05 smithi063 ceph-mon[187282]: from='osd.5 [v2:172.21.15.93:6816/4114052086,v1:172.21.15.93:6817/4114052086]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-12T11:58:05.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:05 smithi063 ceph-mon[187282]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-12T11:58:06.221 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 11:58:05 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T11:58:05.782+0000 7fb00389a700 -1 osd.5 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T11:58:06.588 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:06 smithi093 ceph-mon[171709]: pgmap v150: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 30/219 objects degraded (13.699%) 2023-12-12T11:58:06.588 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:06 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:58:06.588 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:06 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:58:06.588 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:06 smithi093 ceph-mon[171709]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-12T11:58:06.588 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:06 smithi093 ceph-mon[171709]: osdmap e77: 6 total, 5 up, 6 in 2023-12-12T11:58:06.588 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:06 smithi093 ceph-mon[171709]: from='osd.5 [v2:172.21.15.93:6816/4114052086,v1:172.21.15.93:6817/4114052086]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-12T11:58:06.588 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:06 smithi093 ceph-mon[171709]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-12T11:58:06.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:06 smithi063 ceph-mon[187282]: pgmap v150: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 30/219 objects degraded (13.699%) 2023-12-12T11:58:06.794 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:06 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:58:06.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:06 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:58:06.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:06 smithi063 ceph-mon[187282]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-12T11:58:06.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:06 smithi063 ceph-mon[187282]: osdmap e77: 6 total, 5 up, 6 in 2023-12-12T11:58:06.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:06 smithi063 ceph-mon[187282]: from='osd.5 [v2:172.21.15.93:6816/4114052086,v1:172.21.15.93:6817/4114052086]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-12T11:58:06.795 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:06 smithi063 ceph-mon[187282]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-12T11:58:07.970 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:58:07.970 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:58:07.970 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:58:07.970 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:58:07.971 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:58:07.971 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-12T11:58:07.971 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: osd.5 [v2:172.21.15.93:6816/4114052086,v1:172.21.15.93:6817/4114052086] boot 2023-12-12T11:58:07.971 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: osdmap e78: 6 total, 6 up, 6 in 2023-12-12T11:58:07.971 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-12T11:58:07.971 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:58:07.971 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:58:07.971 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:58:07.971 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:58:07.971 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:58:07.971 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: Upgrade: Setting container_image for all osd 2023-12-12T11:58:07.971 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:58:07.971 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2023-12-12T11:58:07.971 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2023-12-12T11:58:07.972 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2023-12-12T11:58:07.972 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2023-12-12T11:58:07.972 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2023-12-12T11:58:07.972 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2023-12-12T11:58:07.972 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2023-12-12T11:58:07.972 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2023-12-12T11:58:07.972 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2023-12-12T11:58:07.972 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2023-12-12T11:58:07.972 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2023-12-12T11:58:07.972 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2023-12-12T11:58:07.972 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: Upgrade: Setting require_osd_release to 19 unknown 2023-12-12T11:58:07.972 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd require-osd-release", "release": "unknown"}]: dispatch 2023-12-12T11:58:07.972 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: Upgrade: Paused due to UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-12T11:58:07.972 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:58:07.972 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: pgmap v153: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 197 MiB data, 778 MiB used, 536 GiB / 536 GiB avail; 30/219 objects degraded (13.699%) 2023-12-12T11:58:07.972 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:58:07.973 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:58:07.973 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:58:07.973 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:58:07.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:58:07.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:58:07.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:58:07.973 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:58:07.974 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:58:07.974 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-12T11:58:07.974 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: osd.5 [v2:172.21.15.93:6816/4114052086,v1:172.21.15.93:6817/4114052086] boot 2023-12-12T11:58:07.974 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: osdmap e78: 6 total, 6 up, 6 in 2023-12-12T11:58:07.974 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-12T11:58:07.974 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:58:07.974 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:58:07.974 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:58:07.974 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:58:07.974 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:58:07.974 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: Upgrade: Setting container_image for all osd 2023-12-12T11:58:07.974 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:58:07.974 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2023-12-12T11:58:07.974 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2023-12-12T11:58:07.974 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2023-12-12T11:58:07.975 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2023-12-12T11:58:07.975 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2023-12-12T11:58:07.975 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2023-12-12T11:58:07.975 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2023-12-12T11:58:07.975 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2023-12-12T11:58:07.975 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2023-12-12T11:58:07.975 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2023-12-12T11:58:07.975 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2023-12-12T11:58:07.975 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2023-12-12T11:58:07.975 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: Upgrade: Setting require_osd_release to 19 unknown 2023-12-12T11:58:07.975 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd require-osd-release", "release": "unknown"}]: dispatch 2023-12-12T11:58:07.975 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: Upgrade: Paused due to UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-12T11:58:07.975 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:58:07.975 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: pgmap v153: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 197 MiB data, 778 MiB used, 536 GiB / 536 GiB avail; 30/219 objects degraded (13.699%) 2023-12-12T11:58:07.975 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:58:07.975 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:58:07.976 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:58:07.976 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:07 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:58:08.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:07 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-mon-smithi063[187235]: 2023-12-12T11:58:07.966+0000 7f3dddb79700 -1 log_channel(cluster) log [ERR] : Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-12T11:58:09.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:08 smithi063 ceph-mon[187282]: osdmap e79: 6 total, 6 up, 6 in 2023-12-12T11:58:09.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:08 smithi063 ceph-mon[187282]: Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-12T11:58:09.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:08 smithi093 ceph-mon[171709]: osdmap e79: 6 total, 6 up, 6 in 2023-12-12T11:58:09.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:08 smithi093 ceph-mon[171709]: Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-12T11:58:10.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:09 smithi063 ceph-mon[187282]: pgmap v155: 65 pgs: 9 peering, 7 active+undersized+degraded, 12 active+undersized, 37 active+clean; 197 MiB data, 778 MiB used, 536 GiB / 536 GiB avail; 14/219 objects degraded (6.393%) 2023-12-12T11:58:10.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:09 smithi093 ceph-mon[171709]: pgmap v155: 65 pgs: 9 peering, 7 active+undersized+degraded, 12 active+undersized, 37 active+clean; 197 MiB data, 778 MiB used, 536 GiB / 536 GiB avail; 14/219 objects degraded (6.393%) 2023-12-12T11:58:10.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.373+0000 7f4fffdf1700 1 -- 172.21.15.63:0/4255019777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ff8070570 msgr2=0x7f4ff80709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:58:10.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.373+0000 7f4fffdf1700 1 --2- 172.21.15.63:0/4255019777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ff8070570 0x7f4ff80709c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8004940 tx=0x7f4fe8009e30 comp rx=0 tx=0).stop 2023-12-12T11:58:10.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.373+0000 7f4fffdf1700 1 -- 172.21.15.63:0/4255019777 shutdown_connections 2023-12-12T11:58:10.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.373+0000 7f4fffdf1700 1 --2- 172.21.15.63:0/4255019777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ff8070570 0x7f4ff80709c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:10.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.373+0000 7f4fffdf1700 1 --2- 172.21.15.63:0/4255019777 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ff8071bc0 0x7f4ff8070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:10.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.373+0000 7f4fffdf1700 1 -- 172.21.15.63:0/4255019777 >> 172.21.15.63:0/4255019777 conn(0x7f4ff80f82d0 msgr2=0x7f4ff80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:58:10.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.373+0000 7f4fffdf1700 1 -- 172.21.15.63:0/4255019777 shutdown_connections 2023-12-12T11:58:10.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.374+0000 7f4fffdf1700 1 -- 172.21.15.63:0/4255019777 wait complete. 2023-12-12T11:58:10.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.375+0000 7f4fffdf1700 1 Processor -- start 2023-12-12T11:58:10.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.375+0000 7f4fffdf1700 1 -- start start 2023-12-12T11:58:10.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.375+0000 7f4fffdf1700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ff8070570 0x7f4ff810f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:58:10.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.375+0000 7f4fffdf1700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ff8071bc0 0x7f4ff810fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:58:10.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.375+0000 7f4fffdf1700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff81103a0 con 0x7f4ff8071bc0 2023-12-12T11:58:10.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.375+0000 7f4fffdf1700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff8110c40 con 0x7f4ff8070570 2023-12-12T11:58:10.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.376+0000 7f4ffd38c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ff8071bc0 0x7f4ff810fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:58:10.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.376+0000 7f4ffd38c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ff8071bc0 0x7f4ff810fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57402/0 (socket says 172.21.15.63:57402) 2023-12-12T11:58:10.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.376+0000 7f4ffd38c700 1 -- 172.21.15.63:0/3426021089 learned_addr learned my addr 172.21.15.63:0/3426021089 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:58:10.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.376+0000 7f4ffdb8d700 1 --2- 172.21.15.63:0/3426021089 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ff8070570 0x7f4ff810f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:58:10.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.376+0000 7f4ffd38c700 1 -- 172.21.15.63:0/3426021089 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ff8070570 msgr2=0x7f4ff810f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:58:10.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.376+0000 7f4ffd38c700 1 --2- 172.21.15.63:0/3426021089 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ff8070570 0x7f4ff810f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:10.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.376+0000 7f4ffd38c700 1 -- 172.21.15.63:0/3426021089 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe8005040 con 0x7f4ff8071bc0 2023-12-12T11:58:10.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.376+0000 7f4ffd38c700 1 --2- 172.21.15.63:0/3426021089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ff8071bc0 0x7f4ff810fda0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8009fd0 tx=0x7f4fe8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:58:10.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.377+0000 7f4fee7fc700 1 -- 172.21.15.63:0/3426021089 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fe800e040 con 0x7f4ff8071bc0 2023-12-12T11:58:10.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.377+0000 7f4fffdf1700 1 -- 172.21.15.63:0/3426021089 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff8110ec0 con 0x7f4ff8071bc0 2023-12-12T11:58:10.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.377+0000 7f4fee7fc700 1 -- 172.21.15.63:0/3426021089 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4fe8004290 con 0x7f4ff8071bc0 2023-12-12T11:58:10.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.377+0000 7f4fee7fc700 1 -- 172.21.15.63:0/3426021089 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fe801c3f0 con 0x7f4ff8071bc0 2023-12-12T11:58:10.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.377+0000 7f4fffdf1700 1 -- 172.21.15.63:0/3426021089 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff8111400 con 0x7f4ff8071bc0 2023-12-12T11:58:10.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.378+0000 7f4fffdf1700 1 -- 172.21.15.63:0/3426021089 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff81096f0 con 0x7f4ff8071bc0 2023-12-12T11:58:10.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.379+0000 7f4fee7fc700 1 -- 172.21.15.63:0/3426021089 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f4fe800bbf0 con 0x7f4ff8071bc0 2023-12-12T11:58:10.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.380+0000 7f4fee7fc700 1 --2- 172.21.15.63:0/3426021089 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f4fe406ce70 0x7f4fe406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:58:10.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.380+0000 7f4fee7fc700 1 -- 172.21.15.63:0/3426021089 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f4fe808d6a0 con 0x7f4ff8071bc0 2023-12-12T11:58:10.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.380+0000 7f4ffdb8d700 1 --2- 172.21.15.63:0/3426021089 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f4fe406ce70 0x7f4fe406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:58:10.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.381+0000 7f4ffdb8d700 1 --2- 172.21.15.63:0/3426021089 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f4fe406ce70 0x7f4fe406f320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4009fd0 tx=0x7f4ff400b040 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:58:10.388 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.385+0000 7f4fee7fc700 1 -- 172.21.15.63:0/3426021089 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4fe805b030 con 0x7f4ff8071bc0 2023-12-12T11:58:10.618 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.616+0000 7f4fffdf1700 1 -- 172.21.15.63:0/3426021089 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ff8107930 con 0x7f4fe406ce70 2023-12-12T11:58:10.619 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.617+0000 7f4fee7fc700 1 -- 172.21.15.63:0/3426021089 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7f4ff400f040 con 0x7f4fe406ce70 2023-12-12T11:58:10.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.619+0000 7f4fffdf1700 1 -- 172.21.15.63:0/3426021089 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f4fe406ce70 msgr2=0x7f4fe406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:58:10.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.619+0000 7f4fffdf1700 1 --2- 172.21.15.63:0/3426021089 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f4fe406ce70 0x7f4fe406f320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4009fd0 tx=0x7f4ff400b040 comp rx=0 tx=0).stop 2023-12-12T11:58:10.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.619+0000 7f4fffdf1700 1 -- 172.21.15.63:0/3426021089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ff8071bc0 msgr2=0x7f4ff810fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:58:10.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.619+0000 7f4fffdf1700 1 --2- 172.21.15.63:0/3426021089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ff8071bc0 0x7f4ff810fda0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8009fd0 tx=0x7f4fe8009e30 comp rx=0 tx=0).stop 2023-12-12T11:58:10.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.619+0000 7f4fffdf1700 1 -- 172.21.15.63:0/3426021089 shutdown_connections 2023-12-12T11:58:10.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.619+0000 7f4fffdf1700 1 --2- 172.21.15.63:0/3426021089 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f4fe406ce70 0x7f4fe406f320 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:10.623 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.619+0000 7f4fffdf1700 1 --2- 172.21.15.63:0/3426021089 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ff8070570 0x7f4ff810f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:10.623 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.619+0000 7f4fffdf1700 1 --2- 172.21.15.63:0/3426021089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ff8071bc0 0x7f4ff810fda0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:10.623 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.619+0000 7f4fffdf1700 1 -- 172.21.15.63:0/3426021089 >> 172.21.15.63:0/3426021089 conn(0x7f4ff80f82d0 msgr2=0x7f4ff8103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:58:10.623 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.620+0000 7f4fffdf1700 1 -- 172.21.15.63:0/3426021089 shutdown_connections 2023-12-12T11:58:10.623 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.620+0000 7f4fffdf1700 1 -- 172.21.15.63:0/3426021089 wait complete. 2023-12-12T11:58:10.637 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-12T11:58:10.761 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.759+0000 7fe88d26b700 1 -- 172.21.15.63:0/1328072941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8880fdc00 msgr2=0x7fe8880fe050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:58:10.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.759+0000 7fe88d26b700 1 --2- 172.21.15.63:0/1328072941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8880fdc00 0x7fe8880fe050 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe87c004940 tx=0x7fe87c009e30 comp rx=0 tx=0).stop 2023-12-12T11:58:10.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.759+0000 7fe88d26b700 1 -- 172.21.15.63:0/1328072941 shutdown_connections 2023-12-12T11:58:10.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.759+0000 7fe88d26b700 1 --2- 172.21.15.63:0/1328072941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8880fdc00 0x7fe8880fe050 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:10.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.759+0000 7fe88d26b700 1 --2- 172.21.15.63:0/1328072941 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8880fc9f0 0x7fe8880fce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:10.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.759+0000 7fe88d26b700 1 -- 172.21.15.63:0/1328072941 >> 172.21.15.63:0/1328072941 conn(0x7fe8880f8090 msgr2=0x7fe8880fa4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:58:10.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.759+0000 7fe88d26b700 1 -- 172.21.15.63:0/1328072941 shutdown_connections 2023-12-12T11:58:10.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.759+0000 7fe88d26b700 1 -- 172.21.15.63:0/1328072941 wait complete. 2023-12-12T11:58:10.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.760+0000 7fe88d26b700 1 Processor -- start 2023-12-12T11:58:10.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.760+0000 7fe88d26b700 1 -- start start 2023-12-12T11:58:10.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.761+0000 7fe88d26b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8880fc9f0 0x7fe888071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:58:10.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.761+0000 7fe88d26b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8880fdc00 0x7fe88806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:58:10.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.761+0000 7fe88d26b700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe888070590 con 0x7fe8880fc9f0 2023-12-12T11:58:10.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.761+0000 7fe88d26b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe888070700 con 0x7fe8880fdc00 2023-12-12T11:58:10.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.761+0000 7fe887fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8880fc9f0 0x7fe888071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:58:10.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.761+0000 7fe887fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8880fc9f0 0x7fe888071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57422/0 (socket says 172.21.15.63:57422) 2023-12-12T11:58:10.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.761+0000 7fe887fff700 1 -- 172.21.15.63:0/4233978146 learned_addr learned my addr 172.21.15.63:0/4233978146 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:58:10.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.761+0000 7fe8877fe700 1 --2- 172.21.15.63:0/4233978146 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8880fdc00 0x7fe88806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:58:10.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.761+0000 7fe887fff700 1 -- 172.21.15.63:0/4233978146 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8880fdc00 msgr2=0x7fe88806ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:58:10.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.761+0000 7fe887fff700 1 --2- 172.21.15.63:0/4233978146 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8880fdc00 0x7fe88806ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:10.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.761+0000 7fe887fff700 1 -- 172.21.15.63:0/4233978146 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87c005040 con 0x7fe8880fc9f0 2023-12-12T11:58:10.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.762+0000 7fe887fff700 1 --2- 172.21.15.63:0/4233978146 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8880fc9f0 0x7fe888071b10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe878002a80 tx=0x7fe878004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:58:10.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.762+0000 7fe884ff9700 1 -- 172.21.15.63:0/4233978146 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe878007cc0 con 0x7fe8880fc9f0 2023-12-12T11:58:10.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.762+0000 7fe884ff9700 1 -- 172.21.15.63:0/4233978146 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe87800f040 con 0x7fe8880fc9f0 2023-12-12T11:58:10.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.762+0000 7fe884ff9700 1 -- 172.21.15.63:0/4233978146 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe87800da20 con 0x7fe8880fc9f0 2023-12-12T11:58:10.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.762+0000 7fe88d26b700 1 -- 172.21.15.63:0/4233978146 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8880709e0 con 0x7fe8880fc9f0 2023-12-12T11:58:10.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.762+0000 7fe88d26b700 1 -- 172.21.15.63:0/4233978146 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe888115320 con 0x7fe8880fc9f0 2023-12-12T11:58:10.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.763+0000 7fe88d26b700 1 -- 172.21.15.63:0/4233978146 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe88804bb80 con 0x7fe8880fc9f0 2023-12-12T11:58:10.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.764+0000 7fe884ff9700 1 -- 172.21.15.63:0/4233978146 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fe87800db80 con 0x7fe8880fc9f0 2023-12-12T11:58:10.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.765+0000 7fe884ff9700 1 --2- 172.21.15.63:0/4233978146 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe87006ce70 0x7fe87006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:58:10.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.765+0000 7fe884ff9700 1 -- 172.21.15.63:0/4233978146 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fe87808bfd0 con 0x7fe8880fc9f0 2023-12-12T11:58:10.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.766+0000 7fe8877fe700 1 --2- 172.21.15.63:0/4233978146 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe87006ce70 0x7fe87006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:58:10.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.766+0000 7fe8877fe700 1 --2- 172.21.15.63:0/4233978146 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe87006ce70 0x7fe87006f320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe87c004f90 tx=0x7fe87c009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:58:10.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.770+0000 7fe884ff9700 1 -- 172.21.15.63:0/4233978146 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe8780bf2f0 con 0x7fe8880fc9f0 2023-12-12T11:58:11.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:10.999+0000 7fe88d26b700 1 -- 172.21.15.63:0/4233978146 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe888102550 con 0x7fe87006ce70 2023-12-12T11:58:11.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:11.000+0000 7fe884ff9700 1 -- 172.21.15.63:0/4233978146 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7fe888102550 con 0x7fe87006ce70 2023-12-12T11:58:11.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:11.002+0000 7fe88d26b700 1 -- 172.21.15.63:0/4233978146 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe87006ce70 msgr2=0x7fe87006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:58:11.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:11.002+0000 7fe88d26b700 1 --2- 172.21.15.63:0/4233978146 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe87006ce70 0x7fe87006f320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe87c004f90 tx=0x7fe87c009e30 comp rx=0 tx=0).stop 2023-12-12T11:58:11.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:11.002+0000 7fe88d26b700 1 -- 172.21.15.63:0/4233978146 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8880fc9f0 msgr2=0x7fe888071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:58:11.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:11.002+0000 7fe88d26b700 1 --2- 172.21.15.63:0/4233978146 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8880fc9f0 0x7fe888071b10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe878002a80 tx=0x7fe878004600 comp rx=0 tx=0).stop 2023-12-12T11:58:11.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:11.002+0000 7fe88d26b700 1 -- 172.21.15.63:0/4233978146 shutdown_connections 2023-12-12T11:58:11.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:11.002+0000 7fe88d26b700 1 --2- 172.21.15.63:0/4233978146 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe87006ce70 0x7fe87006f320 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:11.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:11.002+0000 7fe88d26b700 1 --2- 172.21.15.63:0/4233978146 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8880fc9f0 0x7fe888071b10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:11.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:11.002+0000 7fe88d26b700 1 --2- 172.21.15.63:0/4233978146 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8880fdc00 0x7fe88806ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:11.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:11.002+0000 7fe88d26b700 1 -- 172.21.15.63:0/4233978146 >> 172.21.15.63:0/4233978146 conn(0x7fe8880f8090 msgr2=0x7fe888100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:58:11.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:11.002+0000 7fe88d26b700 1 -- 172.21.15.63:0/4233978146 shutdown_connections 2023-12-12T11:58:11.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:11.003+0000 7fe88d26b700 1 -- 172.21.15.63:0/4233978146 wait complete. 2023-12-12T11:58:11.020 INFO:teuthology.orchestra.run.smithi063.stdout:"Error: UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception" 2023-12-12T11:58:11.029 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:10 smithi063 ceph-mon[187282]: Health check update: Degraded data redundancy: 14/219 objects degraded (6.393%), 7 pgs degraded (PG_DEGRADED) 2023-12-12T11:58:11.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:10 smithi093 ceph-mon[171709]: Health check update: Degraded data redundancy: 14/219 objects degraded (6.393%), 7 pgs degraded (PG_DEGRADED) 2023-12-12T11:58:11.404 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -e sha1=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 -- bash -c 'ceph orch ps' 2023-12-12T11:58:11.845 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:58:12.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:11 smithi063 ceph-mon[187282]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:58:12.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:11 smithi063 ceph-mon[187282]: pgmap v156: 65 pgs: 9 peering, 1 active+undersized, 55 active+clean; 197 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:12.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:11 smithi063 ceph-mon[187282]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:58:12.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:11 smithi093 ceph-mon[171709]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:58:12.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:11 smithi093 ceph-mon[171709]: pgmap v156: 65 pgs: 9 peering, 1 active+undersized, 55 active+clean; 197 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:12.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:11 smithi093 ceph-mon[171709]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:58:13.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:12 smithi063 ceph-mon[187282]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/219 objects degraded (6.393%), 7 pgs degraded) 2023-12-12T11:58:13.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.082+0000 7fdc8e38b700 1 -- 172.21.15.63:0/1841132055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc88102c00 msgr2=0x7fdc88102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:58:13.085 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.082+0000 7fdc8e38b700 1 --2- 172.21.15.63:0/1841132055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc88102c00 0x7fdc88102fd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdc78004940 tx=0x7fdc78009e30 comp rx=0 tx=0).stop 2023-12-12T11:58:13.085 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.082+0000 7fdc8e38b700 1 -- 172.21.15.63:0/1841132055 shutdown_connections 2023-12-12T11:58:13.085 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.082+0000 7fdc8e38b700 1 --2- 172.21.15.63:0/1841132055 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc881035a0 0x7fdc880fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:13.085 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.082+0000 7fdc8e38b700 1 --2- 172.21.15.63:0/1841132055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc88102c00 0x7fdc88102fd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:13.085 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.082+0000 7fdc8e38b700 1 -- 172.21.15.63:0/1841132055 >> 172.21.15.63:0/1841132055 conn(0x7fdc880f8790 msgr2=0x7fdc880faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:58:13.085 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.082+0000 7fdc8e38b700 1 -- 172.21.15.63:0/1841132055 shutdown_connections 2023-12-12T11:58:13.085 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.082+0000 7fdc8e38b700 1 -- 172.21.15.63:0/1841132055 wait complete. 2023-12-12T11:58:13.088 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.083+0000 7fdc8e38b700 1 Processor -- start 2023-12-12T11:58:13.088 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.083+0000 7fdc8e38b700 1 -- start start 2023-12-12T11:58:13.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.083+0000 7fdc8e38b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc88102c00 0x7fdc88113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:58:13.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.083+0000 7fdc8e38b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc881035a0 0x7fdc88113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:58:13.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.083+0000 7fdc8e38b700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc881141e0 con 0x7fdc88102c00 2023-12-12T11:58:13.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.083+0000 7fdc8e38b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8810d4d0 con 0x7fdc881035a0 2023-12-12T11:58:13.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.083+0000 7fdc87fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc88102c00 0x7fdc88113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:58:13.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.084+0000 7fdc87fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc88102c00 0x7fdc88113610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57436/0 (socket says 172.21.15.63:57436) 2023-12-12T11:58:13.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.084+0000 7fdc87fff700 1 -- 172.21.15.63:0/2813676226 learned_addr learned my addr 172.21.15.63:0/2813676226 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:58:13.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.084+0000 7fdc877fe700 1 --2- 172.21.15.63:0/2813676226 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc881035a0 0x7fdc88113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:58:13.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.084+0000 7fdc87fff700 1 -- 172.21.15.63:0/2813676226 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc881035a0 msgr2=0x7fdc88113b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:58:13.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.084+0000 7fdc87fff700 1 --2- 172.21.15.63:0/2813676226 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc881035a0 0x7fdc88113b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:13.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.084+0000 7fdc87fff700 1 -- 172.21.15.63:0/2813676226 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc78005040 con 0x7fdc88102c00 2023-12-12T11:58:13.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.084+0000 7fdc877fe700 1 --2- 172.21.15.63:0/2813676226 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc881035a0 0x7fdc88113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T11:58:13.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.084+0000 7fdc87fff700 1 --2- 172.21.15.63:0/2813676226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc88102c00 0x7fdc88113610 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdc78009360 tx=0x7fdc78009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:58:13.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.085+0000 7fdc84ff9700 1 -- 172.21.15.63:0/2813676226 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc7800e040 con 0x7fdc88102c00 2023-12-12T11:58:13.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.085+0000 7fdc84ff9700 1 -- 172.21.15.63:0/2813676226 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdc7800bc50 con 0x7fdc88102c00 2023-12-12T11:58:13.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.085+0000 7fdc84ff9700 1 -- 172.21.15.63:0/2813676226 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc7801c630 con 0x7fdc88102c00 2023-12-12T11:58:13.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.085+0000 7fdc8e38b700 1 -- 172.21.15.63:0/2813676226 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc8810d700 con 0x7fdc88102c00 2023-12-12T11:58:13.091 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.085+0000 7fdc8e38b700 1 -- 172.21.15.63:0/2813676226 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc8810dc40 con 0x7fdc88102c00 2023-12-12T11:58:13.091 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.086+0000 7fdc8e38b700 1 -- 172.21.15.63:0/2813676226 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc880fff10 con 0x7fdc88102c00 2023-12-12T11:58:13.092 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.087+0000 7fdc84ff9700 1 -- 172.21.15.63:0/2813676226 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fdc78013420 con 0x7fdc88102c00 2023-12-12T11:58:13.092 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.088+0000 7fdc84ff9700 1 --2- 172.21.15.63:0/2813676226 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fdc7006ce70 0x7fdc7006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:58:13.093 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.088+0000 7fdc84ff9700 1 -- 172.21.15.63:0/2813676226 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fdc7808d6c0 con 0x7fdc88102c00 2023-12-12T11:58:13.093 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.088+0000 7fdc877fe700 1 --2- 172.21.15.63:0/2813676226 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fdc7006ce70 0x7fdc7006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:58:13.093 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.089+0000 7fdc877fe700 1 --2- 172.21.15.63:0/2813676226 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fdc7006ce70 0x7fdc7006f320 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c009fd0 tx=0x7fdc7c009ee0 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:58:13.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.092+0000 7fdc84ff9700 1 -- 172.21.15.63:0/2813676226 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fdc7805afb0 con 0x7fdc88102c00 2023-12-12T11:58:13.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:12 smithi093 ceph-mon[171709]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/219 objects degraded (6.393%), 7 pgs degraded) 2023-12-12T11:58:13.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.319+0000 7fdc8e38b700 1 -- 172.21.15.63:0/2813676226 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc8804bbf0 con 0x7fdc7006ce70 2023-12-12T11:58:13.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.329+0000 7fdc84ff9700 1 -- 172.21.15.63:0/2813676226 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fdc8804bbf0 con 0x7fdc7006ce70 2023-12-12T11:58:13.332 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-12T11:58:13.332 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (5m) 107s ago 13m 14.9M - 0.25.0 c8568f914cd2 f237d9f64783 2023-12-12T11:58:13.332 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (3m) 107s ago 13m 7838k - 19.0.0-96-gf1fbf3c5 8cf689f388db 202fa7506e7c 2023-12-12T11:58:13.332 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi093 smithi093 running (3m) 11s ago 12m 7852k - 19.0.0-96-gf1fbf3c5 8cf689f388db ac9d76320ce6 2023-12-12T11:58:13.332 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (5m) 107s ago 13m 78.5M - 9.4.7 954c08fa6188 51300a1a5b87 2023-12-12T11:58:13.332 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.aevpzg smithi063 running (9m) 107s ago 9m 10.5G - 17.2.7-123-gbef78a51 ae6196193935 df9a6781f836 2023-12-12T11:58:13.333 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.bdqbnp smithi063 running (9m) 107s ago 9m 15.6M - 17.2.7-123-gbef78a51 ae6196193935 0c7e1d21eee9 2023-12-12T11:58:13.333 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.rhaqsh smithi093 running (9m) 11s ago 9m 15.9M - 17.2.7-123-gbef78a51 ae6196193935 257aee771d87 2023-12-12T11:58:13.333 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.swdqms smithi093 running (9m) 11s ago 9m 15.9M - 17.2.7-123-gbef78a51 ae6196193935 f46d7173d3b1 2023-12-12T11:58:13.333 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.zjnfdi smithi063 *:8443,9283,8765 running (5m) 107s ago 15m 515M - 19.0.0-96-gf1fbf3c5 8cf689f388db dab6fa4aaa54 2023-12-12T11:58:13.333 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi093.nbtltu smithi093 *:8443,9283,8765 running (4m) 11s ago 12m 452M - 19.0.0-96-gf1fbf3c5 8cf689f388db 701529e7fa8e 2023-12-12T11:58:13.333 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (4m) 107s ago 15m 61.7M 2048M 19.0.0-96-gf1fbf3c5 8cf689f388db 11f12a2e88e4 2023-12-12T11:58:13.333 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi093 smithi093 running (3m) 11s ago 12m 51.7M 2048M 19.0.0-96-gf1fbf3c5 8cf689f388db 1ffc49fcd680 2023-12-12T11:58:13.333 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (6m) 107s ago 13m 8510k - 1.5.0 0da6a335fe13 8eed63374ddf 2023-12-12T11:58:13.333 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi093 smithi093 *:9100 running (5m) 11s ago 12m 8384k - 1.5.0 0da6a335fe13 10e19431c1a2 2023-12-12T11:58:13.333 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (2m) 107s ago 12m 131M 1618M 19.0.0-96-gf1fbf3c5 8cf689f388db fade55811ec1 2023-12-12T11:58:13.333 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (2m) 107s ago 11m 138M 1618M 19.0.0-96-gf1fbf3c5 8cf689f388db 733e6ff9e83d 2023-12-12T11:58:13.333 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (112s) 107s ago 11m 12.5M 1618M 19.0.0-96-gf1fbf3c5 8cf689f388db bc155cfbaf86 2023-12-12T11:58:13.333 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi093 running (78s) 11s ago 11m 148M 2642M 19.0.0-96-gf1fbf3c5 8cf689f388db 36b87923d47a 2023-12-12T11:58:13.333 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi093 running (46s) 11s ago 10m 131M 2642M 19.0.0-96-gf1fbf3c5 8cf689f388db accfb5d51d84 2023-12-12T11:58:13.333 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi093 running (14s) 11s ago 10m 12.0M 2642M 19.0.0-96-gf1fbf3c5 8cf689f388db 3f1f7e0448b5 2023-12-12T11:58:13.334 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (4m) 107s ago 13m 48.2M - 2.43.0 a07b618ecd1d 834d9fc4eb61 2023-12-12T11:58:13.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.332+0000 7fdc8e38b700 1 -- 172.21.15.63:0/2813676226 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fdc7006ce70 msgr2=0x7fdc7006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:58:13.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.332+0000 7fdc8e38b700 1 --2- 172.21.15.63:0/2813676226 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fdc7006ce70 0x7fdc7006f320 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c009fd0 tx=0x7fdc7c009ee0 comp rx=0 tx=0).stop 2023-12-12T11:58:13.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.332+0000 7fdc8e38b700 1 -- 172.21.15.63:0/2813676226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc88102c00 msgr2=0x7fdc88113610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:58:13.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.332+0000 7fdc8e38b700 1 --2- 172.21.15.63:0/2813676226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc88102c00 0x7fdc88113610 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdc78009360 tx=0x7fdc78009e30 comp rx=0 tx=0).stop 2023-12-12T11:58:13.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.332+0000 7fdc8e38b700 1 -- 172.21.15.63:0/2813676226 shutdown_connections 2023-12-12T11:58:13.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.332+0000 7fdc8e38b700 1 --2- 172.21.15.63:0/2813676226 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fdc7006ce70 0x7fdc7006f320 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:13.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.332+0000 7fdc8e38b700 1 --2- 172.21.15.63:0/2813676226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc88102c00 0x7fdc88113610 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:13.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.332+0000 7fdc8e38b700 1 --2- 172.21.15.63:0/2813676226 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc881035a0 0x7fdc88113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:13.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.332+0000 7fdc8e38b700 1 -- 172.21.15.63:0/2813676226 >> 172.21.15.63:0/2813676226 conn(0x7fdc880f8790 msgr2=0x7fdc880fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:58:13.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.332+0000 7fdc8e38b700 1 -- 172.21.15.63:0/2813676226 shutdown_connections 2023-12-12T11:58:13.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:13.332+0000 7fdc8e38b700 1 -- 172.21.15.63:0/2813676226 wait complete. 2023-12-12T11:58:13.700 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -e sha1=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 -- bash -c 'ceph orch upgrade status' 2023-12-12T11:58:14.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:13 smithi063 ceph-mon[187282]: pgmap v157: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:14.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:13 smithi063 ceph-mon[187282]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:58:14.145 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:58:14.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:13 smithi093 ceph-mon[171709]: pgmap v157: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:14.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:13 smithi093 ceph-mon[171709]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:58:15.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.315+0000 7f98fccc4700 1 -- 172.21.15.63:0/3711885904 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98f81035a0 msgr2=0x7f98f80fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:58:15.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.315+0000 7f98fccc4700 1 --2- 172.21.15.63:0/3711885904 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98f81035a0 0x7f98f80fcc10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f98ec004940 tx=0x7f98ec009e30 comp rx=0 tx=0).stop 2023-12-12T11:58:15.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.315+0000 7f98fccc4700 1 -- 172.21.15.63:0/3711885904 shutdown_connections 2023-12-12T11:58:15.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.315+0000 7f98fccc4700 1 --2- 172.21.15.63:0/3711885904 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98f81035a0 0x7f98f80fcc10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:15.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.315+0000 7f98fccc4700 1 --2- 172.21.15.63:0/3711885904 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f98f8102c00 0x7f98f8102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:15.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.315+0000 7f98fccc4700 1 -- 172.21.15.63:0/3711885904 >> 172.21.15.63:0/3711885904 conn(0x7f98f80f8790 msgr2=0x7f98f80faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:58:15.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.315+0000 7f98fccc4700 1 -- 172.21.15.63:0/3711885904 shutdown_connections 2023-12-12T11:58:15.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.315+0000 7f98fccc4700 1 -- 172.21.15.63:0/3711885904 wait complete. 2023-12-12T11:58:15.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.316+0000 7f98fccc4700 1 Processor -- start 2023-12-12T11:58:15.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.317+0000 7f98fccc4700 1 -- start start 2023-12-12T11:58:15.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.317+0000 7f98fccc4700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f98f8102c00 0x7f98f8113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:58:15.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.317+0000 7f98fccc4700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98f81035a0 0x7f98f8113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:58:15.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.317+0000 7f98fccc4700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f8114210 con 0x7f98f81035a0 2023-12-12T11:58:15.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.317+0000 7f98fccc4700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f810d500 con 0x7f98f8102c00 2023-12-12T11:58:15.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.317+0000 7f98f5d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98f81035a0 0x7f98f8113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:58:15.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.317+0000 7f98f5d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98f81035a0 0x7f98f8113bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57454/0 (socket says 172.21.15.63:57454) 2023-12-12T11:58:15.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.317+0000 7f98f5d9b700 1 -- 172.21.15.63:0/2381650307 learned_addr learned my addr 172.21.15.63:0/2381650307 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:58:15.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.317+0000 7f98f659c700 1 --2- 172.21.15.63:0/2381650307 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f98f8102c00 0x7f98f8113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:58:15.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.318+0000 7f98f5d9b700 1 -- 172.21.15.63:0/2381650307 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f98f8102c00 msgr2=0x7f98f8113680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:58:15.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.318+0000 7f98f5d9b700 1 --2- 172.21.15.63:0/2381650307 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f98f8102c00 0x7f98f8113680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:15.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.318+0000 7f98f5d9b700 1 -- 172.21.15.63:0/2381650307 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ec005040 con 0x7f98f81035a0 2023-12-12T11:58:15.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.318+0000 7f98f5d9b700 1 --2- 172.21.15.63:0/2381650307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98f81035a0 0x7f98f8113bc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f98ec009fd0 tx=0x7f98ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:58:15.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.318+0000 7f98e6ffd700 1 -- 172.21.15.63:0/2381650307 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98ec00e040 con 0x7f98f81035a0 2023-12-12T11:58:15.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.318+0000 7f98e6ffd700 1 -- 172.21.15.63:0/2381650307 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f98ec013420 con 0x7f98f81035a0 2023-12-12T11:58:15.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.318+0000 7f98fccc4700 1 -- 172.21.15.63:0/2381650307 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f810d780 con 0x7f98f81035a0 2023-12-12T11:58:15.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.318+0000 7f98e6ffd700 1 -- 172.21.15.63:0/2381650307 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98ec01c630 con 0x7f98f81035a0 2023-12-12T11:58:15.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.318+0000 7f98fccc4700 1 -- 172.21.15.63:0/2381650307 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f810dcc0 con 0x7f98f81035a0 2023-12-12T11:58:15.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.320+0000 7f98fccc4700 1 -- 172.21.15.63:0/2381650307 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f8113310 con 0x7f98f81035a0 2023-12-12T11:58:15.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.320+0000 7f98e6ffd700 1 -- 172.21.15.63:0/2381650307 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f98ec013a00 con 0x7f98f81035a0 2023-12-12T11:58:15.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.321+0000 7f98e6ffd700 1 --2- 172.21.15.63:0/2381650307 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f98e006ce60 0x7f98e006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:58:15.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.322+0000 7f98e6ffd700 1 -- 172.21.15.63:0/2381650307 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f98ec08d580 con 0x7f98f81035a0 2023-12-12T11:58:15.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.322+0000 7f98f659c700 1 --2- 172.21.15.63:0/2381650307 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f98e006ce60 0x7f98e006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:58:15.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.322+0000 7f98f659c700 1 --2- 172.21.15.63:0/2381650307 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f98e006ce60 0x7f98e006f310 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f98e8007fd0 tx=0x7f98e8009040 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:58:15.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.326+0000 7f98e6ffd700 1 -- 172.21.15.63:0/2381650307 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f98ec05af10 con 0x7f98f81035a0 2023-12-12T11:58:15.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.557+0000 7f98fccc4700 1 -- 172.21.15.63:0/2381650307 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f98f804bb80 con 0x7f98e006ce60 2023-12-12T11:58:15.560 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.558+0000 7f98e6ffd700 1 -- 172.21.15.63:0/2381650307 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7f98f804bb80 con 0x7f98e006ce60 2023-12-12T11:58:15.561 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:58:15.561 INFO:teuthology.orchestra.run.smithi063.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dbb46fd2dbbe029cfba763f2b7c769e980f86b63e74be0c72e188909e20b81f3", 2023-12-12T11:58:15.561 INFO:teuthology.orchestra.run.smithi063.stdout: "in_progress": true, 2023-12-12T11:58:15.561 INFO:teuthology.orchestra.run.smithi063.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-12T11:58:15.561 INFO:teuthology.orchestra.run.smithi063.stdout: "services_complete": [ 2023-12-12T11:58:15.561 INFO:teuthology.orchestra.run.smithi063.stdout: "osd", 2023-12-12T11:58:15.561 INFO:teuthology.orchestra.run.smithi063.stdout: "mon", 2023-12-12T11:58:15.561 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr", 2023-12-12T11:58:15.561 INFO:teuthology.orchestra.run.smithi063.stdout: "crash" 2023-12-12T11:58:15.561 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2023-12-12T11:58:15.561 INFO:teuthology.orchestra.run.smithi063.stdout: "progress": "12/21 daemons upgraded", 2023-12-12T11:58:15.561 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "Error: UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception", 2023-12-12T11:58:15.561 INFO:teuthology.orchestra.run.smithi063.stdout: "is_paused": true 2023-12-12T11:58:15.561 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:58:15.563 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.560+0000 7f98fccc4700 1 -- 172.21.15.63:0/2381650307 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f98e006ce60 msgr2=0x7f98e006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:58:15.563 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.560+0000 7f98fccc4700 1 --2- 172.21.15.63:0/2381650307 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f98e006ce60 0x7f98e006f310 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f98e8007fd0 tx=0x7f98e8009040 comp rx=0 tx=0).stop 2023-12-12T11:58:15.563 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.560+0000 7f98fccc4700 1 -- 172.21.15.63:0/2381650307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98f81035a0 msgr2=0x7f98f8113bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:58:15.563 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.560+0000 7f98fccc4700 1 --2- 172.21.15.63:0/2381650307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98f81035a0 0x7f98f8113bc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f98ec009fd0 tx=0x7f98ec009e30 comp rx=0 tx=0).stop 2023-12-12T11:58:15.563 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.560+0000 7f98fccc4700 1 -- 172.21.15.63:0/2381650307 shutdown_connections 2023-12-12T11:58:15.563 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.560+0000 7f98fccc4700 1 --2- 172.21.15.63:0/2381650307 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f98e006ce60 0x7f98e006f310 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:15.563 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.561+0000 7f98fccc4700 1 --2- 172.21.15.63:0/2381650307 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f98f8102c00 0x7f98f8113680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:15.563 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.561+0000 7f98fccc4700 1 --2- 172.21.15.63:0/2381650307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98f81035a0 0x7f98f8113bc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:15.564 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.561+0000 7f98fccc4700 1 -- 172.21.15.63:0/2381650307 >> 172.21.15.63:0/2381650307 conn(0x7f98f80f8790 msgr2=0x7f98f80fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:58:15.564 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.561+0000 7f98fccc4700 1 -- 172.21.15.63:0/2381650307 shutdown_connections 2023-12-12T11:58:15.564 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:15.561+0000 7f98fccc4700 1 -- 172.21.15.63:0/2381650307 wait complete. 2023-12-12T11:58:15.942 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:15 smithi063 ceph-mon[187282]: pgmap v158: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:15.966 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -e sha1=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 -- bash -c 'ceph health detail' 2023-12-12T11:58:16.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:15 smithi093 ceph-mon[171709]: pgmap v158: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:16.409 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:58:16.939 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:16 smithi063 ceph-mon[187282]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:58:17.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:16 smithi093 ceph-mon[171709]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:58:17.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.647+0000 7fe3319e3700 1 -- 172.21.15.63:0/1316026467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe32c102c00 msgr2=0x7fe32c102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:58:17.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.647+0000 7fe3319e3700 1 --2- 172.21.15.63:0/1316026467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe32c102c00 0x7fe32c102fd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe31c004940 tx=0x7fe31c009e30 comp rx=0 tx=0).stop 2023-12-12T11:58:17.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.648+0000 7fe3319e3700 1 -- 172.21.15.63:0/1316026467 shutdown_connections 2023-12-12T11:58:17.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.648+0000 7fe3319e3700 1 --2- 172.21.15.63:0/1316026467 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe32c1035a0 0x7fe32c0fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:17.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.648+0000 7fe3319e3700 1 --2- 172.21.15.63:0/1316026467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe32c102c00 0x7fe32c102fd0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:17.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.648+0000 7fe3319e3700 1 -- 172.21.15.63:0/1316026467 >> 172.21.15.63:0/1316026467 conn(0x7fe32c0f8790 msgr2=0x7fe32c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:58:17.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.648+0000 7fe3319e3700 1 -- 172.21.15.63:0/1316026467 shutdown_connections 2023-12-12T11:58:17.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.648+0000 7fe3319e3700 1 -- 172.21.15.63:0/1316026467 wait complete. 2023-12-12T11:58:17.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.649+0000 7fe3319e3700 1 Processor -- start 2023-12-12T11:58:17.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.649+0000 7fe3319e3700 1 -- start start 2023-12-12T11:58:17.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.650+0000 7fe3319e3700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe32c102c00 0x7fe32c06ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:58:17.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.650+0000 7fe3319e3700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe32c1035a0 0x7fe32c070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:58:17.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.650+0000 7fe3319e3700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c070a80 con 0x7fe32c1035a0 2023-12-12T11:58:17.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.650+0000 7fe3319e3700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c070bf0 con 0x7fe32c102c00 2023-12-12T11:58:17.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.650+0000 7fe32a7fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe32c1035a0 0x7fe32c070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:58:17.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.650+0000 7fe32a7fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe32c1035a0 0x7fe32c070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57470/0 (socket says 172.21.15.63:57470) 2023-12-12T11:58:17.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.650+0000 7fe32a7fc700 1 -- 172.21.15.63:0/222298105 learned_addr learned my addr 172.21.15.63:0/222298105 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:58:17.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.650+0000 7fe32affd700 1 --2- 172.21.15.63:0/222298105 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe32c102c00 0x7fe32c06ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:58:17.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.650+0000 7fe32a7fc700 1 -- 172.21.15.63:0/222298105 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe32c102c00 msgr2=0x7fe32c06ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:58:17.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.650+0000 7fe32a7fc700 1 --2- 172.21.15.63:0/222298105 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe32c102c00 0x7fe32c06ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:17.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.650+0000 7fe32a7fc700 1 -- 172.21.15.63:0/222298105 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31c005040 con 0x7fe32c1035a0 2023-12-12T11:58:17.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.651+0000 7fe32a7fc700 1 --2- 172.21.15.63:0/222298105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe32c1035a0 0x7fe32c070480 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe320002a50 tx=0x7fe320004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:58:17.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.651+0000 7fe3137fe700 1 -- 172.21.15.63:0/222298105 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe320007cc0 con 0x7fe32c1035a0 2023-12-12T11:58:17.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.651+0000 7fe3319e3700 1 -- 172.21.15.63:0/222298105 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32c119850 con 0x7fe32c1035a0 2023-12-12T11:58:17.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.651+0000 7fe3137fe700 1 -- 172.21.15.63:0/222298105 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe32000f040 con 0x7fe32c1035a0 2023-12-12T11:58:17.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.651+0000 7fe3137fe700 1 -- 172.21.15.63:0/222298105 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe32000d920 con 0x7fe32c1035a0 2023-12-12T11:58:17.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.651+0000 7fe3319e3700 1 -- 172.21.15.63:0/222298105 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32c119d30 con 0x7fe32c1035a0 2023-12-12T11:58:17.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.652+0000 7fe3319e3700 1 -- 172.21.15.63:0/222298105 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe32c0fff10 con 0x7fe32c1035a0 2023-12-12T11:58:17.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.653+0000 7fe3137fe700 1 -- 172.21.15.63:0/222298105 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fe320009680 con 0x7fe32c1035a0 2023-12-12T11:58:17.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.654+0000 7fe3137fe700 1 --2- 172.21.15.63:0/222298105 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe31406ce70 0x7fe31406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:58:17.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.654+0000 7fe3137fe700 1 -- 172.21.15.63:0/222298105 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fe32008c0c0 con 0x7fe32c1035a0 2023-12-12T11:58:17.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.654+0000 7fe32affd700 1 --2- 172.21.15.63:0/222298105 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe31406ce70 0x7fe31406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:58:17.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.655+0000 7fe32affd700 1 --2- 172.21.15.63:0/222298105 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe31406ce70 0x7fe31406f320 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0043d0 tx=0x7fe31c009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:58:17.661 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.659+0000 7fe3137fe700 1 -- 172.21.15.63:0/222298105 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe320055ea0 con 0x7fe32c1035a0 2023-12-12T11:58:17.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.952+0000 7fe3319e3700 1 -- 172.21.15.63:0/222298105 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe32c071680 con 0x7fe32c1035a0 2023-12-12T11:58:17.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.952+0000 7fe3137fe700 1 -- 172.21.15.63:0/222298105 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+451 (secure 0 0 0) 0x7fe3200594c0 con 0x7fe32c1035a0 2023-12-12T11:58:17.955 INFO:teuthology.orchestra.run.smithi063.stdout:HEALTH_ERR 1 filesystem with deprecated feature inline_data; Upgrade: failed due to an unexpected exception 2023-12-12T11:58:17.955 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-12T11:58:17.955 INFO:teuthology.orchestra.run.smithi063.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-12T11:58:17.956 INFO:teuthology.orchestra.run.smithi063.stdout:[ERR] UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-12T11:58:17.956 INFO:teuthology.orchestra.run.smithi063.stdout: Unexpected exception occurred during upgrade process: osd require-osd-release failed: unrecognized release unknown retval: -22 2023-12-12T11:58:17.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.955+0000 7fe3319e3700 1 -- 172.21.15.63:0/222298105 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe31406ce70 msgr2=0x7fe31406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:58:17.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.955+0000 7fe3319e3700 1 --2- 172.21.15.63:0/222298105 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe31406ce70 0x7fe31406f320 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0043d0 tx=0x7fe31c009e30 comp rx=0 tx=0).stop 2023-12-12T11:58:17.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.955+0000 7fe3319e3700 1 -- 172.21.15.63:0/222298105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe32c1035a0 msgr2=0x7fe32c070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:58:17.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.955+0000 7fe3319e3700 1 --2- 172.21.15.63:0/222298105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe32c1035a0 0x7fe32c070480 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe320002a50 tx=0x7fe320004600 comp rx=0 tx=0).stop 2023-12-12T11:58:17.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.955+0000 7fe3319e3700 1 -- 172.21.15.63:0/222298105 shutdown_connections 2023-12-12T11:58:17.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.955+0000 7fe3319e3700 1 --2- 172.21.15.63:0/222298105 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe31406ce70 0x7fe31406f320 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:17.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.955+0000 7fe3319e3700 1 --2- 172.21.15.63:0/222298105 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe32c102c00 0x7fe32c06ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:17.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.955+0000 7fe3319e3700 1 --2- 172.21.15.63:0/222298105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe32c1035a0 0x7fe32c070480 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:17.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.955+0000 7fe3319e3700 1 -- 172.21.15.63:0/222298105 >> 172.21.15.63:0/222298105 conn(0x7fe32c0f8790 msgr2=0x7fe32c0fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:58:17.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.955+0000 7fe3319e3700 1 -- 172.21.15.63:0/222298105 shutdown_connections 2023-12-12T11:58:17.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:17.955+0000 7fe3319e3700 1 -- 172.21.15.63:0/222298105 wait complete. 2023-12-12T11:58:18.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:17 smithi063 ceph-mon[187282]: pgmap v159: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:18.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:17 smithi093 ceph-mon[171709]: pgmap v159: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:18.294 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -e sha1=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 -- bash -c 'ceph versions' 2023-12-12T11:58:18.732 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:58:19.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:18 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/222298105' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:58:19.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:18 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/222298105' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-12T11:58:19.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.897+0000 7f471f3f9700 1 -- 172.21.15.63:0/1837713553 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4718102c00 msgr2=0x7f4718102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:58:19.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.897+0000 7f471f3f9700 1 --2- 172.21.15.63:0/1837713553 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4718102c00 0x7f4718102fd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4714004940 tx=0x7f4714009e30 comp rx=0 tx=0).stop 2023-12-12T11:58:19.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.897+0000 7f471f3f9700 1 -- 172.21.15.63:0/1837713553 shutdown_connections 2023-12-12T11:58:19.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.897+0000 7f471f3f9700 1 --2- 172.21.15.63:0/1837713553 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f47181035a0 0x7f47180fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:19.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.897+0000 7f471f3f9700 1 --2- 172.21.15.63:0/1837713553 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4718102c00 0x7f4718102fd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:19.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.897+0000 7f471f3f9700 1 -- 172.21.15.63:0/1837713553 >> 172.21.15.63:0/1837713553 conn(0x7f47180f8790 msgr2=0x7f47180faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:58:19.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.897+0000 7f471f3f9700 1 -- 172.21.15.63:0/1837713553 shutdown_connections 2023-12-12T11:58:19.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.897+0000 7f471f3f9700 1 -- 172.21.15.63:0/1837713553 wait complete. 2023-12-12T11:58:19.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.898+0000 7f471f3f9700 1 Processor -- start 2023-12-12T11:58:19.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.898+0000 7f471f3f9700 1 -- start start 2023-12-12T11:58:19.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.899+0000 7f471f3f9700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4718102c00 0x7f471806ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:58:19.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.899+0000 7f471f3f9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47181035a0 0x7f4718070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:58:19.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.899+0000 7f471f3f9700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4718070a80 con 0x7f47181035a0 2023-12-12T11:58:19.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.899+0000 7f471f3f9700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4718070bf0 con 0x7f4718102c00 2023-12-12T11:58:19.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.899+0000 7f471c994700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47181035a0 0x7f4718070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:58:19.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.899+0000 7f471c994700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47181035a0 0x7f4718070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37738/0 (socket says 172.21.15.63:37738) 2023-12-12T11:58:19.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.899+0000 7f471c994700 1 -- 172.21.15.63:0/3877353944 learned_addr learned my addr 172.21.15.63:0/3877353944 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:58:19.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.899+0000 7f471d195700 1 --2- 172.21.15.63:0/3877353944 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4718102c00 0x7f471806ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:58:19.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.900+0000 7f471c994700 1 -- 172.21.15.63:0/3877353944 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4718102c00 msgr2=0x7f471806ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:58:19.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.900+0000 7f471c994700 1 --2- 172.21.15.63:0/3877353944 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4718102c00 0x7f471806ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:19.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.900+0000 7f471c994700 1 -- 172.21.15.63:0/3877353944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4714005040 con 0x7f47181035a0 2023-12-12T11:58:19.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.900+0000 7f471c994700 1 --2- 172.21.15.63:0/3877353944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47181035a0 0x7f4718070480 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f470800eb40 tx=0x7f470800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:58:19.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.900+0000 7f470dffb700 1 -- 172.21.15.63:0/3877353944 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4708007cc0 con 0x7f47181035a0 2023-12-12T11:58:19.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.900+0000 7f470dffb700 1 -- 172.21.15.63:0/3877353944 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f470800f040 con 0x7f47181035a0 2023-12-12T11:58:19.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.900+0000 7f470dffb700 1 -- 172.21.15.63:0/3877353944 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f470800c8f0 con 0x7f47181035a0 2023-12-12T11:58:19.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.900+0000 7f471f3f9700 1 -- 172.21.15.63:0/3877353944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4718119880 con 0x7f47181035a0 2023-12-12T11:58:19.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.900+0000 7f471f3f9700 1 -- 172.21.15.63:0/3877353944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4718119ce0 con 0x7f47181035a0 2023-12-12T11:58:19.904 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.901+0000 7f471f3f9700 1 -- 172.21.15.63:0/3877353944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47180fff10 con 0x7f47181035a0 2023-12-12T11:58:19.904 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.902+0000 7f470dffb700 1 -- 172.21.15.63:0/3877353944 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f47080090d0 con 0x7f47181035a0 2023-12-12T11:58:19.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.903+0000 7f470dffb700 1 --2- 172.21.15.63:0/3877353944 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f470406ce70 0x7f470406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:58:19.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.903+0000 7f470dffb700 1 -- 172.21.15.63:0/3877353944 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f470808bd30 con 0x7f47181035a0 2023-12-12T11:58:19.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.904+0000 7f471d195700 1 --2- 172.21.15.63:0/3877353944 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f470406ce70 0x7f470406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:58:19.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.904+0000 7f471d195700 1 --2- 172.21.15.63:0/3877353944 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f470406ce70 0x7f470406f320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4714009fd0 tx=0x7f4714009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:58:19.910 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:19.908+0000 7f470dffb700 1 -- 172.21.15.63:0/3877353944 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4708055c40 con 0x7f47181035a0 2023-12-12T11:58:20.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:19 smithi063 ceph-mon[187282]: pgmap v160: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:20.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:20.205+0000 7f471f3f9700 1 -- 172.21.15.63:0/3877353944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f47180fc360 con 0x7f47181035a0 2023-12-12T11:58:20.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:20.206+0000 7f470dffb700 1 -- 172.21.15.63:0/3877353944 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+721 (secure 0 0 0) 0x7f4708059260 con 0x7f47181035a0 2023-12-12T11:58:20.209 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:58:20.209 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-12T11:58:20.209 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 2 2023-12-12T11:58:20.209 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:58:20.209 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-12T11:58:20.209 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 2 2023-12-12T11:58:20.209 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:58:20.209 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-12T11:58:20.209 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 6 2023-12-12T11:58:20.209 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:58:20.209 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-12T11:58:20.209 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 4 2023-12-12T11:58:20.210 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:58:20.210 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-12T11:58:20.210 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 4, 2023-12-12T11:58:20.210 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 10 2023-12-12T11:58:20.210 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-12T11:58:20.210 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:58:20.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:20.208+0000 7f471f3f9700 1 -- 172.21.15.63:0/3877353944 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f470406ce70 msgr2=0x7f470406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:58:20.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:20.209+0000 7f471f3f9700 1 --2- 172.21.15.63:0/3877353944 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f470406ce70 0x7f470406f320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4714009fd0 tx=0x7f4714009e30 comp rx=0 tx=0).stop 2023-12-12T11:58:20.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:20.209+0000 7f471f3f9700 1 -- 172.21.15.63:0/3877353944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47181035a0 msgr2=0x7f4718070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:58:20.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:20.209+0000 7f471f3f9700 1 --2- 172.21.15.63:0/3877353944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47181035a0 0x7f4718070480 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f470800eb40 tx=0x7f470800b040 comp rx=0 tx=0).stop 2023-12-12T11:58:20.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:20.209+0000 7f471f3f9700 1 -- 172.21.15.63:0/3877353944 shutdown_connections 2023-12-12T11:58:20.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:20.209+0000 7f471f3f9700 1 --2- 172.21.15.63:0/3877353944 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f470406ce70 0x7f470406f320 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:20.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:20.209+0000 7f471f3f9700 1 --2- 172.21.15.63:0/3877353944 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4718102c00 0x7f471806ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:20.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:20.209+0000 7f471f3f9700 1 --2- 172.21.15.63:0/3877353944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47181035a0 0x7f4718070480 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:58:20.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:20.209+0000 7f471f3f9700 1 -- 172.21.15.63:0/3877353944 >> 172.21.15.63:0/3877353944 conn(0x7f47180f8790 msgr2=0x7f47180fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:58:20.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:20.209+0000 7f471f3f9700 1 -- 172.21.15.63:0/3877353944 shutdown_connections 2023-12-12T11:58:20.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:58:20.209+0000 7f471f3f9700 1 -- 172.21.15.63:0/3877353944 wait complete. 2023-12-12T11:58:20.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:19 smithi093 ceph-mon[171709]: pgmap v160: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:20.599 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -e sha1=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2023-12-12T11:58:21.038 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:58:21.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:20 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/3877353944' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:58:21.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:20 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:58:21.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:20 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:58:21.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:20 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:58:21.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:20 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/3877353944' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:58:21.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:20 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:58:21.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:20 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:58:21.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:20 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:58:22.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:21 smithi063 ceph-mon[187282]: pgmap v161: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:22.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:21 smithi093 ceph-mon[171709]: pgmap v161: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:22.267 INFO:teuthology.orchestra.run.smithi063.stdout:wait for servicemap items w/ changing names to refresh 2023-12-12T11:58:22.646 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -e sha1=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 -- bash -c 'sleep 60' 2023-12-12T11:58:23.087 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:58:24.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:24 smithi063 ceph-mon[187282]: pgmap v162: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:24.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:24 smithi093 ceph-mon[171709]: pgmap v162: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:26.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:25 smithi063 ceph-mon[187282]: pgmap v163: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:26.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:25 smithi093 ceph-mon[171709]: pgmap v163: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:28.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:28 smithi063 ceph-mon[187282]: pgmap v164: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:28.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:28 smithi093 ceph-mon[171709]: pgmap v164: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:30.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:30 smithi063 ceph-mon[187282]: pgmap v165: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:30.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:30 smithi093 ceph-mon[171709]: pgmap v165: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:32.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:32 smithi063 ceph-mon[187282]: pgmap v166: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:32.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:32 smithi093 ceph-mon[171709]: pgmap v166: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:34.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:34 smithi063 ceph-mon[187282]: pgmap v167: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:34.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:34 smithi093 ceph-mon[171709]: pgmap v167: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:36.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:35 smithi063 ceph-mon[187282]: pgmap v168: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:36.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:35 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:58:36.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:35 smithi093 ceph-mon[171709]: pgmap v168: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:36.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:35 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:58:38.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:38 smithi063 ceph-mon[187282]: pgmap v169: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:38.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:38 smithi093 ceph-mon[171709]: pgmap v169: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:40.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:40 smithi063 ceph-mon[187282]: pgmap v170: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:40.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:40 smithi093 ceph-mon[171709]: pgmap v170: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:42.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:42 smithi063 ceph-mon[187282]: pgmap v171: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:42.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:42 smithi093 ceph-mon[171709]: pgmap v171: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:44.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:44 smithi093 ceph-mon[171709]: pgmap v172: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:44.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:44 smithi063 ceph-mon[187282]: pgmap v172: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:46.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:45 smithi063 ceph-mon[187282]: pgmap v173: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:46.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:45 smithi093 ceph-mon[171709]: pgmap v173: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:48.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:48 smithi063 ceph-mon[187282]: pgmap v174: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:48.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:48 smithi093 ceph-mon[171709]: pgmap v174: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:50.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:50 smithi063 ceph-mon[187282]: pgmap v175: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:50.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:50 smithi093 ceph-mon[171709]: pgmap v175: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:51.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:51 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:58:51.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:51 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:58:52.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:52 smithi093 ceph-mon[171709]: pgmap v176: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:52.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:52 smithi063 ceph-mon[187282]: pgmap v176: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:54.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:54 smithi093 ceph-mon[171709]: pgmap v177: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:54.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:54 smithi063 ceph-mon[187282]: pgmap v177: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:56.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:55 smithi063 ceph-mon[187282]: pgmap v178: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:56.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:55 smithi093 ceph-mon[171709]: pgmap v178: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:58.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:58:58 smithi063 ceph-mon[187282]: pgmap v179: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:58:58.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:58:58 smithi093 ceph-mon[171709]: pgmap v179: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:00.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:00 smithi063 ceph-mon[187282]: pgmap v180: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:00.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:00 smithi093 ceph-mon[171709]: pgmap v180: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:02.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:02 smithi093 ceph-mon[171709]: pgmap v181: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:02.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:02 smithi063 ceph-mon[187282]: pgmap v181: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:04.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:04 smithi093 ceph-mon[171709]: pgmap v182: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:04.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:04 smithi063 ceph-mon[187282]: pgmap v182: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:06.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:05 smithi063 ceph-mon[187282]: pgmap v183: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:06.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:05 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:59:06.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:05 smithi093 ceph-mon[171709]: pgmap v183: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:06.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:05 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:59:08.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:08 smithi063 ceph-mon[187282]: pgmap v184: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:08.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:08 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:59:08.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:08 smithi093 ceph-mon[171709]: pgmap v184: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:08.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:08 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-12T11:59:09.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:09 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:59:09.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:09 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:59:09.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:09 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:59:09.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:09 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-12T11:59:09.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:09 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-12T11:59:09.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:09 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' 2023-12-12T11:59:10.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:10 smithi093 ceph-mon[171709]: pgmap v185: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:10.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:10 smithi063 ceph-mon[187282]: pgmap v185: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:12.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:12 smithi093 ceph-mon[171709]: pgmap v186: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:12.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:12 smithi063 ceph-mon[187282]: pgmap v186: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:14.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:14 smithi093 ceph-mon[171709]: pgmap v187: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:14.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:14 smithi063 ceph-mon[187282]: pgmap v187: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:16.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:15 smithi063 ceph-mon[187282]: pgmap v188: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:16.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:15 smithi093 ceph-mon[171709]: pgmap v188: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:18.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:18 smithi093 ceph-mon[171709]: pgmap v189: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:18.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:18 smithi063 ceph-mon[187282]: pgmap v189: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:20.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:20 smithi093 ceph-mon[171709]: pgmap v190: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:20.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:20 smithi063 ceph-mon[187282]: pgmap v190: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:21.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:21 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:59:21.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:21 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:59:22.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:22 smithi093 ceph-mon[171709]: pgmap v191: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:22.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:22 smithi063 ceph-mon[187282]: pgmap v191: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:24.440 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:24 smithi063 ceph-mon[187282]: pgmap v192: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:24.467 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -e sha1=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 -- bash -c 'ceph orch ps' 2023-12-12T11:59:24.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:24 smithi093 ceph-mon[171709]: pgmap v192: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:24.906 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:59:26.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.039+0000 7ff5fff15700 1 -- 172.21.15.63:0/1365789519 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5f8102c20 msgr2=0x7ff5f8102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:26.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.039+0000 7ff5fff15700 1 --2- 172.21.15.63:0/1365789519 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5f8102c20 0x7ff5f8102ff0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4004940 tx=0x7ff5f4009e30 comp rx=0 tx=0).stop 2023-12-12T11:59:26.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.039+0000 7ff5fff15700 1 -- 172.21.15.63:0/1365789519 shutdown_connections 2023-12-12T11:59:26.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.039+0000 7ff5fff15700 1 --2- 172.21.15.63:0/1365789519 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5f8065390 0x7ff5f8065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:26.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.039+0000 7ff5fff15700 1 --2- 172.21.15.63:0/1365789519 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5f8102c20 0x7ff5f8102ff0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:26.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.039+0000 7ff5fff15700 1 -- 172.21.15.63:0/1365789519 >> 172.21.15.63:0/1365789519 conn(0x7ff5f80719b0 msgr2=0x7ff5f8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:59:26.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.039+0000 7ff5fff15700 1 -- 172.21.15.63:0/1365789519 shutdown_connections 2023-12-12T11:59:26.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.039+0000 7ff5fff15700 1 -- 172.21.15.63:0/1365789519 wait complete. 2023-12-12T11:59:26.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.040+0000 7ff5fff15700 1 Processor -- start 2023-12-12T11:59:26.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.040+0000 7ff5fff15700 1 -- start start 2023-12-12T11:59:26.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.040+0000 7ff5fff15700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5f8065390 0x7ff5f8113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:26.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.040+0000 7ff5fff15700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5f8102c20 0x7ff5f8113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:26.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.040+0000 7ff5fff15700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f8114220 con 0x7ff5f8102c20 2023-12-12T11:59:26.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.040+0000 7ff5fff15700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f810d570 con 0x7ff5f8065390 2023-12-12T11:59:26.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.040+0000 7ff5fd4b0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5f8102c20 0x7ff5f8113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:26.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.041+0000 7ff5fd4b0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5f8102c20 0x7ff5f8113bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53354/0 (socket says 172.21.15.63:53354) 2023-12-12T11:59:26.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.041+0000 7ff5fd4b0700 1 -- 172.21.15.63:0/4291834629 learned_addr learned my addr 172.21.15.63:0/4291834629 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:59:26.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.041+0000 7ff5fd4b0700 1 -- 172.21.15.63:0/4291834629 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5f8065390 msgr2=0x7ff5f8113690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:26.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.041+0000 7ff5fdcb1700 1 --2- 172.21.15.63:0/4291834629 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5f8065390 0x7ff5f8113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:26.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.041+0000 7ff5fd4b0700 1 --2- 172.21.15.63:0/4291834629 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5f8065390 0x7ff5f8113690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:26.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.041+0000 7ff5fd4b0700 1 -- 172.21.15.63:0/4291834629 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f4005040 con 0x7ff5f8102c20 2023-12-12T11:59:26.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.041+0000 7ff5fdcb1700 1 --2- 172.21.15.63:0/4291834629 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5f8065390 0x7ff5f8113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T11:59:26.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.041+0000 7ff5fd4b0700 1 --2- 172.21.15.63:0/4291834629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5f8102c20 0x7ff5f8113bd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff5e800c8c0 tx=0x7ff5e80044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:59:26.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.041+0000 7ff5ee7fc700 1 -- 172.21.15.63:0/4291834629 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5e800a980 con 0x7ff5f8102c20 2023-12-12T11:59:26.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.041+0000 7ff5fff15700 1 -- 172.21.15.63:0/4291834629 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f810d850 con 0x7ff5f8102c20 2023-12-12T11:59:26.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.042+0000 7ff5ee7fc700 1 -- 172.21.15.63:0/4291834629 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff5e800ce60 con 0x7ff5f8102c20 2023-12-12T11:59:26.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.042+0000 7ff5ee7fc700 1 -- 172.21.15.63:0/4291834629 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5e801b400 con 0x7ff5f8102c20 2023-12-12T11:59:26.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.042+0000 7ff5fff15700 1 -- 172.21.15.63:0/4291834629 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f810dd90 con 0x7ff5f8102c20 2023-12-12T11:59:26.046 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:25 smithi063 ceph-mon[187282]: pgmap v193: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:26.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.043+0000 7ff5fff15700 1 -- 172.21.15.63:0/4291834629 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f80fff40 con 0x7ff5f8102c20 2023-12-12T11:59:26.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.044+0000 7ff5ee7fc700 1 -- 172.21.15.63:0/4291834629 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7ff5e801b560 con 0x7ff5f8102c20 2023-12-12T11:59:26.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.045+0000 7ff5ee7fc700 1 --2- 172.21.15.63:0/4291834629 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7ff5e406ce70 0x7ff5e406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:26.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.045+0000 7ff5ee7fc700 1 -- 172.21.15.63:0/4291834629 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6500+0+0 (secure 0 0 0) 0x7ff5e808c4a0 con 0x7ff5f8102c20 2023-12-12T11:59:26.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.045+0000 7ff5fdcb1700 1 --2- 172.21.15.63:0/4291834629 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7ff5e406ce70 0x7ff5e406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:26.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.046+0000 7ff5fdcb1700 1 --2- 172.21.15.63:0/4291834629 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7ff5e406ce70 0x7ff5e406f320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff5f400b840 tx=0x7ff5f4009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:59:26.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.050+0000 7ff5ee7fc700 1 -- 172.21.15.63:0/4291834629 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff5e8059ee0 con 0x7ff5f8102c20 2023-12-12T11:59:26.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:25 smithi093 ceph-mon[171709]: pgmap v193: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:26.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.270+0000 7ff5fff15700 1 -- 172.21.15.63:0/4291834629 --> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5f804bb80 con 0x7ff5e406ce70 2023-12-12T11:59:26.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.280+0000 7ff5ee7fc700 1 -- 172.21.15.63:0/4291834629 <== mgr.24663 v2:172.21.15.63:6800/1308705199 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7ff5f804bb80 con 0x7ff5e406ce70 2023-12-12T11:59:26.283 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-12T11:59:26.283 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (7m) 3m ago 14m 14.9M - 0.25.0 c8568f914cd2 f237d9f64783 2023-12-12T11:59:26.283 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (4m) 3m ago 15m 7838k - 19.0.0-96-gf1fbf3c5 8cf689f388db 202fa7506e7c 2023-12-12T11:59:26.283 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi093 smithi093 running (4m) 84s ago 14m 7852k - 19.0.0-96-gf1fbf3c5 8cf689f388db ac9d76320ce6 2023-12-12T11:59:26.283 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (7m) 3m ago 14m 78.5M - 9.4.7 954c08fa6188 51300a1a5b87 2023-12-12T11:59:26.283 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.aevpzg smithi063 running (10m) 3m ago 10m 10.5G - 17.2.7-123-gbef78a51 ae6196193935 df9a6781f836 2023-12-12T11:59:26.283 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.bdqbnp smithi063 running (10m) 3m ago 10m 15.6M - 17.2.7-123-gbef78a51 ae6196193935 0c7e1d21eee9 2023-12-12T11:59:26.284 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.rhaqsh smithi093 running (10m) 84s ago 10m 15.9M - 17.2.7-123-gbef78a51 ae6196193935 257aee771d87 2023-12-12T11:59:26.284 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi093.swdqms smithi093 running (10m) 84s ago 10m 15.9M - 17.2.7-123-gbef78a51 ae6196193935 f46d7173d3b1 2023-12-12T11:59:26.284 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.zjnfdi smithi063 *:8443,9283,8765 running (6m) 3m ago 16m 515M - 19.0.0-96-gf1fbf3c5 8cf689f388db dab6fa4aaa54 2023-12-12T11:59:26.284 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi093.nbtltu smithi093 *:8443,9283,8765 running (6m) 84s ago 14m 452M - 19.0.0-96-gf1fbf3c5 8cf689f388db 701529e7fa8e 2023-12-12T11:59:26.284 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (5m) 3m ago 16m 61.7M 2048M 19.0.0-96-gf1fbf3c5 8cf689f388db 11f12a2e88e4 2023-12-12T11:59:26.284 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi093 smithi093 running (5m) 84s ago 13m 51.7M 2048M 19.0.0-96-gf1fbf3c5 8cf689f388db 1ffc49fcd680 2023-12-12T11:59:26.284 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (7m) 3m ago 14m 8510k - 1.5.0 0da6a335fe13 8eed63374ddf 2023-12-12T11:59:26.284 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi093 smithi093 *:9100 running (6m) 84s ago 14m 8384k - 1.5.0 0da6a335fe13 10e19431c1a2 2023-12-12T11:59:26.284 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (4m) 3m ago 13m 131M 1618M 19.0.0-96-gf1fbf3c5 8cf689f388db fade55811ec1 2023-12-12T11:59:26.284 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (3m) 3m ago 13m 138M 1618M 19.0.0-96-gf1fbf3c5 8cf689f388db 733e6ff9e83d 2023-12-12T11:59:26.284 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (3m) 3m ago 12m 12.5M 1618M 19.0.0-96-gf1fbf3c5 8cf689f388db bc155cfbaf86 2023-12-12T11:59:26.284 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi093 running (2m) 84s ago 12m 148M 2642M 19.0.0-96-gf1fbf3c5 8cf689f388db 36b87923d47a 2023-12-12T11:59:26.284 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi093 running (119s) 84s ago 11m 131M 2642M 19.0.0-96-gf1fbf3c5 8cf689f388db accfb5d51d84 2023-12-12T11:59:26.284 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi093 running (87s) 84s ago 11m 12.0M 2642M 19.0.0-96-gf1fbf3c5 8cf689f388db 3f1f7e0448b5 2023-12-12T11:59:26.284 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (6m) 3m ago 14m 48.2M - 2.43.0 a07b618ecd1d 834d9fc4eb61 2023-12-12T11:59:26.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.282+0000 7ff5fff15700 1 -- 172.21.15.63:0/4291834629 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7ff5e406ce70 msgr2=0x7ff5e406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:26.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.282+0000 7ff5fff15700 1 --2- 172.21.15.63:0/4291834629 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7ff5e406ce70 0x7ff5e406f320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff5f400b840 tx=0x7ff5f4009e30 comp rx=0 tx=0).stop 2023-12-12T11:59:26.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.282+0000 7ff5fff15700 1 -- 172.21.15.63:0/4291834629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5f8102c20 msgr2=0x7ff5f8113bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:26.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.282+0000 7ff5fff15700 1 --2- 172.21.15.63:0/4291834629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5f8102c20 0x7ff5f8113bd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff5e800c8c0 tx=0x7ff5e80044c0 comp rx=0 tx=0).stop 2023-12-12T11:59:26.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.283+0000 7ff5fff15700 1 -- 172.21.15.63:0/4291834629 shutdown_connections 2023-12-12T11:59:26.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.283+0000 7ff5fff15700 1 --2- 172.21.15.63:0/4291834629 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7ff5e406ce70 0x7ff5e406f320 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:26.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.283+0000 7ff5fff15700 1 --2- 172.21.15.63:0/4291834629 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5f8065390 0x7ff5f8113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:26.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.283+0000 7ff5fff15700 1 --2- 172.21.15.63:0/4291834629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5f8102c20 0x7ff5f8113bd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:26.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.283+0000 7ff5fff15700 1 -- 172.21.15.63:0/4291834629 >> 172.21.15.63:0/4291834629 conn(0x7ff5f80719b0 msgr2=0x7ff5f80fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:59:26.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.283+0000 7ff5fff15700 1 -- 172.21.15.63:0/4291834629 shutdown_connections 2023-12-12T11:59:26.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:26.283+0000 7ff5fff15700 1 -- 172.21.15.63:0/4291834629 wait complete. 2023-12-12T11:59:26.642 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -e sha1=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 -- bash -c 'ceph versions' 2023-12-12T11:59:27.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:26 smithi063 ceph-mon[187282]: from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:59:27.082 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:59:27.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:26 smithi093 ceph-mon[171709]: from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-12T11:59:28.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:27 smithi063 ceph-mon[187282]: pgmap v194: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:28.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:27 smithi093 ceph-mon[171709]: pgmap v194: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:28.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.389+0000 7fe26759e700 1 -- 172.21.15.63:0/1722762476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2680fda40 msgr2=0x7fe2680fde10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:28.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.389+0000 7fe26759e700 1 --2- 172.21.15.63:0/1722762476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2680fda40 0x7fe2680fde10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe258004940 tx=0x7fe258009e30 comp rx=0 tx=0).stop 2023-12-12T11:59:28.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.389+0000 7fe26759e700 1 -- 172.21.15.63:0/1722762476 shutdown_connections 2023-12-12T11:59:28.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.389+0000 7fe26759e700 1 --2- 172.21.15.63:0/1722762476 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2680fe3e0 0x7fe268106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:28.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.389+0000 7fe26759e700 1 --2- 172.21.15.63:0/1722762476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2680fda40 0x7fe2680fde10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:28.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.389+0000 7fe26759e700 1 -- 172.21.15.63:0/1722762476 >> 172.21.15.63:0/1722762476 conn(0x7fe2680f74d0 msgr2=0x7fe2680f98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:59:28.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.389+0000 7fe26759e700 1 -- 172.21.15.63:0/1722762476 shutdown_connections 2023-12-12T11:59:28.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.389+0000 7fe26759e700 1 -- 172.21.15.63:0/1722762476 wait complete. 2023-12-12T11:59:28.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.390+0000 7fe26759e700 1 Processor -- start 2023-12-12T11:59:28.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.391+0000 7fe26759e700 1 -- start start 2023-12-12T11:59:28.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.391+0000 7fe26759e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2680fda40 0x7fe268113450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:28.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.391+0000 7fe26759e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2680fe3e0 0x7fe268113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:28.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.391+0000 7fe26759e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe268113fe0 con 0x7fe2680fe3e0 2023-12-12T11:59:28.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.391+0000 7fe26759e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26810d330 con 0x7fe2680fda40 2023-12-12T11:59:28.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.391+0000 7fe265d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2680fe3e0 0x7fe268113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:28.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.391+0000 7fe265d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2680fe3e0 0x7fe268113990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42380/0 (socket says 172.21.15.63:42380) 2023-12-12T11:59:28.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.392+0000 7fe265d9b700 1 -- 172.21.15.63:0/41003256 learned_addr learned my addr 172.21.15.63:0/41003256 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:59:28.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.392+0000 7fe26659c700 1 --2- 172.21.15.63:0/41003256 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2680fda40 0x7fe268113450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:28.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.392+0000 7fe265d9b700 1 -- 172.21.15.63:0/41003256 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2680fda40 msgr2=0x7fe268113450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:28.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.392+0000 7fe265d9b700 1 --2- 172.21.15.63:0/41003256 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2680fda40 0x7fe268113450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:28.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.392+0000 7fe265d9b700 1 -- 172.21.15.63:0/41003256 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe258005040 con 0x7fe2680fe3e0 2023-12-12T11:59:28.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.392+0000 7fe265d9b700 1 --2- 172.21.15.63:0/41003256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2680fe3e0 0x7fe268113990 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe25c00c8c0 tx=0x7fe25c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:59:28.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.392+0000 7fe256ffd700 1 -- 172.21.15.63:0/41003256 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe25c00a760 con 0x7fe2680fe3e0 2023-12-12T11:59:28.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.392+0000 7fe256ffd700 1 -- 172.21.15.63:0/41003256 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe25c00ad70 con 0x7fe2680fe3e0 2023-12-12T11:59:28.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.392+0000 7fe26759e700 1 -- 172.21.15.63:0/41003256 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe26810d610 con 0x7fe2680fe3e0 2023-12-12T11:59:28.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.392+0000 7fe256ffd700 1 -- 172.21.15.63:0/41003256 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe25c0113a0 con 0x7fe2680fe3e0 2023-12-12T11:59:28.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.393+0000 7fe26759e700 1 -- 172.21.15.63:0/41003256 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe26810db50 con 0x7fe2680fe3e0 2023-12-12T11:59:28.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.394+0000 7fe26759e700 1 -- 172.21.15.63:0/41003256 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe268104030 con 0x7fe2680fe3e0 2023-12-12T11:59:28.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.395+0000 7fe256ffd700 1 -- 172.21.15.63:0/41003256 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fe25c012400 con 0x7fe2680fe3e0 2023-12-12T11:59:28.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.395+0000 7fe256ffd700 1 --2- 172.21.15.63:0/41003256 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe25006ce70 0x7fe25006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:28.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.396+0000 7fe256ffd700 1 -- 172.21.15.63:0/41003256 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fe25c08c320 con 0x7fe2680fe3e0 2023-12-12T11:59:28.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.396+0000 7fe26659c700 1 --2- 172.21.15.63:0/41003256 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe25006ce70 0x7fe25006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:28.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.396+0000 7fe26659c700 1 --2- 172.21.15.63:0/41003256 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe25006ce70 0x7fe25006f320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe258009fd0 tx=0x7fe258009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:59:28.403 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.400+0000 7fe256ffd700 1 -- 172.21.15.63:0/41003256 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe25c056200 con 0x7fe2680fe3e0 2023-12-12T11:59:28.702 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.699+0000 7fe26759e700 1 -- 172.21.15.63:0/41003256 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe26804bb80 con 0x7fe2680fe3e0 2023-12-12T11:59:28.702 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.700+0000 7fe256ffd700 1 -- 172.21.15.63:0/41003256 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+721 (secure 0 0 0) 0x7fe25c059820 con 0x7fe2680fe3e0 2023-12-12T11:59:28.702 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-12T11:59:28.703 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-12T11:59:28.703 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 2 2023-12-12T11:59:28.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:59:28.703 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-12T11:59:28.703 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 2 2023-12-12T11:59:28.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:59:28.703 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-12T11:59:28.703 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 6 2023-12-12T11:59:28.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:59:28.703 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-12T11:59:28.703 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 4 2023-12-12T11:59:28.704 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-12T11:59:28.704 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-12T11:59:28.704 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-123-gbef78a51 (bef78a51880cb7d25e258a6b00c26898788a1958) quincy (stable)": 4, 2023-12-12T11:59:28.704 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)": 10 2023-12-12T11:59:28.704 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-12T11:59:28.704 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-12T11:59:28.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.702+0000 7fe26759e700 1 -- 172.21.15.63:0/41003256 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe25006ce70 msgr2=0x7fe25006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:28.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.702+0000 7fe26759e700 1 --2- 172.21.15.63:0/41003256 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe25006ce70 0x7fe25006f320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe258009fd0 tx=0x7fe258009e30 comp rx=0 tx=0).stop 2023-12-12T11:59:28.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.702+0000 7fe26759e700 1 -- 172.21.15.63:0/41003256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2680fe3e0 msgr2=0x7fe268113990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:28.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.702+0000 7fe26759e700 1 --2- 172.21.15.63:0/41003256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2680fe3e0 0x7fe268113990 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe25c00c8c0 tx=0x7fe25c0044c0 comp rx=0 tx=0).stop 2023-12-12T11:59:28.706 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.702+0000 7fe26759e700 1 -- 172.21.15.63:0/41003256 shutdown_connections 2023-12-12T11:59:28.706 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.702+0000 7fe26759e700 1 --2- 172.21.15.63:0/41003256 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe25006ce70 0x7fe25006f320 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:28.706 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.702+0000 7fe26759e700 1 --2- 172.21.15.63:0/41003256 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2680fda40 0x7fe268113450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:28.706 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.702+0000 7fe26759e700 1 --2- 172.21.15.63:0/41003256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2680fe3e0 0x7fe268113990 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:28.706 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.702+0000 7fe26759e700 1 -- 172.21.15.63:0/41003256 >> 172.21.15.63:0/41003256 conn(0x7fe2680f74d0 msgr2=0x7fe2681011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:59:28.706 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.703+0000 7fe26759e700 1 -- 172.21.15.63:0/41003256 shutdown_connections 2023-12-12T11:59:28.706 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:28.703+0000 7fe26759e700 1 -- 172.21.15.63:0/41003256 wait complete. 2023-12-12T11:59:29.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:28 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/41003256' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:59:29.099 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -e sha1=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2023-12-12T11:59:29.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:28 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/41003256' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:59:29.540 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/mon.smithi063/config 2023-12-12T11:59:30.044 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:29 smithi063 ceph-mon[187282]: pgmap v195: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:30.221 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:29 smithi093 ceph-mon[171709]: pgmap v195: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:30.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.722+0000 7fb2f925b700 1 -- 172.21.15.63:0/3895815942 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2f4102c00 msgr2=0x7fb2f4102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:30.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.722+0000 7fb2f925b700 1 --2- 172.21.15.63:0/3895815942 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2f4102c00 0x7fb2f4102fd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4004940 tx=0x7fb2e4009e30 comp rx=0 tx=0).stop 2023-12-12T11:59:30.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.722+0000 7fb2f925b700 1 -- 172.21.15.63:0/3895815942 shutdown_connections 2023-12-12T11:59:30.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.722+0000 7fb2f925b700 1 --2- 172.21.15.63:0/3895815942 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2f41035a0 0x7fb2f40fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:30.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.722+0000 7fb2f925b700 1 --2- 172.21.15.63:0/3895815942 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2f4102c00 0x7fb2f4102fd0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:30.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.722+0000 7fb2f925b700 1 -- 172.21.15.63:0/3895815942 >> 172.21.15.63:0/3895815942 conn(0x7fb2f40f8790 msgr2=0x7fb2f40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:59:30.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.722+0000 7fb2f925b700 1 -- 172.21.15.63:0/3895815942 shutdown_connections 2023-12-12T11:59:30.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.722+0000 7fb2f925b700 1 -- 172.21.15.63:0/3895815942 wait complete. 2023-12-12T11:59:30.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.723+0000 7fb2f925b700 1 Processor -- start 2023-12-12T11:59:30.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.723+0000 7fb2f925b700 1 -- start start 2023-12-12T11:59:30.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.723+0000 7fb2f925b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2f4102c00 0x7fb2f4115850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:30.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.723+0000 7fb2f925b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2f41035a0 0x7fb2f4115d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:30.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.723+0000 7fb2f925b700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f41163e0 con 0x7fb2f4102c00 2023-12-12T11:59:30.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.723+0000 7fb2f925b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f410f710 con 0x7fb2f41035a0 2023-12-12T11:59:30.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.724+0000 7fb2f2d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2f4102c00 0x7fb2f4115850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:30.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.724+0000 7fb2f2d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2f4102c00 0x7fb2f4115850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42386/0 (socket says 172.21.15.63:42386) 2023-12-12T11:59:30.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.724+0000 7fb2f2d9d700 1 -- 172.21.15.63:0/335559384 learned_addr learned my addr 172.21.15.63:0/335559384 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:59:30.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.724+0000 7fb2f259c700 1 --2- 172.21.15.63:0/335559384 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2f41035a0 0x7fb2f4115d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:30.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.724+0000 7fb2f2d9d700 1 -- 172.21.15.63:0/335559384 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2f41035a0 msgr2=0x7fb2f4115d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:30.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.724+0000 7fb2f2d9d700 1 --2- 172.21.15.63:0/335559384 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2f41035a0 0x7fb2f4115d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:30.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.724+0000 7fb2f2d9d700 1 -- 172.21.15.63:0/335559384 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e4005040 con 0x7fb2f4102c00 2023-12-12T11:59:30.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.724+0000 7fb2f2d9d700 1 --2- 172.21.15.63:0/335559384 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2f4102c00 0x7fb2f4115850 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009360 tx=0x7fb2e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:59:30.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.724+0000 7fb2db7fe700 1 -- 172.21.15.63:0/335559384 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2e400e040 con 0x7fb2f4102c00 2023-12-12T11:59:30.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.724+0000 7fb2db7fe700 1 -- 172.21.15.63:0/335559384 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb2e400bc50 con 0x7fb2f4102c00 2023-12-12T11:59:30.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.724+0000 7fb2db7fe700 1 -- 172.21.15.63:0/335559384 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2e401c630 con 0x7fb2f4102c00 2023-12-12T11:59:30.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.725+0000 7fb2f925b700 1 -- 172.21.15.63:0/335559384 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f410f990 con 0x7fb2f4102c00 2023-12-12T11:59:30.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.725+0000 7fb2f925b700 1 -- 172.21.15.63:0/335559384 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f410fed0 con 0x7fb2f4102c00 2023-12-12T11:59:30.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.726+0000 7fb2f925b700 1 -- 172.21.15.63:0/335559384 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f40fc390 con 0x7fb2f4102c00 2023-12-12T11:59:30.730 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.727+0000 7fb2db7fe700 1 -- 172.21.15.63:0/335559384 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fb2e4013420 con 0x7fb2f4102c00 2023-12-12T11:59:30.730 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.728+0000 7fb2db7fe700 1 --2- 172.21.15.63:0/335559384 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fb2dc06ce70 0x7fb2dc06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:30.730 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.728+0000 7fb2db7fe700 1 -- 172.21.15.63:0/335559384 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fb2e408d5d0 con 0x7fb2f4102c00 2023-12-12T11:59:30.731 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.728+0000 7fb2f259c700 1 --2- 172.21.15.63:0/335559384 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fb2dc06ce70 0x7fb2dc06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:30.731 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.729+0000 7fb2f259c700 1 --2- 172.21.15.63:0/335559384 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fb2dc06ce70 0x7fb2dc06f320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4111080 tx=0x7fb2e8009ee0 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:59:30.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:30.732+0000 7fb2db7fe700 1 -- 172.21.15.63:0/335559384 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fb2e405af40 con 0x7fb2f4102c00 2023-12-12T11:59:31.028 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.026+0000 7fb2f925b700 1 -- 172.21.15.63:0/335559384 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb2f4110e30 con 0x7fb2f4102c00 2023-12-12T11:59:31.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.026+0000 7fb2db7fe700 1 -- 172.21.15.63:0/335559384 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+721 (secure 0 0 0) 0x7fb2e405aad0 con 0x7fb2f4102c00 2023-12-12T11:59:31.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.029+0000 7fb2f925b700 1 -- 172.21.15.63:0/335559384 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fb2dc06ce70 msgr2=0x7fb2dc06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:31.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.029+0000 7fb2f925b700 1 --2- 172.21.15.63:0/335559384 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fb2dc06ce70 0x7fb2dc06f320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4111080 tx=0x7fb2e8009ee0 comp rx=0 tx=0).stop 2023-12-12T11:59:31.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.029+0000 7fb2f925b700 1 -- 172.21.15.63:0/335559384 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2f4102c00 msgr2=0x7fb2f4115850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:31.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.029+0000 7fb2f925b700 1 --2- 172.21.15.63:0/335559384 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2f4102c00 0x7fb2f4115850 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009360 tx=0x7fb2e4009e30 comp rx=0 tx=0).stop 2023-12-12T11:59:31.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.029+0000 7fb2f925b700 1 -- 172.21.15.63:0/335559384 shutdown_connections 2023-12-12T11:59:31.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.029+0000 7fb2f925b700 1 --2- 172.21.15.63:0/335559384 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fb2dc06ce70 0x7fb2dc06f320 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:31.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.029+0000 7fb2f925b700 1 --2- 172.21.15.63:0/335559384 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2f4102c00 0x7fb2f4115850 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:31.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.029+0000 7fb2f925b700 1 --2- 172.21.15.63:0/335559384 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2f41035a0 0x7fb2f4115d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:31.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.029+0000 7fb2f925b700 1 -- 172.21.15.63:0/335559384 >> 172.21.15.63:0/335559384 conn(0x7fb2f40f8790 msgr2=0x7fb2f40fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:59:31.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.029+0000 7fb2f925b700 1 -- 172.21.15.63:0/335559384 shutdown_connections 2023-12-12T11:59:31.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.029+0000 7fb2f925b700 1 -- 172.21.15.63:0/335559384 wait complete. 2023-12-12T11:59:31.046 INFO:teuthology.orchestra.run.smithi063.stdout:false 2023-12-12T11:59:31.399 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:31 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/335559384' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:59:31.422 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T11:59:31.422 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks/cephadm.py", line 1351, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks/cephadm.py", line 40, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -e sha1=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-12-12T11:59:31.520 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=ff990d3c08d34f4f87d491753742ea65 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks/cephadm.py", line 1351, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks/cephadm.py", line 40, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -e sha1=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-12-12T11:59:31.524 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-12T11:59:31.536 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-12T11:59:31.536 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-12T11:59:31.536 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T11:59:31.552 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:31 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/335559384' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-12T11:59:31.601 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-12T11:59:31.601 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T11:59:31.689 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T11:59:31.930 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.927+0000 7f419b59e700 1 -- 172.21.15.63:0/2290296356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f419c0fc980 msgr2=0x7f419c0fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:31.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.927+0000 7f419b59e700 1 --2- 172.21.15.63:0/2290296356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f419c0fc980 0x7f419c0fcdf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4190004940 tx=0x7f4190009e30 comp rx=0 tx=0).stop 2023-12-12T11:59:31.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.927+0000 7f419b59e700 1 -- 172.21.15.63:0/2290296356 shutdown_connections 2023-12-12T11:59:31.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.927+0000 7f419b59e700 1 --2- 172.21.15.63:0/2290296356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f419c0fc980 0x7f419c0fcdf0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:31.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.927+0000 7f419b59e700 1 --2- 172.21.15.63:0/2290296356 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f419c1029c0 0x7f419c102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:31.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.927+0000 7f419b59e700 1 -- 172.21.15.63:0/2290296356 >> 172.21.15.63:0/2290296356 conn(0x7f419c0f84e0 msgr2=0x7f419c0fa8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:59:31.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.928+0000 7f419b59e700 1 -- 172.21.15.63:0/2290296356 shutdown_connections 2023-12-12T11:59:31.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.928+0000 7f419b59e700 1 -- 172.21.15.63:0/2290296356 wait complete. 2023-12-12T11:59:31.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.929+0000 7f419b59e700 1 Processor -- start 2023-12-12T11:59:31.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.929+0000 7f419b59e700 1 -- start start 2023-12-12T11:59:31.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.929+0000 7f419b59e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f419c0fc980 0x7f419c06ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:31.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.929+0000 7f419b59e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f419c1029c0 0x7f419c070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.929+0000 7f419b59e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419c0709c0 con 0x7f419c0fc980 2023-12-12T11:59:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.929+0000 7f419b59e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419c070b00 con 0x7f419c1029c0 2023-12-12T11:59:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.929+0000 7f419a59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f419c0fc980 0x7f419c06ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.930+0000 7f419a59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f419c0fc980 0x7f419c06ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42396/0 (socket says 172.21.15.63:42396) 2023-12-12T11:59:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.930+0000 7f419a59c700 1 -- 172.21.15.63:0/3572147264 learned_addr learned my addr 172.21.15.63:0/3572147264 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:59:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.930+0000 7f4199d9b700 1 --2- 172.21.15.63:0/3572147264 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f419c1029c0 0x7f419c070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.930+0000 7f419a59c700 1 -- 172.21.15.63:0/3572147264 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f419c1029c0 msgr2=0x7f419c070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.930+0000 7f419a59c700 1 --2- 172.21.15.63:0/3572147264 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f419c1029c0 0x7f419c070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.930+0000 7f419a59c700 1 -- 172.21.15.63:0/3572147264 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4190005040 con 0x7f419c0fc980 2023-12-12T11:59:31.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.930+0000 7f419a59c700 1 --2- 172.21.15.63:0/3572147264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f419c0fc980 0x7f419c06ff40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f418c002a50 tx=0x7f418c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:59:31.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.930+0000 7f418affd700 1 -- 172.21.15.63:0/3572147264 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f418c007cc0 con 0x7f419c0fc980 2023-12-12T11:59:31.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.930+0000 7f418affd700 1 -- 172.21.15.63:0/3572147264 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f418c00f040 con 0x7f419c0fc980 2023-12-12T11:59:31.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.930+0000 7f419b59e700 1 -- 172.21.15.63:0/3572147264 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f419c1195e0 con 0x7f419c0fc980 2023-12-12T11:59:31.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.930+0000 7f418affd700 1 -- 172.21.15.63:0/3572147264 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f418c00da70 con 0x7f419c0fc980 2023-12-12T11:59:31.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.931+0000 7f419b59e700 1 -- 172.21.15.63:0/3572147264 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f419c119930 con 0x7f419c0fc980 2023-12-12T11:59:31.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.932+0000 7f419b59e700 1 -- 172.21.15.63:0/3572147264 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f419c104e40 con 0x7f419c0fc980 2023-12-12T11:59:31.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.933+0000 7f418affd700 1 -- 172.21.15.63:0/3572147264 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f418c00dc10 con 0x7f419c0fc980 2023-12-12T11:59:31.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.934+0000 7f418affd700 1 --2- 172.21.15.63:0/3572147264 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f418406ce70 0x7f418406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:31.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.934+0000 7f418affd700 1 -- 172.21.15.63:0/3572147264 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f418c08baf0 con 0x7f419c0fc980 2023-12-12T11:59:31.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.934+0000 7f4199d9b700 1 --2- 172.21.15.63:0/3572147264 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f418406ce70 0x7f418406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:31.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.934+0000 7f4199d9b700 1 --2- 172.21.15.63:0/3572147264 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f418406ce70 0x7f418406f320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f419000b020 tx=0x7f4190009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:59:31.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:31.938+0000 7f418affd700 1 -- 172.21.15.63:0/3572147264 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f418c0558d0 con 0x7f419c0fc980 2023-12-12T11:59:32.152 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.149+0000 7f419b59e700 1 -- 172.21.15.63:0/3572147264 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f419c04c3c0 con 0x7f419c0fc980 2023-12-12T11:59:32.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.150+0000 7f418affd700 1 -- 172.21.15.63:0/3572147264 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+16502 (secure 0 0 0) 0x7f418c058ef0 con 0x7f419c0fc980 2023-12-12T11:59:32.153 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:59:32.153 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":79,"fsid":"85e33c70-98e3-11ee-95a3-87774f69a715","created":"2023-12-12T11:43:06.421058+0000","modified":"2023-12-12T11:58:07.764909+0000","last_up_change":"2023-12-12T11:58:06.762951+0000","last_in_change":"2023-12-12T11:47:44.737839+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T11:46:58.373192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-12T11:48:57.216360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-12T11:48:58.039176+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6b09da78-38a4-46a4-bf22-b1d21103b497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4193564418},{"type":"v1","addr":"172.21.15.63:6803","nonce":4193564418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":4193564418},{"type":"v1","addr":"172.21.15.63:6805","nonce":4193564418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":4193564418},{"type":"v1","addr":"172.21.15.63:6809","nonce":4193564418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4193564418},{"type":"v1","addr":"172.21.15.63:6807","nonce":4193564418}]},"public_addr":"172.21.15.63:6803/4193564418","cluster_addr":"172.21.15.63:6805/4193564418","heartbeat_back_addr":"172.21.15.63:6809/4193564418","heartbeat_front_addr":"172.21.15.63:6807/4193564418","state":["exists","up"]},{"osd":1,"uuid":"b45154ac-c018-4aa6-89d4-f22bd94b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":392040058},{"type":"v1","addr":"172.21.15.63:6811","nonce":392040058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":392040058},{"type":"v1","addr":"172.21.15.63:6813","nonce":392040058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":392040058},{"type":"v1","addr":"172.21.15.63:6817","nonce":392040058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":392040058},{"type":"v1","addr":"172.21.15.63:6815","nonce":392040058}]},"public_addr":"172.21.15.63:6811/392040058","cluster_addr":"172.21.15.63:6813/392040058","heartbeat_back_addr":"172.21.15.63:6817/392040058","heartbeat_front_addr":"172.21.15.63:6815/392040058","state":["exists","up"]},{"osd":2,"uuid":"2fcdfc7f-334e-427a-8e1e-b95578c88db5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2611117524},{"type":"v1","addr":"172.21.15.63:6819","nonce":2611117524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":2611117524},{"type":"v1","addr":"172.21.15.63:6821","nonce":2611117524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":2611117524},{"type":"v1","addr":"172.21.15.63:6825","nonce":2611117524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2611117524},{"type":"v1","addr":"172.21.15.63:6823","nonce":2611117524}]},"public_addr":"172.21.15.63:6819/2611117524","cluster_addr":"172.21.15.63:6821/2611117524","heartbeat_back_addr":"172.21.15.63:6825/2611117524","heartbeat_front_addr":"172.21.15.63:6823/2611117524","state":["exists","up"]},{"osd":3,"uuid":"79666eff-9c6a-4170-b1b6-9fee68b62865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2608957664},{"type":"v1","addr":"172.21.15.93:6801","nonce":2608957664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2608957664},{"type":"v1","addr":"172.21.15.93:6803","nonce":2608957664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2608957664},{"type":"v1","addr":"172.21.15.93:6807","nonce":2608957664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2608957664},{"type":"v1","addr":"172.21.15.93:6805","nonce":2608957664}]},"public_addr":"172.21.15.93:6801/2608957664","cluster_addr":"172.21.15.93:6803/2608957664","heartbeat_back_addr":"172.21.15.93:6807/2608957664","heartbeat_front_addr":"172.21.15.93:6805/2608957664","state":["exists","up"]},{"osd":4,"uuid":"af069a18-59ca-4e55-a09c-9d4be6e10cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":1202130659},{"type":"v1","addr":"172.21.15.93:6809","nonce":1202130659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":1202130659},{"type":"v1","addr":"172.21.15.93:6811","nonce":1202130659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":1202130659},{"type":"v1","addr":"172.21.15.93:6815","nonce":1202130659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1202130659},{"type":"v1","addr":"172.21.15.93:6813","nonce":1202130659}]},"public_addr":"172.21.15.93:6809/1202130659","cluster_addr":"172.21.15.93:6811/1202130659","heartbeat_back_addr":"172.21.15.93:6815/1202130659","heartbeat_front_addr":"172.21.15.93:6813/1202130659","state":["exists","up"]},{"osd":5,"uuid":"66901eb6-442c-4808-a5d3-958fd4b8f18d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":4114052086},{"type":"v1","addr":"172.21.15.93:6817","nonce":4114052086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":4114052086},{"type":"v1","addr":"172.21.15.93:6819","nonce":4114052086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":4114052086},{"type":"v1","addr":"172.21.15.93:6823","nonce":4114052086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":4114052086},{"type":"v1","addr":"172.21.15.93:6821","nonce":4114052086}]},"public_addr":"172.21.15.93:6817/4114052086","cluster_addr":"172.21.15.93:6819/4114052086","heartbeat_back_addr":"172.21.15.93:6823/4114052086","heartbeat_front_addr":"172.21.15.93:6821/4114052086","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:46:08.420691+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:46:31.277938+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:46:54.903181+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:47:16.535347+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:47:38.988069+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:48:01.641629+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:6801/368827847":"2023-12-13T11:54:05.314973+0000","172.21.15.63:6800/368827847":"2023-12-13T11:54:05.314973+0000","172.21.15.93:6828/3441331233":"2023-12-13T11:52:56.821857+0000","172.21.15.63:6801/4048286824":"2023-12-13T11:44:08.715291+0000","172.21.15.63:0/2270429505":"2023-12-13T11:44:08.715291+0000","172.21.15.63:6826/2809808942":"2023-12-13T11:49:11.105112+0000","172.21.15.93:0/1057256486":"2023-12-13T11:52:56.821857+0000","172.21.15.63:0/3710081653":"2023-12-13T11:51:36.889322+0000","172.21.15.63:6800/1972453923":"2023-12-13T11:43:38.661897+0000","172.21.15.63:0/90805296":"2023-12-13T11:43:38.661897+0000","172.21.15.63:0/1747856225":"2023-12-13T11:51:36.889322+0000","172.21.15.63:6800/3841315087":"2023-12-13T11:51:36.889322+0000","172.21.15.63:0/1972560506":"2023-12-13T11:45:05.780140+0000","172.21.15.63:0/3524404486":"2023-12-13T11:43:38.661897+0000","172.21.15.63:6801/1972453923":"2023-12-13T11:43:38.661897+0000","172.21.15.93:0/343118333":"2023-12-13T11:52:56.821857+0000","172.21.15.63:6827/2809808942":"2023-12-13T11:49:11.105112+0000","172.21.15.63:0/510113990":"2023-12-13T11:54:05.314973+0000","172.21.15.93:6829/3441331233":"2023-12-13T11:52:56.821857+0000","172.21.15.63:6801/3841315087":"2023-12-13T11:51:36.889322+0000","172.21.15.63:0/1089809755":"2023-12-13T11:43:38.661897+0000","172.21.15.63:0/2339917683":"2023-12-13T11:54:05.314973+0000","172.21.15.93:0/707715378":"2023-12-13T11:52:56.821857+0000","172.21.15.63:0/49274924":"2023-12-13T11:54:05.314973+0000","172.21.15.63:0/2015988516":"2023-12-13T11:45:05.780140+0000","172.21.15.63:0/2136521491":"2023-12-13T11:51:36.889322+0000","172.21.15.63:0/1443572827":"2023-12-13T11:45:05.780140+0000","172.21.15.63:6800/4048286824":"2023-12-13T11:44:08.715291+0000","172.21.15.63:0/545666177":"2023-12-13T11:44:08.715291+0000","172.21.15.63:0/2550373170":"2023-12-13T11:51:36.889322+0000","172.21.15.63:0/1601381023":"2023-12-13T11:44:08.715291+0000","172.21.15.93:0/4241774739":"2023-12-13T11:52:56.821857+0000","172.21.15.93:0/3779305150":"2023-12-13T11:52:56.821857+0000","172.21.15.93:0/3098682321":"2023-12-13T11:52:56.821857+0000","172.21.15.63:6800/293571324":"2023-12-13T11:45:05.780140+0000","172.21.15.63:0/1083892159":"2023-12-13T11:54:05.314973+0000","172.21.15.63:0/1222084055":"2023-12-13T11:54:05.314973+0000","172.21.15.63:6801/293571324":"2023-12-13T11:45:05.780140+0000","172.21.15.63:0/2627081339":"2023-12-13T11:54:05.314973+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T11:59:32.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.153+0000 7f419b59e700 1 -- 172.21.15.63:0/3572147264 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f418406ce70 msgr2=0x7f418406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:32.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.153+0000 7f419b59e700 1 --2- 172.21.15.63:0/3572147264 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f418406ce70 0x7f418406f320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f419000b020 tx=0x7f4190009e30 comp rx=0 tx=0).stop 2023-12-12T11:59:32.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.153+0000 7f419b59e700 1 -- 172.21.15.63:0/3572147264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f419c0fc980 msgr2=0x7f419c06ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:32.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.153+0000 7f419b59e700 1 --2- 172.21.15.63:0/3572147264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f419c0fc980 0x7f419c06ff40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f418c002a50 tx=0x7f418c0046b0 comp rx=0 tx=0).stop 2023-12-12T11:59:32.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.153+0000 7f419b59e700 1 -- 172.21.15.63:0/3572147264 shutdown_connections 2023-12-12T11:59:32.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.153+0000 7f419b59e700 1 --2- 172.21.15.63:0/3572147264 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f418406ce70 0x7f418406f320 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:32.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.153+0000 7f419b59e700 1 --2- 172.21.15.63:0/3572147264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f419c0fc980 0x7f419c06ff40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:32.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.153+0000 7f419b59e700 1 --2- 172.21.15.63:0/3572147264 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f419c1029c0 0x7f419c070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:32.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.153+0000 7f419b59e700 1 -- 172.21.15.63:0/3572147264 >> 172.21.15.63:0/3572147264 conn(0x7f419c0f84e0 msgr2=0x7f419c0fa030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:59:32.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.153+0000 7f419b59e700 1 -- 172.21.15.63:0/3572147264 shutdown_connections 2023-12-12T11:59:32.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.153+0000 7f419b59e700 1 -- 172.21.15.63:0/3572147264 wait complete. 2023-12-12T11:59:32.174 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T11:46:58.373192+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-12T11:48:57.216360+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-12T11:48:58.039176+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T11:59:32.175 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T11:59:32.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.376+0000 7f0bca3ff700 1 -- 172.21.15.63:0/3702790325 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0bc41034e0 msgr2=0x7f0bc40fcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:32.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.376+0000 7f0bca3ff700 1 --2- 172.21.15.63:0/3702790325 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0bc41034e0 0x7f0bc40fcb50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8004940 tx=0x7f0bb8009e30 comp rx=0 tx=0).stop 2023-12-12T11:59:32.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.377+0000 7f0bca3ff700 1 -- 172.21.15.63:0/3702790325 shutdown_connections 2023-12-12T11:59:32.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.377+0000 7f0bca3ff700 1 --2- 172.21.15.63:0/3702790325 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0bc41034e0 0x7f0bc40fcb50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:32.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.377+0000 7f0bca3ff700 1 --2- 172.21.15.63:0/3702790325 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0bc4102b40 0x7f0bc4102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:32.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.377+0000 7f0bca3ff700 1 -- 172.21.15.63:0/3702790325 >> 172.21.15.63:0/3702790325 conn(0x7f0bc40f86d0 msgr2=0x7f0bc40faae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:59:32.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.377+0000 7f0bca3ff700 1 -- 172.21.15.63:0/3702790325 shutdown_connections 2023-12-12T11:59:32.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.377+0000 7f0bca3ff700 1 -- 172.21.15.63:0/3702790325 wait complete. 2023-12-12T11:59:32.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.378+0000 7f0bca3ff700 1 Processor -- start 2023-12-12T11:59:32.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.378+0000 7f0bca3ff700 1 -- start start 2023-12-12T11:59:32.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.379+0000 7f0bca3ff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0bc4102b40 0x7f0bc4113300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:32.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.379+0000 7f0bca3ff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0bc41034e0 0x7f0bc4113840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:32.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.379+0000 7f0bca3ff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc4113e90 con 0x7f0bc41034e0 2023-12-12T11:59:32.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.379+0000 7f0bca3ff700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc410d3b0 con 0x7f0bc4102b40 2023-12-12T11:59:32.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.379+0000 7f0bc37fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0bc41034e0 0x7f0bc4113840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:32.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.379+0000 7f0bc37fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0bc41034e0 0x7f0bc4113840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42424/0 (socket says 172.21.15.63:42424) 2023-12-12T11:59:32.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.379+0000 7f0bc37fe700 1 -- 172.21.15.63:0/1020082514 learned_addr learned my addr 172.21.15.63:0/1020082514 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:59:32.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.379+0000 7f0bc3fff700 1 --2- 172.21.15.63:0/1020082514 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0bc4102b40 0x7f0bc4113300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:32.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.379+0000 7f0bc37fe700 1 -- 172.21.15.63:0/1020082514 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0bc4102b40 msgr2=0x7f0bc4113300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:32.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.379+0000 7f0bc37fe700 1 --2- 172.21.15.63:0/1020082514 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0bc4102b40 0x7f0bc4113300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:32.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.379+0000 7f0bc37fe700 1 -- 172.21.15.63:0/1020082514 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb8005040 con 0x7f0bc41034e0 2023-12-12T11:59:32.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.379+0000 7f0bc3fff700 1 --2- 172.21.15.63:0/1020082514 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0bc4102b40 0x7f0bc4113300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T11:59:32.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.380+0000 7f0bc37fe700 1 --2- 172.21.15.63:0/1020082514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0bc41034e0 0x7f0bc4113840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8009fd0 tx=0x7f0bb8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:59:32.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.380+0000 7f0bc0ff9700 1 -- 172.21.15.63:0/1020082514 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bb8021070 con 0x7f0bc41034e0 2023-12-12T11:59:32.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.380+0000 7f0bc0ff9700 1 -- 172.21.15.63:0/1020082514 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0bb801c400 con 0x7f0bc41034e0 2023-12-12T11:59:32.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.380+0000 7f0bca3ff700 1 -- 172.21.15.63:0/1020082514 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc410d630 con 0x7f0bc41034e0 2023-12-12T11:59:32.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.380+0000 7f0bc0ff9700 1 -- 172.21.15.63:0/1020082514 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bb800e070 con 0x7f0bc41034e0 2023-12-12T11:59:32.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.380+0000 7f0bca3ff700 1 -- 172.21.15.63:0/1020082514 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc410db90 con 0x7f0bc41034e0 2023-12-12T11:59:32.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.381+0000 7f0bca3ff700 1 -- 172.21.15.63:0/1020082514 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc4064730 con 0x7f0bc41034e0 2023-12-12T11:59:32.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.382+0000 7f0bc0ff9700 1 -- 172.21.15.63:0/1020082514 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f0bb801ca00 con 0x7f0bc41034e0 2023-12-12T11:59:32.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.383+0000 7f0bc0ff9700 1 --2- 172.21.15.63:0/1020082514 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f0bac06ce60 0x7f0bac06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:32.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.383+0000 7f0bc0ff9700 1 -- 172.21.15.63:0/1020082514 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f0bb808d530 con 0x7f0bc41034e0 2023-12-12T11:59:32.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.384+0000 7f0bc3fff700 1 --2- 172.21.15.63:0/1020082514 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f0bac06ce60 0x7f0bac06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:32.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.384+0000 7f0bc3fff700 1 --2- 172.21.15.63:0/1020082514 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f0bac06ce60 0x7f0bac06f310 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4004600 tx=0x7f0bb400b040 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:59:32.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.388+0000 7f0bc0ff9700 1 -- 172.21.15.63:0/1020082514 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f0bb805ae20 con 0x7f0bc41034e0 2023-12-12T11:59:32.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:32 smithi093 ceph-mon[171709]: pgmap v196: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:32.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:32 smithi063 ceph-mon[187282]: pgmap v196: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:32.601 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.599+0000 7f0bca3ff700 1 -- 172.21.15.63:0/1020082514 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0bc410ddb0 con 0x7f0bc41034e0 2023-12-12T11:59:32.601 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.599+0000 7f0bc0ff9700 1 -- 172.21.15.63:0/1020082514 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0bb8004490 con 0x7f0bc41034e0 2023-12-12T11:59:32.602 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-12T11:59:32.604 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.602+0000 7f0bca3ff700 1 -- 172.21.15.63:0/1020082514 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f0bac06ce60 msgr2=0x7f0bac06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:32.604 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.602+0000 7f0bca3ff700 1 --2- 172.21.15.63:0/1020082514 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f0bac06ce60 0x7f0bac06f310 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4004600 tx=0x7f0bb400b040 comp rx=0 tx=0).stop 2023-12-12T11:59:32.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.602+0000 7f0bca3ff700 1 -- 172.21.15.63:0/1020082514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0bc41034e0 msgr2=0x7f0bc4113840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:32.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.602+0000 7f0bca3ff700 1 --2- 172.21.15.63:0/1020082514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0bc41034e0 0x7f0bc4113840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8009fd0 tx=0x7f0bb8009e30 comp rx=0 tx=0).stop 2023-12-12T11:59:32.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.602+0000 7f0bca3ff700 1 -- 172.21.15.63:0/1020082514 shutdown_connections 2023-12-12T11:59:32.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.602+0000 7f0bca3ff700 1 --2- 172.21.15.63:0/1020082514 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f0bac06ce60 0x7f0bac06f310 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:32.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.602+0000 7f0bca3ff700 1 --2- 172.21.15.63:0/1020082514 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0bc4102b40 0x7f0bc4113300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:32.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.602+0000 7f0bca3ff700 1 --2- 172.21.15.63:0/1020082514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0bc41034e0 0x7f0bc4113840 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:32.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.602+0000 7f0bca3ff700 1 -- 172.21.15.63:0/1020082514 >> 172.21.15.63:0/1020082514 conn(0x7f0bc40f86d0 msgr2=0x7f0bc40fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:59:32.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.602+0000 7f0bca3ff700 1 -- 172.21.15.63:0/1020082514 shutdown_connections 2023-12-12T11:59:32.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.602+0000 7f0bca3ff700 1 -- 172.21.15.63:0/1020082514 wait complete. 2023-12-12T11:59:32.623 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-12T11:59:32.827 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.822+0000 7f37689ff700 1 -- 172.21.15.63:0/1480216441 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37641034e0 msgr2=0x7f37640fcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:32.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.822+0000 7f37689ff700 1 --2- 172.21.15.63:0/1480216441 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37641034e0 0x7f37640fcb50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3758004940 tx=0x7f3758009e30 comp rx=0 tx=0).stop 2023-12-12T11:59:32.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.822+0000 7f37689ff700 1 -- 172.21.15.63:0/1480216441 shutdown_connections 2023-12-12T11:59:32.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.822+0000 7f37689ff700 1 --2- 172.21.15.63:0/1480216441 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37641034e0 0x7f37640fcb50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:32.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.822+0000 7f37689ff700 1 --2- 172.21.15.63:0/1480216441 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3764102b40 0x7f3764102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:32.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.822+0000 7f37689ff700 1 -- 172.21.15.63:0/1480216441 >> 172.21.15.63:0/1480216441 conn(0x7f37640f86d0 msgr2=0x7f37640faae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:59:32.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.822+0000 7f37689ff700 1 -- 172.21.15.63:0/1480216441 shutdown_connections 2023-12-12T11:59:32.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.822+0000 7f37689ff700 1 -- 172.21.15.63:0/1480216441 wait complete. 2023-12-12T11:59:32.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.823+0000 7f37689ff700 1 Processor -- start 2023-12-12T11:59:32.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.823+0000 7f37689ff700 1 -- start start 2023-12-12T11:59:32.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.823+0000 7f37689ff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3764102b40 0x7f3764071a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:32.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.823+0000 7f37689ff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f37641034e0 0x7f376406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:32.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.823+0000 7f37689ff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3764070590 con 0x7f3764102b40 2023-12-12T11:59:32.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.823+0000 7f37689ff700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3764070700 con 0x7f37641034e0 2023-12-12T11:59:32.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.824+0000 7f376259c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3764102b40 0x7f3764071a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:32.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.824+0000 7f376259c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3764102b40 0x7f3764071a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42428/0 (socket says 172.21.15.63:42428) 2023-12-12T11:59:32.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.824+0000 7f376259c700 1 -- 172.21.15.63:0/90546035 learned_addr learned my addr 172.21.15.63:0/90546035 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:59:32.830 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.824+0000 7f3761d9b700 1 --2- 172.21.15.63:0/90546035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f37641034e0 0x7f376406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:32.830 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.824+0000 7f376259c700 1 -- 172.21.15.63:0/90546035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f37641034e0 msgr2=0x7f376406ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:32.830 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.824+0000 7f376259c700 1 --2- 172.21.15.63:0/90546035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f37641034e0 0x7f376406ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:32.830 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.824+0000 7f376259c700 1 -- 172.21.15.63:0/90546035 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3758005040 con 0x7f3764102b40 2023-12-12T11:59:32.830 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.824+0000 7f3761d9b700 1 --2- 172.21.15.63:0/90546035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f37641034e0 0x7f376406ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T11:59:32.830 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.824+0000 7f376259c700 1 --2- 172.21.15.63:0/90546035 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3764102b40 0x7f3764071a90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3754002a50 tx=0x7f37540046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:59:32.830 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.825+0000 7f3752ffd700 1 -- 172.21.15.63:0/90546035 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3754007cc0 con 0x7f3764102b40 2023-12-12T11:59:32.830 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.825+0000 7f3752ffd700 1 -- 172.21.15.63:0/90546035 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f375400f040 con 0x7f3764102b40 2023-12-12T11:59:32.830 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.825+0000 7f37689ff700 1 -- 172.21.15.63:0/90546035 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37640709e0 con 0x7f3764102b40 2023-12-12T11:59:32.831 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.825+0000 7f3752ffd700 1 -- 172.21.15.63:0/90546035 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f375400da70 con 0x7f3764102b40 2023-12-12T11:59:32.831 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.825+0000 7f37689ff700 1 -- 172.21.15.63:0/90546035 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f376411df60 con 0x7f3764102b40 2023-12-12T11:59:32.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.826+0000 7f37689ff700 1 -- 172.21.15.63:0/90546035 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3764105010 con 0x7f3764102b40 2023-12-12T11:59:32.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.827+0000 7f3752ffd700 1 -- 172.21.15.63:0/90546035 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f375400dc10 con 0x7f3764102b40 2023-12-12T11:59:32.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.828+0000 7f3752ffd700 1 --2- 172.21.15.63:0/90546035 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f374c06ce70 0x7f374c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:32.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.828+0000 7f3752ffd700 1 -- 172.21.15.63:0/90546035 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f375408ba60 con 0x7f3764102b40 2023-12-12T11:59:32.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.828+0000 7f3761d9b700 1 --2- 172.21.15.63:0/90546035 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f374c06ce70 0x7f374c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:32.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.829+0000 7f3761d9b700 1 --2- 172.21.15.63:0/90546035 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f374c06ce70 0x7f374c06f320 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f375800b3b0 tx=0x7f3758009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:59:32.834 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:32.832+0000 7f3752ffd700 1 -- 172.21.15.63:0/90546035 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3754059350 con 0x7f3764102b40 2023-12-12T11:59:33.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.041+0000 7f37689ff700 1 -- 172.21.15.63:0/90546035 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f3764064730 con 0x7f3764102b40 2023-12-12T11:59:33.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.042+0000 7f3752ffd700 1 -- 172.21.15.63:0/90546035 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v79) v1 ==== 107+0+11 (secure 0 0 0) 0x7f3764064730 con 0x7f3764102b40 2023-12-12T11:59:33.045 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-12T11:59:33.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.044+0000 7f37689ff700 1 -- 172.21.15.63:0/90546035 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f374c06ce70 msgr2=0x7f374c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:33.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.044+0000 7f37689ff700 1 --2- 172.21.15.63:0/90546035 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f374c06ce70 0x7f374c06f320 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f375800b3b0 tx=0x7f3758009e30 comp rx=0 tx=0).stop 2023-12-12T11:59:33.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.044+0000 7f37689ff700 1 -- 172.21.15.63:0/90546035 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3764102b40 msgr2=0x7f3764071a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:33.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.044+0000 7f37689ff700 1 --2- 172.21.15.63:0/90546035 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3764102b40 0x7f3764071a90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3754002a50 tx=0x7f37540046b0 comp rx=0 tx=0).stop 2023-12-12T11:59:33.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.044+0000 7f37689ff700 1 -- 172.21.15.63:0/90546035 shutdown_connections 2023-12-12T11:59:33.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.044+0000 7f37689ff700 1 --2- 172.21.15.63:0/90546035 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f374c06ce70 0x7f374c06f320 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:33.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.044+0000 7f37689ff700 1 --2- 172.21.15.63:0/90546035 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3764102b40 0x7f3764071a90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:33.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.044+0000 7f37689ff700 1 --2- 172.21.15.63:0/90546035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f37641034e0 0x7f376406ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:33.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.044+0000 7f37689ff700 1 -- 172.21.15.63:0/90546035 >> 172.21.15.63:0/90546035 conn(0x7f37640f86d0 msgr2=0x7f37640fa280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:59:33.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.044+0000 7f37689ff700 1 -- 172.21.15.63:0/90546035 shutdown_connections 2023-12-12T11:59:33.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.044+0000 7f37689ff700 1 -- 172.21.15.63:0/90546035 wait complete. 2023-12-12T11:59:33.065 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-12T11:59:33.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.265+0000 7fc43d9ff700 1 -- 172.21.15.63:0/547184698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc438102b40 msgr2=0x7fc438102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:33.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.265+0000 7fc43d9ff700 1 --2- 172.21.15.63:0/547184698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc438102b40 0x7fc438102f10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc428004940 tx=0x7fc428009e30 comp rx=0 tx=0).stop 2023-12-12T11:59:33.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.265+0000 7fc43d9ff700 1 -- 172.21.15.63:0/547184698 shutdown_connections 2023-12-12T11:59:33.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.265+0000 7fc43d9ff700 1 --2- 172.21.15.63:0/547184698 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc4381034e0 0x7fc4380fcb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:33.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.265+0000 7fc43d9ff700 1 --2- 172.21.15.63:0/547184698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc438102b40 0x7fc438102f10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:33.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.265+0000 7fc43d9ff700 1 -- 172.21.15.63:0/547184698 >> 172.21.15.63:0/547184698 conn(0x7fc4380f86d0 msgr2=0x7fc4380faae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:59:33.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.265+0000 7fc43d9ff700 1 -- 172.21.15.63:0/547184698 shutdown_connections 2023-12-12T11:59:33.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.265+0000 7fc43d9ff700 1 -- 172.21.15.63:0/547184698 wait complete. 2023-12-12T11:59:33.271 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.266+0000 7fc43d9ff700 1 Processor -- start 2023-12-12T11:59:33.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.267+0000 7fc43d9ff700 1 -- start start 2023-12-12T11:59:33.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.267+0000 7fc43d9ff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc438102b40 0x7fc4381133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:33.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.267+0000 7fc43d9ff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc4381034e0 0x7fc438113900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:33.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.267+0000 7fc43d9ff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc438113f50 con 0x7fc438102b40 2023-12-12T11:59:33.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.267+0000 7fc43d9ff700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43810d4b0 con 0x7fc4381034e0 2023-12-12T11:59:33.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.268+0000 7fc436ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc438102b40 0x7fc4381133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:33.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.268+0000 7fc436ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc438102b40 0x7fc4381133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42448/0 (socket says 172.21.15.63:42448) 2023-12-12T11:59:33.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.268+0000 7fc436ffd700 1 -- 172.21.15.63:0/2389648898 learned_addr learned my addr 172.21.15.63:0/2389648898 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:59:33.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.268+0000 7fc4367fc700 1 --2- 172.21.15.63:0/2389648898 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc4381034e0 0x7fc438113900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:33.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.268+0000 7fc436ffd700 1 -- 172.21.15.63:0/2389648898 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc4381034e0 msgr2=0x7fc438113900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:33.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.268+0000 7fc436ffd700 1 --2- 172.21.15.63:0/2389648898 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc4381034e0 0x7fc438113900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:33.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.268+0000 7fc436ffd700 1 -- 172.21.15.63:0/2389648898 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc428005040 con 0x7fc438102b40 2023-12-12T11:59:33.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.268+0000 7fc436ffd700 1 --2- 172.21.15.63:0/2389648898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc438102b40 0x7fc4381133c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc428009360 tx=0x7fc428009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:59:33.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.268+0000 7fc41f7fe700 1 -- 172.21.15.63:0/2389648898 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc42800e040 con 0x7fc438102b40 2023-12-12T11:59:33.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.268+0000 7fc41f7fe700 1 -- 172.21.15.63:0/2389648898 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc42800bc50 con 0x7fc438102b40 2023-12-12T11:59:33.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.268+0000 7fc41f7fe700 1 -- 172.21.15.63:0/2389648898 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc42801c630 con 0x7fc438102b40 2023-12-12T11:59:33.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.269+0000 7fc43d9ff700 1 -- 172.21.15.63:0/2389648898 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc43810d730 con 0x7fc438102b40 2023-12-12T11:59:33.274 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.269+0000 7fc43d9ff700 1 -- 172.21.15.63:0/2389648898 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43810dc20 con 0x7fc438102b40 2023-12-12T11:59:33.274 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.270+0000 7fc43d9ff700 1 -- 172.21.15.63:0/2389648898 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4380ffe50 con 0x7fc438102b40 2023-12-12T11:59:33.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.271+0000 7fc41f7fe700 1 -- 172.21.15.63:0/2389648898 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fc428013420 con 0x7fc438102b40 2023-12-12T11:59:33.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.271+0000 7fc41f7fe700 1 --2- 172.21.15.63:0/2389648898 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fc42006ce70 0x7fc42006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:33.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.272+0000 7fc41f7fe700 1 -- 172.21.15.63:0/2389648898 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fc42808d6d0 con 0x7fc438102b40 2023-12-12T11:59:33.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.272+0000 7fc4367fc700 1 --2- 172.21.15.63:0/2389648898 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fc42006ce70 0x7fc42006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:33.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.272+0000 7fc4367fc700 1 --2- 172.21.15.63:0/2389648898 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fc42006ce70 0x7fc42006f320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc42c009fd0 tx=0x7fc42c009f20 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:59:33.278 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.276+0000 7fc41f7fe700 1 -- 172.21.15.63:0/2389648898 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc428057530 con 0x7fc438102b40 2023-12-12T11:59:33.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:33 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/3572147264' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-12T11:59:33.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:33 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/1020082514' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-12T11:59:33.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:33 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/90546035' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-12T11:59:33.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.488+0000 7fc43d9ff700 1 -- 172.21.15.63:0/2389648898 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fc438064730 con 0x7fc438102b40 2023-12-12T11:59:33.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.488+0000 7fc41f7fe700 1 -- 172.21.15.63:0/2389648898 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v79) v1 ==== 107+0+11 (secure 0 0 0) 0x7fc42805ab50 con 0x7fc438102b40 2023-12-12T11:59:33.491 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-12T11:59:33.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.490+0000 7fc43d9ff700 1 -- 172.21.15.63:0/2389648898 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fc42006ce70 msgr2=0x7fc42006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:33.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.490+0000 7fc43d9ff700 1 --2- 172.21.15.63:0/2389648898 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fc42006ce70 0x7fc42006f320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc42c009fd0 tx=0x7fc42c009f20 comp rx=0 tx=0).stop 2023-12-12T11:59:33.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.490+0000 7fc43d9ff700 1 -- 172.21.15.63:0/2389648898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc438102b40 msgr2=0x7fc4381133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:33.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.490+0000 7fc43d9ff700 1 --2- 172.21.15.63:0/2389648898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc438102b40 0x7fc4381133c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc428009360 tx=0x7fc428009e30 comp rx=0 tx=0).stop 2023-12-12T11:59:33.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.491+0000 7fc43d9ff700 1 -- 172.21.15.63:0/2389648898 shutdown_connections 2023-12-12T11:59:33.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.491+0000 7fc43d9ff700 1 --2- 172.21.15.63:0/2389648898 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fc42006ce70 0x7fc42006f320 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:33.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.491+0000 7fc43d9ff700 1 --2- 172.21.15.63:0/2389648898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc438102b40 0x7fc4381133c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:33.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.491+0000 7fc43d9ff700 1 --2- 172.21.15.63:0/2389648898 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc4381034e0 0x7fc438113900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:33.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.491+0000 7fc43d9ff700 1 -- 172.21.15.63:0/2389648898 >> 172.21.15.63:0/2389648898 conn(0x7fc4380f86d0 msgr2=0x7fc4380fa490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:59:33.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.491+0000 7fc43d9ff700 1 -- 172.21.15.63:0/2389648898 shutdown_connections 2023-12-12T11:59:33.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.491+0000 7fc43d9ff700 1 -- 172.21.15.63:0/2389648898 wait complete. 2023-12-12T11:59:33.509 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:33 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/3572147264' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-12T11:59:33.509 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:33 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/1020082514' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-12T11:59:33.509 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:33 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/90546035' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-12T11:59:33.512 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T11:59:33.711 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.708+0000 7fae4adff700 1 -- 172.21.15.63:0/2259077342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae441034e0 msgr2=0x7fae440fcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:33.711 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.708+0000 7fae4adff700 1 --2- 172.21.15.63:0/2259077342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae441034e0 0x7fae440fcb50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fae30004940 tx=0x7fae30009e30 comp rx=0 tx=0).stop 2023-12-12T11:59:33.711 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.708+0000 7fae4adff700 1 -- 172.21.15.63:0/2259077342 shutdown_connections 2023-12-12T11:59:33.712 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.708+0000 7fae4adff700 1 --2- 172.21.15.63:0/2259077342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae441034e0 0x7fae440fcb50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:33.712 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.708+0000 7fae4adff700 1 --2- 172.21.15.63:0/2259077342 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae44102b40 0x7fae44102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:33.712 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.708+0000 7fae4adff700 1 -- 172.21.15.63:0/2259077342 >> 172.21.15.63:0/2259077342 conn(0x7fae440f86d0 msgr2=0x7fae440faae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:59:33.712 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.709+0000 7fae4adff700 1 -- 172.21.15.63:0/2259077342 shutdown_connections 2023-12-12T11:59:33.712 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.709+0000 7fae4adff700 1 -- 172.21.15.63:0/2259077342 wait complete. 2023-12-12T11:59:33.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.709+0000 7fae4adff700 1 Processor -- start 2023-12-12T11:59:33.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.709+0000 7fae4adff700 1 -- start start 2023-12-12T11:59:33.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.710+0000 7fae4adff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae44102b40 0x7fae44071a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:33.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.710+0000 7fae4adff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae441034e0 0x7fae4406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:33.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.710+0000 7fae4adff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae44070590 con 0x7fae44102b40 2023-12-12T11:59:33.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.710+0000 7fae4adff700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae44070700 con 0x7fae441034e0 2023-12-12T11:59:33.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.710+0000 7fae48b9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae44102b40 0x7fae44071a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:33.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.710+0000 7fae48b9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae44102b40 0x7fae44071a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42464/0 (socket says 172.21.15.63:42464) 2023-12-12T11:59:33.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.710+0000 7fae48b9b700 1 -- 172.21.15.63:0/2908119411 learned_addr learned my addr 172.21.15.63:0/2908119411 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:59:33.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.710+0000 7fae43fff700 1 --2- 172.21.15.63:0/2908119411 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae441034e0 0x7fae4406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:33.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.710+0000 7fae48b9b700 1 -- 172.21.15.63:0/2908119411 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae441034e0 msgr2=0x7fae4406ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:33.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.710+0000 7fae48b9b700 1 --2- 172.21.15.63:0/2908119411 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae441034e0 0x7fae4406ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:33.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.710+0000 7fae48b9b700 1 -- 172.21.15.63:0/2908119411 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae30005040 con 0x7fae44102b40 2023-12-12T11:59:33.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.711+0000 7fae48b9b700 1 --2- 172.21.15.63:0/2908119411 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae44102b40 0x7fae44071a90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fae3800c8c0 tx=0x7fae380044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:59:33.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.711+0000 7fae417fa700 1 -- 172.21.15.63:0/2908119411 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae3800a980 con 0x7fae44102b40 2023-12-12T11:59:33.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.711+0000 7fae417fa700 1 -- 172.21.15.63:0/2908119411 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fae3800ce60 con 0x7fae44102b40 2023-12-12T11:59:33.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.711+0000 7fae4adff700 1 -- 172.21.15.63:0/2908119411 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae440709e0 con 0x7fae44102b40 2023-12-12T11:59:33.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.711+0000 7fae417fa700 1 -- 172.21.15.63:0/2908119411 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae380113a0 con 0x7fae44102b40 2023-12-12T11:59:33.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.711+0000 7fae4adff700 1 -- 172.21.15.63:0/2908119411 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae4411df80 con 0x7fae44102b40 2023-12-12T11:59:33.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.712+0000 7fae4adff700 1 -- 172.21.15.63:0/2908119411 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae44105010 con 0x7fae44102b40 2023-12-12T11:59:33.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.713+0000 7fae417fa700 1 -- 172.21.15.63:0/2908119411 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fae38012400 con 0x7fae44102b40 2023-12-12T11:59:33.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.714+0000 7fae417fa700 1 --2- 172.21.15.63:0/2908119411 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fae3406ce70 0x7fae3406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:33.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.714+0000 7fae417fa700 1 -- 172.21.15.63:0/2908119411 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fae3808c410 con 0x7fae44102b40 2023-12-12T11:59:33.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.714+0000 7fae43fff700 1 --2- 172.21.15.63:0/2908119411 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fae3406ce70 0x7fae3406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:33.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.715+0000 7fae43fff700 1 --2- 172.21.15.63:0/2908119411 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fae3406ce70 0x7fae3406f320 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fae44071730 tx=0x7fae30009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:59:33.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.719+0000 7fae417fa700 1 -- 172.21.15.63:0/2908119411 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fae38059d80 con 0x7fae44102b40 2023-12-12T11:59:33.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.946+0000 7fae4adff700 1 -- 172.21.15.63:0/2908119411 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fae44064730 con 0x7fae44102b40 2023-12-12T11:59:33.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.946+0000 7fae417fa700 1 -- 172.21.15.63:0/2908119411 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 39 entries v79) v1 ==== 81+0+2292 (secure 0 0 0) 0x7fae38059910 con 0x7fae44102b40 2023-12-12T11:59:33.949 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6801/368827847 2023-12-13T11:54:05.314973+0000 2023-12-12T11:59:33.949 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6800/368827847 2023-12-13T11:54:05.314973+0000 2023-12-12T11:59:33.949 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.93:6828/3441331233 2023-12-13T11:52:56.821857+0000 2023-12-12T11:59:33.949 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6801/4048286824 2023-12-13T11:44:08.715291+0000 2023-12-12T11:59:33.949 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/2270429505 2023-12-13T11:44:08.715291+0000 2023-12-12T11:59:33.950 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6826/2809808942 2023-12-13T11:49:11.105112+0000 2023-12-12T11:59:33.950 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.93:0/1057256486 2023-12-13T11:52:56.821857+0000 2023-12-12T11:59:33.950 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/3710081653 2023-12-13T11:51:36.889322+0000 2023-12-12T11:59:33.950 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6800/1972453923 2023-12-13T11:43:38.661897+0000 2023-12-12T11:59:33.950 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/90805296 2023-12-13T11:43:38.661897+0000 2023-12-12T11:59:33.950 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/1747856225 2023-12-13T11:51:36.889322+0000 2023-12-12T11:59:33.950 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6800/3841315087 2023-12-13T11:51:36.889322+0000 2023-12-12T11:59:33.950 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/1972560506 2023-12-13T11:45:05.780140+0000 2023-12-12T11:59:33.950 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/3524404486 2023-12-13T11:43:38.661897+0000 2023-12-12T11:59:33.951 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6801/1972453923 2023-12-13T11:43:38.661897+0000 2023-12-12T11:59:33.951 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.93:0/343118333 2023-12-13T11:52:56.821857+0000 2023-12-12T11:59:33.951 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6827/2809808942 2023-12-13T11:49:11.105112+0000 2023-12-12T11:59:33.951 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/510113990 2023-12-13T11:54:05.314973+0000 2023-12-12T11:59:33.951 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.93:6829/3441331233 2023-12-13T11:52:56.821857+0000 2023-12-12T11:59:33.951 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6801/3841315087 2023-12-13T11:51:36.889322+0000 2023-12-12T11:59:33.951 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/1089809755 2023-12-13T11:43:38.661897+0000 2023-12-12T11:59:33.951 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/2339917683 2023-12-13T11:54:05.314973+0000 2023-12-12T11:59:33.951 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.93:0/707715378 2023-12-13T11:52:56.821857+0000 2023-12-12T11:59:33.952 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/49274924 2023-12-13T11:54:05.314973+0000 2023-12-12T11:59:33.952 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/2015988516 2023-12-13T11:45:05.780140+0000 2023-12-12T11:59:33.952 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/2136521491 2023-12-13T11:51:36.889322+0000 2023-12-12T11:59:33.952 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/1443572827 2023-12-13T11:45:05.780140+0000 2023-12-12T11:59:33.952 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6800/4048286824 2023-12-13T11:44:08.715291+0000 2023-12-12T11:59:33.952 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/545666177 2023-12-13T11:44:08.715291+0000 2023-12-12T11:59:33.952 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/2550373170 2023-12-13T11:51:36.889322+0000 2023-12-12T11:59:33.952 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/1601381023 2023-12-13T11:44:08.715291+0000 2023-12-12T11:59:33.953 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.93:0/4241774739 2023-12-13T11:52:56.821857+0000 2023-12-12T11:59:33.953 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.93:0/3779305150 2023-12-13T11:52:56.821857+0000 2023-12-12T11:59:33.953 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.93:0/3098682321 2023-12-13T11:52:56.821857+0000 2023-12-12T11:59:33.953 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6800/293571324 2023-12-13T11:45:05.780140+0000 2023-12-12T11:59:33.953 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/1083892159 2023-12-13T11:54:05.314973+0000 2023-12-12T11:59:33.953 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/1222084055 2023-12-13T11:54:05.314973+0000 2023-12-12T11:59:33.953 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6801/293571324 2023-12-13T11:45:05.780140+0000 2023-12-12T11:59:33.953 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/2627081339 2023-12-13T11:54:05.314973+0000 2023-12-12T11:59:33.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.949+0000 7fae4adff700 1 -- 172.21.15.63:0/2908119411 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fae3406ce70 msgr2=0x7fae3406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:33.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.949+0000 7fae4adff700 1 --2- 172.21.15.63:0/2908119411 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fae3406ce70 0x7fae3406f320 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fae44071730 tx=0x7fae30009e30 comp rx=0 tx=0).stop 2023-12-12T11:59:33.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.949+0000 7fae4adff700 1 -- 172.21.15.63:0/2908119411 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae44102b40 msgr2=0x7fae44071a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:33.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.949+0000 7fae4adff700 1 --2- 172.21.15.63:0/2908119411 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae44102b40 0x7fae44071a90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fae3800c8c0 tx=0x7fae380044c0 comp rx=0 tx=0).stop 2023-12-12T11:59:33.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.949+0000 7fae4adff700 1 -- 172.21.15.63:0/2908119411 shutdown_connections 2023-12-12T11:59:33.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.949+0000 7fae4adff700 1 --2- 172.21.15.63:0/2908119411 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fae3406ce70 0x7fae3406f320 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:33.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.949+0000 7fae4adff700 1 --2- 172.21.15.63:0/2908119411 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae44102b40 0x7fae44071a90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:33.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.949+0000 7fae4adff700 1 --2- 172.21.15.63:0/2908119411 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae441034e0 0x7fae4406ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:33.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.949+0000 7fae4adff700 1 -- 172.21.15.63:0/2908119411 >> 172.21.15.63:0/2908119411 conn(0x7fae440f86d0 msgr2=0x7fae440fa2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:59:33.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.949+0000 7fae4adff700 1 -- 172.21.15.63:0/2908119411 shutdown_connections 2023-12-12T11:59:33.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:33.949+0000 7fae4adff700 1 -- 172.21.15.63:0/2908119411 wait complete. 2023-12-12T11:59:33.956 INFO:teuthology.orchestra.run.smithi063.stderr:listed 39 entries 2023-12-12T11:59:33.970 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-12T11:59:33.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:59:33.971 DEBUG:teuthology.orchestra.run.smithi063:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-12T11:59:34.058 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi063.front.sepia.ceph.com 2023-12-12T11:59:34.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:59:34.059 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-12T11:59:34.137 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-12T11:59:34.137 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T11:59:34.242 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-12T11:59:34.242 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T11:59:34.292 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T11:59:34.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:34 smithi063 ceph-mon[187282]: pgmap v197: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:34.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:34 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/2389648898' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-12T11:59:34.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:34 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/2908119411' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-12T11:59:34.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:34 smithi093 ceph-mon[171709]: pgmap v197: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:34.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:34 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/2389648898' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-12T11:59:34.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:34 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/2908119411' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-12T11:59:34.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.490+0000 7fe755dff700 1 -- 172.21.15.63:0/170328689 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe75006ffe0 msgr2=0x7fe7500703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:34.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.490+0000 7fe755dff700 1 --2- 172.21.15.63:0/170328689 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe75006ffe0 0x7fe7500703b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe740004970 tx=0x7fe740009e30 comp rx=0 tx=0).stop 2023-12-12T11:59:34.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.490+0000 7fe755dff700 1 -- 172.21.15.63:0/170328689 shutdown_connections 2023-12-12T11:59:34.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.490+0000 7fe755dff700 1 --2- 172.21.15.63:0/170328689 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe7500708f0 0x7fe750108db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:34.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.490+0000 7fe755dff700 1 --2- 172.21.15.63:0/170328689 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe75006ffe0 0x7fe7500703b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:34.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.490+0000 7fe755dff700 1 -- 172.21.15.63:0/170328689 >> 172.21.15.63:0/170328689 conn(0x7fe7500f85f0 msgr2=0x7fe7500faa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:59:34.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.490+0000 7fe755dff700 1 -- 172.21.15.63:0/170328689 shutdown_connections 2023-12-12T11:59:34.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.491+0000 7fe755dff700 1 -- 172.21.15.63:0/170328689 wait complete. 2023-12-12T11:59:34.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.491+0000 7fe755dff700 1 Processor -- start 2023-12-12T11:59:34.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.491+0000 7fe755dff700 1 -- start start 2023-12-12T11:59:34.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.492+0000 7fe755dff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe75006ffe0 0x7fe7501153e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:34.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.492+0000 7fe755dff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7500708f0 0x7fe750115920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:34.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.492+0000 7fe755dff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe750115f70 con 0x7fe7500708f0 2023-12-12T11:59:34.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.492+0000 7fe755dff700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75010f4d0 con 0x7fe75006ffe0 2023-12-12T11:59:34.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.492+0000 7fe74effd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7500708f0 0x7fe750115920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:34.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.492+0000 7fe74effd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7500708f0 0x7fe750115920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42486/0 (socket says 172.21.15.63:42486) 2023-12-12T11:59:34.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.492+0000 7fe74effd700 1 -- 172.21.15.63:0/232000011 learned_addr learned my addr 172.21.15.63:0/232000011 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:59:34.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.492+0000 7fe74f7fe700 1 --2- 172.21.15.63:0/232000011 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe75006ffe0 0x7fe7501153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:34.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.492+0000 7fe74effd700 1 -- 172.21.15.63:0/232000011 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe75006ffe0 msgr2=0x7fe7501153e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:34.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.492+0000 7fe74effd700 1 --2- 172.21.15.63:0/232000011 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe75006ffe0 0x7fe7501153e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:34.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.492+0000 7fe74effd700 1 -- 172.21.15.63:0/232000011 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe740005040 con 0x7fe7500708f0 2023-12-12T11:59:34.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.493+0000 7fe74effd700 1 --2- 172.21.15.63:0/232000011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7500708f0 0x7fe750115920 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe744002a50 tx=0x7fe7440046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:59:34.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.493+0000 7fe737fff700 1 -- 172.21.15.63:0/232000011 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe744007cc0 con 0x7fe7500708f0 2023-12-12T11:59:34.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.493+0000 7fe737fff700 1 -- 172.21.15.63:0/232000011 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe74400f040 con 0x7fe7500708f0 2023-12-12T11:59:34.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.493+0000 7fe755dff700 1 -- 172.21.15.63:0/232000011 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe75010f7b0 con 0x7fe7500708f0 2023-12-12T11:59:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.493+0000 7fe737fff700 1 -- 172.21.15.63:0/232000011 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe74400d9c0 con 0x7fe7500708f0 2023-12-12T11:59:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.493+0000 7fe755dff700 1 -- 172.21.15.63:0/232000011 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe75010fcf0 con 0x7fe7500708f0 2023-12-12T11:59:34.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.494+0000 7fe755dff700 1 -- 172.21.15.63:0/232000011 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe750106470 con 0x7fe7500708f0 2023-12-12T11:59:34.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.495+0000 7fe737fff700 1 -- 172.21.15.63:0/232000011 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fe74400db20 con 0x7fe7500708f0 2023-12-12T11:59:34.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.496+0000 7fe737fff700 1 --2- 172.21.15.63:0/232000011 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe73806ce70 0x7fe73806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:34.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.496+0000 7fe737fff700 1 -- 172.21.15.63:0/232000011 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fe74408c100 con 0x7fe7500708f0 2023-12-12T11:59:34.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.497+0000 7fe74f7fe700 1 --2- 172.21.15.63:0/232000011 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe73806ce70 0x7fe73806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:34.500 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.497+0000 7fe74f7fe700 1 --2- 172.21.15.63:0/232000011 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe73806ce70 0x7fe73806f320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe740004940 tx=0x7fe740009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:59:34.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.501+0000 7fe737fff700 1 -- 172.21.15.63:0/232000011 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe744055ee0 con 0x7fe7500708f0 2023-12-12T11:59:34.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.710+0000 7fe755dff700 1 -- 172.21.15.63:0/232000011 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe750110a30 con 0x7fe7500708f0 2023-12-12T11:59:34.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.711+0000 7fe737fff700 1 -- 172.21.15.63:0/232000011 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+16502 (secure 0 0 0) 0x7fe744059500 con 0x7fe7500708f0 2023-12-12T11:59:34.716 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-12T11:59:34.717 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":79,"fsid":"85e33c70-98e3-11ee-95a3-87774f69a715","created":"2023-12-12T11:43:06.421058+0000","modified":"2023-12-12T11:58:07.764909+0000","last_up_change":"2023-12-12T11:58:06.762951+0000","last_in_change":"2023-12-12T11:47:44.737839+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T11:46:58.373192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-12T11:48:57.216360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-12T11:48:58.039176+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6b09da78-38a4-46a4-bf22-b1d21103b497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4193564418},{"type":"v1","addr":"172.21.15.63:6803","nonce":4193564418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":4193564418},{"type":"v1","addr":"172.21.15.63:6805","nonce":4193564418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":4193564418},{"type":"v1","addr":"172.21.15.63:6809","nonce":4193564418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4193564418},{"type":"v1","addr":"172.21.15.63:6807","nonce":4193564418}]},"public_addr":"172.21.15.63:6803/4193564418","cluster_addr":"172.21.15.63:6805/4193564418","heartbeat_back_addr":"172.21.15.63:6809/4193564418","heartbeat_front_addr":"172.21.15.63:6807/4193564418","state":["exists","up"]},{"osd":1,"uuid":"b45154ac-c018-4aa6-89d4-f22bd94b66c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":392040058},{"type":"v1","addr":"172.21.15.63:6811","nonce":392040058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":392040058},{"type":"v1","addr":"172.21.15.63:6813","nonce":392040058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":392040058},{"type":"v1","addr":"172.21.15.63:6817","nonce":392040058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":392040058},{"type":"v1","addr":"172.21.15.63:6815","nonce":392040058}]},"public_addr":"172.21.15.63:6811/392040058","cluster_addr":"172.21.15.63:6813/392040058","heartbeat_back_addr":"172.21.15.63:6817/392040058","heartbeat_front_addr":"172.21.15.63:6815/392040058","state":["exists","up"]},{"osd":2,"uuid":"2fcdfc7f-334e-427a-8e1e-b95578c88db5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2611117524},{"type":"v1","addr":"172.21.15.63:6819","nonce":2611117524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":2611117524},{"type":"v1","addr":"172.21.15.63:6821","nonce":2611117524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":2611117524},{"type":"v1","addr":"172.21.15.63:6825","nonce":2611117524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2611117524},{"type":"v1","addr":"172.21.15.63:6823","nonce":2611117524}]},"public_addr":"172.21.15.63:6819/2611117524","cluster_addr":"172.21.15.63:6821/2611117524","heartbeat_back_addr":"172.21.15.63:6825/2611117524","heartbeat_front_addr":"172.21.15.63:6823/2611117524","state":["exists","up"]},{"osd":3,"uuid":"79666eff-9c6a-4170-b1b6-9fee68b62865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2608957664},{"type":"v1","addr":"172.21.15.93:6801","nonce":2608957664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2608957664},{"type":"v1","addr":"172.21.15.93:6803","nonce":2608957664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2608957664},{"type":"v1","addr":"172.21.15.93:6807","nonce":2608957664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2608957664},{"type":"v1","addr":"172.21.15.93:6805","nonce":2608957664}]},"public_addr":"172.21.15.93:6801/2608957664","cluster_addr":"172.21.15.93:6803/2608957664","heartbeat_back_addr":"172.21.15.93:6807/2608957664","heartbeat_front_addr":"172.21.15.93:6805/2608957664","state":["exists","up"]},{"osd":4,"uuid":"af069a18-59ca-4e55-a09c-9d4be6e10cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":1202130659},{"type":"v1","addr":"172.21.15.93:6809","nonce":1202130659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":1202130659},{"type":"v1","addr":"172.21.15.93:6811","nonce":1202130659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":1202130659},{"type":"v1","addr":"172.21.15.93:6815","nonce":1202130659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1202130659},{"type":"v1","addr":"172.21.15.93:6813","nonce":1202130659}]},"public_addr":"172.21.15.93:6809/1202130659","cluster_addr":"172.21.15.93:6811/1202130659","heartbeat_back_addr":"172.21.15.93:6815/1202130659","heartbeat_front_addr":"172.21.15.93:6813/1202130659","state":["exists","up"]},{"osd":5,"uuid":"66901eb6-442c-4808-a5d3-958fd4b8f18d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":4114052086},{"type":"v1","addr":"172.21.15.93:6817","nonce":4114052086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":4114052086},{"type":"v1","addr":"172.21.15.93:6819","nonce":4114052086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":4114052086},{"type":"v1","addr":"172.21.15.93:6823","nonce":4114052086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":4114052086},{"type":"v1","addr":"172.21.15.93:6821","nonce":4114052086}]},"public_addr":"172.21.15.93:6817/4114052086","cluster_addr":"172.21.15.93:6819/4114052086","heartbeat_back_addr":"172.21.15.93:6823/4114052086","heartbeat_front_addr":"172.21.15.93:6821/4114052086","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:46:08.420691+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:46:31.277938+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:46:54.903181+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:47:16.535347+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:47:38.988069+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T11:48:01.641629+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:6801/368827847":"2023-12-13T11:54:05.314973+0000","172.21.15.63:6800/368827847":"2023-12-13T11:54:05.314973+0000","172.21.15.93:6828/3441331233":"2023-12-13T11:52:56.821857+0000","172.21.15.63:6801/4048286824":"2023-12-13T11:44:08.715291+0000","172.21.15.63:0/2270429505":"2023-12-13T11:44:08.715291+0000","172.21.15.63:6826/2809808942":"2023-12-13T11:49:11.105112+0000","172.21.15.93:0/1057256486":"2023-12-13T11:52:56.821857+0000","172.21.15.63:0/3710081653":"2023-12-13T11:51:36.889322+0000","172.21.15.63:6800/1972453923":"2023-12-13T11:43:38.661897+0000","172.21.15.63:0/90805296":"2023-12-13T11:43:38.661897+0000","172.21.15.63:0/1747856225":"2023-12-13T11:51:36.889322+0000","172.21.15.63:6800/3841315087":"2023-12-13T11:51:36.889322+0000","172.21.15.63:0/1972560506":"2023-12-13T11:45:05.780140+0000","172.21.15.63:0/3524404486":"2023-12-13T11:43:38.661897+0000","172.21.15.63:6801/1972453923":"2023-12-13T11:43:38.661897+0000","172.21.15.93:0/343118333":"2023-12-13T11:52:56.821857+0000","172.21.15.63:6827/2809808942":"2023-12-13T11:49:11.105112+0000","172.21.15.63:0/510113990":"2023-12-13T11:54:05.314973+0000","172.21.15.93:6829/3441331233":"2023-12-13T11:52:56.821857+0000","172.21.15.63:6801/3841315087":"2023-12-13T11:51:36.889322+0000","172.21.15.63:0/1089809755":"2023-12-13T11:43:38.661897+0000","172.21.15.63:0/2339917683":"2023-12-13T11:54:05.314973+0000","172.21.15.93:0/707715378":"2023-12-13T11:52:56.821857+0000","172.21.15.63:0/49274924":"2023-12-13T11:54:05.314973+0000","172.21.15.63:0/2015988516":"2023-12-13T11:45:05.780140+0000","172.21.15.63:0/2136521491":"2023-12-13T11:51:36.889322+0000","172.21.15.63:0/1443572827":"2023-12-13T11:45:05.780140+0000","172.21.15.63:6800/4048286824":"2023-12-13T11:44:08.715291+0000","172.21.15.63:0/545666177":"2023-12-13T11:44:08.715291+0000","172.21.15.63:0/2550373170":"2023-12-13T11:51:36.889322+0000","172.21.15.63:0/1601381023":"2023-12-13T11:44:08.715291+0000","172.21.15.93:0/4241774739":"2023-12-13T11:52:56.821857+0000","172.21.15.93:0/3779305150":"2023-12-13T11:52:56.821857+0000","172.21.15.93:0/3098682321":"2023-12-13T11:52:56.821857+0000","172.21.15.63:6800/293571324":"2023-12-13T11:45:05.780140+0000","172.21.15.63:0/1083892159":"2023-12-13T11:54:05.314973+0000","172.21.15.63:0/1222084055":"2023-12-13T11:54:05.314973+0000","172.21.15.63:6801/293571324":"2023-12-13T11:45:05.780140+0000","172.21.15.63:0/2627081339":"2023-12-13T11:54:05.314973+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T11:59:34.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.714+0000 7fe755dff700 1 -- 172.21.15.63:0/232000011 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe73806ce70 msgr2=0x7fe73806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:34.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.714+0000 7fe755dff700 1 --2- 172.21.15.63:0/232000011 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe73806ce70 0x7fe73806f320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe740004940 tx=0x7fe740009e30 comp rx=0 tx=0).stop 2023-12-12T11:59:34.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.714+0000 7fe755dff700 1 -- 172.21.15.63:0/232000011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7500708f0 msgr2=0x7fe750115920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:34.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.714+0000 7fe755dff700 1 --2- 172.21.15.63:0/232000011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7500708f0 0x7fe750115920 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe744002a50 tx=0x7fe7440046b0 comp rx=0 tx=0).stop 2023-12-12T11:59:34.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.714+0000 7fe755dff700 1 -- 172.21.15.63:0/232000011 shutdown_connections 2023-12-12T11:59:34.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.714+0000 7fe755dff700 1 --2- 172.21.15.63:0/232000011 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7fe73806ce70 0x7fe73806f320 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:34.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.714+0000 7fe755dff700 1 --2- 172.21.15.63:0/232000011 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe75006ffe0 0x7fe7501153e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:34.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.714+0000 7fe755dff700 1 --2- 172.21.15.63:0/232000011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7500708f0 0x7fe750115920 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:34.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.714+0000 7fe755dff700 1 -- 172.21.15.63:0/232000011 >> 172.21.15.63:0/232000011 conn(0x7fe7500f85f0 msgr2=0x7fe7501035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:59:34.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.714+0000 7fe755dff700 1 -- 172.21.15.63:0/232000011 shutdown_connections 2023-12-12T11:59:34.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.714+0000 7fe755dff700 1 -- 172.21.15.63:0/232000011 wait complete. 2023-12-12T11:59:34.737 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T11:46:58.373192+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-12T11:48:57.216360+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-12T11:48:58.039176+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T11:59:34.737 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T11:59:34.939 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.936+0000 7efdf25ff700 1 -- 172.21.15.63:0/3039013697 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdec102b50 msgr2=0x7efdec102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:34.939 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.936+0000 7efdf25ff700 1 --2- 172.21.15.63:0/3039013697 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdec102b50 0x7efdec102f20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efddc004940 tx=0x7efddc009e30 comp rx=0 tx=0).stop 2023-12-12T11:59:34.939 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.936+0000 7efdf25ff700 1 -- 172.21.15.63:0/3039013697 shutdown_connections 2023-12-12T11:59:34.939 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.936+0000 7efdf25ff700 1 --2- 172.21.15.63:0/3039013697 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efdec1034f0 0x7efdec0fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:34.939 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.936+0000 7efdf25ff700 1 --2- 172.21.15.63:0/3039013697 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdec102b50 0x7efdec102f20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:34.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.936+0000 7efdf25ff700 1 -- 172.21.15.63:0/3039013697 >> 172.21.15.63:0/3039013697 conn(0x7efdec0f8700 msgr2=0x7efdec0fab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:59:34.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.936+0000 7efdf25ff700 1 -- 172.21.15.63:0/3039013697 shutdown_connections 2023-12-12T11:59:34.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.936+0000 7efdf25ff700 1 -- 172.21.15.63:0/3039013697 wait complete. 2023-12-12T11:59:34.941 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.937+0000 7efdf25ff700 1 Processor -- start 2023-12-12T11:59:34.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.937+0000 7efdf25ff700 1 -- start start 2023-12-12T11:59:34.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.937+0000 7efdf25ff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efdec102b50 0x7efdec115500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:34.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.937+0000 7efdf25ff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdec1034f0 0x7efdec115a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:34.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.937+0000 7efdf25ff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec116090 con 0x7efdec1034f0 2023-12-12T11:59:34.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.937+0000 7efdf25ff700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec10f5d0 con 0x7efdec102b50 2023-12-12T11:59:34.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.938+0000 7efdeb7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdec1034f0 0x7efdec115a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:34.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.938+0000 7efdeb7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdec1034f0 0x7efdec115a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42504/0 (socket says 172.21.15.63:42504) 2023-12-12T11:59:34.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.938+0000 7efdeb7fe700 1 -- 172.21.15.63:0/211161159 learned_addr learned my addr 172.21.15.63:0/211161159 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:59:34.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.938+0000 7efdebfff700 1 --2- 172.21.15.63:0/211161159 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efdec102b50 0x7efdec115500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:34.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.938+0000 7efdeb7fe700 1 -- 172.21.15.63:0/211161159 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efdec102b50 msgr2=0x7efdec115500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:34.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.938+0000 7efdeb7fe700 1 --2- 172.21.15.63:0/211161159 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efdec102b50 0x7efdec115500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:34.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.938+0000 7efdeb7fe700 1 -- 172.21.15.63:0/211161159 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efddc005040 con 0x7efdec1034f0 2023-12-12T11:59:34.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.938+0000 7efdebfff700 1 --2- 172.21.15.63:0/211161159 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efdec102b50 0x7efdec115500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T11:59:34.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.938+0000 7efdeb7fe700 1 --2- 172.21.15.63:0/211161159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdec1034f0 0x7efdec115a40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efde000eb40 tx=0x7efde000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:59:34.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.938+0000 7efde8ff9700 1 -- 172.21.15.63:0/211161159 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efde0007cc0 con 0x7efdec1034f0 2023-12-12T11:59:34.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.939+0000 7efdf25ff700 1 -- 172.21.15.63:0/211161159 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdec10f850 con 0x7efdec1034f0 2023-12-12T11:59:34.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.939+0000 7efde8ff9700 1 -- 172.21.15.63:0/211161159 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efde000f040 con 0x7efdec1034f0 2023-12-12T11:59:34.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.939+0000 7efde8ff9700 1 -- 172.21.15.63:0/211161159 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efde0009510 con 0x7efdec1034f0 2023-12-12T11:59:34.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.939+0000 7efdf25ff700 1 -- 172.21.15.63:0/211161159 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdec10fe10 con 0x7efdec1034f0 2023-12-12T11:59:34.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.940+0000 7efdf25ff700 1 -- 172.21.15.63:0/211161159 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdec064730 con 0x7efdec1034f0 2023-12-12T11:59:34.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.941+0000 7efde8ff9700 1 -- 172.21.15.63:0/211161159 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7efde0009670 con 0x7efdec1034f0 2023-12-12T11:59:34.945 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.942+0000 7efde8ff9700 1 --2- 172.21.15.63:0/211161159 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7efdd406ce70 0x7efdd406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:34.945 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.942+0000 7efde8ff9700 1 -- 172.21.15.63:0/211161159 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6500+0+0 (secure 0 0 0) 0x7efde008bfe0 con 0x7efdec1034f0 2023-12-12T11:59:34.945 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.942+0000 7efdebfff700 1 --2- 172.21.15.63:0/211161159 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7efdd406ce70 0x7efdd406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:34.945 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.943+0000 7efdebfff700 1 --2- 172.21.15.63:0/211161159 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7efdd406ce70 0x7efdd406f320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efddc009fd0 tx=0x7efddc009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:59:34.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:34.947+0000 7efde8ff9700 1 -- 172.21.15.63:0/211161159 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7efde00598b0 con 0x7efdec1034f0 2023-12-12T11:59:35.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.161+0000 7efdf25ff700 1 -- 172.21.15.63:0/211161159 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efdec110bc0 con 0x7efdec1034f0 2023-12-12T11:59:35.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.161+0000 7efde8ff9700 1 -- 172.21.15.63:0/211161159 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7efdec110bc0 con 0x7efdec1034f0 2023-12-12T11:59:35.164 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-12T11:59:35.166 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.163+0000 7efdf25ff700 1 -- 172.21.15.63:0/211161159 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7efdd406ce70 msgr2=0x7efdd406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:35.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.163+0000 7efdf25ff700 1 --2- 172.21.15.63:0/211161159 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7efdd406ce70 0x7efdd406f320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efddc009fd0 tx=0x7efddc009e30 comp rx=0 tx=0).stop 2023-12-12T11:59:35.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.163+0000 7efdf25ff700 1 -- 172.21.15.63:0/211161159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdec1034f0 msgr2=0x7efdec115a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:35.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.163+0000 7efdf25ff700 1 --2- 172.21.15.63:0/211161159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdec1034f0 0x7efdec115a40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efde000eb40 tx=0x7efde000b040 comp rx=0 tx=0).stop 2023-12-12T11:59:35.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.164+0000 7efdf25ff700 1 -- 172.21.15.63:0/211161159 shutdown_connections 2023-12-12T11:59:35.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.164+0000 7efdf25ff700 1 --2- 172.21.15.63:0/211161159 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7efdd406ce70 0x7efdd406f320 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:35.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.164+0000 7efdf25ff700 1 --2- 172.21.15.63:0/211161159 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efdec102b50 0x7efdec115500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:35.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.164+0000 7efdf25ff700 1 --2- 172.21.15.63:0/211161159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efdec1034f0 0x7efdec115a40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:35.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.164+0000 7efdf25ff700 1 -- 172.21.15.63:0/211161159 >> 172.21.15.63:0/211161159 conn(0x7efdec0f8700 msgr2=0x7efdec0f9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:59:35.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.164+0000 7efdf25ff700 1 -- 172.21.15.63:0/211161159 shutdown_connections 2023-12-12T11:59:35.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.164+0000 7efdf25ff700 1 -- 172.21.15.63:0/211161159 wait complete. 2023-12-12T11:59:35.185 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-12T11:59:35.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.384+0000 7f5062bff700 1 -- 172.21.15.63:0/1657117882 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f505c1034e0 msgr2=0x7f505c0fcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:35.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.384+0000 7f5062bff700 1 --2- 172.21.15.63:0/1657117882 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f505c1034e0 0x7f505c0fcb50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5048004940 tx=0x7f5048009e30 comp rx=0 tx=0).stop 2023-12-12T11:59:35.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.384+0000 7f5062bff700 1 -- 172.21.15.63:0/1657117882 shutdown_connections 2023-12-12T11:59:35.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.384+0000 7f5062bff700 1 --2- 172.21.15.63:0/1657117882 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f505c1034e0 0x7f505c0fcb50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:35.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.384+0000 7f5062bff700 1 --2- 172.21.15.63:0/1657117882 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f505c102b40 0x7f505c102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:35.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.384+0000 7f5062bff700 1 -- 172.21.15.63:0/1657117882 >> 172.21.15.63:0/1657117882 conn(0x7f505c0f86d0 msgr2=0x7f505c0faae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:59:35.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.384+0000 7f5062bff700 1 -- 172.21.15.63:0/1657117882 shutdown_connections 2023-12-12T11:59:35.388 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.384+0000 7f5062bff700 1 -- 172.21.15.63:0/1657117882 wait complete. 2023-12-12T11:59:35.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.385+0000 7f5062bff700 1 Processor -- start 2023-12-12T11:59:35.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.385+0000 7f5062bff700 1 -- start start 2023-12-12T11:59:35.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.385+0000 7f5062bff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f505c102b40 0x7f505c115540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:35.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.385+0000 7f5062bff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f505c1034e0 0x7f505c115a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:35.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.385+0000 7f5062bff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505c1160d0 con 0x7f505c1034e0 2023-12-12T11:59:35.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.385+0000 7f5062bff700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505c10f610 con 0x7f505c102b40 2023-12-12T11:59:35.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.385+0000 7f505bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f505c1034e0 0x7f505c115a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:35.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.386+0000 7f505bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f505c1034e0 0x7f505c115a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42528/0 (socket says 172.21.15.63:42528) 2023-12-12T11:59:35.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.386+0000 7f505bfff700 1 -- 172.21.15.63:0/1358391672 learned_addr learned my addr 172.21.15.63:0/1358391672 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:59:35.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.386+0000 7f506099b700 1 --2- 172.21.15.63:0/1358391672 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f505c102b40 0x7f505c115540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:35.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.386+0000 7f505bfff700 1 -- 172.21.15.63:0/1358391672 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f505c102b40 msgr2=0x7f505c115540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:35.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.386+0000 7f505bfff700 1 --2- 172.21.15.63:0/1358391672 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f505c102b40 0x7f505c115540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:35.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.386+0000 7f505bfff700 1 -- 172.21.15.63:0/1358391672 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5048005040 con 0x7f505c1034e0 2023-12-12T11:59:35.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.386+0000 7f506099b700 1 --2- 172.21.15.63:0/1358391672 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f505c102b40 0x7f505c115540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T11:59:35.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.386+0000 7f505bfff700 1 --2- 172.21.15.63:0/1358391672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f505c1034e0 0x7f505c115a80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5048008d80 tx=0x7f5048009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:59:35.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.386+0000 7f50597fa700 1 -- 172.21.15.63:0/1358391672 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5048021070 con 0x7f505c1034e0 2023-12-12T11:59:35.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.386+0000 7f50597fa700 1 -- 172.21.15.63:0/1358391672 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f504801c400 con 0x7f505c1034e0 2023-12-12T11:59:35.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.386+0000 7f50597fa700 1 -- 172.21.15.63:0/1358391672 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f504800e070 con 0x7f505c1034e0 2023-12-12T11:59:35.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.386+0000 7f5062bff700 1 -- 172.21.15.63:0/1358391672 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f505c10f890 con 0x7f505c1034e0 2023-12-12T11:59:35.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.387+0000 7f5062bff700 1 -- 172.21.15.63:0/1358391672 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f505c10fdf0 con 0x7f505c1034e0 2023-12-12T11:59:35.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.388+0000 7f5062bff700 1 -- 172.21.15.63:0/1358391672 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f505c064730 con 0x7f505c1034e0 2023-12-12T11:59:35.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.389+0000 7f50597fa700 1 -- 172.21.15.63:0/1358391672 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f504801c950 con 0x7f505c1034e0 2023-12-12T11:59:35.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.390+0000 7f50597fa700 1 --2- 172.21.15.63:0/1358391672 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f504c06ce70 0x7f504c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:35.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.390+0000 7f50597fa700 1 -- 172.21.15.63:0/1358391672 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f504808d380 con 0x7f505c1034e0 2023-12-12T11:59:35.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.390+0000 7f506099b700 1 --2- 172.21.15.63:0/1358391672 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f504c06ce70 0x7f504c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:35.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.391+0000 7f506099b700 1 --2- 172.21.15.63:0/1358391672 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f504c06ce70 0x7f504c06f320 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5050004600 tx=0x7f505000b040 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:59:35.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.395+0000 7f50597fa700 1 -- 172.21.15.63:0/1358391672 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f504805adb0 con 0x7f505c1034e0 2023-12-12T11:59:35.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:35 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/232000011' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-12T11:59:35.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:35 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/232000011' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-12T11:59:35.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.608+0000 7f5062bff700 1 -- 172.21.15.63:0/1358391672 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f505c110060 con 0x7f505c1034e0 2023-12-12T11:59:35.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.609+0000 7f50597fa700 1 -- 172.21.15.63:0/1358391672 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v79) v1 ==== 107+0+11 (secure 0 0 0) 0x7f504805a940 con 0x7f505c1034e0 2023-12-12T11:59:35.612 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-12T11:59:35.614 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.611+0000 7f5062bff700 1 -- 172.21.15.63:0/1358391672 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f504c06ce70 msgr2=0x7f504c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:35.614 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.611+0000 7f5062bff700 1 --2- 172.21.15.63:0/1358391672 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f504c06ce70 0x7f504c06f320 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5050004600 tx=0x7f505000b040 comp rx=0 tx=0).stop 2023-12-12T11:59:35.614 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.611+0000 7f5062bff700 1 -- 172.21.15.63:0/1358391672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f505c1034e0 msgr2=0x7f505c115a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:35.614 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.611+0000 7f5062bff700 1 --2- 172.21.15.63:0/1358391672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f505c1034e0 0x7f505c115a80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5048008d80 tx=0x7f5048009e30 comp rx=0 tx=0).stop 2023-12-12T11:59:35.614 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.611+0000 7f5062bff700 1 -- 172.21.15.63:0/1358391672 shutdown_connections 2023-12-12T11:59:35.614 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.611+0000 7f5062bff700 1 --2- 172.21.15.63:0/1358391672 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f504c06ce70 0x7f504c06f320 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:35.614 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.611+0000 7f5062bff700 1 --2- 172.21.15.63:0/1358391672 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f505c102b40 0x7f505c115540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:35.615 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.611+0000 7f5062bff700 1 --2- 172.21.15.63:0/1358391672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f505c1034e0 0x7f505c115a80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:35.615 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.611+0000 7f5062bff700 1 -- 172.21.15.63:0/1358391672 >> 172.21.15.63:0/1358391672 conn(0x7f505c0f86d0 msgr2=0x7f505c0fa090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:59:35.615 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.611+0000 7f5062bff700 1 -- 172.21.15.63:0/1358391672 shutdown_connections 2023-12-12T11:59:35.615 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.611+0000 7f5062bff700 1 -- 172.21.15.63:0/1358391672 wait complete. 2023-12-12T11:59:35.632 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-12T11:59:35.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.837+0000 7f4f2c9ff700 1 -- 172.21.15.63:0/3482672581 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f28102b50 msgr2=0x7f4f28102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:35.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.837+0000 7f4f2c9ff700 1 --2- 172.21.15.63:0/3482672581 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f28102b50 0x7f4f28102f20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4f18004940 tx=0x7f4f18009e30 comp rx=0 tx=0).stop 2023-12-12T11:59:35.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.837+0000 7f4f2c9ff700 1 -- 172.21.15.63:0/3482672581 shutdown_connections 2023-12-12T11:59:35.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.837+0000 7f4f2c9ff700 1 --2- 172.21.15.63:0/3482672581 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4f281034f0 0x7f4f280fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:35.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.837+0000 7f4f2c9ff700 1 --2- 172.21.15.63:0/3482672581 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f28102b50 0x7f4f28102f20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:35.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.837+0000 7f4f2c9ff700 1 -- 172.21.15.63:0/3482672581 >> 172.21.15.63:0/3482672581 conn(0x7f4f280f8700 msgr2=0x7f4f280fab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:59:35.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.837+0000 7f4f2c9ff700 1 -- 172.21.15.63:0/3482672581 shutdown_connections 2023-12-12T11:59:35.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.837+0000 7f4f2c9ff700 1 -- 172.21.15.63:0/3482672581 wait complete. 2023-12-12T11:59:35.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.838+0000 7f4f2c9ff700 1 Processor -- start 2023-12-12T11:59:35.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.838+0000 7f4f2c9ff700 1 -- start start 2023-12-12T11:59:35.845 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.838+0000 7f4f2c9ff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4f28102b50 0x7f4f28113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:35.845 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.838+0000 7f4f2c9ff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f281034f0 0x7f4f281138c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:35.845 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.838+0000 7f4f2c9ff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f28113f10 con 0x7f4f281034f0 2023-12-12T11:59:35.845 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.838+0000 7f4f2c9ff700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2810d430 con 0x7f4f28102b50 2023-12-12T11:59:35.845 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.839+0000 7f4f25d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f281034f0 0x7f4f281138c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:35.845 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.839+0000 7f4f25d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f281034f0 0x7f4f281138c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42546/0 (socket says 172.21.15.63:42546) 2023-12-12T11:59:35.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.839+0000 7f4f25d9b700 1 -- 172.21.15.63:0/809763908 learned_addr learned my addr 172.21.15.63:0/809763908 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:59:35.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.839+0000 7f4f2659c700 1 --2- 172.21.15.63:0/809763908 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4f28102b50 0x7f4f28113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:35.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.839+0000 7f4f25d9b700 1 -- 172.21.15.63:0/809763908 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4f28102b50 msgr2=0x7f4f28113380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:35.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.839+0000 7f4f25d9b700 1 --2- 172.21.15.63:0/809763908 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4f28102b50 0x7f4f28113380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:35.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.839+0000 7f4f25d9b700 1 -- 172.21.15.63:0/809763908 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f18005040 con 0x7f4f281034f0 2023-12-12T11:59:35.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.839+0000 7f4f25d9b700 1 --2- 172.21.15.63:0/809763908 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f281034f0 0x7f4f281138c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c002a80 tx=0x7f4f1c004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:59:35.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.839+0000 7f4f16ffd700 1 -- 172.21.15.63:0/809763908 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f1c007cc0 con 0x7f4f281034f0 2023-12-12T11:59:35.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.839+0000 7f4f16ffd700 1 -- 172.21.15.63:0/809763908 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4f1c00f040 con 0x7f4f281034f0 2023-12-12T11:59:35.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.839+0000 7f4f2c9ff700 1 -- 172.21.15.63:0/809763908 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2810d710 con 0x7f4f281034f0 2023-12-12T11:59:35.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.839+0000 7f4f16ffd700 1 -- 172.21.15.63:0/809763908 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f1c00da40 con 0x7f4f281034f0 2023-12-12T11:59:35.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.840+0000 7f4f2c9ff700 1 -- 172.21.15.63:0/809763908 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2810dcd0 con 0x7f4f281034f0 2023-12-12T11:59:35.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.841+0000 7f4f2c9ff700 1 -- 172.21.15.63:0/809763908 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f280ffe60 con 0x7f4f281034f0 2023-12-12T11:59:35.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.842+0000 7f4f16ffd700 1 -- 172.21.15.63:0/809763908 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f4f1c00dbe0 con 0x7f4f281034f0 2023-12-12T11:59:35.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.842+0000 7f4f16ffd700 1 --2- 172.21.15.63:0/809763908 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f4f1006ce70 0x7f4f1006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:35.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.843+0000 7f4f16ffd700 1 -- 172.21.15.63:0/809763908 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f4f1c08ba30 con 0x7f4f281034f0 2023-12-12T11:59:35.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.843+0000 7f4f2659c700 1 --2- 172.21.15.63:0/809763908 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f4f1006ce70 0x7f4f1006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:35.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.843+0000 7f4f2659c700 1 --2- 172.21.15.63:0/809763908 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f4f1006ce70 0x7f4f1006f320 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800b020 tx=0x7f4f18009e30 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:59:35.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:35.847+0000 7f4f16ffd700 1 -- 172.21.15.63:0/809763908 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4f1c059320 con 0x7f4f281034f0 2023-12-12T11:59:36.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.056+0000 7f4f2c9ff700 1 -- 172.21.15.63:0/809763908 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f4f28064730 con 0x7f4f281034f0 2023-12-12T11:59:36.059 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.056+0000 7f4f16ffd700 1 -- 172.21.15.63:0/809763908 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v79) v1 ==== 107+0+11 (secure 0 0 0) 0x7f4f1c058eb0 con 0x7f4f281034f0 2023-12-12T11:59:36.059 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-12T11:59:36.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.059+0000 7f4f2c9ff700 1 -- 172.21.15.63:0/809763908 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f4f1006ce70 msgr2=0x7f4f1006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:36.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.059+0000 7f4f2c9ff700 1 --2- 172.21.15.63:0/809763908 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f4f1006ce70 0x7f4f1006f320 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800b020 tx=0x7f4f18009e30 comp rx=0 tx=0).stop 2023-12-12T11:59:36.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.059+0000 7f4f2c9ff700 1 -- 172.21.15.63:0/809763908 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f281034f0 msgr2=0x7f4f281138c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:36.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.059+0000 7f4f2c9ff700 1 --2- 172.21.15.63:0/809763908 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f281034f0 0x7f4f281138c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c002a80 tx=0x7f4f1c004630 comp rx=0 tx=0).stop 2023-12-12T11:59:36.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.059+0000 7f4f2c9ff700 1 -- 172.21.15.63:0/809763908 shutdown_connections 2023-12-12T11:59:36.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.059+0000 7f4f2c9ff700 1 --2- 172.21.15.63:0/809763908 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f4f1006ce70 0x7f4f1006f320 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:36.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.059+0000 7f4f2c9ff700 1 --2- 172.21.15.63:0/809763908 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4f28102b50 0x7f4f28113380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:36.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.059+0000 7f4f2c9ff700 1 --2- 172.21.15.63:0/809763908 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f281034f0 0x7f4f281138c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:36.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.059+0000 7f4f2c9ff700 1 -- 172.21.15.63:0/809763908 >> 172.21.15.63:0/809763908 conn(0x7f4f280f8700 msgr2=0x7f4f280fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:59:36.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.059+0000 7f4f2c9ff700 1 -- 172.21.15.63:0/809763908 shutdown_connections 2023-12-12T11:59:36.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.059+0000 7f4f2c9ff700 1 -- 172.21.15.63:0/809763908 wait complete. 2023-12-12T11:59:36.080 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T11:59:36.284 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.279+0000 7f0ac3fff700 1 -- 172.21.15.63:0/4238540585 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0abc0fe6f0 msgr2=0x7f0abc106d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:36.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.279+0000 7f0ac3fff700 1 --2- 172.21.15.63:0/4238540585 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0abc0fe6f0 0x7f0abc106d30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0aac004940 tx=0x7f0aac009e30 comp rx=0 tx=0).stop 2023-12-12T11:59:36.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.279+0000 7f0ac3fff700 1 -- 172.21.15.63:0/4238540585 shutdown_connections 2023-12-12T11:59:36.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.279+0000 7f0ac3fff700 1 --2- 172.21.15.63:0/4238540585 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0abc0fe6f0 0x7f0abc106d30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:36.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.279+0000 7f0ac3fff700 1 --2- 172.21.15.63:0/4238540585 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0abc0fdd50 0x7f0abc0fe120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:36.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.279+0000 7f0ac3fff700 1 -- 172.21.15.63:0/4238540585 >> 172.21.15.63:0/4238540585 conn(0x7f0abc0f7780 msgr2=0x7f0abc0f9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:59:36.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.279+0000 7f0ac3fff700 1 -- 172.21.15.63:0/4238540585 shutdown_connections 2023-12-12T11:59:36.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.279+0000 7f0ac3fff700 1 -- 172.21.15.63:0/4238540585 wait complete. 2023-12-12T11:59:36.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.280+0000 7f0ac3fff700 1 Processor -- start 2023-12-12T11:59:36.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.280+0000 7f0ac3fff700 1 -- start start 2023-12-12T11:59:36.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.280+0000 7f0ac3fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0abc0fdd50 0x7f0abc0fbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:36.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.280+0000 7f0ac3fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0abc0fe6f0 0x7f0abc0fc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:36.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.280+0000 7f0ac3fff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc0fc600 con 0x7f0abc0fe6f0 2023-12-12T11:59:36.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.280+0000 7f0ac3fff700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc0fc740 con 0x7f0abc0fdd50 2023-12-12T11:59:36.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.280+0000 7f0ac159a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0abc0fe6f0 0x7f0abc0fc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:36.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.280+0000 7f0ac159a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0abc0fe6f0 0x7f0abc0fc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42570/0 (socket says 172.21.15.63:42570) 2023-12-12T11:59:36.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.281+0000 7f0ac159a700 1 -- 172.21.15.63:0/115944956 learned_addr learned my addr 172.21.15.63:0/115944956 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-12T11:59:36.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.281+0000 7f0ac1d9b700 1 --2- 172.21.15.63:0/115944956 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0abc0fdd50 0x7f0abc0fbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:36.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.281+0000 7f0ac159a700 1 -- 172.21.15.63:0/115944956 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0abc0fdd50 msgr2=0x7f0abc0fbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:36.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.281+0000 7f0ac159a700 1 --2- 172.21.15.63:0/115944956 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0abc0fdd50 0x7f0abc0fbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:36.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.281+0000 7f0ac159a700 1 -- 172.21.15.63:0/115944956 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aac005040 con 0x7f0abc0fe6f0 2023-12-12T11:59:36.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.281+0000 7f0ac159a700 1 --2- 172.21.15.63:0/115944956 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0abc0fe6f0 0x7f0abc0fc0c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0aac000c00 tx=0x7f0aac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:59:36.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.281+0000 7f0ab27fc700 1 -- 172.21.15.63:0/115944956 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0aac021070 con 0x7f0abc0fe6f0 2023-12-12T11:59:36.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.281+0000 7f0ab27fc700 1 -- 172.21.15.63:0/115944956 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0aac01c400 con 0x7f0abc0fe6f0 2023-12-12T11:59:36.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.281+0000 7f0ac3fff700 1 -- 172.21.15.63:0/115944956 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0abc0fc9c0 con 0x7f0abc0fe6f0 2023-12-12T11:59:36.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.281+0000 7f0ab27fc700 1 -- 172.21.15.63:0/115944956 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0aac00e070 con 0x7f0abc0fe6f0 2023-12-12T11:59:36.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.282+0000 7f0ac3fff700 1 -- 172.21.15.63:0/115944956 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0abc119bd0 con 0x7f0abc0fe6f0 2023-12-12T11:59:36.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.283+0000 7f0ac3fff700 1 -- 172.21.15.63:0/115944956 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0abc104340 con 0x7f0abc0fe6f0 2023-12-12T11:59:36.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.284+0000 7f0ab27fc700 1 -- 172.21.15.63:0/115944956 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 36) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f0aac01c570 con 0x7f0abc0fe6f0 2023-12-12T11:59:36.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.285+0000 7f0ab27fc700 1 --2- 172.21.15.63:0/115944956 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f0aa806ce70 0x7f0aa806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T11:59:36.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.285+0000 7f0ab27fc700 1 -- 172.21.15.63:0/115944956 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f0aac08d540 con 0x7f0abc0fe6f0 2023-12-12T11:59:36.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.285+0000 7f0ac1d9b700 1 --2- 172.21.15.63:0/115944956 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f0aa806ce70 0x7f0aa806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T11:59:36.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.286+0000 7f0ac1d9b700 1 --2- 172.21.15.63:0/115944956 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f0aa806ce70 0x7f0aa806f320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8004600 tx=0x7f0ab800b040 comp rx=0 tx=0).ready entity=mgr.24663 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T11:59:36.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.290+0000 7f0ab27fc700 1 -- 172.21.15.63:0/115944956 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f0aac0573a0 con 0x7f0abc0fe6f0 2023-12-12T11:59:36.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:36 smithi093 ceph-mon[171709]: pgmap v198: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:36.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:36 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/211161159' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-12T11:59:36.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:36 smithi093 ceph-mon[171709]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:59:36.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:36 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/1358391672' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-12T11:59:36.471 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:36 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/809763908' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-12T11:59:36.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.522+0000 7f0ac3fff700 1 -- 172.21.15.63:0/115944956 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0abc064b80 con 0x7f0abc0fe6f0 2023-12-12T11:59:36.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.523+0000 7f0ab27fc700 1 -- 172.21.15.63:0/115944956 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 39 entries v79) v1 ==== 81+0+2292 (secure 0 0 0) 0x7f0aac01c820 con 0x7f0abc0fe6f0 2023-12-12T11:59:36.526 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6801/368827847 2023-12-13T11:54:05.314973+0000 2023-12-12T11:59:36.526 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6800/368827847 2023-12-13T11:54:05.314973+0000 2023-12-12T11:59:36.526 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.93:6828/3441331233 2023-12-13T11:52:56.821857+0000 2023-12-12T11:59:36.526 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6801/4048286824 2023-12-13T11:44:08.715291+0000 2023-12-12T11:59:36.527 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/2270429505 2023-12-13T11:44:08.715291+0000 2023-12-12T11:59:36.527 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6826/2809808942 2023-12-13T11:49:11.105112+0000 2023-12-12T11:59:36.527 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.93:0/1057256486 2023-12-13T11:52:56.821857+0000 2023-12-12T11:59:36.527 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/3710081653 2023-12-13T11:51:36.889322+0000 2023-12-12T11:59:36.527 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6800/1972453923 2023-12-13T11:43:38.661897+0000 2023-12-12T11:59:36.527 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/90805296 2023-12-13T11:43:38.661897+0000 2023-12-12T11:59:36.528 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/1747856225 2023-12-13T11:51:36.889322+0000 2023-12-12T11:59:36.528 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6800/3841315087 2023-12-13T11:51:36.889322+0000 2023-12-12T11:59:36.528 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/1972560506 2023-12-13T11:45:05.780140+0000 2023-12-12T11:59:36.528 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/3524404486 2023-12-13T11:43:38.661897+0000 2023-12-12T11:59:36.528 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6801/1972453923 2023-12-13T11:43:38.661897+0000 2023-12-12T11:59:36.529 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.93:0/343118333 2023-12-13T11:52:56.821857+0000 2023-12-12T11:59:36.529 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6827/2809808942 2023-12-13T11:49:11.105112+0000 2023-12-12T11:59:36.529 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/510113990 2023-12-13T11:54:05.314973+0000 2023-12-12T11:59:36.529 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.93:6829/3441331233 2023-12-13T11:52:56.821857+0000 2023-12-12T11:59:36.529 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6801/3841315087 2023-12-13T11:51:36.889322+0000 2023-12-12T11:59:36.529 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/1089809755 2023-12-13T11:43:38.661897+0000 2023-12-12T11:59:36.530 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/2339917683 2023-12-13T11:54:05.314973+0000 2023-12-12T11:59:36.530 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.93:0/707715378 2023-12-13T11:52:56.821857+0000 2023-12-12T11:59:36.530 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/49274924 2023-12-13T11:54:05.314973+0000 2023-12-12T11:59:36.530 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/2015988516 2023-12-13T11:45:05.780140+0000 2023-12-12T11:59:36.530 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/2136521491 2023-12-13T11:51:36.889322+0000 2023-12-12T11:59:36.531 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/1443572827 2023-12-13T11:45:05.780140+0000 2023-12-12T11:59:36.531 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6800/4048286824 2023-12-13T11:44:08.715291+0000 2023-12-12T11:59:36.531 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/545666177 2023-12-13T11:44:08.715291+0000 2023-12-12T11:59:36.531 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/2550373170 2023-12-13T11:51:36.889322+0000 2023-12-12T11:59:36.531 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/1601381023 2023-12-13T11:44:08.715291+0000 2023-12-12T11:59:36.531 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.93:0/4241774739 2023-12-13T11:52:56.821857+0000 2023-12-12T11:59:36.532 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.93:0/3779305150 2023-12-13T11:52:56.821857+0000 2023-12-12T11:59:36.532 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.93:0/3098682321 2023-12-13T11:52:56.821857+0000 2023-12-12T11:59:36.532 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6800/293571324 2023-12-13T11:45:05.780140+0000 2023-12-12T11:59:36.532 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/1083892159 2023-12-13T11:54:05.314973+0000 2023-12-12T11:59:36.532 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/1222084055 2023-12-13T11:54:05.314973+0000 2023-12-12T11:59:36.532 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6801/293571324 2023-12-13T11:45:05.780140+0000 2023-12-12T11:59:36.532 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/2627081339 2023-12-13T11:54:05.314973+0000 2023-12-12T11:59:36.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.525+0000 7f0ac3fff700 1 -- 172.21.15.63:0/115944956 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f0aa806ce70 msgr2=0x7f0aa806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:36.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.525+0000 7f0ac3fff700 1 --2- 172.21.15.63:0/115944956 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f0aa806ce70 0x7f0aa806f320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8004600 tx=0x7f0ab800b040 comp rx=0 tx=0).stop 2023-12-12T11:59:36.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.525+0000 7f0ac3fff700 1 -- 172.21.15.63:0/115944956 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0abc0fe6f0 msgr2=0x7f0abc0fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T11:59:36.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.525+0000 7f0ac3fff700 1 --2- 172.21.15.63:0/115944956 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0abc0fe6f0 0x7f0abc0fc0c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0aac000c00 tx=0x7f0aac009e30 comp rx=0 tx=0).stop 2023-12-12T11:59:36.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.525+0000 7f0ac3fff700 1 -- 172.21.15.63:0/115944956 shutdown_connections 2023-12-12T11:59:36.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.525+0000 7f0ac3fff700 1 --2- 172.21.15.63:0/115944956 >> [v2:172.21.15.63:6800/1308705199,v1:172.21.15.63:6801/1308705199] conn(0x7f0aa806ce70 0x7f0aa806f320 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:36.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.525+0000 7f0ac3fff700 1 --2- 172.21.15.63:0/115944956 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0abc0fdd50 0x7f0abc0fbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:36.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.525+0000 7f0ac3fff700 1 --2- 172.21.15.63:0/115944956 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0abc0fe6f0 0x7f0abc0fc0c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T11:59:36.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.525+0000 7f0ac3fff700 1 -- 172.21.15.63:0/115944956 >> 172.21.15.63:0/115944956 conn(0x7f0abc0f7780 msgr2=0x7f0abc1014c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T11:59:36.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.525+0000 7f0ac3fff700 1 -- 172.21.15.63:0/115944956 shutdown_connections 2023-12-12T11:59:36.536 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-12T11:59:36.525+0000 7f0ac3fff700 1 -- 172.21.15.63:0/115944956 wait complete. 2023-12-12T11:59:36.536 INFO:teuthology.orchestra.run.smithi063.stderr:listed 39 entries 2023-12-12T11:59:36.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:36 smithi063 ceph-mon[187282]: pgmap v198: 65 pgs: 65 active+clean; 197 MiB data, 779 MiB used, 536 GiB / 536 GiB avail 2023-12-12T11:59:36.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:36 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/211161159' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-12T11:59:36.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:36 smithi063 ceph-mon[187282]: from='mgr.24663 172.21.15.63:0/2980389053' entity='mgr.smithi063.zjnfdi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-12T11:59:36.544 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:36 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/1358391672' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-12T11:59:36.545 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:36 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/809763908' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-12T11:59:36.547 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-12T11:59:36.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:59:36.547 DEBUG:teuthology.orchestra.run.smithi093:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-12T11:59:36.677 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi093.front.sepia.ceph.com 2023-12-12T11:59:36.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:59:36.677 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-12T11:59:36.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:59:36.765 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2023-12-12T11:59:36.872 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-12T11:59:36.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:59:36.874 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T11:59:36.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:59:36.955 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link delete ceph-brx 2023-12-12T11:59:37.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:59:37.079 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list 2023-12-12T11:59:37.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-12T11:59:37.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:59:37.128 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T11:59:37.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T11:59:37.202 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link delete ceph-brx 2023-12-12T11:59:37.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:37 smithi063 ceph-mon[187282]: from='client.? 172.21.15.63:0/115944956' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-12T11:59:37.307 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-12-12T11:59:37.318 INFO:tasks.cephadm:Teardown begin 2023-12-12T11:59:37.319 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-12T11:59:37.393 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-12T11:59:37.456 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:37 smithi093 ceph-mon[171709]: from='client.? 172.21.15.63:0/115944956' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-12T11:59:37.464 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-12-12T11:59:37.465 DEBUG:teuthology.orchestra.run.smithi063:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-12T11:59:37.512 DEBUG:teuthology.orchestra.run.smithi093:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-12T11:59:37.558 INFO:tasks.cephadm:Stopping all daemons... 2023-12-12T11:59:37.559 INFO:tasks.cephadm.mon.smithi063:Stopping mon.smithi063... 2023-12-12T11:59:37.559 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-85e33c70-98e3-11ee-95a3-87774f69a715@mon.smithi063 2023-12-12T11:59:37.946 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:37 smithi063 systemd[1]: Stopping Ceph mon.smithi063 for 85e33c70-98e3-11ee-95a3-87774f69a715... 2023-12-12T11:59:38.294 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:37 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-mon-smithi063[187235]: 2023-12-12T11:59:37.943+0000 7f3de0b7f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi063 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-12T11:59:38.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:37 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-mon-smithi063[187235]: 2023-12-12T11:59:37.943+0000 7f3de0b7f700 -1 mon.smithi063@0(leader) e3 *** Got Signal Terminated *** 2023-12-12T11:59:38.678 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 12 11:59:38 smithi063 bash[220129]: ceph-85e33c70-98e3-11ee-95a3-87774f69a715-mon-smithi063 2023-12-12T11:59:38.703 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85e33c70-98e3-11ee-95a3-87774f69a715@mon.smithi063.service' 2023-12-12T11:59:38.809 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-12T11:59:38.809 INFO:tasks.cephadm.mon.smithi063:Stopped mon.smithi063 2023-12-12T11:59:38.810 INFO:tasks.cephadm.mon.smithi093:Stopping mon.smithi093... 2023-12-12T11:59:38.810 DEBUG:teuthology.orchestra.run.smithi093:> sudo systemctl stop ceph-85e33c70-98e3-11ee-95a3-87774f69a715@mon.smithi093 2023-12-12T11:59:39.174 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:38 smithi093 systemd[1]: Stopping Ceph mon.smithi093 for 85e33c70-98e3-11ee-95a3-87774f69a715... 2023-12-12T11:59:39.436 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:39 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-mon-smithi093[171686]: 2023-12-12T11:59:39.169+0000 7f3c6842d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi093 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-12T11:59:39.436 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:39 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-mon-smithi093[171686]: 2023-12-12T11:59:39.169+0000 7f3c6842d700 -1 mon.smithi093@1(peon) e3 *** Got Signal Terminated *** 2023-12-12T11:59:39.721 INFO:journalctl@ceph.mon.smithi093.smithi093.stdout:Dec 12 11:59:39 smithi093 bash[203216]: ceph-85e33c70-98e3-11ee-95a3-87774f69a715-mon-smithi093 2023-12-12T11:59:39.793 DEBUG:teuthology.orchestra.run.smithi093:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85e33c70-98e3-11ee-95a3-87774f69a715@mon.smithi093.service' 2023-12-12T11:59:39.888 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-12T11:59:39.889 INFO:tasks.cephadm.mon.smithi093:Stopped mon.smithi093 2023-12-12T11:59:39.889 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-12-12T11:59:39.889 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-85e33c70-98e3-11ee-95a3-87774f69a715@osd.0 2023-12-12T11:59:40.253 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:59:39 smithi063 systemd[1]: Stopping Ceph osd.0 for 85e33c70-98e3-11ee-95a3-87774f69a715... 2023-12-12T11:59:40.544 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:59:40 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-0[197453]: 2023-12-12T11:59:40.250+0000 7f2665e27700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-12T11:59:40.545 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:59:40 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-0[197453]: 2023-12-12T11:59:40.250+0000 7f2665e27700 -1 osd.0 79 *** Got signal Terminated *** 2023-12-12T11:59:40.545 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:59:40 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-0[197453]: 2023-12-12T11:59:40.250+0000 7f2665e27700 -1 osd.0 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-12T11:59:46.044 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 12 11:59:45 smithi063 bash[220288]: ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-0 2023-12-12T11:59:47.330 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85e33c70-98e3-11ee-95a3-87774f69a715@osd.0.service' 2023-12-12T11:59:47.423 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-12T11:59:47.423 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-12-12T11:59:47.423 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-12-12T11:59:47.423 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-85e33c70-98e3-11ee-95a3-87774f69a715@osd.1 2023-12-12T11:59:47.770 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:59:47 smithi063 systemd[1]: Stopping Ceph osd.1 for 85e33c70-98e3-11ee-95a3-87774f69a715... 2023-12-12T11:59:48.044 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:59:47 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-1[203959]: 2023-12-12T11:59:47.767+0000 7f644c17c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-12T11:59:48.045 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:59:47 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-1[203959]: 2023-12-12T11:59:47.767+0000 7f644c17c700 -1 osd.1 79 *** Got signal Terminated *** 2023-12-12T11:59:48.045 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:59:47 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-1[203959]: 2023-12-12T11:59:47.767+0000 7f644c17c700 -1 osd.1 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-12T11:59:53.795 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 12 11:59:53 smithi063 bash[220553]: ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-1 2023-12-12T11:59:54.927 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85e33c70-98e3-11ee-95a3-87774f69a715@osd.1.service' 2023-12-12T11:59:55.019 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-12T11:59:55.019 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-12-12T11:59:55.019 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-12-12T11:59:55.019 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-85e33c70-98e3-11ee-95a3-87774f69a715@osd.2 2023-12-12T11:59:55.294 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:59:55 smithi063 systemd[1]: Stopping Ceph osd.2 for 85e33c70-98e3-11ee-95a3-87774f69a715... 2023-12-12T11:59:55.794 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:59:55 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-2[210437]: 2023-12-12T11:59:55.340+0000 7f8145c76700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-12T11:59:55.795 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:59:55 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-2[210437]: 2023-12-12T11:59:55.340+0000 7f8145c76700 -1 osd.2 79 *** Got signal Terminated *** 2023-12-12T11:59:55.795 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 11:59:55 smithi063 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-2[210437]: 2023-12-12T11:59:55.340+0000 7f8145c76700 -1 osd.2 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-12T12:00:01.295 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 12 12:00:01 smithi063 bash[220815]: ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-2 2023-12-12T12:00:02.459 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85e33c70-98e3-11ee-95a3-87774f69a715@osd.2.service' 2023-12-12T12:00:02.552 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-12T12:00:02.552 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-12-12T12:00:02.552 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-12-12T12:00:02.552 DEBUG:teuthology.orchestra.run.smithi093:> sudo systemctl stop ceph-85e33c70-98e3-11ee-95a3-87774f69a715@osd.3 2023-12-12T12:00:02.901 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 12:00:02 smithi093 systemd[1]: Stopping Ceph osd.3 for 85e33c70-98e3-11ee-95a3-87774f69a715... 2023-12-12T12:00:03.221 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 12:00:02 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-3[184305]: 2023-12-12T12:00:02.898+0000 7fe9bbab9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-12T12:00:03.221 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 12:00:02 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-3[184305]: 2023-12-12T12:00:02.898+0000 7fe9bbab9700 -1 osd.3 79 *** Got signal Terminated *** 2023-12-12T12:00:03.222 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 12:00:02 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-3[184305]: 2023-12-12T12:00:02.898+0000 7fe9bbab9700 -1 osd.3 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-12T12:00:06.971 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 12:00:06 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-4[190403]: 2023-12-12T12:00:06.535+0000 7fb01a481700 -1 osd.4 79 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-12T11:59:43.775916+0000 front 2023-12-12T11:59:43.775977+0000 (oldest deadline 2023-12-12T12:00:06.075956+0000) 2023-12-12T12:00:07.471 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 12:00:07 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-3[184305]: 2023-12-12T12:00:07.191+0000 7fe9b68b1700 -1 osd.3 79 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-12T11:59:42.366184+0000 front 2023-12-12T11:59:42.366231+0000 (oldest deadline 2023-12-12T12:00:06.466086+0000) 2023-12-12T12:00:07.472 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:07 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T12:00:07.318+0000 7fb00509d700 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-12T11:59:43.757543+0000 front 2023-12-12T11:59:43.757525+0000 (oldest deadline 2023-12-12T12:00:07.256984+0000) 2023-12-12T12:00:07.971 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 12:00:07 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-4[190403]: 2023-12-12T12:00:07.534+0000 7fb01a481700 -1 osd.4 79 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-12T11:59:43.775916+0000 front 2023-12-12T11:59:43.775977+0000 (oldest deadline 2023-12-12T12:00:06.075956+0000) 2023-12-12T12:00:08.721 INFO:journalctl@ceph.osd.3.smithi093.stdout:Dec 12 12:00:08 smithi093 bash[203368]: ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-3 2023-12-12T12:00:08.722 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 12:00:08 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-4[190403]: 2023-12-12T12:00:08.514+0000 7fb01a481700 -1 osd.4 79 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-12T11:59:43.775916+0000 front 2023-12-12T11:59:43.775977+0000 (oldest deadline 2023-12-12T12:00:06.075956+0000) 2023-12-12T12:00:08.722 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:08 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T12:00:08.366+0000 7fb00509d700 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-12T11:59:43.757543+0000 front 2023-12-12T11:59:43.757525+0000 (oldest deadline 2023-12-12T12:00:07.256984+0000) 2023-12-12T12:00:09.471 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:09 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T12:00:09.340+0000 7fb00509d700 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-12T11:59:43.757543+0000 front 2023-12-12T11:59:43.757525+0000 (oldest deadline 2023-12-12T12:00:07.256984+0000) 2023-12-12T12:00:09.817 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 12:00:09 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-4[190403]: 2023-12-12T12:00:09.496+0000 7fb01a481700 -1 osd.4 79 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-12T11:59:43.775916+0000 front 2023-12-12T11:59:43.775977+0000 (oldest deadline 2023-12-12T12:00:06.075956+0000) 2023-12-12T12:00:09.998 DEBUG:teuthology.orchestra.run.smithi093:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85e33c70-98e3-11ee-95a3-87774f69a715@osd.3.service' 2023-12-12T12:00:10.088 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-12T12:00:10.088 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-12-12T12:00:10.088 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-12-12T12:00:10.089 DEBUG:teuthology.orchestra.run.smithi093:> sudo systemctl stop ceph-85e33c70-98e3-11ee-95a3-87774f69a715@osd.4 2023-12-12T12:00:10.417 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 12:00:10 smithi093 systemd[1]: Stopping Ceph osd.4 for 85e33c70-98e3-11ee-95a3-87774f69a715... 2023-12-12T12:00:10.417 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:10 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T12:00:10.303+0000 7fb00509d700 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-12T11:59:43.757543+0000 front 2023-12-12T11:59:43.757525+0000 (oldest deadline 2023-12-12T12:00:07.256984+0000) 2023-12-12T12:00:10.721 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 12:00:10 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-4[190403]: 2023-12-12T12:00:10.414+0000 7fb02168d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-12T12:00:10.721 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 12:00:10 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-4[190403]: 2023-12-12T12:00:10.414+0000 7fb02168d700 -1 osd.4 79 *** Got signal Terminated *** 2023-12-12T12:00:10.721 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 12:00:10 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-4[190403]: 2023-12-12T12:00:10.414+0000 7fb02168d700 -1 osd.4 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-12T12:00:10.721 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 12:00:10 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-4[190403]: 2023-12-12T12:00:10.483+0000 7fb01a481700 -1 osd.4 79 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-12T11:59:43.775916+0000 front 2023-12-12T11:59:43.775977+0000 (oldest deadline 2023-12-12T12:00:06.075956+0000) 2023-12-12T12:00:11.721 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 12:00:11 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-4[190403]: 2023-12-12T12:00:11.503+0000 7fb01a481700 -1 osd.4 79 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-12T11:59:43.775916+0000 front 2023-12-12T11:59:43.775977+0000 (oldest deadline 2023-12-12T12:00:06.075956+0000) 2023-12-12T12:00:11.721 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:11 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T12:00:11.302+0000 7fb00509d700 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-12T11:59:43.757543+0000 front 2023-12-12T11:59:43.757525+0000 (oldest deadline 2023-12-12T12:00:07.256984+0000) 2023-12-12T12:00:12.721 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 12:00:12 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-4[190403]: 2023-12-12T12:00:12.501+0000 7fb01a481700 -1 osd.4 79 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-12T11:59:43.775916+0000 front 2023-12-12T11:59:43.775977+0000 (oldest deadline 2023-12-12T12:00:06.075956+0000) 2023-12-12T12:00:12.721 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:12 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T12:00:12.288+0000 7fb00509d700 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-12T11:59:43.757543+0000 front 2023-12-12T11:59:43.757525+0000 (oldest deadline 2023-12-12T12:00:07.256984+0000) 2023-12-12T12:00:13.721 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 12:00:13 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-4[190403]: 2023-12-12T12:00:13.549+0000 7fb01a481700 -1 osd.4 79 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-12T11:59:43.775916+0000 front 2023-12-12T11:59:43.775977+0000 (oldest deadline 2023-12-12T12:00:06.075956+0000) 2023-12-12T12:00:13.721 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:13 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T12:00:13.313+0000 7fb00509d700 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-12T11:59:43.757543+0000 front 2023-12-12T11:59:43.757525+0000 (oldest deadline 2023-12-12T12:00:07.256984+0000) 2023-12-12T12:00:14.721 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 12:00:14 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-4[190403]: 2023-12-12T12:00:14.549+0000 7fb01a481700 -1 osd.4 79 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-12T11:59:43.775916+0000 front 2023-12-12T11:59:43.775977+0000 (oldest deadline 2023-12-12T12:00:06.075956+0000) 2023-12-12T12:00:14.721 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:14 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T12:00:14.354+0000 7fb00509d700 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-12T11:59:43.757543+0000 front 2023-12-12T11:59:43.757525+0000 (oldest deadline 2023-12-12T12:00:07.256984+0000) 2023-12-12T12:00:14.721 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:14 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T12:00:14.354+0000 7fb00509d700 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.63:6814 osd.1 since back 2023-12-12T11:59:51.358222+0000 front 2023-12-12T11:59:51.358136+0000 (oldest deadline 2023-12-12T12:00:13.658113+0000) 2023-12-12T12:00:15.721 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:15 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T12:00:15.320+0000 7fb00509d700 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-12T11:59:43.757543+0000 front 2023-12-12T11:59:43.757525+0000 (oldest deadline 2023-12-12T12:00:07.256984+0000) 2023-12-12T12:00:15.721 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:15 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T12:00:15.320+0000 7fb00509d700 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.63:6814 osd.1 since back 2023-12-12T11:59:51.358222+0000 front 2023-12-12T11:59:51.358136+0000 (oldest deadline 2023-12-12T12:00:13.658113+0000) 2023-12-12T12:00:16.471 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 12 12:00:16 smithi093 bash[203633]: ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-4 2023-12-12T12:00:16.472 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:16 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T12:00:16.286+0000 7fb00509d700 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-12T11:59:43.757543+0000 front 2023-12-12T11:59:43.757525+0000 (oldest deadline 2023-12-12T12:00:07.256984+0000) 2023-12-12T12:00:16.472 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:16 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T12:00:16.286+0000 7fb00509d700 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.63:6814 osd.1 since back 2023-12-12T11:59:51.358222+0000 front 2023-12-12T11:59:51.358136+0000 (oldest deadline 2023-12-12T12:00:13.658113+0000) 2023-12-12T12:00:17.653 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:17 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T12:00:17.283+0000 7fb00509d700 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-12T11:59:43.757543+0000 front 2023-12-12T11:59:43.757525+0000 (oldest deadline 2023-12-12T12:00:07.256984+0000) 2023-12-12T12:00:17.654 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:17 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T12:00:17.283+0000 7fb00509d700 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.63:6814 osd.1 since back 2023-12-12T11:59:51.358222+0000 front 2023-12-12T11:59:51.358136+0000 (oldest deadline 2023-12-12T12:00:13.658113+0000) 2023-12-12T12:00:17.676 DEBUG:teuthology.orchestra.run.smithi093:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85e33c70-98e3-11ee-95a3-87774f69a715@osd.4.service' 2023-12-12T12:00:17.769 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-12T12:00:17.769 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-12-12T12:00:17.769 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-12-12T12:00:17.769 DEBUG:teuthology.orchestra.run.smithi093:> sudo systemctl stop ceph-85e33c70-98e3-11ee-95a3-87774f69a715@osd.5 2023-12-12T12:00:17.971 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:17 smithi093 systemd[1]: Stopping Ceph osd.5 for 85e33c70-98e3-11ee-95a3-87774f69a715... 2023-12-12T12:00:18.471 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:18 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T12:00:18.105+0000 7fb00c2a9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-12T12:00:18.471 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:18 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T12:00:18.105+0000 7fb00c2a9700 -1 osd.5 79 *** Got signal Terminated *** 2023-12-12T12:00:18.471 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:18 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T12:00:18.105+0000 7fb00c2a9700 -1 osd.5 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-12T12:00:18.472 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:18 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T12:00:18.333+0000 7fb00509d700 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-12T11:59:43.757543+0000 front 2023-12-12T11:59:43.757525+0000 (oldest deadline 2023-12-12T12:00:07.256984+0000) 2023-12-12T12:00:18.472 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:18 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T12:00:18.333+0000 7fb00509d700 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.63:6814 osd.1 since back 2023-12-12T11:59:51.358222+0000 front 2023-12-12T11:59:51.358136+0000 (oldest deadline 2023-12-12T12:00:13.658113+0000) 2023-12-12T12:00:19.721 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:19 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T12:00:19.293+0000 7fb00509d700 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-12T11:59:43.757543+0000 front 2023-12-12T11:59:43.757525+0000 (oldest deadline 2023-12-12T12:00:07.256984+0000) 2023-12-12T12:00:19.721 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:19 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T12:00:19.293+0000 7fb00509d700 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.63:6814 osd.1 since back 2023-12-12T11:59:51.358222+0000 front 2023-12-12T11:59:51.358136+0000 (oldest deadline 2023-12-12T12:00:13.658113+0000) 2023-12-12T12:00:20.721 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:20 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T12:00:20.307+0000 7fb00509d700 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-12T11:59:43.757543+0000 front 2023-12-12T11:59:43.757525+0000 (oldest deadline 2023-12-12T12:00:07.256984+0000) 2023-12-12T12:00:20.721 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:20 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T12:00:20.307+0000 7fb00509d700 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.63:6814 osd.1 since back 2023-12-12T11:59:51.358222+0000 front 2023-12-12T11:59:51.358136+0000 (oldest deadline 2023-12-12T12:00:13.658113+0000) 2023-12-12T12:00:21.724 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:21 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T12:00:21.271+0000 7fb00509d700 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-12T11:59:43.757543+0000 front 2023-12-12T11:59:43.757525+0000 (oldest deadline 2023-12-12T12:00:07.256984+0000) 2023-12-12T12:00:21.724 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:21 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T12:00:21.271+0000 7fb00509d700 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.63:6814 osd.1 since back 2023-12-12T11:59:51.358222+0000 front 2023-12-12T11:59:51.358136+0000 (oldest deadline 2023-12-12T12:00:13.658113+0000) 2023-12-12T12:00:22.721 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:22 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T12:00:22.224+0000 7fb00509d700 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-12T11:59:43.757543+0000 front 2023-12-12T11:59:43.757525+0000 (oldest deadline 2023-12-12T12:00:07.256984+0000) 2023-12-12T12:00:22.721 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:22 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T12:00:22.224+0000 7fb00509d700 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.63:6814 osd.1 since back 2023-12-12T11:59:51.358222+0000 front 2023-12-12T11:59:51.358136+0000 (oldest deadline 2023-12-12T12:00:13.658113+0000) 2023-12-12T12:00:22.721 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:22 smithi093 ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5[197075]: 2023-12-12T12:00:22.224+0000 7fb00509d700 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.63:6822 osd.2 since back 2023-12-12T11:59:56.559052+0000 front 2023-12-12T11:59:56.558987+0000 (oldest deadline 2023-12-12T12:00:21.859039+0000) 2023-12-12T12:00:23.971 INFO:journalctl@ceph.osd.5.smithi093.stdout:Dec 12 12:00:23 smithi093 bash[203897]: ceph-85e33c70-98e3-11ee-95a3-87774f69a715-osd-5 2023-12-12T12:00:25.197 DEBUG:teuthology.orchestra.run.smithi093:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85e33c70-98e3-11ee-95a3-87774f69a715@osd.5.service' 2023-12-12T12:00:25.288 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-12T12:00:25.288 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-12-12T12:00:25.288 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 --force --keep-logs 2023-12-12T12:00:45.903 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 --force --keep-logs 2023-12-12T12:00:58.229 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-12T12:00:58.311 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-12T12:00:58.384 INFO:tasks.cephadm:Archiving crash dumps... 2023-12-12T12:00:58.387 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/crash to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488285/remote/smithi063/crash 2023-12-12T12:00:58.388 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/crash -- . 2023-12-12T12:00:58.460 INFO:teuthology.orchestra.run.smithi063.stderr:tar: /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/crash: Cannot open: No such file or directory 2023-12-12T12:00:58.460 INFO:teuthology.orchestra.run.smithi063.stderr:tar: Error is not recoverable: exiting now 2023-12-12T12:00:58.463 DEBUG:teuthology.misc:Transferring archived files from smithi093:/var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/crash to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488285/remote/smithi093/crash 2023-12-12T12:00:58.464 DEBUG:teuthology.orchestra.run.smithi093:> sudo tar c -f - -C /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/crash -- . 2023-12-12T12:00:58.531 INFO:teuthology.orchestra.run.smithi093.stderr:tar: /var/lib/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/crash: Cannot open: No such file or directory 2023-12-12T12:00:58.531 INFO:teuthology.orchestra.run.smithi093.stderr:tar: Error is not recoverable: exiting now 2023-12-12T12:00:58.533 INFO:tasks.cephadm:Checking cluster log for badness... 2023-12-12T12:00:58.534 DEBUG:teuthology.orchestra.run.smithi063:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-12T12:00:58.614 INFO:teuthology.orchestra.run.smithi063.stderr:grep: /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph.log: No such file or directory 2023-12-12T12:00:58.619 INFO:tasks.cephadm:Compressing logs... 2023-12-12T12:00:58.619 DEBUG:teuthology.orchestra.run.smithi063:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-12T12:00:58.623 DEBUG:teuthology.orchestra.run.smithi093:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-12T12:00:58.689 INFO:teuthology.orchestra.run.smithi063.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-12-12T12:00:58.689 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-12T12:00:58.690 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-mon.smithi063.log 2023-12-12T12:00:58.690 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-volume.log 2023-12-12T12:00:58.692 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-mon.smithi063.log: gzip -5 --verbose -- /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-osd.2.log 2023-12-12T12:00:58.692 INFO:teuthology.orchestra.run.smithi093.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-12T12:00:58.693 INFO:teuthology.orchestra.run.smithi093.stderr:: No such file or directory 2023-12-12T12:00:58.693 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi093.swdqms.log 2023-12-12T12:00:58.694 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi063.aevpzg.log 2023-12-12T12:00:58.694 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-volume.log 2023-12-12T12:00:58.695 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi093.swdqms.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-12T12:00:58.696 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-osd.0.log 2023-12-12T12:00:58.696 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-mgr.smithi093.nbtltu.log 2023-12-12T12:00:58.697 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-osd.3.log 2023-12-12T12:00:58.697 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi063.aevpzg.log: gzip -5 --verbose -- /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-mgr.smithi063.zjnfdi.log 2023-12-12T12:00:58.698 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-mgr.smithi093.nbtltu.log: gzip -5 --verbose -- /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-osd.4.log 2023-12-12T12:00:58.698 INFO:teuthology.orchestra.run.smithi093.stderr: 94.2% -- replaced with /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi093.swdqms.log.gz 2023-12-12T12:00:58.699 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-osd.5.log 2023-12-12T12:00:58.699 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi063.bdqbnp.log 2023-12-12T12:00:58.700 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi093.rhaqsh.log 2023-12-12T12:00:58.702 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-mgr.smithi063.zjnfdi.log: /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi063.bdqbnp.log: 91.2% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-12T12:00:58.702 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-osd.1.log 2023-12-12T12:00:58.703 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-mon.smithi093.log 2023-12-12T12:00:58.705 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-osd.1.log: 90.6% -- replaced with /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-volume.log.gz 2023-12-12T12:00:58.706 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi093.rhaqsh.log: /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-mon.smithi093.log: 90.8% -- replaced with /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-volume.log.gz 2023-12-12T12:00:58.707 INFO:teuthology.orchestra.run.smithi093.stderr: 94.2% -- replaced with /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi093.rhaqsh.log.gz 2023-12-12T12:00:58.713 INFO:teuthology.orchestra.run.smithi063.stderr: 91.5% -- replaced with /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi063.bdqbnp.log.gz 2023-12-12T12:00:58.741 INFO:teuthology.orchestra.run.smithi093.stderr: 88.4% -- replaced with /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-mgr.smithi093.nbtltu.log.gz 2023-12-12T12:00:58.929 INFO:teuthology.orchestra.run.smithi093.stderr: 92.5% -- replaced with /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-mon.smithi093.log.gz 2023-12-12T12:00:58.994 INFO:teuthology.orchestra.run.smithi063.stderr: 88.2% -- replaced with /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-mgr.smithi063.zjnfdi.log.gz 2023-12-12T12:00:59.374 INFO:teuthology.orchestra.run.smithi063.stderr: 90.6% -- replaced with /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-mon.smithi063.log.gz 2023-12-12T12:01:03.086 INFO:teuthology.orchestra.run.smithi093.stderr: 93.3% -- replaced with /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-osd.4.log.gz 2023-12-12T12:01:03.508 INFO:teuthology.orchestra.run.smithi063.stderr: 93.5% -- replaced with /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-osd.2.log.gz 2023-12-12T12:01:04.432 INFO:teuthology.orchestra.run.smithi063.stderr: 93.4% -- replaced with /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-osd.0.log.gz 2023-12-12T12:01:04.519 INFO:teuthology.orchestra.run.smithi093.stderr: 93.4% -- replaced with /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-osd.5.log.gz 2023-12-12T12:01:04.937 INFO:teuthology.orchestra.run.smithi063.stderr: 93.4% -- replaced with /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-osd.1.log.gz 2023-12-12T12:01:05.140 INFO:teuthology.orchestra.run.smithi093.stderr: 93.4% -- replaced with /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-osd.3.log.gz 2023-12-12T12:01:05.143 INFO:teuthology.orchestra.run.smithi093.stderr: 2023-12-12T12:01:05.143 INFO:teuthology.orchestra.run.smithi093.stderr:real 0m6.476s 2023-12-12T12:01:05.144 INFO:teuthology.orchestra.run.smithi093.stderr:user 0m15.623s 2023-12-12T12:01:05.144 INFO:teuthology.orchestra.run.smithi093.stderr:sys 0m1.382s 2023-12-12T12:02:33.601 INFO:teuthology.orchestra.run.smithi063.stderr: 92.6% -- replaced with /var/log/ceph/85e33c70-98e3-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi063.aevpzg.log.gz 2023-12-12T12:02:33.603 INFO:teuthology.orchestra.run.smithi063.stderr: 2023-12-12T12:02:33.603 INFO:teuthology.orchestra.run.smithi063.stderr:real 1m34.940s 2023-12-12T12:02:33.603 INFO:teuthology.orchestra.run.smithi063.stderr:user 1m45.002s 2023-12-12T12:02:33.603 INFO:teuthology.orchestra.run.smithi063.stderr:sys 0m7.765s 2023-12-12T12:02:33.605 INFO:tasks.cephadm:Archiving logs... 2023-12-12T12:02:33.605 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/log/ceph to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488285/remote/smithi063/log 2023-12-12T12:02:33.606 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-12T12:02:49.428 DEBUG:teuthology.misc:Transferring archived files from smithi093:/var/log/ceph to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488285/remote/smithi093/log 2023-12-12T12:02:49.429 DEBUG:teuthology.orchestra.run.smithi093:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-12T12:02:51.849 INFO:tasks.cephadm:Removing cluster... 2023-12-12T12:02:51.850 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 --force 2023-12-12T12:02:53.011 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 --force 2023-12-12T12:02:53.834 INFO:tasks.cephadm:Removing cephadm ... 2023-12-12T12:02:53.834 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-12T12:02:53.885 DEBUG:teuthology.orchestra.run.smithi093:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-12T12:02:53.933 INFO:tasks.cephadm:Teardown complete 2023-12-12T12:02:53.934 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-12T12:02:53.945 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-12T12:02:53.946 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-12T12:02:53.951 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-12T12:02:54.075 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-12T12:02:54.091 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-12T12:02:54.091 DEBUG:teuthology.orchestra.run.smithi063:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-12T12:02:54.096 DEBUG:teuthology.orchestra.run.smithi093:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-12T12:02:54.137 INFO:teuthology.orchestra.run.smithi063.stderr:bash: ntpq: command not found 2023-12-12T12:02:54.141 INFO:teuthology.orchestra.run.smithi093.stderr:bash: ntpq: command not found 2023-12-12T12:02:54.145 INFO:teuthology.orchestra.run.smithi063.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-12T12:02:54.145 INFO:teuthology.orchestra.run.smithi063.stdout:=============================================================================== 2023-12-12T12:02:54.145 INFO:teuthology.orchestra.run.smithi063.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 52 +1630us[+1630us] +/- 90ms 2023-12-12T12:02:54.145 INFO:teuthology.orchestra.run.smithi063.stdout:^* hv02.front.sepia.ceph.com 3 7 377 118 -798us[ -786us] +/- 55ms 2023-12-12T12:02:54.146 INFO:teuthology.orchestra.run.smithi063.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 52 -287us[ -287us] +/- 86ms 2023-12-12T12:02:54.146 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T12:02:54.148 INFO:teuthology.orchestra.run.smithi093.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-12T12:02:54.148 INFO:teuthology.orchestra.run.smithi093.stdout:=============================================================================== 2023-12-12T12:02:54.148 INFO:teuthology.orchestra.run.smithi093.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 51 +1702us[+1702us] +/- 90ms 2023-12-12T12:02:54.148 INFO:teuthology.orchestra.run.smithi093.stdout:^* hv02.front.sepia.ceph.com 3 7 377 119 -779us[ -777us] +/- 55ms 2023-12-12T12:02:54.148 INFO:teuthology.orchestra.run.smithi093.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 52 -290us[ -290us] +/- 86ms 2023-12-12T12:02:54.149 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T12:02:54.150 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-12T12:02:54.164 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-12T12:02:54.165 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-12T12:02:54.181 DEBUG:teuthology.orchestra.run.smithi063:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-12T12:02:54.363 DEBUG:teuthology.orchestra.run.smithi093:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-12T12:02:54.531 DEBUG:teuthology.orchestra.run.smithi063:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-12T12:02:54.610 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T12:02:54.611 DEBUG:teuthology.orchestra.run.smithi093:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-12T12:02:54.687 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T12:02:54.688 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-12T12:02:54.700 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-12T12:02:54.751 INFO:teuthology.task.internal:Duration was 2123.238233 seconds 2023-12-12T12:02:54.751 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-12T12:02:54.766 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-12T12:02:54.766 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-12T12:02:54.771 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-12T12:02:54.887 INFO:teuthology.orchestra.run.smithi063.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-12T12:02:54.889 INFO:teuthology.orchestra.run.smithi093.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-12T12:02:55.326 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-12T12:02:55.326 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi063.front.sepia.ceph.com 2023-12-12T12:02:55.327 DEBUG:teuthology.orchestra.run.smithi063:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-12T12:02:55.390 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi093.front.sepia.ceph.com 2023-12-12T12:02:55.390 DEBUG:teuthology.orchestra.run.smithi093:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-12T12:02:55.454 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-12T12:02:55.454 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-12T12:02:55.459 DEBUG:teuthology.orchestra.run.smithi093:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-12T12:02:55.563 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-12T12:02:55.563 DEBUG:teuthology.orchestra.run.smithi063:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-12T12:02:55.568 DEBUG:teuthology.orchestra.run.smithi093:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-12T12:02:55.740 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-12T12:02:55.752 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-12T12:02:55.752 DEBUG:teuthology.orchestra.run.smithi063:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-12T12:02:55.824 DEBUG:teuthology.orchestra.run.smithi093:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-12T12:02:55.895 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-12T12:02:55.906 DEBUG:teuthology.orchestra.run.smithi063:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-12T12:02:55.911 DEBUG:teuthology.orchestra.run.smithi093:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-12T12:02:55.977 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = core 2023-12-12T12:02:55.980 INFO:teuthology.orchestra.run.smithi093.stdout:kernel.core_pattern = core 2023-12-12T12:02:56.014 DEBUG:teuthology.orchestra.run.smithi063:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-12T12:02:56.058 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T12:02:56.059 DEBUG:teuthology.orchestra.run.smithi093:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-12T12:02:56.104 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T12:02:56.105 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-12T12:02:56.124 INFO:teuthology.task.internal:Transferring archived files... 2023-12-12T12:02:56.125 DEBUG:teuthology.misc:Transferring archived files from smithi063:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488285/remote/smithi063 2023-12-12T12:02:56.125 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-12T12:02:56.212 DEBUG:teuthology.misc:Transferring archived files from smithi093:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488285/remote/smithi093 2023-12-12T12:02:56.212 DEBUG:teuthology.orchestra.run.smithi093:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-12T12:02:56.296 INFO:teuthology.task.internal:Removing archive directory... 2023-12-12T12:02:56.296 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-12T12:02:56.301 DEBUG:teuthology.orchestra.run.smithi093:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-12T12:02:56.347 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-12T12:02:56.361 INFO:teuthology.task.internal:Not uploading archives. 2023-12-12T12:02:56.361 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-12T12:02:56.373 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-12T12:02:56.373 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-12T12:02:56.388 DEBUG:teuthology.orchestra.run.smithi093:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-12T12:02:56.430 INFO:teuthology.orchestra.run.smithi063.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 12 12:02 /home/ubuntu/cephtest 2023-12-12T12:02:56.435 INFO:teuthology.orchestra.run.smithi093.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 12 12:02 /home/ubuntu/cephtest 2023-12-12T12:02:56.439 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-12T12:02:56.453 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-12T12:02:56.483 INFO:teuthology.nuke:Checking targets against current locks 2023-12-12T12:02:56.511 DEBUG:teuthology.nuke:shortname: smithi063 2023-12-12T12:02:56.512 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-12T12:02:56.543 DEBUG:teuthology.nuke:shortname: smithi093 2023-12-12T12:02:56.544 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-12T12:02:56.554 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi063.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488285', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 11:15:41.206340', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO01mRfwTFnLLqpMz4MuaRzsiv6dXKVKV2kivOnL3uTufca4/qmQSZUKBAsM9tCPrdRGR6Y+tef4W9ku/7awxQg='} 2023-12-12T12:02:56.582 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488285', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 11:15:41.207694', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNlaUBOyZRqFYnKLb8cCpbp8FibGz4MHdMFP2RQvBvGPhp3k/CYweWfdGRsm3qM0cMrdk+DHYtdnI9VQ+yyzCfA='} 2023-12-12T12:02:56.626 INFO:teuthology.orchestra.console.smithi063:Power off 2023-12-12T12:02:56.627 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-12T12:02:56.658 DEBUG:teuthology.orchestra.console.smithi063:power off output: Chassis Power Control: Down/Off 2023-12-12T12:02:56.659 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T12:02:56.676 INFO:teuthology.orchestra.console.smithi093:Power off 2023-12-12T12:02:56.677 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-12T12:02:56.686 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on 2023-12-12T12:02:56.700 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off 2023-12-12T12:02:56.701 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T12:02:56.725 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-12-12T12:03:00.687 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T12:03:00.727 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T12:03:00.798 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on 2023-12-12T12:03:00.836 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-12-12T12:03:04.801 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T12:03:04.837 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T12:03:04.913 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off 2023-12-12T12:03:04.947 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-12-12T12:03:05.015 INFO:teuthology.orchestra.console.smithi063:Power off completed 2023-12-12T12:03:08.952 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T12:03:09.062 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-12-12T12:03:09.162 INFO:teuthology.orchestra.console.smithi093:Power off completed 2023-12-12T12:03:09.269 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2123.2382328510284 failure_reason: 'Command failed on smithi063 with status 1: ''sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85e33c70-98e3-11ee-95a3-87774f69a715 -e sha1=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 -- bash -c \''ceph versions | jq -e \''"\''"\''.overall | length == 1\''"\''"\''\''''' flavor: default host.a-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c host.b-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c owner: mchangir sentry_event: https://sentry.ceph.com/organizations/ceph/?query=ff990d3c08d34f4f87d491753742ea65 status: fail success: false 2023-12-12T12:03:09.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T12:03:09.402 INFO:teuthology.run:FAIL